Oct 26 00:02:54 user nova-compute[75165]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=75165) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Oct 26 00:02:54 user nova-compute[75165]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=75165) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Oct 26 00:02:54 user nova-compute[75165]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=75165) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Oct 26 00:02:54 user nova-compute[75165]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Oct 26 00:02:54 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:02:54 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.021s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:02:54 user nova-compute[75165]: INFO nova.virt.driver [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] Loading compute driver 'libvirt.LibvirtDriver'
Oct 26 00:02:55 user nova-compute[75165]: INFO nova.compute.provider_config [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] Acquiring lock "singleton_lock" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] Acquired lock "singleton_lock" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] Releasing lock "singleton_lock" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] Full set of CONF: {{(pid=75165) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] ******************************************************************************** {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] Configuration options gathered from: {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] ================================================================================ {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] allow_resize_to_same_host      = True {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] arq_binding_timeout            = 300 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] backdoor_port                  = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] backdoor_socket                = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] block_device_allocate_retries  = 300 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] block_device_allocate_retries_interval = 5 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] cert                           = self.pem {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] compute_monitors               = [] {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] config_dir                     = [] {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] config_drive_format            = iso9660 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] config_source                  = [] {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] console_host                   = user {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] control_exchange               = nova {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] cpu_allocation_ratio           = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] daemon                         = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] debug                          = True {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] default_access_ip_network_name = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] default_availability_zone      = nova {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] default_ephemeral_format       = ext4 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] default_green_pool_size        = 1000 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] default_schedule_zone          = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] disk_allocation_ratio          = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] enable_new_services            = True {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] enabled_apis                   = ['osapi_compute'] {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] enabled_ssl_apis               = [] {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] flat_injected                  = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] force_config_drive             = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] force_raw_images               = True {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] graceful_shutdown_timeout      = 5 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] heal_instance_info_cache_interval = 60 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] host                           = user {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] instance_build_timeout         = 0 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] instance_delete_interval       = 300 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] instance_format                = [instance: %(uuid)s]  {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] instance_name_template         = instance-%08x {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] instance_usage_audit           = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] instance_usage_audit_period    = month {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] internal_service_availability_zone = internal {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] key                            = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] live_migration_retry_count     = 30 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] log_config_append              = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] log_dir                        = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] log_file                       = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] log_options                    = True {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] log_rotate_interval            = 1 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] log_rotate_interval_type       = days {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] log_rotation_type              = none {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] long_rpc_timeout               = 1800 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] max_concurrent_builds          = 10 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] max_concurrent_live_migrations = 1 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] max_concurrent_snapshots       = 5 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] max_local_block_devices        = 3 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] max_logfile_count              = 30 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] max_logfile_size_mb            = 200 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] maximum_instance_delete_attempts = 5 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] metadata_listen                = 0.0.0.0 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] metadata_listen_port           = 8775 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] metadata_workers               = 3 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] migrate_max_retries            = -1 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] mkisofs_cmd                    = genisoimage {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] my_ip                          = 10.0.0.210 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] network_allocate_retries       = 0 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] osapi_compute_listen_port      = 8774 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] osapi_compute_unique_server_name_scope =  {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] osapi_compute_workers          = 3 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] password_length                = 12 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] periodic_enable                = True {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] periodic_fuzzy_delay           = 60 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] pointer_model                  = ps2mouse {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] preallocate_images             = none {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] publish_errors                 = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] pybasedir                      = /opt/stack/nova {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] ram_allocation_ratio           = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] rate_limit_burst               = 0 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] rate_limit_except_level        = CRITICAL {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] rate_limit_interval            = 0 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] reboot_timeout                 = 0 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] reclaim_instance_interval      = 0 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] record                         = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] reimage_timeout_per_gb         = 60 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] report_interval                = 120 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] rescue_timeout                 = 0 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] reserved_host_cpus             = 0 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] reserved_host_disk_mb          = 0 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] reserved_host_memory_mb        = 512 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] reserved_huge_pages            = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] resize_confirm_window          = 0 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] resize_fs_using_block_device   = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] resume_guests_state_on_host_boot = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] rpc_response_timeout           = 60 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] run_external_periodic_tasks    = True {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] running_deleted_instance_action = reap {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] running_deleted_instance_poll_interval = 1800 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] running_deleted_instance_timeout = 0 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] scheduler_instance_sync_interval = 120 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] service_down_time              = 720 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] servicegroup_driver            = db {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] shelved_offload_time           = 0 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] shelved_poll_interval          = 3600 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] shutdown_timeout               = 0 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] source_is_ipv6                 = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] ssl_only                       = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] state_path                     = /opt/stack/data/nova {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] sync_power_state_interval      = 600 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] sync_power_state_pool_size     = 1000 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] syslog_log_facility            = LOG_USER {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] tempdir                        = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] timeout_nbd                    = 10 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] transport_url                  = **** {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] update_resources_interval      = 0 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] use_cow_images                 = True {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] use_eventlog                   = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] use_journal                    = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] use_json                       = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] use_rootwrap_daemon            = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] use_stderr                     = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] use_syslog                     = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] vcpu_pin_set                   = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] vif_plugging_is_fatal          = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] vif_plugging_timeout           = 0 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] virt_mkfs                      = [] {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] volume_usage_poll_interval     = 0 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] watch_log_file                 = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] web                            = /usr/share/spice-html5 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] oslo_concurrency.disable_process_locking = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] api.auth_strategy              = keystone {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] api.compute_link_prefix        = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] api.dhcp_domain                = novalocal {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] api.enable_instance_password   = True {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] api.glance_link_prefix         = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] api.instance_list_per_project_cells = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] api.list_records_by_skipping_down_cells = True {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] api.local_metadata_per_cell    = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] api.max_limit                  = 1000 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] api.metadata_cache_expiration  = 15 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] api.neutron_default_tenant_id  = default {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] api.use_forwarded_for          = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] api.use_neutron_default_nets   = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] api.vendordata_dynamic_targets = [] {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] api.vendordata_jsonfile_path   = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] cache.backend                  = dogpile.cache.memcached {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] cache.backend_argument         = **** {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] cache.config_prefix            = cache.oslo {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] cache.dead_timeout             = 60.0 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] cache.debug_cache_backend      = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] cache.enable_retry_client      = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] cache.enable_socket_keepalive  = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] cache.enabled                  = True {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] cache.expiration_time          = 600 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] cache.hashclient_retry_attempts = 2 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] cache.memcache_dead_retry      = 300 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] cache.memcache_password        =  {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] cache.memcache_pool_maxsize    = 10 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] cache.memcache_sasl_enabled    = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] cache.memcache_username        =  {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] cache.proxies                  = [] {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] cache.retry_attempts           = 2 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] cache.retry_delay              = 0.0 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] cache.socket_keepalive_count   = 1 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] cache.socket_keepalive_idle    = 1 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] cache.socket_keepalive_interval = 1 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] cache.tls_allowed_ciphers      = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] cache.tls_cafile               = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] cache.tls_certfile             = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] cache.tls_enabled              = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] cache.tls_keyfile              = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] cinder.auth_section            = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] cinder.auth_type               = password {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] cinder.cafile                  = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] cinder.certfile                = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] cinder.collect_timing          = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] cinder.cross_az_attach         = True {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] cinder.debug                   = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] cinder.endpoint_template       = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] cinder.http_retries            = 3 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] cinder.insecure                = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] cinder.keyfile                 = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] cinder.os_region_name          = RegionOne {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] cinder.split_loggers           = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] cinder.timeout                 = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] compute.cpu_dedicated_set      = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] compute.cpu_shared_set         = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] compute.image_type_exclude_list = [] {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] compute.max_concurrent_disk_ops = 0 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] compute.max_disk_devices_to_attach = -1 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] compute.resource_provider_association_refresh = 300 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] compute.shutdown_retry_interval = 10 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] conductor.workers              = 3 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] console.allowed_origins        = [] {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] console.ssl_ciphers            = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] console.ssl_minimum_version    = default {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] consoleauth.token_ttl          = 600 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] cyborg.cafile                  = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] cyborg.certfile                = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] cyborg.collect_timing          = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] cyborg.connect_retries         = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] cyborg.connect_retry_delay     = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] cyborg.endpoint_override       = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] cyborg.insecure                = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] cyborg.keyfile                 = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] cyborg.max_version             = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] cyborg.min_version             = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] cyborg.region_name             = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] cyborg.service_name            = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] cyborg.service_type            = accelerator {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] cyborg.split_loggers           = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] cyborg.status_code_retries     = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] cyborg.status_code_retry_delay = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] cyborg.timeout                 = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] cyborg.version                 = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] database.backend               = sqlalchemy {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] database.connection            = **** {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] database.connection_debug      = 0 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] database.connection_parameters =  {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] database.connection_recycle_time = 3600 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] database.connection_trace      = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] database.db_inc_retry_interval = True {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] database.db_max_retries        = 20 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] database.db_max_retry_interval = 10 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] database.db_retry_interval     = 1 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] database.max_overflow          = 50 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] database.max_pool_size         = 5 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] database.max_retries           = 10 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] database.mysql_wsrep_sync_wait = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] database.pool_timeout          = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] database.retry_interval        = 10 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] database.slave_connection      = **** {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] database.sqlite_synchronous    = True {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] api_database.backend           = sqlalchemy {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] api_database.connection        = **** {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] api_database.connection_debug  = 0 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] api_database.connection_parameters =  {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] api_database.connection_recycle_time = 3600 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] api_database.connection_trace  = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] api_database.db_inc_retry_interval = True {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] api_database.db_max_retries    = 20 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] api_database.db_max_retry_interval = 10 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] api_database.db_retry_interval = 1 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] api_database.max_overflow      = 50 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] api_database.max_pool_size     = 5 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] api_database.max_retries       = 10 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] api_database.pool_timeout      = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] api_database.retry_interval    = 10 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] api_database.slave_connection  = **** {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] api_database.sqlite_synchronous = True {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] devices.enabled_mdev_types     = [] {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] ephemeral_storage_encryption.enabled = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] glance.api_servers             = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] glance.cafile                  = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] glance.certfile                = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] glance.collect_timing          = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] glance.connect_retries         = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] glance.connect_retry_delay     = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] glance.debug                   = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] glance.default_trusted_certificate_ids = [] {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] glance.enable_certificate_validation = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] glance.enable_rbd_download     = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] glance.endpoint_override       = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] glance.insecure                = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] glance.keyfile                 = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] glance.max_version             = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] glance.min_version             = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] glance.num_retries             = 3 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] glance.rbd_ceph_conf           =  {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] glance.rbd_connect_timeout     = 5 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] glance.rbd_pool                =  {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] glance.rbd_user                =  {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] glance.region_name             = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] glance.service_name            = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] glance.service_type            = image {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] glance.split_loggers           = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] glance.status_code_retries     = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] glance.status_code_retry_delay = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] glance.timeout                 = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] glance.verify_glance_signatures = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] glance.version                 = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] guestfs.debug                  = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] hyperv.config_drive_cdrom      = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] hyperv.config_drive_inject_password = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] hyperv.enable_instance_metrics_collection = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] hyperv.enable_remotefx         = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] hyperv.instances_path_share    =  {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] hyperv.iscsi_initiator_list    = [] {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] hyperv.limit_cpu_features      = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] hyperv.power_state_check_timeframe = 60 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] hyperv.use_multipath_io        = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] hyperv.volume_attach_retry_count = 10 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] hyperv.vswitch_name            = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] mks.enabled                    = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] image_cache.manager_interval   = 2400 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] image_cache.precache_concurrency = 1 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] image_cache.remove_unused_base_images = True {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] image_cache.subdirectory_name  = _base {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] ironic.api_max_retries         = 60 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] ironic.api_retry_interval      = 2 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] ironic.auth_section            = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] ironic.auth_type               = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] ironic.cafile                  = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] ironic.certfile                = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] ironic.collect_timing          = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] ironic.conductor_group         = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] ironic.connect_retries         = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] ironic.connect_retry_delay     = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] ironic.endpoint_override       = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] ironic.insecure                = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] ironic.keyfile                 = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] ironic.max_version             = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] ironic.min_version             = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] ironic.peer_list               = [] {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] ironic.region_name             = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] ironic.serial_console_state_timeout = 10 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] ironic.service_name            = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] ironic.service_type            = baremetal {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] ironic.split_loggers           = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] ironic.status_code_retries     = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] ironic.status_code_retry_delay = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] ironic.timeout                 = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] ironic.version                 = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] key_manager.fixed_key          = **** {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] barbican.barbican_api_version  = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] barbican.barbican_endpoint     = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] barbican.barbican_endpoint_type = public {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] barbican.barbican_region_name  = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] barbican.cafile                = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] barbican.certfile              = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] barbican.collect_timing        = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] barbican.insecure              = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] barbican.keyfile               = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] barbican.number_of_retries     = 60 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] barbican.retry_delay           = 1 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] barbican.send_service_user_token = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] barbican.split_loggers         = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] barbican.timeout               = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] barbican.verify_ssl            = True {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] barbican.verify_ssl_path       = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] barbican_service_user.auth_section = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] barbican_service_user.auth_type = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] barbican_service_user.cafile   = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] barbican_service_user.certfile = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] barbican_service_user.collect_timing = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] barbican_service_user.insecure = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] barbican_service_user.keyfile  = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] barbican_service_user.split_loggers = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] barbican_service_user.timeout  = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] vault.approle_role_id          = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] vault.approle_secret_id        = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] vault.cafile                   = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] vault.certfile                 = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] vault.collect_timing           = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] vault.insecure                 = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] vault.keyfile                  = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] vault.kv_mountpoint            = secret {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] vault.kv_path                  = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] vault.kv_version               = 2 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] vault.namespace                = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] vault.root_token_id            = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] vault.split_loggers            = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] vault.ssl_ca_crt_file          = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] vault.timeout                  = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] vault.use_ssl                  = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] keystone.auth_section          = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] keystone.auth_type             = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] keystone.cafile                = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] keystone.certfile              = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] keystone.collect_timing        = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] keystone.connect_retries       = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] keystone.connect_retry_delay   = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] keystone.endpoint_override     = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] keystone.insecure              = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] keystone.keyfile               = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] keystone.max_version           = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] keystone.min_version           = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] keystone.region_name           = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] keystone.service_name          = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] keystone.service_type          = identity {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] keystone.split_loggers         = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] keystone.status_code_retries   = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] keystone.status_code_retry_delay = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] keystone.timeout               = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] keystone.version               = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] libvirt.connection_uri         =  {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] libvirt.cpu_mode               = custom {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: WARNING oslo_config.cfg [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] libvirt.cpu_power_governor_high = performance {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] libvirt.cpu_power_governor_low = powersave {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] libvirt.cpu_power_management   = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] libvirt.device_detach_attempts = 8 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] libvirt.device_detach_timeout  = 20 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] libvirt.disk_cachemodes        = [] {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] libvirt.disk_prefix            = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] libvirt.enabled_perf_events    = [] {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] libvirt.file_backed_memory     = 0 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] libvirt.gid_maps               = [] {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] libvirt.hw_disk_discard        = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] libvirt.hw_machine_type        = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] libvirt.images_rbd_glance_store_name =  {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] libvirt.images_rbd_pool        = rbd {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] libvirt.images_type            = default {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] libvirt.images_volume_group    = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] libvirt.inject_key             = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] libvirt.inject_partition       = -2 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] libvirt.inject_password        = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] libvirt.iscsi_iface            = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] libvirt.iser_use_multipath     = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] libvirt.live_migration_bandwidth = 0 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] libvirt.live_migration_downtime = 500 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] libvirt.live_migration_inbound_addr = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] libvirt.live_migration_permit_post_copy = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] libvirt.live_migration_scheme  = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] libvirt.live_migration_timeout_action = abort {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] libvirt.live_migration_tunnelled = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: WARNING oslo_config.cfg [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Oct 26 00:02:55 user nova-compute[75165]: live_migration_uri is deprecated for removal in favor of two other options that
Oct 26 00:02:55 user nova-compute[75165]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Oct 26 00:02:55 user nova-compute[75165]: and ``live_migration_inbound_addr`` respectively.
Oct 26 00:02:55 user nova-compute[75165]: ).  Its value may be silently ignored in the future.
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] libvirt.live_migration_with_native_tls = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] libvirt.max_queues             = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] libvirt.nfs_mount_options      = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] libvirt.num_memory_encrypted_guests = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] libvirt.num_pcie_ports         = 0 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] libvirt.pmem_namespaces        = [] {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] libvirt.quobyte_client_cfg     = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] libvirt.rbd_secret_uuid        = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] libvirt.rbd_user               = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] libvirt.remote_filesystem_transport = ssh {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] libvirt.rescue_image_id        = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] libvirt.rescue_kernel_id       = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] libvirt.rescue_ramdisk_id      = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] libvirt.rx_queue_size          = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] libvirt.smbfs_mount_options    =  {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] libvirt.snapshot_compression   = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] libvirt.snapshot_image_format  = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] libvirt.sparse_logical_volumes = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] libvirt.swtpm_enabled          = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] libvirt.swtpm_group            = tss {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] libvirt.swtpm_user             = tss {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] libvirt.sysinfo_serial         = unique {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] libvirt.tb_cache_size          = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] libvirt.tx_queue_size          = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] libvirt.uid_maps               = [] {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] libvirt.use_virtio_for_bridges = True {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] libvirt.virt_type              = kvm {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] libvirt.volume_clear           = zero {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] libvirt.volume_clear_size      = 0 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] libvirt.volume_use_multipath   = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] libvirt.vzstorage_cache_path   = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] libvirt.vzstorage_mount_user   = stack {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] neutron.auth_section           = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] neutron.auth_type              = password {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] neutron.cafile                 = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] neutron.certfile               = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] neutron.collect_timing         = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] neutron.connect_retries        = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] neutron.connect_retry_delay    = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] neutron.default_floating_pool  = public {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] neutron.endpoint_override      = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] neutron.extension_sync_interval = 600 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] neutron.http_retries           = 3 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] neutron.insecure               = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] neutron.keyfile                = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] neutron.max_version            = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] neutron.min_version            = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] neutron.ovs_bridge             = br-int {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] neutron.physnets               = [] {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] neutron.region_name            = RegionOne {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] neutron.service_metadata_proxy = True {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] neutron.service_name           = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] neutron.service_type           = network {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] neutron.split_loggers          = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] neutron.status_code_retries    = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] neutron.status_code_retry_delay = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] neutron.timeout                = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] neutron.version                = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] notifications.bdms_in_notifications = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] notifications.default_level    = INFO {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] notifications.notification_format = unversioned {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] notifications.notify_on_state_change = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] pci.alias                      = [] {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] pci.device_spec                = [] {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] pci.report_in_placement        = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] placement.auth_section         = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] placement.auth_type            = password {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] placement.cafile               = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] placement.certfile             = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] placement.collect_timing       = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] placement.connect_retries      = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] placement.connect_retry_delay  = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] placement.default_domain_id    = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] placement.default_domain_name  = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] placement.domain_id            = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] placement.domain_name          = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] placement.endpoint_override    = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] placement.insecure             = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] placement.keyfile              = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] placement.max_version          = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] placement.min_version          = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] placement.password             = **** {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] placement.project_domain_id    = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] placement.project_domain_name  = Default {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] placement.project_id           = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] placement.project_name         = service {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] placement.region_name          = RegionOne {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] placement.service_name         = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] placement.service_type         = placement {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] placement.split_loggers        = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] placement.status_code_retries  = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] placement.status_code_retry_delay = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] placement.system_scope         = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] placement.timeout              = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] placement.trust_id             = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] placement.user_domain_id       = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] placement.user_domain_name     = Default {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] placement.user_id              = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] placement.username             = placement {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] placement.version              = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] quota.cores                    = 20 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] quota.count_usage_from_placement = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] quota.injected_file_content_bytes = 10240 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] quota.injected_file_path_length = 255 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] quota.injected_files           = 5 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] quota.instances                = 10 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] quota.key_pairs                = 100 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] quota.metadata_items           = 128 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] quota.ram                      = 51200 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] quota.recheck_quota            = True {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] quota.server_group_members     = 10 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] quota.server_groups            = 10 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] rdp.enabled                    = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] scheduler.image_metadata_prefilter = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] scheduler.max_attempts         = 3 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] scheduler.max_placement_results = 1000 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] scheduler.query_placement_for_image_type_support = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] scheduler.workers              = 3 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] filter_scheduler.host_subset_size = 1 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] filter_scheduler.isolated_hosts = [] {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] filter_scheduler.isolated_images = [] {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] filter_scheduler.pci_in_placement = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] filter_scheduler.track_instance_changes = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] metrics.required               = True {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] metrics.weight_multiplier      = 1.0 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] metrics.weight_setting         = [] {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] serial_console.enabled         = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] serial_console.port_range      = 10000:20000 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] serial_console.serialproxy_port = 6083 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] service_user.auth_section      = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] service_user.auth_type         = password {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] service_user.cafile            = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] service_user.certfile          = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] service_user.collect_timing    = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] service_user.insecure          = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] service_user.keyfile           = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] service_user.send_service_user_token = True {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] service_user.split_loggers     = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] service_user.timeout           = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] spice.agent_enabled            = True {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] spice.enabled                  = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] spice.html5proxy_port          = 6082 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] spice.image_compression        = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] spice.jpeg_compression         = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] spice.playback_compression     = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] spice.server_listen            = 127.0.0.1 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] spice.streaming_mode           = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] spice.zlib_compression         = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] upgrade_levels.baseapi         = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] upgrade_levels.cert            = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] upgrade_levels.compute         = auto {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] upgrade_levels.conductor       = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] upgrade_levels.scheduler       = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] vendordata_dynamic_auth.auth_section = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] vendordata_dynamic_auth.auth_type = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] vendordata_dynamic_auth.cafile = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] vendordata_dynamic_auth.certfile = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] vendordata_dynamic_auth.insecure = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] vendordata_dynamic_auth.keyfile = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] vendordata_dynamic_auth.timeout = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] vmware.api_retry_count         = 10 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] vmware.ca_file                 = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] vmware.cache_prefix            = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] vmware.cluster_name            = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] vmware.connection_pool_size    = 10 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] vmware.console_delay_seconds   = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] vmware.datastore_regex         = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] vmware.host_ip                 = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] vmware.host_password           = **** {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] vmware.host_port               = 443 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] vmware.host_username           = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] vmware.insecure                = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] vmware.integration_bridge      = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] vmware.maximum_objects         = 100 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] vmware.pbm_default_policy      = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] vmware.pbm_enabled             = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] vmware.pbm_wsdl_location       = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] vmware.serial_port_proxy_uri   = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] vmware.serial_port_service_uri = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] vmware.task_poll_interval      = 0.5 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] vmware.use_linked_clone        = True {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] vmware.vnc_keymap              = en-us {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] vmware.vnc_port                = 5900 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] vmware.vnc_port_total          = 10000 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] vnc.auth_schemes               = ['none'] {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] vnc.enabled                    = True {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] vnc.novncproxy_port            = 6080 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] vnc.server_listen              = 0.0.0.0 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] vnc.vencrypt_ca_certs          = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] vnc.vencrypt_client_cert       = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] vnc.vencrypt_client_key        = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] workarounds.disable_rootwrap   = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] workarounds.enable_numa_live_migration = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] workarounds.libvirt_disable_apic = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] wsgi.client_socket_timeout     = 900 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] wsgi.default_pool_size         = 1000 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] wsgi.keep_alive                = True {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] wsgi.max_header_line           = 16384 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] wsgi.ssl_ca_file               = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] wsgi.ssl_cert_file             = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] wsgi.ssl_key_file              = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] wsgi.tcp_keepidle              = 600 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] zvm.ca_file                    = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] zvm.cloud_connector_url        = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] zvm.reachable_timeout          = 300 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] oslo_policy.enforce_new_defaults = True {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] oslo_policy.enforce_scope      = True {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] oslo_policy.policy_default_rule = default {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] oslo_policy.policy_file        = policy.yaml {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] profiler.connection_string     = messaging:// {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] profiler.enabled               = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] profiler.es_doc_type           = notification {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] profiler.es_scroll_size        = 10000 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] profiler.es_scroll_time        = 2m {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] profiler.filter_error_trace    = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] profiler.hmac_keys             = **** {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] profiler.sentinel_service_name = mymaster {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] profiler.socket_timeout        = 0.1 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] profiler.trace_requests        = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] profiler.trace_sqlalchemy      = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] profiler_jaeger.process_tags   = {} {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] profiler_jaeger.service_name_prefix = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] profiler_otlp.service_name_prefix = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] remote_debug.host              = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] remote_debug.port              = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] oslo_messaging_rabbit.ssl      = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] oslo_messaging_notifications.retry = -1 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] oslo_limit.auth_section        = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] oslo_limit.auth_type           = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] oslo_limit.cafile              = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] oslo_limit.certfile            = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] oslo_limit.collect_timing      = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] oslo_limit.connect_retries     = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] oslo_limit.connect_retry_delay = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] oslo_limit.endpoint_id         = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] oslo_limit.endpoint_override   = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] oslo_limit.insecure            = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] oslo_limit.keyfile             = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] oslo_limit.max_version         = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] oslo_limit.min_version         = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] oslo_limit.region_name         = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] oslo_limit.service_name        = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] oslo_limit.service_type        = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] oslo_limit.split_loggers       = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] oslo_limit.status_code_retries = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] oslo_limit.status_code_retry_delay = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] oslo_limit.timeout             = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] oslo_limit.valid_interfaces    = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] oslo_limit.version             = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] oslo_reports.file_event_handler = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] oslo_reports.log_dir           = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] vif_plug_ovs_privileged.group  = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] vif_plug_ovs_privileged.user   = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] os_vif_linux_bridge.flat_interface = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] os_vif_ovs.isolate_vif         = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] os_vif_ovs.per_port_bridge     = False {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] os_brick.lock_path             = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] privsep_osbrick.capabilities   = [21] {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] privsep_osbrick.group          = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] privsep_osbrick.helper_command = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] privsep_osbrick.user           = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] nova_sys_admin.group           = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] nova_sys_admin.helper_command  = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] nova_sys_admin.user            = None {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG oslo_service.service [None req-563d84bd-d79b-43b4-85c8-d14b323ad225 None None] ******************************************************************************** {{(pid=75165) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Oct 26 00:02:55 user nova-compute[75165]: INFO nova.service [-] Starting compute node (version 0.0.0)
Oct 26 00:02:55 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-a2276838-4303-4694-b734-014de1e95741 None None] Connecting to libvirt: qemu:///system {{(pid=75165) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:506}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-a2276838-4303-4694-b734-014de1e95741 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f8c016724d0> {{(pid=75165) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:512}}
Oct 26 00:02:55 user nova-compute[75165]: libvirt:  error : internal error: could not initialize domain event timer
Oct 26 00:02:55 user nova-compute[75165]: WARNING nova.virt.libvirt.host [None req-a2276838-4303-4694-b734-014de1e95741 None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Oct 26 00:02:55 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-a2276838-4303-4694-b734-014de1e95741 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f8c016724d0> {{(pid=75165) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:533}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-a2276838-4303-4694-b734-014de1e95741 None None] Starting native event thread {{(pid=75165) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-a2276838-4303-4694-b734-014de1e95741 None None] Starting green dispatch thread {{(pid=75165) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Oct 26 00:02:55 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-a2276838-4303-4694-b734-014de1e95741 None None] Starting connection event dispatch thread {{(pid=75165) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:501}}
Oct 26 00:02:55 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-a2276838-4303-4694-b734-014de1e95741 None None] Connection event '1' reason 'None'
Oct 26 00:02:55 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-a2276838-4303-4694-b734-014de1e95741 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Oct 26 00:02:55 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.mount [None req-a2276838-4303-4694-b734-014de1e95741 None None] Initialising _HostMountState generation 0 {{(pid=75165) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Oct 26 00:03:02 user nova-compute[75165]: INFO nova.virt.libvirt.host [None req-a2276838-4303-4694-b734-014de1e95741 None None] Libvirt host capabilities <capabilities>
Oct 26 00:03:02 user nova-compute[75165]:   <host>
Oct 26 00:03:02 user nova-compute[75165]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Oct 26 00:03:02 user nova-compute[75165]:     <cpu>
Oct 26 00:03:02 user nova-compute[75165]:       <arch>x86_64</arch>
Oct 26 00:03:02 user nova-compute[75165]:       <model>IvyBridge-IBRS</model>
Oct 26 00:03:02 user nova-compute[75165]:       <vendor>Intel</vendor>
Oct 26 00:03:02 user nova-compute[75165]:       <microcode version='1070'/>
Oct 26 00:03:02 user nova-compute[75165]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Oct 26 00:03:02 user nova-compute[75165]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Oct 26 00:03:02 user nova-compute[75165]:       <feature name='ss'/>
Oct 26 00:03:02 user nova-compute[75165]:       <feature name='vmx'/>
Oct 26 00:03:02 user nova-compute[75165]:       <feature name='pcid'/>
Oct 26 00:03:02 user nova-compute[75165]:       <feature name='osxsave'/>
Oct 26 00:03:02 user nova-compute[75165]:       <feature name='hypervisor'/>
Oct 26 00:03:02 user nova-compute[75165]:       <feature name='arat'/>
Oct 26 00:03:02 user nova-compute[75165]:       <feature name='tsc_adjust'/>
Oct 26 00:03:02 user nova-compute[75165]:       <feature name='md-clear'/>
Oct 26 00:03:02 user nova-compute[75165]:       <feature name='stibp'/>
Oct 26 00:03:02 user nova-compute[75165]:       <feature name='arch-capabilities'/>
Oct 26 00:03:02 user nova-compute[75165]:       <feature name='ssbd'/>
Oct 26 00:03:02 user nova-compute[75165]:       <feature name='invtsc'/>
Oct 26 00:03:02 user nova-compute[75165]:       <feature name='rsba'/>
Oct 26 00:03:02 user nova-compute[75165]:       <feature name='skip-l1dfl-vmentry'/>
Oct 26 00:03:02 user nova-compute[75165]:       <pages unit='KiB' size='4'/>
Oct 26 00:03:02 user nova-compute[75165]:       <pages unit='KiB' size='2048'/>
Oct 26 00:03:02 user nova-compute[75165]:     </cpu>
Oct 26 00:03:02 user nova-compute[75165]:     <power_management>
Oct 26 00:03:02 user nova-compute[75165]:       <suspend_mem/>
Oct 26 00:03:02 user nova-compute[75165]:       <suspend_disk/>
Oct 26 00:03:02 user nova-compute[75165]:       <suspend_hybrid/>
Oct 26 00:03:02 user nova-compute[75165]:     </power_management>
Oct 26 00:03:02 user nova-compute[75165]:     <iommu support='no'/>
Oct 26 00:03:02 user nova-compute[75165]:     <migration_features>
Oct 26 00:03:02 user nova-compute[75165]:       <live/>
Oct 26 00:03:02 user nova-compute[75165]:       <uri_transports>
Oct 26 00:03:02 user nova-compute[75165]:         <uri_transport>tcp</uri_transport>
Oct 26 00:03:02 user nova-compute[75165]:         <uri_transport>rdma</uri_transport>
Oct 26 00:03:02 user nova-compute[75165]:       </uri_transports>
Oct 26 00:03:02 user nova-compute[75165]:     </migration_features>
Oct 26 00:03:02 user nova-compute[75165]:     <topology>
Oct 26 00:03:02 user nova-compute[75165]:       <cells num='2'>
Oct 26 00:03:02 user nova-compute[75165]:         <cell id='0'>
Oct 26 00:03:02 user nova-compute[75165]:           <memory unit='KiB'>8189224</memory>
Oct 26 00:03:02 user nova-compute[75165]:           <pages unit='KiB' size='4'>2047306</pages>
Oct 26 00:03:02 user nova-compute[75165]:           <pages unit='KiB' size='2048'>0</pages>
Oct 26 00:03:02 user nova-compute[75165]:           <distances>
Oct 26 00:03:02 user nova-compute[75165]:             <sibling id='0' value='10'/>
Oct 26 00:03:02 user nova-compute[75165]:             <sibling id='1' value='20'/>
Oct 26 00:03:02 user nova-compute[75165]:           </distances>
Oct 26 00:03:02 user nova-compute[75165]:           <cpus num='6'>
Oct 26 00:03:02 user nova-compute[75165]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Oct 26 00:03:02 user nova-compute[75165]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Oct 26 00:03:02 user nova-compute[75165]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Oct 26 00:03:02 user nova-compute[75165]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Oct 26 00:03:02 user nova-compute[75165]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Oct 26 00:03:02 user nova-compute[75165]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Oct 26 00:03:02 user nova-compute[75165]:           </cpus>
Oct 26 00:03:02 user nova-compute[75165]:         </cell>
Oct 26 00:03:02 user nova-compute[75165]:         <cell id='1'>
Oct 26 00:03:02 user nova-compute[75165]:           <memory unit='KiB'>8206460</memory>
Oct 26 00:03:02 user nova-compute[75165]:           <pages unit='KiB' size='4'>2051615</pages>
Oct 26 00:03:02 user nova-compute[75165]:           <pages unit='KiB' size='2048'>0</pages>
Oct 26 00:03:02 user nova-compute[75165]:           <distances>
Oct 26 00:03:02 user nova-compute[75165]:             <sibling id='0' value='20'/>
Oct 26 00:03:02 user nova-compute[75165]:             <sibling id='1' value='10'/>
Oct 26 00:03:02 user nova-compute[75165]:           </distances>
Oct 26 00:03:02 user nova-compute[75165]:           <cpus num='6'>
Oct 26 00:03:02 user nova-compute[75165]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Oct 26 00:03:02 user nova-compute[75165]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Oct 26 00:03:02 user nova-compute[75165]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Oct 26 00:03:02 user nova-compute[75165]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Oct 26 00:03:02 user nova-compute[75165]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Oct 26 00:03:02 user nova-compute[75165]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Oct 26 00:03:02 user nova-compute[75165]:           </cpus>
Oct 26 00:03:02 user nova-compute[75165]:         </cell>
Oct 26 00:03:02 user nova-compute[75165]:       </cells>
Oct 26 00:03:02 user nova-compute[75165]:     </topology>
Oct 26 00:03:02 user nova-compute[75165]:     <cache>
Oct 26 00:03:02 user nova-compute[75165]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Oct 26 00:03:02 user nova-compute[75165]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Oct 26 00:03:02 user nova-compute[75165]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Oct 26 00:03:02 user nova-compute[75165]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Oct 26 00:03:02 user nova-compute[75165]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Oct 26 00:03:02 user nova-compute[75165]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Oct 26 00:03:02 user nova-compute[75165]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Oct 26 00:03:02 user nova-compute[75165]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Oct 26 00:03:02 user nova-compute[75165]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Oct 26 00:03:02 user nova-compute[75165]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Oct 26 00:03:02 user nova-compute[75165]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Oct 26 00:03:02 user nova-compute[75165]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Oct 26 00:03:02 user nova-compute[75165]:     </cache>
Oct 26 00:03:02 user nova-compute[75165]:     <secmodel>
Oct 26 00:03:02 user nova-compute[75165]:       <model>apparmor</model>
Oct 26 00:03:02 user nova-compute[75165]:       <doi>0</doi>
Oct 26 00:03:02 user nova-compute[75165]:     </secmodel>
Oct 26 00:03:02 user nova-compute[75165]:     <secmodel>
Oct 26 00:03:02 user nova-compute[75165]:       <model>dac</model>
Oct 26 00:03:02 user nova-compute[75165]:       <doi>0</doi>
Oct 26 00:03:02 user nova-compute[75165]:       <baselabel type='kvm'>+64055:+108</baselabel>
Oct 26 00:03:02 user nova-compute[75165]:       <baselabel type='qemu'>+64055:+108</baselabel>
Oct 26 00:03:02 user nova-compute[75165]:     </secmodel>
Oct 26 00:03:02 user nova-compute[75165]:   </host>
Oct 26 00:03:02 user nova-compute[75165]:   <guest>
Oct 26 00:03:02 user nova-compute[75165]:     <os_type>hvm</os_type>
Oct 26 00:03:02 user nova-compute[75165]:     <arch name='alpha'>
Oct 26 00:03:02 user nova-compute[75165]:       <wordsize>64</wordsize>
Oct 26 00:03:02 user nova-compute[75165]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='4'>clipper</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <domain type='qemu'/>
Oct 26 00:03:02 user nova-compute[75165]:     </arch>
Oct 26 00:03:02 user nova-compute[75165]:     <features>
Oct 26 00:03:02 user nova-compute[75165]:       <cpuselection/>
Oct 26 00:03:02 user nova-compute[75165]:       <deviceboot/>
Oct 26 00:03:02 user nova-compute[75165]:       <disksnapshot default='on' toggle='no'/>
Oct 26 00:03:02 user nova-compute[75165]:     </features>
Oct 26 00:03:02 user nova-compute[75165]:   </guest>
Oct 26 00:03:02 user nova-compute[75165]:   <guest>
Oct 26 00:03:02 user nova-compute[75165]:     <os_type>hvm</os_type>
Oct 26 00:03:02 user nova-compute[75165]:     <arch name='armv6l'>
Oct 26 00:03:02 user nova-compute[75165]:       <wordsize>32</wordsize>
Oct 26 00:03:02 user nova-compute[75165]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>integratorcp</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='2'>ast2600-evb</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>borzoi</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>spitz</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='255'>virt-2.7</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='2'>nuri</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>romulus-bmc</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='512'>virt-3.0</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='512'>virt-5.0</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='2'>npcm750-evb</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='255'>virt-2.10</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='2'>rainier-bmc</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>mps3-an547</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='2'>musca-b1</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>versatileab</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>kzm</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='255'>virt-2.8</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='2'>musca-a</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='512'>virt-3.1</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='512'>virt-5.1</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='2'>smdkc210</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>sx1</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='255'>virt-2.11</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>imx25-pdk</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='255'>virt-2.9</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='4'>orangepi-pc</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>z2</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='512'>virt-5.2</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>tosa</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>mps2-an500</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='255'>virt-2.12</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='2'>mps2-an521</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='4'>sabrelite</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>mps2-an511</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>canon-a1100</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>realview-eb</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>emcraft-sf2</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>realview-pb-a8</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='512'>virt-4.0</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>raspi1ap</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>palmetto-bmc</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>sx1-v1</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>n810</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>g220a-bmc</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>n800</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='2'>tacoma-bmc</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='512'>virt-4.1</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='2'>quanta-gsj</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>versatilepb</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>terrier</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>mainstone</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='512'>virt-4.2</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='2'>mps3-an524</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='2'>kudo-bmc</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='4'>vexpress-a9</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='4'>midway</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>musicpal</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>lm3s811evb</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>lm3s6965evb</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>microbit</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>mps2-an505</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>mps2-an385</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='512'>virt-6.0</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>cubieboard</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>verdex</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>netduino2</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>mps2-an386</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='512'>virt-6.1</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='4'>raspi2b</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='4'>vexpress-a15</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='2'>fuji-bmc</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='512'>virt-6.2</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>cheetah</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='255'>virt-2.6</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>ast2500-evb</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='4'>highbank</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>akita</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>connex</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>netduinoplus2</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>collie</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>raspi0</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <domain type='qemu'/>
Oct 26 00:03:02 user nova-compute[75165]:     </arch>
Oct 26 00:03:02 user nova-compute[75165]:     <features>
Oct 26 00:03:02 user nova-compute[75165]:       <cpuselection/>
Oct 26 00:03:02 user nova-compute[75165]:       <deviceboot/>
Oct 26 00:03:02 user nova-compute[75165]:       <disksnapshot default='on' toggle='no'/>
Oct 26 00:03:02 user nova-compute[75165]:     </features>
Oct 26 00:03:02 user nova-compute[75165]:   </guest>
Oct 26 00:03:02 user nova-compute[75165]:   <guest>
Oct 26 00:03:02 user nova-compute[75165]:     <os_type>hvm</os_type>
Oct 26 00:03:02 user nova-compute[75165]:     <arch name='armv7l'>
Oct 26 00:03:02 user nova-compute[75165]:       <wordsize>32</wordsize>
Oct 26 00:03:02 user nova-compute[75165]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>integratorcp</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='2'>ast2600-evb</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>borzoi</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>spitz</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='255'>virt-2.7</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='2'>nuri</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>romulus-bmc</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='512'>virt-3.0</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='512'>virt-5.0</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='2'>npcm750-evb</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='255'>virt-2.10</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='2'>rainier-bmc</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>mps3-an547</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='2'>musca-b1</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>versatileab</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>kzm</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='255'>virt-2.8</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='2'>musca-a</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='512'>virt-3.1</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='512'>virt-5.1</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='2'>smdkc210</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>sx1</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='255'>virt-2.11</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>imx25-pdk</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='255'>virt-2.9</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='4'>orangepi-pc</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>z2</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='512'>virt-5.2</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>tosa</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>mps2-an500</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='255'>virt-2.12</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='2'>mps2-an521</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='4'>sabrelite</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>mps2-an511</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>canon-a1100</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>realview-eb</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>emcraft-sf2</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>realview-pb-a8</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='512'>virt-4.0</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>raspi1ap</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>palmetto-bmc</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>sx1-v1</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>n810</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>g220a-bmc</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>n800</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='2'>tacoma-bmc</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='512'>virt-4.1</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='2'>quanta-gsj</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>versatilepb</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>terrier</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>mainstone</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='512'>virt-4.2</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='2'>mps3-an524</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='2'>kudo-bmc</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='4'>vexpress-a9</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='4'>midway</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>musicpal</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>lm3s811evb</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>lm3s6965evb</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>microbit</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>mps2-an505</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>mps2-an385</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='512'>virt-6.0</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>cubieboard</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>verdex</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>netduino2</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>mps2-an386</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='512'>virt-6.1</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='4'>raspi2b</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='4'>vexpress-a15</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='2'>fuji-bmc</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='512'>virt-6.2</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>cheetah</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='255'>virt-2.6</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>ast2500-evb</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='4'>highbank</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>akita</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>connex</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>netduinoplus2</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>collie</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>raspi0</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <domain type='qemu'/>
Oct 26 00:03:02 user nova-compute[75165]:     </arch>
Oct 26 00:03:02 user nova-compute[75165]:     <features>
Oct 26 00:03:02 user nova-compute[75165]:       <cpuselection/>
Oct 26 00:03:02 user nova-compute[75165]:       <deviceboot/>
Oct 26 00:03:02 user nova-compute[75165]:       <disksnapshot default='on' toggle='no'/>
Oct 26 00:03:02 user nova-compute[75165]:     </features>
Oct 26 00:03:02 user nova-compute[75165]:   </guest>
Oct 26 00:03:02 user nova-compute[75165]:   <guest>
Oct 26 00:03:02 user nova-compute[75165]:     <os_type>hvm</os_type>
Oct 26 00:03:02 user nova-compute[75165]:     <arch name='aarch64'>
Oct 26 00:03:02 user nova-compute[75165]:       <wordsize>64</wordsize>
Oct 26 00:03:02 user nova-compute[75165]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>integratorcp</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='2'>ast2600-evb</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>borzoi</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>spitz</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='255'>virt-2.7</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='2'>nuri</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>romulus-bmc</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='512'>virt-3.0</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='512'>virt-5.0</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='2'>npcm750-evb</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='255'>virt-2.10</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='2'>rainier-bmc</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>mps3-an547</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='255'>virt-2.8</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='2'>musca-b1</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>versatileab</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>kzm</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='2'>musca-a</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='512'>virt-3.1</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='512'>virt-5.1</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='2'>smdkc210</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>sx1</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='255'>virt-2.11</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>imx25-pdk</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='255'>virt-2.9</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='4'>orangepi-pc</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>z2</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='512'>virt-5.2</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>tosa</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>mps2-an500</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='255'>virt-2.12</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='2'>mps2-an521</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='4'>sabrelite</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>mps2-an511</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>canon-a1100</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>realview-eb</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>emcraft-sf2</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>realview-pb-a8</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='512'>sbsa-ref</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='512'>virt-4.0</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>raspi1ap</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>palmetto-bmc</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>sx1-v1</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>n810</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>g220a-bmc</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>n800</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='2'>tacoma-bmc</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='512'>virt-4.1</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='2'>quanta-gsj</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>versatilepb</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>terrier</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>mainstone</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='512'>virt-4.2</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='2'>mps3-an524</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='2'>kudo-bmc</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='4'>vexpress-a9</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='4'>midway</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>musicpal</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>lm3s811evb</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>lm3s6965evb</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>microbit</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>mps2-an505</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>mps2-an385</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='512'>virt-6.0</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='4'>raspi3ap</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>cubieboard</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>verdex</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>netduino2</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>mps2-an386</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='512'>virt-6.1</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='4'>raspi3b</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='4'>raspi2b</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='4'>vexpress-a15</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='2'>fuji-bmc</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='512'>virt-6.2</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>cheetah</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='255'>virt-2.6</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>ast2500-evb</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='4'>highbank</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>akita</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>connex</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>netduinoplus2</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>collie</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>raspi0</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <domain type='qemu'/>
Oct 26 00:03:02 user nova-compute[75165]:     </arch>
Oct 26 00:03:02 user nova-compute[75165]:     <features>
Oct 26 00:03:02 user nova-compute[75165]:       <acpi default='on' toggle='yes'/>
Oct 26 00:03:02 user nova-compute[75165]:       <cpuselection/>
Oct 26 00:03:02 user nova-compute[75165]:       <deviceboot/>
Oct 26 00:03:02 user nova-compute[75165]:       <disksnapshot default='on' toggle='no'/>
Oct 26 00:03:02 user nova-compute[75165]:     </features>
Oct 26 00:03:02 user nova-compute[75165]:   </guest>
Oct 26 00:03:02 user nova-compute[75165]:   <guest>
Oct 26 00:03:02 user nova-compute[75165]:     <os_type>hvm</os_type>
Oct 26 00:03:02 user nova-compute[75165]:     <arch name='cris'>
Oct 26 00:03:02 user nova-compute[75165]:       <wordsize>32</wordsize>
Oct 26 00:03:02 user nova-compute[75165]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>axis-dev88</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <domain type='qemu'/>
Oct 26 00:03:02 user nova-compute[75165]:     </arch>
Oct 26 00:03:02 user nova-compute[75165]:     <features>
Oct 26 00:03:02 user nova-compute[75165]:       <cpuselection/>
Oct 26 00:03:02 user nova-compute[75165]:       <deviceboot/>
Oct 26 00:03:02 user nova-compute[75165]:       <disksnapshot default='on' toggle='no'/>
Oct 26 00:03:02 user nova-compute[75165]:     </features>
Oct 26 00:03:02 user nova-compute[75165]:   </guest>
Oct 26 00:03:02 user nova-compute[75165]:   <guest>
Oct 26 00:03:02 user nova-compute[75165]:     <os_type>hvm</os_type>
Oct 26 00:03:02 user nova-compute[75165]:     <arch name='i686'>
Oct 26 00:03:02 user nova-compute[75165]:       <wordsize>32</wordsize>
Oct 26 00:03:02 user nova-compute[75165]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='288'>pc-q35-artful</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>x-remote</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>isapc</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='288'>pc-q35-disco</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='288'>pc-q35-impish</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='288'>pc-q35-focal</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='288'>microvm</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <domain type='qemu'/>
Oct 26 00:03:02 user nova-compute[75165]:       <domain type='kvm'/>
Oct 26 00:03:02 user nova-compute[75165]:     </arch>
Oct 26 00:03:02 user nova-compute[75165]:     <features>
Oct 26 00:03:02 user nova-compute[75165]:       <pae/>
Oct 26 00:03:02 user nova-compute[75165]:       <nonpae/>
Oct 26 00:03:02 user nova-compute[75165]:       <acpi default='on' toggle='yes'/>
Oct 26 00:03:02 user nova-compute[75165]:       <apic default='on' toggle='no'/>
Oct 26 00:03:02 user nova-compute[75165]:       <cpuselection/>
Oct 26 00:03:02 user nova-compute[75165]:       <deviceboot/>
Oct 26 00:03:02 user nova-compute[75165]:       <disksnapshot default='on' toggle='no'/>
Oct 26 00:03:02 user nova-compute[75165]:     </features>
Oct 26 00:03:02 user nova-compute[75165]:   </guest>
Oct 26 00:03:02 user nova-compute[75165]:   <guest>
Oct 26 00:03:02 user nova-compute[75165]:     <os_type>hvm</os_type>
Oct 26 00:03:02 user nova-compute[75165]:     <arch name='m68k'>
Oct 26 00:03:02 user nova-compute[75165]:       <wordsize>32</wordsize>
Oct 26 00:03:02 user nova-compute[75165]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>mcf5208evb</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>an5206</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>virt-6.0</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>q800</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>virt-6.2</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>next-cube</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>virt-6.1</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <domain type='qemu'/>
Oct 26 00:03:02 user nova-compute[75165]:     </arch>
Oct 26 00:03:02 user nova-compute[75165]:     <features>
Oct 26 00:03:02 user nova-compute[75165]:       <cpuselection/>
Oct 26 00:03:02 user nova-compute[75165]:       <deviceboot/>
Oct 26 00:03:02 user nova-compute[75165]:       <disksnapshot default='on' toggle='no'/>
Oct 26 00:03:02 user nova-compute[75165]:     </features>
Oct 26 00:03:02 user nova-compute[75165]:   </guest>
Oct 26 00:03:02 user nova-compute[75165]:   <guest>
Oct 26 00:03:02 user nova-compute[75165]:     <os_type>hvm</os_type>
Oct 26 00:03:02 user nova-compute[75165]:     <arch name='microblaze'>
Oct 26 00:03:02 user nova-compute[75165]:       <wordsize>32</wordsize>
Oct 26 00:03:02 user nova-compute[75165]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>petalogix-ml605</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <domain type='qemu'/>
Oct 26 00:03:02 user nova-compute[75165]:     </arch>
Oct 26 00:03:02 user nova-compute[75165]:     <features>
Oct 26 00:03:02 user nova-compute[75165]:       <cpuselection/>
Oct 26 00:03:02 user nova-compute[75165]:       <deviceboot/>
Oct 26 00:03:02 user nova-compute[75165]:       <disksnapshot default='on' toggle='no'/>
Oct 26 00:03:02 user nova-compute[75165]:     </features>
Oct 26 00:03:02 user nova-compute[75165]:   </guest>
Oct 26 00:03:02 user nova-compute[75165]:   <guest>
Oct 26 00:03:02 user nova-compute[75165]:     <os_type>hvm</os_type>
Oct 26 00:03:02 user nova-compute[75165]:     <arch name='microblazeel'>
Oct 26 00:03:02 user nova-compute[75165]:       <wordsize>32</wordsize>
Oct 26 00:03:02 user nova-compute[75165]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>petalogix-ml605</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <domain type='qemu'/>
Oct 26 00:03:02 user nova-compute[75165]:     </arch>
Oct 26 00:03:02 user nova-compute[75165]:     <features>
Oct 26 00:03:02 user nova-compute[75165]:       <cpuselection/>
Oct 26 00:03:02 user nova-compute[75165]:       <deviceboot/>
Oct 26 00:03:02 user nova-compute[75165]:       <disksnapshot default='on' toggle='no'/>
Oct 26 00:03:02 user nova-compute[75165]:     </features>
Oct 26 00:03:02 user nova-compute[75165]:   </guest>
Oct 26 00:03:02 user nova-compute[75165]:   <guest>
Oct 26 00:03:02 user nova-compute[75165]:     <os_type>hvm</os_type>
Oct 26 00:03:02 user nova-compute[75165]:     <arch name='mips'>
Oct 26 00:03:02 user nova-compute[75165]:       <wordsize>32</wordsize>
Oct 26 00:03:02 user nova-compute[75165]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='16'>malta</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>mipssim</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <domain type='qemu'/>
Oct 26 00:03:02 user nova-compute[75165]:     </arch>
Oct 26 00:03:02 user nova-compute[75165]:     <features>
Oct 26 00:03:02 user nova-compute[75165]:       <cpuselection/>
Oct 26 00:03:02 user nova-compute[75165]:       <deviceboot/>
Oct 26 00:03:02 user nova-compute[75165]:       <disksnapshot default='on' toggle='no'/>
Oct 26 00:03:02 user nova-compute[75165]:     </features>
Oct 26 00:03:02 user nova-compute[75165]:   </guest>
Oct 26 00:03:02 user nova-compute[75165]:   <guest>
Oct 26 00:03:02 user nova-compute[75165]:     <os_type>hvm</os_type>
Oct 26 00:03:02 user nova-compute[75165]:     <arch name='mipsel'>
Oct 26 00:03:02 user nova-compute[75165]:       <wordsize>32</wordsize>
Oct 26 00:03:02 user nova-compute[75165]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='16'>malta</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>mipssim</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <domain type='qemu'/>
Oct 26 00:03:02 user nova-compute[75165]:     </arch>
Oct 26 00:03:02 user nova-compute[75165]:     <features>
Oct 26 00:03:02 user nova-compute[75165]:       <cpuselection/>
Oct 26 00:03:02 user nova-compute[75165]:       <deviceboot/>
Oct 26 00:03:02 user nova-compute[75165]:       <disksnapshot default='on' toggle='no'/>
Oct 26 00:03:02 user nova-compute[75165]:     </features>
Oct 26 00:03:02 user nova-compute[75165]:   </guest>
Oct 26 00:03:02 user nova-compute[75165]:   <guest>
Oct 26 00:03:02 user nova-compute[75165]:     <os_type>hvm</os_type>
Oct 26 00:03:02 user nova-compute[75165]:     <arch name='mips64'>
Oct 26 00:03:02 user nova-compute[75165]:       <wordsize>64</wordsize>
Oct 26 00:03:02 user nova-compute[75165]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='16'>malta</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>mipssim</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>pica61</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>magnum</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <domain type='qemu'/>
Oct 26 00:03:02 user nova-compute[75165]:     </arch>
Oct 26 00:03:02 user nova-compute[75165]:     <features>
Oct 26 00:03:02 user nova-compute[75165]:       <cpuselection/>
Oct 26 00:03:02 user nova-compute[75165]:       <deviceboot/>
Oct 26 00:03:02 user nova-compute[75165]:       <disksnapshot default='on' toggle='no'/>
Oct 26 00:03:02 user nova-compute[75165]:     </features>
Oct 26 00:03:02 user nova-compute[75165]:   </guest>
Oct 26 00:03:02 user nova-compute[75165]:   <guest>
Oct 26 00:03:02 user nova-compute[75165]:     <os_type>hvm</os_type>
Oct 26 00:03:02 user nova-compute[75165]:     <arch name='mips64el'>
Oct 26 00:03:02 user nova-compute[75165]:       <wordsize>64</wordsize>
Oct 26 00:03:02 user nova-compute[75165]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='16'>malta</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='16'>loongson3-virt</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>mipssim</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>pica61</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>magnum</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='16'>boston</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>fuloong2e</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <domain type='qemu'/>
Oct 26 00:03:02 user nova-compute[75165]:     </arch>
Oct 26 00:03:02 user nova-compute[75165]:     <features>
Oct 26 00:03:02 user nova-compute[75165]:       <cpuselection/>
Oct 26 00:03:02 user nova-compute[75165]:       <deviceboot/>
Oct 26 00:03:02 user nova-compute[75165]:       <disksnapshot default='on' toggle='no'/>
Oct 26 00:03:02 user nova-compute[75165]:     </features>
Oct 26 00:03:02 user nova-compute[75165]:   </guest>
Oct 26 00:03:02 user nova-compute[75165]:   <guest>
Oct 26 00:03:02 user nova-compute[75165]:     <os_type>hvm</os_type>
Oct 26 00:03:02 user nova-compute[75165]:     <arch name='ppc'>
Oct 26 00:03:02 user nova-compute[75165]:       <wordsize>32</wordsize>
Oct 26 00:03:02 user nova-compute[75165]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>g3beige</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>virtex-ml507</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>mac99</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='32'>ppce500</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>pegasos2</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>sam460ex</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>bamboo</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>40p</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>ref405ep</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='15'>mpc8544ds</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>taihu</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <domain type='qemu'/>
Oct 26 00:03:02 user nova-compute[75165]:     </arch>
Oct 26 00:03:02 user nova-compute[75165]:     <features>
Oct 26 00:03:02 user nova-compute[75165]:       <cpuselection/>
Oct 26 00:03:02 user nova-compute[75165]:       <deviceboot/>
Oct 26 00:03:02 user nova-compute[75165]:       <disksnapshot default='on' toggle='no'/>
Oct 26 00:03:02 user nova-compute[75165]:     </features>
Oct 26 00:03:02 user nova-compute[75165]:   </guest>
Oct 26 00:03:02 user nova-compute[75165]:   <guest>
Oct 26 00:03:02 user nova-compute[75165]:     <os_type>hvm</os_type>
Oct 26 00:03:02 user nova-compute[75165]:     <arch name='ppc64'>
Oct 26 00:03:02 user nova-compute[75165]:       <wordsize>64</wordsize>
Oct 26 00:03:02 user nova-compute[75165]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='2048'>powernv9</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>taihu</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='15'>mpc8544ds</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='2048'>powernv10</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='32'>ppce500</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>40p</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>pegasos2</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>bamboo</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>g3beige</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>virtex-ml507</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>mac99</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>sam460ex</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>ref405ep</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='2048'>powernv8</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <domain type='qemu'/>
Oct 26 00:03:02 user nova-compute[75165]:     </arch>
Oct 26 00:03:02 user nova-compute[75165]:     <features>
Oct 26 00:03:02 user nova-compute[75165]:       <cpuselection/>
Oct 26 00:03:02 user nova-compute[75165]:       <deviceboot/>
Oct 26 00:03:02 user nova-compute[75165]:       <disksnapshot default='on' toggle='no'/>
Oct 26 00:03:02 user nova-compute[75165]:     </features>
Oct 26 00:03:02 user nova-compute[75165]:   </guest>
Oct 26 00:03:02 user nova-compute[75165]:   <guest>
Oct 26 00:03:02 user nova-compute[75165]:     <os_type>hvm</os_type>
Oct 26 00:03:02 user nova-compute[75165]:     <arch name='ppc64le'>
Oct 26 00:03:02 user nova-compute[75165]:       <wordsize>64</wordsize>
Oct 26 00:03:02 user nova-compute[75165]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='2048'>powernv9</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>taihu</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='15'>mpc8544ds</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='2048'>powernv10</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='32'>ppce500</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>40p</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>pegasos2</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>bamboo</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>g3beige</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>virtex-ml507</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>mac99</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>sam460ex</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>ref405ep</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='2048'>powernv8</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <domain type='qemu'/>
Oct 26 00:03:02 user nova-compute[75165]:     </arch>
Oct 26 00:03:02 user nova-compute[75165]:     <features>
Oct 26 00:03:02 user nova-compute[75165]:       <cpuselection/>
Oct 26 00:03:02 user nova-compute[75165]:       <deviceboot/>
Oct 26 00:03:02 user nova-compute[75165]:       <disksnapshot default='on' toggle='no'/>
Oct 26 00:03:02 user nova-compute[75165]:     </features>
Oct 26 00:03:02 user nova-compute[75165]:   </guest>
Oct 26 00:03:02 user nova-compute[75165]:   <guest>
Oct 26 00:03:02 user nova-compute[75165]:     <os_type>hvm</os_type>
Oct 26 00:03:02 user nova-compute[75165]:     <arch name='riscv32'>
Oct 26 00:03:02 user nova-compute[75165]:       <wordsize>32</wordsize>
Oct 26 00:03:02 user nova-compute[75165]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='8'>spike</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>opentitan</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='5'>sifive_u</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>sifive_e</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='8'>virt</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <domain type='qemu'/>
Oct 26 00:03:02 user nova-compute[75165]:     </arch>
Oct 26 00:03:02 user nova-compute[75165]:     <features>
Oct 26 00:03:02 user nova-compute[75165]:       <cpuselection/>
Oct 26 00:03:02 user nova-compute[75165]:       <deviceboot/>
Oct 26 00:03:02 user nova-compute[75165]:       <disksnapshot default='on' toggle='no'/>
Oct 26 00:03:02 user nova-compute[75165]:     </features>
Oct 26 00:03:02 user nova-compute[75165]:   </guest>
Oct 26 00:03:02 user nova-compute[75165]:   <guest>
Oct 26 00:03:02 user nova-compute[75165]:     <os_type>hvm</os_type>
Oct 26 00:03:02 user nova-compute[75165]:     <arch name='riscv64'>
Oct 26 00:03:02 user nova-compute[75165]:       <wordsize>64</wordsize>
Oct 26 00:03:02 user nova-compute[75165]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='8'>spike</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='5'>sifive_u</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>shakti_c</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>sifive_e</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='8'>virt</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <domain type='qemu'/>
Oct 26 00:03:02 user nova-compute[75165]:     </arch>
Oct 26 00:03:02 user nova-compute[75165]:     <features>
Oct 26 00:03:02 user nova-compute[75165]:       <cpuselection/>
Oct 26 00:03:02 user nova-compute[75165]:       <deviceboot/>
Oct 26 00:03:02 user nova-compute[75165]:       <disksnapshot default='on' toggle='no'/>
Oct 26 00:03:02 user nova-compute[75165]:     </features>
Oct 26 00:03:02 user nova-compute[75165]:   </guest>
Oct 26 00:03:02 user nova-compute[75165]:   <guest>
Oct 26 00:03:02 user nova-compute[75165]:     <os_type>hvm</os_type>
Oct 26 00:03:02 user nova-compute[75165]:     <arch name='s390x'>
Oct 26 00:03:02 user nova-compute[75165]:       <wordsize>64</wordsize>
Oct 26 00:03:02 user nova-compute[75165]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <domain type='qemu'/>
Oct 26 00:03:02 user nova-compute[75165]:     </arch>
Oct 26 00:03:02 user nova-compute[75165]:     <features>
Oct 26 00:03:02 user nova-compute[75165]:       <cpuselection/>
Oct 26 00:03:02 user nova-compute[75165]:       <deviceboot/>
Oct 26 00:03:02 user nova-compute[75165]:       <disksnapshot default='on' toggle='no'/>
Oct 26 00:03:02 user nova-compute[75165]:     </features>
Oct 26 00:03:02 user nova-compute[75165]:   </guest>
Oct 26 00:03:02 user nova-compute[75165]:   <guest>
Oct 26 00:03:02 user nova-compute[75165]:     <os_type>hvm</os_type>
Oct 26 00:03:02 user nova-compute[75165]:     <arch name='sh4'>
Oct 26 00:03:02 user nova-compute[75165]:       <wordsize>32</wordsize>
Oct 26 00:03:02 user nova-compute[75165]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>shix</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>r2d</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <domain type='qemu'/>
Oct 26 00:03:02 user nova-compute[75165]:     </arch>
Oct 26 00:03:02 user nova-compute[75165]:     <features>
Oct 26 00:03:02 user nova-compute[75165]:       <cpuselection/>
Oct 26 00:03:02 user nova-compute[75165]:       <deviceboot/>
Oct 26 00:03:02 user nova-compute[75165]:       <disksnapshot default='on' toggle='no'/>
Oct 26 00:03:02 user nova-compute[75165]:     </features>
Oct 26 00:03:02 user nova-compute[75165]:   </guest>
Oct 26 00:03:02 user nova-compute[75165]:   <guest>
Oct 26 00:03:02 user nova-compute[75165]:     <os_type>hvm</os_type>
Oct 26 00:03:02 user nova-compute[75165]:     <arch name='sh4eb'>
Oct 26 00:03:02 user nova-compute[75165]:       <wordsize>64</wordsize>
Oct 26 00:03:02 user nova-compute[75165]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>shix</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>r2d</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <domain type='qemu'/>
Oct 26 00:03:02 user nova-compute[75165]:     </arch>
Oct 26 00:03:02 user nova-compute[75165]:     <features>
Oct 26 00:03:02 user nova-compute[75165]:       <cpuselection/>
Oct 26 00:03:02 user nova-compute[75165]:       <deviceboot/>
Oct 26 00:03:02 user nova-compute[75165]:       <disksnapshot default='on' toggle='no'/>
Oct 26 00:03:02 user nova-compute[75165]:     </features>
Oct 26 00:03:02 user nova-compute[75165]:   </guest>
Oct 26 00:03:02 user nova-compute[75165]:   <guest>
Oct 26 00:03:02 user nova-compute[75165]:     <os_type>hvm</os_type>
Oct 26 00:03:02 user nova-compute[75165]:     <arch name='sparc'>
Oct 26 00:03:02 user nova-compute[75165]:       <wordsize>32</wordsize>
Oct 26 00:03:02 user nova-compute[75165]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>SS-5</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='4'>SS-20</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>LX</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>SPARCClassic</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>leon3_generic</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>SPARCbook</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>SS-4</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='4'>SS-600MP</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='4'>SS-10</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>Voyager</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <domain type='qemu'/>
Oct 26 00:03:02 user nova-compute[75165]:     </arch>
Oct 26 00:03:02 user nova-compute[75165]:     <features>
Oct 26 00:03:02 user nova-compute[75165]:       <cpuselection/>
Oct 26 00:03:02 user nova-compute[75165]:       <deviceboot/>
Oct 26 00:03:02 user nova-compute[75165]:       <disksnapshot default='on' toggle='no'/>
Oct 26 00:03:02 user nova-compute[75165]:     </features>
Oct 26 00:03:02 user nova-compute[75165]:   </guest>
Oct 26 00:03:02 user nova-compute[75165]:   <guest>
Oct 26 00:03:02 user nova-compute[75165]:     <os_type>hvm</os_type>
Oct 26 00:03:02 user nova-compute[75165]:     <arch name='sparc64'>
Oct 26 00:03:02 user nova-compute[75165]:       <wordsize>64</wordsize>
Oct 26 00:03:02 user nova-compute[75165]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>sun4u</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>niagara</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>sun4v</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <domain type='qemu'/>
Oct 26 00:03:02 user nova-compute[75165]:     </arch>
Oct 26 00:03:02 user nova-compute[75165]:     <features>
Oct 26 00:03:02 user nova-compute[75165]:       <cpuselection/>
Oct 26 00:03:02 user nova-compute[75165]:       <deviceboot/>
Oct 26 00:03:02 user nova-compute[75165]:       <disksnapshot default='on' toggle='no'/>
Oct 26 00:03:02 user nova-compute[75165]:     </features>
Oct 26 00:03:02 user nova-compute[75165]:   </guest>
Oct 26 00:03:02 user nova-compute[75165]:   <guest>
Oct 26 00:03:02 user nova-compute[75165]:     <os_type>hvm</os_type>
Oct 26 00:03:02 user nova-compute[75165]:     <arch name='x86_64'>
Oct 26 00:03:02 user nova-compute[75165]:       <wordsize>64</wordsize>
Oct 26 00:03:02 user nova-compute[75165]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='288'>pc-q35-artful</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>x-remote</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='1'>isapc</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='288'>pc-q35-disco</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='288'>pc-q35-impish</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='288'>pc-q35-focal</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='288'>microvm</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <domain type='qemu'/>
Oct 26 00:03:02 user nova-compute[75165]:       <domain type='kvm'/>
Oct 26 00:03:02 user nova-compute[75165]:     </arch>
Oct 26 00:03:02 user nova-compute[75165]:     <features>
Oct 26 00:03:02 user nova-compute[75165]:       <acpi default='on' toggle='yes'/>
Oct 26 00:03:02 user nova-compute[75165]:       <apic default='on' toggle='no'/>
Oct 26 00:03:02 user nova-compute[75165]:       <cpuselection/>
Oct 26 00:03:02 user nova-compute[75165]:       <deviceboot/>
Oct 26 00:03:02 user nova-compute[75165]:       <disksnapshot default='on' toggle='no'/>
Oct 26 00:03:02 user nova-compute[75165]:     </features>
Oct 26 00:03:02 user nova-compute[75165]:   </guest>
Oct 26 00:03:02 user nova-compute[75165]:   <guest>
Oct 26 00:03:02 user nova-compute[75165]:     <os_type>hvm</os_type>
Oct 26 00:03:02 user nova-compute[75165]:     <arch name='xtensa'>
Oct 26 00:03:02 user nova-compute[75165]:       <wordsize>32</wordsize>
Oct 26 00:03:02 user nova-compute[75165]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='4'>sim</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='32'>kc705</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='32'>ml605</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='32'>ml605-nommu</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='32'>virt</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='32'>lx60-nommu</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='32'>lx200</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='32'>lx200-nommu</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='32'>lx60</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='32'>kc705-nommu</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <domain type='qemu'/>
Oct 26 00:03:02 user nova-compute[75165]:     </arch>
Oct 26 00:03:02 user nova-compute[75165]:     <features>
Oct 26 00:03:02 user nova-compute[75165]:       <cpuselection/>
Oct 26 00:03:02 user nova-compute[75165]:       <deviceboot/>
Oct 26 00:03:02 user nova-compute[75165]:       <disksnapshot default='on' toggle='no'/>
Oct 26 00:03:02 user nova-compute[75165]:     </features>
Oct 26 00:03:02 user nova-compute[75165]:   </guest>
Oct 26 00:03:02 user nova-compute[75165]:   <guest>
Oct 26 00:03:02 user nova-compute[75165]:     <os_type>hvm</os_type>
Oct 26 00:03:02 user nova-compute[75165]:     <arch name='xtensaeb'>
Oct 26 00:03:02 user nova-compute[75165]:       <wordsize>32</wordsize>
Oct 26 00:03:02 user nova-compute[75165]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='4'>sim</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='32'>kc705</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='32'>ml605</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='32'>ml605-nommu</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='32'>virt</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='32'>lx60-nommu</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='32'>lx200</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='32'>lx200-nommu</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='32'>lx60</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <machine maxCpus='32'>kc705-nommu</machine>
Oct 26 00:03:02 user nova-compute[75165]:       <domain type='qemu'/>
Oct 26 00:03:02 user nova-compute[75165]:     </arch>
Oct 26 00:03:02 user nova-compute[75165]:     <features>
Oct 26 00:03:02 user nova-compute[75165]:       <cpuselection/>
Oct 26 00:03:02 user nova-compute[75165]:       <deviceboot/>
Oct 26 00:03:02 user nova-compute[75165]:       <disksnapshot default='on' toggle='no'/>
Oct 26 00:03:02 user nova-compute[75165]:     </features>
Oct 26 00:03:02 user nova-compute[75165]:   </guest>
Oct 26 00:03:02 user nova-compute[75165]: </capabilities>
Oct 26 00:03:02 user nova-compute[75165]: 
Oct 26 00:03:02 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-a2276838-4303-4694-b734-014de1e95741 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=75165) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 00:03:02 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-a2276838-4303-4694-b734-014de1e95741 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=75165) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 00:03:02 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-a2276838-4303-4694-b734-014de1e95741 None None] Getting domain capabilities for armv6l via machine types: {None, 'virt'} {{(pid=75165) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 00:03:02 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-a2276838-4303-4694-b734-014de1e95741 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75165) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 00:03:02 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-a2276838-4303-4694-b734-014de1e95741 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75165) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 00:03:02 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-a2276838-4303-4694-b734-014de1e95741 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=75165) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 00:03:02 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-a2276838-4303-4694-b734-014de1e95741 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75165) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 00:03:02 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-a2276838-4303-4694-b734-014de1e95741 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=75165) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 00:03:02 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-a2276838-4303-4694-b734-014de1e95741 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=75165) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 00:03:02 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-a2276838-4303-4694-b734-014de1e95741 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=75165) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 00:03:02 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-a2276838-4303-4694-b734-014de1e95741 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=75165) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 00:03:02 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-a2276838-4303-4694-b734-014de1e95741 None None] Getting domain capabilities for i686 via machine types: {'ubuntu', 'q35', 'ubuntu-q35', 'pc'} {{(pid=75165) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 00:03:02 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-a2276838-4303-4694-b734-014de1e95741 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Oct 26 00:03:02 user nova-compute[75165]: <domainCapabilities>
Oct 26 00:03:02 user nova-compute[75165]:   <path>/usr/bin/qemu-system-i386</path>
Oct 26 00:03:02 user nova-compute[75165]:   <domain>kvm</domain>
Oct 26 00:03:02 user nova-compute[75165]:   <machine>pc-i440fx-jammy</machine>
Oct 26 00:03:02 user nova-compute[75165]:   <arch>i686</arch>
Oct 26 00:03:02 user nova-compute[75165]:   <vcpu max='255'/>
Oct 26 00:03:02 user nova-compute[75165]:   <iothreads supported='yes'/>
Oct 26 00:03:02 user nova-compute[75165]:   <os supported='yes'>
Oct 26 00:03:02 user nova-compute[75165]:     <enum name='firmware'/>
Oct 26 00:03:02 user nova-compute[75165]:     <loader supported='yes'>
Oct 26 00:03:02 user nova-compute[75165]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Oct 26 00:03:02 user nova-compute[75165]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Oct 26 00:03:02 user nova-compute[75165]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Oct 26 00:03:02 user nova-compute[75165]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Oct 26 00:03:02 user nova-compute[75165]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Oct 26 00:03:02 user nova-compute[75165]:       <enum name='type'>
Oct 26 00:03:02 user nova-compute[75165]:         <value>rom</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>pflash</value>
Oct 26 00:03:02 user nova-compute[75165]:       </enum>
Oct 26 00:03:02 user nova-compute[75165]:       <enum name='readonly'>
Oct 26 00:03:02 user nova-compute[75165]:         <value>yes</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>no</value>
Oct 26 00:03:02 user nova-compute[75165]:       </enum>
Oct 26 00:03:02 user nova-compute[75165]:       <enum name='secure'>
Oct 26 00:03:02 user nova-compute[75165]:         <value>no</value>
Oct 26 00:03:02 user nova-compute[75165]:       </enum>
Oct 26 00:03:02 user nova-compute[75165]:     </loader>
Oct 26 00:03:02 user nova-compute[75165]:   </os>
Oct 26 00:03:02 user nova-compute[75165]:   <cpu>
Oct 26 00:03:02 user nova-compute[75165]:     <mode name='host-passthrough' supported='yes'>
Oct 26 00:03:02 user nova-compute[75165]:       <enum name='hostPassthroughMigratable'>
Oct 26 00:03:02 user nova-compute[75165]:         <value>off</value>
Oct 26 00:03:02 user nova-compute[75165]:       </enum>
Oct 26 00:03:02 user nova-compute[75165]:     </mode>
Oct 26 00:03:02 user nova-compute[75165]:     <mode name='maximum' supported='yes'>
Oct 26 00:03:02 user nova-compute[75165]:       <enum name='maximumMigratable'>
Oct 26 00:03:02 user nova-compute[75165]:         <value>on</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>off</value>
Oct 26 00:03:02 user nova-compute[75165]:       </enum>
Oct 26 00:03:02 user nova-compute[75165]:     </mode>
Oct 26 00:03:02 user nova-compute[75165]:     <mode name='host-model' supported='yes'>
Oct 26 00:03:02 user nova-compute[75165]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 26 00:03:02 user nova-compute[75165]:       <vendor>Intel</vendor>
Oct 26 00:03:02 user nova-compute[75165]:       <feature policy='require' name='ss'/>
Oct 26 00:03:02 user nova-compute[75165]:       <feature policy='require' name='vmx'/>
Oct 26 00:03:02 user nova-compute[75165]:       <feature policy='require' name='pcid'/>
Oct 26 00:03:02 user nova-compute[75165]:       <feature policy='require' name='hypervisor'/>
Oct 26 00:03:02 user nova-compute[75165]:       <feature policy='require' name='arat'/>
Oct 26 00:03:02 user nova-compute[75165]:       <feature policy='require' name='tsc_adjust'/>
Oct 26 00:03:02 user nova-compute[75165]:       <feature policy='require' name='umip'/>
Oct 26 00:03:02 user nova-compute[75165]:       <feature policy='require' name='md-clear'/>
Oct 26 00:03:02 user nova-compute[75165]:       <feature policy='require' name='stibp'/>
Oct 26 00:03:02 user nova-compute[75165]:       <feature policy='require' name='arch-capabilities'/>
Oct 26 00:03:02 user nova-compute[75165]:       <feature policy='require' name='ssbd'/>
Oct 26 00:03:02 user nova-compute[75165]:       <feature policy='require' name='ibpb'/>
Oct 26 00:03:02 user nova-compute[75165]:       <feature policy='require' name='ibrs'/>
Oct 26 00:03:02 user nova-compute[75165]:       <feature policy='require' name='amd-stibp'/>
Oct 26 00:03:02 user nova-compute[75165]:       <feature policy='require' name='amd-ssbd'/>
Oct 26 00:03:02 user nova-compute[75165]:       <feature policy='disable' name='erms'/>
Oct 26 00:03:02 user nova-compute[75165]:       <feature policy='disable' name='xsaveopt'/>
Oct 26 00:03:02 user nova-compute[75165]:       <feature policy='disable' name='lm'/>
Oct 26 00:03:02 user nova-compute[75165]:     </mode>
Oct 26 00:03:02 user nova-compute[75165]:     <mode name='custom' supported='yes'>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>qemu64</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='yes'>qemu32</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>phenom</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='yes'>pentium3</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='yes'>pentium2</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='yes'>pentium</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>n270</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>kvm64</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='yes'>kvm32</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='yes'>coreduo</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>core2duo</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>athlon</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Westmere-IBRS</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Westmere</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Snowridge</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Skylake-Server</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Skylake-Client</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>SandyBridge</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Penryn</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Opteron_G5</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Opteron_G4</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Opteron_G3</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Opteron_G2</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Opteron_G1</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Nehalem-IBRS</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Nehalem</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>IvyBridge</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Icelake-Server</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Haswell-noTSX</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Haswell-IBRS</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Haswell</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>EPYC-Rome</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>EPYC-Milan</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>EPYC-IBPB</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>EPYC</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Dhyana</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Cooperlake</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Conroe</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Cascadelake-Server</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Broadwell-noTSX</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Broadwell-IBRS</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Broadwell</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='yes'>486</model>
Oct 26 00:03:02 user nova-compute[75165]:     </mode>
Oct 26 00:03:02 user nova-compute[75165]:   </cpu>
Oct 26 00:03:02 user nova-compute[75165]:   <memoryBacking supported='yes'>
Oct 26 00:03:02 user nova-compute[75165]:     <enum name='sourceType'>
Oct 26 00:03:02 user nova-compute[75165]:       <value>file</value>
Oct 26 00:03:02 user nova-compute[75165]:       <value>anonymous</value>
Oct 26 00:03:02 user nova-compute[75165]:       <value>memfd</value>
Oct 26 00:03:02 user nova-compute[75165]:     </enum>
Oct 26 00:03:02 user nova-compute[75165]:   </memoryBacking>
Oct 26 00:03:02 user nova-compute[75165]:   <devices>
Oct 26 00:03:02 user nova-compute[75165]:     <disk supported='yes'>
Oct 26 00:03:02 user nova-compute[75165]:       <enum name='diskDevice'>
Oct 26 00:03:02 user nova-compute[75165]:         <value>disk</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>cdrom</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>floppy</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>lun</value>
Oct 26 00:03:02 user nova-compute[75165]:       </enum>
Oct 26 00:03:02 user nova-compute[75165]:       <enum name='bus'>
Oct 26 00:03:02 user nova-compute[75165]:         <value>ide</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>fdc</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>scsi</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>virtio</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>usb</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>sata</value>
Oct 26 00:03:02 user nova-compute[75165]:       </enum>
Oct 26 00:03:02 user nova-compute[75165]:       <enum name='model'>
Oct 26 00:03:02 user nova-compute[75165]:         <value>virtio</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>virtio-transitional</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>virtio-non-transitional</value>
Oct 26 00:03:02 user nova-compute[75165]:       </enum>
Oct 26 00:03:02 user nova-compute[75165]:     </disk>
Oct 26 00:03:02 user nova-compute[75165]:     <graphics supported='yes'>
Oct 26 00:03:02 user nova-compute[75165]:       <enum name='type'>
Oct 26 00:03:02 user nova-compute[75165]:         <value>sdl</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>vnc</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>spice</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>egl-headless</value>
Oct 26 00:03:02 user nova-compute[75165]:       </enum>
Oct 26 00:03:02 user nova-compute[75165]:     </graphics>
Oct 26 00:03:02 user nova-compute[75165]:     <video supported='yes'>
Oct 26 00:03:02 user nova-compute[75165]:       <enum name='modelType'>
Oct 26 00:03:02 user nova-compute[75165]:         <value>vga</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>cirrus</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>vmvga</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>qxl</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>virtio</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>none</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>bochs</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>ramfb</value>
Oct 26 00:03:02 user nova-compute[75165]:       </enum>
Oct 26 00:03:02 user nova-compute[75165]:     </video>
Oct 26 00:03:02 user nova-compute[75165]:     <hostdev supported='yes'>
Oct 26 00:03:02 user nova-compute[75165]:       <enum name='mode'>
Oct 26 00:03:02 user nova-compute[75165]:         <value>subsystem</value>
Oct 26 00:03:02 user nova-compute[75165]:       </enum>
Oct 26 00:03:02 user nova-compute[75165]:       <enum name='startupPolicy'>
Oct 26 00:03:02 user nova-compute[75165]:         <value>default</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>mandatory</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>requisite</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>optional</value>
Oct 26 00:03:02 user nova-compute[75165]:       </enum>
Oct 26 00:03:02 user nova-compute[75165]:       <enum name='subsysType'>
Oct 26 00:03:02 user nova-compute[75165]:         <value>usb</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>pci</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>scsi</value>
Oct 26 00:03:02 user nova-compute[75165]:       </enum>
Oct 26 00:03:02 user nova-compute[75165]:       <enum name='capsType'/>
Oct 26 00:03:02 user nova-compute[75165]:       <enum name='pciBackend'/>
Oct 26 00:03:02 user nova-compute[75165]:     </hostdev>
Oct 26 00:03:02 user nova-compute[75165]:     <rng supported='yes'>
Oct 26 00:03:02 user nova-compute[75165]:       <enum name='model'>
Oct 26 00:03:02 user nova-compute[75165]:         <value>virtio</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>virtio-transitional</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>virtio-non-transitional</value>
Oct 26 00:03:02 user nova-compute[75165]:       </enum>
Oct 26 00:03:02 user nova-compute[75165]:       <enum name='backendModel'>
Oct 26 00:03:02 user nova-compute[75165]:         <value>random</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>egd</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>builtin</value>
Oct 26 00:03:02 user nova-compute[75165]:       </enum>
Oct 26 00:03:02 user nova-compute[75165]:     </rng>
Oct 26 00:03:02 user nova-compute[75165]:     <filesystem supported='yes'>
Oct 26 00:03:02 user nova-compute[75165]:       <enum name='driverType'>
Oct 26 00:03:02 user nova-compute[75165]:         <value>path</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>handle</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>virtiofs</value>
Oct 26 00:03:02 user nova-compute[75165]:       </enum>
Oct 26 00:03:02 user nova-compute[75165]:     </filesystem>
Oct 26 00:03:02 user nova-compute[75165]:     <tpm supported='yes'>
Oct 26 00:03:02 user nova-compute[75165]:       <enum name='model'>
Oct 26 00:03:02 user nova-compute[75165]:         <value>tpm-tis</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>tpm-crb</value>
Oct 26 00:03:02 user nova-compute[75165]:       </enum>
Oct 26 00:03:02 user nova-compute[75165]:       <enum name='backendModel'>
Oct 26 00:03:02 user nova-compute[75165]:         <value>passthrough</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>emulator</value>
Oct 26 00:03:02 user nova-compute[75165]:       </enum>
Oct 26 00:03:02 user nova-compute[75165]:     </tpm>
Oct 26 00:03:02 user nova-compute[75165]:   </devices>
Oct 26 00:03:02 user nova-compute[75165]:   <features>
Oct 26 00:03:02 user nova-compute[75165]:     <gic supported='no'/>
Oct 26 00:03:02 user nova-compute[75165]:     <vmcoreinfo supported='yes'/>
Oct 26 00:03:02 user nova-compute[75165]:     <genid supported='yes'/>
Oct 26 00:03:02 user nova-compute[75165]:     <backingStoreInput supported='yes'/>
Oct 26 00:03:02 user nova-compute[75165]:     <backup supported='yes'/>
Oct 26 00:03:02 user nova-compute[75165]:     <sev supported='no'/>
Oct 26 00:03:02 user nova-compute[75165]:   </features>
Oct 26 00:03:02 user nova-compute[75165]: </domainCapabilities>
Oct 26 00:03:02 user nova-compute[75165]:  {{(pid=75165) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 26 00:03:02 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-a2276838-4303-4694-b734-014de1e95741 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Oct 26 00:03:02 user nova-compute[75165]: <domainCapabilities>
Oct 26 00:03:02 user nova-compute[75165]:   <path>/usr/bin/qemu-system-i386</path>
Oct 26 00:03:02 user nova-compute[75165]:   <domain>kvm</domain>
Oct 26 00:03:02 user nova-compute[75165]:   <machine>pc-q35-6.2</machine>
Oct 26 00:03:02 user nova-compute[75165]:   <arch>i686</arch>
Oct 26 00:03:02 user nova-compute[75165]:   <vcpu max='288'/>
Oct 26 00:03:02 user nova-compute[75165]:   <iothreads supported='yes'/>
Oct 26 00:03:02 user nova-compute[75165]:   <os supported='yes'>
Oct 26 00:03:02 user nova-compute[75165]:     <enum name='firmware'/>
Oct 26 00:03:02 user nova-compute[75165]:     <loader supported='yes'>
Oct 26 00:03:02 user nova-compute[75165]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Oct 26 00:03:02 user nova-compute[75165]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Oct 26 00:03:02 user nova-compute[75165]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Oct 26 00:03:02 user nova-compute[75165]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Oct 26 00:03:02 user nova-compute[75165]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Oct 26 00:03:02 user nova-compute[75165]:       <enum name='type'>
Oct 26 00:03:02 user nova-compute[75165]:         <value>rom</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>pflash</value>
Oct 26 00:03:02 user nova-compute[75165]:       </enum>
Oct 26 00:03:02 user nova-compute[75165]:       <enum name='readonly'>
Oct 26 00:03:02 user nova-compute[75165]:         <value>yes</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>no</value>
Oct 26 00:03:02 user nova-compute[75165]:       </enum>
Oct 26 00:03:02 user nova-compute[75165]:       <enum name='secure'>
Oct 26 00:03:02 user nova-compute[75165]:         <value>no</value>
Oct 26 00:03:02 user nova-compute[75165]:       </enum>
Oct 26 00:03:02 user nova-compute[75165]:     </loader>
Oct 26 00:03:02 user nova-compute[75165]:   </os>
Oct 26 00:03:02 user nova-compute[75165]:   <cpu>
Oct 26 00:03:02 user nova-compute[75165]:     <mode name='host-passthrough' supported='yes'>
Oct 26 00:03:02 user nova-compute[75165]:       <enum name='hostPassthroughMigratable'>
Oct 26 00:03:02 user nova-compute[75165]:         <value>off</value>
Oct 26 00:03:02 user nova-compute[75165]:       </enum>
Oct 26 00:03:02 user nova-compute[75165]:     </mode>
Oct 26 00:03:02 user nova-compute[75165]:     <mode name='maximum' supported='yes'>
Oct 26 00:03:02 user nova-compute[75165]:       <enum name='maximumMigratable'>
Oct 26 00:03:02 user nova-compute[75165]:         <value>on</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>off</value>
Oct 26 00:03:02 user nova-compute[75165]:       </enum>
Oct 26 00:03:02 user nova-compute[75165]:     </mode>
Oct 26 00:03:02 user nova-compute[75165]:     <mode name='host-model' supported='yes'>
Oct 26 00:03:02 user nova-compute[75165]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 26 00:03:02 user nova-compute[75165]:       <vendor>Intel</vendor>
Oct 26 00:03:02 user nova-compute[75165]:       <feature policy='require' name='ss'/>
Oct 26 00:03:02 user nova-compute[75165]:       <feature policy='require' name='vmx'/>
Oct 26 00:03:02 user nova-compute[75165]:       <feature policy='require' name='pcid'/>
Oct 26 00:03:02 user nova-compute[75165]:       <feature policy='require' name='hypervisor'/>
Oct 26 00:03:02 user nova-compute[75165]:       <feature policy='require' name='arat'/>
Oct 26 00:03:02 user nova-compute[75165]:       <feature policy='require' name='tsc_adjust'/>
Oct 26 00:03:02 user nova-compute[75165]:       <feature policy='require' name='umip'/>
Oct 26 00:03:02 user nova-compute[75165]:       <feature policy='require' name='md-clear'/>
Oct 26 00:03:02 user nova-compute[75165]:       <feature policy='require' name='stibp'/>
Oct 26 00:03:02 user nova-compute[75165]:       <feature policy='require' name='arch-capabilities'/>
Oct 26 00:03:02 user nova-compute[75165]:       <feature policy='require' name='ssbd'/>
Oct 26 00:03:02 user nova-compute[75165]:       <feature policy='require' name='ibpb'/>
Oct 26 00:03:02 user nova-compute[75165]:       <feature policy='require' name='ibrs'/>
Oct 26 00:03:02 user nova-compute[75165]:       <feature policy='require' name='amd-stibp'/>
Oct 26 00:03:02 user nova-compute[75165]:       <feature policy='require' name='amd-ssbd'/>
Oct 26 00:03:02 user nova-compute[75165]:       <feature policy='disable' name='erms'/>
Oct 26 00:03:02 user nova-compute[75165]:       <feature policy='disable' name='xsaveopt'/>
Oct 26 00:03:02 user nova-compute[75165]:       <feature policy='disable' name='lm'/>
Oct 26 00:03:02 user nova-compute[75165]:     </mode>
Oct 26 00:03:02 user nova-compute[75165]:     <mode name='custom' supported='yes'>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>qemu64</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='yes'>qemu32</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>phenom</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='yes'>pentium3</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='yes'>pentium2</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='yes'>pentium</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>n270</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>kvm64</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='yes'>kvm32</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='yes'>coreduo</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>core2duo</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>athlon</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Westmere-IBRS</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Westmere</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Snowridge</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Skylake-Server</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Skylake-Client</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>SandyBridge</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Penryn</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Opteron_G5</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Opteron_G4</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Opteron_G3</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Opteron_G2</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Opteron_G1</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Nehalem-IBRS</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Nehalem</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>IvyBridge</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Icelake-Server</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Haswell-noTSX</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Haswell-IBRS</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Haswell</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>EPYC-Rome</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>EPYC-Milan</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>EPYC-IBPB</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>EPYC</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Dhyana</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Cooperlake</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Conroe</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Cascadelake-Server</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Broadwell-noTSX</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Broadwell-IBRS</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Broadwell</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='yes'>486</model>
Oct 26 00:03:02 user nova-compute[75165]:     </mode>
Oct 26 00:03:02 user nova-compute[75165]:   </cpu>
Oct 26 00:03:02 user nova-compute[75165]:   <memoryBacking supported='yes'>
Oct 26 00:03:02 user nova-compute[75165]:     <enum name='sourceType'>
Oct 26 00:03:02 user nova-compute[75165]:       <value>file</value>
Oct 26 00:03:02 user nova-compute[75165]:       <value>anonymous</value>
Oct 26 00:03:02 user nova-compute[75165]:       <value>memfd</value>
Oct 26 00:03:02 user nova-compute[75165]:     </enum>
Oct 26 00:03:02 user nova-compute[75165]:   </memoryBacking>
Oct 26 00:03:02 user nova-compute[75165]:   <devices>
Oct 26 00:03:02 user nova-compute[75165]:     <disk supported='yes'>
Oct 26 00:03:02 user nova-compute[75165]:       <enum name='diskDevice'>
Oct 26 00:03:02 user nova-compute[75165]:         <value>disk</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>cdrom</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>floppy</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>lun</value>
Oct 26 00:03:02 user nova-compute[75165]:       </enum>
Oct 26 00:03:02 user nova-compute[75165]:       <enum name='bus'>
Oct 26 00:03:02 user nova-compute[75165]:         <value>fdc</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>scsi</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>virtio</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>usb</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>sata</value>
Oct 26 00:03:02 user nova-compute[75165]:       </enum>
Oct 26 00:03:02 user nova-compute[75165]:       <enum name='model'>
Oct 26 00:03:02 user nova-compute[75165]:         <value>virtio</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>virtio-transitional</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>virtio-non-transitional</value>
Oct 26 00:03:02 user nova-compute[75165]:       </enum>
Oct 26 00:03:02 user nova-compute[75165]:     </disk>
Oct 26 00:03:02 user nova-compute[75165]:     <graphics supported='yes'>
Oct 26 00:03:02 user nova-compute[75165]:       <enum name='type'>
Oct 26 00:03:02 user nova-compute[75165]:         <value>sdl</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>vnc</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>spice</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>egl-headless</value>
Oct 26 00:03:02 user nova-compute[75165]:       </enum>
Oct 26 00:03:02 user nova-compute[75165]:     </graphics>
Oct 26 00:03:02 user nova-compute[75165]:     <video supported='yes'>
Oct 26 00:03:02 user nova-compute[75165]:       <enum name='modelType'>
Oct 26 00:03:02 user nova-compute[75165]:         <value>vga</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>cirrus</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>vmvga</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>qxl</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>virtio</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>none</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>bochs</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>ramfb</value>
Oct 26 00:03:02 user nova-compute[75165]:       </enum>
Oct 26 00:03:02 user nova-compute[75165]:     </video>
Oct 26 00:03:02 user nova-compute[75165]:     <hostdev supported='yes'>
Oct 26 00:03:02 user nova-compute[75165]:       <enum name='mode'>
Oct 26 00:03:02 user nova-compute[75165]:         <value>subsystem</value>
Oct 26 00:03:02 user nova-compute[75165]:       </enum>
Oct 26 00:03:02 user nova-compute[75165]:       <enum name='startupPolicy'>
Oct 26 00:03:02 user nova-compute[75165]:         <value>default</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>mandatory</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>requisite</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>optional</value>
Oct 26 00:03:02 user nova-compute[75165]:       </enum>
Oct 26 00:03:02 user nova-compute[75165]:       <enum name='subsysType'>
Oct 26 00:03:02 user nova-compute[75165]:         <value>usb</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>pci</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>scsi</value>
Oct 26 00:03:02 user nova-compute[75165]:       </enum>
Oct 26 00:03:02 user nova-compute[75165]:       <enum name='capsType'/>
Oct 26 00:03:02 user nova-compute[75165]:       <enum name='pciBackend'/>
Oct 26 00:03:02 user nova-compute[75165]:     </hostdev>
Oct 26 00:03:02 user nova-compute[75165]:     <rng supported='yes'>
Oct 26 00:03:02 user nova-compute[75165]:       <enum name='model'>
Oct 26 00:03:02 user nova-compute[75165]:         <value>virtio</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>virtio-transitional</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>virtio-non-transitional</value>
Oct 26 00:03:02 user nova-compute[75165]:       </enum>
Oct 26 00:03:02 user nova-compute[75165]:       <enum name='backendModel'>
Oct 26 00:03:02 user nova-compute[75165]:         <value>random</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>egd</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>builtin</value>
Oct 26 00:03:02 user nova-compute[75165]:       </enum>
Oct 26 00:03:02 user nova-compute[75165]:     </rng>
Oct 26 00:03:02 user nova-compute[75165]:     <filesystem supported='yes'>
Oct 26 00:03:02 user nova-compute[75165]:       <enum name='driverType'>
Oct 26 00:03:02 user nova-compute[75165]:         <value>path</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>handle</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>virtiofs</value>
Oct 26 00:03:02 user nova-compute[75165]:       </enum>
Oct 26 00:03:02 user nova-compute[75165]:     </filesystem>
Oct 26 00:03:02 user nova-compute[75165]:     <tpm supported='yes'>
Oct 26 00:03:02 user nova-compute[75165]:       <enum name='model'>
Oct 26 00:03:02 user nova-compute[75165]:         <value>tpm-tis</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>tpm-crb</value>
Oct 26 00:03:02 user nova-compute[75165]:       </enum>
Oct 26 00:03:02 user nova-compute[75165]:       <enum name='backendModel'>
Oct 26 00:03:02 user nova-compute[75165]:         <value>passthrough</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>emulator</value>
Oct 26 00:03:02 user nova-compute[75165]:       </enum>
Oct 26 00:03:02 user nova-compute[75165]:     </tpm>
Oct 26 00:03:02 user nova-compute[75165]:   </devices>
Oct 26 00:03:02 user nova-compute[75165]:   <features>
Oct 26 00:03:02 user nova-compute[75165]:     <gic supported='no'/>
Oct 26 00:03:02 user nova-compute[75165]:     <vmcoreinfo supported='yes'/>
Oct 26 00:03:02 user nova-compute[75165]:     <genid supported='yes'/>
Oct 26 00:03:02 user nova-compute[75165]:     <backingStoreInput supported='yes'/>
Oct 26 00:03:02 user nova-compute[75165]:     <backup supported='yes'/>
Oct 26 00:03:02 user nova-compute[75165]:     <sev supported='no'/>
Oct 26 00:03:02 user nova-compute[75165]:   </features>
Oct 26 00:03:02 user nova-compute[75165]: </domainCapabilities>
Oct 26 00:03:02 user nova-compute[75165]:  {{(pid=75165) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 26 00:03:02 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-a2276838-4303-4694-b734-014de1e95741 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Oct 26 00:03:02 user nova-compute[75165]: <domainCapabilities>
Oct 26 00:03:02 user nova-compute[75165]:   <path>/usr/bin/qemu-system-i386</path>
Oct 26 00:03:02 user nova-compute[75165]:   <domain>kvm</domain>
Oct 26 00:03:02 user nova-compute[75165]:   <machine>pc-q35-jammy</machine>
Oct 26 00:03:02 user nova-compute[75165]:   <arch>i686</arch>
Oct 26 00:03:02 user nova-compute[75165]:   <vcpu max='288'/>
Oct 26 00:03:02 user nova-compute[75165]:   <iothreads supported='yes'/>
Oct 26 00:03:02 user nova-compute[75165]:   <os supported='yes'>
Oct 26 00:03:02 user nova-compute[75165]:     <enum name='firmware'/>
Oct 26 00:03:02 user nova-compute[75165]:     <loader supported='yes'>
Oct 26 00:03:02 user nova-compute[75165]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Oct 26 00:03:02 user nova-compute[75165]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Oct 26 00:03:02 user nova-compute[75165]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Oct 26 00:03:02 user nova-compute[75165]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Oct 26 00:03:02 user nova-compute[75165]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Oct 26 00:03:02 user nova-compute[75165]:       <enum name='type'>
Oct 26 00:03:02 user nova-compute[75165]:         <value>rom</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>pflash</value>
Oct 26 00:03:02 user nova-compute[75165]:       </enum>
Oct 26 00:03:02 user nova-compute[75165]:       <enum name='readonly'>
Oct 26 00:03:02 user nova-compute[75165]:         <value>yes</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>no</value>
Oct 26 00:03:02 user nova-compute[75165]:       </enum>
Oct 26 00:03:02 user nova-compute[75165]:       <enum name='secure'>
Oct 26 00:03:02 user nova-compute[75165]:         <value>no</value>
Oct 26 00:03:02 user nova-compute[75165]:       </enum>
Oct 26 00:03:02 user nova-compute[75165]:     </loader>
Oct 26 00:03:02 user nova-compute[75165]:   </os>
Oct 26 00:03:02 user nova-compute[75165]:   <cpu>
Oct 26 00:03:02 user nova-compute[75165]:     <mode name='host-passthrough' supported='yes'>
Oct 26 00:03:02 user nova-compute[75165]:       <enum name='hostPassthroughMigratable'>
Oct 26 00:03:02 user nova-compute[75165]:         <value>off</value>
Oct 26 00:03:02 user nova-compute[75165]:       </enum>
Oct 26 00:03:02 user nova-compute[75165]:     </mode>
Oct 26 00:03:02 user nova-compute[75165]:     <mode name='maximum' supported='yes'>
Oct 26 00:03:02 user nova-compute[75165]:       <enum name='maximumMigratable'>
Oct 26 00:03:02 user nova-compute[75165]:         <value>on</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>off</value>
Oct 26 00:03:02 user nova-compute[75165]:       </enum>
Oct 26 00:03:02 user nova-compute[75165]:     </mode>
Oct 26 00:03:02 user nova-compute[75165]:     <mode name='host-model' supported='yes'>
Oct 26 00:03:02 user nova-compute[75165]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 26 00:03:02 user nova-compute[75165]:       <vendor>Intel</vendor>
Oct 26 00:03:02 user nova-compute[75165]:       <feature policy='require' name='ss'/>
Oct 26 00:03:02 user nova-compute[75165]:       <feature policy='require' name='vmx'/>
Oct 26 00:03:02 user nova-compute[75165]:       <feature policy='require' name='pcid'/>
Oct 26 00:03:02 user nova-compute[75165]:       <feature policy='require' name='hypervisor'/>
Oct 26 00:03:02 user nova-compute[75165]:       <feature policy='require' name='arat'/>
Oct 26 00:03:02 user nova-compute[75165]:       <feature policy='require' name='tsc_adjust'/>
Oct 26 00:03:02 user nova-compute[75165]:       <feature policy='require' name='umip'/>
Oct 26 00:03:02 user nova-compute[75165]:       <feature policy='require' name='md-clear'/>
Oct 26 00:03:02 user nova-compute[75165]:       <feature policy='require' name='stibp'/>
Oct 26 00:03:02 user nova-compute[75165]:       <feature policy='require' name='arch-capabilities'/>
Oct 26 00:03:02 user nova-compute[75165]:       <feature policy='require' name='ssbd'/>
Oct 26 00:03:02 user nova-compute[75165]:       <feature policy='require' name='ibpb'/>
Oct 26 00:03:02 user nova-compute[75165]:       <feature policy='require' name='ibrs'/>
Oct 26 00:03:02 user nova-compute[75165]:       <feature policy='require' name='amd-stibp'/>
Oct 26 00:03:02 user nova-compute[75165]:       <feature policy='require' name='amd-ssbd'/>
Oct 26 00:03:02 user nova-compute[75165]:       <feature policy='disable' name='erms'/>
Oct 26 00:03:02 user nova-compute[75165]:       <feature policy='disable' name='xsaveopt'/>
Oct 26 00:03:02 user nova-compute[75165]:       <feature policy='disable' name='lm'/>
Oct 26 00:03:02 user nova-compute[75165]:     </mode>
Oct 26 00:03:02 user nova-compute[75165]:     <mode name='custom' supported='yes'>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>qemu64</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='yes'>qemu32</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>phenom</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='yes'>pentium3</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='yes'>pentium2</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='yes'>pentium</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>n270</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>kvm64</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='yes'>kvm32</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='yes'>coreduo</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>core2duo</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>athlon</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Westmere-IBRS</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Westmere</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Snowridge</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Skylake-Server</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Skylake-Client</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>SandyBridge</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Penryn</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Opteron_G5</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Opteron_G4</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Opteron_G3</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Opteron_G2</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Opteron_G1</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Nehalem-IBRS</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Nehalem</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>IvyBridge</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Icelake-Server</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Haswell-noTSX</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Haswell-IBRS</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Haswell</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>EPYC-Rome</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>EPYC-Milan</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>EPYC-IBPB</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>EPYC</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Dhyana</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Cooperlake</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Conroe</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Cascadelake-Server</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Broadwell-noTSX</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Broadwell-IBRS</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Broadwell</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='yes'>486</model>
Oct 26 00:03:02 user nova-compute[75165]:     </mode>
Oct 26 00:03:02 user nova-compute[75165]:   </cpu>
Oct 26 00:03:02 user nova-compute[75165]:   <memoryBacking supported='yes'>
Oct 26 00:03:02 user nova-compute[75165]:     <enum name='sourceType'>
Oct 26 00:03:02 user nova-compute[75165]:       <value>file</value>
Oct 26 00:03:02 user nova-compute[75165]:       <value>anonymous</value>
Oct 26 00:03:02 user nova-compute[75165]:       <value>memfd</value>
Oct 26 00:03:02 user nova-compute[75165]:     </enum>
Oct 26 00:03:02 user nova-compute[75165]:   </memoryBacking>
Oct 26 00:03:02 user nova-compute[75165]:   <devices>
Oct 26 00:03:02 user nova-compute[75165]:     <disk supported='yes'>
Oct 26 00:03:02 user nova-compute[75165]:       <enum name='diskDevice'>
Oct 26 00:03:02 user nova-compute[75165]:         <value>disk</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>cdrom</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>floppy</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>lun</value>
Oct 26 00:03:02 user nova-compute[75165]:       </enum>
Oct 26 00:03:02 user nova-compute[75165]:       <enum name='bus'>
Oct 26 00:03:02 user nova-compute[75165]:         <value>fdc</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>scsi</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>virtio</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>usb</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>sata</value>
Oct 26 00:03:02 user nova-compute[75165]:       </enum>
Oct 26 00:03:02 user nova-compute[75165]:       <enum name='model'>
Oct 26 00:03:02 user nova-compute[75165]:         <value>virtio</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>virtio-transitional</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>virtio-non-transitional</value>
Oct 26 00:03:02 user nova-compute[75165]:       </enum>
Oct 26 00:03:02 user nova-compute[75165]:     </disk>
Oct 26 00:03:02 user nova-compute[75165]:     <graphics supported='yes'>
Oct 26 00:03:02 user nova-compute[75165]:       <enum name='type'>
Oct 26 00:03:02 user nova-compute[75165]:         <value>sdl</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>vnc</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>spice</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>egl-headless</value>
Oct 26 00:03:02 user nova-compute[75165]:       </enum>
Oct 26 00:03:02 user nova-compute[75165]:     </graphics>
Oct 26 00:03:02 user nova-compute[75165]:     <video supported='yes'>
Oct 26 00:03:02 user nova-compute[75165]:       <enum name='modelType'>
Oct 26 00:03:02 user nova-compute[75165]:         <value>vga</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>cirrus</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>vmvga</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>qxl</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>virtio</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>none</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>bochs</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>ramfb</value>
Oct 26 00:03:02 user nova-compute[75165]:       </enum>
Oct 26 00:03:02 user nova-compute[75165]:     </video>
Oct 26 00:03:02 user nova-compute[75165]:     <hostdev supported='yes'>
Oct 26 00:03:02 user nova-compute[75165]:       <enum name='mode'>
Oct 26 00:03:02 user nova-compute[75165]:         <value>subsystem</value>
Oct 26 00:03:02 user nova-compute[75165]:       </enum>
Oct 26 00:03:02 user nova-compute[75165]:       <enum name='startupPolicy'>
Oct 26 00:03:02 user nova-compute[75165]:         <value>default</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>mandatory</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>requisite</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>optional</value>
Oct 26 00:03:02 user nova-compute[75165]:       </enum>
Oct 26 00:03:02 user nova-compute[75165]:       <enum name='subsysType'>
Oct 26 00:03:02 user nova-compute[75165]:         <value>usb</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>pci</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>scsi</value>
Oct 26 00:03:02 user nova-compute[75165]:       </enum>
Oct 26 00:03:02 user nova-compute[75165]:       <enum name='capsType'/>
Oct 26 00:03:02 user nova-compute[75165]:       <enum name='pciBackend'/>
Oct 26 00:03:02 user nova-compute[75165]:     </hostdev>
Oct 26 00:03:02 user nova-compute[75165]:     <rng supported='yes'>
Oct 26 00:03:02 user nova-compute[75165]:       <enum name='model'>
Oct 26 00:03:02 user nova-compute[75165]:         <value>virtio</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>virtio-transitional</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>virtio-non-transitional</value>
Oct 26 00:03:02 user nova-compute[75165]:       </enum>
Oct 26 00:03:02 user nova-compute[75165]:       <enum name='backendModel'>
Oct 26 00:03:02 user nova-compute[75165]:         <value>random</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>egd</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>builtin</value>
Oct 26 00:03:02 user nova-compute[75165]:       </enum>
Oct 26 00:03:02 user nova-compute[75165]:     </rng>
Oct 26 00:03:02 user nova-compute[75165]:     <filesystem supported='yes'>
Oct 26 00:03:02 user nova-compute[75165]:       <enum name='driverType'>
Oct 26 00:03:02 user nova-compute[75165]:         <value>path</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>handle</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>virtiofs</value>
Oct 26 00:03:02 user nova-compute[75165]:       </enum>
Oct 26 00:03:02 user nova-compute[75165]:     </filesystem>
Oct 26 00:03:02 user nova-compute[75165]:     <tpm supported='yes'>
Oct 26 00:03:02 user nova-compute[75165]:       <enum name='model'>
Oct 26 00:03:02 user nova-compute[75165]:         <value>tpm-tis</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>tpm-crb</value>
Oct 26 00:03:02 user nova-compute[75165]:       </enum>
Oct 26 00:03:02 user nova-compute[75165]:       <enum name='backendModel'>
Oct 26 00:03:02 user nova-compute[75165]:         <value>passthrough</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>emulator</value>
Oct 26 00:03:02 user nova-compute[75165]:       </enum>
Oct 26 00:03:02 user nova-compute[75165]:     </tpm>
Oct 26 00:03:02 user nova-compute[75165]:   </devices>
Oct 26 00:03:02 user nova-compute[75165]:   <features>
Oct 26 00:03:02 user nova-compute[75165]:     <gic supported='no'/>
Oct 26 00:03:02 user nova-compute[75165]:     <vmcoreinfo supported='yes'/>
Oct 26 00:03:02 user nova-compute[75165]:     <genid supported='yes'/>
Oct 26 00:03:02 user nova-compute[75165]:     <backingStoreInput supported='yes'/>
Oct 26 00:03:02 user nova-compute[75165]:     <backup supported='yes'/>
Oct 26 00:03:02 user nova-compute[75165]:     <sev supported='no'/>
Oct 26 00:03:02 user nova-compute[75165]:   </features>
Oct 26 00:03:02 user nova-compute[75165]: </domainCapabilities>
Oct 26 00:03:02 user nova-compute[75165]:  {{(pid=75165) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 26 00:03:02 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-a2276838-4303-4694-b734-014de1e95741 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Oct 26 00:03:02 user nova-compute[75165]: <domainCapabilities>
Oct 26 00:03:02 user nova-compute[75165]:   <path>/usr/bin/qemu-system-i386</path>
Oct 26 00:03:02 user nova-compute[75165]:   <domain>kvm</domain>
Oct 26 00:03:02 user nova-compute[75165]:   <machine>pc-i440fx-6.2</machine>
Oct 26 00:03:02 user nova-compute[75165]:   <arch>i686</arch>
Oct 26 00:03:02 user nova-compute[75165]:   <vcpu max='255'/>
Oct 26 00:03:02 user nova-compute[75165]:   <iothreads supported='yes'/>
Oct 26 00:03:02 user nova-compute[75165]:   <os supported='yes'>
Oct 26 00:03:02 user nova-compute[75165]:     <enum name='firmware'/>
Oct 26 00:03:02 user nova-compute[75165]:     <loader supported='yes'>
Oct 26 00:03:02 user nova-compute[75165]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Oct 26 00:03:02 user nova-compute[75165]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Oct 26 00:03:02 user nova-compute[75165]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Oct 26 00:03:02 user nova-compute[75165]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Oct 26 00:03:02 user nova-compute[75165]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Oct 26 00:03:02 user nova-compute[75165]:       <enum name='type'>
Oct 26 00:03:02 user nova-compute[75165]:         <value>rom</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>pflash</value>
Oct 26 00:03:02 user nova-compute[75165]:       </enum>
Oct 26 00:03:02 user nova-compute[75165]:       <enum name='readonly'>
Oct 26 00:03:02 user nova-compute[75165]:         <value>yes</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>no</value>
Oct 26 00:03:02 user nova-compute[75165]:       </enum>
Oct 26 00:03:02 user nova-compute[75165]:       <enum name='secure'>
Oct 26 00:03:02 user nova-compute[75165]:         <value>no</value>
Oct 26 00:03:02 user nova-compute[75165]:       </enum>
Oct 26 00:03:02 user nova-compute[75165]:     </loader>
Oct 26 00:03:02 user nova-compute[75165]:   </os>
Oct 26 00:03:02 user nova-compute[75165]:   <cpu>
Oct 26 00:03:02 user nova-compute[75165]:     <mode name='host-passthrough' supported='yes'>
Oct 26 00:03:02 user nova-compute[75165]:       <enum name='hostPassthroughMigratable'>
Oct 26 00:03:02 user nova-compute[75165]:         <value>off</value>
Oct 26 00:03:02 user nova-compute[75165]:       </enum>
Oct 26 00:03:02 user nova-compute[75165]:     </mode>
Oct 26 00:03:02 user nova-compute[75165]:     <mode name='maximum' supported='yes'>
Oct 26 00:03:02 user nova-compute[75165]:       <enum name='maximumMigratable'>
Oct 26 00:03:02 user nova-compute[75165]:         <value>on</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>off</value>
Oct 26 00:03:02 user nova-compute[75165]:       </enum>
Oct 26 00:03:02 user nova-compute[75165]:     </mode>
Oct 26 00:03:02 user nova-compute[75165]:     <mode name='host-model' supported='yes'>
Oct 26 00:03:02 user nova-compute[75165]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 26 00:03:02 user nova-compute[75165]:       <vendor>Intel</vendor>
Oct 26 00:03:02 user nova-compute[75165]:       <feature policy='require' name='ss'/>
Oct 26 00:03:02 user nova-compute[75165]:       <feature policy='require' name='vmx'/>
Oct 26 00:03:02 user nova-compute[75165]:       <feature policy='require' name='pcid'/>
Oct 26 00:03:02 user nova-compute[75165]:       <feature policy='require' name='hypervisor'/>
Oct 26 00:03:02 user nova-compute[75165]:       <feature policy='require' name='arat'/>
Oct 26 00:03:02 user nova-compute[75165]:       <feature policy='require' name='tsc_adjust'/>
Oct 26 00:03:02 user nova-compute[75165]:       <feature policy='require' name='umip'/>
Oct 26 00:03:02 user nova-compute[75165]:       <feature policy='require' name='md-clear'/>
Oct 26 00:03:02 user nova-compute[75165]:       <feature policy='require' name='stibp'/>
Oct 26 00:03:02 user nova-compute[75165]:       <feature policy='require' name='arch-capabilities'/>
Oct 26 00:03:02 user nova-compute[75165]:       <feature policy='require' name='ssbd'/>
Oct 26 00:03:02 user nova-compute[75165]:       <feature policy='require' name='ibpb'/>
Oct 26 00:03:02 user nova-compute[75165]:       <feature policy='require' name='ibrs'/>
Oct 26 00:03:02 user nova-compute[75165]:       <feature policy='require' name='amd-stibp'/>
Oct 26 00:03:02 user nova-compute[75165]:       <feature policy='require' name='amd-ssbd'/>
Oct 26 00:03:02 user nova-compute[75165]:       <feature policy='disable' name='erms'/>
Oct 26 00:03:02 user nova-compute[75165]:       <feature policy='disable' name='xsaveopt'/>
Oct 26 00:03:02 user nova-compute[75165]:       <feature policy='disable' name='lm'/>
Oct 26 00:03:02 user nova-compute[75165]:     </mode>
Oct 26 00:03:02 user nova-compute[75165]:     <mode name='custom' supported='yes'>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>qemu64</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='yes'>qemu32</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>phenom</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='yes'>pentium3</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='yes'>pentium2</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='yes'>pentium</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>n270</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>kvm64</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='yes'>kvm32</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='yes'>coreduo</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>core2duo</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>athlon</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Westmere-IBRS</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Westmere</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Snowridge</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Skylake-Server</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Skylake-Client</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>SandyBridge</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Penryn</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Opteron_G5</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Opteron_G4</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Opteron_G3</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Opteron_G2</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Opteron_G1</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Nehalem-IBRS</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Nehalem</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>IvyBridge</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Icelake-Server</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Haswell-noTSX</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Haswell-IBRS</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Haswell</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>EPYC-Rome</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>EPYC-Milan</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>EPYC-IBPB</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>EPYC</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Dhyana</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Cooperlake</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Conroe</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Cascadelake-Server</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Broadwell-noTSX</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Broadwell-IBRS</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Broadwell</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='yes'>486</model>
Oct 26 00:03:02 user nova-compute[75165]:     </mode>
Oct 26 00:03:02 user nova-compute[75165]:   </cpu>
Oct 26 00:03:02 user nova-compute[75165]:   <memoryBacking supported='yes'>
Oct 26 00:03:02 user nova-compute[75165]:     <enum name='sourceType'>
Oct 26 00:03:02 user nova-compute[75165]:       <value>file</value>
Oct 26 00:03:02 user nova-compute[75165]:       <value>anonymous</value>
Oct 26 00:03:02 user nova-compute[75165]:       <value>memfd</value>
Oct 26 00:03:02 user nova-compute[75165]:     </enum>
Oct 26 00:03:02 user nova-compute[75165]:   </memoryBacking>
Oct 26 00:03:02 user nova-compute[75165]:   <devices>
Oct 26 00:03:02 user nova-compute[75165]:     <disk supported='yes'>
Oct 26 00:03:02 user nova-compute[75165]:       <enum name='diskDevice'>
Oct 26 00:03:02 user nova-compute[75165]:         <value>disk</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>cdrom</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>floppy</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>lun</value>
Oct 26 00:03:02 user nova-compute[75165]:       </enum>
Oct 26 00:03:02 user nova-compute[75165]:       <enum name='bus'>
Oct 26 00:03:02 user nova-compute[75165]:         <value>ide</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>fdc</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>scsi</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>virtio</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>usb</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>sata</value>
Oct 26 00:03:02 user nova-compute[75165]:       </enum>
Oct 26 00:03:02 user nova-compute[75165]:       <enum name='model'>
Oct 26 00:03:02 user nova-compute[75165]:         <value>virtio</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>virtio-transitional</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>virtio-non-transitional</value>
Oct 26 00:03:02 user nova-compute[75165]:       </enum>
Oct 26 00:03:02 user nova-compute[75165]:     </disk>
Oct 26 00:03:02 user nova-compute[75165]:     <graphics supported='yes'>
Oct 26 00:03:02 user nova-compute[75165]:       <enum name='type'>
Oct 26 00:03:02 user nova-compute[75165]:         <value>sdl</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>vnc</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>spice</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>egl-headless</value>
Oct 26 00:03:02 user nova-compute[75165]:       </enum>
Oct 26 00:03:02 user nova-compute[75165]:     </graphics>
Oct 26 00:03:02 user nova-compute[75165]:     <video supported='yes'>
Oct 26 00:03:02 user nova-compute[75165]:       <enum name='modelType'>
Oct 26 00:03:02 user nova-compute[75165]:         <value>vga</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>cirrus</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>vmvga</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>qxl</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>virtio</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>none</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>bochs</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>ramfb</value>
Oct 26 00:03:02 user nova-compute[75165]:       </enum>
Oct 26 00:03:02 user nova-compute[75165]:     </video>
Oct 26 00:03:02 user nova-compute[75165]:     <hostdev supported='yes'>
Oct 26 00:03:02 user nova-compute[75165]:       <enum name='mode'>
Oct 26 00:03:02 user nova-compute[75165]:         <value>subsystem</value>
Oct 26 00:03:02 user nova-compute[75165]:       </enum>
Oct 26 00:03:02 user nova-compute[75165]:       <enum name='startupPolicy'>
Oct 26 00:03:02 user nova-compute[75165]:         <value>default</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>mandatory</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>requisite</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>optional</value>
Oct 26 00:03:02 user nova-compute[75165]:       </enum>
Oct 26 00:03:02 user nova-compute[75165]:       <enum name='subsysType'>
Oct 26 00:03:02 user nova-compute[75165]:         <value>usb</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>pci</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>scsi</value>
Oct 26 00:03:02 user nova-compute[75165]:       </enum>
Oct 26 00:03:02 user nova-compute[75165]:       <enum name='capsType'/>
Oct 26 00:03:02 user nova-compute[75165]:       <enum name='pciBackend'/>
Oct 26 00:03:02 user nova-compute[75165]:     </hostdev>
Oct 26 00:03:02 user nova-compute[75165]:     <rng supported='yes'>
Oct 26 00:03:02 user nova-compute[75165]:       <enum name='model'>
Oct 26 00:03:02 user nova-compute[75165]:         <value>virtio</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>virtio-transitional</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>virtio-non-transitional</value>
Oct 26 00:03:02 user nova-compute[75165]:       </enum>
Oct 26 00:03:02 user nova-compute[75165]:       <enum name='backendModel'>
Oct 26 00:03:02 user nova-compute[75165]:         <value>random</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>egd</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>builtin</value>
Oct 26 00:03:02 user nova-compute[75165]:       </enum>
Oct 26 00:03:02 user nova-compute[75165]:     </rng>
Oct 26 00:03:02 user nova-compute[75165]:     <filesystem supported='yes'>
Oct 26 00:03:02 user nova-compute[75165]:       <enum name='driverType'>
Oct 26 00:03:02 user nova-compute[75165]:         <value>path</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>handle</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>virtiofs</value>
Oct 26 00:03:02 user nova-compute[75165]:       </enum>
Oct 26 00:03:02 user nova-compute[75165]:     </filesystem>
Oct 26 00:03:02 user nova-compute[75165]:     <tpm supported='yes'>
Oct 26 00:03:02 user nova-compute[75165]:       <enum name='model'>
Oct 26 00:03:02 user nova-compute[75165]:         <value>tpm-tis</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>tpm-crb</value>
Oct 26 00:03:02 user nova-compute[75165]:       </enum>
Oct 26 00:03:02 user nova-compute[75165]:       <enum name='backendModel'>
Oct 26 00:03:02 user nova-compute[75165]:         <value>passthrough</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>emulator</value>
Oct 26 00:03:02 user nova-compute[75165]:       </enum>
Oct 26 00:03:02 user nova-compute[75165]:     </tpm>
Oct 26 00:03:02 user nova-compute[75165]:   </devices>
Oct 26 00:03:02 user nova-compute[75165]:   <features>
Oct 26 00:03:02 user nova-compute[75165]:     <gic supported='no'/>
Oct 26 00:03:02 user nova-compute[75165]:     <vmcoreinfo supported='yes'/>
Oct 26 00:03:02 user nova-compute[75165]:     <genid supported='yes'/>
Oct 26 00:03:02 user nova-compute[75165]:     <backingStoreInput supported='yes'/>
Oct 26 00:03:02 user nova-compute[75165]:     <backup supported='yes'/>
Oct 26 00:03:02 user nova-compute[75165]:     <sev supported='no'/>
Oct 26 00:03:02 user nova-compute[75165]:   </features>
Oct 26 00:03:02 user nova-compute[75165]: </domainCapabilities>
Oct 26 00:03:02 user nova-compute[75165]:  {{(pid=75165) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 26 00:03:02 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-a2276838-4303-4694-b734-014de1e95741 None None] Getting domain capabilities for m68k via machine types: {None, 'virt'} {{(pid=75165) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 00:03:02 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-a2276838-4303-4694-b734-014de1e95741 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75165) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 00:03:02 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-a2276838-4303-4694-b734-014de1e95741 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75165) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 00:03:02 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-a2276838-4303-4694-b734-014de1e95741 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=75165) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 00:03:02 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-a2276838-4303-4694-b734-014de1e95741 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=75165) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 00:03:02 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-a2276838-4303-4694-b734-014de1e95741 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=75165) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 00:03:02 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-a2276838-4303-4694-b734-014de1e95741 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=75165) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 00:03:02 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-a2276838-4303-4694-b734-014de1e95741 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=75165) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 00:03:02 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-a2276838-4303-4694-b734-014de1e95741 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=75165) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 00:03:02 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-a2276838-4303-4694-b734-014de1e95741 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=75165) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 00:03:02 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-a2276838-4303-4694-b734-014de1e95741 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=75165) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 00:03:02 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-a2276838-4303-4694-b734-014de1e95741 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=75165) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 00:03:02 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-a2276838-4303-4694-b734-014de1e95741 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=75165) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 00:03:02 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-a2276838-4303-4694-b734-014de1e95741 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=75165) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 00:03:02 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-a2276838-4303-4694-b734-014de1e95741 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=75165) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 00:03:02 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-a2276838-4303-4694-b734-014de1e95741 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=75165) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 00:03:02 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-a2276838-4303-4694-b734-014de1e95741 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=75165) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 00:03:02 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-a2276838-4303-4694-b734-014de1e95741 None None] Getting domain capabilities for ppc64 via machine types: {'pseries', 'powernv', None} {{(pid=75165) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 00:03:02 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-a2276838-4303-4694-b734-014de1e95741 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75165) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 00:03:02 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-a2276838-4303-4694-b734-014de1e95741 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75165) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 00:03:02 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-a2276838-4303-4694-b734-014de1e95741 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75165) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 00:03:02 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-a2276838-4303-4694-b734-014de1e95741 None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=75165) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 00:03:02 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-a2276838-4303-4694-b734-014de1e95741 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75165) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 00:03:02 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-a2276838-4303-4694-b734-014de1e95741 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75165) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 00:03:02 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-a2276838-4303-4694-b734-014de1e95741 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=75165) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 00:03:02 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-a2276838-4303-4694-b734-014de1e95741 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=75165) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 00:03:02 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-a2276838-4303-4694-b734-014de1e95741 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=75165) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 00:03:02 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-a2276838-4303-4694-b734-014de1e95741 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=75165) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 00:03:02 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-a2276838-4303-4694-b734-014de1e95741 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=75165) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 00:03:02 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-a2276838-4303-4694-b734-014de1e95741 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=75165) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 00:03:02 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-a2276838-4303-4694-b734-014de1e95741 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=75165) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 00:03:02 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-a2276838-4303-4694-b734-014de1e95741 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=75165) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 00:03:02 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-a2276838-4303-4694-b734-014de1e95741 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=75165) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 00:03:02 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-a2276838-4303-4694-b734-014de1e95741 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=75165) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 00:03:02 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-a2276838-4303-4694-b734-014de1e95741 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=75165) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 00:03:02 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-a2276838-4303-4694-b734-014de1e95741 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=75165) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 00:03:02 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-a2276838-4303-4694-b734-014de1e95741 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=75165) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 00:03:02 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-a2276838-4303-4694-b734-014de1e95741 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=75165) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 00:03:02 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-a2276838-4303-4694-b734-014de1e95741 None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu', 'q35', 'ubuntu-q35', 'pc'} {{(pid=75165) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 00:03:02 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-a2276838-4303-4694-b734-014de1e95741 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Oct 26 00:03:02 user nova-compute[75165]: <domainCapabilities>
Oct 26 00:03:02 user nova-compute[75165]:   <path>/usr/bin/qemu-system-x86_64</path>
Oct 26 00:03:02 user nova-compute[75165]:   <domain>kvm</domain>
Oct 26 00:03:02 user nova-compute[75165]:   <machine>pc-i440fx-jammy</machine>
Oct 26 00:03:02 user nova-compute[75165]:   <arch>x86_64</arch>
Oct 26 00:03:02 user nova-compute[75165]:   <vcpu max='255'/>
Oct 26 00:03:02 user nova-compute[75165]:   <iothreads supported='yes'/>
Oct 26 00:03:02 user nova-compute[75165]:   <os supported='yes'>
Oct 26 00:03:02 user nova-compute[75165]:     <enum name='firmware'>
Oct 26 00:03:02 user nova-compute[75165]:       <value>efi</value>
Oct 26 00:03:02 user nova-compute[75165]:     </enum>
Oct 26 00:03:02 user nova-compute[75165]:     <loader supported='yes'>
Oct 26 00:03:02 user nova-compute[75165]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Oct 26 00:03:02 user nova-compute[75165]:       <enum name='type'>
Oct 26 00:03:02 user nova-compute[75165]:         <value>rom</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>pflash</value>
Oct 26 00:03:02 user nova-compute[75165]:       </enum>
Oct 26 00:03:02 user nova-compute[75165]:       <enum name='readonly'>
Oct 26 00:03:02 user nova-compute[75165]:         <value>yes</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>no</value>
Oct 26 00:03:02 user nova-compute[75165]:       </enum>
Oct 26 00:03:02 user nova-compute[75165]:       <enum name='secure'>
Oct 26 00:03:02 user nova-compute[75165]:         <value>no</value>
Oct 26 00:03:02 user nova-compute[75165]:       </enum>
Oct 26 00:03:02 user nova-compute[75165]:     </loader>
Oct 26 00:03:02 user nova-compute[75165]:   </os>
Oct 26 00:03:02 user nova-compute[75165]:   <cpu>
Oct 26 00:03:02 user nova-compute[75165]:     <mode name='host-passthrough' supported='yes'>
Oct 26 00:03:02 user nova-compute[75165]:       <enum name='hostPassthroughMigratable'>
Oct 26 00:03:02 user nova-compute[75165]:         <value>on</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>off</value>
Oct 26 00:03:02 user nova-compute[75165]:       </enum>
Oct 26 00:03:02 user nova-compute[75165]:     </mode>
Oct 26 00:03:02 user nova-compute[75165]:     <mode name='maximum' supported='yes'>
Oct 26 00:03:02 user nova-compute[75165]:       <enum name='maximumMigratable'>
Oct 26 00:03:02 user nova-compute[75165]:         <value>on</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>off</value>
Oct 26 00:03:02 user nova-compute[75165]:       </enum>
Oct 26 00:03:02 user nova-compute[75165]:     </mode>
Oct 26 00:03:02 user nova-compute[75165]:     <mode name='host-model' supported='yes'>
Oct 26 00:03:02 user nova-compute[75165]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 26 00:03:02 user nova-compute[75165]:       <vendor>Intel</vendor>
Oct 26 00:03:02 user nova-compute[75165]:       <feature policy='require' name='ss'/>
Oct 26 00:03:02 user nova-compute[75165]:       <feature policy='require' name='vmx'/>
Oct 26 00:03:02 user nova-compute[75165]:       <feature policy='require' name='pcid'/>
Oct 26 00:03:02 user nova-compute[75165]:       <feature policy='require' name='hypervisor'/>
Oct 26 00:03:02 user nova-compute[75165]:       <feature policy='require' name='arat'/>
Oct 26 00:03:02 user nova-compute[75165]:       <feature policy='require' name='tsc_adjust'/>
Oct 26 00:03:02 user nova-compute[75165]:       <feature policy='require' name='umip'/>
Oct 26 00:03:02 user nova-compute[75165]:       <feature policy='require' name='md-clear'/>
Oct 26 00:03:02 user nova-compute[75165]:       <feature policy='require' name='stibp'/>
Oct 26 00:03:02 user nova-compute[75165]:       <feature policy='require' name='arch-capabilities'/>
Oct 26 00:03:02 user nova-compute[75165]:       <feature policy='require' name='ssbd'/>
Oct 26 00:03:02 user nova-compute[75165]:       <feature policy='require' name='invtsc'/>
Oct 26 00:03:02 user nova-compute[75165]:       <feature policy='require' name='ibpb'/>
Oct 26 00:03:02 user nova-compute[75165]:       <feature policy='require' name='ibrs'/>
Oct 26 00:03:02 user nova-compute[75165]:       <feature policy='require' name='amd-stibp'/>
Oct 26 00:03:02 user nova-compute[75165]:       <feature policy='require' name='amd-ssbd'/>
Oct 26 00:03:02 user nova-compute[75165]:       <feature policy='require' name='rsba'/>
Oct 26 00:03:02 user nova-compute[75165]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Oct 26 00:03:02 user nova-compute[75165]:       <feature policy='require' name='pschange-mc-no'/>
Oct 26 00:03:02 user nova-compute[75165]:       <feature policy='disable' name='erms'/>
Oct 26 00:03:02 user nova-compute[75165]:       <feature policy='disable' name='xsaveopt'/>
Oct 26 00:03:02 user nova-compute[75165]:     </mode>
Oct 26 00:03:02 user nova-compute[75165]:     <mode name='custom' supported='yes'>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>qemu64</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='yes'>qemu32</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>phenom</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='yes'>pentium3</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='yes'>pentium2</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='yes'>pentium</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>n270</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='yes'>kvm64</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='yes'>kvm32</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='yes'>coreduo</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='yes'>core2duo</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>athlon</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='yes'>Westmere-IBRS</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='yes'>Westmere</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Snowridge</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Skylake-Server</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Skylake-Client</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>SandyBridge</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='yes'>Penryn</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Opteron_G5</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Opteron_G4</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Opteron_G3</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Opteron_G2</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='yes'>Opteron_G1</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='yes'>Nehalem-IBRS</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='yes'>Nehalem</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>IvyBridge</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Icelake-Server</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Haswell-noTSX</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Haswell-IBRS</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Haswell</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>EPYC-Rome</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>EPYC-Milan</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>EPYC-IBPB</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>EPYC</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Dhyana</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Cooperlake</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='yes'>Conroe</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Cascadelake-Server</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Broadwell-noTSX</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Broadwell-IBRS</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Broadwell</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='yes'>486</model>
Oct 26 00:03:02 user nova-compute[75165]:     </mode>
Oct 26 00:03:02 user nova-compute[75165]:   </cpu>
Oct 26 00:03:02 user nova-compute[75165]:   <memoryBacking supported='yes'>
Oct 26 00:03:02 user nova-compute[75165]:     <enum name='sourceType'>
Oct 26 00:03:02 user nova-compute[75165]:       <value>file</value>
Oct 26 00:03:02 user nova-compute[75165]:       <value>anonymous</value>
Oct 26 00:03:02 user nova-compute[75165]:       <value>memfd</value>
Oct 26 00:03:02 user nova-compute[75165]:     </enum>
Oct 26 00:03:02 user nova-compute[75165]:   </memoryBacking>
Oct 26 00:03:02 user nova-compute[75165]:   <devices>
Oct 26 00:03:02 user nova-compute[75165]:     <disk supported='yes'>
Oct 26 00:03:02 user nova-compute[75165]:       <enum name='diskDevice'>
Oct 26 00:03:02 user nova-compute[75165]:         <value>disk</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>cdrom</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>floppy</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>lun</value>
Oct 26 00:03:02 user nova-compute[75165]:       </enum>
Oct 26 00:03:02 user nova-compute[75165]:       <enum name='bus'>
Oct 26 00:03:02 user nova-compute[75165]:         <value>ide</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>fdc</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>scsi</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>virtio</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>usb</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>sata</value>
Oct 26 00:03:02 user nova-compute[75165]:       </enum>
Oct 26 00:03:02 user nova-compute[75165]:       <enum name='model'>
Oct 26 00:03:02 user nova-compute[75165]:         <value>virtio</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>virtio-transitional</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>virtio-non-transitional</value>
Oct 26 00:03:02 user nova-compute[75165]:       </enum>
Oct 26 00:03:02 user nova-compute[75165]:     </disk>
Oct 26 00:03:02 user nova-compute[75165]:     <graphics supported='yes'>
Oct 26 00:03:02 user nova-compute[75165]:       <enum name='type'>
Oct 26 00:03:02 user nova-compute[75165]:         <value>sdl</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>vnc</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>spice</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>egl-headless</value>
Oct 26 00:03:02 user nova-compute[75165]:       </enum>
Oct 26 00:03:02 user nova-compute[75165]:     </graphics>
Oct 26 00:03:02 user nova-compute[75165]:     <video supported='yes'>
Oct 26 00:03:02 user nova-compute[75165]:       <enum name='modelType'>
Oct 26 00:03:02 user nova-compute[75165]:         <value>vga</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>cirrus</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>vmvga</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>qxl</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>virtio</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>none</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>bochs</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>ramfb</value>
Oct 26 00:03:02 user nova-compute[75165]:       </enum>
Oct 26 00:03:02 user nova-compute[75165]:     </video>
Oct 26 00:03:02 user nova-compute[75165]:     <hostdev supported='yes'>
Oct 26 00:03:02 user nova-compute[75165]:       <enum name='mode'>
Oct 26 00:03:02 user nova-compute[75165]:         <value>subsystem</value>
Oct 26 00:03:02 user nova-compute[75165]:       </enum>
Oct 26 00:03:02 user nova-compute[75165]:       <enum name='startupPolicy'>
Oct 26 00:03:02 user nova-compute[75165]:         <value>default</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>mandatory</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>requisite</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>optional</value>
Oct 26 00:03:02 user nova-compute[75165]:       </enum>
Oct 26 00:03:02 user nova-compute[75165]:       <enum name='subsysType'>
Oct 26 00:03:02 user nova-compute[75165]:         <value>usb</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>pci</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>scsi</value>
Oct 26 00:03:02 user nova-compute[75165]:       </enum>
Oct 26 00:03:02 user nova-compute[75165]:       <enum name='capsType'/>
Oct 26 00:03:02 user nova-compute[75165]:       <enum name='pciBackend'/>
Oct 26 00:03:02 user nova-compute[75165]:     </hostdev>
Oct 26 00:03:02 user nova-compute[75165]:     <rng supported='yes'>
Oct 26 00:03:02 user nova-compute[75165]:       <enum name='model'>
Oct 26 00:03:02 user nova-compute[75165]:         <value>virtio</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>virtio-transitional</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>virtio-non-transitional</value>
Oct 26 00:03:02 user nova-compute[75165]:       </enum>
Oct 26 00:03:02 user nova-compute[75165]:       <enum name='backendModel'>
Oct 26 00:03:02 user nova-compute[75165]:         <value>random</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>egd</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>builtin</value>
Oct 26 00:03:02 user nova-compute[75165]:       </enum>
Oct 26 00:03:02 user nova-compute[75165]:     </rng>
Oct 26 00:03:02 user nova-compute[75165]:     <filesystem supported='yes'>
Oct 26 00:03:02 user nova-compute[75165]:       <enum name='driverType'>
Oct 26 00:03:02 user nova-compute[75165]:         <value>path</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>handle</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>virtiofs</value>
Oct 26 00:03:02 user nova-compute[75165]:       </enum>
Oct 26 00:03:02 user nova-compute[75165]:     </filesystem>
Oct 26 00:03:02 user nova-compute[75165]:     <tpm supported='yes'>
Oct 26 00:03:02 user nova-compute[75165]:       <enum name='model'>
Oct 26 00:03:02 user nova-compute[75165]:         <value>tpm-tis</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>tpm-crb</value>
Oct 26 00:03:02 user nova-compute[75165]:       </enum>
Oct 26 00:03:02 user nova-compute[75165]:       <enum name='backendModel'>
Oct 26 00:03:02 user nova-compute[75165]:         <value>passthrough</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>emulator</value>
Oct 26 00:03:02 user nova-compute[75165]:       </enum>
Oct 26 00:03:02 user nova-compute[75165]:     </tpm>
Oct 26 00:03:02 user nova-compute[75165]:   </devices>
Oct 26 00:03:02 user nova-compute[75165]:   <features>
Oct 26 00:03:02 user nova-compute[75165]:     <gic supported='no'/>
Oct 26 00:03:02 user nova-compute[75165]:     <vmcoreinfo supported='yes'/>
Oct 26 00:03:02 user nova-compute[75165]:     <genid supported='yes'/>
Oct 26 00:03:02 user nova-compute[75165]:     <backingStoreInput supported='yes'/>
Oct 26 00:03:02 user nova-compute[75165]:     <backup supported='yes'/>
Oct 26 00:03:02 user nova-compute[75165]:     <sev supported='no'/>
Oct 26 00:03:02 user nova-compute[75165]:   </features>
Oct 26 00:03:02 user nova-compute[75165]: </domainCapabilities>
Oct 26 00:03:02 user nova-compute[75165]:  {{(pid=75165) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 26 00:03:02 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-a2276838-4303-4694-b734-014de1e95741 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Oct 26 00:03:02 user nova-compute[75165]: <domainCapabilities>
Oct 26 00:03:02 user nova-compute[75165]:   <path>/usr/bin/qemu-system-x86_64</path>
Oct 26 00:03:02 user nova-compute[75165]:   <domain>kvm</domain>
Oct 26 00:03:02 user nova-compute[75165]:   <machine>pc-q35-6.2</machine>
Oct 26 00:03:02 user nova-compute[75165]:   <arch>x86_64</arch>
Oct 26 00:03:02 user nova-compute[75165]:   <vcpu max='288'/>
Oct 26 00:03:02 user nova-compute[75165]:   <iothreads supported='yes'/>
Oct 26 00:03:02 user nova-compute[75165]:   <os supported='yes'>
Oct 26 00:03:02 user nova-compute[75165]:     <enum name='firmware'>
Oct 26 00:03:02 user nova-compute[75165]:       <value>efi</value>
Oct 26 00:03:02 user nova-compute[75165]:     </enum>
Oct 26 00:03:02 user nova-compute[75165]:     <loader supported='yes'>
Oct 26 00:03:02 user nova-compute[75165]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Oct 26 00:03:02 user nova-compute[75165]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Oct 26 00:03:02 user nova-compute[75165]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Oct 26 00:03:02 user nova-compute[75165]:       <enum name='type'>
Oct 26 00:03:02 user nova-compute[75165]:         <value>rom</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>pflash</value>
Oct 26 00:03:02 user nova-compute[75165]:       </enum>
Oct 26 00:03:02 user nova-compute[75165]:       <enum name='readonly'>
Oct 26 00:03:02 user nova-compute[75165]:         <value>yes</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>no</value>
Oct 26 00:03:02 user nova-compute[75165]:       </enum>
Oct 26 00:03:02 user nova-compute[75165]:       <enum name='secure'>
Oct 26 00:03:02 user nova-compute[75165]:         <value>yes</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>no</value>
Oct 26 00:03:02 user nova-compute[75165]:       </enum>
Oct 26 00:03:02 user nova-compute[75165]:     </loader>
Oct 26 00:03:02 user nova-compute[75165]:   </os>
Oct 26 00:03:02 user nova-compute[75165]:   <cpu>
Oct 26 00:03:02 user nova-compute[75165]:     <mode name='host-passthrough' supported='yes'>
Oct 26 00:03:02 user nova-compute[75165]:       <enum name='hostPassthroughMigratable'>
Oct 26 00:03:02 user nova-compute[75165]:         <value>on</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>off</value>
Oct 26 00:03:02 user nova-compute[75165]:       </enum>
Oct 26 00:03:02 user nova-compute[75165]:     </mode>
Oct 26 00:03:02 user nova-compute[75165]:     <mode name='maximum' supported='yes'>
Oct 26 00:03:02 user nova-compute[75165]:       <enum name='maximumMigratable'>
Oct 26 00:03:02 user nova-compute[75165]:         <value>on</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>off</value>
Oct 26 00:03:02 user nova-compute[75165]:       </enum>
Oct 26 00:03:02 user nova-compute[75165]:     </mode>
Oct 26 00:03:02 user nova-compute[75165]:     <mode name='host-model' supported='yes'>
Oct 26 00:03:02 user nova-compute[75165]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 26 00:03:02 user nova-compute[75165]:       <vendor>Intel</vendor>
Oct 26 00:03:02 user nova-compute[75165]:       <feature policy='require' name='ss'/>
Oct 26 00:03:02 user nova-compute[75165]:       <feature policy='require' name='vmx'/>
Oct 26 00:03:02 user nova-compute[75165]:       <feature policy='require' name='pcid'/>
Oct 26 00:03:02 user nova-compute[75165]:       <feature policy='require' name='hypervisor'/>
Oct 26 00:03:02 user nova-compute[75165]:       <feature policy='require' name='arat'/>
Oct 26 00:03:02 user nova-compute[75165]:       <feature policy='require' name='tsc_adjust'/>
Oct 26 00:03:02 user nova-compute[75165]:       <feature policy='require' name='umip'/>
Oct 26 00:03:02 user nova-compute[75165]:       <feature policy='require' name='md-clear'/>
Oct 26 00:03:02 user nova-compute[75165]:       <feature policy='require' name='stibp'/>
Oct 26 00:03:02 user nova-compute[75165]:       <feature policy='require' name='arch-capabilities'/>
Oct 26 00:03:02 user nova-compute[75165]:       <feature policy='require' name='ssbd'/>
Oct 26 00:03:02 user nova-compute[75165]:       <feature policy='require' name='invtsc'/>
Oct 26 00:03:02 user nova-compute[75165]:       <feature policy='require' name='ibpb'/>
Oct 26 00:03:02 user nova-compute[75165]:       <feature policy='require' name='ibrs'/>
Oct 26 00:03:02 user nova-compute[75165]:       <feature policy='require' name='amd-stibp'/>
Oct 26 00:03:02 user nova-compute[75165]:       <feature policy='require' name='amd-ssbd'/>
Oct 26 00:03:02 user nova-compute[75165]:       <feature policy='require' name='rsba'/>
Oct 26 00:03:02 user nova-compute[75165]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Oct 26 00:03:02 user nova-compute[75165]:       <feature policy='require' name='pschange-mc-no'/>
Oct 26 00:03:02 user nova-compute[75165]:       <feature policy='disable' name='erms'/>
Oct 26 00:03:02 user nova-compute[75165]:       <feature policy='disable' name='xsaveopt'/>
Oct 26 00:03:02 user nova-compute[75165]:     </mode>
Oct 26 00:03:02 user nova-compute[75165]:     <mode name='custom' supported='yes'>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>qemu64</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='yes'>qemu32</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>phenom</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='yes'>pentium3</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='yes'>pentium2</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='yes'>pentium</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>n270</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='yes'>kvm64</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='yes'>kvm32</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='yes'>coreduo</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='yes'>core2duo</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>athlon</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='yes'>Westmere-IBRS</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='yes'>Westmere</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Snowridge</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Skylake-Server</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Skylake-Client</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>SandyBridge</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='yes'>Penryn</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Opteron_G5</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Opteron_G4</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Opteron_G3</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Opteron_G2</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='yes'>Opteron_G1</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='yes'>Nehalem-IBRS</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='yes'>Nehalem</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>IvyBridge</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Icelake-Server</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Haswell-noTSX</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Haswell-IBRS</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Haswell</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>EPYC-Rome</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>EPYC-Milan</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>EPYC-IBPB</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>EPYC</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Dhyana</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Cooperlake</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='yes'>Conroe</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Cascadelake-Server</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Broadwell-noTSX</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Broadwell-IBRS</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='no'>Broadwell</model>
Oct 26 00:03:02 user nova-compute[75165]:       <model usable='yes'>486</model>
Oct 26 00:03:02 user nova-compute[75165]:     </mode>
Oct 26 00:03:02 user nova-compute[75165]:   </cpu>
Oct 26 00:03:02 user nova-compute[75165]:   <memoryBacking supported='yes'>
Oct 26 00:03:02 user nova-compute[75165]:     <enum name='sourceType'>
Oct 26 00:03:02 user nova-compute[75165]:       <value>file</value>
Oct 26 00:03:02 user nova-compute[75165]:       <value>anonymous</value>
Oct 26 00:03:02 user nova-compute[75165]:       <value>memfd</value>
Oct 26 00:03:02 user nova-compute[75165]:     </enum>
Oct 26 00:03:02 user nova-compute[75165]:   </memoryBacking>
Oct 26 00:03:02 user nova-compute[75165]:   <devices>
Oct 26 00:03:02 user nova-compute[75165]:     <disk supported='yes'>
Oct 26 00:03:02 user nova-compute[75165]:       <enum name='diskDevice'>
Oct 26 00:03:02 user nova-compute[75165]:         <value>disk</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>cdrom</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>floppy</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>lun</value>
Oct 26 00:03:02 user nova-compute[75165]:       </enum>
Oct 26 00:03:02 user nova-compute[75165]:       <enum name='bus'>
Oct 26 00:03:02 user nova-compute[75165]:         <value>fdc</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>scsi</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>virtio</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>usb</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>sata</value>
Oct 26 00:03:02 user nova-compute[75165]:       </enum>
Oct 26 00:03:02 user nova-compute[75165]:       <enum name='model'>
Oct 26 00:03:02 user nova-compute[75165]:         <value>virtio</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>virtio-transitional</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>virtio-non-transitional</value>
Oct 26 00:03:02 user nova-compute[75165]:       </enum>
Oct 26 00:03:02 user nova-compute[75165]:     </disk>
Oct 26 00:03:02 user nova-compute[75165]:     <graphics supported='yes'>
Oct 26 00:03:02 user nova-compute[75165]:       <enum name='type'>
Oct 26 00:03:02 user nova-compute[75165]:         <value>sdl</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>vnc</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>spice</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>egl-headless</value>
Oct 26 00:03:02 user nova-compute[75165]:       </enum>
Oct 26 00:03:02 user nova-compute[75165]:     </graphics>
Oct 26 00:03:02 user nova-compute[75165]:     <video supported='yes'>
Oct 26 00:03:02 user nova-compute[75165]:       <enum name='modelType'>
Oct 26 00:03:02 user nova-compute[75165]:         <value>vga</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>cirrus</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>vmvga</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>qxl</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>virtio</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>none</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>bochs</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>ramfb</value>
Oct 26 00:03:02 user nova-compute[75165]:       </enum>
Oct 26 00:03:02 user nova-compute[75165]:     </video>
Oct 26 00:03:02 user nova-compute[75165]:     <hostdev supported='yes'>
Oct 26 00:03:02 user nova-compute[75165]:       <enum name='mode'>
Oct 26 00:03:02 user nova-compute[75165]:         <value>subsystem</value>
Oct 26 00:03:02 user nova-compute[75165]:       </enum>
Oct 26 00:03:02 user nova-compute[75165]:       <enum name='startupPolicy'>
Oct 26 00:03:02 user nova-compute[75165]:         <value>default</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>mandatory</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>requisite</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>optional</value>
Oct 26 00:03:02 user nova-compute[75165]:       </enum>
Oct 26 00:03:02 user nova-compute[75165]:       <enum name='subsysType'>
Oct 26 00:03:02 user nova-compute[75165]:         <value>usb</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>pci</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>scsi</value>
Oct 26 00:03:02 user nova-compute[75165]:       </enum>
Oct 26 00:03:02 user nova-compute[75165]:       <enum name='capsType'/>
Oct 26 00:03:02 user nova-compute[75165]:       <enum name='pciBackend'/>
Oct 26 00:03:02 user nova-compute[75165]:     </hostdev>
Oct 26 00:03:02 user nova-compute[75165]:     <rng supported='yes'>
Oct 26 00:03:02 user nova-compute[75165]:       <enum name='model'>
Oct 26 00:03:02 user nova-compute[75165]:         <value>virtio</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>virtio-transitional</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>virtio-non-transitional</value>
Oct 26 00:03:02 user nova-compute[75165]:       </enum>
Oct 26 00:03:02 user nova-compute[75165]:       <enum name='backendModel'>
Oct 26 00:03:02 user nova-compute[75165]:         <value>random</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>egd</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>builtin</value>
Oct 26 00:03:02 user nova-compute[75165]:       </enum>
Oct 26 00:03:02 user nova-compute[75165]:     </rng>
Oct 26 00:03:02 user nova-compute[75165]:     <filesystem supported='yes'>
Oct 26 00:03:02 user nova-compute[75165]:       <enum name='driverType'>
Oct 26 00:03:02 user nova-compute[75165]:         <value>path</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>handle</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>virtiofs</value>
Oct 26 00:03:02 user nova-compute[75165]:       </enum>
Oct 26 00:03:02 user nova-compute[75165]:     </filesystem>
Oct 26 00:03:02 user nova-compute[75165]:     <tpm supported='yes'>
Oct 26 00:03:02 user nova-compute[75165]:       <enum name='model'>
Oct 26 00:03:02 user nova-compute[75165]:         <value>tpm-tis</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>tpm-crb</value>
Oct 26 00:03:02 user nova-compute[75165]:       </enum>
Oct 26 00:03:02 user nova-compute[75165]:       <enum name='backendModel'>
Oct 26 00:03:02 user nova-compute[75165]:         <value>passthrough</value>
Oct 26 00:03:02 user nova-compute[75165]:         <value>emulator</value>
Oct 26 00:03:02 user nova-compute[75165]:       </enum>
Oct 26 00:03:02 user nova-compute[75165]:     </tpm>
Oct 26 00:03:02 user nova-compute[75165]:   </devices>
Oct 26 00:03:02 user nova-compute[75165]:   <features>
Oct 26 00:03:02 user nova-compute[75165]:     <gic supported='no'/>
Oct 26 00:03:03 user nova-compute[75165]:     <vmcoreinfo supported='yes'/>
Oct 26 00:03:03 user nova-compute[75165]:     <genid supported='yes'/>
Oct 26 00:03:03 user nova-compute[75165]:     <backingStoreInput supported='yes'/>
Oct 26 00:03:03 user nova-compute[75165]:     <backup supported='yes'/>
Oct 26 00:03:03 user nova-compute[75165]:     <sev supported='no'/>
Oct 26 00:03:03 user nova-compute[75165]:   </features>
Oct 26 00:03:03 user nova-compute[75165]: </domainCapabilities>
Oct 26 00:03:03 user nova-compute[75165]:  {{(pid=75165) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 26 00:03:03 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-a2276838-4303-4694-b734-014de1e95741 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Oct 26 00:03:03 user nova-compute[75165]: <domainCapabilities>
Oct 26 00:03:03 user nova-compute[75165]:   <path>/usr/bin/qemu-system-x86_64</path>
Oct 26 00:03:03 user nova-compute[75165]:   <domain>kvm</domain>
Oct 26 00:03:03 user nova-compute[75165]:   <machine>pc-q35-jammy</machine>
Oct 26 00:03:03 user nova-compute[75165]:   <arch>x86_64</arch>
Oct 26 00:03:03 user nova-compute[75165]:   <vcpu max='288'/>
Oct 26 00:03:03 user nova-compute[75165]:   <iothreads supported='yes'/>
Oct 26 00:03:03 user nova-compute[75165]:   <os supported='yes'>
Oct 26 00:03:03 user nova-compute[75165]:     <enum name='firmware'>
Oct 26 00:03:03 user nova-compute[75165]:       <value>efi</value>
Oct 26 00:03:03 user nova-compute[75165]:     </enum>
Oct 26 00:03:03 user nova-compute[75165]:     <loader supported='yes'>
Oct 26 00:03:03 user nova-compute[75165]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Oct 26 00:03:03 user nova-compute[75165]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Oct 26 00:03:03 user nova-compute[75165]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Oct 26 00:03:03 user nova-compute[75165]:       <enum name='type'>
Oct 26 00:03:03 user nova-compute[75165]:         <value>rom</value>
Oct 26 00:03:03 user nova-compute[75165]:         <value>pflash</value>
Oct 26 00:03:03 user nova-compute[75165]:       </enum>
Oct 26 00:03:03 user nova-compute[75165]:       <enum name='readonly'>
Oct 26 00:03:03 user nova-compute[75165]:         <value>yes</value>
Oct 26 00:03:03 user nova-compute[75165]:         <value>no</value>
Oct 26 00:03:03 user nova-compute[75165]:       </enum>
Oct 26 00:03:03 user nova-compute[75165]:       <enum name='secure'>
Oct 26 00:03:03 user nova-compute[75165]:         <value>yes</value>
Oct 26 00:03:03 user nova-compute[75165]:         <value>no</value>
Oct 26 00:03:03 user nova-compute[75165]:       </enum>
Oct 26 00:03:03 user nova-compute[75165]:     </loader>
Oct 26 00:03:03 user nova-compute[75165]:   </os>
Oct 26 00:03:03 user nova-compute[75165]:   <cpu>
Oct 26 00:03:03 user nova-compute[75165]:     <mode name='host-passthrough' supported='yes'>
Oct 26 00:03:03 user nova-compute[75165]:       <enum name='hostPassthroughMigratable'>
Oct 26 00:03:03 user nova-compute[75165]:         <value>on</value>
Oct 26 00:03:03 user nova-compute[75165]:         <value>off</value>
Oct 26 00:03:03 user nova-compute[75165]:       </enum>
Oct 26 00:03:03 user nova-compute[75165]:     </mode>
Oct 26 00:03:03 user nova-compute[75165]:     <mode name='maximum' supported='yes'>
Oct 26 00:03:03 user nova-compute[75165]:       <enum name='maximumMigratable'>
Oct 26 00:03:03 user nova-compute[75165]:         <value>on</value>
Oct 26 00:03:03 user nova-compute[75165]:         <value>off</value>
Oct 26 00:03:03 user nova-compute[75165]:       </enum>
Oct 26 00:03:03 user nova-compute[75165]:     </mode>
Oct 26 00:03:03 user nova-compute[75165]:     <mode name='host-model' supported='yes'>
Oct 26 00:03:03 user nova-compute[75165]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 26 00:03:03 user nova-compute[75165]:       <vendor>Intel</vendor>
Oct 26 00:03:03 user nova-compute[75165]:       <feature policy='require' name='ss'/>
Oct 26 00:03:03 user nova-compute[75165]:       <feature policy='require' name='vmx'/>
Oct 26 00:03:03 user nova-compute[75165]:       <feature policy='require' name='pcid'/>
Oct 26 00:03:03 user nova-compute[75165]:       <feature policy='require' name='hypervisor'/>
Oct 26 00:03:03 user nova-compute[75165]:       <feature policy='require' name='arat'/>
Oct 26 00:03:03 user nova-compute[75165]:       <feature policy='require' name='tsc_adjust'/>
Oct 26 00:03:03 user nova-compute[75165]:       <feature policy='require' name='umip'/>
Oct 26 00:03:03 user nova-compute[75165]:       <feature policy='require' name='md-clear'/>
Oct 26 00:03:03 user nova-compute[75165]:       <feature policy='require' name='stibp'/>
Oct 26 00:03:03 user nova-compute[75165]:       <feature policy='require' name='arch-capabilities'/>
Oct 26 00:03:03 user nova-compute[75165]:       <feature policy='require' name='ssbd'/>
Oct 26 00:03:03 user nova-compute[75165]:       <feature policy='require' name='invtsc'/>
Oct 26 00:03:03 user nova-compute[75165]:       <feature policy='require' name='ibpb'/>
Oct 26 00:03:03 user nova-compute[75165]:       <feature policy='require' name='ibrs'/>
Oct 26 00:03:03 user nova-compute[75165]:       <feature policy='require' name='amd-stibp'/>
Oct 26 00:03:03 user nova-compute[75165]:       <feature policy='require' name='amd-ssbd'/>
Oct 26 00:03:03 user nova-compute[75165]:       <feature policy='require' name='rsba'/>
Oct 26 00:03:03 user nova-compute[75165]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Oct 26 00:03:03 user nova-compute[75165]:       <feature policy='require' name='pschange-mc-no'/>
Oct 26 00:03:03 user nova-compute[75165]:       <feature policy='disable' name='erms'/>
Oct 26 00:03:03 user nova-compute[75165]:       <feature policy='disable' name='xsaveopt'/>
Oct 26 00:03:03 user nova-compute[75165]:     </mode>
Oct 26 00:03:03 user nova-compute[75165]:     <mode name='custom' supported='yes'>
Oct 26 00:03:03 user nova-compute[75165]:       <model usable='no'>qemu64</model>
Oct 26 00:03:03 user nova-compute[75165]:       <model usable='yes'>qemu32</model>
Oct 26 00:03:03 user nova-compute[75165]:       <model usable='no'>phenom</model>
Oct 26 00:03:03 user nova-compute[75165]:       <model usable='yes'>pentium3</model>
Oct 26 00:03:03 user nova-compute[75165]:       <model usable='yes'>pentium2</model>
Oct 26 00:03:03 user nova-compute[75165]:       <model usable='yes'>pentium</model>
Oct 26 00:03:03 user nova-compute[75165]:       <model usable='no'>n270</model>
Oct 26 00:03:03 user nova-compute[75165]:       <model usable='yes'>kvm64</model>
Oct 26 00:03:03 user nova-compute[75165]:       <model usable='yes'>kvm32</model>
Oct 26 00:03:03 user nova-compute[75165]:       <model usable='yes'>coreduo</model>
Oct 26 00:03:03 user nova-compute[75165]:       <model usable='yes'>core2duo</model>
Oct 26 00:03:03 user nova-compute[75165]:       <model usable='no'>athlon</model>
Oct 26 00:03:03 user nova-compute[75165]:       <model usable='yes'>Westmere-IBRS</model>
Oct 26 00:03:03 user nova-compute[75165]:       <model usable='yes'>Westmere</model>
Oct 26 00:03:03 user nova-compute[75165]:       <model usable='no'>Snowridge</model>
Oct 26 00:03:03 user nova-compute[75165]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 26 00:03:03 user nova-compute[75165]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 26 00:03:03 user nova-compute[75165]:       <model usable='no'>Skylake-Server</model>
Oct 26 00:03:03 user nova-compute[75165]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 26 00:03:03 user nova-compute[75165]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 26 00:03:03 user nova-compute[75165]:       <model usable='no'>Skylake-Client</model>
Oct 26 00:03:03 user nova-compute[75165]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 26 00:03:03 user nova-compute[75165]:       <model usable='no'>SandyBridge</model>
Oct 26 00:03:03 user nova-compute[75165]:       <model usable='yes'>Penryn</model>
Oct 26 00:03:03 user nova-compute[75165]:       <model usable='no'>Opteron_G5</model>
Oct 26 00:03:03 user nova-compute[75165]:       <model usable='no'>Opteron_G4</model>
Oct 26 00:03:03 user nova-compute[75165]:       <model usable='no'>Opteron_G3</model>
Oct 26 00:03:03 user nova-compute[75165]:       <model usable='no'>Opteron_G2</model>
Oct 26 00:03:03 user nova-compute[75165]:       <model usable='yes'>Opteron_G1</model>
Oct 26 00:03:03 user nova-compute[75165]:       <model usable='yes'>Nehalem-IBRS</model>
Oct 26 00:03:03 user nova-compute[75165]:       <model usable='yes'>Nehalem</model>
Oct 26 00:03:03 user nova-compute[75165]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 26 00:03:03 user nova-compute[75165]:       <model usable='no'>IvyBridge</model>
Oct 26 00:03:03 user nova-compute[75165]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 26 00:03:03 user nova-compute[75165]:       <model usable='no'>Icelake-Server</model>
Oct 26 00:03:03 user nova-compute[75165]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 26 00:03:03 user nova-compute[75165]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 26 00:03:03 user nova-compute[75165]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 26 00:03:03 user nova-compute[75165]:       <model usable='no'>Haswell-noTSX</model>
Oct 26 00:03:03 user nova-compute[75165]:       <model usable='no'>Haswell-IBRS</model>
Oct 26 00:03:03 user nova-compute[75165]:       <model usable='no'>Haswell</model>
Oct 26 00:03:03 user nova-compute[75165]:       <model usable='no'>EPYC-Rome</model>
Oct 26 00:03:03 user nova-compute[75165]:       <model usable='no'>EPYC-Milan</model>
Oct 26 00:03:03 user nova-compute[75165]:       <model usable='no'>EPYC-IBPB</model>
Oct 26 00:03:03 user nova-compute[75165]:       <model usable='no'>EPYC</model>
Oct 26 00:03:03 user nova-compute[75165]:       <model usable='no'>Dhyana</model>
Oct 26 00:03:03 user nova-compute[75165]:       <model usable='no'>Cooperlake</model>
Oct 26 00:03:03 user nova-compute[75165]:       <model usable='yes'>Conroe</model>
Oct 26 00:03:03 user nova-compute[75165]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 26 00:03:03 user nova-compute[75165]:       <model usable='no'>Cascadelake-Server</model>
Oct 26 00:03:03 user nova-compute[75165]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 26 00:03:03 user nova-compute[75165]:       <model usable='no'>Broadwell-noTSX</model>
Oct 26 00:03:03 user nova-compute[75165]:       <model usable='no'>Broadwell-IBRS</model>
Oct 26 00:03:03 user nova-compute[75165]:       <model usable='no'>Broadwell</model>
Oct 26 00:03:03 user nova-compute[75165]:       <model usable='yes'>486</model>
Oct 26 00:03:03 user nova-compute[75165]:     </mode>
Oct 26 00:03:03 user nova-compute[75165]:   </cpu>
Oct 26 00:03:03 user nova-compute[75165]:   <memoryBacking supported='yes'>
Oct 26 00:03:03 user nova-compute[75165]:     <enum name='sourceType'>
Oct 26 00:03:03 user nova-compute[75165]:       <value>file</value>
Oct 26 00:03:03 user nova-compute[75165]:       <value>anonymous</value>
Oct 26 00:03:03 user nova-compute[75165]:       <value>memfd</value>
Oct 26 00:03:03 user nova-compute[75165]:     </enum>
Oct 26 00:03:03 user nova-compute[75165]:   </memoryBacking>
Oct 26 00:03:03 user nova-compute[75165]:   <devices>
Oct 26 00:03:03 user nova-compute[75165]:     <disk supported='yes'>
Oct 26 00:03:03 user nova-compute[75165]:       <enum name='diskDevice'>
Oct 26 00:03:03 user nova-compute[75165]:         <value>disk</value>
Oct 26 00:03:03 user nova-compute[75165]:         <value>cdrom</value>
Oct 26 00:03:03 user nova-compute[75165]:         <value>floppy</value>
Oct 26 00:03:03 user nova-compute[75165]:         <value>lun</value>
Oct 26 00:03:03 user nova-compute[75165]:       </enum>
Oct 26 00:03:03 user nova-compute[75165]:       <enum name='bus'>
Oct 26 00:03:03 user nova-compute[75165]:         <value>fdc</value>
Oct 26 00:03:03 user nova-compute[75165]:         <value>scsi</value>
Oct 26 00:03:03 user nova-compute[75165]:         <value>virtio</value>
Oct 26 00:03:03 user nova-compute[75165]:         <value>usb</value>
Oct 26 00:03:03 user nova-compute[75165]:         <value>sata</value>
Oct 26 00:03:03 user nova-compute[75165]:       </enum>
Oct 26 00:03:03 user nova-compute[75165]:       <enum name='model'>
Oct 26 00:03:03 user nova-compute[75165]:         <value>virtio</value>
Oct 26 00:03:03 user nova-compute[75165]:         <value>virtio-transitional</value>
Oct 26 00:03:03 user nova-compute[75165]:         <value>virtio-non-transitional</value>
Oct 26 00:03:03 user nova-compute[75165]:       </enum>
Oct 26 00:03:03 user nova-compute[75165]:     </disk>
Oct 26 00:03:03 user nova-compute[75165]:     <graphics supported='yes'>
Oct 26 00:03:03 user nova-compute[75165]:       <enum name='type'>
Oct 26 00:03:03 user nova-compute[75165]:         <value>sdl</value>
Oct 26 00:03:03 user nova-compute[75165]:         <value>vnc</value>
Oct 26 00:03:03 user nova-compute[75165]:         <value>spice</value>
Oct 26 00:03:03 user nova-compute[75165]:         <value>egl-headless</value>
Oct 26 00:03:03 user nova-compute[75165]:       </enum>
Oct 26 00:03:03 user nova-compute[75165]:     </graphics>
Oct 26 00:03:03 user nova-compute[75165]:     <video supported='yes'>
Oct 26 00:03:03 user nova-compute[75165]:       <enum name='modelType'>
Oct 26 00:03:03 user nova-compute[75165]:         <value>vga</value>
Oct 26 00:03:03 user nova-compute[75165]:         <value>cirrus</value>
Oct 26 00:03:03 user nova-compute[75165]:         <value>vmvga</value>
Oct 26 00:03:03 user nova-compute[75165]:         <value>qxl</value>
Oct 26 00:03:03 user nova-compute[75165]:         <value>virtio</value>
Oct 26 00:03:03 user nova-compute[75165]:         <value>none</value>
Oct 26 00:03:03 user nova-compute[75165]:         <value>bochs</value>
Oct 26 00:03:03 user nova-compute[75165]:         <value>ramfb</value>
Oct 26 00:03:03 user nova-compute[75165]:       </enum>
Oct 26 00:03:03 user nova-compute[75165]:     </video>
Oct 26 00:03:03 user nova-compute[75165]:     <hostdev supported='yes'>
Oct 26 00:03:03 user nova-compute[75165]:       <enum name='mode'>
Oct 26 00:03:03 user nova-compute[75165]:         <value>subsystem</value>
Oct 26 00:03:03 user nova-compute[75165]:       </enum>
Oct 26 00:03:03 user nova-compute[75165]:       <enum name='startupPolicy'>
Oct 26 00:03:03 user nova-compute[75165]:         <value>default</value>
Oct 26 00:03:03 user nova-compute[75165]:         <value>mandatory</value>
Oct 26 00:03:03 user nova-compute[75165]:         <value>requisite</value>
Oct 26 00:03:03 user nova-compute[75165]:         <value>optional</value>
Oct 26 00:03:03 user nova-compute[75165]:       </enum>
Oct 26 00:03:03 user nova-compute[75165]:       <enum name='subsysType'>
Oct 26 00:03:03 user nova-compute[75165]:         <value>usb</value>
Oct 26 00:03:03 user nova-compute[75165]:         <value>pci</value>
Oct 26 00:03:03 user nova-compute[75165]:         <value>scsi</value>
Oct 26 00:03:03 user nova-compute[75165]:       </enum>
Oct 26 00:03:03 user nova-compute[75165]:       <enum name='capsType'/>
Oct 26 00:03:03 user nova-compute[75165]:       <enum name='pciBackend'/>
Oct 26 00:03:03 user nova-compute[75165]:     </hostdev>
Oct 26 00:03:03 user nova-compute[75165]:     <rng supported='yes'>
Oct 26 00:03:03 user nova-compute[75165]:       <enum name='model'>
Oct 26 00:03:03 user nova-compute[75165]:         <value>virtio</value>
Oct 26 00:03:03 user nova-compute[75165]:         <value>virtio-transitional</value>
Oct 26 00:03:03 user nova-compute[75165]:         <value>virtio-non-transitional</value>
Oct 26 00:03:03 user nova-compute[75165]:       </enum>
Oct 26 00:03:03 user nova-compute[75165]:       <enum name='backendModel'>
Oct 26 00:03:03 user nova-compute[75165]:         <value>random</value>
Oct 26 00:03:03 user nova-compute[75165]:         <value>egd</value>
Oct 26 00:03:03 user nova-compute[75165]:         <value>builtin</value>
Oct 26 00:03:03 user nova-compute[75165]:       </enum>
Oct 26 00:03:03 user nova-compute[75165]:     </rng>
Oct 26 00:03:03 user nova-compute[75165]:     <filesystem supported='yes'>
Oct 26 00:03:03 user nova-compute[75165]:       <enum name='driverType'>
Oct 26 00:03:03 user nova-compute[75165]:         <value>path</value>
Oct 26 00:03:03 user nova-compute[75165]:         <value>handle</value>
Oct 26 00:03:03 user nova-compute[75165]:         <value>virtiofs</value>
Oct 26 00:03:03 user nova-compute[75165]:       </enum>
Oct 26 00:03:03 user nova-compute[75165]:     </filesystem>
Oct 26 00:03:03 user nova-compute[75165]:     <tpm supported='yes'>
Oct 26 00:03:03 user nova-compute[75165]:       <enum name='model'>
Oct 26 00:03:03 user nova-compute[75165]:         <value>tpm-tis</value>
Oct 26 00:03:03 user nova-compute[75165]:         <value>tpm-crb</value>
Oct 26 00:03:03 user nova-compute[75165]:       </enum>
Oct 26 00:03:03 user nova-compute[75165]:       <enum name='backendModel'>
Oct 26 00:03:03 user nova-compute[75165]:         <value>passthrough</value>
Oct 26 00:03:03 user nova-compute[75165]:         <value>emulator</value>
Oct 26 00:03:03 user nova-compute[75165]:       </enum>
Oct 26 00:03:03 user nova-compute[75165]:     </tpm>
Oct 26 00:03:03 user nova-compute[75165]:   </devices>
Oct 26 00:03:03 user nova-compute[75165]:   <features>
Oct 26 00:03:03 user nova-compute[75165]:     <gic supported='no'/>
Oct 26 00:03:03 user nova-compute[75165]:     <vmcoreinfo supported='yes'/>
Oct 26 00:03:03 user nova-compute[75165]:     <genid supported='yes'/>
Oct 26 00:03:03 user nova-compute[75165]:     <backingStoreInput supported='yes'/>
Oct 26 00:03:03 user nova-compute[75165]:     <backup supported='yes'/>
Oct 26 00:03:03 user nova-compute[75165]:     <sev supported='no'/>
Oct 26 00:03:03 user nova-compute[75165]:   </features>
Oct 26 00:03:03 user nova-compute[75165]: </domainCapabilities>
Oct 26 00:03:03 user nova-compute[75165]:  {{(pid=75165) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 26 00:03:03 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-a2276838-4303-4694-b734-014de1e95741 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Oct 26 00:03:03 user nova-compute[75165]: <domainCapabilities>
Oct 26 00:03:03 user nova-compute[75165]:   <path>/usr/bin/qemu-system-x86_64</path>
Oct 26 00:03:03 user nova-compute[75165]:   <domain>kvm</domain>
Oct 26 00:03:03 user nova-compute[75165]:   <machine>pc-i440fx-6.2</machine>
Oct 26 00:03:03 user nova-compute[75165]:   <arch>x86_64</arch>
Oct 26 00:03:03 user nova-compute[75165]:   <vcpu max='255'/>
Oct 26 00:03:03 user nova-compute[75165]:   <iothreads supported='yes'/>
Oct 26 00:03:03 user nova-compute[75165]:   <os supported='yes'>
Oct 26 00:03:03 user nova-compute[75165]:     <enum name='firmware'>
Oct 26 00:03:03 user nova-compute[75165]:       <value>efi</value>
Oct 26 00:03:03 user nova-compute[75165]:     </enum>
Oct 26 00:03:03 user nova-compute[75165]:     <loader supported='yes'>
Oct 26 00:03:03 user nova-compute[75165]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Oct 26 00:03:03 user nova-compute[75165]:       <enum name='type'>
Oct 26 00:03:03 user nova-compute[75165]:         <value>rom</value>
Oct 26 00:03:03 user nova-compute[75165]:         <value>pflash</value>
Oct 26 00:03:03 user nova-compute[75165]:       </enum>
Oct 26 00:03:03 user nova-compute[75165]:       <enum name='readonly'>
Oct 26 00:03:03 user nova-compute[75165]:         <value>yes</value>
Oct 26 00:03:03 user nova-compute[75165]:         <value>no</value>
Oct 26 00:03:03 user nova-compute[75165]:       </enum>
Oct 26 00:03:03 user nova-compute[75165]:       <enum name='secure'>
Oct 26 00:03:03 user nova-compute[75165]:         <value>no</value>
Oct 26 00:03:03 user nova-compute[75165]:       </enum>
Oct 26 00:03:03 user nova-compute[75165]:     </loader>
Oct 26 00:03:03 user nova-compute[75165]:   </os>
Oct 26 00:03:03 user nova-compute[75165]:   <cpu>
Oct 26 00:03:03 user nova-compute[75165]:     <mode name='host-passthrough' supported='yes'>
Oct 26 00:03:03 user nova-compute[75165]:       <enum name='hostPassthroughMigratable'>
Oct 26 00:03:03 user nova-compute[75165]:         <value>on</value>
Oct 26 00:03:03 user nova-compute[75165]:         <value>off</value>
Oct 26 00:03:03 user nova-compute[75165]:       </enum>
Oct 26 00:03:03 user nova-compute[75165]:     </mode>
Oct 26 00:03:03 user nova-compute[75165]:     <mode name='maximum' supported='yes'>
Oct 26 00:03:03 user nova-compute[75165]:       <enum name='maximumMigratable'>
Oct 26 00:03:03 user nova-compute[75165]:         <value>on</value>
Oct 26 00:03:03 user nova-compute[75165]:         <value>off</value>
Oct 26 00:03:03 user nova-compute[75165]:       </enum>
Oct 26 00:03:03 user nova-compute[75165]:     </mode>
Oct 26 00:03:03 user nova-compute[75165]:     <mode name='host-model' supported='yes'>
Oct 26 00:03:03 user nova-compute[75165]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 26 00:03:03 user nova-compute[75165]:       <vendor>Intel</vendor>
Oct 26 00:03:03 user nova-compute[75165]:       <feature policy='require' name='ss'/>
Oct 26 00:03:03 user nova-compute[75165]:       <feature policy='require' name='vmx'/>
Oct 26 00:03:03 user nova-compute[75165]:       <feature policy='require' name='pcid'/>
Oct 26 00:03:03 user nova-compute[75165]:       <feature policy='require' name='hypervisor'/>
Oct 26 00:03:03 user nova-compute[75165]:       <feature policy='require' name='arat'/>
Oct 26 00:03:03 user nova-compute[75165]:       <feature policy='require' name='tsc_adjust'/>
Oct 26 00:03:03 user nova-compute[75165]:       <feature policy='require' name='umip'/>
Oct 26 00:03:03 user nova-compute[75165]:       <feature policy='require' name='md-clear'/>
Oct 26 00:03:03 user nova-compute[75165]:       <feature policy='require' name='stibp'/>
Oct 26 00:03:03 user nova-compute[75165]:       <feature policy='require' name='arch-capabilities'/>
Oct 26 00:03:03 user nova-compute[75165]:       <feature policy='require' name='ssbd'/>
Oct 26 00:03:03 user nova-compute[75165]:       <feature policy='require' name='invtsc'/>
Oct 26 00:03:03 user nova-compute[75165]:       <feature policy='require' name='ibpb'/>
Oct 26 00:03:03 user nova-compute[75165]:       <feature policy='require' name='ibrs'/>
Oct 26 00:03:03 user nova-compute[75165]:       <feature policy='require' name='amd-stibp'/>
Oct 26 00:03:03 user nova-compute[75165]:       <feature policy='require' name='amd-ssbd'/>
Oct 26 00:03:03 user nova-compute[75165]:       <feature policy='require' name='rsba'/>
Oct 26 00:03:03 user nova-compute[75165]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Oct 26 00:03:03 user nova-compute[75165]:       <feature policy='require' name='pschange-mc-no'/>
Oct 26 00:03:03 user nova-compute[75165]:       <feature policy='disable' name='erms'/>
Oct 26 00:03:03 user nova-compute[75165]:       <feature policy='disable' name='xsaveopt'/>
Oct 26 00:03:03 user nova-compute[75165]:     </mode>
Oct 26 00:03:03 user nova-compute[75165]:     <mode name='custom' supported='yes'>
Oct 26 00:03:03 user nova-compute[75165]:       <model usable='no'>qemu64</model>
Oct 26 00:03:03 user nova-compute[75165]:       <model usable='yes'>qemu32</model>
Oct 26 00:03:03 user nova-compute[75165]:       <model usable='no'>phenom</model>
Oct 26 00:03:03 user nova-compute[75165]:       <model usable='yes'>pentium3</model>
Oct 26 00:03:03 user nova-compute[75165]:       <model usable='yes'>pentium2</model>
Oct 26 00:03:03 user nova-compute[75165]:       <model usable='yes'>pentium</model>
Oct 26 00:03:03 user nova-compute[75165]:       <model usable='no'>n270</model>
Oct 26 00:03:03 user nova-compute[75165]:       <model usable='yes'>kvm64</model>
Oct 26 00:03:03 user nova-compute[75165]:       <model usable='yes'>kvm32</model>
Oct 26 00:03:03 user nova-compute[75165]:       <model usable='yes'>coreduo</model>
Oct 26 00:03:03 user nova-compute[75165]:       <model usable='yes'>core2duo</model>
Oct 26 00:03:03 user nova-compute[75165]:       <model usable='no'>athlon</model>
Oct 26 00:03:03 user nova-compute[75165]:       <model usable='yes'>Westmere-IBRS</model>
Oct 26 00:03:03 user nova-compute[75165]:       <model usable='yes'>Westmere</model>
Oct 26 00:03:03 user nova-compute[75165]:       <model usable='no'>Snowridge</model>
Oct 26 00:03:03 user nova-compute[75165]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 26 00:03:03 user nova-compute[75165]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 26 00:03:03 user nova-compute[75165]:       <model usable='no'>Skylake-Server</model>
Oct 26 00:03:03 user nova-compute[75165]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 26 00:03:03 user nova-compute[75165]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 26 00:03:03 user nova-compute[75165]:       <model usable='no'>Skylake-Client</model>
Oct 26 00:03:03 user nova-compute[75165]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 26 00:03:03 user nova-compute[75165]:       <model usable='no'>SandyBridge</model>
Oct 26 00:03:03 user nova-compute[75165]:       <model usable='yes'>Penryn</model>
Oct 26 00:03:03 user nova-compute[75165]:       <model usable='no'>Opteron_G5</model>
Oct 26 00:03:03 user nova-compute[75165]:       <model usable='no'>Opteron_G4</model>
Oct 26 00:03:03 user nova-compute[75165]:       <model usable='no'>Opteron_G3</model>
Oct 26 00:03:03 user nova-compute[75165]:       <model usable='no'>Opteron_G2</model>
Oct 26 00:03:03 user nova-compute[75165]:       <model usable='yes'>Opteron_G1</model>
Oct 26 00:03:03 user nova-compute[75165]:       <model usable='yes'>Nehalem-IBRS</model>
Oct 26 00:03:03 user nova-compute[75165]:       <model usable='yes'>Nehalem</model>
Oct 26 00:03:03 user nova-compute[75165]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 26 00:03:03 user nova-compute[75165]:       <model usable='no'>IvyBridge</model>
Oct 26 00:03:03 user nova-compute[75165]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 26 00:03:03 user nova-compute[75165]:       <model usable='no'>Icelake-Server</model>
Oct 26 00:03:03 user nova-compute[75165]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 26 00:03:03 user nova-compute[75165]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 26 00:03:03 user nova-compute[75165]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 26 00:03:03 user nova-compute[75165]:       <model usable='no'>Haswell-noTSX</model>
Oct 26 00:03:03 user nova-compute[75165]:       <model usable='no'>Haswell-IBRS</model>
Oct 26 00:03:03 user nova-compute[75165]:       <model usable='no'>Haswell</model>
Oct 26 00:03:03 user nova-compute[75165]:       <model usable='no'>EPYC-Rome</model>
Oct 26 00:03:03 user nova-compute[75165]:       <model usable='no'>EPYC-Milan</model>
Oct 26 00:03:03 user nova-compute[75165]:       <model usable='no'>EPYC-IBPB</model>
Oct 26 00:03:03 user nova-compute[75165]:       <model usable='no'>EPYC</model>
Oct 26 00:03:03 user nova-compute[75165]:       <model usable='no'>Dhyana</model>
Oct 26 00:03:03 user nova-compute[75165]:       <model usable='no'>Cooperlake</model>
Oct 26 00:03:03 user nova-compute[75165]:       <model usable='yes'>Conroe</model>
Oct 26 00:03:03 user nova-compute[75165]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 26 00:03:03 user nova-compute[75165]:       <model usable='no'>Cascadelake-Server</model>
Oct 26 00:03:03 user nova-compute[75165]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 26 00:03:03 user nova-compute[75165]:       <model usable='no'>Broadwell-noTSX</model>
Oct 26 00:03:03 user nova-compute[75165]:       <model usable='no'>Broadwell-IBRS</model>
Oct 26 00:03:03 user nova-compute[75165]:       <model usable='no'>Broadwell</model>
Oct 26 00:03:03 user nova-compute[75165]:       <model usable='yes'>486</model>
Oct 26 00:03:03 user nova-compute[75165]:     </mode>
Oct 26 00:03:03 user nova-compute[75165]:   </cpu>
Oct 26 00:03:03 user nova-compute[75165]:   <memoryBacking supported='yes'>
Oct 26 00:03:03 user nova-compute[75165]:     <enum name='sourceType'>
Oct 26 00:03:03 user nova-compute[75165]:       <value>file</value>
Oct 26 00:03:03 user nova-compute[75165]:       <value>anonymous</value>
Oct 26 00:03:03 user nova-compute[75165]:       <value>memfd</value>
Oct 26 00:03:03 user nova-compute[75165]:     </enum>
Oct 26 00:03:03 user nova-compute[75165]:   </memoryBacking>
Oct 26 00:03:03 user nova-compute[75165]:   <devices>
Oct 26 00:03:03 user nova-compute[75165]:     <disk supported='yes'>
Oct 26 00:03:03 user nova-compute[75165]:       <enum name='diskDevice'>
Oct 26 00:03:03 user nova-compute[75165]:         <value>disk</value>
Oct 26 00:03:03 user nova-compute[75165]:         <value>cdrom</value>
Oct 26 00:03:03 user nova-compute[75165]:         <value>floppy</value>
Oct 26 00:03:03 user nova-compute[75165]:         <value>lun</value>
Oct 26 00:03:03 user nova-compute[75165]:       </enum>
Oct 26 00:03:03 user nova-compute[75165]:       <enum name='bus'>
Oct 26 00:03:03 user nova-compute[75165]:         <value>ide</value>
Oct 26 00:03:03 user nova-compute[75165]:         <value>fdc</value>
Oct 26 00:03:03 user nova-compute[75165]:         <value>scsi</value>
Oct 26 00:03:03 user nova-compute[75165]:         <value>virtio</value>
Oct 26 00:03:03 user nova-compute[75165]:         <value>usb</value>
Oct 26 00:03:03 user nova-compute[75165]:         <value>sata</value>
Oct 26 00:03:03 user nova-compute[75165]:       </enum>
Oct 26 00:03:03 user nova-compute[75165]:       <enum name='model'>
Oct 26 00:03:03 user nova-compute[75165]:         <value>virtio</value>
Oct 26 00:03:03 user nova-compute[75165]:         <value>virtio-transitional</value>
Oct 26 00:03:03 user nova-compute[75165]:         <value>virtio-non-transitional</value>
Oct 26 00:03:03 user nova-compute[75165]:       </enum>
Oct 26 00:03:03 user nova-compute[75165]:     </disk>
Oct 26 00:03:03 user nova-compute[75165]:     <graphics supported='yes'>
Oct 26 00:03:03 user nova-compute[75165]:       <enum name='type'>
Oct 26 00:03:03 user nova-compute[75165]:         <value>sdl</value>
Oct 26 00:03:03 user nova-compute[75165]:         <value>vnc</value>
Oct 26 00:03:03 user nova-compute[75165]:         <value>spice</value>
Oct 26 00:03:03 user nova-compute[75165]:         <value>egl-headless</value>
Oct 26 00:03:03 user nova-compute[75165]:       </enum>
Oct 26 00:03:03 user nova-compute[75165]:     </graphics>
Oct 26 00:03:03 user nova-compute[75165]:     <video supported='yes'>
Oct 26 00:03:03 user nova-compute[75165]:       <enum name='modelType'>
Oct 26 00:03:03 user nova-compute[75165]:         <value>vga</value>
Oct 26 00:03:03 user nova-compute[75165]:         <value>cirrus</value>
Oct 26 00:03:03 user nova-compute[75165]:         <value>vmvga</value>
Oct 26 00:03:03 user nova-compute[75165]:         <value>qxl</value>
Oct 26 00:03:03 user nova-compute[75165]:         <value>virtio</value>
Oct 26 00:03:03 user nova-compute[75165]:         <value>none</value>
Oct 26 00:03:03 user nova-compute[75165]:         <value>bochs</value>
Oct 26 00:03:03 user nova-compute[75165]:         <value>ramfb</value>
Oct 26 00:03:03 user nova-compute[75165]:       </enum>
Oct 26 00:03:03 user nova-compute[75165]:     </video>
Oct 26 00:03:03 user nova-compute[75165]:     <hostdev supported='yes'>
Oct 26 00:03:03 user nova-compute[75165]:       <enum name='mode'>
Oct 26 00:03:03 user nova-compute[75165]:         <value>subsystem</value>
Oct 26 00:03:03 user nova-compute[75165]:       </enum>
Oct 26 00:03:03 user nova-compute[75165]:       <enum name='startupPolicy'>
Oct 26 00:03:03 user nova-compute[75165]:         <value>default</value>
Oct 26 00:03:03 user nova-compute[75165]:         <value>mandatory</value>
Oct 26 00:03:03 user nova-compute[75165]:         <value>requisite</value>
Oct 26 00:03:03 user nova-compute[75165]:         <value>optional</value>
Oct 26 00:03:03 user nova-compute[75165]:       </enum>
Oct 26 00:03:03 user nova-compute[75165]:       <enum name='subsysType'>
Oct 26 00:03:03 user nova-compute[75165]:         <value>usb</value>
Oct 26 00:03:03 user nova-compute[75165]:         <value>pci</value>
Oct 26 00:03:03 user nova-compute[75165]:         <value>scsi</value>
Oct 26 00:03:03 user nova-compute[75165]:       </enum>
Oct 26 00:03:03 user nova-compute[75165]:       <enum name='capsType'/>
Oct 26 00:03:03 user nova-compute[75165]:       <enum name='pciBackend'/>
Oct 26 00:03:03 user nova-compute[75165]:     </hostdev>
Oct 26 00:03:03 user nova-compute[75165]:     <rng supported='yes'>
Oct 26 00:03:03 user nova-compute[75165]:       <enum name='model'>
Oct 26 00:03:03 user nova-compute[75165]:         <value>virtio</value>
Oct 26 00:03:03 user nova-compute[75165]:         <value>virtio-transitional</value>
Oct 26 00:03:03 user nova-compute[75165]:         <value>virtio-non-transitional</value>
Oct 26 00:03:03 user nova-compute[75165]:       </enum>
Oct 26 00:03:03 user nova-compute[75165]:       <enum name='backendModel'>
Oct 26 00:03:03 user nova-compute[75165]:         <value>random</value>
Oct 26 00:03:03 user nova-compute[75165]:         <value>egd</value>
Oct 26 00:03:03 user nova-compute[75165]:         <value>builtin</value>
Oct 26 00:03:03 user nova-compute[75165]:       </enum>
Oct 26 00:03:03 user nova-compute[75165]:     </rng>
Oct 26 00:03:03 user nova-compute[75165]:     <filesystem supported='yes'>
Oct 26 00:03:03 user nova-compute[75165]:       <enum name='driverType'>
Oct 26 00:03:03 user nova-compute[75165]:         <value>path</value>
Oct 26 00:03:03 user nova-compute[75165]:         <value>handle</value>
Oct 26 00:03:03 user nova-compute[75165]:         <value>virtiofs</value>
Oct 26 00:03:03 user nova-compute[75165]:       </enum>
Oct 26 00:03:03 user nova-compute[75165]:     </filesystem>
Oct 26 00:03:03 user nova-compute[75165]:     <tpm supported='yes'>
Oct 26 00:03:03 user nova-compute[75165]:       <enum name='model'>
Oct 26 00:03:03 user nova-compute[75165]:         <value>tpm-tis</value>
Oct 26 00:03:03 user nova-compute[75165]:         <value>tpm-crb</value>
Oct 26 00:03:03 user nova-compute[75165]:       </enum>
Oct 26 00:03:03 user nova-compute[75165]:       <enum name='backendModel'>
Oct 26 00:03:03 user nova-compute[75165]:         <value>passthrough</value>
Oct 26 00:03:03 user nova-compute[75165]:         <value>emulator</value>
Oct 26 00:03:03 user nova-compute[75165]:       </enum>
Oct 26 00:03:03 user nova-compute[75165]:     </tpm>
Oct 26 00:03:03 user nova-compute[75165]:   </devices>
Oct 26 00:03:03 user nova-compute[75165]:   <features>
Oct 26 00:03:03 user nova-compute[75165]:     <gic supported='no'/>
Oct 26 00:03:03 user nova-compute[75165]:     <vmcoreinfo supported='yes'/>
Oct 26 00:03:03 user nova-compute[75165]:     <genid supported='yes'/>
Oct 26 00:03:03 user nova-compute[75165]:     <backingStoreInput supported='yes'/>
Oct 26 00:03:03 user nova-compute[75165]:     <backup supported='yes'/>
Oct 26 00:03:03 user nova-compute[75165]:     <sev supported='no'/>
Oct 26 00:03:03 user nova-compute[75165]:   </features>
Oct 26 00:03:03 user nova-compute[75165]: </domainCapabilities>
Oct 26 00:03:03 user nova-compute[75165]:  {{(pid=75165) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 26 00:03:03 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-a2276838-4303-4694-b734-014de1e95741 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=75165) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 00:03:03 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-a2276838-4303-4694-b734-014de1e95741 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=75165) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 00:03:03 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-a2276838-4303-4694-b734-014de1e95741 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=75165) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 00:03:03 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-a2276838-4303-4694-b734-014de1e95741 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=75165) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 00:03:03 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-a2276838-4303-4694-b734-014de1e95741 None None] Checking secure boot support for host arch (x86_64) {{(pid=75165) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Oct 26 00:03:03 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-a2276838-4303-4694-b734-014de1e95741 None None] Checking secure boot support for host arch (x86_64) {{(pid=75165) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Oct 26 00:03:03 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-a2276838-4303-4694-b734-014de1e95741 None None] Checking secure boot support for host arch (x86_64) {{(pid=75165) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Oct 26 00:03:03 user nova-compute[75165]: INFO nova.virt.libvirt.host [None req-a2276838-4303-4694-b734-014de1e95741 None None] Secure Boot support detected
Oct 26 00:03:03 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-a2276838-4303-4694-b734-014de1e95741 None None] cpu compare xml: <cpu match="exact">
Oct 26 00:03:03 user nova-compute[75165]:   <model>Nehalem</model>
Oct 26 00:03:03 user nova-compute[75165]: </cpu>
Oct 26 00:03:03 user nova-compute[75165]:  {{(pid=75165) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Oct 26 00:03:03 user nova-compute[75165]: INFO nova.virt.node [None req-a2276838-4303-4694-b734-014de1e95741 None None] Generated node identity 03214fd5-21d1-46ec-b6b0-6449b77ba230
Oct 26 00:03:03 user nova-compute[75165]: INFO nova.virt.node [None req-a2276838-4303-4694-b734-014de1e95741 None None] Wrote node identity 03214fd5-21d1-46ec-b6b0-6449b77ba230 to /opt/stack/data/nova/compute_id
Oct 26 00:03:03 user nova-compute[75165]: WARNING nova.compute.manager [None req-a2276838-4303-4694-b734-014de1e95741 None None] Compute nodes ['03214fd5-21d1-46ec-b6b0-6449b77ba230'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Oct 26 00:03:03 user nova-compute[75165]: INFO nova.compute.manager [None req-a2276838-4303-4694-b734-014de1e95741 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Oct 26 00:03:03 user nova-compute[75165]: WARNING nova.compute.manager [None req-a2276838-4303-4694-b734-014de1e95741 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Oct 26 00:03:03 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-a2276838-4303-4694-b734-014de1e95741 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:03:03 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-a2276838-4303-4694-b734-014de1e95741 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:03:03 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-a2276838-4303-4694-b734-014de1e95741 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:03:03 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-a2276838-4303-4694-b734-014de1e95741 None None] Auditing locally available compute resources for user (node: user) {{(pid=75165) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 00:03:03 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-a2276838-4303-4694-b734-014de1e95741 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:03:03 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-a2276838-4303-4694-b734-014de1e95741 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:03:03 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-a2276838-4303-4694-b734-014de1e95741 None None] Hypervisor/Node resource view: name=user free_ram=10998MB free_disk=25.91727066040039GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75165) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 00:03:03 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-a2276838-4303-4694-b734-014de1e95741 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:03:03 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-a2276838-4303-4694-b734-014de1e95741 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:03:03 user nova-compute[75165]: WARNING nova.compute.resource_tracker [None req-a2276838-4303-4694-b734-014de1e95741 None None] No compute node record for user:03214fd5-21d1-46ec-b6b0-6449b77ba230: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 03214fd5-21d1-46ec-b6b0-6449b77ba230 could not be found.
Oct 26 00:03:03 user nova-compute[75165]: INFO nova.compute.resource_tracker [None req-a2276838-4303-4694-b734-014de1e95741 None None] Compute node record created for user:user with uuid: 03214fd5-21d1-46ec-b6b0-6449b77ba230
Oct 26 00:03:03 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-a2276838-4303-4694-b734-014de1e95741 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75165) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 00:03:03 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-a2276838-4303-4694-b734-014de1e95741 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75165) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 00:03:03 user nova-compute[75165]: INFO nova.scheduler.client.report [None req-a2276838-4303-4694-b734-014de1e95741 None None] [req-db2a0d3b-9364-4dbc-ba2e-1468359e2005] Created resource provider record via placement API for resource provider with UUID 03214fd5-21d1-46ec-b6b0-6449b77ba230 and name user.
Oct 26 00:03:03 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-a2276838-4303-4694-b734-014de1e95741 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=75165) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Oct 26 00:03:03 user nova-compute[75165]: INFO nova.virt.libvirt.host [None req-a2276838-4303-4694-b734-014de1e95741 None None] kernel doesn't support AMD SEV
Oct 26 00:03:03 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-a2276838-4303-4694-b734-014de1e95741 None None] Updating inventory in ProviderTree for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 26 00:03:03 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-a2276838-4303-4694-b734-014de1e95741 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75165) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 00:03:03 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-a2276838-4303-4694-b734-014de1e95741 None None] Libvirt baseline CPU <cpu>
Oct 26 00:03:03 user nova-compute[75165]:   <arch>x86_64</arch>
Oct 26 00:03:03 user nova-compute[75165]:   <model>Nehalem</model>
Oct 26 00:03:03 user nova-compute[75165]:   <vendor>Intel</vendor>
Oct 26 00:03:03 user nova-compute[75165]:   <topology sockets="6" cores="1" threads="1"/>
Oct 26 00:03:03 user nova-compute[75165]: </cpu>
Oct 26 00:03:03 user nova-compute[75165]:  {{(pid=75165) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Oct 26 00:03:03 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-a2276838-4303-4694-b734-014de1e95741 None None] Updated inventory for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Oct 26 00:03:03 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-a2276838-4303-4694-b734-014de1e95741 None None] Updating resource provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 generation from 0 to 1 during operation: update_inventory {{(pid=75165) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Oct 26 00:03:03 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-a2276838-4303-4694-b734-014de1e95741 None None] Updating inventory in ProviderTree for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 26 00:03:04 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-a2276838-4303-4694-b734-014de1e95741 None None] Updating resource provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 generation from 1 to 2 during operation: update_traits {{(pid=75165) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Oct 26 00:03:04 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-a2276838-4303-4694-b734-014de1e95741 None None] Compute_service record updated for user:user {{(pid=75165) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 00:03:04 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-a2276838-4303-4694-b734-014de1e95741 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.766s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:03:04 user nova-compute[75165]: DEBUG nova.service [None req-a2276838-4303-4694-b734-014de1e95741 None None] Creating RPC server for service compute {{(pid=75165) start /opt/stack/nova/nova/service.py:182}}
Oct 26 00:03:04 user nova-compute[75165]: DEBUG nova.service [None req-a2276838-4303-4694-b734-014de1e95741 None None] Join ServiceGroup membership for this service compute {{(pid=75165) start /opt/stack/nova/nova/service.py:199}}
Oct 26 00:03:04 user nova-compute[75165]: DEBUG nova.servicegroup.drivers.db [None req-a2276838-4303-4694-b734-014de1e95741 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=75165) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Oct 26 00:03:15 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:03:15 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:03:54 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:03:54 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:03:54 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Starting heal instance info cache {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 00:03:54 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Rebuilding the list of instances to heal {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 00:03:54 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Didn't find any instances for network info cache update. {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 26 00:03:54 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:03:54 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:03:54 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:03:54 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:03:54 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:03:54 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:03:54 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75165) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 00:03:54 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:03:54 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:03:54 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:03:54 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:03:54 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75165) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 00:03:55 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:03:55 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:03:55 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Hypervisor/Node resource view: name=user free_ram=10423MB free_disk=25.82107925415039GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75165) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 00:03:55 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:03:55 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:03:55 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75165) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 00:03:55 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75165) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 00:03:55 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:03:55 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:03:55 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Compute_service record updated for user:user {{(pid=75165) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 00:03:55 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.139s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:04:55 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:04:55 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:04:55 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:04:55 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:04:55 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75165) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 00:04:55 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:04:55 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:04:55 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:04:55 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:04:55 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75165) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 00:04:56 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:04:56 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:04:56 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Hypervisor/Node resource view: name=user free_ram=10382MB free_disk=25.885196685791016GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75165) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 00:04:56 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:04:56 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:04:56 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75165) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 00:04:56 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75165) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 00:04:56 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:04:56 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:04:56 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Compute_service record updated for user:user {{(pid=75165) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 00:04:56 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.106s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:04:57 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:04:57 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:04:57 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Starting heal instance info cache {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 00:04:57 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Rebuilding the list of instances to heal {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 00:04:57 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Didn't find any instances for network info cache update. {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 26 00:04:57 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:04:57 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:04:57 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:05:55 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:05:55 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75165) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 00:05:55 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:05:55 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:05:55 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:05:55 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:05:55 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75165) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 00:05:56 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:05:56 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:05:56 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Hypervisor/Node resource view: name=user free_ram=10365MB free_disk=25.638736724853516GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75165) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 00:05:56 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:05:56 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:05:56 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75165) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 00:05:56 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75165) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 00:05:56 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:05:56 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:05:56 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Compute_service record updated for user:user {{(pid=75165) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 00:05:56 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.105s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:05:57 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:05:57 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:05:57 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:05:57 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:05:57 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:05:57 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:05:58 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:05:58 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Starting heal instance info cache {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 00:05:58 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Rebuilding the list of instances to heal {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 00:05:58 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Didn't find any instances for network info cache update. {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 26 00:06:56 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:06:56 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75165) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 00:06:57 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:06:57 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:06:57 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:06:57 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:06:57 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:06:57 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:06:57 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:06:57 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:06:57 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75165) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 00:06:58 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:06:58 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:06:58 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Hypervisor/Node resource view: name=user free_ram=9648MB free_disk=25.65887451171875GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75165) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 00:06:58 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:06:58 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.006s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:06:58 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75165) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 00:06:58 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75165) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 00:06:58 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:06:58 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:06:58 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Compute_service record updated for user:user {{(pid=75165) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 00:06:58 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.172s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:06:59 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:06:59 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:06:59 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:06:59 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Starting heal instance info cache {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 00:06:59 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Rebuilding the list of instances to heal {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 00:06:59 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Didn't find any instances for network info cache update. {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 26 00:06:59 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:07:03 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-70ba4ee4-a84c-4587-a8b9-97fd07c2ee83 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Acquiring lock "9633e6bb-5e95-4994-92a2-9d8f85a946ff" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:07:03 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-70ba4ee4-a84c-4587-a8b9-97fd07c2ee83 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Lock "9633e6bb-5e95-4994-92a2-9d8f85a946ff" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:07:03 user nova-compute[75165]: DEBUG nova.compute.manager [None req-70ba4ee4-a84c-4587-a8b9-97fd07c2ee83 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] [instance: 9633e6bb-5e95-4994-92a2-9d8f85a946ff] Starting instance... {{(pid=75165) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 00:07:04 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-70ba4ee4-a84c-4587-a8b9-97fd07c2ee83 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:07:04 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-70ba4ee4-a84c-4587-a8b9-97fd07c2ee83 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:07:04 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-70ba4ee4-a84c-4587-a8b9-97fd07c2ee83 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75165) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 00:07:04 user nova-compute[75165]: INFO nova.compute.claims [None req-70ba4ee4-a84c-4587-a8b9-97fd07c2ee83 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] [instance: 9633e6bb-5e95-4994-92a2-9d8f85a946ff] Claim successful on node user
Oct 26 00:07:04 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-70ba4ee4-a84c-4587-a8b9-97fd07c2ee83 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:07:04 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-70ba4ee4-a84c-4587-a8b9-97fd07c2ee83 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:07:04 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-70ba4ee4-a84c-4587-a8b9-97fd07c2ee83 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.395s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:07:04 user nova-compute[75165]: DEBUG nova.compute.manager [None req-70ba4ee4-a84c-4587-a8b9-97fd07c2ee83 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] [instance: 9633e6bb-5e95-4994-92a2-9d8f85a946ff] Start building networks asynchronously for instance. {{(pid=75165) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 00:07:04 user nova-compute[75165]: DEBUG nova.compute.manager [None req-70ba4ee4-a84c-4587-a8b9-97fd07c2ee83 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] [instance: 9633e6bb-5e95-4994-92a2-9d8f85a946ff] Allocating IP information in the background. {{(pid=75165) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 00:07:04 user nova-compute[75165]: DEBUG nova.network.neutron [None req-70ba4ee4-a84c-4587-a8b9-97fd07c2ee83 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] [instance: 9633e6bb-5e95-4994-92a2-9d8f85a946ff] allocate_for_instance() {{(pid=75165) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 00:07:04 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-70ba4ee4-a84c-4587-a8b9-97fd07c2ee83 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] [instance: 9633e6bb-5e95-4994-92a2-9d8f85a946ff] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 00:07:04 user nova-compute[75165]: DEBUG nova.compute.manager [None req-70ba4ee4-a84c-4587-a8b9-97fd07c2ee83 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] [instance: 9633e6bb-5e95-4994-92a2-9d8f85a946ff] Start building block device mappings for instance. {{(pid=75165) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 00:07:05 user nova-compute[75165]: DEBUG nova.compute.manager [None req-70ba4ee4-a84c-4587-a8b9-97fd07c2ee83 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] [instance: 9633e6bb-5e95-4994-92a2-9d8f85a946ff] Start spawning the instance on the hypervisor. {{(pid=75165) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 00:07:05 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-70ba4ee4-a84c-4587-a8b9-97fd07c2ee83 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] [instance: 9633e6bb-5e95-4994-92a2-9d8f85a946ff] Creating instance directory {{(pid=75165) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 00:07:05 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-70ba4ee4-a84c-4587-a8b9-97fd07c2ee83 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] [instance: 9633e6bb-5e95-4994-92a2-9d8f85a946ff] Creating image(s)
Oct 26 00:07:05 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-70ba4ee4-a84c-4587-a8b9-97fd07c2ee83 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Acquiring lock "/opt/stack/data/nova/instances/9633e6bb-5e95-4994-92a2-9d8f85a946ff/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:07:05 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-70ba4ee4-a84c-4587-a8b9-97fd07c2ee83 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Lock "/opt/stack/data/nova/instances/9633e6bb-5e95-4994-92a2-9d8f85a946ff/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:07:05 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-70ba4ee4-a84c-4587-a8b9-97fd07c2ee83 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Lock "/opt/stack/data/nova/instances/9633e6bb-5e95-4994-92a2-9d8f85a946ff/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:07:05 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-70ba4ee4-a84c-4587-a8b9-97fd07c2ee83 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Acquiring lock "7d3243421cf3fdc288b758f687a93103b7b95466" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:07:05 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-70ba4ee4-a84c-4587-a8b9-97fd07c2ee83 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Lock "7d3243421cf3fdc288b758f687a93103b7b95466" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.003s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:07:05 user nova-compute[75165]: DEBUG nova.policy [None req-70ba4ee4-a84c-4587-a8b9-97fd07c2ee83 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd86fd0a8654f412d8c4e8e14d408d7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '410dcedc2c3c49c3990259eca1aee491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75165) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 00:07:05 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-70ba4ee4-a84c-4587-a8b9-97fd07c2ee83 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466.part --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:07:05 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-656c1a74-11db-4031-95a6-53f325bfd24b tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Acquiring lock "84c6b624-648b-40e2-a37e-ff08609bad84" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:07:05 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-656c1a74-11db-4031-95a6-53f325bfd24b tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Lock "84c6b624-648b-40e2-a37e-ff08609bad84" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:07:06 user nova-compute[75165]: DEBUG nova.compute.manager [None req-656c1a74-11db-4031-95a6-53f325bfd24b tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: 84c6b624-648b-40e2-a37e-ff08609bad84] Starting instance... {{(pid=75165) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 00:07:06 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-656c1a74-11db-4031-95a6-53f325bfd24b tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:07:06 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-656c1a74-11db-4031-95a6-53f325bfd24b tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:07:06 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-70ba4ee4-a84c-4587-a8b9-97fd07c2ee83 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466.part --force-share --output=json" returned: 0 in 0.201s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:07:06 user nova-compute[75165]: DEBUG nova.virt.images [None req-70ba4ee4-a84c-4587-a8b9-97fd07c2ee83 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] bff0d8a1-739e-4c4d-9efa-b73ba7b76d01 was qcow2, converting to raw {{(pid=75165) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 26 00:07:06 user nova-compute[75165]: DEBUG nova.privsep.utils [None req-70ba4ee4-a84c-4587-a8b9-97fd07c2ee83 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75165) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 26 00:07:06 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-70ba4ee4-a84c-4587-a8b9-97fd07c2ee83 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466.part /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466.converted {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:07:06 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-656c1a74-11db-4031-95a6-53f325bfd24b tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75165) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 00:07:06 user nova-compute[75165]: INFO nova.compute.claims [None req-656c1a74-11db-4031-95a6-53f325bfd24b tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: 84c6b624-648b-40e2-a37e-ff08609bad84] Claim successful on node user
Oct 26 00:07:06 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-70ba4ee4-a84c-4587-a8b9-97fd07c2ee83 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466.part /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466.converted" returned: 0 in 0.191s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:07:06 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-70ba4ee4-a84c-4587-a8b9-97fd07c2ee83 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466.converted --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:07:06 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-70ba4ee4-a84c-4587-a8b9-97fd07c2ee83 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466.converted --force-share --output=json" returned: 0 in 0.169s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:07:06 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-70ba4ee4-a84c-4587-a8b9-97fd07c2ee83 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Lock "7d3243421cf3fdc288b758f687a93103b7b95466" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.394s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:07:06 user nova-compute[75165]: INFO oslo.privsep.daemon [None req-70ba4ee4-a84c-4587-a8b9-97fd07c2ee83 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp4hy03tcr/privsep.sock']
Oct 26 00:07:06 user sudo[84410]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp4hy03tcr/privsep.sock
Oct 26 00:07:06 user sudo[84410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Oct 26 00:07:06 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-656c1a74-11db-4031-95a6-53f325bfd24b tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:07:06 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-656c1a74-11db-4031-95a6-53f325bfd24b tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:07:06 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-656c1a74-11db-4031-95a6-53f325bfd24b tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.555s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:07:06 user nova-compute[75165]: DEBUG nova.compute.manager [None req-656c1a74-11db-4031-95a6-53f325bfd24b tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: 84c6b624-648b-40e2-a37e-ff08609bad84] Start building networks asynchronously for instance. {{(pid=75165) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 00:07:06 user nova-compute[75165]: DEBUG nova.compute.manager [None req-656c1a74-11db-4031-95a6-53f325bfd24b tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: 84c6b624-648b-40e2-a37e-ff08609bad84] Allocating IP information in the background. {{(pid=75165) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 00:07:06 user nova-compute[75165]: DEBUG nova.network.neutron [None req-656c1a74-11db-4031-95a6-53f325bfd24b tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: 84c6b624-648b-40e2-a37e-ff08609bad84] allocate_for_instance() {{(pid=75165) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 00:07:06 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-656c1a74-11db-4031-95a6-53f325bfd24b tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: 84c6b624-648b-40e2-a37e-ff08609bad84] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 00:07:06 user nova-compute[75165]: DEBUG nova.compute.manager [None req-656c1a74-11db-4031-95a6-53f325bfd24b tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: 84c6b624-648b-40e2-a37e-ff08609bad84] Start building block device mappings for instance. {{(pid=75165) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 00:07:06 user nova-compute[75165]: DEBUG nova.compute.manager [None req-656c1a74-11db-4031-95a6-53f325bfd24b tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: 84c6b624-648b-40e2-a37e-ff08609bad84] Start spawning the instance on the hypervisor. {{(pid=75165) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 00:07:06 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-656c1a74-11db-4031-95a6-53f325bfd24b tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: 84c6b624-648b-40e2-a37e-ff08609bad84] Creating instance directory {{(pid=75165) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 00:07:06 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-656c1a74-11db-4031-95a6-53f325bfd24b tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: 84c6b624-648b-40e2-a37e-ff08609bad84] Creating image(s)
Oct 26 00:07:06 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-656c1a74-11db-4031-95a6-53f325bfd24b tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Acquiring lock "/opt/stack/data/nova/instances/84c6b624-648b-40e2-a37e-ff08609bad84/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:07:06 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-656c1a74-11db-4031-95a6-53f325bfd24b tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Lock "/opt/stack/data/nova/instances/84c6b624-648b-40e2-a37e-ff08609bad84/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:07:06 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-656c1a74-11db-4031-95a6-53f325bfd24b tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Lock "/opt/stack/data/nova/instances/84c6b624-648b-40e2-a37e-ff08609bad84/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:07:07 user nova-compute[75165]: DEBUG nova.policy [None req-656c1a74-11db-4031-95a6-53f325bfd24b tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '67876ca3211b47bc99af08436edeb91f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71aa69c0ea2d49e184e1e055ff3efa1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75165) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 00:07:07 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-f14fa41a-0db2-4572-b30a-8c5b8ceb0780 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] Acquiring lock "18dcf77e-fac2-4b38-ad1c-1f52ce14704a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:07:07 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-f14fa41a-0db2-4572-b30a-8c5b8ceb0780 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] Lock "18dcf77e-fac2-4b38-ad1c-1f52ce14704a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:07:07 user nova-compute[75165]: DEBUG nova.compute.manager [None req-f14fa41a-0db2-4572-b30a-8c5b8ceb0780 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] [instance: 18dcf77e-fac2-4b38-ad1c-1f52ce14704a] Starting instance... {{(pid=75165) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 00:07:07 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-3b915456-470b-49b5-bdff-ae3b0de14dc0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Acquiring lock "c4e44bfc-6a68-46ce-8335-aaaba5160d3e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:07:07 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-3b915456-470b-49b5-bdff-ae3b0de14dc0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Lock "c4e44bfc-6a68-46ce-8335-aaaba5160d3e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:07:07 user nova-compute[75165]: DEBUG nova.compute.manager [None req-3b915456-470b-49b5-bdff-ae3b0de14dc0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: c4e44bfc-6a68-46ce-8335-aaaba5160d3e] Starting instance... {{(pid=75165) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 00:07:07 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-f14fa41a-0db2-4572-b30a-8c5b8ceb0780 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:07:07 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-f14fa41a-0db2-4572-b30a-8c5b8ceb0780 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:07:07 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-f14fa41a-0db2-4572-b30a-8c5b8ceb0780 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75165) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 00:07:07 user nova-compute[75165]: INFO nova.compute.claims [None req-f14fa41a-0db2-4572-b30a-8c5b8ceb0780 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] [instance: 18dcf77e-fac2-4b38-ad1c-1f52ce14704a] Claim successful on node user
Oct 26 00:07:07 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-3b915456-470b-49b5-bdff-ae3b0de14dc0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:07:08 user sudo[84410]: pam_unix(sudo:session): session closed for user root
Oct 26 00:07:08 user nova-compute[75165]: INFO oslo.privsep.daemon [None req-70ba4ee4-a84c-4587-a8b9-97fd07c2ee83 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Spawned new privsep daemon via rootwrap
Oct 26 00:07:08 user nova-compute[75165]: INFO oslo.privsep.daemon [-] privsep daemon starting
Oct 26 00:07:08 user nova-compute[75165]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Oct 26 00:07:08 user nova-compute[75165]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Oct 26 00:07:08 user nova-compute[75165]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84422
Oct 26 00:07:08 user nova-compute[75165]: WARNING oslo_privsep.priv_context [None req-656c1a74-11db-4031-95a6-53f325bfd24b tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] privsep daemon already running
Oct 26 00:07:08 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-f14fa41a-0db2-4572-b30a-8c5b8ceb0780 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:07:08 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-f14fa41a-0db2-4572-b30a-8c5b8ceb0780 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:07:08 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-f14fa41a-0db2-4572-b30a-8c5b8ceb0780 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.315s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:07:08 user nova-compute[75165]: DEBUG nova.compute.manager [None req-f14fa41a-0db2-4572-b30a-8c5b8ceb0780 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] [instance: 18dcf77e-fac2-4b38-ad1c-1f52ce14704a] Start building networks asynchronously for instance. {{(pid=75165) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 00:07:08 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-3b915456-470b-49b5-bdff-ae3b0de14dc0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.271s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:07:08 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-3b915456-470b-49b5-bdff-ae3b0de14dc0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75165) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 00:07:08 user nova-compute[75165]: INFO nova.compute.claims [None req-3b915456-470b-49b5-bdff-ae3b0de14dc0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: c4e44bfc-6a68-46ce-8335-aaaba5160d3e] Claim successful on node user
Oct 26 00:07:08 user nova-compute[75165]: DEBUG nova.compute.manager [None req-f14fa41a-0db2-4572-b30a-8c5b8ceb0780 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] [instance: 18dcf77e-fac2-4b38-ad1c-1f52ce14704a] Allocating IP information in the background. {{(pid=75165) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 00:07:08 user nova-compute[75165]: DEBUG nova.network.neutron [None req-f14fa41a-0db2-4572-b30a-8c5b8ceb0780 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] [instance: 18dcf77e-fac2-4b38-ad1c-1f52ce14704a] allocate_for_instance() {{(pid=75165) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 00:07:08 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-f14fa41a-0db2-4572-b30a-8c5b8ceb0780 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] [instance: 18dcf77e-fac2-4b38-ad1c-1f52ce14704a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 00:07:08 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-70ba4ee4-a84c-4587-a8b9-97fd07c2ee83 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:07:08 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-656c1a74-11db-4031-95a6-53f325bfd24b tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:07:08 user nova-compute[75165]: DEBUG nova.compute.manager [None req-f14fa41a-0db2-4572-b30a-8c5b8ceb0780 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] [instance: 18dcf77e-fac2-4b38-ad1c-1f52ce14704a] Start building block device mappings for instance. {{(pid=75165) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 00:07:08 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-70ba4ee4-a84c-4587-a8b9-97fd07c2ee83 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json" returned: 0 in 0.178s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:07:08 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-70ba4ee4-a84c-4587-a8b9-97fd07c2ee83 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Acquiring lock "7d3243421cf3fdc288b758f687a93103b7b95466" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:07:08 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-70ba4ee4-a84c-4587-a8b9-97fd07c2ee83 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Lock "7d3243421cf3fdc288b758f687a93103b7b95466" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:07:08 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-70ba4ee4-a84c-4587-a8b9-97fd07c2ee83 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:07:08 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-656c1a74-11db-4031-95a6-53f325bfd24b tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json" returned: 0 in 0.220s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:07:08 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-656c1a74-11db-4031-95a6-53f325bfd24b tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Acquiring lock "7d3243421cf3fdc288b758f687a93103b7b95466" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:07:08 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-3b915456-470b-49b5-bdff-ae3b0de14dc0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:07:08 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-3b915456-470b-49b5-bdff-ae3b0de14dc0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:07:08 user nova-compute[75165]: DEBUG nova.compute.manager [None req-f14fa41a-0db2-4572-b30a-8c5b8ceb0780 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] [instance: 18dcf77e-fac2-4b38-ad1c-1f52ce14704a] Start spawning the instance on the hypervisor. {{(pid=75165) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 00:07:08 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-f14fa41a-0db2-4572-b30a-8c5b8ceb0780 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] [instance: 18dcf77e-fac2-4b38-ad1c-1f52ce14704a] Creating instance directory {{(pid=75165) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 00:07:08 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-f14fa41a-0db2-4572-b30a-8c5b8ceb0780 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] [instance: 18dcf77e-fac2-4b38-ad1c-1f52ce14704a] Creating image(s)
Oct 26 00:07:08 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-f14fa41a-0db2-4572-b30a-8c5b8ceb0780 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] Acquiring lock "/opt/stack/data/nova/instances/18dcf77e-fac2-4b38-ad1c-1f52ce14704a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:07:08 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-f14fa41a-0db2-4572-b30a-8c5b8ceb0780 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] Lock "/opt/stack/data/nova/instances/18dcf77e-fac2-4b38-ad1c-1f52ce14704a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:07:08 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-f14fa41a-0db2-4572-b30a-8c5b8ceb0780 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] Lock "/opt/stack/data/nova/instances/18dcf77e-fac2-4b38-ad1c-1f52ce14704a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:07:08 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-f14fa41a-0db2-4572-b30a-8c5b8ceb0780 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:07:08 user nova-compute[75165]: DEBUG nova.policy [None req-f14fa41a-0db2-4572-b30a-8c5b8ceb0780 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ea4de283f02c40479a0bc185f9a06b8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dee554bb28784e6486c6c5fb2df68caf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75165) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 00:07:08 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-3b915456-470b-49b5-bdff-ae3b0de14dc0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.473s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:07:08 user nova-compute[75165]: DEBUG nova.compute.manager [None req-3b915456-470b-49b5-bdff-ae3b0de14dc0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: c4e44bfc-6a68-46ce-8335-aaaba5160d3e] Start building networks asynchronously for instance. {{(pid=75165) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 00:07:08 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-70ba4ee4-a84c-4587-a8b9-97fd07c2ee83 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json" returned: 0 in 0.227s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:07:08 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-70ba4ee4-a84c-4587-a8b9-97fd07c2ee83 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466,backing_fmt=raw /opt/stack/data/nova/instances/9633e6bb-5e95-4994-92a2-9d8f85a946ff/disk 1073741824 {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:07:08 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-70ba4ee4-a84c-4587-a8b9-97fd07c2ee83 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466,backing_fmt=raw /opt/stack/data/nova/instances/9633e6bb-5e95-4994-92a2-9d8f85a946ff/disk 1073741824" returned: 0 in 0.054s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:07:08 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-70ba4ee4-a84c-4587-a8b9-97fd07c2ee83 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Lock "7d3243421cf3fdc288b758f687a93103b7b95466" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.285s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:07:08 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-70ba4ee4-a84c-4587-a8b9-97fd07c2ee83 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:07:08 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-656c1a74-11db-4031-95a6-53f325bfd24b tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Lock "7d3243421cf3fdc288b758f687a93103b7b95466" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.240s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:07:08 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-656c1a74-11db-4031-95a6-53f325bfd24b tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:07:08 user nova-compute[75165]: DEBUG nova.compute.manager [None req-3b915456-470b-49b5-bdff-ae3b0de14dc0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: c4e44bfc-6a68-46ce-8335-aaaba5160d3e] Allocating IP information in the background. {{(pid=75165) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 00:07:08 user nova-compute[75165]: DEBUG nova.network.neutron [None req-3b915456-470b-49b5-bdff-ae3b0de14dc0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: c4e44bfc-6a68-46ce-8335-aaaba5160d3e] allocate_for_instance() {{(pid=75165) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 00:07:08 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-f14fa41a-0db2-4572-b30a-8c5b8ceb0780 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json" returned: 0 in 0.206s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:07:08 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-f14fa41a-0db2-4572-b30a-8c5b8ceb0780 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] Acquiring lock "7d3243421cf3fdc288b758f687a93103b7b95466" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:07:08 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-3b915456-470b-49b5-bdff-ae3b0de14dc0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: c4e44bfc-6a68-46ce-8335-aaaba5160d3e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 00:07:08 user nova-compute[75165]: DEBUG nova.compute.manager [None req-3b915456-470b-49b5-bdff-ae3b0de14dc0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: c4e44bfc-6a68-46ce-8335-aaaba5160d3e] Start building block device mappings for instance. {{(pid=75165) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 00:07:08 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-70ba4ee4-a84c-4587-a8b9-97fd07c2ee83 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json" returned: 0 in 0.187s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:07:08 user nova-compute[75165]: DEBUG nova.virt.disk.api [None req-70ba4ee4-a84c-4587-a8b9-97fd07c2ee83 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9633e6bb-5e95-4994-92a2-9d8f85a946ff/disk. size=1073741824 {{(pid=75165) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 00:07:08 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-70ba4ee4-a84c-4587-a8b9-97fd07c2ee83 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9633e6bb-5e95-4994-92a2-9d8f85a946ff/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:07:08 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-656c1a74-11db-4031-95a6-53f325bfd24b tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json" returned: 0 in 0.186s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:07:08 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-656c1a74-11db-4031-95a6-53f325bfd24b tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466,backing_fmt=raw /opt/stack/data/nova/instances/84c6b624-648b-40e2-a37e-ff08609bad84/disk 1073741824 {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:07:08 user nova-compute[75165]: DEBUG nova.compute.manager [None req-3b915456-470b-49b5-bdff-ae3b0de14dc0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: c4e44bfc-6a68-46ce-8335-aaaba5160d3e] Start spawning the instance on the hypervisor. {{(pid=75165) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 00:07:08 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-3b915456-470b-49b5-bdff-ae3b0de14dc0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: c4e44bfc-6a68-46ce-8335-aaaba5160d3e] Creating instance directory {{(pid=75165) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 00:07:08 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-3b915456-470b-49b5-bdff-ae3b0de14dc0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: c4e44bfc-6a68-46ce-8335-aaaba5160d3e] Creating image(s)
Oct 26 00:07:08 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-3b915456-470b-49b5-bdff-ae3b0de14dc0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Acquiring lock "/opt/stack/data/nova/instances/c4e44bfc-6a68-46ce-8335-aaaba5160d3e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:07:08 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-3b915456-470b-49b5-bdff-ae3b0de14dc0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Lock "/opt/stack/data/nova/instances/c4e44bfc-6a68-46ce-8335-aaaba5160d3e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:07:08 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-3b915456-470b-49b5-bdff-ae3b0de14dc0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Lock "/opt/stack/data/nova/instances/c4e44bfc-6a68-46ce-8335-aaaba5160d3e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:07:08 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-3b915456-470b-49b5-bdff-ae3b0de14dc0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:07:08 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-656c1a74-11db-4031-95a6-53f325bfd24b tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466,backing_fmt=raw /opt/stack/data/nova/instances/84c6b624-648b-40e2-a37e-ff08609bad84/disk 1073741824" returned: 0 in 0.067s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:07:08 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-656c1a74-11db-4031-95a6-53f325bfd24b tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Lock "7d3243421cf3fdc288b758f687a93103b7b95466" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:07:08 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-656c1a74-11db-4031-95a6-53f325bfd24b tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:07:08 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-f14fa41a-0db2-4572-b30a-8c5b8ceb0780 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] Lock "7d3243421cf3fdc288b758f687a93103b7b95466" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.236s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:07:08 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-f14fa41a-0db2-4572-b30a-8c5b8ceb0780 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:07:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-70ba4ee4-a84c-4587-a8b9-97fd07c2ee83 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9633e6bb-5e95-4994-92a2-9d8f85a946ff/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:07:09 user nova-compute[75165]: DEBUG nova.virt.disk.api [None req-70ba4ee4-a84c-4587-a8b9-97fd07c2ee83 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Cannot resize image /opt/stack/data/nova/instances/9633e6bb-5e95-4994-92a2-9d8f85a946ff/disk to a smaller size. {{(pid=75165) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 00:07:09 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-70ba4ee4-a84c-4587-a8b9-97fd07c2ee83 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] [instance: 9633e6bb-5e95-4994-92a2-9d8f85a946ff] Created local disks {{(pid=75165) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 00:07:09 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-70ba4ee4-a84c-4587-a8b9-97fd07c2ee83 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] [instance: 9633e6bb-5e95-4994-92a2-9d8f85a946ff] Ensure instance console log exists: /opt/stack/data/nova/instances/9633e6bb-5e95-4994-92a2-9d8f85a946ff/console.log {{(pid=75165) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 00:07:09 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-70ba4ee4-a84c-4587-a8b9-97fd07c2ee83 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:07:09 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-70ba4ee4-a84c-4587-a8b9-97fd07c2ee83 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:07:09 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-70ba4ee4-a84c-4587-a8b9-97fd07c2ee83 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:07:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-656c1a74-11db-4031-95a6-53f325bfd24b tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json" returned: 0 in 0.148s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:07:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-3b915456-470b-49b5-bdff-ae3b0de14dc0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json" returned: 0 in 0.179s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:07:09 user nova-compute[75165]: DEBUG nova.virt.disk.api [None req-656c1a74-11db-4031-95a6-53f325bfd24b tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Checking if we can resize image /opt/stack/data/nova/instances/84c6b624-648b-40e2-a37e-ff08609bad84/disk. size=1073741824 {{(pid=75165) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 00:07:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-656c1a74-11db-4031-95a6-53f325bfd24b tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84c6b624-648b-40e2-a37e-ff08609bad84/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:07:09 user nova-compute[75165]: DEBUG nova.network.neutron [None req-70ba4ee4-a84c-4587-a8b9-97fd07c2ee83 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] [instance: 9633e6bb-5e95-4994-92a2-9d8f85a946ff] Successfully created port: 6beaf63f-0750-4c6a-b0bd-ebfbca211ad1 {{(pid=75165) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 00:07:09 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-3b915456-470b-49b5-bdff-ae3b0de14dc0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Acquiring lock "7d3243421cf3fdc288b758f687a93103b7b95466" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:07:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-f14fa41a-0db2-4572-b30a-8c5b8ceb0780 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json" returned: 0 in 0.186s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:07:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-f14fa41a-0db2-4572-b30a-8c5b8ceb0780 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466,backing_fmt=raw /opt/stack/data/nova/instances/18dcf77e-fac2-4b38-ad1c-1f52ce14704a/disk 1073741824 {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:07:09 user nova-compute[75165]: DEBUG nova.policy [None req-3b915456-470b-49b5-bdff-ae3b0de14dc0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '67876ca3211b47bc99af08436edeb91f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71aa69c0ea2d49e184e1e055ff3efa1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75165) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 00:07:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-f14fa41a-0db2-4572-b30a-8c5b8ceb0780 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466,backing_fmt=raw /opt/stack/data/nova/instances/18dcf77e-fac2-4b38-ad1c-1f52ce14704a/disk 1073741824" returned: 0 in 0.043s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:07:09 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-f14fa41a-0db2-4572-b30a-8c5b8ceb0780 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] Lock "7d3243421cf3fdc288b758f687a93103b7b95466" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:07:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-f14fa41a-0db2-4572-b30a-8c5b8ceb0780 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:07:09 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-3b915456-470b-49b5-bdff-ae3b0de14dc0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Lock "7d3243421cf3fdc288b758f687a93103b7b95466" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.097s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:07:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-3b915456-470b-49b5-bdff-ae3b0de14dc0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:07:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-656c1a74-11db-4031-95a6-53f325bfd24b tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84c6b624-648b-40e2-a37e-ff08609bad84/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:07:09 user nova-compute[75165]: DEBUG nova.virt.disk.api [None req-656c1a74-11db-4031-95a6-53f325bfd24b tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Cannot resize image /opt/stack/data/nova/instances/84c6b624-648b-40e2-a37e-ff08609bad84/disk to a smaller size. {{(pid=75165) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 00:07:09 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-656c1a74-11db-4031-95a6-53f325bfd24b tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: 84c6b624-648b-40e2-a37e-ff08609bad84] Created local disks {{(pid=75165) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 00:07:09 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-656c1a74-11db-4031-95a6-53f325bfd24b tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: 84c6b624-648b-40e2-a37e-ff08609bad84] Ensure instance console log exists: /opt/stack/data/nova/instances/84c6b624-648b-40e2-a37e-ff08609bad84/console.log {{(pid=75165) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 00:07:09 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-656c1a74-11db-4031-95a6-53f325bfd24b tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:07:09 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-656c1a74-11db-4031-95a6-53f325bfd24b tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:07:09 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-656c1a74-11db-4031-95a6-53f325bfd24b tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:07:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-f14fa41a-0db2-4572-b30a-8c5b8ceb0780 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json" returned: 0 in 0.180s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:07:09 user nova-compute[75165]: DEBUG nova.virt.disk.api [None req-f14fa41a-0db2-4572-b30a-8c5b8ceb0780 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] Checking if we can resize image /opt/stack/data/nova/instances/18dcf77e-fac2-4b38-ad1c-1f52ce14704a/disk. size=1073741824 {{(pid=75165) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 00:07:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-f14fa41a-0db2-4572-b30a-8c5b8ceb0780 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18dcf77e-fac2-4b38-ad1c-1f52ce14704a/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:07:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-3b915456-470b-49b5-bdff-ae3b0de14dc0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json" returned: 0 in 0.196s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:07:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-3b915456-470b-49b5-bdff-ae3b0de14dc0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466,backing_fmt=raw /opt/stack/data/nova/instances/c4e44bfc-6a68-46ce-8335-aaaba5160d3e/disk 1073741824 {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:07:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-3b915456-470b-49b5-bdff-ae3b0de14dc0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466,backing_fmt=raw /opt/stack/data/nova/instances/c4e44bfc-6a68-46ce-8335-aaaba5160d3e/disk 1073741824" returned: 0 in 0.047s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:07:09 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-3b915456-470b-49b5-bdff-ae3b0de14dc0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Lock "7d3243421cf3fdc288b758f687a93103b7b95466" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:07:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-3b915456-470b-49b5-bdff-ae3b0de14dc0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:07:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-f14fa41a-0db2-4572-b30a-8c5b8ceb0780 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18dcf77e-fac2-4b38-ad1c-1f52ce14704a/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:07:09 user nova-compute[75165]: DEBUG nova.virt.disk.api [None req-f14fa41a-0db2-4572-b30a-8c5b8ceb0780 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] Cannot resize image /opt/stack/data/nova/instances/18dcf77e-fac2-4b38-ad1c-1f52ce14704a/disk to a smaller size. {{(pid=75165) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 00:07:09 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-f14fa41a-0db2-4572-b30a-8c5b8ceb0780 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] [instance: 18dcf77e-fac2-4b38-ad1c-1f52ce14704a] Created local disks {{(pid=75165) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 00:07:09 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-f14fa41a-0db2-4572-b30a-8c5b8ceb0780 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] [instance: 18dcf77e-fac2-4b38-ad1c-1f52ce14704a] Ensure instance console log exists: /opt/stack/data/nova/instances/18dcf77e-fac2-4b38-ad1c-1f52ce14704a/console.log {{(pid=75165) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 00:07:09 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-f14fa41a-0db2-4572-b30a-8c5b8ceb0780 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:07:09 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-f14fa41a-0db2-4572-b30a-8c5b8ceb0780 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:07:09 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-f14fa41a-0db2-4572-b30a-8c5b8ceb0780 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:07:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-3b915456-470b-49b5-bdff-ae3b0de14dc0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json" returned: 0 in 0.186s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:07:09 user nova-compute[75165]: DEBUG nova.virt.disk.api [None req-3b915456-470b-49b5-bdff-ae3b0de14dc0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c4e44bfc-6a68-46ce-8335-aaaba5160d3e/disk. size=1073741824 {{(pid=75165) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 00:07:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-3b915456-470b-49b5-bdff-ae3b0de14dc0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e44bfc-6a68-46ce-8335-aaaba5160d3e/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:07:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-3b915456-470b-49b5-bdff-ae3b0de14dc0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e44bfc-6a68-46ce-8335-aaaba5160d3e/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:07:09 user nova-compute[75165]: DEBUG nova.virt.disk.api [None req-3b915456-470b-49b5-bdff-ae3b0de14dc0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Cannot resize image /opt/stack/data/nova/instances/c4e44bfc-6a68-46ce-8335-aaaba5160d3e/disk to a smaller size. {{(pid=75165) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 00:07:09 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-3b915456-470b-49b5-bdff-ae3b0de14dc0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: c4e44bfc-6a68-46ce-8335-aaaba5160d3e] Created local disks {{(pid=75165) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 00:07:09 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-3b915456-470b-49b5-bdff-ae3b0de14dc0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: c4e44bfc-6a68-46ce-8335-aaaba5160d3e] Ensure instance console log exists: /opt/stack/data/nova/instances/c4e44bfc-6a68-46ce-8335-aaaba5160d3e/console.log {{(pid=75165) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 00:07:09 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-3b915456-470b-49b5-bdff-ae3b0de14dc0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:07:09 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-3b915456-470b-49b5-bdff-ae3b0de14dc0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:07:09 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-3b915456-470b-49b5-bdff-ae3b0de14dc0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:07:10 user nova-compute[75165]: DEBUG nova.network.neutron [None req-656c1a74-11db-4031-95a6-53f325bfd24b tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: 84c6b624-648b-40e2-a37e-ff08609bad84] Successfully created port: 2107529c-ec0e-4d1d-85b4-8605dcabc415 {{(pid=75165) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 00:07:11 user nova-compute[75165]: DEBUG nova.network.neutron [None req-f14fa41a-0db2-4572-b30a-8c5b8ceb0780 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] [instance: 18dcf77e-fac2-4b38-ad1c-1f52ce14704a] Successfully created port: 7d1fdd51-5be0-40fd-bb7a-ef881af8f4f8 {{(pid=75165) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 00:07:11 user nova-compute[75165]: DEBUG nova.network.neutron [None req-3b915456-470b-49b5-bdff-ae3b0de14dc0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: c4e44bfc-6a68-46ce-8335-aaaba5160d3e] Successfully created port: 842f3b7a-8da7-48d2-90f7-7241fbaab648 {{(pid=75165) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 00:07:12 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-2b8cd73e-9f80-44dc-bacf-845d4a401ebb tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Acquiring lock "a7eeb145-1565-4812-818b-fefda5f2436d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:07:12 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-2b8cd73e-9f80-44dc-bacf-845d4a401ebb tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Lock "a7eeb145-1565-4812-818b-fefda5f2436d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:07:12 user nova-compute[75165]: DEBUG nova.compute.manager [None req-2b8cd73e-9f80-44dc-bacf-845d4a401ebb tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: a7eeb145-1565-4812-818b-fefda5f2436d] Starting instance... {{(pid=75165) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 00:07:12 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-2b8cd73e-9f80-44dc-bacf-845d4a401ebb tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:07:12 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-2b8cd73e-9f80-44dc-bacf-845d4a401ebb tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:07:12 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-2b8cd73e-9f80-44dc-bacf-845d4a401ebb tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75165) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 00:07:12 user nova-compute[75165]: INFO nova.compute.claims [None req-2b8cd73e-9f80-44dc-bacf-845d4a401ebb tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: a7eeb145-1565-4812-818b-fefda5f2436d] Claim successful on node user
Oct 26 00:07:12 user nova-compute[75165]: DEBUG nova.network.neutron [None req-70ba4ee4-a84c-4587-a8b9-97fd07c2ee83 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] [instance: 9633e6bb-5e95-4994-92a2-9d8f85a946ff] Successfully updated port: 6beaf63f-0750-4c6a-b0bd-ebfbca211ad1 {{(pid=75165) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 00:07:12 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-70ba4ee4-a84c-4587-a8b9-97fd07c2ee83 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Acquiring lock "refresh_cache-9633e6bb-5e95-4994-92a2-9d8f85a946ff" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:07:12 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-70ba4ee4-a84c-4587-a8b9-97fd07c2ee83 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Acquired lock "refresh_cache-9633e6bb-5e95-4994-92a2-9d8f85a946ff" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:07:12 user nova-compute[75165]: DEBUG nova.network.neutron [None req-70ba4ee4-a84c-4587-a8b9-97fd07c2ee83 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] [instance: 9633e6bb-5e95-4994-92a2-9d8f85a946ff] Building network info cache for instance {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 00:07:12 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-2b8cd73e-9f80-44dc-bacf-845d4a401ebb tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:07:12 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-2b8cd73e-9f80-44dc-bacf-845d4a401ebb tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:07:12 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-2b8cd73e-9f80-44dc-bacf-845d4a401ebb tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.381s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:07:12 user nova-compute[75165]: DEBUG nova.compute.manager [None req-2b8cd73e-9f80-44dc-bacf-845d4a401ebb tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: a7eeb145-1565-4812-818b-fefda5f2436d] Start building networks asynchronously for instance. {{(pid=75165) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 00:07:12 user nova-compute[75165]: DEBUG nova.network.neutron [None req-70ba4ee4-a84c-4587-a8b9-97fd07c2ee83 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] [instance: 9633e6bb-5e95-4994-92a2-9d8f85a946ff] Instance cache missing network info. {{(pid=75165) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 00:07:12 user nova-compute[75165]: DEBUG nova.compute.manager [None req-2b8cd73e-9f80-44dc-bacf-845d4a401ebb tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: a7eeb145-1565-4812-818b-fefda5f2436d] Allocating IP information in the background. {{(pid=75165) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 00:07:12 user nova-compute[75165]: DEBUG nova.network.neutron [None req-2b8cd73e-9f80-44dc-bacf-845d4a401ebb tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: a7eeb145-1565-4812-818b-fefda5f2436d] allocate_for_instance() {{(pid=75165) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 00:07:12 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-2b8cd73e-9f80-44dc-bacf-845d4a401ebb tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: a7eeb145-1565-4812-818b-fefda5f2436d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 00:07:12 user nova-compute[75165]: DEBUG nova.compute.manager [None req-2b8cd73e-9f80-44dc-bacf-845d4a401ebb tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: a7eeb145-1565-4812-818b-fefda5f2436d] Start building block device mappings for instance. {{(pid=75165) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 00:07:12 user nova-compute[75165]: DEBUG nova.compute.manager [None req-2b8cd73e-9f80-44dc-bacf-845d4a401ebb tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: a7eeb145-1565-4812-818b-fefda5f2436d] Start spawning the instance on the hypervisor. {{(pid=75165) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 00:07:12 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-2b8cd73e-9f80-44dc-bacf-845d4a401ebb tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: a7eeb145-1565-4812-818b-fefda5f2436d] Creating instance directory {{(pid=75165) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 00:07:12 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-2b8cd73e-9f80-44dc-bacf-845d4a401ebb tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: a7eeb145-1565-4812-818b-fefda5f2436d] Creating image(s)
Oct 26 00:07:12 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-2b8cd73e-9f80-44dc-bacf-845d4a401ebb tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Acquiring lock "/opt/stack/data/nova/instances/a7eeb145-1565-4812-818b-fefda5f2436d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:07:12 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-2b8cd73e-9f80-44dc-bacf-845d4a401ebb tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Lock "/opt/stack/data/nova/instances/a7eeb145-1565-4812-818b-fefda5f2436d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:07:12 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-2b8cd73e-9f80-44dc-bacf-845d4a401ebb tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Lock "/opt/stack/data/nova/instances/a7eeb145-1565-4812-818b-fefda5f2436d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:07:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-2b8cd73e-9f80-44dc-bacf-845d4a401ebb tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:07:12 user nova-compute[75165]: DEBUG nova.policy [None req-2b8cd73e-9f80-44dc-bacf-845d4a401ebb tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5b3ce94f4c01446ebf79a1eba3833e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2911497df44047d9a9ee36a5652298bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75165) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 00:07:13 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-2b8cd73e-9f80-44dc-bacf-845d4a401ebb tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json" returned: 0 in 0.228s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:07:13 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-2b8cd73e-9f80-44dc-bacf-845d4a401ebb tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Acquiring lock "7d3243421cf3fdc288b758f687a93103b7b95466" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:07:13 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-2b8cd73e-9f80-44dc-bacf-845d4a401ebb tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Lock "7d3243421cf3fdc288b758f687a93103b7b95466" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:07:13 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-2b8cd73e-9f80-44dc-bacf-845d4a401ebb tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:07:13 user nova-compute[75165]: DEBUG nova.compute.manager [req-3b559ea4-7494-453c-9197-120ac2b304df req-2cc0d21b-266d-4b38-976e-c285928fe2e7 service nova] [instance: 9633e6bb-5e95-4994-92a2-9d8f85a946ff] Received event network-changed-6beaf63f-0750-4c6a-b0bd-ebfbca211ad1 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:07:13 user nova-compute[75165]: DEBUG nova.compute.manager [req-3b559ea4-7494-453c-9197-120ac2b304df req-2cc0d21b-266d-4b38-976e-c285928fe2e7 service nova] [instance: 9633e6bb-5e95-4994-92a2-9d8f85a946ff] Refreshing instance network info cache due to event network-changed-6beaf63f-0750-4c6a-b0bd-ebfbca211ad1. {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 00:07:13 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-3b559ea4-7494-453c-9197-120ac2b304df req-2cc0d21b-266d-4b38-976e-c285928fe2e7 service nova] Acquiring lock "refresh_cache-9633e6bb-5e95-4994-92a2-9d8f85a946ff" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:07:13 user nova-compute[75165]: DEBUG nova.network.neutron [None req-656c1a74-11db-4031-95a6-53f325bfd24b tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: 84c6b624-648b-40e2-a37e-ff08609bad84] Successfully updated port: 2107529c-ec0e-4d1d-85b4-8605dcabc415 {{(pid=75165) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 00:07:13 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-656c1a74-11db-4031-95a6-53f325bfd24b tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Acquiring lock "refresh_cache-84c6b624-648b-40e2-a37e-ff08609bad84" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:07:13 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-656c1a74-11db-4031-95a6-53f325bfd24b tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Acquired lock "refresh_cache-84c6b624-648b-40e2-a37e-ff08609bad84" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:07:13 user nova-compute[75165]: DEBUG nova.network.neutron [None req-656c1a74-11db-4031-95a6-53f325bfd24b tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: 84c6b624-648b-40e2-a37e-ff08609bad84] Building network info cache for instance {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 00:07:13 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-2b8cd73e-9f80-44dc-bacf-845d4a401ebb tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json" returned: 0 in 0.210s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:07:13 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-2b8cd73e-9f80-44dc-bacf-845d4a401ebb tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466,backing_fmt=raw /opt/stack/data/nova/instances/a7eeb145-1565-4812-818b-fefda5f2436d/disk 1073741824 {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:07:13 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-2b8cd73e-9f80-44dc-bacf-845d4a401ebb tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466,backing_fmt=raw /opt/stack/data/nova/instances/a7eeb145-1565-4812-818b-fefda5f2436d/disk 1073741824" returned: 0 in 0.058s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:07:13 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-2b8cd73e-9f80-44dc-bacf-845d4a401ebb tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Lock "7d3243421cf3fdc288b758f687a93103b7b95466" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.276s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:07:13 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-2b8cd73e-9f80-44dc-bacf-845d4a401ebb tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:07:13 user nova-compute[75165]: DEBUG nova.network.neutron [None req-656c1a74-11db-4031-95a6-53f325bfd24b tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: 84c6b624-648b-40e2-a37e-ff08609bad84] Instance cache missing network info. {{(pid=75165) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 00:07:13 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-26a64c2e-3ffa-417d-920d-0886e701b786 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Acquiring lock "26a0b493-bb47-466e-95d5-945fc3849fa5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:07:13 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-26a64c2e-3ffa-417d-920d-0886e701b786 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Lock "26a0b493-bb47-466e-95d5-945fc3849fa5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:07:13 user nova-compute[75165]: DEBUG nova.compute.manager [None req-26a64c2e-3ffa-417d-920d-0886e701b786 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] Starting instance... {{(pid=75165) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 00:07:13 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-2b8cd73e-9f80-44dc-bacf-845d4a401ebb tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json" returned: 0 in 0.216s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:07:13 user nova-compute[75165]: DEBUG nova.virt.disk.api [None req-2b8cd73e-9f80-44dc-bacf-845d4a401ebb tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a7eeb145-1565-4812-818b-fefda5f2436d/disk. size=1073741824 {{(pid=75165) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 00:07:13 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-2b8cd73e-9f80-44dc-bacf-845d4a401ebb tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7eeb145-1565-4812-818b-fefda5f2436d/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:07:13 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-26a64c2e-3ffa-417d-920d-0886e701b786 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:07:13 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-26a64c2e-3ffa-417d-920d-0886e701b786 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:07:13 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-26a64c2e-3ffa-417d-920d-0886e701b786 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75165) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 00:07:13 user nova-compute[75165]: INFO nova.compute.claims [None req-26a64c2e-3ffa-417d-920d-0886e701b786 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] Claim successful on node user
Oct 26 00:07:13 user nova-compute[75165]: DEBUG nova.network.neutron [None req-70ba4ee4-a84c-4587-a8b9-97fd07c2ee83 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] [instance: 9633e6bb-5e95-4994-92a2-9d8f85a946ff] Updating instance_info_cache with network_info: [{"id": "6beaf63f-0750-4c6a-b0bd-ebfbca211ad1", "address": "fa:16:3e:c1:5c:f3", "network": {"id": "6344595d-af28-41d8-9091-f7565d587f85", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-916895889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "410dcedc2c3c49c3990259eca1aee491", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6beaf63f-07", "ovs_interfaceid": "6beaf63f-0750-4c6a-b0bd-ebfbca211ad1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:07:13 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-70ba4ee4-a84c-4587-a8b9-97fd07c2ee83 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Releasing lock "refresh_cache-9633e6bb-5e95-4994-92a2-9d8f85a946ff" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:07:13 user nova-compute[75165]: DEBUG nova.compute.manager [None req-70ba4ee4-a84c-4587-a8b9-97fd07c2ee83 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] [instance: 9633e6bb-5e95-4994-92a2-9d8f85a946ff] Instance network_info: |[{"id": "6beaf63f-0750-4c6a-b0bd-ebfbca211ad1", "address": "fa:16:3e:c1:5c:f3", "network": {"id": "6344595d-af28-41d8-9091-f7565d587f85", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-916895889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "410dcedc2c3c49c3990259eca1aee491", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6beaf63f-07", "ovs_interfaceid": "6beaf63f-0750-4c6a-b0bd-ebfbca211ad1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75165) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 00:07:13 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-3b559ea4-7494-453c-9197-120ac2b304df req-2cc0d21b-266d-4b38-976e-c285928fe2e7 service nova] Acquired lock "refresh_cache-9633e6bb-5e95-4994-92a2-9d8f85a946ff" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:07:13 user nova-compute[75165]: DEBUG nova.network.neutron [req-3b559ea4-7494-453c-9197-120ac2b304df req-2cc0d21b-266d-4b38-976e-c285928fe2e7 service nova] [instance: 9633e6bb-5e95-4994-92a2-9d8f85a946ff] Refreshing network info cache for port 6beaf63f-0750-4c6a-b0bd-ebfbca211ad1 {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 00:07:13 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-70ba4ee4-a84c-4587-a8b9-97fd07c2ee83 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] [instance: 9633e6bb-5e95-4994-92a2-9d8f85a946ff] Start _get_guest_xml network_info=[{"id": "6beaf63f-0750-4c6a-b0bd-ebfbca211ad1", "address": "fa:16:3e:c1:5c:f3", "network": {"id": "6344595d-af28-41d8-9091-f7565d587f85", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-916895889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "410dcedc2c3c49c3990259eca1aee491", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6beaf63f-07", "ovs_interfaceid": "6beaf63f-0750-4c6a-b0bd-ebfbca211ad1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T00:03:24Z,direct_url=<?>,disk_format='qcow2',id=bff0d8a1-739e-4c4d-9efa-b73ba7b76d01,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e56bbf444fd34c348475c73673611447',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T00:03:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'size': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': 'bff0d8a1-739e-4c4d-9efa-b73ba7b76d01'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75165) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 00:07:13 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-2b8cd73e-9f80-44dc-bacf-845d4a401ebb tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7eeb145-1565-4812-818b-fefda5f2436d/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:07:13 user nova-compute[75165]: DEBUG nova.virt.disk.api [None req-2b8cd73e-9f80-44dc-bacf-845d4a401ebb tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Cannot resize image /opt/stack/data/nova/instances/a7eeb145-1565-4812-818b-fefda5f2436d/disk to a smaller size. {{(pid=75165) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 00:07:13 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-2b8cd73e-9f80-44dc-bacf-845d4a401ebb tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: a7eeb145-1565-4812-818b-fefda5f2436d] Created local disks {{(pid=75165) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 00:07:13 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-2b8cd73e-9f80-44dc-bacf-845d4a401ebb tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: a7eeb145-1565-4812-818b-fefda5f2436d] Ensure instance console log exists: /opt/stack/data/nova/instances/a7eeb145-1565-4812-818b-fefda5f2436d/console.log {{(pid=75165) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 00:07:13 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-2b8cd73e-9f80-44dc-bacf-845d4a401ebb tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:07:13 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-2b8cd73e-9f80-44dc-bacf-845d4a401ebb tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:07:13 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-2b8cd73e-9f80-44dc-bacf-845d4a401ebb tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:07:13 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-70ba4ee4-a84c-4587-a8b9-97fd07c2ee83 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:07:13 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-70ba4ee4-a84c-4587-a8b9-97fd07c2ee83 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:07:13 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-70ba4ee4-a84c-4587-a8b9-97fd07c2ee83 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75165) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 00:07:13 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-70ba4ee4-a84c-4587-a8b9-97fd07c2ee83 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] CPU controller missing on host. {{(pid=75165) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 00:07:13 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-70ba4ee4-a84c-4587-a8b9-97fd07c2ee83 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75165) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 00:07:13 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-70ba4ee4-a84c-4587-a8b9-97fd07c2ee83 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] CPU controller found on host. {{(pid=75165) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 00:07:13 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-70ba4ee4-a84c-4587-a8b9-97fd07c2ee83 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75165) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 00:07:13 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-70ba4ee4-a84c-4587-a8b9-97fd07c2ee83 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T00:03:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T00:03:24Z,direct_url=<?>,disk_format='qcow2',id=bff0d8a1-739e-4c4d-9efa-b73ba7b76d01,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e56bbf444fd34c348475c73673611447',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T00:03:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 00:07:13 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-70ba4ee4-a84c-4587-a8b9-97fd07c2ee83 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Flavor limits 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 00:07:13 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-70ba4ee4-a84c-4587-a8b9-97fd07c2ee83 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Image limits 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 00:07:13 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-70ba4ee4-a84c-4587-a8b9-97fd07c2ee83 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Flavor pref 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 00:07:13 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-70ba4ee4-a84c-4587-a8b9-97fd07c2ee83 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Image pref 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 00:07:13 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-70ba4ee4-a84c-4587-a8b9-97fd07c2ee83 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 00:07:13 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-70ba4ee4-a84c-4587-a8b9-97fd07c2ee83 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 00:07:13 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-70ba4ee4-a84c-4587-a8b9-97fd07c2ee83 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75165) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 00:07:13 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-70ba4ee4-a84c-4587-a8b9-97fd07c2ee83 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Got 1 possible topologies {{(pid=75165) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 00:07:13 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-70ba4ee4-a84c-4587-a8b9-97fd07c2ee83 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 00:07:13 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-70ba4ee4-a84c-4587-a8b9-97fd07c2ee83 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 00:07:13 user nova-compute[75165]: DEBUG nova.privsep.utils [None req-70ba4ee4-a84c-4587-a8b9-97fd07c2ee83 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75165) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 26 00:07:13 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-70ba4ee4-a84c-4587-a8b9-97fd07c2ee83 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:07:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1900438134',display_name='tempest-ServersNegativeTestJSON-server-1900438134',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1900438134',id=1,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='410dcedc2c3c49c3990259eca1aee491',ramdisk_id='',reservation_id='r-aaqcpij4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-585947888',owner_user_name='tempest-ServersNegativeTestJSON-585947888-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T00:07:05Z,user_data=None,user_id='d86fd0a8654f412d8c4e8e14d408d7ed',uuid=9633e6bb-5e95-4994-92a2-9d8f85a946ff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6beaf63f-0750-4c6a-b0bd-ebfbca211ad1", "address": "fa:16:3e:c1:5c:f3", "network": {"id": "6344595d-af28-41d8-9091-f7565d587f85", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-916895889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "410dcedc2c3c49c3990259eca1aee491", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6beaf63f-07", "ovs_interfaceid": "6beaf63f-0750-4c6a-b0bd-ebfbca211ad1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75165) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 00:07:13 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-70ba4ee4-a84c-4587-a8b9-97fd07c2ee83 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Converting VIF {"id": "6beaf63f-0750-4c6a-b0bd-ebfbca211ad1", "address": "fa:16:3e:c1:5c:f3", "network": {"id": "6344595d-af28-41d8-9091-f7565d587f85", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-916895889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "410dcedc2c3c49c3990259eca1aee491", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6beaf63f-07", "ovs_interfaceid": "6beaf63f-0750-4c6a-b0bd-ebfbca211ad1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:07:13 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-70ba4ee4-a84c-4587-a8b9-97fd07c2ee83 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:5c:f3,bridge_name='br-int',has_traffic_filtering=True,id=6beaf63f-0750-4c6a-b0bd-ebfbca211ad1,network=Network(6344595d-af28-41d8-9091-f7565d587f85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6beaf63f-07') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:07:13 user nova-compute[75165]: DEBUG nova.objects.instance [None req-70ba4ee4-a84c-4587-a8b9-97fd07c2ee83 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Lazy-loading 'pci_devices' on Instance uuid 9633e6bb-5e95-4994-92a2-9d8f85a946ff {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:07:13 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-70ba4ee4-a84c-4587-a8b9-97fd07c2ee83 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] [instance: 9633e6bb-5e95-4994-92a2-9d8f85a946ff] End _get_guest_xml xml=<domain type="kvm">
Oct 26 00:07:13 user nova-compute[75165]:   <uuid>9633e6bb-5e95-4994-92a2-9d8f85a946ff</uuid>
Oct 26 00:07:13 user nova-compute[75165]:   <name>instance-00000001</name>
Oct 26 00:07:13 user nova-compute[75165]:   <memory>524288</memory>
Oct 26 00:07:13 user nova-compute[75165]:   <vcpu>1</vcpu>
Oct 26 00:07:13 user nova-compute[75165]:   <metadata>
Oct 26 00:07:13 user nova-compute[75165]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 00:07:13 user nova-compute[75165]:       <nova:package version="0.0.0"/>
Oct 26 00:07:13 user nova-compute[75165]:       <nova:name>tempest-ServersNegativeTestJSON-server-1900438134</nova:name>
Oct 26 00:07:13 user nova-compute[75165]:       <nova:creationTime>2023-10-26 00:07:13</nova:creationTime>
Oct 26 00:07:13 user nova-compute[75165]:       <nova:flavor name="m1.tiny">
Oct 26 00:07:13 user nova-compute[75165]:         <nova:memory>512</nova:memory>
Oct 26 00:07:13 user nova-compute[75165]:         <nova:disk>1</nova:disk>
Oct 26 00:07:13 user nova-compute[75165]:         <nova:swap>0</nova:swap>
Oct 26 00:07:13 user nova-compute[75165]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 00:07:13 user nova-compute[75165]:         <nova:vcpus>1</nova:vcpus>
Oct 26 00:07:13 user nova-compute[75165]:       </nova:flavor>
Oct 26 00:07:13 user nova-compute[75165]:       <nova:owner>
Oct 26 00:07:13 user nova-compute[75165]:         <nova:user uuid="d86fd0a8654f412d8c4e8e14d408d7ed">tempest-ServersNegativeTestJSON-585947888-project-member</nova:user>
Oct 26 00:07:13 user nova-compute[75165]:         <nova:project uuid="410dcedc2c3c49c3990259eca1aee491">tempest-ServersNegativeTestJSON-585947888</nova:project>
Oct 26 00:07:13 user nova-compute[75165]:       </nova:owner>
Oct 26 00:07:13 user nova-compute[75165]:       <nova:root type="image" uuid="bff0d8a1-739e-4c4d-9efa-b73ba7b76d01"/>
Oct 26 00:07:13 user nova-compute[75165]:       <nova:ports>
Oct 26 00:07:13 user nova-compute[75165]:         <nova:port uuid="6beaf63f-0750-4c6a-b0bd-ebfbca211ad1">
Oct 26 00:07:13 user nova-compute[75165]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 26 00:07:13 user nova-compute[75165]:         </nova:port>
Oct 26 00:07:13 user nova-compute[75165]:       </nova:ports>
Oct 26 00:07:13 user nova-compute[75165]:     </nova:instance>
Oct 26 00:07:13 user nova-compute[75165]:   </metadata>
Oct 26 00:07:13 user nova-compute[75165]:   <sysinfo type="smbios">
Oct 26 00:07:13 user nova-compute[75165]:     <system>
Oct 26 00:07:13 user nova-compute[75165]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 00:07:13 user nova-compute[75165]:       <entry name="product">OpenStack Nova</entry>
Oct 26 00:07:13 user nova-compute[75165]:       <entry name="version">0.0.0</entry>
Oct 26 00:07:13 user nova-compute[75165]:       <entry name="serial">9633e6bb-5e95-4994-92a2-9d8f85a946ff</entry>
Oct 26 00:07:13 user nova-compute[75165]:       <entry name="uuid">9633e6bb-5e95-4994-92a2-9d8f85a946ff</entry>
Oct 26 00:07:13 user nova-compute[75165]:       <entry name="family">Virtual Machine</entry>
Oct 26 00:07:13 user nova-compute[75165]:     </system>
Oct 26 00:07:13 user nova-compute[75165]:   </sysinfo>
Oct 26 00:07:13 user nova-compute[75165]:   <os>
Oct 26 00:07:13 user nova-compute[75165]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 00:07:13 user nova-compute[75165]:     <boot dev="hd"/>
Oct 26 00:07:13 user nova-compute[75165]:     <smbios mode="sysinfo"/>
Oct 26 00:07:13 user nova-compute[75165]:   </os>
Oct 26 00:07:13 user nova-compute[75165]:   <features>
Oct 26 00:07:13 user nova-compute[75165]:     <acpi/>
Oct 26 00:07:13 user nova-compute[75165]:     <apic/>
Oct 26 00:07:13 user nova-compute[75165]:     <vmcoreinfo/>
Oct 26 00:07:13 user nova-compute[75165]:   </features>
Oct 26 00:07:13 user nova-compute[75165]:   <clock offset="utc">
Oct 26 00:07:13 user nova-compute[75165]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 00:07:13 user nova-compute[75165]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 00:07:13 user nova-compute[75165]:     <timer name="hpet" present="no"/>
Oct 26 00:07:13 user nova-compute[75165]:   </clock>
Oct 26 00:07:13 user nova-compute[75165]:   <cpu mode="custom" match="exact">
Oct 26 00:07:13 user nova-compute[75165]:     <model>Nehalem</model>
Oct 26 00:07:13 user nova-compute[75165]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 00:07:13 user nova-compute[75165]:   </cpu>
Oct 26 00:07:13 user nova-compute[75165]:   <devices>
Oct 26 00:07:13 user nova-compute[75165]:     <disk type="file" device="disk">
Oct 26 00:07:13 user nova-compute[75165]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 00:07:13 user nova-compute[75165]:       <source file="/opt/stack/data/nova/instances/9633e6bb-5e95-4994-92a2-9d8f85a946ff/disk"/>
Oct 26 00:07:13 user nova-compute[75165]:       <target dev="vda" bus="virtio"/>
Oct 26 00:07:13 user nova-compute[75165]:     </disk>
Oct 26 00:07:13 user nova-compute[75165]:     <interface type="ethernet">
Oct 26 00:07:13 user nova-compute[75165]:       <mac address="fa:16:3e:c1:5c:f3"/>
Oct 26 00:07:13 user nova-compute[75165]:       <model type="virtio"/>
Oct 26 00:07:13 user nova-compute[75165]:       <mtu size="1442"/>
Oct 26 00:07:13 user nova-compute[75165]:       <target dev="tap6beaf63f-07"/>
Oct 26 00:07:13 user nova-compute[75165]:     </interface>
Oct 26 00:07:13 user nova-compute[75165]:     <serial type="pty">
Oct 26 00:07:13 user nova-compute[75165]:       <log file="/opt/stack/data/nova/instances/9633e6bb-5e95-4994-92a2-9d8f85a946ff/console.log" append="off"/>
Oct 26 00:07:13 user nova-compute[75165]:     </serial>
Oct 26 00:07:13 user nova-compute[75165]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 00:07:13 user nova-compute[75165]:     <video>
Oct 26 00:07:13 user nova-compute[75165]:       <model type="virtio"/>
Oct 26 00:07:13 user nova-compute[75165]:     </video>
Oct 26 00:07:13 user nova-compute[75165]:     <rng model="virtio">
Oct 26 00:07:13 user nova-compute[75165]:       <backend model="random">/dev/urandom</backend>
Oct 26 00:07:13 user nova-compute[75165]:     </rng>
Oct 26 00:07:13 user nova-compute[75165]:     <controller type="usb" index="0" model="none"/>
Oct 26 00:07:13 user nova-compute[75165]:     <memballoon model="virtio">
Oct 26 00:07:13 user nova-compute[75165]:       <stats period="10"/>
Oct 26 00:07:13 user nova-compute[75165]:     </memballoon>
Oct 26 00:07:13 user nova-compute[75165]:   </devices>
Oct 26 00:07:13 user nova-compute[75165]: </domain>
Oct 26 00:07:13 user nova-compute[75165]:  {{(pid=75165) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 00:07:13 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-70ba4ee4-a84c-4587-a8b9-97fd07c2ee83 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:07:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1900438134',display_name='tempest-ServersNegativeTestJSON-server-1900438134',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1900438134',id=1,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='410dcedc2c3c49c3990259eca1aee491',ramdisk_id='',reservation_id='r-aaqcpij4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-585947888',owner_user_name='tempest-ServersNegativeTestJSON-585947888-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T00:07:05Z,user_data=None,user_id='d86fd0a8654f412d8c4e8e14d408d7ed',uuid=9633e6bb-5e95-4994-92a2-9d8f85a946ff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6beaf63f-0750-4c6a-b0bd-ebfbca211ad1", "address": "fa:16:3e:c1:5c:f3", "network": {"id": "6344595d-af28-41d8-9091-f7565d587f85", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-916895889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "410dcedc2c3c49c3990259eca1aee491", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6beaf63f-07", "ovs_interfaceid": "6beaf63f-0750-4c6a-b0bd-ebfbca211ad1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 00:07:13 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-70ba4ee4-a84c-4587-a8b9-97fd07c2ee83 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Converting VIF {"id": "6beaf63f-0750-4c6a-b0bd-ebfbca211ad1", "address": "fa:16:3e:c1:5c:f3", "network": {"id": "6344595d-af28-41d8-9091-f7565d587f85", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-916895889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "410dcedc2c3c49c3990259eca1aee491", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6beaf63f-07", "ovs_interfaceid": "6beaf63f-0750-4c6a-b0bd-ebfbca211ad1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:07:13 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-70ba4ee4-a84c-4587-a8b9-97fd07c2ee83 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:5c:f3,bridge_name='br-int',has_traffic_filtering=True,id=6beaf63f-0750-4c6a-b0bd-ebfbca211ad1,network=Network(6344595d-af28-41d8-9091-f7565d587f85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6beaf63f-07') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:07:13 user nova-compute[75165]: DEBUG os_vif [None req-70ba4ee4-a84c-4587-a8b9-97fd07c2ee83 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:5c:f3,bridge_name='br-int',has_traffic_filtering=True,id=6beaf63f-0750-4c6a-b0bd-ebfbca211ad1,network=Network(6344595d-af28-41d8-9091-f7565d587f85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6beaf63f-07') {{(pid=75165) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 00:07:13 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl [None req-70ba4ee4-a84c-4587-a8b9-97fd07c2ee83 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Created schema index Interface.name {{(pid=75165) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Oct 26 00:07:13 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl [None req-70ba4ee4-a84c-4587-a8b9-97fd07c2ee83 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Created schema index Port.name {{(pid=75165) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Oct 26 00:07:13 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl [None req-70ba4ee4-a84c-4587-a8b9-97fd07c2ee83 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Created schema index Bridge.name {{(pid=75165) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Oct 26 00:07:13 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-70ba4ee4-a84c-4587-a8b9-97fd07c2ee83 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=75165) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 00:07:13 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-70ba4ee4-a84c-4587-a8b9-97fd07c2ee83 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] [POLLOUT] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:13 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-70ba4ee4-a84c-4587-a8b9-97fd07c2ee83 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75165) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 00:07:13 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-70ba4ee4-a84c-4587-a8b9-97fd07c2ee83 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:14 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-a2cf0630-846e-4208-9c81-8b7d5d545f44 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Acquiring lock "3b153af2-c93b-47d2-ae8c-76cfd44e384c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:07:14 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-a2cf0630-846e-4208-9c81-8b7d5d545f44 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Lock "3b153af2-c93b-47d2-ae8c-76cfd44e384c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:07:14 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:14 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:07:14 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 00:07:14 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:14 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5c2bef6b-bd18-5e36-9032-402ecf8cf311', '_type': 'linux-noop'}}, row=False) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:07:14 user nova-compute[75165]: DEBUG nova.compute.manager [None req-a2cf0630-846e-4208-9c81-8b7d5d545f44 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] Starting instance... {{(pid=75165) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 00:07:14 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:07:14 user nova-compute[75165]: INFO oslo.privsep.daemon [None req-70ba4ee4-a84c-4587-a8b9-97fd07c2ee83 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpmc3ww_j6/privsep.sock']
Oct 26 00:07:14 user sudo[84507]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpmc3ww_j6/privsep.sock
Oct 26 00:07:14 user sudo[84507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Oct 26 00:07:14 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-26a64c2e-3ffa-417d-920d-0886e701b786 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:07:14 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-a2cf0630-846e-4208-9c81-8b7d5d545f44 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:07:14 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-26a64c2e-3ffa-417d-920d-0886e701b786 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:07:14 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-26a64c2e-3ffa-417d-920d-0886e701b786 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.724s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:07:14 user nova-compute[75165]: DEBUG nova.compute.manager [None req-26a64c2e-3ffa-417d-920d-0886e701b786 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] Start building networks asynchronously for instance. {{(pid=75165) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 00:07:14 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-a2cf0630-846e-4208-9c81-8b7d5d545f44 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.074s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:07:14 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-a2cf0630-846e-4208-9c81-8b7d5d545f44 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75165) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 00:07:14 user nova-compute[75165]: INFO nova.compute.claims [None req-a2cf0630-846e-4208-9c81-8b7d5d545f44 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] Claim successful on node user
Oct 26 00:07:14 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-fc7b823a-9e61-4fab-b9a0-528ca2ebc895 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Acquiring lock "6f9add59-cabe-4965-8fe3-524618550581" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:07:14 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-fc7b823a-9e61-4fab-b9a0-528ca2ebc895 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Lock "6f9add59-cabe-4965-8fe3-524618550581" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:07:14 user nova-compute[75165]: DEBUG nova.network.neutron [None req-656c1a74-11db-4031-95a6-53f325bfd24b tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: 84c6b624-648b-40e2-a37e-ff08609bad84] Updating instance_info_cache with network_info: [{"id": "2107529c-ec0e-4d1d-85b4-8605dcabc415", "address": "fa:16:3e:0c:8a:94", "network": {"id": "b31bac4b-1951-4ca3-8682-f1f24de0a5c3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1323234642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71aa69c0ea2d49e184e1e055ff3efa1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2107529c-ec", "ovs_interfaceid": "2107529c-ec0e-4d1d-85b4-8605dcabc415", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:07:14 user nova-compute[75165]: DEBUG nova.compute.manager [None req-fc7b823a-9e61-4fab-b9a0-528ca2ebc895 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] [instance: 6f9add59-cabe-4965-8fe3-524618550581] Starting instance... {{(pid=75165) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 00:07:14 user nova-compute[75165]: DEBUG nova.compute.manager [None req-26a64c2e-3ffa-417d-920d-0886e701b786 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] Allocating IP information in the background. {{(pid=75165) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 00:07:14 user nova-compute[75165]: DEBUG nova.network.neutron [None req-26a64c2e-3ffa-417d-920d-0886e701b786 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] allocate_for_instance() {{(pid=75165) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 00:07:14 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-26a64c2e-3ffa-417d-920d-0886e701b786 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 00:07:14 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-656c1a74-11db-4031-95a6-53f325bfd24b tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Releasing lock "refresh_cache-84c6b624-648b-40e2-a37e-ff08609bad84" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:07:14 user nova-compute[75165]: DEBUG nova.compute.manager [None req-656c1a74-11db-4031-95a6-53f325bfd24b tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: 84c6b624-648b-40e2-a37e-ff08609bad84] Instance network_info: |[{"id": "2107529c-ec0e-4d1d-85b4-8605dcabc415", "address": "fa:16:3e:0c:8a:94", "network": {"id": "b31bac4b-1951-4ca3-8682-f1f24de0a5c3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1323234642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71aa69c0ea2d49e184e1e055ff3efa1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2107529c-ec", "ovs_interfaceid": "2107529c-ec0e-4d1d-85b4-8605dcabc415", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75165) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 00:07:14 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-656c1a74-11db-4031-95a6-53f325bfd24b tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: 84c6b624-648b-40e2-a37e-ff08609bad84] Start _get_guest_xml network_info=[{"id": "2107529c-ec0e-4d1d-85b4-8605dcabc415", "address": "fa:16:3e:0c:8a:94", "network": {"id": "b31bac4b-1951-4ca3-8682-f1f24de0a5c3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1323234642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71aa69c0ea2d49e184e1e055ff3efa1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2107529c-ec", "ovs_interfaceid": "2107529c-ec0e-4d1d-85b4-8605dcabc415", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T00:03:24Z,direct_url=<?>,disk_format='qcow2',id=bff0d8a1-739e-4c4d-9efa-b73ba7b76d01,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e56bbf444fd34c348475c73673611447',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T00:03:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'size': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': 'bff0d8a1-739e-4c4d-9efa-b73ba7b76d01'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75165) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 00:07:14 user nova-compute[75165]: DEBUG nova.compute.manager [None req-26a64c2e-3ffa-417d-920d-0886e701b786 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] Start building block device mappings for instance. {{(pid=75165) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 00:07:14 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-656c1a74-11db-4031-95a6-53f325bfd24b tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:07:14 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-656c1a74-11db-4031-95a6-53f325bfd24b tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:07:14 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-656c1a74-11db-4031-95a6-53f325bfd24b tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75165) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 00:07:14 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-656c1a74-11db-4031-95a6-53f325bfd24b tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] CPU controller missing on host. {{(pid=75165) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 00:07:14 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-656c1a74-11db-4031-95a6-53f325bfd24b tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75165) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 00:07:14 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-656c1a74-11db-4031-95a6-53f325bfd24b tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] CPU controller found on host. {{(pid=75165) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 00:07:14 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-656c1a74-11db-4031-95a6-53f325bfd24b tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75165) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 00:07:14 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-656c1a74-11db-4031-95a6-53f325bfd24b tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T00:03:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T00:03:24Z,direct_url=<?>,disk_format='qcow2',id=bff0d8a1-739e-4c4d-9efa-b73ba7b76d01,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e56bbf444fd34c348475c73673611447',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T00:03:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 00:07:14 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-656c1a74-11db-4031-95a6-53f325bfd24b tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Flavor limits 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 00:07:14 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-656c1a74-11db-4031-95a6-53f325bfd24b tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Image limits 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 00:07:14 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-656c1a74-11db-4031-95a6-53f325bfd24b tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Flavor pref 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 00:07:14 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-656c1a74-11db-4031-95a6-53f325bfd24b tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Image pref 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 00:07:14 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-656c1a74-11db-4031-95a6-53f325bfd24b tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 00:07:14 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-656c1a74-11db-4031-95a6-53f325bfd24b tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 00:07:14 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-656c1a74-11db-4031-95a6-53f325bfd24b tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75165) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 00:07:14 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-656c1a74-11db-4031-95a6-53f325bfd24b tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Got 1 possible topologies {{(pid=75165) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 00:07:14 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-656c1a74-11db-4031-95a6-53f325bfd24b tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 00:07:14 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-656c1a74-11db-4031-95a6-53f325bfd24b tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 00:07:14 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-656c1a74-11db-4031-95a6-53f325bfd24b tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:07:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1528860087',display_name='tempest-ServerRescueNegativeTestJSON-server-1528860087',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1528860087',id=2,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='71aa69c0ea2d49e184e1e055ff3efa1d',ramdisk_id='',reservation_id='r-oa51f9pk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2141505807',owner_user_name='tempest-ServerRescueNegativeTestJSON-2141505807-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T00:07:07Z,user_data=None,user_id='67876ca3211b47bc99af08436edeb91f',uuid=84c6b624-648b-40e2-a37e-ff08609bad84,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2107529c-ec0e-4d1d-85b4-8605dcabc415", "address": "fa:16:3e:0c:8a:94", "network": {"id": "b31bac4b-1951-4ca3-8682-f1f24de0a5c3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1323234642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71aa69c0ea2d49e184e1e055ff3efa1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2107529c-ec", "ovs_interfaceid": "2107529c-ec0e-4d1d-85b4-8605dcabc415", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75165) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 00:07:14 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-656c1a74-11db-4031-95a6-53f325bfd24b tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Converting VIF {"id": "2107529c-ec0e-4d1d-85b4-8605dcabc415", "address": "fa:16:3e:0c:8a:94", "network": {"id": "b31bac4b-1951-4ca3-8682-f1f24de0a5c3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1323234642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71aa69c0ea2d49e184e1e055ff3efa1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2107529c-ec", "ovs_interfaceid": "2107529c-ec0e-4d1d-85b4-8605dcabc415", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:07:14 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-656c1a74-11db-4031-95a6-53f325bfd24b tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:8a:94,bridge_name='br-int',has_traffic_filtering=True,id=2107529c-ec0e-4d1d-85b4-8605dcabc415,network=Network(b31bac4b-1951-4ca3-8682-f1f24de0a5c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2107529c-ec') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:07:14 user nova-compute[75165]: DEBUG nova.objects.instance [None req-656c1a74-11db-4031-95a6-53f325bfd24b tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Lazy-loading 'pci_devices' on Instance uuid 84c6b624-648b-40e2-a37e-ff08609bad84 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:07:14 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-656c1a74-11db-4031-95a6-53f325bfd24b tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: 84c6b624-648b-40e2-a37e-ff08609bad84] End _get_guest_xml xml=<domain type="kvm">
Oct 26 00:07:14 user nova-compute[75165]:   <uuid>84c6b624-648b-40e2-a37e-ff08609bad84</uuid>
Oct 26 00:07:14 user nova-compute[75165]:   <name>instance-00000002</name>
Oct 26 00:07:14 user nova-compute[75165]:   <memory>524288</memory>
Oct 26 00:07:14 user nova-compute[75165]:   <vcpu>1</vcpu>
Oct 26 00:07:14 user nova-compute[75165]:   <metadata>
Oct 26 00:07:14 user nova-compute[75165]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 00:07:14 user nova-compute[75165]:       <nova:package version="0.0.0"/>
Oct 26 00:07:14 user nova-compute[75165]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1528860087</nova:name>
Oct 26 00:07:14 user nova-compute[75165]:       <nova:creationTime>2023-10-26 00:07:14</nova:creationTime>
Oct 26 00:07:14 user nova-compute[75165]:       <nova:flavor name="m1.tiny">
Oct 26 00:07:14 user nova-compute[75165]:         <nova:memory>512</nova:memory>
Oct 26 00:07:14 user nova-compute[75165]:         <nova:disk>1</nova:disk>
Oct 26 00:07:14 user nova-compute[75165]:         <nova:swap>0</nova:swap>
Oct 26 00:07:14 user nova-compute[75165]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 00:07:14 user nova-compute[75165]:         <nova:vcpus>1</nova:vcpus>
Oct 26 00:07:14 user nova-compute[75165]:       </nova:flavor>
Oct 26 00:07:14 user nova-compute[75165]:       <nova:owner>
Oct 26 00:07:14 user nova-compute[75165]:         <nova:user uuid="67876ca3211b47bc99af08436edeb91f">tempest-ServerRescueNegativeTestJSON-2141505807-project-member</nova:user>
Oct 26 00:07:14 user nova-compute[75165]:         <nova:project uuid="71aa69c0ea2d49e184e1e055ff3efa1d">tempest-ServerRescueNegativeTestJSON-2141505807</nova:project>
Oct 26 00:07:14 user nova-compute[75165]:       </nova:owner>
Oct 26 00:07:14 user nova-compute[75165]:       <nova:root type="image" uuid="bff0d8a1-739e-4c4d-9efa-b73ba7b76d01"/>
Oct 26 00:07:14 user nova-compute[75165]:       <nova:ports>
Oct 26 00:07:14 user nova-compute[75165]:         <nova:port uuid="2107529c-ec0e-4d1d-85b4-8605dcabc415">
Oct 26 00:07:14 user nova-compute[75165]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 26 00:07:14 user nova-compute[75165]:         </nova:port>
Oct 26 00:07:14 user nova-compute[75165]:       </nova:ports>
Oct 26 00:07:14 user nova-compute[75165]:     </nova:instance>
Oct 26 00:07:14 user nova-compute[75165]:   </metadata>
Oct 26 00:07:14 user nova-compute[75165]:   <sysinfo type="smbios">
Oct 26 00:07:14 user nova-compute[75165]:     <system>
Oct 26 00:07:14 user nova-compute[75165]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 00:07:14 user nova-compute[75165]:       <entry name="product">OpenStack Nova</entry>
Oct 26 00:07:14 user nova-compute[75165]:       <entry name="version">0.0.0</entry>
Oct 26 00:07:14 user nova-compute[75165]:       <entry name="serial">84c6b624-648b-40e2-a37e-ff08609bad84</entry>
Oct 26 00:07:14 user nova-compute[75165]:       <entry name="uuid">84c6b624-648b-40e2-a37e-ff08609bad84</entry>
Oct 26 00:07:14 user nova-compute[75165]:       <entry name="family">Virtual Machine</entry>
Oct 26 00:07:14 user nova-compute[75165]:     </system>
Oct 26 00:07:14 user nova-compute[75165]:   </sysinfo>
Oct 26 00:07:14 user nova-compute[75165]:   <os>
Oct 26 00:07:14 user nova-compute[75165]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 00:07:14 user nova-compute[75165]:     <boot dev="hd"/>
Oct 26 00:07:14 user nova-compute[75165]:     <smbios mode="sysinfo"/>
Oct 26 00:07:14 user nova-compute[75165]:   </os>
Oct 26 00:07:14 user nova-compute[75165]:   <features>
Oct 26 00:07:14 user nova-compute[75165]:     <acpi/>
Oct 26 00:07:14 user nova-compute[75165]:     <apic/>
Oct 26 00:07:14 user nova-compute[75165]:     <vmcoreinfo/>
Oct 26 00:07:14 user nova-compute[75165]:   </features>
Oct 26 00:07:14 user nova-compute[75165]:   <clock offset="utc">
Oct 26 00:07:14 user nova-compute[75165]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 00:07:14 user nova-compute[75165]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 00:07:14 user nova-compute[75165]:     <timer name="hpet" present="no"/>
Oct 26 00:07:14 user nova-compute[75165]:   </clock>
Oct 26 00:07:14 user nova-compute[75165]:   <cpu mode="custom" match="exact">
Oct 26 00:07:14 user nova-compute[75165]:     <model>Nehalem</model>
Oct 26 00:07:14 user nova-compute[75165]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 00:07:14 user nova-compute[75165]:   </cpu>
Oct 26 00:07:14 user nova-compute[75165]:   <devices>
Oct 26 00:07:14 user nova-compute[75165]:     <disk type="file" device="disk">
Oct 26 00:07:14 user nova-compute[75165]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 00:07:14 user nova-compute[75165]:       <source file="/opt/stack/data/nova/instances/84c6b624-648b-40e2-a37e-ff08609bad84/disk"/>
Oct 26 00:07:14 user nova-compute[75165]:       <target dev="vda" bus="virtio"/>
Oct 26 00:07:14 user nova-compute[75165]:     </disk>
Oct 26 00:07:14 user nova-compute[75165]:     <interface type="ethernet">
Oct 26 00:07:14 user nova-compute[75165]:       <mac address="fa:16:3e:0c:8a:94"/>
Oct 26 00:07:14 user nova-compute[75165]:       <model type="virtio"/>
Oct 26 00:07:14 user nova-compute[75165]:       <mtu size="1442"/>
Oct 26 00:07:14 user nova-compute[75165]:       <target dev="tap2107529c-ec"/>
Oct 26 00:07:14 user nova-compute[75165]:     </interface>
Oct 26 00:07:14 user nova-compute[75165]:     <serial type="pty">
Oct 26 00:07:14 user nova-compute[75165]:       <log file="/opt/stack/data/nova/instances/84c6b624-648b-40e2-a37e-ff08609bad84/console.log" append="off"/>
Oct 26 00:07:14 user nova-compute[75165]:     </serial>
Oct 26 00:07:14 user nova-compute[75165]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 00:07:14 user nova-compute[75165]:     <video>
Oct 26 00:07:14 user nova-compute[75165]:       <model type="virtio"/>
Oct 26 00:07:14 user nova-compute[75165]:     </video>
Oct 26 00:07:14 user nova-compute[75165]:     <rng model="virtio">
Oct 26 00:07:14 user nova-compute[75165]:       <backend model="random">/dev/urandom</backend>
Oct 26 00:07:14 user nova-compute[75165]:     </rng>
Oct 26 00:07:14 user nova-compute[75165]:     <controller type="usb" index="0" model="none"/>
Oct 26 00:07:14 user nova-compute[75165]:     <memballoon model="virtio">
Oct 26 00:07:14 user nova-compute[75165]:       <stats period="10"/>
Oct 26 00:07:14 user nova-compute[75165]:     </memballoon>
Oct 26 00:07:14 user nova-compute[75165]:   </devices>
Oct 26 00:07:14 user nova-compute[75165]: </domain>
Oct 26 00:07:14 user nova-compute[75165]:  {{(pid=75165) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 00:07:14 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-656c1a74-11db-4031-95a6-53f325bfd24b tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:07:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1528860087',display_name='tempest-ServerRescueNegativeTestJSON-server-1528860087',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1528860087',id=2,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='71aa69c0ea2d49e184e1e055ff3efa1d',ramdisk_id='',reservation_id='r-oa51f9pk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2141505807',owner_user_name='tempest-ServerRescueNegativeTestJSON-2141505807-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T00:07:07Z,user_data=None,user_id='67876ca3211b47bc99af08436edeb91f',uuid=84c6b624-648b-40e2-a37e-ff08609bad84,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2107529c-ec0e-4d1d-85b4-8605dcabc415", "address": "fa:16:3e:0c:8a:94", "network": {"id": "b31bac4b-1951-4ca3-8682-f1f24de0a5c3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1323234642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71aa69c0ea2d49e184e1e055ff3efa1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2107529c-ec", "ovs_interfaceid": "2107529c-ec0e-4d1d-85b4-8605dcabc415", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 00:07:14 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-656c1a74-11db-4031-95a6-53f325bfd24b tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Converting VIF {"id": "2107529c-ec0e-4d1d-85b4-8605dcabc415", "address": "fa:16:3e:0c:8a:94", "network": {"id": "b31bac4b-1951-4ca3-8682-f1f24de0a5c3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1323234642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71aa69c0ea2d49e184e1e055ff3efa1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2107529c-ec", "ovs_interfaceid": "2107529c-ec0e-4d1d-85b4-8605dcabc415", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:07:14 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-656c1a74-11db-4031-95a6-53f325bfd24b tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:8a:94,bridge_name='br-int',has_traffic_filtering=True,id=2107529c-ec0e-4d1d-85b4-8605dcabc415,network=Network(b31bac4b-1951-4ca3-8682-f1f24de0a5c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2107529c-ec') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:07:14 user nova-compute[75165]: DEBUG os_vif [None req-656c1a74-11db-4031-95a6-53f325bfd24b tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:8a:94,bridge_name='br-int',has_traffic_filtering=True,id=2107529c-ec0e-4d1d-85b4-8605dcabc415,network=Network(b31bac4b-1951-4ca3-8682-f1f24de0a5c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2107529c-ec') {{(pid=75165) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 00:07:14 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:14 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:07:14 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 00:07:14 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:14 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1717dd06-0777-5d17-a761-8bde903989d1', '_type': 'linux-noop'}}, row=False) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:07:14 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:14 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-fc7b823a-9e61-4fab-b9a0-528ca2ebc895 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:07:14 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:07:14 user nova-compute[75165]: DEBUG nova.compute.manager [None req-26a64c2e-3ffa-417d-920d-0886e701b786 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] Start spawning the instance on the hypervisor. {{(pid=75165) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 00:07:14 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-26a64c2e-3ffa-417d-920d-0886e701b786 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] Creating instance directory {{(pid=75165) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 00:07:14 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-26a64c2e-3ffa-417d-920d-0886e701b786 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] Creating image(s)
Oct 26 00:07:14 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-26a64c2e-3ffa-417d-920d-0886e701b786 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Acquiring lock "/opt/stack/data/nova/instances/26a0b493-bb47-466e-95d5-945fc3849fa5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:07:14 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-26a64c2e-3ffa-417d-920d-0886e701b786 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Lock "/opt/stack/data/nova/instances/26a0b493-bb47-466e-95d5-945fc3849fa5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:07:14 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-26a64c2e-3ffa-417d-920d-0886e701b786 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Lock "/opt/stack/data/nova/instances/26a0b493-bb47-466e-95d5-945fc3849fa5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:07:14 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-26a64c2e-3ffa-417d-920d-0886e701b786 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:07:14 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-a2cf0630-846e-4208-9c81-8b7d5d545f44 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:07:14 user nova-compute[75165]: DEBUG nova.policy [None req-26a64c2e-3ffa-417d-920d-0886e701b786 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7ac761f144034256baf6a2372a7b685c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cbae16d09ed4474bb6653f08165a4e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75165) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 00:07:14 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-a2cf0630-846e-4208-9c81-8b7d5d545f44 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:07:14 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-26a64c2e-3ffa-417d-920d-0886e701b786 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json" returned: 0 in 0.215s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:07:14 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-26a64c2e-3ffa-417d-920d-0886e701b786 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Acquiring lock "7d3243421cf3fdc288b758f687a93103b7b95466" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:07:14 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-26a64c2e-3ffa-417d-920d-0886e701b786 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Lock "7d3243421cf3fdc288b758f687a93103b7b95466" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:07:14 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-26a64c2e-3ffa-417d-920d-0886e701b786 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:07:14 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-a2cf0630-846e-4208-9c81-8b7d5d545f44 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.629s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:07:14 user nova-compute[75165]: DEBUG nova.compute.manager [None req-a2cf0630-846e-4208-9c81-8b7d5d545f44 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] Start building networks asynchronously for instance. {{(pid=75165) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 00:07:14 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-fc7b823a-9e61-4fab-b9a0-528ca2ebc895 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.328s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:07:14 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-fc7b823a-9e61-4fab-b9a0-528ca2ebc895 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75165) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 00:07:14 user nova-compute[75165]: INFO nova.compute.claims [None req-fc7b823a-9e61-4fab-b9a0-528ca2ebc895 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] [instance: 6f9add59-cabe-4965-8fe3-524618550581] Claim successful on node user
Oct 26 00:07:15 user nova-compute[75165]: DEBUG nova.compute.manager [None req-a2cf0630-846e-4208-9c81-8b7d5d545f44 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] Allocating IP information in the background. {{(pid=75165) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 00:07:15 user nova-compute[75165]: DEBUG nova.network.neutron [None req-a2cf0630-846e-4208-9c81-8b7d5d545f44 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] allocate_for_instance() {{(pid=75165) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 00:07:15 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-a2cf0630-846e-4208-9c81-8b7d5d545f44 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 00:07:15 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-26a64c2e-3ffa-417d-920d-0886e701b786 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json" returned: 0 in 0.171s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:07:15 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-26a64c2e-3ffa-417d-920d-0886e701b786 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466,backing_fmt=raw /opt/stack/data/nova/instances/26a0b493-bb47-466e-95d5-945fc3849fa5/disk 1073741824 {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:07:15 user nova-compute[75165]: DEBUG nova.compute.manager [None req-a2cf0630-846e-4208-9c81-8b7d5d545f44 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] Start building block device mappings for instance. {{(pid=75165) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 00:07:15 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-26a64c2e-3ffa-417d-920d-0886e701b786 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466,backing_fmt=raw /opt/stack/data/nova/instances/26a0b493-bb47-466e-95d5-945fc3849fa5/disk 1073741824" returned: 0 in 0.051s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:07:15 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-26a64c2e-3ffa-417d-920d-0886e701b786 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Lock "7d3243421cf3fdc288b758f687a93103b7b95466" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.224s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:07:15 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-26a64c2e-3ffa-417d-920d-0886e701b786 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:07:15 user nova-compute[75165]: DEBUG nova.network.neutron [None req-f14fa41a-0db2-4572-b30a-8c5b8ceb0780 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] [instance: 18dcf77e-fac2-4b38-ad1c-1f52ce14704a] Successfully updated port: 7d1fdd51-5be0-40fd-bb7a-ef881af8f4f8 {{(pid=75165) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 00:07:15 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-f14fa41a-0db2-4572-b30a-8c5b8ceb0780 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] Acquiring lock "refresh_cache-18dcf77e-fac2-4b38-ad1c-1f52ce14704a" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:07:15 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-f14fa41a-0db2-4572-b30a-8c5b8ceb0780 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] Acquired lock "refresh_cache-18dcf77e-fac2-4b38-ad1c-1f52ce14704a" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:07:15 user nova-compute[75165]: DEBUG nova.network.neutron [None req-f14fa41a-0db2-4572-b30a-8c5b8ceb0780 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] [instance: 18dcf77e-fac2-4b38-ad1c-1f52ce14704a] Building network info cache for instance {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 00:07:15 user nova-compute[75165]: DEBUG nova.network.neutron [None req-3b915456-470b-49b5-bdff-ae3b0de14dc0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: c4e44bfc-6a68-46ce-8335-aaaba5160d3e] Successfully updated port: 842f3b7a-8da7-48d2-90f7-7241fbaab648 {{(pid=75165) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 00:07:15 user nova-compute[75165]: DEBUG nova.network.neutron [req-3b559ea4-7494-453c-9197-120ac2b304df req-2cc0d21b-266d-4b38-976e-c285928fe2e7 service nova] [instance: 9633e6bb-5e95-4994-92a2-9d8f85a946ff] Updated VIF entry in instance network info cache for port 6beaf63f-0750-4c6a-b0bd-ebfbca211ad1. {{(pid=75165) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 00:07:15 user nova-compute[75165]: DEBUG nova.network.neutron [req-3b559ea4-7494-453c-9197-120ac2b304df req-2cc0d21b-266d-4b38-976e-c285928fe2e7 service nova] [instance: 9633e6bb-5e95-4994-92a2-9d8f85a946ff] Updating instance_info_cache with network_info: [{"id": "6beaf63f-0750-4c6a-b0bd-ebfbca211ad1", "address": "fa:16:3e:c1:5c:f3", "network": {"id": "6344595d-af28-41d8-9091-f7565d587f85", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-916895889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "410dcedc2c3c49c3990259eca1aee491", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6beaf63f-07", "ovs_interfaceid": "6beaf63f-0750-4c6a-b0bd-ebfbca211ad1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:07:15 user nova-compute[75165]: DEBUG nova.policy [None req-a2cf0630-846e-4208-9c81-8b7d5d545f44 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '43f095bccf684d5a84b874439f2c58e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0db2c49ee28f4b7b9fa990faddb9d3a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75165) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 00:07:15 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:15 user nova-compute[75165]: DEBUG nova.compute.manager [None req-a2cf0630-846e-4208-9c81-8b7d5d545f44 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] Start spawning the instance on the hypervisor. {{(pid=75165) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 00:07:15 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-a2cf0630-846e-4208-9c81-8b7d5d545f44 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] Creating instance directory {{(pid=75165) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 00:07:15 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-a2cf0630-846e-4208-9c81-8b7d5d545f44 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] Creating image(s)
Oct 26 00:07:15 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-a2cf0630-846e-4208-9c81-8b7d5d545f44 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Acquiring lock "/opt/stack/data/nova/instances/3b153af2-c93b-47d2-ae8c-76cfd44e384c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:07:15 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-a2cf0630-846e-4208-9c81-8b7d5d545f44 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Lock "/opt/stack/data/nova/instances/3b153af2-c93b-47d2-ae8c-76cfd44e384c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:07:15 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-a2cf0630-846e-4208-9c81-8b7d5d545f44 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Lock "/opt/stack/data/nova/instances/3b153af2-c93b-47d2-ae8c-76cfd44e384c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:07:15 user nova-compute[75165]: DEBUG nova.compute.manager [req-74e41b32-ebb5-4d06-b61c-3ef0c7e0dc78 req-b5947b1b-0155-461e-b142-468f0e12571e service nova] [instance: 84c6b624-648b-40e2-a37e-ff08609bad84] Received event network-changed-2107529c-ec0e-4d1d-85b4-8605dcabc415 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:07:15 user nova-compute[75165]: DEBUG nova.compute.manager [req-74e41b32-ebb5-4d06-b61c-3ef0c7e0dc78 req-b5947b1b-0155-461e-b142-468f0e12571e service nova] [instance: 84c6b624-648b-40e2-a37e-ff08609bad84] Refreshing instance network info cache due to event network-changed-2107529c-ec0e-4d1d-85b4-8605dcabc415. {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 00:07:15 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-74e41b32-ebb5-4d06-b61c-3ef0c7e0dc78 req-b5947b1b-0155-461e-b142-468f0e12571e service nova] Acquiring lock "refresh_cache-84c6b624-648b-40e2-a37e-ff08609bad84" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:07:15 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-74e41b32-ebb5-4d06-b61c-3ef0c7e0dc78 req-b5947b1b-0155-461e-b142-468f0e12571e service nova] Acquired lock "refresh_cache-84c6b624-648b-40e2-a37e-ff08609bad84" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:07:15 user nova-compute[75165]: DEBUG nova.network.neutron [req-74e41b32-ebb5-4d06-b61c-3ef0c7e0dc78 req-b5947b1b-0155-461e-b142-468f0e12571e service nova] [instance: 84c6b624-648b-40e2-a37e-ff08609bad84] Refreshing network info cache for port 2107529c-ec0e-4d1d-85b4-8605dcabc415 {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 00:07:15 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-26a64c2e-3ffa-417d-920d-0886e701b786 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json" returned: 0 in 0.495s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:07:15 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-3b915456-470b-49b5-bdff-ae3b0de14dc0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Acquiring lock "refresh_cache-c4e44bfc-6a68-46ce-8335-aaaba5160d3e" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:07:15 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-3b915456-470b-49b5-bdff-ae3b0de14dc0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Acquired lock "refresh_cache-c4e44bfc-6a68-46ce-8335-aaaba5160d3e" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:07:15 user nova-compute[75165]: DEBUG nova.network.neutron [None req-3b915456-470b-49b5-bdff-ae3b0de14dc0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: c4e44bfc-6a68-46ce-8335-aaaba5160d3e] Building network info cache for instance {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 00:07:15 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-a2cf0630-846e-4208-9c81-8b7d5d545f44 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:07:15 user nova-compute[75165]: DEBUG nova.virt.disk.api [None req-26a64c2e-3ffa-417d-920d-0886e701b786 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Checking if we can resize image /opt/stack/data/nova/instances/26a0b493-bb47-466e-95d5-945fc3849fa5/disk. size=1073741824 {{(pid=75165) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 00:07:15 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-26a64c2e-3ffa-417d-920d-0886e701b786 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26a0b493-bb47-466e-95d5-945fc3849fa5/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:07:15 user nova-compute[75165]: DEBUG nova.network.neutron [None req-f14fa41a-0db2-4572-b30a-8c5b8ceb0780 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] [instance: 18dcf77e-fac2-4b38-ad1c-1f52ce14704a] Instance cache missing network info. {{(pid=75165) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 00:07:15 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-3b559ea4-7494-453c-9197-120ac2b304df req-2cc0d21b-266d-4b38-976e-c285928fe2e7 service nova] Releasing lock "refresh_cache-9633e6bb-5e95-4994-92a2-9d8f85a946ff" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:07:15 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-a2cf0630-846e-4208-9c81-8b7d5d545f44 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json" returned: 0 in 0.186s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:07:15 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-a2cf0630-846e-4208-9c81-8b7d5d545f44 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Acquiring lock "7d3243421cf3fdc288b758f687a93103b7b95466" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:07:15 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-a2cf0630-846e-4208-9c81-8b7d5d545f44 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Lock "7d3243421cf3fdc288b758f687a93103b7b95466" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:07:15 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-a2cf0630-846e-4208-9c81-8b7d5d545f44 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:07:15 user sudo[84507]: pam_unix(sudo:session): session closed for user root
Oct 26 00:07:15 user nova-compute[75165]: DEBUG nova.compute.manager [req-2ebb0d92-2419-4cf8-a80f-0a5b26df77db req-d7a8e36e-8bc3-4232-a745-2f5a4c936ac3 service nova] [instance: 18dcf77e-fac2-4b38-ad1c-1f52ce14704a] Received event network-changed-7d1fdd51-5be0-40fd-bb7a-ef881af8f4f8 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:07:15 user nova-compute[75165]: DEBUG nova.compute.manager [req-2ebb0d92-2419-4cf8-a80f-0a5b26df77db req-d7a8e36e-8bc3-4232-a745-2f5a4c936ac3 service nova] [instance: 18dcf77e-fac2-4b38-ad1c-1f52ce14704a] Refreshing instance network info cache due to event network-changed-7d1fdd51-5be0-40fd-bb7a-ef881af8f4f8. {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 00:07:15 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-2ebb0d92-2419-4cf8-a80f-0a5b26df77db req-d7a8e36e-8bc3-4232-a745-2f5a4c936ac3 service nova] Acquiring lock "refresh_cache-18dcf77e-fac2-4b38-ad1c-1f52ce14704a" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:07:15 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:15 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-26a64c2e-3ffa-417d-920d-0886e701b786 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26a0b493-bb47-466e-95d5-945fc3849fa5/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:07:15 user nova-compute[75165]: INFO oslo.privsep.daemon [None req-70ba4ee4-a84c-4587-a8b9-97fd07c2ee83 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Spawned new privsep daemon via rootwrap
Oct 26 00:07:15 user nova-compute[75165]: DEBUG nova.virt.disk.api [None req-26a64c2e-3ffa-417d-920d-0886e701b786 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Cannot resize image /opt/stack/data/nova/instances/26a0b493-bb47-466e-95d5-945fc3849fa5/disk to a smaller size. {{(pid=75165) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 00:07:15 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-26a64c2e-3ffa-417d-920d-0886e701b786 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] Created local disks {{(pid=75165) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 00:07:15 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-26a64c2e-3ffa-417d-920d-0886e701b786 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] Ensure instance console log exists: /opt/stack/data/nova/instances/26a0b493-bb47-466e-95d5-945fc3849fa5/console.log {{(pid=75165) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 00:07:15 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-26a64c2e-3ffa-417d-920d-0886e701b786 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:07:15 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-26a64c2e-3ffa-417d-920d-0886e701b786 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:07:15 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-26a64c2e-3ffa-417d-920d-0886e701b786 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:07:15 user nova-compute[75165]: DEBUG nova.network.neutron [None req-3b915456-470b-49b5-bdff-ae3b0de14dc0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: c4e44bfc-6a68-46ce-8335-aaaba5160d3e] Instance cache missing network info. {{(pid=75165) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 00:07:15 user nova-compute[75165]: INFO oslo.privsep.daemon [-] privsep daemon starting
Oct 26 00:07:15 user nova-compute[75165]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Oct 26 00:07:15 user nova-compute[75165]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Oct 26 00:07:15 user nova-compute[75165]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84522
Oct 26 00:07:15 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-fc7b823a-9e61-4fab-b9a0-528ca2ebc895 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:07:15 user nova-compute[75165]: WARNING oslo_privsep.priv_context [None req-656c1a74-11db-4031-95a6-53f325bfd24b tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] privsep daemon already running
Oct 26 00:07:15 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-fc7b823a-9e61-4fab-b9a0-528ca2ebc895 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:07:15 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-a2cf0630-846e-4208-9c81-8b7d5d545f44 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json" returned: 0 in 0.195s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:07:15 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-a2cf0630-846e-4208-9c81-8b7d5d545f44 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466,backing_fmt=raw /opt/stack/data/nova/instances/3b153af2-c93b-47d2-ae8c-76cfd44e384c/disk 1073741824 {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:07:16 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-fc7b823a-9e61-4fab-b9a0-528ca2ebc895 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.083s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:07:16 user nova-compute[75165]: DEBUG nova.compute.manager [None req-fc7b823a-9e61-4fab-b9a0-528ca2ebc895 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] [instance: 6f9add59-cabe-4965-8fe3-524618550581] Start building networks asynchronously for instance. {{(pid=75165) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 00:07:16 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-a2cf0630-846e-4208-9c81-8b7d5d545f44 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466,backing_fmt=raw /opt/stack/data/nova/instances/3b153af2-c93b-47d2-ae8c-76cfd44e384c/disk 1073741824" returned: 0 in 0.046s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:07:16 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-a2cf0630-846e-4208-9c81-8b7d5d545f44 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Lock "7d3243421cf3fdc288b758f687a93103b7b95466" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:07:16 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-a2cf0630-846e-4208-9c81-8b7d5d545f44 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:07:16 user nova-compute[75165]: DEBUG nova.compute.manager [None req-fc7b823a-9e61-4fab-b9a0-528ca2ebc895 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] [instance: 6f9add59-cabe-4965-8fe3-524618550581] Allocating IP information in the background. {{(pid=75165) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 00:07:16 user nova-compute[75165]: DEBUG nova.network.neutron [None req-fc7b823a-9e61-4fab-b9a0-528ca2ebc895 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] [instance: 6f9add59-cabe-4965-8fe3-524618550581] allocate_for_instance() {{(pid=75165) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 00:07:16 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-fc7b823a-9e61-4fab-b9a0-528ca2ebc895 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] [instance: 6f9add59-cabe-4965-8fe3-524618550581] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 00:07:16 user nova-compute[75165]: DEBUG nova.compute.manager [None req-fc7b823a-9e61-4fab-b9a0-528ca2ebc895 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] [instance: 6f9add59-cabe-4965-8fe3-524618550581] Start building block device mappings for instance. {{(pid=75165) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 00:07:16 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-a2cf0630-846e-4208-9c81-8b7d5d545f44 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json" returned: 0 in 0.168s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:07:16 user nova-compute[75165]: DEBUG nova.virt.disk.api [None req-a2cf0630-846e-4208-9c81-8b7d5d545f44 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3b153af2-c93b-47d2-ae8c-76cfd44e384c/disk. size=1073741824 {{(pid=75165) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 00:07:16 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-a2cf0630-846e-4208-9c81-8b7d5d545f44 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b153af2-c93b-47d2-ae8c-76cfd44e384c/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:07:16 user nova-compute[75165]: DEBUG nova.compute.manager [None req-fc7b823a-9e61-4fab-b9a0-528ca2ebc895 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] [instance: 6f9add59-cabe-4965-8fe3-524618550581] Start spawning the instance on the hypervisor. {{(pid=75165) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 00:07:16 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-fc7b823a-9e61-4fab-b9a0-528ca2ebc895 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] [instance: 6f9add59-cabe-4965-8fe3-524618550581] Creating instance directory {{(pid=75165) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 00:07:16 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-fc7b823a-9e61-4fab-b9a0-528ca2ebc895 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] [instance: 6f9add59-cabe-4965-8fe3-524618550581] Creating image(s)
Oct 26 00:07:16 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-fc7b823a-9e61-4fab-b9a0-528ca2ebc895 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Acquiring lock "/opt/stack/data/nova/instances/6f9add59-cabe-4965-8fe3-524618550581/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:07:16 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-fc7b823a-9e61-4fab-b9a0-528ca2ebc895 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Lock "/opt/stack/data/nova/instances/6f9add59-cabe-4965-8fe3-524618550581/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:07:16 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-fc7b823a-9e61-4fab-b9a0-528ca2ebc895 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Lock "/opt/stack/data/nova/instances/6f9add59-cabe-4965-8fe3-524618550581/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:07:16 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-fc7b823a-9e61-4fab-b9a0-528ca2ebc895 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:07:16 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-a2cf0630-846e-4208-9c81-8b7d5d545f44 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b153af2-c93b-47d2-ae8c-76cfd44e384c/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:07:16 user nova-compute[75165]: DEBUG nova.virt.disk.api [None req-a2cf0630-846e-4208-9c81-8b7d5d545f44 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Cannot resize image /opt/stack/data/nova/instances/3b153af2-c93b-47d2-ae8c-76cfd44e384c/disk to a smaller size. {{(pid=75165) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 00:07:16 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-a2cf0630-846e-4208-9c81-8b7d5d545f44 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] Created local disks {{(pid=75165) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 00:07:16 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-a2cf0630-846e-4208-9c81-8b7d5d545f44 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] Ensure instance console log exists: /opt/stack/data/nova/instances/3b153af2-c93b-47d2-ae8c-76cfd44e384c/console.log {{(pid=75165) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 00:07:16 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-a2cf0630-846e-4208-9c81-8b7d5d545f44 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:07:16 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-a2cf0630-846e-4208-9c81-8b7d5d545f44 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:07:16 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-a2cf0630-846e-4208-9c81-8b7d5d545f44 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:07:16 user nova-compute[75165]: DEBUG nova.policy [None req-fc7b823a-9e61-4fab-b9a0-528ca2ebc895 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a40cb1b08014444686bd0adad03f6c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '920152101768459baa71010b380ea8f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75165) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 00:07:16 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:16 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2107529c-ec, may_exist=True, interface_attrs={}) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:07:16 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2107529c-ec, col_values=(('qos', UUID('645ce881-2294-4095-92b4-7d6ce9fcb535')),), if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:07:16 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2107529c-ec, col_values=(('external_ids', {'iface-id': '2107529c-ec0e-4d1d-85b4-8605dcabc415', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0c:8a:94', 'vm-uuid': '84c6b624-648b-40e2-a37e-ff08609bad84'}),), if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:07:16 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:16 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:07:16 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:16 user nova-compute[75165]: INFO os_vif [None req-656c1a74-11db-4031-95a6-53f325bfd24b tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:8a:94,bridge_name='br-int',has_traffic_filtering=True,id=2107529c-ec0e-4d1d-85b4-8605dcabc415,network=Network(b31bac4b-1951-4ca3-8682-f1f24de0a5c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2107529c-ec')
Oct 26 00:07:16 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:16 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6beaf63f-07, may_exist=True, interface_attrs={}) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:07:16 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6beaf63f-07, col_values=(('qos', UUID('31e33527-9104-4ff7-a0b0-ab1dfb79644a')),), if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:07:16 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6beaf63f-07, col_values=(('external_ids', {'iface-id': '6beaf63f-0750-4c6a-b0bd-ebfbca211ad1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c1:5c:f3', 'vm-uuid': '9633e6bb-5e95-4994-92a2-9d8f85a946ff'}),), if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:07:16 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:07:16 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:16 user nova-compute[75165]: INFO os_vif [None req-70ba4ee4-a84c-4587-a8b9-97fd07c2ee83 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:5c:f3,bridge_name='br-int',has_traffic_filtering=True,id=6beaf63f-0750-4c6a-b0bd-ebfbca211ad1,network=Network(6344595d-af28-41d8-9091-f7565d587f85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6beaf63f-07')
Oct 26 00:07:16 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-fc7b823a-9e61-4fab-b9a0-528ca2ebc895 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json" returned: 0 in 0.179s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:07:16 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-fc7b823a-9e61-4fab-b9a0-528ca2ebc895 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Acquiring lock "7d3243421cf3fdc288b758f687a93103b7b95466" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:07:16 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-fc7b823a-9e61-4fab-b9a0-528ca2ebc895 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Lock "7d3243421cf3fdc288b758f687a93103b7b95466" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:07:16 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-fc7b823a-9e61-4fab-b9a0-528ca2ebc895 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:07:16 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-656c1a74-11db-4031-95a6-53f325bfd24b tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] No BDM found with device name vda, not building metadata. {{(pid=75165) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 00:07:16 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-656c1a74-11db-4031-95a6-53f325bfd24b tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] No VIF found with MAC fa:16:3e:0c:8a:94, not building metadata {{(pid=75165) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 00:07:16 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-70ba4ee4-a84c-4587-a8b9-97fd07c2ee83 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] No BDM found with device name vda, not building metadata. {{(pid=75165) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 00:07:16 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-70ba4ee4-a84c-4587-a8b9-97fd07c2ee83 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] No VIF found with MAC fa:16:3e:c1:5c:f3, not building metadata {{(pid=75165) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 00:07:16 user nova-compute[75165]: DEBUG nova.network.neutron [None req-2b8cd73e-9f80-44dc-bacf-845d4a401ebb tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: a7eeb145-1565-4812-818b-fefda5f2436d] Successfully created port: 7a43d085-a683-4c49-a7c8-13b8f35c943d {{(pid=75165) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 00:07:16 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-fc7b823a-9e61-4fab-b9a0-528ca2ebc895 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json" returned: 0 in 0.222s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:07:16 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-fc7b823a-9e61-4fab-b9a0-528ca2ebc895 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466,backing_fmt=raw /opt/stack/data/nova/instances/6f9add59-cabe-4965-8fe3-524618550581/disk 1073741824 {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:07:16 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-fc7b823a-9e61-4fab-b9a0-528ca2ebc895 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466,backing_fmt=raw /opt/stack/data/nova/instances/6f9add59-cabe-4965-8fe3-524618550581/disk 1073741824" returned: 0 in 0.050s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:07:16 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-fc7b823a-9e61-4fab-b9a0-528ca2ebc895 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Lock "7d3243421cf3fdc288b758f687a93103b7b95466" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.276s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:07:16 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-fc7b823a-9e61-4fab-b9a0-528ca2ebc895 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:07:16 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-fc7b823a-9e61-4fab-b9a0-528ca2ebc895 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json" returned: 0 in 0.171s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:07:16 user nova-compute[75165]: DEBUG nova.virt.disk.api [None req-fc7b823a-9e61-4fab-b9a0-528ca2ebc895 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6f9add59-cabe-4965-8fe3-524618550581/disk. size=1073741824 {{(pid=75165) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 00:07:16 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-fc7b823a-9e61-4fab-b9a0-528ca2ebc895 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f9add59-cabe-4965-8fe3-524618550581/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:07:17 user nova-compute[75165]: DEBUG nova.network.neutron [None req-f14fa41a-0db2-4572-b30a-8c5b8ceb0780 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] [instance: 18dcf77e-fac2-4b38-ad1c-1f52ce14704a] Updating instance_info_cache with network_info: [{"id": "7d1fdd51-5be0-40fd-bb7a-ef881af8f4f8", "address": "fa:16:3e:4f:f1:44", "network": {"id": "c4452fe5-2ef8-4c11-89ec-695fd0a8b67e", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-984180216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dee554bb28784e6486c6c5fb2df68caf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d1fdd51-5b", "ovs_interfaceid": "7d1fdd51-5be0-40fd-bb7a-ef881af8f4f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:07:17 user nova-compute[75165]: DEBUG nova.network.neutron [None req-3b915456-470b-49b5-bdff-ae3b0de14dc0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: c4e44bfc-6a68-46ce-8335-aaaba5160d3e] Updating instance_info_cache with network_info: [{"id": "842f3b7a-8da7-48d2-90f7-7241fbaab648", "address": "fa:16:3e:1f:64:04", "network": {"id": "b31bac4b-1951-4ca3-8682-f1f24de0a5c3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1323234642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71aa69c0ea2d49e184e1e055ff3efa1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap842f3b7a-8d", "ovs_interfaceid": "842f3b7a-8da7-48d2-90f7-7241fbaab648", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:07:17 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-fc7b823a-9e61-4fab-b9a0-528ca2ebc895 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f9add59-cabe-4965-8fe3-524618550581/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:07:17 user nova-compute[75165]: DEBUG nova.virt.disk.api [None req-fc7b823a-9e61-4fab-b9a0-528ca2ebc895 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Cannot resize image /opt/stack/data/nova/instances/6f9add59-cabe-4965-8fe3-524618550581/disk to a smaller size. {{(pid=75165) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 00:07:17 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-fc7b823a-9e61-4fab-b9a0-528ca2ebc895 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] [instance: 6f9add59-cabe-4965-8fe3-524618550581] Created local disks {{(pid=75165) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 00:07:17 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-fc7b823a-9e61-4fab-b9a0-528ca2ebc895 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] [instance: 6f9add59-cabe-4965-8fe3-524618550581] Ensure instance console log exists: /opt/stack/data/nova/instances/6f9add59-cabe-4965-8fe3-524618550581/console.log {{(pid=75165) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 00:07:17 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-fc7b823a-9e61-4fab-b9a0-528ca2ebc895 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:07:17 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-fc7b823a-9e61-4fab-b9a0-528ca2ebc895 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:07:17 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-fc7b823a-9e61-4fab-b9a0-528ca2ebc895 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:07:17 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-f14fa41a-0db2-4572-b30a-8c5b8ceb0780 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] Releasing lock "refresh_cache-18dcf77e-fac2-4b38-ad1c-1f52ce14704a" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:07:17 user nova-compute[75165]: DEBUG nova.compute.manager [None req-f14fa41a-0db2-4572-b30a-8c5b8ceb0780 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] [instance: 18dcf77e-fac2-4b38-ad1c-1f52ce14704a] Instance network_info: |[{"id": "7d1fdd51-5be0-40fd-bb7a-ef881af8f4f8", "address": "fa:16:3e:4f:f1:44", "network": {"id": "c4452fe5-2ef8-4c11-89ec-695fd0a8b67e", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-984180216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dee554bb28784e6486c6c5fb2df68caf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d1fdd51-5b", "ovs_interfaceid": "7d1fdd51-5be0-40fd-bb7a-ef881af8f4f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75165) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 00:07:17 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-2ebb0d92-2419-4cf8-a80f-0a5b26df77db req-d7a8e36e-8bc3-4232-a745-2f5a4c936ac3 service nova] Acquired lock "refresh_cache-18dcf77e-fac2-4b38-ad1c-1f52ce14704a" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:07:17 user nova-compute[75165]: DEBUG nova.network.neutron [req-2ebb0d92-2419-4cf8-a80f-0a5b26df77db req-d7a8e36e-8bc3-4232-a745-2f5a4c936ac3 service nova] [instance: 18dcf77e-fac2-4b38-ad1c-1f52ce14704a] Refreshing network info cache for port 7d1fdd51-5be0-40fd-bb7a-ef881af8f4f8 {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 00:07:17 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-f14fa41a-0db2-4572-b30a-8c5b8ceb0780 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] [instance: 18dcf77e-fac2-4b38-ad1c-1f52ce14704a] Start _get_guest_xml network_info=[{"id": "7d1fdd51-5be0-40fd-bb7a-ef881af8f4f8", "address": "fa:16:3e:4f:f1:44", "network": {"id": "c4452fe5-2ef8-4c11-89ec-695fd0a8b67e", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-984180216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dee554bb28784e6486c6c5fb2df68caf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d1fdd51-5b", "ovs_interfaceid": "7d1fdd51-5be0-40fd-bb7a-ef881af8f4f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T00:03:24Z,direct_url=<?>,disk_format='qcow2',id=bff0d8a1-739e-4c4d-9efa-b73ba7b76d01,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e56bbf444fd34c348475c73673611447',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T00:03:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'size': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': 'bff0d8a1-739e-4c4d-9efa-b73ba7b76d01'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75165) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 00:07:17 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-3b915456-470b-49b5-bdff-ae3b0de14dc0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Releasing lock "refresh_cache-c4e44bfc-6a68-46ce-8335-aaaba5160d3e" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:07:17 user nova-compute[75165]: DEBUG nova.compute.manager [None req-3b915456-470b-49b5-bdff-ae3b0de14dc0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: c4e44bfc-6a68-46ce-8335-aaaba5160d3e] Instance network_info: |[{"id": "842f3b7a-8da7-48d2-90f7-7241fbaab648", "address": "fa:16:3e:1f:64:04", "network": {"id": "b31bac4b-1951-4ca3-8682-f1f24de0a5c3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1323234642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71aa69c0ea2d49e184e1e055ff3efa1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap842f3b7a-8d", "ovs_interfaceid": "842f3b7a-8da7-48d2-90f7-7241fbaab648", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75165) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 00:07:17 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-3b915456-470b-49b5-bdff-ae3b0de14dc0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: c4e44bfc-6a68-46ce-8335-aaaba5160d3e] Start _get_guest_xml network_info=[{"id": "842f3b7a-8da7-48d2-90f7-7241fbaab648", "address": "fa:16:3e:1f:64:04", "network": {"id": "b31bac4b-1951-4ca3-8682-f1f24de0a5c3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1323234642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71aa69c0ea2d49e184e1e055ff3efa1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap842f3b7a-8d", "ovs_interfaceid": "842f3b7a-8da7-48d2-90f7-7241fbaab648", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T00:03:24Z,direct_url=<?>,disk_format='qcow2',id=bff0d8a1-739e-4c4d-9efa-b73ba7b76d01,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e56bbf444fd34c348475c73673611447',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T00:03:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'size': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': 'bff0d8a1-739e-4c4d-9efa-b73ba7b76d01'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75165) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 00:07:17 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-f14fa41a-0db2-4572-b30a-8c5b8ceb0780 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:07:17 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-f14fa41a-0db2-4572-b30a-8c5b8ceb0780 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:07:17 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-3b915456-470b-49b5-bdff-ae3b0de14dc0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:07:17 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-3b915456-470b-49b5-bdff-ae3b0de14dc0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:07:17 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-f14fa41a-0db2-4572-b30a-8c5b8ceb0780 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75165) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 00:07:17 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-f14fa41a-0db2-4572-b30a-8c5b8ceb0780 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] CPU controller missing on host. {{(pid=75165) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 00:07:17 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-3b915456-470b-49b5-bdff-ae3b0de14dc0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75165) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 00:07:17 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-3b915456-470b-49b5-bdff-ae3b0de14dc0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] CPU controller missing on host. {{(pid=75165) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 00:07:17 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-f14fa41a-0db2-4572-b30a-8c5b8ceb0780 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75165) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 00:07:17 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-f14fa41a-0db2-4572-b30a-8c5b8ceb0780 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] CPU controller found on host. {{(pid=75165) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 00:07:17 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-f14fa41a-0db2-4572-b30a-8c5b8ceb0780 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75165) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 00:07:17 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-f14fa41a-0db2-4572-b30a-8c5b8ceb0780 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T00:03:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T00:03:24Z,direct_url=<?>,disk_format='qcow2',id=bff0d8a1-739e-4c4d-9efa-b73ba7b76d01,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e56bbf444fd34c348475c73673611447',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T00:03:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 00:07:17 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-f14fa41a-0db2-4572-b30a-8c5b8ceb0780 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] Flavor limits 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 00:07:17 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-f14fa41a-0db2-4572-b30a-8c5b8ceb0780 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] Image limits 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 00:07:17 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-f14fa41a-0db2-4572-b30a-8c5b8ceb0780 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] Flavor pref 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 00:07:17 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-f14fa41a-0db2-4572-b30a-8c5b8ceb0780 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] Image pref 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 00:07:17 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-f14fa41a-0db2-4572-b30a-8c5b8ceb0780 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 00:07:17 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-f14fa41a-0db2-4572-b30a-8c5b8ceb0780 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 00:07:17 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-f14fa41a-0db2-4572-b30a-8c5b8ceb0780 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75165) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 00:07:17 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-f14fa41a-0db2-4572-b30a-8c5b8ceb0780 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] Got 1 possible topologies {{(pid=75165) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 00:07:17 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-f14fa41a-0db2-4572-b30a-8c5b8ceb0780 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 00:07:17 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-f14fa41a-0db2-4572-b30a-8c5b8ceb0780 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 00:07:17 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-f14fa41a-0db2-4572-b30a-8c5b8ceb0780 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:07:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-81328623',display_name='tempest-DeleteServersTestJSON-server-81328623',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-81328623',id=3,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dee554bb28784e6486c6c5fb2df68caf',ramdisk_id='',reservation_id='r-d0umixtb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1293379709',owner_user_name='tempest-DeleteServersTestJSON-1293379709-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T00:07:08Z,user_data=None,user_id='ea4de283f02c40479a0bc185f9a06b8f',uuid=18dcf77e-fac2-4b38-ad1c-1f52ce14704a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7d1fdd51-5be0-40fd-bb7a-ef881af8f4f8", "address": "fa:16:3e:4f:f1:44", "network": {"id": "c4452fe5-2ef8-4c11-89ec-695fd0a8b67e", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-984180216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dee554bb28784e6486c6c5fb2df68caf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d1fdd51-5b", "ovs_interfaceid": "7d1fdd51-5be0-40fd-bb7a-ef881af8f4f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75165) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 00:07:17 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-f14fa41a-0db2-4572-b30a-8c5b8ceb0780 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] Converting VIF {"id": "7d1fdd51-5be0-40fd-bb7a-ef881af8f4f8", "address": "fa:16:3e:4f:f1:44", "network": {"id": "c4452fe5-2ef8-4c11-89ec-695fd0a8b67e", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-984180216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dee554bb28784e6486c6c5fb2df68caf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d1fdd51-5b", "ovs_interfaceid": "7d1fdd51-5be0-40fd-bb7a-ef881af8f4f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:07:17 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-f14fa41a-0db2-4572-b30a-8c5b8ceb0780 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:f1:44,bridge_name='br-int',has_traffic_filtering=True,id=7d1fdd51-5be0-40fd-bb7a-ef881af8f4f8,network=Network(c4452fe5-2ef8-4c11-89ec-695fd0a8b67e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d1fdd51-5b') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:07:17 user nova-compute[75165]: DEBUG nova.objects.instance [None req-f14fa41a-0db2-4572-b30a-8c5b8ceb0780 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] Lazy-loading 'pci_devices' on Instance uuid 18dcf77e-fac2-4b38-ad1c-1f52ce14704a {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:07:17 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:17 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-3b915456-470b-49b5-bdff-ae3b0de14dc0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75165) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 00:07:17 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-3b915456-470b-49b5-bdff-ae3b0de14dc0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] CPU controller found on host. {{(pid=75165) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 00:07:17 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-3b915456-470b-49b5-bdff-ae3b0de14dc0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75165) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 00:07:17 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-3b915456-470b-49b5-bdff-ae3b0de14dc0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T00:03:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T00:03:24Z,direct_url=<?>,disk_format='qcow2',id=bff0d8a1-739e-4c4d-9efa-b73ba7b76d01,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e56bbf444fd34c348475c73673611447',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T00:03:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 00:07:17 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-3b915456-470b-49b5-bdff-ae3b0de14dc0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Flavor limits 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 00:07:17 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-3b915456-470b-49b5-bdff-ae3b0de14dc0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Image limits 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 00:07:17 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-3b915456-470b-49b5-bdff-ae3b0de14dc0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Flavor pref 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 00:07:17 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-3b915456-470b-49b5-bdff-ae3b0de14dc0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Image pref 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 00:07:17 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-3b915456-470b-49b5-bdff-ae3b0de14dc0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 00:07:17 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-3b915456-470b-49b5-bdff-ae3b0de14dc0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 00:07:17 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-3b915456-470b-49b5-bdff-ae3b0de14dc0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75165) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 00:07:17 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-3b915456-470b-49b5-bdff-ae3b0de14dc0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Got 1 possible topologies {{(pid=75165) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 00:07:17 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-3b915456-470b-49b5-bdff-ae3b0de14dc0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 00:07:17 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-3b915456-470b-49b5-bdff-ae3b0de14dc0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 00:07:17 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-3b915456-470b-49b5-bdff-ae3b0de14dc0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:07:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1155771609',display_name='tempest-ServerRescueNegativeTestJSON-server-1155771609',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1155771609',id=4,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='71aa69c0ea2d49e184e1e055ff3efa1d',ramdisk_id='',reservation_id='r-6fsjgoly',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2141505807',owner_user_name='tempest-ServerRescueNegativeTestJSON-2141505807-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T00:07:09Z,user_data=None,user_id='67876ca3211b47bc99af08436edeb91f',uuid=c4e44bfc-6a68-46ce-8335-aaaba5160d3e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "842f3b7a-8da7-48d2-90f7-7241fbaab648", "address": "fa:16:3e:1f:64:04", "network": {"id": "b31bac4b-1951-4ca3-8682-f1f24de0a5c3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1323234642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71aa69c0ea2d49e184e1e055ff3efa1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap842f3b7a-8d", "ovs_interfaceid": "842f3b7a-8da7-48d2-90f7-7241fbaab648", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75165) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 00:07:17 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-3b915456-470b-49b5-bdff-ae3b0de14dc0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Converting VIF {"id": "842f3b7a-8da7-48d2-90f7-7241fbaab648", "address": "fa:16:3e:1f:64:04", "network": {"id": "b31bac4b-1951-4ca3-8682-f1f24de0a5c3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1323234642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71aa69c0ea2d49e184e1e055ff3efa1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap842f3b7a-8d", "ovs_interfaceid": "842f3b7a-8da7-48d2-90f7-7241fbaab648", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:07:17 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-3b915456-470b-49b5-bdff-ae3b0de14dc0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:64:04,bridge_name='br-int',has_traffic_filtering=True,id=842f3b7a-8da7-48d2-90f7-7241fbaab648,network=Network(b31bac4b-1951-4ca3-8682-f1f24de0a5c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap842f3b7a-8d') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:07:17 user nova-compute[75165]: DEBUG nova.objects.instance [None req-3b915456-470b-49b5-bdff-ae3b0de14dc0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Lazy-loading 'pci_devices' on Instance uuid c4e44bfc-6a68-46ce-8335-aaaba5160d3e {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:07:17 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-f14fa41a-0db2-4572-b30a-8c5b8ceb0780 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] [instance: 18dcf77e-fac2-4b38-ad1c-1f52ce14704a] End _get_guest_xml xml=<domain type="kvm">
Oct 26 00:07:17 user nova-compute[75165]:   <uuid>18dcf77e-fac2-4b38-ad1c-1f52ce14704a</uuid>
Oct 26 00:07:17 user nova-compute[75165]:   <name>instance-00000003</name>
Oct 26 00:07:17 user nova-compute[75165]:   <memory>524288</memory>
Oct 26 00:07:17 user nova-compute[75165]:   <vcpu>1</vcpu>
Oct 26 00:07:17 user nova-compute[75165]:   <metadata>
Oct 26 00:07:17 user nova-compute[75165]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 00:07:17 user nova-compute[75165]:       <nova:package version="0.0.0"/>
Oct 26 00:07:17 user nova-compute[75165]:       <nova:name>tempest-DeleteServersTestJSON-server-81328623</nova:name>
Oct 26 00:07:17 user nova-compute[75165]:       <nova:creationTime>2023-10-26 00:07:17</nova:creationTime>
Oct 26 00:07:17 user nova-compute[75165]:       <nova:flavor name="m1.tiny">
Oct 26 00:07:17 user nova-compute[75165]:         <nova:memory>512</nova:memory>
Oct 26 00:07:17 user nova-compute[75165]:         <nova:disk>1</nova:disk>
Oct 26 00:07:17 user nova-compute[75165]:         <nova:swap>0</nova:swap>
Oct 26 00:07:17 user nova-compute[75165]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 00:07:17 user nova-compute[75165]:         <nova:vcpus>1</nova:vcpus>
Oct 26 00:07:17 user nova-compute[75165]:       </nova:flavor>
Oct 26 00:07:17 user nova-compute[75165]:       <nova:owner>
Oct 26 00:07:17 user nova-compute[75165]:         <nova:user uuid="ea4de283f02c40479a0bc185f9a06b8f">tempest-DeleteServersTestJSON-1293379709-project-member</nova:user>
Oct 26 00:07:17 user nova-compute[75165]:         <nova:project uuid="dee554bb28784e6486c6c5fb2df68caf">tempest-DeleteServersTestJSON-1293379709</nova:project>
Oct 26 00:07:17 user nova-compute[75165]:       </nova:owner>
Oct 26 00:07:17 user nova-compute[75165]:       <nova:root type="image" uuid="bff0d8a1-739e-4c4d-9efa-b73ba7b76d01"/>
Oct 26 00:07:17 user nova-compute[75165]:       <nova:ports>
Oct 26 00:07:17 user nova-compute[75165]:         <nova:port uuid="7d1fdd51-5be0-40fd-bb7a-ef881af8f4f8">
Oct 26 00:07:17 user nova-compute[75165]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 26 00:07:17 user nova-compute[75165]:         </nova:port>
Oct 26 00:07:17 user nova-compute[75165]:       </nova:ports>
Oct 26 00:07:17 user nova-compute[75165]:     </nova:instance>
Oct 26 00:07:17 user nova-compute[75165]:   </metadata>
Oct 26 00:07:17 user nova-compute[75165]:   <sysinfo type="smbios">
Oct 26 00:07:17 user nova-compute[75165]:     <system>
Oct 26 00:07:17 user nova-compute[75165]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 00:07:17 user nova-compute[75165]:       <entry name="product">OpenStack Nova</entry>
Oct 26 00:07:17 user nova-compute[75165]:       <entry name="version">0.0.0</entry>
Oct 26 00:07:17 user nova-compute[75165]:       <entry name="serial">18dcf77e-fac2-4b38-ad1c-1f52ce14704a</entry>
Oct 26 00:07:17 user nova-compute[75165]:       <entry name="uuid">18dcf77e-fac2-4b38-ad1c-1f52ce14704a</entry>
Oct 26 00:07:17 user nova-compute[75165]:       <entry name="family">Virtual Machine</entry>
Oct 26 00:07:17 user nova-compute[75165]:     </system>
Oct 26 00:07:17 user nova-compute[75165]:   </sysinfo>
Oct 26 00:07:17 user nova-compute[75165]:   <os>
Oct 26 00:07:17 user nova-compute[75165]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 00:07:17 user nova-compute[75165]:     <boot dev="hd"/>
Oct 26 00:07:17 user nova-compute[75165]:     <smbios mode="sysinfo"/>
Oct 26 00:07:17 user nova-compute[75165]:   </os>
Oct 26 00:07:17 user nova-compute[75165]:   <features>
Oct 26 00:07:17 user nova-compute[75165]:     <acpi/>
Oct 26 00:07:17 user nova-compute[75165]:     <apic/>
Oct 26 00:07:17 user nova-compute[75165]:     <vmcoreinfo/>
Oct 26 00:07:17 user nova-compute[75165]:   </features>
Oct 26 00:07:17 user nova-compute[75165]:   <clock offset="utc">
Oct 26 00:07:17 user nova-compute[75165]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 00:07:17 user nova-compute[75165]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 00:07:17 user nova-compute[75165]:     <timer name="hpet" present="no"/>
Oct 26 00:07:17 user nova-compute[75165]:   </clock>
Oct 26 00:07:17 user nova-compute[75165]:   <cpu mode="custom" match="exact">
Oct 26 00:07:17 user nova-compute[75165]:     <model>Nehalem</model>
Oct 26 00:07:17 user nova-compute[75165]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 00:07:17 user nova-compute[75165]:   </cpu>
Oct 26 00:07:17 user nova-compute[75165]:   <devices>
Oct 26 00:07:17 user nova-compute[75165]:     <disk type="file" device="disk">
Oct 26 00:07:17 user nova-compute[75165]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 00:07:17 user nova-compute[75165]:       <source file="/opt/stack/data/nova/instances/18dcf77e-fac2-4b38-ad1c-1f52ce14704a/disk"/>
Oct 26 00:07:17 user nova-compute[75165]:       <target dev="vda" bus="virtio"/>
Oct 26 00:07:17 user nova-compute[75165]:     </disk>
Oct 26 00:07:17 user nova-compute[75165]:     <interface type="ethernet">
Oct 26 00:07:17 user nova-compute[75165]:       <mac address="fa:16:3e:4f:f1:44"/>
Oct 26 00:07:17 user nova-compute[75165]:       <model type="virtio"/>
Oct 26 00:07:17 user nova-compute[75165]:       <mtu size="1442"/>
Oct 26 00:07:17 user nova-compute[75165]:       <target dev="tap7d1fdd51-5b"/>
Oct 26 00:07:17 user nova-compute[75165]:     </interface>
Oct 26 00:07:17 user nova-compute[75165]:     <serial type="pty">
Oct 26 00:07:17 user nova-compute[75165]:       <log file="/opt/stack/data/nova/instances/18dcf77e-fac2-4b38-ad1c-1f52ce14704a/console.log" append="off"/>
Oct 26 00:07:17 user nova-compute[75165]:     </serial>
Oct 26 00:07:17 user nova-compute[75165]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 00:07:17 user nova-compute[75165]:     <video>
Oct 26 00:07:17 user nova-compute[75165]:       <model type="virtio"/>
Oct 26 00:07:17 user nova-compute[75165]:     </video>
Oct 26 00:07:17 user nova-compute[75165]:     <rng model="virtio">
Oct 26 00:07:17 user nova-compute[75165]:       <backend model="random">/dev/urandom</backend>
Oct 26 00:07:17 user nova-compute[75165]:     </rng>
Oct 26 00:07:17 user nova-compute[75165]:     <controller type="usb" index="0" model="none"/>
Oct 26 00:07:17 user nova-compute[75165]:     <memballoon model="virtio">
Oct 26 00:07:17 user nova-compute[75165]:       <stats period="10"/>
Oct 26 00:07:17 user nova-compute[75165]:     </memballoon>
Oct 26 00:07:17 user nova-compute[75165]:   </devices>
Oct 26 00:07:17 user nova-compute[75165]: </domain>
Oct 26 00:07:17 user nova-compute[75165]:  {{(pid=75165) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 00:07:17 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-f14fa41a-0db2-4572-b30a-8c5b8ceb0780 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:07:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-81328623',display_name='tempest-DeleteServersTestJSON-server-81328623',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-81328623',id=3,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dee554bb28784e6486c6c5fb2df68caf',ramdisk_id='',reservation_id='r-d0umixtb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1293379709',owner_user_name='tempest-DeleteServersTestJSON-1293379709-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T00:07:08Z,user_data=None,user_id='ea4de283f02c40479a0bc185f9a06b8f',uuid=18dcf77e-fac2-4b38-ad1c-1f52ce14704a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7d1fdd51-5be0-40fd-bb7a-ef881af8f4f8", "address": "fa:16:3e:4f:f1:44", "network": {"id": "c4452fe5-2ef8-4c11-89ec-695fd0a8b67e", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-984180216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dee554bb28784e6486c6c5fb2df68caf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d1fdd51-5b", "ovs_interfaceid": "7d1fdd51-5be0-40fd-bb7a-ef881af8f4f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 00:07:17 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-f14fa41a-0db2-4572-b30a-8c5b8ceb0780 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] Converting VIF {"id": "7d1fdd51-5be0-40fd-bb7a-ef881af8f4f8", "address": "fa:16:3e:4f:f1:44", "network": {"id": "c4452fe5-2ef8-4c11-89ec-695fd0a8b67e", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-984180216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dee554bb28784e6486c6c5fb2df68caf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d1fdd51-5b", "ovs_interfaceid": "7d1fdd51-5be0-40fd-bb7a-ef881af8f4f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:07:17 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-f14fa41a-0db2-4572-b30a-8c5b8ceb0780 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:f1:44,bridge_name='br-int',has_traffic_filtering=True,id=7d1fdd51-5be0-40fd-bb7a-ef881af8f4f8,network=Network(c4452fe5-2ef8-4c11-89ec-695fd0a8b67e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d1fdd51-5b') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:07:17 user nova-compute[75165]: DEBUG os_vif [None req-f14fa41a-0db2-4572-b30a-8c5b8ceb0780 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:f1:44,bridge_name='br-int',has_traffic_filtering=True,id=7d1fdd51-5be0-40fd-bb7a-ef881af8f4f8,network=Network(c4452fe5-2ef8-4c11-89ec-695fd0a8b67e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d1fdd51-5b') {{(pid=75165) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 00:07:17 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:17 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:07:17 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 00:07:17 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:17 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0db230d5-2b93-5ebc-85b4-4a16fee34c1f', '_type': 'linux-noop'}}, row=False) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:07:17 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-3b915456-470b-49b5-bdff-ae3b0de14dc0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: c4e44bfc-6a68-46ce-8335-aaaba5160d3e] End _get_guest_xml xml=<domain type="kvm">
Oct 26 00:07:17 user nova-compute[75165]:   <uuid>c4e44bfc-6a68-46ce-8335-aaaba5160d3e</uuid>
Oct 26 00:07:17 user nova-compute[75165]:   <name>instance-00000004</name>
Oct 26 00:07:17 user nova-compute[75165]:   <memory>524288</memory>
Oct 26 00:07:17 user nova-compute[75165]:   <vcpu>1</vcpu>
Oct 26 00:07:17 user nova-compute[75165]:   <metadata>
Oct 26 00:07:17 user nova-compute[75165]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 00:07:17 user nova-compute[75165]:       <nova:package version="0.0.0"/>
Oct 26 00:07:17 user nova-compute[75165]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1155771609</nova:name>
Oct 26 00:07:17 user nova-compute[75165]:       <nova:creationTime>2023-10-26 00:07:17</nova:creationTime>
Oct 26 00:07:17 user nova-compute[75165]:       <nova:flavor name="m1.tiny">
Oct 26 00:07:17 user nova-compute[75165]:         <nova:memory>512</nova:memory>
Oct 26 00:07:17 user nova-compute[75165]:         <nova:disk>1</nova:disk>
Oct 26 00:07:17 user nova-compute[75165]:         <nova:swap>0</nova:swap>
Oct 26 00:07:17 user nova-compute[75165]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 00:07:17 user nova-compute[75165]:         <nova:vcpus>1</nova:vcpus>
Oct 26 00:07:17 user nova-compute[75165]:       </nova:flavor>
Oct 26 00:07:17 user nova-compute[75165]:       <nova:owner>
Oct 26 00:07:17 user nova-compute[75165]:         <nova:user uuid="67876ca3211b47bc99af08436edeb91f">tempest-ServerRescueNegativeTestJSON-2141505807-project-member</nova:user>
Oct 26 00:07:17 user nova-compute[75165]:         <nova:project uuid="71aa69c0ea2d49e184e1e055ff3efa1d">tempest-ServerRescueNegativeTestJSON-2141505807</nova:project>
Oct 26 00:07:17 user nova-compute[75165]:       </nova:owner>
Oct 26 00:07:17 user nova-compute[75165]:       <nova:root type="image" uuid="bff0d8a1-739e-4c4d-9efa-b73ba7b76d01"/>
Oct 26 00:07:17 user nova-compute[75165]:       <nova:ports>
Oct 26 00:07:17 user nova-compute[75165]:         <nova:port uuid="842f3b7a-8da7-48d2-90f7-7241fbaab648">
Oct 26 00:07:17 user nova-compute[75165]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 26 00:07:17 user nova-compute[75165]:         </nova:port>
Oct 26 00:07:17 user nova-compute[75165]:       </nova:ports>
Oct 26 00:07:17 user nova-compute[75165]:     </nova:instance>
Oct 26 00:07:17 user nova-compute[75165]:   </metadata>
Oct 26 00:07:17 user nova-compute[75165]:   <sysinfo type="smbios">
Oct 26 00:07:17 user nova-compute[75165]:     <system>
Oct 26 00:07:17 user nova-compute[75165]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 00:07:17 user nova-compute[75165]:       <entry name="product">OpenStack Nova</entry>
Oct 26 00:07:17 user nova-compute[75165]:       <entry name="version">0.0.0</entry>
Oct 26 00:07:17 user nova-compute[75165]:       <entry name="serial">c4e44bfc-6a68-46ce-8335-aaaba5160d3e</entry>
Oct 26 00:07:17 user nova-compute[75165]:       <entry name="uuid">c4e44bfc-6a68-46ce-8335-aaaba5160d3e</entry>
Oct 26 00:07:17 user nova-compute[75165]:       <entry name="family">Virtual Machine</entry>
Oct 26 00:07:17 user nova-compute[75165]:     </system>
Oct 26 00:07:17 user nova-compute[75165]:   </sysinfo>
Oct 26 00:07:17 user nova-compute[75165]:   <os>
Oct 26 00:07:17 user nova-compute[75165]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 00:07:17 user nova-compute[75165]:     <boot dev="hd"/>
Oct 26 00:07:17 user nova-compute[75165]:     <smbios mode="sysinfo"/>
Oct 26 00:07:17 user nova-compute[75165]:   </os>
Oct 26 00:07:17 user nova-compute[75165]:   <features>
Oct 26 00:07:17 user nova-compute[75165]:     <acpi/>
Oct 26 00:07:17 user nova-compute[75165]:     <apic/>
Oct 26 00:07:17 user nova-compute[75165]:     <vmcoreinfo/>
Oct 26 00:07:17 user nova-compute[75165]:   </features>
Oct 26 00:07:17 user nova-compute[75165]:   <clock offset="utc">
Oct 26 00:07:17 user nova-compute[75165]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 00:07:17 user nova-compute[75165]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 00:07:17 user nova-compute[75165]:     <timer name="hpet" present="no"/>
Oct 26 00:07:17 user nova-compute[75165]:   </clock>
Oct 26 00:07:17 user nova-compute[75165]:   <cpu mode="custom" match="exact">
Oct 26 00:07:17 user nova-compute[75165]:     <model>Nehalem</model>
Oct 26 00:07:17 user nova-compute[75165]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 00:07:17 user nova-compute[75165]:   </cpu>
Oct 26 00:07:17 user nova-compute[75165]:   <devices>
Oct 26 00:07:17 user nova-compute[75165]:     <disk type="file" device="disk">
Oct 26 00:07:17 user nova-compute[75165]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 00:07:17 user nova-compute[75165]:       <source file="/opt/stack/data/nova/instances/c4e44bfc-6a68-46ce-8335-aaaba5160d3e/disk"/>
Oct 26 00:07:17 user nova-compute[75165]:       <target dev="vda" bus="virtio"/>
Oct 26 00:07:17 user nova-compute[75165]:     </disk>
Oct 26 00:07:17 user nova-compute[75165]:     <interface type="ethernet">
Oct 26 00:07:17 user nova-compute[75165]:       <mac address="fa:16:3e:1f:64:04"/>
Oct 26 00:07:17 user nova-compute[75165]:       <model type="virtio"/>
Oct 26 00:07:17 user nova-compute[75165]:       <mtu size="1442"/>
Oct 26 00:07:17 user nova-compute[75165]:       <target dev="tap842f3b7a-8d"/>
Oct 26 00:07:17 user nova-compute[75165]:     </interface>
Oct 26 00:07:17 user nova-compute[75165]:     <serial type="pty">
Oct 26 00:07:17 user nova-compute[75165]:       <log file="/opt/stack/data/nova/instances/c4e44bfc-6a68-46ce-8335-aaaba5160d3e/console.log" append="off"/>
Oct 26 00:07:17 user nova-compute[75165]:     </serial>
Oct 26 00:07:17 user nova-compute[75165]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 00:07:17 user nova-compute[75165]:     <video>
Oct 26 00:07:17 user nova-compute[75165]:       <model type="virtio"/>
Oct 26 00:07:17 user nova-compute[75165]:     </video>
Oct 26 00:07:17 user nova-compute[75165]:     <rng model="virtio">
Oct 26 00:07:17 user nova-compute[75165]:       <backend model="random">/dev/urandom</backend>
Oct 26 00:07:17 user nova-compute[75165]:     </rng>
Oct 26 00:07:17 user nova-compute[75165]:     <controller type="usb" index="0" model="none"/>
Oct 26 00:07:17 user nova-compute[75165]:     <memballoon model="virtio">
Oct 26 00:07:17 user nova-compute[75165]:       <stats period="10"/>
Oct 26 00:07:17 user nova-compute[75165]:     </memballoon>
Oct 26 00:07:17 user nova-compute[75165]:   </devices>
Oct 26 00:07:17 user nova-compute[75165]: </domain>
Oct 26 00:07:17 user nova-compute[75165]:  {{(pid=75165) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 00:07:17 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-3b915456-470b-49b5-bdff-ae3b0de14dc0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:07:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1155771609',display_name='tempest-ServerRescueNegativeTestJSON-server-1155771609',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1155771609',id=4,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='71aa69c0ea2d49e184e1e055ff3efa1d',ramdisk_id='',reservation_id='r-6fsjgoly',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2141505807',owner_user_name='tempest-ServerRescueNegativeTestJSON-2141505807-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T00:07:09Z,user_data=None,user_id='67876ca3211b47bc99af08436edeb91f',uuid=c4e44bfc-6a68-46ce-8335-aaaba5160d3e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "842f3b7a-8da7-48d2-90f7-7241fbaab648", "address": "fa:16:3e:1f:64:04", "network": {"id": "b31bac4b-1951-4ca3-8682-f1f24de0a5c3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1323234642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71aa69c0ea2d49e184e1e055ff3efa1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap842f3b7a-8d", "ovs_interfaceid": "842f3b7a-8da7-48d2-90f7-7241fbaab648", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 00:07:17 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-3b915456-470b-49b5-bdff-ae3b0de14dc0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Converting VIF {"id": "842f3b7a-8da7-48d2-90f7-7241fbaab648", "address": "fa:16:3e:1f:64:04", "network": {"id": "b31bac4b-1951-4ca3-8682-f1f24de0a5c3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1323234642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71aa69c0ea2d49e184e1e055ff3efa1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap842f3b7a-8d", "ovs_interfaceid": "842f3b7a-8da7-48d2-90f7-7241fbaab648", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:07:17 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-3b915456-470b-49b5-bdff-ae3b0de14dc0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:64:04,bridge_name='br-int',has_traffic_filtering=True,id=842f3b7a-8da7-48d2-90f7-7241fbaab648,network=Network(b31bac4b-1951-4ca3-8682-f1f24de0a5c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap842f3b7a-8d') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:07:17 user nova-compute[75165]: DEBUG os_vif [None req-3b915456-470b-49b5-bdff-ae3b0de14dc0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:64:04,bridge_name='br-int',has_traffic_filtering=True,id=842f3b7a-8da7-48d2-90f7-7241fbaab648,network=Network(b31bac4b-1951-4ca3-8682-f1f24de0a5c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap842f3b7a-8d') {{(pid=75165) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 00:07:17 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:07:17 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:17 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:17 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:07:17 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 00:07:17 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:17 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7577cbc7-b6f0-5b02-8fe5-33daddacd095', '_type': 'linux-noop'}}, row=False) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:07:17 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:07:17 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:17 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:17 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7d1fdd51-5b, may_exist=True, interface_attrs={}) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:07:17 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7d1fdd51-5b, col_values=(('qos', UUID('8db3adeb-1be4-4f9b-9bf2-b9b6bbd12160')),), if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:07:17 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7d1fdd51-5b, col_values=(('external_ids', {'iface-id': '7d1fdd51-5be0-40fd-bb7a-ef881af8f4f8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4f:f1:44', 'vm-uuid': '18dcf77e-fac2-4b38-ad1c-1f52ce14704a'}),), if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:07:17 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:07:17 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:17 user nova-compute[75165]: INFO os_vif [None req-f14fa41a-0db2-4572-b30a-8c5b8ceb0780 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:f1:44,bridge_name='br-int',has_traffic_filtering=True,id=7d1fdd51-5be0-40fd-bb7a-ef881af8f4f8,network=Network(c4452fe5-2ef8-4c11-89ec-695fd0a8b67e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d1fdd51-5b')
Oct 26 00:07:17 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:17 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap842f3b7a-8d, may_exist=True, interface_attrs={}) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:07:17 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap842f3b7a-8d, col_values=(('qos', UUID('7f7e277f-03b7-4b6c-b93b-e6e05cb9656a')),), if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:07:17 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap842f3b7a-8d, col_values=(('external_ids', {'iface-id': '842f3b7a-8da7-48d2-90f7-7241fbaab648', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1f:64:04', 'vm-uuid': 'c4e44bfc-6a68-46ce-8335-aaaba5160d3e'}),), if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:07:17 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:07:17 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:17 user nova-compute[75165]: INFO os_vif [None req-3b915456-470b-49b5-bdff-ae3b0de14dc0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:64:04,bridge_name='br-int',has_traffic_filtering=True,id=842f3b7a-8da7-48d2-90f7-7241fbaab648,network=Network(b31bac4b-1951-4ca3-8682-f1f24de0a5c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap842f3b7a-8d')
Oct 26 00:07:17 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-f14fa41a-0db2-4572-b30a-8c5b8ceb0780 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] No BDM found with device name vda, not building metadata. {{(pid=75165) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 00:07:17 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-f14fa41a-0db2-4572-b30a-8c5b8ceb0780 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] No VIF found with MAC fa:16:3e:4f:f1:44, not building metadata {{(pid=75165) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 00:07:17 user nova-compute[75165]: DEBUG nova.network.neutron [None req-26a64c2e-3ffa-417d-920d-0886e701b786 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] Successfully created port: 1d6d497c-7382-4dff-b136-d1220b05a838 {{(pid=75165) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 00:07:17 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-3b915456-470b-49b5-bdff-ae3b0de14dc0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] No BDM found with device name vda, not building metadata. {{(pid=75165) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 00:07:17 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-3b915456-470b-49b5-bdff-ae3b0de14dc0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] No VIF found with MAC fa:16:3e:1f:64:04, not building metadata {{(pid=75165) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 00:07:17 user nova-compute[75165]: DEBUG nova.network.neutron [req-74e41b32-ebb5-4d06-b61c-3ef0c7e0dc78 req-b5947b1b-0155-461e-b142-468f0e12571e service nova] [instance: 84c6b624-648b-40e2-a37e-ff08609bad84] Updated VIF entry in instance network info cache for port 2107529c-ec0e-4d1d-85b4-8605dcabc415. {{(pid=75165) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 00:07:17 user nova-compute[75165]: DEBUG nova.network.neutron [req-74e41b32-ebb5-4d06-b61c-3ef0c7e0dc78 req-b5947b1b-0155-461e-b142-468f0e12571e service nova] [instance: 84c6b624-648b-40e2-a37e-ff08609bad84] Updating instance_info_cache with network_info: [{"id": "2107529c-ec0e-4d1d-85b4-8605dcabc415", "address": "fa:16:3e:0c:8a:94", "network": {"id": "b31bac4b-1951-4ca3-8682-f1f24de0a5c3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1323234642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71aa69c0ea2d49e184e1e055ff3efa1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2107529c-ec", "ovs_interfaceid": "2107529c-ec0e-4d1d-85b4-8605dcabc415", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:07:17 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-74e41b32-ebb5-4d06-b61c-3ef0c7e0dc78 req-b5947b1b-0155-461e-b142-468f0e12571e service nova] Releasing lock "refresh_cache-84c6b624-648b-40e2-a37e-ff08609bad84" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:07:17 user nova-compute[75165]: DEBUG nova.compute.manager [req-15994eb0-9fac-48e6-9855-871aca2dc96b req-df82ccb7-c715-48eb-966b-072dff0e4a14 service nova] [instance: c4e44bfc-6a68-46ce-8335-aaaba5160d3e] Received event network-changed-842f3b7a-8da7-48d2-90f7-7241fbaab648 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:07:17 user nova-compute[75165]: DEBUG nova.compute.manager [req-15994eb0-9fac-48e6-9855-871aca2dc96b req-df82ccb7-c715-48eb-966b-072dff0e4a14 service nova] [instance: c4e44bfc-6a68-46ce-8335-aaaba5160d3e] Refreshing instance network info cache due to event network-changed-842f3b7a-8da7-48d2-90f7-7241fbaab648. {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 00:07:17 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-15994eb0-9fac-48e6-9855-871aca2dc96b req-df82ccb7-c715-48eb-966b-072dff0e4a14 service nova] Acquiring lock "refresh_cache-c4e44bfc-6a68-46ce-8335-aaaba5160d3e" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:07:17 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-15994eb0-9fac-48e6-9855-871aca2dc96b req-df82ccb7-c715-48eb-966b-072dff0e4a14 service nova] Acquired lock "refresh_cache-c4e44bfc-6a68-46ce-8335-aaaba5160d3e" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:07:17 user nova-compute[75165]: DEBUG nova.network.neutron [req-15994eb0-9fac-48e6-9855-871aca2dc96b req-df82ccb7-c715-48eb-966b-072dff0e4a14 service nova] [instance: c4e44bfc-6a68-46ce-8335-aaaba5160d3e] Refreshing network info cache for port 842f3b7a-8da7-48d2-90f7-7241fbaab648 {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 00:07:18 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:18 user nova-compute[75165]: DEBUG nova.network.neutron [req-2ebb0d92-2419-4cf8-a80f-0a5b26df77db req-d7a8e36e-8bc3-4232-a745-2f5a4c936ac3 service nova] [instance: 18dcf77e-fac2-4b38-ad1c-1f52ce14704a] Updated VIF entry in instance network info cache for port 7d1fdd51-5be0-40fd-bb7a-ef881af8f4f8. {{(pid=75165) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 00:07:18 user nova-compute[75165]: DEBUG nova.network.neutron [req-2ebb0d92-2419-4cf8-a80f-0a5b26df77db req-d7a8e36e-8bc3-4232-a745-2f5a4c936ac3 service nova] [instance: 18dcf77e-fac2-4b38-ad1c-1f52ce14704a] Updating instance_info_cache with network_info: [{"id": "7d1fdd51-5be0-40fd-bb7a-ef881af8f4f8", "address": "fa:16:3e:4f:f1:44", "network": {"id": "c4452fe5-2ef8-4c11-89ec-695fd0a8b67e", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-984180216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dee554bb28784e6486c6c5fb2df68caf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d1fdd51-5b", "ovs_interfaceid": "7d1fdd51-5be0-40fd-bb7a-ef881af8f4f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:07:18 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-2ebb0d92-2419-4cf8-a80f-0a5b26df77db req-d7a8e36e-8bc3-4232-a745-2f5a4c936ac3 service nova] Releasing lock "refresh_cache-18dcf77e-fac2-4b38-ad1c-1f52ce14704a" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:07:18 user nova-compute[75165]: DEBUG nova.network.neutron [None req-a2cf0630-846e-4208-9c81-8b7d5d545f44 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] Successfully created port: 874a1698-c52c-444c-bed5-52633dbaeead {{(pid=75165) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 00:07:19 user nova-compute[75165]: DEBUG nova.network.neutron [None req-fc7b823a-9e61-4fab-b9a0-528ca2ebc895 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] [instance: 6f9add59-cabe-4965-8fe3-524618550581] Successfully created port: 50bf388e-b8ff-4924-9633-7e97d083a361 {{(pid=75165) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 00:07:19 user nova-compute[75165]: DEBUG nova.network.neutron [req-15994eb0-9fac-48e6-9855-871aca2dc96b req-df82ccb7-c715-48eb-966b-072dff0e4a14 service nova] [instance: c4e44bfc-6a68-46ce-8335-aaaba5160d3e] Updated VIF entry in instance network info cache for port 842f3b7a-8da7-48d2-90f7-7241fbaab648. {{(pid=75165) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 00:07:19 user nova-compute[75165]: DEBUG nova.network.neutron [req-15994eb0-9fac-48e6-9855-871aca2dc96b req-df82ccb7-c715-48eb-966b-072dff0e4a14 service nova] [instance: c4e44bfc-6a68-46ce-8335-aaaba5160d3e] Updating instance_info_cache with network_info: [{"id": "842f3b7a-8da7-48d2-90f7-7241fbaab648", "address": "fa:16:3e:1f:64:04", "network": {"id": "b31bac4b-1951-4ca3-8682-f1f24de0a5c3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1323234642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71aa69c0ea2d49e184e1e055ff3efa1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap842f3b7a-8d", "ovs_interfaceid": "842f3b7a-8da7-48d2-90f7-7241fbaab648", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:07:19 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-15994eb0-9fac-48e6-9855-871aca2dc96b req-df82ccb7-c715-48eb-966b-072dff0e4a14 service nova] Releasing lock "refresh_cache-c4e44bfc-6a68-46ce-8335-aaaba5160d3e" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:07:19 user nova-compute[75165]: DEBUG nova.network.neutron [None req-2b8cd73e-9f80-44dc-bacf-845d4a401ebb tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: a7eeb145-1565-4812-818b-fefda5f2436d] Successfully updated port: 7a43d085-a683-4c49-a7c8-13b8f35c943d {{(pid=75165) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 00:07:19 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-2b8cd73e-9f80-44dc-bacf-845d4a401ebb tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Acquiring lock "refresh_cache-a7eeb145-1565-4812-818b-fefda5f2436d" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:07:19 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-2b8cd73e-9f80-44dc-bacf-845d4a401ebb tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Acquired lock "refresh_cache-a7eeb145-1565-4812-818b-fefda5f2436d" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:07:19 user nova-compute[75165]: DEBUG nova.network.neutron [None req-2b8cd73e-9f80-44dc-bacf-845d4a401ebb tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: a7eeb145-1565-4812-818b-fefda5f2436d] Building network info cache for instance {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 00:07:19 user nova-compute[75165]: DEBUG nova.network.neutron [None req-2b8cd73e-9f80-44dc-bacf-845d4a401ebb tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: a7eeb145-1565-4812-818b-fefda5f2436d] Instance cache missing network info. {{(pid=75165) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 00:07:19 user nova-compute[75165]: DEBUG nova.network.neutron [None req-26a64c2e-3ffa-417d-920d-0886e701b786 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] Successfully updated port: 1d6d497c-7382-4dff-b136-d1220b05a838 {{(pid=75165) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 00:07:19 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-26a64c2e-3ffa-417d-920d-0886e701b786 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Acquiring lock "refresh_cache-26a0b493-bb47-466e-95d5-945fc3849fa5" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:07:19 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-26a64c2e-3ffa-417d-920d-0886e701b786 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Acquired lock "refresh_cache-26a0b493-bb47-466e-95d5-945fc3849fa5" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:07:19 user nova-compute[75165]: DEBUG nova.network.neutron [None req-26a64c2e-3ffa-417d-920d-0886e701b786 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] Building network info cache for instance {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 00:07:19 user nova-compute[75165]: DEBUG nova.compute.manager [req-c7753a85-2e0a-4ec1-9d51-62a4edded03f req-18ba39c6-b1d3-48de-a9c0-09f88b16ee1d service nova] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] Received event network-changed-1d6d497c-7382-4dff-b136-d1220b05a838 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:07:19 user nova-compute[75165]: DEBUG nova.compute.manager [req-c7753a85-2e0a-4ec1-9d51-62a4edded03f req-18ba39c6-b1d3-48de-a9c0-09f88b16ee1d service nova] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] Refreshing instance network info cache due to event network-changed-1d6d497c-7382-4dff-b136-d1220b05a838. {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 00:07:19 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-c7753a85-2e0a-4ec1-9d51-62a4edded03f req-18ba39c6-b1d3-48de-a9c0-09f88b16ee1d service nova] Acquiring lock "refresh_cache-26a0b493-bb47-466e-95d5-945fc3849fa5" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:07:19 user nova-compute[75165]: DEBUG nova.network.neutron [None req-26a64c2e-3ffa-417d-920d-0886e701b786 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] Instance cache missing network info. {{(pid=75165) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 00:07:19 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:19 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:19 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:20 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:20 user nova-compute[75165]: DEBUG nova.compute.manager [req-9ff0b11f-2d6a-4408-9006-1bfad803f6a6 req-3fea2019-b20d-4382-92fc-ca0da704753c service nova] [instance: a7eeb145-1565-4812-818b-fefda5f2436d] Received event network-changed-7a43d085-a683-4c49-a7c8-13b8f35c943d {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:07:20 user nova-compute[75165]: DEBUG nova.compute.manager [req-9ff0b11f-2d6a-4408-9006-1bfad803f6a6 req-3fea2019-b20d-4382-92fc-ca0da704753c service nova] [instance: a7eeb145-1565-4812-818b-fefda5f2436d] Refreshing instance network info cache due to event network-changed-7a43d085-a683-4c49-a7c8-13b8f35c943d. {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 00:07:20 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-9ff0b11f-2d6a-4408-9006-1bfad803f6a6 req-3fea2019-b20d-4382-92fc-ca0da704753c service nova] Acquiring lock "refresh_cache-a7eeb145-1565-4812-818b-fefda5f2436d" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:07:20 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:20 user nova-compute[75165]: DEBUG nova.network.neutron [None req-2b8cd73e-9f80-44dc-bacf-845d4a401ebb tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: a7eeb145-1565-4812-818b-fefda5f2436d] Updating instance_info_cache with network_info: [{"id": "7a43d085-a683-4c49-a7c8-13b8f35c943d", "address": "fa:16:3e:e8:63:41", "network": {"id": "bd1c84f9-bba9-4a23-8bf2-17e65022136a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1557945804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2911497df44047d9a9ee36a5652298bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a43d085-a6", "ovs_interfaceid": "7a43d085-a683-4c49-a7c8-13b8f35c943d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:07:20 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-2b8cd73e-9f80-44dc-bacf-845d4a401ebb tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Releasing lock "refresh_cache-a7eeb145-1565-4812-818b-fefda5f2436d" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:07:20 user nova-compute[75165]: DEBUG nova.compute.manager [None req-2b8cd73e-9f80-44dc-bacf-845d4a401ebb tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: a7eeb145-1565-4812-818b-fefda5f2436d] Instance network_info: |[{"id": "7a43d085-a683-4c49-a7c8-13b8f35c943d", "address": "fa:16:3e:e8:63:41", "network": {"id": "bd1c84f9-bba9-4a23-8bf2-17e65022136a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1557945804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2911497df44047d9a9ee36a5652298bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a43d085-a6", "ovs_interfaceid": "7a43d085-a683-4c49-a7c8-13b8f35c943d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75165) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 00:07:20 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-9ff0b11f-2d6a-4408-9006-1bfad803f6a6 req-3fea2019-b20d-4382-92fc-ca0da704753c service nova] Acquired lock "refresh_cache-a7eeb145-1565-4812-818b-fefda5f2436d" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:07:20 user nova-compute[75165]: DEBUG nova.network.neutron [req-9ff0b11f-2d6a-4408-9006-1bfad803f6a6 req-3fea2019-b20d-4382-92fc-ca0da704753c service nova] [instance: a7eeb145-1565-4812-818b-fefda5f2436d] Refreshing network info cache for port 7a43d085-a683-4c49-a7c8-13b8f35c943d {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 00:07:20 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-2b8cd73e-9f80-44dc-bacf-845d4a401ebb tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: a7eeb145-1565-4812-818b-fefda5f2436d] Start _get_guest_xml network_info=[{"id": "7a43d085-a683-4c49-a7c8-13b8f35c943d", "address": "fa:16:3e:e8:63:41", "network": {"id": "bd1c84f9-bba9-4a23-8bf2-17e65022136a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1557945804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2911497df44047d9a9ee36a5652298bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a43d085-a6", "ovs_interfaceid": "7a43d085-a683-4c49-a7c8-13b8f35c943d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T00:03:24Z,direct_url=<?>,disk_format='qcow2',id=bff0d8a1-739e-4c4d-9efa-b73ba7b76d01,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e56bbf444fd34c348475c73673611447',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T00:03:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'size': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': 'bff0d8a1-739e-4c4d-9efa-b73ba7b76d01'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75165) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 00:07:20 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-2b8cd73e-9f80-44dc-bacf-845d4a401ebb tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:07:20 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-2b8cd73e-9f80-44dc-bacf-845d4a401ebb tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:07:20 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-2b8cd73e-9f80-44dc-bacf-845d4a401ebb tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75165) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 00:07:20 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-2b8cd73e-9f80-44dc-bacf-845d4a401ebb tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] CPU controller missing on host. {{(pid=75165) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 00:07:20 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-2b8cd73e-9f80-44dc-bacf-845d4a401ebb tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75165) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 00:07:20 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-2b8cd73e-9f80-44dc-bacf-845d4a401ebb tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] CPU controller found on host. {{(pid=75165) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 00:07:20 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-2b8cd73e-9f80-44dc-bacf-845d4a401ebb tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75165) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 00:07:20 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-2b8cd73e-9f80-44dc-bacf-845d4a401ebb tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T00:03:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T00:03:24Z,direct_url=<?>,disk_format='qcow2',id=bff0d8a1-739e-4c4d-9efa-b73ba7b76d01,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e56bbf444fd34c348475c73673611447',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T00:03:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 00:07:20 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-2b8cd73e-9f80-44dc-bacf-845d4a401ebb tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Flavor limits 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 00:07:20 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-2b8cd73e-9f80-44dc-bacf-845d4a401ebb tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Image limits 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 00:07:20 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-2b8cd73e-9f80-44dc-bacf-845d4a401ebb tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Flavor pref 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 00:07:20 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-2b8cd73e-9f80-44dc-bacf-845d4a401ebb tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Image pref 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 00:07:20 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-2b8cd73e-9f80-44dc-bacf-845d4a401ebb tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 00:07:20 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-2b8cd73e-9f80-44dc-bacf-845d4a401ebb tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 00:07:20 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-2b8cd73e-9f80-44dc-bacf-845d4a401ebb tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75165) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 00:07:20 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-2b8cd73e-9f80-44dc-bacf-845d4a401ebb tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Got 1 possible topologies {{(pid=75165) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 00:07:20 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-2b8cd73e-9f80-44dc-bacf-845d4a401ebb tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 00:07:20 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-2b8cd73e-9f80-44dc-bacf-845d4a401ebb tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 00:07:20 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-2b8cd73e-9f80-44dc-bacf-845d4a401ebb tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:07:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-626914428',display_name='tempest-ServerActionsTestOtherA-server-626914428',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-626914428',id=5,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOtsEaxSd5nKie4b+oTvKYqMVt06ToquYp528kCMFq0uGoZPhLpZteN38KkhJxhsHSzqyfMtJ24GLZPdcByyVczoa0tAnbSbuiNOiWj1Q2SiBRytz34zgMiDTwdnF2ayTw==',key_name='tempest-keypair-1300111',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2911497df44047d9a9ee36a5652298bc',ramdisk_id='',reservation_id='r-0fmnza9p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1690932306',owner_user_name='tempest-ServerActionsTestOtherA-1690932306-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T00:07:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b3ce94f4c01446ebf79a1eba3833e01',uuid=a7eeb145-1565-4812-818b-fefda5f2436d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7a43d085-a683-4c49-a7c8-13b8f35c943d", "address": "fa:16:3e:e8:63:41", "network": {"id": "bd1c84f9-bba9-4a23-8bf2-17e65022136a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1557945804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2911497df44047d9a9ee36a5652298bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a43d085-a6", "ovs_interfaceid": "7a43d085-a683-4c49-a7c8-13b8f35c943d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75165) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 00:07:20 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-2b8cd73e-9f80-44dc-bacf-845d4a401ebb tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Converting VIF {"id": "7a43d085-a683-4c49-a7c8-13b8f35c943d", "address": "fa:16:3e:e8:63:41", "network": {"id": "bd1c84f9-bba9-4a23-8bf2-17e65022136a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1557945804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2911497df44047d9a9ee36a5652298bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a43d085-a6", "ovs_interfaceid": "7a43d085-a683-4c49-a7c8-13b8f35c943d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:07:20 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-2b8cd73e-9f80-44dc-bacf-845d4a401ebb tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:63:41,bridge_name='br-int',has_traffic_filtering=True,id=7a43d085-a683-4c49-a7c8-13b8f35c943d,network=Network(bd1c84f9-bba9-4a23-8bf2-17e65022136a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a43d085-a6') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:07:20 user nova-compute[75165]: DEBUG nova.objects.instance [None req-2b8cd73e-9f80-44dc-bacf-845d4a401ebb tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Lazy-loading 'pci_devices' on Instance uuid a7eeb145-1565-4812-818b-fefda5f2436d {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:07:20 user nova-compute[75165]: DEBUG nova.network.neutron [None req-26a64c2e-3ffa-417d-920d-0886e701b786 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] Updating instance_info_cache with network_info: [{"id": "1d6d497c-7382-4dff-b136-d1220b05a838", "address": "fa:16:3e:d3:eb:fb", "network": {"id": "08c51c53-4819-493e-b4eb-df5d6024d43d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1633769998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9cbae16d09ed4474bb6653f08165a4e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d6d497c-73", "ovs_interfaceid": "1d6d497c-7382-4dff-b136-d1220b05a838", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:07:20 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-2b8cd73e-9f80-44dc-bacf-845d4a401ebb tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: a7eeb145-1565-4812-818b-fefda5f2436d] End _get_guest_xml xml=<domain type="kvm">
Oct 26 00:07:20 user nova-compute[75165]:   <uuid>a7eeb145-1565-4812-818b-fefda5f2436d</uuid>
Oct 26 00:07:20 user nova-compute[75165]:   <name>instance-00000005</name>
Oct 26 00:07:20 user nova-compute[75165]:   <memory>524288</memory>
Oct 26 00:07:20 user nova-compute[75165]:   <vcpu>1</vcpu>
Oct 26 00:07:20 user nova-compute[75165]:   <metadata>
Oct 26 00:07:20 user nova-compute[75165]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 00:07:20 user nova-compute[75165]:       <nova:package version="0.0.0"/>
Oct 26 00:07:20 user nova-compute[75165]:       <nova:name>tempest-ServerActionsTestOtherA-server-626914428</nova:name>
Oct 26 00:07:20 user nova-compute[75165]:       <nova:creationTime>2023-10-26 00:07:20</nova:creationTime>
Oct 26 00:07:20 user nova-compute[75165]:       <nova:flavor name="m1.tiny">
Oct 26 00:07:20 user nova-compute[75165]:         <nova:memory>512</nova:memory>
Oct 26 00:07:20 user nova-compute[75165]:         <nova:disk>1</nova:disk>
Oct 26 00:07:20 user nova-compute[75165]:         <nova:swap>0</nova:swap>
Oct 26 00:07:20 user nova-compute[75165]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 00:07:20 user nova-compute[75165]:         <nova:vcpus>1</nova:vcpus>
Oct 26 00:07:20 user nova-compute[75165]:       </nova:flavor>
Oct 26 00:07:20 user nova-compute[75165]:       <nova:owner>
Oct 26 00:07:20 user nova-compute[75165]:         <nova:user uuid="5b3ce94f4c01446ebf79a1eba3833e01">tempest-ServerActionsTestOtherA-1690932306-project-member</nova:user>
Oct 26 00:07:20 user nova-compute[75165]:         <nova:project uuid="2911497df44047d9a9ee36a5652298bc">tempest-ServerActionsTestOtherA-1690932306</nova:project>
Oct 26 00:07:20 user nova-compute[75165]:       </nova:owner>
Oct 26 00:07:20 user nova-compute[75165]:       <nova:root type="image" uuid="bff0d8a1-739e-4c4d-9efa-b73ba7b76d01"/>
Oct 26 00:07:20 user nova-compute[75165]:       <nova:ports>
Oct 26 00:07:20 user nova-compute[75165]:         <nova:port uuid="7a43d085-a683-4c49-a7c8-13b8f35c943d">
Oct 26 00:07:20 user nova-compute[75165]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 26 00:07:20 user nova-compute[75165]:         </nova:port>
Oct 26 00:07:20 user nova-compute[75165]:       </nova:ports>
Oct 26 00:07:20 user nova-compute[75165]:     </nova:instance>
Oct 26 00:07:20 user nova-compute[75165]:   </metadata>
Oct 26 00:07:20 user nova-compute[75165]:   <sysinfo type="smbios">
Oct 26 00:07:20 user nova-compute[75165]:     <system>
Oct 26 00:07:20 user nova-compute[75165]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 00:07:20 user nova-compute[75165]:       <entry name="product">OpenStack Nova</entry>
Oct 26 00:07:20 user nova-compute[75165]:       <entry name="version">0.0.0</entry>
Oct 26 00:07:20 user nova-compute[75165]:       <entry name="serial">a7eeb145-1565-4812-818b-fefda5f2436d</entry>
Oct 26 00:07:20 user nova-compute[75165]:       <entry name="uuid">a7eeb145-1565-4812-818b-fefda5f2436d</entry>
Oct 26 00:07:20 user nova-compute[75165]:       <entry name="family">Virtual Machine</entry>
Oct 26 00:07:20 user nova-compute[75165]:     </system>
Oct 26 00:07:20 user nova-compute[75165]:   </sysinfo>
Oct 26 00:07:20 user nova-compute[75165]:   <os>
Oct 26 00:07:20 user nova-compute[75165]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 00:07:20 user nova-compute[75165]:     <boot dev="hd"/>
Oct 26 00:07:20 user nova-compute[75165]:     <smbios mode="sysinfo"/>
Oct 26 00:07:20 user nova-compute[75165]:   </os>
Oct 26 00:07:20 user nova-compute[75165]:   <features>
Oct 26 00:07:20 user nova-compute[75165]:     <acpi/>
Oct 26 00:07:20 user nova-compute[75165]:     <apic/>
Oct 26 00:07:20 user nova-compute[75165]:     <vmcoreinfo/>
Oct 26 00:07:20 user nova-compute[75165]:   </features>
Oct 26 00:07:20 user nova-compute[75165]:   <clock offset="utc">
Oct 26 00:07:20 user nova-compute[75165]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 00:07:20 user nova-compute[75165]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 00:07:20 user nova-compute[75165]:     <timer name="hpet" present="no"/>
Oct 26 00:07:20 user nova-compute[75165]:   </clock>
Oct 26 00:07:20 user nova-compute[75165]:   <cpu mode="custom" match="exact">
Oct 26 00:07:20 user nova-compute[75165]:     <model>Nehalem</model>
Oct 26 00:07:20 user nova-compute[75165]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 00:07:20 user nova-compute[75165]:   </cpu>
Oct 26 00:07:20 user nova-compute[75165]:   <devices>
Oct 26 00:07:20 user nova-compute[75165]:     <disk type="file" device="disk">
Oct 26 00:07:20 user nova-compute[75165]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 00:07:20 user nova-compute[75165]:       <source file="/opt/stack/data/nova/instances/a7eeb145-1565-4812-818b-fefda5f2436d/disk"/>
Oct 26 00:07:20 user nova-compute[75165]:       <target dev="vda" bus="virtio"/>
Oct 26 00:07:20 user nova-compute[75165]:     </disk>
Oct 26 00:07:20 user nova-compute[75165]:     <interface type="ethernet">
Oct 26 00:07:20 user nova-compute[75165]:       <mac address="fa:16:3e:e8:63:41"/>
Oct 26 00:07:20 user nova-compute[75165]:       <model type="virtio"/>
Oct 26 00:07:20 user nova-compute[75165]:       <mtu size="1442"/>
Oct 26 00:07:20 user nova-compute[75165]:       <target dev="tap7a43d085-a6"/>
Oct 26 00:07:20 user nova-compute[75165]:     </interface>
Oct 26 00:07:20 user nova-compute[75165]:     <serial type="pty">
Oct 26 00:07:20 user nova-compute[75165]:       <log file="/opt/stack/data/nova/instances/a7eeb145-1565-4812-818b-fefda5f2436d/console.log" append="off"/>
Oct 26 00:07:20 user nova-compute[75165]:     </serial>
Oct 26 00:07:20 user nova-compute[75165]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 00:07:20 user nova-compute[75165]:     <video>
Oct 26 00:07:20 user nova-compute[75165]:       <model type="virtio"/>
Oct 26 00:07:20 user nova-compute[75165]:     </video>
Oct 26 00:07:20 user nova-compute[75165]:     <rng model="virtio">
Oct 26 00:07:20 user nova-compute[75165]:       <backend model="random">/dev/urandom</backend>
Oct 26 00:07:20 user nova-compute[75165]:     </rng>
Oct 26 00:07:20 user nova-compute[75165]:     <controller type="usb" index="0" model="none"/>
Oct 26 00:07:20 user nova-compute[75165]:     <memballoon model="virtio">
Oct 26 00:07:20 user nova-compute[75165]:       <stats period="10"/>
Oct 26 00:07:20 user nova-compute[75165]:     </memballoon>
Oct 26 00:07:20 user nova-compute[75165]:   </devices>
Oct 26 00:07:20 user nova-compute[75165]: </domain>
Oct 26 00:07:20 user nova-compute[75165]:  {{(pid=75165) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 00:07:20 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-2b8cd73e-9f80-44dc-bacf-845d4a401ebb tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:07:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-626914428',display_name='tempest-ServerActionsTestOtherA-server-626914428',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-626914428',id=5,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOtsEaxSd5nKie4b+oTvKYqMVt06ToquYp528kCMFq0uGoZPhLpZteN38KkhJxhsHSzqyfMtJ24GLZPdcByyVczoa0tAnbSbuiNOiWj1Q2SiBRytz34zgMiDTwdnF2ayTw==',key_name='tempest-keypair-1300111',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2911497df44047d9a9ee36a5652298bc',ramdisk_id='',reservation_id='r-0fmnza9p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1690932306',owner_user_name='tempest-ServerActionsTestOtherA-1690932306-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T00:07:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b3ce94f4c01446ebf79a1eba3833e01',uuid=a7eeb145-1565-4812-818b-fefda5f2436d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7a43d085-a683-4c49-a7c8-13b8f35c943d", "address": "fa:16:3e:e8:63:41", "network": {"id": "bd1c84f9-bba9-4a23-8bf2-17e65022136a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1557945804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2911497df44047d9a9ee36a5652298bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a43d085-a6", "ovs_interfaceid": "7a43d085-a683-4c49-a7c8-13b8f35c943d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 00:07:20 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-2b8cd73e-9f80-44dc-bacf-845d4a401ebb tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Converting VIF {"id": "7a43d085-a683-4c49-a7c8-13b8f35c943d", "address": "fa:16:3e:e8:63:41", "network": {"id": "bd1c84f9-bba9-4a23-8bf2-17e65022136a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1557945804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2911497df44047d9a9ee36a5652298bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a43d085-a6", "ovs_interfaceid": "7a43d085-a683-4c49-a7c8-13b8f35c943d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:07:20 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-2b8cd73e-9f80-44dc-bacf-845d4a401ebb tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:63:41,bridge_name='br-int',has_traffic_filtering=True,id=7a43d085-a683-4c49-a7c8-13b8f35c943d,network=Network(bd1c84f9-bba9-4a23-8bf2-17e65022136a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a43d085-a6') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:07:20 user nova-compute[75165]: DEBUG os_vif [None req-2b8cd73e-9f80-44dc-bacf-845d4a401ebb tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:63:41,bridge_name='br-int',has_traffic_filtering=True,id=7a43d085-a683-4c49-a7c8-13b8f35c943d,network=Network(bd1c84f9-bba9-4a23-8bf2-17e65022136a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a43d085-a6') {{(pid=75165) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 00:07:20 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:20 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:07:20 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 00:07:20 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:20 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2be4e105-78d1-5d37-94b3-b1cd96836921', '_type': 'linux-noop'}}, row=False) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:07:20 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:07:20 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-26a64c2e-3ffa-417d-920d-0886e701b786 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Releasing lock "refresh_cache-26a0b493-bb47-466e-95d5-945fc3849fa5" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:07:20 user nova-compute[75165]: DEBUG nova.compute.manager [None req-26a64c2e-3ffa-417d-920d-0886e701b786 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] Instance network_info: |[{"id": "1d6d497c-7382-4dff-b136-d1220b05a838", "address": "fa:16:3e:d3:eb:fb", "network": {"id": "08c51c53-4819-493e-b4eb-df5d6024d43d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1633769998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9cbae16d09ed4474bb6653f08165a4e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d6d497c-73", "ovs_interfaceid": "1d6d497c-7382-4dff-b136-d1220b05a838", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75165) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 00:07:20 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-c7753a85-2e0a-4ec1-9d51-62a4edded03f req-18ba39c6-b1d3-48de-a9c0-09f88b16ee1d service nova] Acquired lock "refresh_cache-26a0b493-bb47-466e-95d5-945fc3849fa5" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:07:20 user nova-compute[75165]: DEBUG nova.network.neutron [req-c7753a85-2e0a-4ec1-9d51-62a4edded03f req-18ba39c6-b1d3-48de-a9c0-09f88b16ee1d service nova] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] Refreshing network info cache for port 1d6d497c-7382-4dff-b136-d1220b05a838 {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 00:07:20 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-26a64c2e-3ffa-417d-920d-0886e701b786 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] Start _get_guest_xml network_info=[{"id": "1d6d497c-7382-4dff-b136-d1220b05a838", "address": "fa:16:3e:d3:eb:fb", "network": {"id": "08c51c53-4819-493e-b4eb-df5d6024d43d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1633769998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9cbae16d09ed4474bb6653f08165a4e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d6d497c-73", "ovs_interfaceid": "1d6d497c-7382-4dff-b136-d1220b05a838", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T00:03:24Z,direct_url=<?>,disk_format='qcow2',id=bff0d8a1-739e-4c4d-9efa-b73ba7b76d01,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e56bbf444fd34c348475c73673611447',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T00:03:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'size': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': 'bff0d8a1-739e-4c4d-9efa-b73ba7b76d01'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75165) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 00:07:20 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:20 user nova-compute[75165]: DEBUG nova.network.neutron [None req-fc7b823a-9e61-4fab-b9a0-528ca2ebc895 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] [instance: 6f9add59-cabe-4965-8fe3-524618550581] Successfully updated port: 50bf388e-b8ff-4924-9633-7e97d083a361 {{(pid=75165) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 00:07:20 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-26a64c2e-3ffa-417d-920d-0886e701b786 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:07:20 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-26a64c2e-3ffa-417d-920d-0886e701b786 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:07:20 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:20 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7a43d085-a6, may_exist=True, interface_attrs={}) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:07:20 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7a43d085-a6, col_values=(('qos', UUID('2169deac-3018-482d-9f7a-a05665c00954')),), if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:07:20 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7a43d085-a6, col_values=(('external_ids', {'iface-id': '7a43d085-a683-4c49-a7c8-13b8f35c943d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e8:63:41', 'vm-uuid': 'a7eeb145-1565-4812-818b-fefda5f2436d'}),), if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:07:20 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-fc7b823a-9e61-4fab-b9a0-528ca2ebc895 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Acquiring lock "refresh_cache-6f9add59-cabe-4965-8fe3-524618550581" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:07:20 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-fc7b823a-9e61-4fab-b9a0-528ca2ebc895 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Acquired lock "refresh_cache-6f9add59-cabe-4965-8fe3-524618550581" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:07:20 user nova-compute[75165]: DEBUG nova.network.neutron [None req-fc7b823a-9e61-4fab-b9a0-528ca2ebc895 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] [instance: 6f9add59-cabe-4965-8fe3-524618550581] Building network info cache for instance {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 00:07:20 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:07:20 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-26a64c2e-3ffa-417d-920d-0886e701b786 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75165) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 00:07:20 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-26a64c2e-3ffa-417d-920d-0886e701b786 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] CPU controller missing on host. {{(pid=75165) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 00:07:20 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-26a64c2e-3ffa-417d-920d-0886e701b786 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75165) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 00:07:20 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-26a64c2e-3ffa-417d-920d-0886e701b786 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] CPU controller found on host. {{(pid=75165) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 00:07:20 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-26a64c2e-3ffa-417d-920d-0886e701b786 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75165) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 00:07:20 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-26a64c2e-3ffa-417d-920d-0886e701b786 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T00:03:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T00:03:24Z,direct_url=<?>,disk_format='qcow2',id=bff0d8a1-739e-4c4d-9efa-b73ba7b76d01,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e56bbf444fd34c348475c73673611447',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T00:03:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 00:07:20 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-26a64c2e-3ffa-417d-920d-0886e701b786 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Flavor limits 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 00:07:20 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-26a64c2e-3ffa-417d-920d-0886e701b786 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Image limits 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 00:07:20 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-26a64c2e-3ffa-417d-920d-0886e701b786 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Flavor pref 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 00:07:20 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-26a64c2e-3ffa-417d-920d-0886e701b786 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Image pref 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 00:07:20 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-26a64c2e-3ffa-417d-920d-0886e701b786 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 00:07:20 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-26a64c2e-3ffa-417d-920d-0886e701b786 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 00:07:20 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-26a64c2e-3ffa-417d-920d-0886e701b786 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75165) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 00:07:20 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-26a64c2e-3ffa-417d-920d-0886e701b786 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Got 1 possible topologies {{(pid=75165) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 00:07:20 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-26a64c2e-3ffa-417d-920d-0886e701b786 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 00:07:20 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-26a64c2e-3ffa-417d-920d-0886e701b786 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 00:07:20 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-26a64c2e-3ffa-417d-920d-0886e701b786 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:07:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-609329296',display_name='tempest-ServerStableDeviceRescueTest-server-609329296',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-609329296',id=6,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC4BNQ+GaWhIdYY5+kuVMESGWyvIRQoK5o0tz+YWgwiyxZJkfUowNPNzbMJ3GImV/y2wwOtRmsApdRZKOXSoI+VOZ3WRPGRkXXPlFnBMVzrbGW9ERsWeijK3p6uBV3K5Jg==',key_name='tempest-keypair-627775438',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9cbae16d09ed4474bb6653f08165a4e5',ramdisk_id='',reservation_id='r-y8rfmg08',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1585397509',owner_user_name='tempest-ServerStableDeviceRescueTest-1585397509-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T00:07:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7ac761f144034256baf6a2372a7b685c',uuid=26a0b493-bb47-466e-95d5-945fc3849fa5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1d6d497c-7382-4dff-b136-d1220b05a838", "address": "fa:16:3e:d3:eb:fb", "network": {"id": "08c51c53-4819-493e-b4eb-df5d6024d43d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1633769998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9cbae16d09ed4474bb6653f08165a4e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d6d497c-73", "ovs_interfaceid": "1d6d497c-7382-4dff-b136-d1220b05a838", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75165) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 00:07:20 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-26a64c2e-3ffa-417d-920d-0886e701b786 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Converting VIF {"id": "1d6d497c-7382-4dff-b136-d1220b05a838", "address": "fa:16:3e:d3:eb:fb", "network": {"id": "08c51c53-4819-493e-b4eb-df5d6024d43d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1633769998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9cbae16d09ed4474bb6653f08165a4e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d6d497c-73", "ovs_interfaceid": "1d6d497c-7382-4dff-b136-d1220b05a838", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:07:20 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-26a64c2e-3ffa-417d-920d-0886e701b786 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:eb:fb,bridge_name='br-int',has_traffic_filtering=True,id=1d6d497c-7382-4dff-b136-d1220b05a838,network=Network(08c51c53-4819-493e-b4eb-df5d6024d43d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d6d497c-73') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:07:20 user nova-compute[75165]: DEBUG nova.objects.instance [None req-26a64c2e-3ffa-417d-920d-0886e701b786 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Lazy-loading 'pci_devices' on Instance uuid 26a0b493-bb47-466e-95d5-945fc3849fa5 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:07:20 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:20 user nova-compute[75165]: INFO os_vif [None req-2b8cd73e-9f80-44dc-bacf-845d4a401ebb tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:63:41,bridge_name='br-int',has_traffic_filtering=True,id=7a43d085-a683-4c49-a7c8-13b8f35c943d,network=Network(bd1c84f9-bba9-4a23-8bf2-17e65022136a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a43d085-a6')
Oct 26 00:07:20 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-26a64c2e-3ffa-417d-920d-0886e701b786 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] End _get_guest_xml xml=<domain type="kvm">
Oct 26 00:07:20 user nova-compute[75165]:   <uuid>26a0b493-bb47-466e-95d5-945fc3849fa5</uuid>
Oct 26 00:07:20 user nova-compute[75165]:   <name>instance-00000006</name>
Oct 26 00:07:20 user nova-compute[75165]:   <memory>524288</memory>
Oct 26 00:07:20 user nova-compute[75165]:   <vcpu>1</vcpu>
Oct 26 00:07:20 user nova-compute[75165]:   <metadata>
Oct 26 00:07:20 user nova-compute[75165]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 00:07:20 user nova-compute[75165]:       <nova:package version="0.0.0"/>
Oct 26 00:07:20 user nova-compute[75165]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-609329296</nova:name>
Oct 26 00:07:20 user nova-compute[75165]:       <nova:creationTime>2023-10-26 00:07:20</nova:creationTime>
Oct 26 00:07:20 user nova-compute[75165]:       <nova:flavor name="m1.tiny">
Oct 26 00:07:20 user nova-compute[75165]:         <nova:memory>512</nova:memory>
Oct 26 00:07:20 user nova-compute[75165]:         <nova:disk>1</nova:disk>
Oct 26 00:07:20 user nova-compute[75165]:         <nova:swap>0</nova:swap>
Oct 26 00:07:20 user nova-compute[75165]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 00:07:20 user nova-compute[75165]:         <nova:vcpus>1</nova:vcpus>
Oct 26 00:07:20 user nova-compute[75165]:       </nova:flavor>
Oct 26 00:07:20 user nova-compute[75165]:       <nova:owner>
Oct 26 00:07:20 user nova-compute[75165]:         <nova:user uuid="7ac761f144034256baf6a2372a7b685c">tempest-ServerStableDeviceRescueTest-1585397509-project-member</nova:user>
Oct 26 00:07:20 user nova-compute[75165]:         <nova:project uuid="9cbae16d09ed4474bb6653f08165a4e5">tempest-ServerStableDeviceRescueTest-1585397509</nova:project>
Oct 26 00:07:20 user nova-compute[75165]:       </nova:owner>
Oct 26 00:07:20 user nova-compute[75165]:       <nova:root type="image" uuid="bff0d8a1-739e-4c4d-9efa-b73ba7b76d01"/>
Oct 26 00:07:20 user nova-compute[75165]:       <nova:ports>
Oct 26 00:07:20 user nova-compute[75165]:         <nova:port uuid="1d6d497c-7382-4dff-b136-d1220b05a838">
Oct 26 00:07:20 user nova-compute[75165]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 26 00:07:20 user nova-compute[75165]:         </nova:port>
Oct 26 00:07:20 user nova-compute[75165]:       </nova:ports>
Oct 26 00:07:20 user nova-compute[75165]:     </nova:instance>
Oct 26 00:07:20 user nova-compute[75165]:   </metadata>
Oct 26 00:07:20 user nova-compute[75165]:   <sysinfo type="smbios">
Oct 26 00:07:20 user nova-compute[75165]:     <system>
Oct 26 00:07:20 user nova-compute[75165]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 00:07:20 user nova-compute[75165]:       <entry name="product">OpenStack Nova</entry>
Oct 26 00:07:20 user nova-compute[75165]:       <entry name="version">0.0.0</entry>
Oct 26 00:07:20 user nova-compute[75165]:       <entry name="serial">26a0b493-bb47-466e-95d5-945fc3849fa5</entry>
Oct 26 00:07:20 user nova-compute[75165]:       <entry name="uuid">26a0b493-bb47-466e-95d5-945fc3849fa5</entry>
Oct 26 00:07:20 user nova-compute[75165]:       <entry name="family">Virtual Machine</entry>
Oct 26 00:07:20 user nova-compute[75165]:     </system>
Oct 26 00:07:20 user nova-compute[75165]:   </sysinfo>
Oct 26 00:07:20 user nova-compute[75165]:   <os>
Oct 26 00:07:20 user nova-compute[75165]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 00:07:20 user nova-compute[75165]:     <boot dev="hd"/>
Oct 26 00:07:20 user nova-compute[75165]:     <smbios mode="sysinfo"/>
Oct 26 00:07:20 user nova-compute[75165]:   </os>
Oct 26 00:07:20 user nova-compute[75165]:   <features>
Oct 26 00:07:20 user nova-compute[75165]:     <acpi/>
Oct 26 00:07:20 user nova-compute[75165]:     <apic/>
Oct 26 00:07:20 user nova-compute[75165]:     <vmcoreinfo/>
Oct 26 00:07:20 user nova-compute[75165]:   </features>
Oct 26 00:07:20 user nova-compute[75165]:   <clock offset="utc">
Oct 26 00:07:20 user nova-compute[75165]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 00:07:20 user nova-compute[75165]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 00:07:20 user nova-compute[75165]:     <timer name="hpet" present="no"/>
Oct 26 00:07:20 user nova-compute[75165]:   </clock>
Oct 26 00:07:20 user nova-compute[75165]:   <cpu mode="custom" match="exact">
Oct 26 00:07:20 user nova-compute[75165]:     <model>Nehalem</model>
Oct 26 00:07:20 user nova-compute[75165]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 00:07:20 user nova-compute[75165]:   </cpu>
Oct 26 00:07:20 user nova-compute[75165]:   <devices>
Oct 26 00:07:20 user nova-compute[75165]:     <disk type="file" device="disk">
Oct 26 00:07:20 user nova-compute[75165]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 00:07:20 user nova-compute[75165]:       <source file="/opt/stack/data/nova/instances/26a0b493-bb47-466e-95d5-945fc3849fa5/disk"/>
Oct 26 00:07:20 user nova-compute[75165]:       <target dev="vda" bus="virtio"/>
Oct 26 00:07:20 user nova-compute[75165]:     </disk>
Oct 26 00:07:20 user nova-compute[75165]:     <interface type="ethernet">
Oct 26 00:07:20 user nova-compute[75165]:       <mac address="fa:16:3e:d3:eb:fb"/>
Oct 26 00:07:20 user nova-compute[75165]:       <model type="virtio"/>
Oct 26 00:07:20 user nova-compute[75165]:       <mtu size="1442"/>
Oct 26 00:07:20 user nova-compute[75165]:       <target dev="tap1d6d497c-73"/>
Oct 26 00:07:20 user nova-compute[75165]:     </interface>
Oct 26 00:07:20 user nova-compute[75165]:     <serial type="pty">
Oct 26 00:07:20 user nova-compute[75165]:       <log file="/opt/stack/data/nova/instances/26a0b493-bb47-466e-95d5-945fc3849fa5/console.log" append="off"/>
Oct 26 00:07:20 user nova-compute[75165]:     </serial>
Oct 26 00:07:20 user nova-compute[75165]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 00:07:20 user nova-compute[75165]:     <video>
Oct 26 00:07:20 user nova-compute[75165]:       <model type="virtio"/>
Oct 26 00:07:20 user nova-compute[75165]:     </video>
Oct 26 00:07:20 user nova-compute[75165]:     <rng model="virtio">
Oct 26 00:07:20 user nova-compute[75165]:       <backend model="random">/dev/urandom</backend>
Oct 26 00:07:20 user nova-compute[75165]:     </rng>
Oct 26 00:07:20 user nova-compute[75165]:     <controller type="usb" index="0" model="none"/>
Oct 26 00:07:20 user nova-compute[75165]:     <memballoon model="virtio">
Oct 26 00:07:20 user nova-compute[75165]:       <stats period="10"/>
Oct 26 00:07:20 user nova-compute[75165]:     </memballoon>
Oct 26 00:07:20 user nova-compute[75165]:   </devices>
Oct 26 00:07:20 user nova-compute[75165]: </domain>
Oct 26 00:07:20 user nova-compute[75165]:  {{(pid=75165) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 00:07:20 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-26a64c2e-3ffa-417d-920d-0886e701b786 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:07:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-609329296',display_name='tempest-ServerStableDeviceRescueTest-server-609329296',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-609329296',id=6,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC4BNQ+GaWhIdYY5+kuVMESGWyvIRQoK5o0tz+YWgwiyxZJkfUowNPNzbMJ3GImV/y2wwOtRmsApdRZKOXSoI+VOZ3WRPGRkXXPlFnBMVzrbGW9ERsWeijK3p6uBV3K5Jg==',key_name='tempest-keypair-627775438',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9cbae16d09ed4474bb6653f08165a4e5',ramdisk_id='',reservation_id='r-y8rfmg08',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1585397509',owner_user_name='tempest-ServerStableDeviceRescueTest-1585397509-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T00:07:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7ac761f144034256baf6a2372a7b685c',uuid=26a0b493-bb47-466e-95d5-945fc3849fa5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1d6d497c-7382-4dff-b136-d1220b05a838", "address": "fa:16:3e:d3:eb:fb", "network": {"id": "08c51c53-4819-493e-b4eb-df5d6024d43d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1633769998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9cbae16d09ed4474bb6653f08165a4e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d6d497c-73", "ovs_interfaceid": "1d6d497c-7382-4dff-b136-d1220b05a838", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 00:07:20 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-26a64c2e-3ffa-417d-920d-0886e701b786 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Converting VIF {"id": "1d6d497c-7382-4dff-b136-d1220b05a838", "address": "fa:16:3e:d3:eb:fb", "network": {"id": "08c51c53-4819-493e-b4eb-df5d6024d43d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1633769998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9cbae16d09ed4474bb6653f08165a4e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d6d497c-73", "ovs_interfaceid": "1d6d497c-7382-4dff-b136-d1220b05a838", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:07:20 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-26a64c2e-3ffa-417d-920d-0886e701b786 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:eb:fb,bridge_name='br-int',has_traffic_filtering=True,id=1d6d497c-7382-4dff-b136-d1220b05a838,network=Network(08c51c53-4819-493e-b4eb-df5d6024d43d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d6d497c-73') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:07:20 user nova-compute[75165]: DEBUG os_vif [None req-26a64c2e-3ffa-417d-920d-0886e701b786 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:eb:fb,bridge_name='br-int',has_traffic_filtering=True,id=1d6d497c-7382-4dff-b136-d1220b05a838,network=Network(08c51c53-4819-493e-b4eb-df5d6024d43d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d6d497c-73') {{(pid=75165) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 00:07:20 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:20 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:07:20 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 00:07:20 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:20 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'de85c4c2-38c6-51f3-91d3-fa7ec60d015c', '_type': 'linux-noop'}}, row=False) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:07:20 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:07:20 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:20 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-2b8cd73e-9f80-44dc-bacf-845d4a401ebb tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] No BDM found with device name vda, not building metadata. {{(pid=75165) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 00:07:20 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-2b8cd73e-9f80-44dc-bacf-845d4a401ebb tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] No VIF found with MAC fa:16:3e:e8:63:41, not building metadata {{(pid=75165) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 00:07:20 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:20 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1d6d497c-73, may_exist=True, interface_attrs={}) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:07:20 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1d6d497c-73, col_values=(('qos', UUID('a5f06d0c-c86f-44b1-ba8c-f34281ef8ffb')),), if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:07:20 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1d6d497c-73, col_values=(('external_ids', {'iface-id': '1d6d497c-7382-4dff-b136-d1220b05a838', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d3:eb:fb', 'vm-uuid': '26a0b493-bb47-466e-95d5-945fc3849fa5'}),), if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:07:20 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:07:20 user nova-compute[75165]: DEBUG nova.network.neutron [None req-fc7b823a-9e61-4fab-b9a0-528ca2ebc895 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] [instance: 6f9add59-cabe-4965-8fe3-524618550581] Instance cache missing network info. {{(pid=75165) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 00:07:20 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:20 user nova-compute[75165]: INFO os_vif [None req-26a64c2e-3ffa-417d-920d-0886e701b786 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:eb:fb,bridge_name='br-int',has_traffic_filtering=True,id=1d6d497c-7382-4dff-b136-d1220b05a838,network=Network(08c51c53-4819-493e-b4eb-df5d6024d43d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d6d497c-73')
Oct 26 00:07:21 user nova-compute[75165]: DEBUG nova.network.neutron [None req-a2cf0630-846e-4208-9c81-8b7d5d545f44 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] Successfully updated port: 874a1698-c52c-444c-bed5-52633dbaeead {{(pid=75165) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 00:07:21 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-a2cf0630-846e-4208-9c81-8b7d5d545f44 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Acquiring lock "refresh_cache-3b153af2-c93b-47d2-ae8c-76cfd44e384c" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:07:21 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-a2cf0630-846e-4208-9c81-8b7d5d545f44 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Acquired lock "refresh_cache-3b153af2-c93b-47d2-ae8c-76cfd44e384c" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:07:21 user nova-compute[75165]: DEBUG nova.network.neutron [None req-a2cf0630-846e-4208-9c81-8b7d5d545f44 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] Building network info cache for instance {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 00:07:21 user nova-compute[75165]: DEBUG nova.network.neutron [None req-a2cf0630-846e-4208-9c81-8b7d5d545f44 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] Instance cache missing network info. {{(pid=75165) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 00:07:21 user nova-compute[75165]: DEBUG nova.network.neutron [None req-fc7b823a-9e61-4fab-b9a0-528ca2ebc895 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] [instance: 6f9add59-cabe-4965-8fe3-524618550581] Updating instance_info_cache with network_info: [{"id": "50bf388e-b8ff-4924-9633-7e97d083a361", "address": "fa:16:3e:16:28:b9", "network": {"id": "f54e2e9f-5c1e-44ca-bd4b-9cf0747b0f72", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-806146051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "920152101768459baa71010b380ea8f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50bf388e-b8", "ovs_interfaceid": "50bf388e-b8ff-4924-9633-7e97d083a361", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:07:21 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-fc7b823a-9e61-4fab-b9a0-528ca2ebc895 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Releasing lock "refresh_cache-6f9add59-cabe-4965-8fe3-524618550581" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:07:21 user nova-compute[75165]: DEBUG nova.compute.manager [None req-fc7b823a-9e61-4fab-b9a0-528ca2ebc895 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] [instance: 6f9add59-cabe-4965-8fe3-524618550581] Instance network_info: |[{"id": "50bf388e-b8ff-4924-9633-7e97d083a361", "address": "fa:16:3e:16:28:b9", "network": {"id": "f54e2e9f-5c1e-44ca-bd4b-9cf0747b0f72", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-806146051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "920152101768459baa71010b380ea8f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50bf388e-b8", "ovs_interfaceid": "50bf388e-b8ff-4924-9633-7e97d083a361", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75165) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 00:07:21 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-fc7b823a-9e61-4fab-b9a0-528ca2ebc895 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] [instance: 6f9add59-cabe-4965-8fe3-524618550581] Start _get_guest_xml network_info=[{"id": "50bf388e-b8ff-4924-9633-7e97d083a361", "address": "fa:16:3e:16:28:b9", "network": {"id": "f54e2e9f-5c1e-44ca-bd4b-9cf0747b0f72", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-806146051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "920152101768459baa71010b380ea8f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50bf388e-b8", "ovs_interfaceid": "50bf388e-b8ff-4924-9633-7e97d083a361", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T00:03:24Z,direct_url=<?>,disk_format='qcow2',id=bff0d8a1-739e-4c4d-9efa-b73ba7b76d01,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e56bbf444fd34c348475c73673611447',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T00:03:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'size': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': 'bff0d8a1-739e-4c4d-9efa-b73ba7b76d01'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75165) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 00:07:21 user nova-compute[75165]: DEBUG nova.network.neutron [req-c7753a85-2e0a-4ec1-9d51-62a4edded03f req-18ba39c6-b1d3-48de-a9c0-09f88b16ee1d service nova] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] Updated VIF entry in instance network info cache for port 1d6d497c-7382-4dff-b136-d1220b05a838. {{(pid=75165) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 00:07:21 user nova-compute[75165]: DEBUG nova.network.neutron [req-c7753a85-2e0a-4ec1-9d51-62a4edded03f req-18ba39c6-b1d3-48de-a9c0-09f88b16ee1d service nova] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] Updating instance_info_cache with network_info: [{"id": "1d6d497c-7382-4dff-b136-d1220b05a838", "address": "fa:16:3e:d3:eb:fb", "network": {"id": "08c51c53-4819-493e-b4eb-df5d6024d43d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1633769998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9cbae16d09ed4474bb6653f08165a4e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d6d497c-73", "ovs_interfaceid": "1d6d497c-7382-4dff-b136-d1220b05a838", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:07:21 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-c7753a85-2e0a-4ec1-9d51-62a4edded03f req-18ba39c6-b1d3-48de-a9c0-09f88b16ee1d service nova] Releasing lock "refresh_cache-26a0b493-bb47-466e-95d5-945fc3849fa5" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:07:21 user nova-compute[75165]: DEBUG nova.network.neutron [req-9ff0b11f-2d6a-4408-9006-1bfad803f6a6 req-3fea2019-b20d-4382-92fc-ca0da704753c service nova] [instance: a7eeb145-1565-4812-818b-fefda5f2436d] Updated VIF entry in instance network info cache for port 7a43d085-a683-4c49-a7c8-13b8f35c943d. {{(pid=75165) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 00:07:21 user nova-compute[75165]: DEBUG nova.network.neutron [req-9ff0b11f-2d6a-4408-9006-1bfad803f6a6 req-3fea2019-b20d-4382-92fc-ca0da704753c service nova] [instance: a7eeb145-1565-4812-818b-fefda5f2436d] Updating instance_info_cache with network_info: [{"id": "7a43d085-a683-4c49-a7c8-13b8f35c943d", "address": "fa:16:3e:e8:63:41", "network": {"id": "bd1c84f9-bba9-4a23-8bf2-17e65022136a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1557945804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2911497df44047d9a9ee36a5652298bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a43d085-a6", "ovs_interfaceid": "7a43d085-a683-4c49-a7c8-13b8f35c943d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:07:21 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-9ff0b11f-2d6a-4408-9006-1bfad803f6a6 req-3fea2019-b20d-4382-92fc-ca0da704753c service nova] Releasing lock "refresh_cache-a7eeb145-1565-4812-818b-fefda5f2436d" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:07:21 user nova-compute[75165]: DEBUG nova.compute.manager [req-cf085ee1-917b-4873-a5b0-2922d1f056af req-f2808f29-3ea4-4b43-946c-04dba8e0f175 service nova] [instance: 6f9add59-cabe-4965-8fe3-524618550581] Received event network-changed-50bf388e-b8ff-4924-9633-7e97d083a361 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:07:21 user nova-compute[75165]: DEBUG nova.compute.manager [req-cf085ee1-917b-4873-a5b0-2922d1f056af req-f2808f29-3ea4-4b43-946c-04dba8e0f175 service nova] [instance: 6f9add59-cabe-4965-8fe3-524618550581] Refreshing instance network info cache due to event network-changed-50bf388e-b8ff-4924-9633-7e97d083a361. {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 00:07:21 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-cf085ee1-917b-4873-a5b0-2922d1f056af req-f2808f29-3ea4-4b43-946c-04dba8e0f175 service nova] Acquiring lock "refresh_cache-6f9add59-cabe-4965-8fe3-524618550581" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:07:21 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-cf085ee1-917b-4873-a5b0-2922d1f056af req-f2808f29-3ea4-4b43-946c-04dba8e0f175 service nova] Acquired lock "refresh_cache-6f9add59-cabe-4965-8fe3-524618550581" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:07:21 user nova-compute[75165]: DEBUG nova.network.neutron [req-cf085ee1-917b-4873-a5b0-2922d1f056af req-f2808f29-3ea4-4b43-946c-04dba8e0f175 service nova] [instance: 6f9add59-cabe-4965-8fe3-524618550581] Refreshing network info cache for port 50bf388e-b8ff-4924-9633-7e97d083a361 {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 00:07:21 user nova-compute[75165]: DEBUG nova.network.neutron [None req-a2cf0630-846e-4208-9c81-8b7d5d545f44 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] Updating instance_info_cache with network_info: [{"id": "874a1698-c52c-444c-bed5-52633dbaeead", "address": "fa:16:3e:75:45:79", "network": {"id": "30951418-d830-4042-9143-c736802150e9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-167387787-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0db2c49ee28f4b7b9fa990faddb9d3a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap874a1698-c5", "ovs_interfaceid": "874a1698-c52c-444c-bed5-52633dbaeead", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:07:21 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-a2cf0630-846e-4208-9c81-8b7d5d545f44 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Releasing lock "refresh_cache-3b153af2-c93b-47d2-ae8c-76cfd44e384c" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:07:21 user nova-compute[75165]: DEBUG nova.compute.manager [None req-a2cf0630-846e-4208-9c81-8b7d5d545f44 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] Instance network_info: |[{"id": "874a1698-c52c-444c-bed5-52633dbaeead", "address": "fa:16:3e:75:45:79", "network": {"id": "30951418-d830-4042-9143-c736802150e9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-167387787-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0db2c49ee28f4b7b9fa990faddb9d3a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap874a1698-c5", "ovs_interfaceid": "874a1698-c52c-444c-bed5-52633dbaeead", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75165) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 00:07:21 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-a2cf0630-846e-4208-9c81-8b7d5d545f44 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] Start _get_guest_xml network_info=[{"id": "874a1698-c52c-444c-bed5-52633dbaeead", "address": "fa:16:3e:75:45:79", "network": {"id": "30951418-d830-4042-9143-c736802150e9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-167387787-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0db2c49ee28f4b7b9fa990faddb9d3a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap874a1698-c5", "ovs_interfaceid": "874a1698-c52c-444c-bed5-52633dbaeead", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T00:03:24Z,direct_url=<?>,disk_format='qcow2',id=bff0d8a1-739e-4c4d-9efa-b73ba7b76d01,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e56bbf444fd34c348475c73673611447',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T00:03:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'size': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': 'bff0d8a1-739e-4c4d-9efa-b73ba7b76d01'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75165) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 00:07:21 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:21 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:22 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:22 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:22 user nova-compute[75165]: DEBUG nova.compute.manager [req-dbb8713c-f14a-4a04-a565-bb6168bd496b req-914a8383-cc38-4c68-a7b0-85d7783fd74b service nova] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] Received event network-changed-874a1698-c52c-444c-bed5-52633dbaeead {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:07:22 user nova-compute[75165]: DEBUG nova.compute.manager [req-dbb8713c-f14a-4a04-a565-bb6168bd496b req-914a8383-cc38-4c68-a7b0-85d7783fd74b service nova] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] Refreshing instance network info cache due to event network-changed-874a1698-c52c-444c-bed5-52633dbaeead. {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 00:07:22 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-dbb8713c-f14a-4a04-a565-bb6168bd496b req-914a8383-cc38-4c68-a7b0-85d7783fd74b service nova] Acquiring lock "refresh_cache-3b153af2-c93b-47d2-ae8c-76cfd44e384c" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:07:22 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-dbb8713c-f14a-4a04-a565-bb6168bd496b req-914a8383-cc38-4c68-a7b0-85d7783fd74b service nova] Acquired lock "refresh_cache-3b153af2-c93b-47d2-ae8c-76cfd44e384c" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:07:22 user nova-compute[75165]: DEBUG nova.network.neutron [req-dbb8713c-f14a-4a04-a565-bb6168bd496b req-914a8383-cc38-4c68-a7b0-85d7783fd74b service nova] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] Refreshing network info cache for port 874a1698-c52c-444c-bed5-52633dbaeead {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 00:07:22 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:22 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:22 user nova-compute[75165]: DEBUG nova.network.neutron [req-cf085ee1-917b-4873-a5b0-2922d1f056af req-f2808f29-3ea4-4b43-946c-04dba8e0f175 service nova] [instance: 6f9add59-cabe-4965-8fe3-524618550581] Updated VIF entry in instance network info cache for port 50bf388e-b8ff-4924-9633-7e97d083a361. {{(pid=75165) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 00:07:22 user nova-compute[75165]: DEBUG nova.network.neutron [req-cf085ee1-917b-4873-a5b0-2922d1f056af req-f2808f29-3ea4-4b43-946c-04dba8e0f175 service nova] [instance: 6f9add59-cabe-4965-8fe3-524618550581] Updating instance_info_cache with network_info: [{"id": "50bf388e-b8ff-4924-9633-7e97d083a361", "address": "fa:16:3e:16:28:b9", "network": {"id": "f54e2e9f-5c1e-44ca-bd4b-9cf0747b0f72", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-806146051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "920152101768459baa71010b380ea8f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50bf388e-b8", "ovs_interfaceid": "50bf388e-b8ff-4924-9633-7e97d083a361", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:07:22 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-cf085ee1-917b-4873-a5b0-2922d1f056af req-f2808f29-3ea4-4b43-946c-04dba8e0f175 service nova] Releasing lock "refresh_cache-6f9add59-cabe-4965-8fe3-524618550581" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:07:22 user nova-compute[75165]: DEBUG nova.network.neutron [req-dbb8713c-f14a-4a04-a565-bb6168bd496b req-914a8383-cc38-4c68-a7b0-85d7783fd74b service nova] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] Updated VIF entry in instance network info cache for port 874a1698-c52c-444c-bed5-52633dbaeead. {{(pid=75165) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 00:07:22 user nova-compute[75165]: DEBUG nova.network.neutron [req-dbb8713c-f14a-4a04-a565-bb6168bd496b req-914a8383-cc38-4c68-a7b0-85d7783fd74b service nova] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] Updating instance_info_cache with network_info: [{"id": "874a1698-c52c-444c-bed5-52633dbaeead", "address": "fa:16:3e:75:45:79", "network": {"id": "30951418-d830-4042-9143-c736802150e9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-167387787-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0db2c49ee28f4b7b9fa990faddb9d3a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap874a1698-c5", "ovs_interfaceid": "874a1698-c52c-444c-bed5-52633dbaeead", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:07:22 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-dbb8713c-f14a-4a04-a565-bb6168bd496b req-914a8383-cc38-4c68-a7b0-85d7783fd74b service nova] Releasing lock "refresh_cache-3b153af2-c93b-47d2-ae8c-76cfd44e384c" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:07:22 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:22 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:23 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:24 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:24 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:24 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:25 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:25 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:25 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:25 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:25 user nova-compute[75165]: DEBUG nova.compute.manager [None req-70ba4ee4-a84c-4587-a8b9-97fd07c2ee83 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] [instance: 9633e6bb-5e95-4994-92a2-9d8f85a946ff] Instance event wait completed in 0 seconds for  {{(pid=75165) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 00:07:25 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-70ba4ee4-a84c-4587-a8b9-97fd07c2ee83 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] [instance: 9633e6bb-5e95-4994-92a2-9d8f85a946ff] Guest created on hypervisor {{(pid=75165) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 00:07:26 user nova-compute[75165]: DEBUG nova.compute.manager [None req-656c1a74-11db-4031-95a6-53f325bfd24b tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: 84c6b624-648b-40e2-a37e-ff08609bad84] Instance event wait completed in 0 seconds for  {{(pid=75165) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 00:07:26 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-656c1a74-11db-4031-95a6-53f325bfd24b tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: 84c6b624-648b-40e2-a37e-ff08609bad84] Guest created on hypervisor {{(pid=75165) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 00:07:26 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:26 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: 84c6b624-648b-40e2-a37e-ff08609bad84] Instance spawned successfully.
Oct 26 00:07:26 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: 9633e6bb-5e95-4994-92a2-9d8f85a946ff] Instance spawned successfully.
Oct 26 00:07:26 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-656c1a74-11db-4031-95a6-53f325bfd24b tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: 84c6b624-648b-40e2-a37e-ff08609bad84] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 00:07:26 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-70ba4ee4-a84c-4587-a8b9-97fd07c2ee83 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] [instance: 9633e6bb-5e95-4994-92a2-9d8f85a946ff] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 00:07:26 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:26 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-fc7b823a-9e61-4fab-b9a0-528ca2ebc895 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:07:26 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-fc7b823a-9e61-4fab-b9a0-528ca2ebc895 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:07:26 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-a2cf0630-846e-4208-9c81-8b7d5d545f44 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:07:26 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-a2cf0630-846e-4208-9c81-8b7d5d545f44 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:07:26 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-fc7b823a-9e61-4fab-b9a0-528ca2ebc895 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75165) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 00:07:26 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-fc7b823a-9e61-4fab-b9a0-528ca2ebc895 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] CPU controller missing on host. {{(pid=75165) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 00:07:26 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:26 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-a2cf0630-846e-4208-9c81-8b7d5d545f44 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75165) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 00:07:26 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-a2cf0630-846e-4208-9c81-8b7d5d545f44 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] CPU controller missing on host. {{(pid=75165) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 00:07:26 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-fc7b823a-9e61-4fab-b9a0-528ca2ebc895 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75165) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 00:07:26 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-fc7b823a-9e61-4fab-b9a0-528ca2ebc895 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] CPU controller found on host. {{(pid=75165) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 00:07:26 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-fc7b823a-9e61-4fab-b9a0-528ca2ebc895 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75165) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 00:07:26 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-fc7b823a-9e61-4fab-b9a0-528ca2ebc895 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T00:03:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T00:03:24Z,direct_url=<?>,disk_format='qcow2',id=bff0d8a1-739e-4c4d-9efa-b73ba7b76d01,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e56bbf444fd34c348475c73673611447',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T00:03:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 00:07:26 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-fc7b823a-9e61-4fab-b9a0-528ca2ebc895 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Flavor limits 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 00:07:26 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-fc7b823a-9e61-4fab-b9a0-528ca2ebc895 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Image limits 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 00:07:26 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-fc7b823a-9e61-4fab-b9a0-528ca2ebc895 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Flavor pref 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 00:07:26 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-fc7b823a-9e61-4fab-b9a0-528ca2ebc895 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Image pref 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 00:07:26 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-fc7b823a-9e61-4fab-b9a0-528ca2ebc895 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 00:07:26 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-fc7b823a-9e61-4fab-b9a0-528ca2ebc895 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 00:07:26 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-fc7b823a-9e61-4fab-b9a0-528ca2ebc895 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75165) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 00:07:26 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-fc7b823a-9e61-4fab-b9a0-528ca2ebc895 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Got 1 possible topologies {{(pid=75165) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 00:07:26 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-fc7b823a-9e61-4fab-b9a0-528ca2ebc895 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 00:07:26 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-fc7b823a-9e61-4fab-b9a0-528ca2ebc895 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 00:07:26 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-fc7b823a-9e61-4fab-b9a0-528ca2ebc895 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:07:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-444593788',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-444593788',id=8,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPmLhpEGqHfWEDVp+Bb7MZzf/vrGL3uKzsxYYhytuWZRJqdFBvNBMiuBIa1UGxiNcAnbXigoebvMGsM57flYclfuZrrgJ5NcpyDMNxYszGc32IAq2Sr05Z1/NqZ2VCnXEw==',key_name='tempest-keypair-548689340',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='920152101768459baa71010b380ea8f1',ramdisk_id='',reservation_id='r-i1asnolo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-6636270',owner_user_name='tempest-AttachVolumeShelveTestJSON-6636270-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T00:07:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a40cb1b08014444686bd0adad03f6c68',uuid=6f9add59-cabe-4965-8fe3-524618550581,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "50bf388e-b8ff-4924-9633-7e97d083a361", "address": "fa:16:3e:16:28:b9", "network": {"id": "f54e2e9f-5c1e-44ca-bd4b-9cf0747b0f72", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-806146051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "920152101768459baa71010b380ea8f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50bf388e-b8", "ovs_interfaceid": "50bf388e-b8ff-4924-9633-7e97d083a361", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75165) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 00:07:26 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-fc7b823a-9e61-4fab-b9a0-528ca2ebc895 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Converting VIF {"id": "50bf388e-b8ff-4924-9633-7e97d083a361", "address": "fa:16:3e:16:28:b9", "network": {"id": "f54e2e9f-5c1e-44ca-bd4b-9cf0747b0f72", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-806146051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "920152101768459baa71010b380ea8f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50bf388e-b8", "ovs_interfaceid": "50bf388e-b8ff-4924-9633-7e97d083a361", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:07:26 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-fc7b823a-9e61-4fab-b9a0-528ca2ebc895 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:28:b9,bridge_name='br-int',has_traffic_filtering=True,id=50bf388e-b8ff-4924-9633-7e97d083a361,network=Network(f54e2e9f-5c1e-44ca-bd4b-9cf0747b0f72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50bf388e-b8') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:07:26 user nova-compute[75165]: DEBUG nova.objects.instance [None req-fc7b823a-9e61-4fab-b9a0-528ca2ebc895 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Lazy-loading 'pci_devices' on Instance uuid 6f9add59-cabe-4965-8fe3-524618550581 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:07:26 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:26 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-656c1a74-11db-4031-95a6-53f325bfd24b tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: 84c6b624-648b-40e2-a37e-ff08609bad84] Found default for hw_cdrom_bus of ide {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:07:26 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-656c1a74-11db-4031-95a6-53f325bfd24b tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: 84c6b624-648b-40e2-a37e-ff08609bad84] Found default for hw_disk_bus of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:07:26 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-656c1a74-11db-4031-95a6-53f325bfd24b tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: 84c6b624-648b-40e2-a37e-ff08609bad84] Found default for hw_input_bus of None {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:07:26 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-656c1a74-11db-4031-95a6-53f325bfd24b tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: 84c6b624-648b-40e2-a37e-ff08609bad84] Found default for hw_pointer_model of None {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:07:26 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-656c1a74-11db-4031-95a6-53f325bfd24b tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: 84c6b624-648b-40e2-a37e-ff08609bad84] Found default for hw_video_model of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:07:26 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-656c1a74-11db-4031-95a6-53f325bfd24b tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: 84c6b624-648b-40e2-a37e-ff08609bad84] Found default for hw_vif_model of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:07:26 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-fc7b823a-9e61-4fab-b9a0-528ca2ebc895 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] [instance: 6f9add59-cabe-4965-8fe3-524618550581] End _get_guest_xml xml=<domain type="kvm">
Oct 26 00:07:26 user nova-compute[75165]:   <uuid>6f9add59-cabe-4965-8fe3-524618550581</uuid>
Oct 26 00:07:26 user nova-compute[75165]:   <name>instance-00000008</name>
Oct 26 00:07:26 user nova-compute[75165]:   <memory>524288</memory>
Oct 26 00:07:26 user nova-compute[75165]:   <vcpu>1</vcpu>
Oct 26 00:07:26 user nova-compute[75165]:   <metadata>
Oct 26 00:07:26 user nova-compute[75165]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 00:07:26 user nova-compute[75165]:       <nova:package version="0.0.0"/>
Oct 26 00:07:26 user nova-compute[75165]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-444593788</nova:name>
Oct 26 00:07:26 user nova-compute[75165]:       <nova:creationTime>2023-10-26 00:07:26</nova:creationTime>
Oct 26 00:07:26 user nova-compute[75165]:       <nova:flavor name="m1.tiny">
Oct 26 00:07:26 user nova-compute[75165]:         <nova:memory>512</nova:memory>
Oct 26 00:07:26 user nova-compute[75165]:         <nova:disk>1</nova:disk>
Oct 26 00:07:26 user nova-compute[75165]:         <nova:swap>0</nova:swap>
Oct 26 00:07:26 user nova-compute[75165]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 00:07:26 user nova-compute[75165]:         <nova:vcpus>1</nova:vcpus>
Oct 26 00:07:26 user nova-compute[75165]:       </nova:flavor>
Oct 26 00:07:26 user nova-compute[75165]:       <nova:owner>
Oct 26 00:07:26 user nova-compute[75165]:         <nova:user uuid="a40cb1b08014444686bd0adad03f6c68">tempest-AttachVolumeShelveTestJSON-6636270-project-member</nova:user>
Oct 26 00:07:26 user nova-compute[75165]:         <nova:project uuid="920152101768459baa71010b380ea8f1">tempest-AttachVolumeShelveTestJSON-6636270</nova:project>
Oct 26 00:07:26 user nova-compute[75165]:       </nova:owner>
Oct 26 00:07:26 user nova-compute[75165]:       <nova:root type="image" uuid="bff0d8a1-739e-4c4d-9efa-b73ba7b76d01"/>
Oct 26 00:07:26 user nova-compute[75165]:       <nova:ports>
Oct 26 00:07:26 user nova-compute[75165]:         <nova:port uuid="50bf388e-b8ff-4924-9633-7e97d083a361">
Oct 26 00:07:26 user nova-compute[75165]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 26 00:07:26 user nova-compute[75165]:         </nova:port>
Oct 26 00:07:26 user nova-compute[75165]:       </nova:ports>
Oct 26 00:07:26 user nova-compute[75165]:     </nova:instance>
Oct 26 00:07:26 user nova-compute[75165]:   </metadata>
Oct 26 00:07:26 user nova-compute[75165]:   <sysinfo type="smbios">
Oct 26 00:07:26 user nova-compute[75165]:     <system>
Oct 26 00:07:26 user nova-compute[75165]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 00:07:26 user nova-compute[75165]:       <entry name="product">OpenStack Nova</entry>
Oct 26 00:07:26 user nova-compute[75165]:       <entry name="version">0.0.0</entry>
Oct 26 00:07:26 user nova-compute[75165]:       <entry name="serial">6f9add59-cabe-4965-8fe3-524618550581</entry>
Oct 26 00:07:26 user nova-compute[75165]:       <entry name="uuid">6f9add59-cabe-4965-8fe3-524618550581</entry>
Oct 26 00:07:26 user nova-compute[75165]:       <entry name="family">Virtual Machine</entry>
Oct 26 00:07:26 user nova-compute[75165]:     </system>
Oct 26 00:07:26 user nova-compute[75165]:   </sysinfo>
Oct 26 00:07:26 user nova-compute[75165]:   <os>
Oct 26 00:07:26 user nova-compute[75165]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 00:07:26 user nova-compute[75165]:     <boot dev="hd"/>
Oct 26 00:07:26 user nova-compute[75165]:     <smbios mode="sysinfo"/>
Oct 26 00:07:26 user nova-compute[75165]:   </os>
Oct 26 00:07:26 user nova-compute[75165]:   <features>
Oct 26 00:07:26 user nova-compute[75165]:     <acpi/>
Oct 26 00:07:26 user nova-compute[75165]:     <apic/>
Oct 26 00:07:26 user nova-compute[75165]:     <vmcoreinfo/>
Oct 26 00:07:26 user nova-compute[75165]:   </features>
Oct 26 00:07:26 user nova-compute[75165]:   <clock offset="utc">
Oct 26 00:07:26 user nova-compute[75165]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 00:07:26 user nova-compute[75165]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 00:07:26 user nova-compute[75165]:     <timer name="hpet" present="no"/>
Oct 26 00:07:26 user nova-compute[75165]:   </clock>
Oct 26 00:07:26 user nova-compute[75165]:   <cpu mode="custom" match="exact">
Oct 26 00:07:26 user nova-compute[75165]:     <model>Nehalem</model>
Oct 26 00:07:26 user nova-compute[75165]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 00:07:26 user nova-compute[75165]:   </cpu>
Oct 26 00:07:26 user nova-compute[75165]:   <devices>
Oct 26 00:07:26 user nova-compute[75165]:     <disk type="file" device="disk">
Oct 26 00:07:26 user nova-compute[75165]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 00:07:26 user nova-compute[75165]:       <source file="/opt/stack/data/nova/instances/6f9add59-cabe-4965-8fe3-524618550581/disk"/>
Oct 26 00:07:26 user nova-compute[75165]:       <target dev="vda" bus="virtio"/>
Oct 26 00:07:26 user nova-compute[75165]:     </disk>
Oct 26 00:07:26 user nova-compute[75165]:     <interface type="ethernet">
Oct 26 00:07:26 user nova-compute[75165]:       <mac address="fa:16:3e:16:28:b9"/>
Oct 26 00:07:26 user nova-compute[75165]:       <model type="virtio"/>
Oct 26 00:07:26 user nova-compute[75165]:       <mtu size="1442"/>
Oct 26 00:07:26 user nova-compute[75165]:       <target dev="tap50bf388e-b8"/>
Oct 26 00:07:26 user nova-compute[75165]:     </interface>
Oct 26 00:07:26 user nova-compute[75165]:     <serial type="pty">
Oct 26 00:07:26 user nova-compute[75165]:       <log file="/opt/stack/data/nova/instances/6f9add59-cabe-4965-8fe3-524618550581/console.log" append="off"/>
Oct 26 00:07:26 user nova-compute[75165]:     </serial>
Oct 26 00:07:26 user nova-compute[75165]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 00:07:26 user nova-compute[75165]:     <video>
Oct 26 00:07:26 user nova-compute[75165]:       <model type="virtio"/>
Oct 26 00:07:26 user nova-compute[75165]:     </video>
Oct 26 00:07:26 user nova-compute[75165]:     <rng model="virtio">
Oct 26 00:07:26 user nova-compute[75165]:       <backend model="random">/dev/urandom</backend>
Oct 26 00:07:26 user nova-compute[75165]:     </rng>
Oct 26 00:07:26 user nova-compute[75165]:     <controller type="usb" index="0" model="none"/>
Oct 26 00:07:26 user nova-compute[75165]:     <memballoon model="virtio">
Oct 26 00:07:26 user nova-compute[75165]:       <stats period="10"/>
Oct 26 00:07:26 user nova-compute[75165]:     </memballoon>
Oct 26 00:07:26 user nova-compute[75165]:   </devices>
Oct 26 00:07:26 user nova-compute[75165]: </domain>
Oct 26 00:07:26 user nova-compute[75165]:  {{(pid=75165) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 00:07:26 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-fc7b823a-9e61-4fab-b9a0-528ca2ebc895 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:07:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-444593788',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-444593788',id=8,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPmLhpEGqHfWEDVp+Bb7MZzf/vrGL3uKzsxYYhytuWZRJqdFBvNBMiuBIa1UGxiNcAnbXigoebvMGsM57flYclfuZrrgJ5NcpyDMNxYszGc32IAq2Sr05Z1/NqZ2VCnXEw==',key_name='tempest-keypair-548689340',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='920152101768459baa71010b380ea8f1',ramdisk_id='',reservation_id='r-i1asnolo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-6636270',owner_user_name='tempest-AttachVolumeShelveTestJSON-6636270-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T00:07:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a40cb1b08014444686bd0adad03f6c68',uuid=6f9add59-cabe-4965-8fe3-524618550581,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "50bf388e-b8ff-4924-9633-7e97d083a361", "address": "fa:16:3e:16:28:b9", "network": {"id": "f54e2e9f-5c1e-44ca-bd4b-9cf0747b0f72", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-806146051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "920152101768459baa71010b380ea8f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50bf388e-b8", "ovs_interfaceid": "50bf388e-b8ff-4924-9633-7e97d083a361", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 00:07:26 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-fc7b823a-9e61-4fab-b9a0-528ca2ebc895 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Converting VIF {"id": "50bf388e-b8ff-4924-9633-7e97d083a361", "address": "fa:16:3e:16:28:b9", "network": {"id": "f54e2e9f-5c1e-44ca-bd4b-9cf0747b0f72", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-806146051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "920152101768459baa71010b380ea8f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50bf388e-b8", "ovs_interfaceid": "50bf388e-b8ff-4924-9633-7e97d083a361", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:07:26 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-fc7b823a-9e61-4fab-b9a0-528ca2ebc895 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:28:b9,bridge_name='br-int',has_traffic_filtering=True,id=50bf388e-b8ff-4924-9633-7e97d083a361,network=Network(f54e2e9f-5c1e-44ca-bd4b-9cf0747b0f72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50bf388e-b8') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:07:26 user nova-compute[75165]: DEBUG os_vif [None req-fc7b823a-9e61-4fab-b9a0-528ca2ebc895 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:28:b9,bridge_name='br-int',has_traffic_filtering=True,id=50bf388e-b8ff-4924-9633-7e97d083a361,network=Network(f54e2e9f-5c1e-44ca-bd4b-9cf0747b0f72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50bf388e-b8') {{(pid=75165) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 00:07:26 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-a2cf0630-846e-4208-9c81-8b7d5d545f44 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75165) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 00:07:26 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-a2cf0630-846e-4208-9c81-8b7d5d545f44 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] CPU controller found on host. {{(pid=75165) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 00:07:26 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-a2cf0630-846e-4208-9c81-8b7d5d545f44 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75165) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 00:07:26 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-a2cf0630-846e-4208-9c81-8b7d5d545f44 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T00:03:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T00:03:24Z,direct_url=<?>,disk_format='qcow2',id=bff0d8a1-739e-4c4d-9efa-b73ba7b76d01,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e56bbf444fd34c348475c73673611447',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T00:03:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 00:07:26 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-a2cf0630-846e-4208-9c81-8b7d5d545f44 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Flavor limits 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 00:07:26 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-a2cf0630-846e-4208-9c81-8b7d5d545f44 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Image limits 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 00:07:26 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-a2cf0630-846e-4208-9c81-8b7d5d545f44 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Flavor pref 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 00:07:26 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-a2cf0630-846e-4208-9c81-8b7d5d545f44 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Image pref 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 00:07:26 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-a2cf0630-846e-4208-9c81-8b7d5d545f44 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 00:07:26 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-a2cf0630-846e-4208-9c81-8b7d5d545f44 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 00:07:26 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-a2cf0630-846e-4208-9c81-8b7d5d545f44 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75165) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 00:07:26 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-a2cf0630-846e-4208-9c81-8b7d5d545f44 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Got 1 possible topologies {{(pid=75165) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 00:07:26 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-a2cf0630-846e-4208-9c81-8b7d5d545f44 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 00:07:26 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-a2cf0630-846e-4208-9c81-8b7d5d545f44 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 00:07:26 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-a2cf0630-846e-4208-9c81-8b7d5d545f44 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:07:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1649801525',display_name='tempest-ServerActionsTestOtherB-server-1649801525',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1649801525',id=7,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOvLHGJ3GKBbD7yL0+CRyOJiq2ETP4pGNCe7wwUyptp7nQivcPunaHj7Jl8TaU2mAtfcWQAgpHGkK+GRkPrduKn69eOts5d8qkM1kDwYiMG7whEGtVeGR66PH/dfoMGjVA==',key_name='tempest-keypair-513358976',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0db2c49ee28f4b7b9fa990faddb9d3a9',ramdisk_id='',reservation_id='r-tna5v2cw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-238342146',owner_user_name='tempest-ServerActionsTestOtherB-238342146-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T00:07:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43f095bccf684d5a84b874439f2c58e0',uuid=3b153af2-c93b-47d2-ae8c-76cfd44e384c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "874a1698-c52c-444c-bed5-52633dbaeead", "address": "fa:16:3e:75:45:79", "network": {"id": "30951418-d830-4042-9143-c736802150e9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-167387787-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0db2c49ee28f4b7b9fa990faddb9d3a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap874a1698-c5", "ovs_interfaceid": "874a1698-c52c-444c-bed5-52633dbaeead", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75165) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 00:07:26 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-a2cf0630-846e-4208-9c81-8b7d5d545f44 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Converting VIF {"id": "874a1698-c52c-444c-bed5-52633dbaeead", "address": "fa:16:3e:75:45:79", "network": {"id": "30951418-d830-4042-9143-c736802150e9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-167387787-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0db2c49ee28f4b7b9fa990faddb9d3a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap874a1698-c5", "ovs_interfaceid": "874a1698-c52c-444c-bed5-52633dbaeead", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:07:26 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-a2cf0630-846e-4208-9c81-8b7d5d545f44 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:45:79,bridge_name='br-int',has_traffic_filtering=True,id=874a1698-c52c-444c-bed5-52633dbaeead,network=Network(30951418-d830-4042-9143-c736802150e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap874a1698-c5') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:07:26 user nova-compute[75165]: DEBUG nova.objects.instance [None req-a2cf0630-846e-4208-9c81-8b7d5d545f44 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Lazy-loading 'pci_devices' on Instance uuid 3b153af2-c93b-47d2-ae8c-76cfd44e384c {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:07:26 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:26 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:07:26 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 00:07:26 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:26 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e2057e2d-c3da-512f-99d8-f15fefab5212', '_type': 'linux-noop'}}, row=False) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:07:26 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-8761496d-0cb4-491c-a886-275d93d9f08d tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] Acquiring lock "f465963f-1d0f-4ca3-a8b8-681566b7d40a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:07:26 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-8761496d-0cb4-491c-a886-275d93d9f08d tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] Lock "f465963f-1d0f-4ca3-a8b8-681566b7d40a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:07:26 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-a2cf0630-846e-4208-9c81-8b7d5d545f44 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] End _get_guest_xml xml=<domain type="kvm">
Oct 26 00:07:26 user nova-compute[75165]:   <uuid>3b153af2-c93b-47d2-ae8c-76cfd44e384c</uuid>
Oct 26 00:07:26 user nova-compute[75165]:   <name>instance-00000007</name>
Oct 26 00:07:26 user nova-compute[75165]:   <memory>524288</memory>
Oct 26 00:07:26 user nova-compute[75165]:   <vcpu>1</vcpu>
Oct 26 00:07:26 user nova-compute[75165]:   <metadata>
Oct 26 00:07:26 user nova-compute[75165]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 00:07:26 user nova-compute[75165]:       <nova:package version="0.0.0"/>
Oct 26 00:07:26 user nova-compute[75165]:       <nova:name>tempest-ServerActionsTestOtherB-server-1649801525</nova:name>
Oct 26 00:07:26 user nova-compute[75165]:       <nova:creationTime>2023-10-26 00:07:26</nova:creationTime>
Oct 26 00:07:26 user nova-compute[75165]:       <nova:flavor name="m1.tiny">
Oct 26 00:07:26 user nova-compute[75165]:         <nova:memory>512</nova:memory>
Oct 26 00:07:26 user nova-compute[75165]:         <nova:disk>1</nova:disk>
Oct 26 00:07:26 user nova-compute[75165]:         <nova:swap>0</nova:swap>
Oct 26 00:07:26 user nova-compute[75165]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 00:07:26 user nova-compute[75165]:         <nova:vcpus>1</nova:vcpus>
Oct 26 00:07:26 user nova-compute[75165]:       </nova:flavor>
Oct 26 00:07:26 user nova-compute[75165]:       <nova:owner>
Oct 26 00:07:26 user nova-compute[75165]:         <nova:user uuid="43f095bccf684d5a84b874439f2c58e0">tempest-ServerActionsTestOtherB-238342146-project-member</nova:user>
Oct 26 00:07:26 user nova-compute[75165]:         <nova:project uuid="0db2c49ee28f4b7b9fa990faddb9d3a9">tempest-ServerActionsTestOtherB-238342146</nova:project>
Oct 26 00:07:26 user nova-compute[75165]:       </nova:owner>
Oct 26 00:07:26 user nova-compute[75165]:       <nova:root type="image" uuid="bff0d8a1-739e-4c4d-9efa-b73ba7b76d01"/>
Oct 26 00:07:26 user nova-compute[75165]:       <nova:ports>
Oct 26 00:07:26 user nova-compute[75165]:         <nova:port uuid="874a1698-c52c-444c-bed5-52633dbaeead">
Oct 26 00:07:26 user nova-compute[75165]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 26 00:07:26 user nova-compute[75165]:         </nova:port>
Oct 26 00:07:26 user nova-compute[75165]:       </nova:ports>
Oct 26 00:07:26 user nova-compute[75165]:     </nova:instance>
Oct 26 00:07:26 user nova-compute[75165]:   </metadata>
Oct 26 00:07:26 user nova-compute[75165]:   <sysinfo type="smbios">
Oct 26 00:07:26 user nova-compute[75165]:     <system>
Oct 26 00:07:26 user nova-compute[75165]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 00:07:26 user nova-compute[75165]:       <entry name="product">OpenStack Nova</entry>
Oct 26 00:07:26 user nova-compute[75165]:       <entry name="version">0.0.0</entry>
Oct 26 00:07:26 user nova-compute[75165]:       <entry name="serial">3b153af2-c93b-47d2-ae8c-76cfd44e384c</entry>
Oct 26 00:07:26 user nova-compute[75165]:       <entry name="uuid">3b153af2-c93b-47d2-ae8c-76cfd44e384c</entry>
Oct 26 00:07:26 user nova-compute[75165]:       <entry name="family">Virtual Machine</entry>
Oct 26 00:07:26 user nova-compute[75165]:     </system>
Oct 26 00:07:26 user nova-compute[75165]:   </sysinfo>
Oct 26 00:07:26 user nova-compute[75165]:   <os>
Oct 26 00:07:26 user nova-compute[75165]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 00:07:26 user nova-compute[75165]:     <boot dev="hd"/>
Oct 26 00:07:26 user nova-compute[75165]:     <smbios mode="sysinfo"/>
Oct 26 00:07:26 user nova-compute[75165]:   </os>
Oct 26 00:07:26 user nova-compute[75165]:   <features>
Oct 26 00:07:26 user nova-compute[75165]:     <acpi/>
Oct 26 00:07:26 user nova-compute[75165]:     <apic/>
Oct 26 00:07:26 user nova-compute[75165]:     <vmcoreinfo/>
Oct 26 00:07:26 user nova-compute[75165]:   </features>
Oct 26 00:07:26 user nova-compute[75165]:   <clock offset="utc">
Oct 26 00:07:26 user nova-compute[75165]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 00:07:26 user nova-compute[75165]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 00:07:26 user nova-compute[75165]:     <timer name="hpet" present="no"/>
Oct 26 00:07:26 user nova-compute[75165]:   </clock>
Oct 26 00:07:26 user nova-compute[75165]:   <cpu mode="custom" match="exact">
Oct 26 00:07:26 user nova-compute[75165]:     <model>Nehalem</model>
Oct 26 00:07:26 user nova-compute[75165]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 00:07:26 user nova-compute[75165]:   </cpu>
Oct 26 00:07:26 user nova-compute[75165]:   <devices>
Oct 26 00:07:26 user nova-compute[75165]:     <disk type="file" device="disk">
Oct 26 00:07:26 user nova-compute[75165]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 00:07:26 user nova-compute[75165]:       <source file="/opt/stack/data/nova/instances/3b153af2-c93b-47d2-ae8c-76cfd44e384c/disk"/>
Oct 26 00:07:26 user nova-compute[75165]:       <target dev="vda" bus="virtio"/>
Oct 26 00:07:26 user nova-compute[75165]:     </disk>
Oct 26 00:07:26 user nova-compute[75165]:     <interface type="ethernet">
Oct 26 00:07:26 user nova-compute[75165]:       <mac address="fa:16:3e:75:45:79"/>
Oct 26 00:07:26 user nova-compute[75165]:       <model type="virtio"/>
Oct 26 00:07:26 user nova-compute[75165]:       <mtu size="1442"/>
Oct 26 00:07:26 user nova-compute[75165]:       <target dev="tap874a1698-c5"/>
Oct 26 00:07:26 user nova-compute[75165]:     </interface>
Oct 26 00:07:26 user nova-compute[75165]:     <serial type="pty">
Oct 26 00:07:26 user nova-compute[75165]:       <log file="/opt/stack/data/nova/instances/3b153af2-c93b-47d2-ae8c-76cfd44e384c/console.log" append="off"/>
Oct 26 00:07:26 user nova-compute[75165]:     </serial>
Oct 26 00:07:26 user nova-compute[75165]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 00:07:26 user nova-compute[75165]:     <video>
Oct 26 00:07:26 user nova-compute[75165]:       <model type="virtio"/>
Oct 26 00:07:26 user nova-compute[75165]:     </video>
Oct 26 00:07:26 user nova-compute[75165]:     <rng model="virtio">
Oct 26 00:07:26 user nova-compute[75165]:       <backend model="random">/dev/urandom</backend>
Oct 26 00:07:26 user nova-compute[75165]:     </rng>
Oct 26 00:07:26 user nova-compute[75165]:     <controller type="usb" index="0" model="none"/>
Oct 26 00:07:26 user nova-compute[75165]:     <memballoon model="virtio">
Oct 26 00:07:26 user nova-compute[75165]:       <stats period="10"/>
Oct 26 00:07:26 user nova-compute[75165]:     </memballoon>
Oct 26 00:07:26 user nova-compute[75165]:   </devices>
Oct 26 00:07:26 user nova-compute[75165]: </domain>
Oct 26 00:07:26 user nova-compute[75165]:  {{(pid=75165) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 00:07:26 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-a2cf0630-846e-4208-9c81-8b7d5d545f44 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:07:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1649801525',display_name='tempest-ServerActionsTestOtherB-server-1649801525',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1649801525',id=7,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOvLHGJ3GKBbD7yL0+CRyOJiq2ETP4pGNCe7wwUyptp7nQivcPunaHj7Jl8TaU2mAtfcWQAgpHGkK+GRkPrduKn69eOts5d8qkM1kDwYiMG7whEGtVeGR66PH/dfoMGjVA==',key_name='tempest-keypair-513358976',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0db2c49ee28f4b7b9fa990faddb9d3a9',ramdisk_id='',reservation_id='r-tna5v2cw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-238342146',owner_user_name='tempest-ServerActionsTestOtherB-238342146-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T00:07:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43f095bccf684d5a84b874439f2c58e0',uuid=3b153af2-c93b-47d2-ae8c-76cfd44e384c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "874a1698-c52c-444c-bed5-52633dbaeead", "address": "fa:16:3e:75:45:79", "network": {"id": "30951418-d830-4042-9143-c736802150e9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-167387787-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0db2c49ee28f4b7b9fa990faddb9d3a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap874a1698-c5", "ovs_interfaceid": "874a1698-c52c-444c-bed5-52633dbaeead", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 00:07:26 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-a2cf0630-846e-4208-9c81-8b7d5d545f44 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Converting VIF {"id": "874a1698-c52c-444c-bed5-52633dbaeead", "address": "fa:16:3e:75:45:79", "network": {"id": "30951418-d830-4042-9143-c736802150e9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-167387787-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0db2c49ee28f4b7b9fa990faddb9d3a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap874a1698-c5", "ovs_interfaceid": "874a1698-c52c-444c-bed5-52633dbaeead", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:07:26 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-a2cf0630-846e-4208-9c81-8b7d5d545f44 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:45:79,bridge_name='br-int',has_traffic_filtering=True,id=874a1698-c52c-444c-bed5-52633dbaeead,network=Network(30951418-d830-4042-9143-c736802150e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap874a1698-c5') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:07:26 user nova-compute[75165]: DEBUG os_vif [None req-a2cf0630-846e-4208-9c81-8b7d5d545f44 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:45:79,bridge_name='br-int',has_traffic_filtering=True,id=874a1698-c52c-444c-bed5-52633dbaeead,network=Network(30951418-d830-4042-9143-c736802150e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap874a1698-c5') {{(pid=75165) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 00:07:26 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:26 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:07:26 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:26 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:07:26 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 00:07:26 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-70ba4ee4-a84c-4587-a8b9-97fd07c2ee83 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] [instance: 9633e6bb-5e95-4994-92a2-9d8f85a946ff] Found default for hw_cdrom_bus of ide {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:07:26 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-70ba4ee4-a84c-4587-a8b9-97fd07c2ee83 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] [instance: 9633e6bb-5e95-4994-92a2-9d8f85a946ff] Found default for hw_disk_bus of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:07:26 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-70ba4ee4-a84c-4587-a8b9-97fd07c2ee83 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] [instance: 9633e6bb-5e95-4994-92a2-9d8f85a946ff] Found default for hw_input_bus of None {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:07:26 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-70ba4ee4-a84c-4587-a8b9-97fd07c2ee83 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] [instance: 9633e6bb-5e95-4994-92a2-9d8f85a946ff] Found default for hw_pointer_model of None {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:07:26 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-70ba4ee4-a84c-4587-a8b9-97fd07c2ee83 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] [instance: 9633e6bb-5e95-4994-92a2-9d8f85a946ff] Found default for hw_video_model of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:07:26 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-70ba4ee4-a84c-4587-a8b9-97fd07c2ee83 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] [instance: 9633e6bb-5e95-4994-92a2-9d8f85a946ff] Found default for hw_vif_model of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:07:26 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:26 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4fd37b35-3e3c-57c4-8962-2fc6df59ac1d', '_type': 'linux-noop'}}, row=False) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:07:26 user nova-compute[75165]: INFO nova.compute.manager [None req-656c1a74-11db-4031-95a6-53f325bfd24b tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: 84c6b624-648b-40e2-a37e-ff08609bad84] Took 19.38 seconds to spawn the instance on the hypervisor.
Oct 26 00:07:26 user nova-compute[75165]: DEBUG nova.compute.manager [None req-656c1a74-11db-4031-95a6-53f325bfd24b tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: 84c6b624-648b-40e2-a37e-ff08609bad84] Checking state {{(pid=75165) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 00:07:26 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:26 user nova-compute[75165]: DEBUG nova.compute.manager [None req-8761496d-0cb4-491c-a886-275d93d9f08d tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] [instance: f465963f-1d0f-4ca3-a8b8-681566b7d40a] Starting instance... {{(pid=75165) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 00:07:26 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-26a64c2e-3ffa-417d-920d-0886e701b786 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] No BDM found with device name vda, not building metadata. {{(pid=75165) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 00:07:26 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-26a64c2e-3ffa-417d-920d-0886e701b786 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] No VIF found with MAC fa:16:3e:d3:eb:fb, not building metadata {{(pid=75165) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 00:07:26 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:07:26 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:26 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap50bf388e-b8, may_exist=True, interface_attrs={}) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:07:26 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap50bf388e-b8, col_values=(('qos', UUID('9ba866e0-f436-4ce7-911e-eb09e84375df')),), if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:07:26 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap50bf388e-b8, col_values=(('external_ids', {'iface-id': '50bf388e-b8ff-4924-9633-7e97d083a361', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:16:28:b9', 'vm-uuid': '6f9add59-cabe-4965-8fe3-524618550581'}),), if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:07:26 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:26 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:07:26 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:26 user nova-compute[75165]: INFO os_vif [None req-fc7b823a-9e61-4fab-b9a0-528ca2ebc895 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:28:b9,bridge_name='br-int',has_traffic_filtering=True,id=50bf388e-b8ff-4924-9633-7e97d083a361,network=Network(f54e2e9f-5c1e-44ca-bd4b-9cf0747b0f72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50bf388e-b8')
Oct 26 00:07:26 user nova-compute[75165]: INFO nova.compute.manager [None req-70ba4ee4-a84c-4587-a8b9-97fd07c2ee83 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] [instance: 9633e6bb-5e95-4994-92a2-9d8f85a946ff] Took 21.35 seconds to spawn the instance on the hypervisor.
Oct 26 00:07:26 user nova-compute[75165]: DEBUG nova.compute.manager [None req-70ba4ee4-a84c-4587-a8b9-97fd07c2ee83 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] [instance: 9633e6bb-5e95-4994-92a2-9d8f85a946ff] Checking state {{(pid=75165) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 00:07:26 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:26 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap874a1698-c5, may_exist=True, interface_attrs={}) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:07:26 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap874a1698-c5, col_values=(('qos', UUID('2437f093-cbb3-4af7-8d0b-a827e2150978')),), if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:07:26 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap874a1698-c5, col_values=(('external_ids', {'iface-id': '874a1698-c52c-444c-bed5-52633dbaeead', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:75:45:79', 'vm-uuid': '3b153af2-c93b-47d2-ae8c-76cfd44e384c'}),), if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:07:26 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:26 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:07:26 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:26 user nova-compute[75165]: INFO os_vif [None req-a2cf0630-846e-4208-9c81-8b7d5d545f44 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:45:79,bridge_name='br-int',has_traffic_filtering=True,id=874a1698-c52c-444c-bed5-52633dbaeead,network=Network(30951418-d830-4042-9143-c736802150e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap874a1698-c5')
Oct 26 00:07:26 user nova-compute[75165]: DEBUG nova.compute.manager [None req-f14fa41a-0db2-4572-b30a-8c5b8ceb0780 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] [instance: 18dcf77e-fac2-4b38-ad1c-1f52ce14704a] Instance event wait completed in 0 seconds for  {{(pid=75165) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 00:07:26 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-f14fa41a-0db2-4572-b30a-8c5b8ceb0780 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] [instance: 18dcf77e-fac2-4b38-ad1c-1f52ce14704a] Guest created on hypervisor {{(pid=75165) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 00:07:26 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-fc7b823a-9e61-4fab-b9a0-528ca2ebc895 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] No BDM found with device name vda, not building metadata. {{(pid=75165) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 00:07:26 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-fc7b823a-9e61-4fab-b9a0-528ca2ebc895 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] No VIF found with MAC fa:16:3e:16:28:b9, not building metadata {{(pid=75165) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 00:07:26 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: 18dcf77e-fac2-4b38-ad1c-1f52ce14704a] Instance spawned successfully.
Oct 26 00:07:26 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-f14fa41a-0db2-4572-b30a-8c5b8ceb0780 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] [instance: 18dcf77e-fac2-4b38-ad1c-1f52ce14704a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 00:07:26 user nova-compute[75165]: INFO nova.compute.manager [None req-656c1a74-11db-4031-95a6-53f325bfd24b tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: 84c6b624-648b-40e2-a37e-ff08609bad84] Took 20.60 seconds to build instance.
Oct 26 00:07:26 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-8761496d-0cb4-491c-a886-275d93d9f08d tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:07:26 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-8761496d-0cb4-491c-a886-275d93d9f08d tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:07:26 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-f14fa41a-0db2-4572-b30a-8c5b8ceb0780 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] [instance: 18dcf77e-fac2-4b38-ad1c-1f52ce14704a] Found default for hw_cdrom_bus of ide {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:07:26 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-f14fa41a-0db2-4572-b30a-8c5b8ceb0780 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] [instance: 18dcf77e-fac2-4b38-ad1c-1f52ce14704a] Found default for hw_disk_bus of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:07:26 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-f14fa41a-0db2-4572-b30a-8c5b8ceb0780 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] [instance: 18dcf77e-fac2-4b38-ad1c-1f52ce14704a] Found default for hw_input_bus of None {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:07:26 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-f14fa41a-0db2-4572-b30a-8c5b8ceb0780 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] [instance: 18dcf77e-fac2-4b38-ad1c-1f52ce14704a] Found default for hw_pointer_model of None {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:07:26 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-f14fa41a-0db2-4572-b30a-8c5b8ceb0780 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] [instance: 18dcf77e-fac2-4b38-ad1c-1f52ce14704a] Found default for hw_video_model of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:07:26 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-f14fa41a-0db2-4572-b30a-8c5b8ceb0780 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] [instance: 18dcf77e-fac2-4b38-ad1c-1f52ce14704a] Found default for hw_vif_model of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:07:26 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-656c1a74-11db-4031-95a6-53f325bfd24b tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Lock "84c6b624-648b-40e2-a37e-ff08609bad84" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.801s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:07:26 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-8761496d-0cb4-491c-a886-275d93d9f08d tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75165) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 00:07:26 user nova-compute[75165]: INFO nova.compute.claims [None req-8761496d-0cb4-491c-a886-275d93d9f08d tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] [instance: f465963f-1d0f-4ca3-a8b8-681566b7d40a] Claim successful on node user
Oct 26 00:07:26 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-a2cf0630-846e-4208-9c81-8b7d5d545f44 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] No BDM found with device name vda, not building metadata. {{(pid=75165) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 00:07:26 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-a2cf0630-846e-4208-9c81-8b7d5d545f44 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] No VIF found with MAC fa:16:3e:75:45:79, not building metadata {{(pid=75165) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 00:07:26 user nova-compute[75165]: INFO nova.compute.manager [None req-70ba4ee4-a84c-4587-a8b9-97fd07c2ee83 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] [instance: 9633e6bb-5e95-4994-92a2-9d8f85a946ff] Took 22.95 seconds to build instance.
Oct 26 00:07:27 user nova-compute[75165]: INFO nova.compute.manager [None req-f14fa41a-0db2-4572-b30a-8c5b8ceb0780 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] [instance: 18dcf77e-fac2-4b38-ad1c-1f52ce14704a] Took 18.52 seconds to spawn the instance on the hypervisor.
Oct 26 00:07:27 user nova-compute[75165]: DEBUG nova.compute.manager [None req-f14fa41a-0db2-4572-b30a-8c5b8ceb0780 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] [instance: 18dcf77e-fac2-4b38-ad1c-1f52ce14704a] Checking state {{(pid=75165) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 00:07:27 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-70ba4ee4-a84c-4587-a8b9-97fd07c2ee83 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Lock "9633e6bb-5e95-4994-92a2-9d8f85a946ff" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 23.210s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:07:27 user nova-compute[75165]: DEBUG nova.compute.manager [None req-3b915456-470b-49b5-bdff-ae3b0de14dc0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: c4e44bfc-6a68-46ce-8335-aaaba5160d3e] Instance event wait completed in 0 seconds for  {{(pid=75165) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 00:07:27 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-3b915456-470b-49b5-bdff-ae3b0de14dc0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: c4e44bfc-6a68-46ce-8335-aaaba5160d3e] Guest created on hypervisor {{(pid=75165) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 00:07:27 user nova-compute[75165]: DEBUG nova.compute.manager [None req-2b8cd73e-9f80-44dc-bacf-845d4a401ebb tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: a7eeb145-1565-4812-818b-fefda5f2436d] Instance event wait completed in 0 seconds for  {{(pid=75165) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 00:07:27 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-2b8cd73e-9f80-44dc-bacf-845d4a401ebb tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: a7eeb145-1565-4812-818b-fefda5f2436d] Guest created on hypervisor {{(pid=75165) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 00:07:27 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: c4e44bfc-6a68-46ce-8335-aaaba5160d3e] Instance spawned successfully.
Oct 26 00:07:27 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-3b915456-470b-49b5-bdff-ae3b0de14dc0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: c4e44bfc-6a68-46ce-8335-aaaba5160d3e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 00:07:27 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: a7eeb145-1565-4812-818b-fefda5f2436d] Instance spawned successfully.
Oct 26 00:07:27 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-2b8cd73e-9f80-44dc-bacf-845d4a401ebb tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: a7eeb145-1565-4812-818b-fefda5f2436d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 00:07:27 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-3b915456-470b-49b5-bdff-ae3b0de14dc0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: c4e44bfc-6a68-46ce-8335-aaaba5160d3e] Found default for hw_cdrom_bus of ide {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:07:27 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-3b915456-470b-49b5-bdff-ae3b0de14dc0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: c4e44bfc-6a68-46ce-8335-aaaba5160d3e] Found default for hw_disk_bus of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:07:27 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-3b915456-470b-49b5-bdff-ae3b0de14dc0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: c4e44bfc-6a68-46ce-8335-aaaba5160d3e] Found default for hw_input_bus of None {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:07:27 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-3b915456-470b-49b5-bdff-ae3b0de14dc0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: c4e44bfc-6a68-46ce-8335-aaaba5160d3e] Found default for hw_pointer_model of None {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:07:27 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-3b915456-470b-49b5-bdff-ae3b0de14dc0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: c4e44bfc-6a68-46ce-8335-aaaba5160d3e] Found default for hw_video_model of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:07:27 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-3b915456-470b-49b5-bdff-ae3b0de14dc0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: c4e44bfc-6a68-46ce-8335-aaaba5160d3e] Found default for hw_vif_model of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:07:27 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-2b8cd73e-9f80-44dc-bacf-845d4a401ebb tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: a7eeb145-1565-4812-818b-fefda5f2436d] Found default for hw_cdrom_bus of ide {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:07:27 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-2b8cd73e-9f80-44dc-bacf-845d4a401ebb tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: a7eeb145-1565-4812-818b-fefda5f2436d] Found default for hw_disk_bus of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:07:27 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-2b8cd73e-9f80-44dc-bacf-845d4a401ebb tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: a7eeb145-1565-4812-818b-fefda5f2436d] Found default for hw_input_bus of None {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:07:27 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-2b8cd73e-9f80-44dc-bacf-845d4a401ebb tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: a7eeb145-1565-4812-818b-fefda5f2436d] Found default for hw_pointer_model of None {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:07:27 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-2b8cd73e-9f80-44dc-bacf-845d4a401ebb tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: a7eeb145-1565-4812-818b-fefda5f2436d] Found default for hw_video_model of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:07:27 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-2b8cd73e-9f80-44dc-bacf-845d4a401ebb tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: a7eeb145-1565-4812-818b-fefda5f2436d] Found default for hw_vif_model of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:07:27 user nova-compute[75165]: INFO nova.compute.manager [None req-f14fa41a-0db2-4572-b30a-8c5b8ceb0780 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] [instance: 18dcf77e-fac2-4b38-ad1c-1f52ce14704a] Took 19.60 seconds to build instance.
Oct 26 00:07:27 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-f14fa41a-0db2-4572-b30a-8c5b8ceb0780 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] Lock "18dcf77e-fac2-4b38-ad1c-1f52ce14704a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.771s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:07:27 user nova-compute[75165]: INFO nova.compute.manager [None req-3b915456-470b-49b5-bdff-ae3b0de14dc0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: c4e44bfc-6a68-46ce-8335-aaaba5160d3e] Took 18.50 seconds to spawn the instance on the hypervisor.
Oct 26 00:07:27 user nova-compute[75165]: DEBUG nova.compute.manager [None req-3b915456-470b-49b5-bdff-ae3b0de14dc0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: c4e44bfc-6a68-46ce-8335-aaaba5160d3e] Checking state {{(pid=75165) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 00:07:27 user nova-compute[75165]: INFO nova.compute.manager [None req-2b8cd73e-9f80-44dc-bacf-845d4a401ebb tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: a7eeb145-1565-4812-818b-fefda5f2436d] Took 14.69 seconds to spawn the instance on the hypervisor.
Oct 26 00:07:27 user nova-compute[75165]: DEBUG nova.compute.manager [None req-2b8cd73e-9f80-44dc-bacf-845d4a401ebb tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: a7eeb145-1565-4812-818b-fefda5f2436d] Checking state {{(pid=75165) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 00:07:27 user nova-compute[75165]: INFO nova.compute.manager [None req-3b915456-470b-49b5-bdff-ae3b0de14dc0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: c4e44bfc-6a68-46ce-8335-aaaba5160d3e] Took 19.84 seconds to build instance.
Oct 26 00:07:27 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-8761496d-0cb4-491c-a886-275d93d9f08d tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:07:27 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-3b915456-470b-49b5-bdff-ae3b0de14dc0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Lock "c4e44bfc-6a68-46ce-8335-aaaba5160d3e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.019s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:07:27 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-8761496d-0cb4-491c-a886-275d93d9f08d tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:07:27 user nova-compute[75165]: INFO nova.compute.manager [None req-2b8cd73e-9f80-44dc-bacf-845d4a401ebb tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: a7eeb145-1565-4812-818b-fefda5f2436d] Took 15.71 seconds to build instance.
Oct 26 00:07:27 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-2b8cd73e-9f80-44dc-bacf-845d4a401ebb tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Lock "a7eeb145-1565-4812-818b-fefda5f2436d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.847s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:07:27 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-8761496d-0cb4-491c-a886-275d93d9f08d tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.141s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:07:27 user nova-compute[75165]: DEBUG nova.compute.manager [None req-8761496d-0cb4-491c-a886-275d93d9f08d tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] [instance: f465963f-1d0f-4ca3-a8b8-681566b7d40a] Start building networks asynchronously for instance. {{(pid=75165) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 00:07:28 user nova-compute[75165]: DEBUG nova.compute.manager [None req-8761496d-0cb4-491c-a886-275d93d9f08d tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] [instance: f465963f-1d0f-4ca3-a8b8-681566b7d40a] Allocating IP information in the background. {{(pid=75165) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 00:07:28 user nova-compute[75165]: DEBUG nova.network.neutron [None req-8761496d-0cb4-491c-a886-275d93d9f08d tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] [instance: f465963f-1d0f-4ca3-a8b8-681566b7d40a] allocate_for_instance() {{(pid=75165) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 00:07:28 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-8761496d-0cb4-491c-a886-275d93d9f08d tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] [instance: f465963f-1d0f-4ca3-a8b8-681566b7d40a] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Oct 26 00:07:28 user nova-compute[75165]: DEBUG nova.compute.manager [None req-8761496d-0cb4-491c-a886-275d93d9f08d tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] [instance: f465963f-1d0f-4ca3-a8b8-681566b7d40a] Start building block device mappings for instance. {{(pid=75165) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 00:07:28 user nova-compute[75165]: DEBUG nova.policy [None req-8761496d-0cb4-491c-a886-275d93d9f08d tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '21fb86a371f74549b250005e42f68233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '509c01c3838743959bacaa4aa2d31b63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75165) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 00:07:28 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:28 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:28 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:28 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:28 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:28 user nova-compute[75165]: DEBUG nova.compute.manager [None req-8761496d-0cb4-491c-a886-275d93d9f08d tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] [instance: f465963f-1d0f-4ca3-a8b8-681566b7d40a] Start spawning the instance on the hypervisor. {{(pid=75165) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 00:07:28 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-8761496d-0cb4-491c-a886-275d93d9f08d tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] [instance: f465963f-1d0f-4ca3-a8b8-681566b7d40a] Creating instance directory {{(pid=75165) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 00:07:28 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-8761496d-0cb4-491c-a886-275d93d9f08d tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] [instance: f465963f-1d0f-4ca3-a8b8-681566b7d40a] Creating image(s)
Oct 26 00:07:28 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-8761496d-0cb4-491c-a886-275d93d9f08d tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] Acquiring lock "/opt/stack/data/nova/instances/f465963f-1d0f-4ca3-a8b8-681566b7d40a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:07:28 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-8761496d-0cb4-491c-a886-275d93d9f08d tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] Lock "/opt/stack/data/nova/instances/f465963f-1d0f-4ca3-a8b8-681566b7d40a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:07:28 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-8761496d-0cb4-491c-a886-275d93d9f08d tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] Lock "/opt/stack/data/nova/instances/f465963f-1d0f-4ca3-a8b8-681566b7d40a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:07:28 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-8761496d-0cb4-491c-a886-275d93d9f08d tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] Acquiring lock "4586e48e46c231dfc61967b578547c063a70cb37" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:07:28 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-8761496d-0cb4-491c-a886-275d93d9f08d tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] Lock "4586e48e46c231dfc61967b578547c063a70cb37" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.007s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:07:29 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-8761496d-0cb4-491c-a886-275d93d9f08d tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4586e48e46c231dfc61967b578547c063a70cb37.part --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:07:29 user nova-compute[75165]: DEBUG nova.network.neutron [None req-8761496d-0cb4-491c-a886-275d93d9f08d tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] [instance: f465963f-1d0f-4ca3-a8b8-681566b7d40a] Successfully created port: f382bfbf-798f-4f17-87ca-ff778203bab3 {{(pid=75165) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 00:07:29 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:29 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-8761496d-0cb4-491c-a886-275d93d9f08d tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4586e48e46c231dfc61967b578547c063a70cb37.part --force-share --output=json" returned: 0 in 0.415s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:07:29 user nova-compute[75165]: DEBUG nova.virt.images [None req-8761496d-0cb4-491c-a886-275d93d9f08d tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] d4e6b02c-7adc-4509-8bf4-b40cfed6a5b2 was qcow2, converting to raw {{(pid=75165) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 26 00:07:29 user nova-compute[75165]: DEBUG nova.privsep.utils [None req-8761496d-0cb4-491c-a886-275d93d9f08d tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75165) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 26 00:07:29 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-8761496d-0cb4-491c-a886-275d93d9f08d tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4586e48e46c231dfc61967b578547c063a70cb37.part /opt/stack/data/nova/instances/_base/4586e48e46c231dfc61967b578547c063a70cb37.converted {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:07:30 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:30 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:30 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:30 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:30 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:30 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:30 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-8761496d-0cb4-491c-a886-275d93d9f08d tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4586e48e46c231dfc61967b578547c063a70cb37.part /opt/stack/data/nova/instances/_base/4586e48e46c231dfc61967b578547c063a70cb37.converted" returned: 0 in 0.819s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:07:30 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-8761496d-0cb4-491c-a886-275d93d9f08d tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4586e48e46c231dfc61967b578547c063a70cb37.converted --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:07:31 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-8761496d-0cb4-491c-a886-275d93d9f08d tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4586e48e46c231dfc61967b578547c063a70cb37.converted --force-share --output=json" returned: 0 in 0.365s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:07:31 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-8761496d-0cb4-491c-a886-275d93d9f08d tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] Lock "4586e48e46c231dfc61967b578547c063a70cb37" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.636s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:07:31 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-8761496d-0cb4-491c-a886-275d93d9f08d tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4586e48e46c231dfc61967b578547c063a70cb37 --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:07:31 user nova-compute[75165]: DEBUG nova.network.neutron [None req-8761496d-0cb4-491c-a886-275d93d9f08d tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] [instance: f465963f-1d0f-4ca3-a8b8-681566b7d40a] Successfully updated port: f382bfbf-798f-4f17-87ca-ff778203bab3 {{(pid=75165) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 00:07:31 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-8761496d-0cb4-491c-a886-275d93d9f08d tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] Acquiring lock "refresh_cache-f465963f-1d0f-4ca3-a8b8-681566b7d40a" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:07:31 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-8761496d-0cb4-491c-a886-275d93d9f08d tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] Acquired lock "refresh_cache-f465963f-1d0f-4ca3-a8b8-681566b7d40a" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:07:31 user nova-compute[75165]: DEBUG nova.network.neutron [None req-8761496d-0cb4-491c-a886-275d93d9f08d tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] [instance: f465963f-1d0f-4ca3-a8b8-681566b7d40a] Building network info cache for instance {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 00:07:31 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-8761496d-0cb4-491c-a886-275d93d9f08d tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4586e48e46c231dfc61967b578547c063a70cb37 --force-share --output=json" returned: 0 in 0.349s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:07:31 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-8761496d-0cb4-491c-a886-275d93d9f08d tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] Acquiring lock "4586e48e46c231dfc61967b578547c063a70cb37" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:07:31 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-8761496d-0cb4-491c-a886-275d93d9f08d tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] Lock "4586e48e46c231dfc61967b578547c063a70cb37" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:07:31 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-8761496d-0cb4-491c-a886-275d93d9f08d tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4586e48e46c231dfc61967b578547c063a70cb37 --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:07:31 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:31 user nova-compute[75165]: DEBUG nova.compute.manager [req-cbb71d49-b5e0-470e-8bcd-688cc0ef74e9 req-6e6fdc25-2cb1-4489-a152-ca5a20c0cec4 service nova] [instance: f465963f-1d0f-4ca3-a8b8-681566b7d40a] Received event network-changed-f382bfbf-798f-4f17-87ca-ff778203bab3 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:07:31 user nova-compute[75165]: DEBUG nova.compute.manager [req-cbb71d49-b5e0-470e-8bcd-688cc0ef74e9 req-6e6fdc25-2cb1-4489-a152-ca5a20c0cec4 service nova] [instance: f465963f-1d0f-4ca3-a8b8-681566b7d40a] Refreshing instance network info cache due to event network-changed-f382bfbf-798f-4f17-87ca-ff778203bab3. {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 00:07:31 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-cbb71d49-b5e0-470e-8bcd-688cc0ef74e9 req-6e6fdc25-2cb1-4489-a152-ca5a20c0cec4 service nova] Acquiring lock "refresh_cache-f465963f-1d0f-4ca3-a8b8-681566b7d40a" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:07:31 user nova-compute[75165]: DEBUG nova.network.neutron [None req-8761496d-0cb4-491c-a886-275d93d9f08d tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] [instance: f465963f-1d0f-4ca3-a8b8-681566b7d40a] Instance cache missing network info. {{(pid=75165) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 00:07:31 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-8761496d-0cb4-491c-a886-275d93d9f08d tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4586e48e46c231dfc61967b578547c063a70cb37 --force-share --output=json" returned: 0 in 0.310s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:07:31 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-8761496d-0cb4-491c-a886-275d93d9f08d tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4586e48e46c231dfc61967b578547c063a70cb37,backing_fmt=raw /opt/stack/data/nova/instances/f465963f-1d0f-4ca3-a8b8-681566b7d40a/disk 1073741824 {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:07:31 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:31 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-8761496d-0cb4-491c-a886-275d93d9f08d tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4586e48e46c231dfc61967b578547c063a70cb37,backing_fmt=raw /opt/stack/data/nova/instances/f465963f-1d0f-4ca3-a8b8-681566b7d40a/disk 1073741824" returned: 0 in 0.117s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:07:31 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-8761496d-0cb4-491c-a886-275d93d9f08d tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] Lock "4586e48e46c231dfc61967b578547c063a70cb37" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.431s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:07:31 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-8761496d-0cb4-491c-a886-275d93d9f08d tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4586e48e46c231dfc61967b578547c063a70cb37 --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:07:31 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:32 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-8761496d-0cb4-491c-a886-275d93d9f08d tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4586e48e46c231dfc61967b578547c063a70cb37 --force-share --output=json" returned: 0 in 0.327s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:07:32 user nova-compute[75165]: DEBUG nova.virt.disk.api [None req-8761496d-0cb4-491c-a886-275d93d9f08d tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f465963f-1d0f-4ca3-a8b8-681566b7d40a/disk. size=1073741824 {{(pid=75165) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 00:07:32 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-8761496d-0cb4-491c-a886-275d93d9f08d tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f465963f-1d0f-4ca3-a8b8-681566b7d40a/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:07:32 user nova-compute[75165]: DEBUG nova.network.neutron [None req-8761496d-0cb4-491c-a886-275d93d9f08d tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] [instance: f465963f-1d0f-4ca3-a8b8-681566b7d40a] Updating instance_info_cache with network_info: [{"id": "f382bfbf-798f-4f17-87ca-ff778203bab3", "address": "fa:16:3e:67:95:5b", "network": {"id": "7da22085-d8b3-4dbe-b796-95cdc69f58fe", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1230661193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "509c01c3838743959bacaa4aa2d31b63", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf382bfbf-79", "ovs_interfaceid": "f382bfbf-798f-4f17-87ca-ff778203bab3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:07:32 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-8761496d-0cb4-491c-a886-275d93d9f08d tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] Releasing lock "refresh_cache-f465963f-1d0f-4ca3-a8b8-681566b7d40a" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:07:32 user nova-compute[75165]: DEBUG nova.compute.manager [None req-8761496d-0cb4-491c-a886-275d93d9f08d tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] [instance: f465963f-1d0f-4ca3-a8b8-681566b7d40a] Instance network_info: |[{"id": "f382bfbf-798f-4f17-87ca-ff778203bab3", "address": "fa:16:3e:67:95:5b", "network": {"id": "7da22085-d8b3-4dbe-b796-95cdc69f58fe", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1230661193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "509c01c3838743959bacaa4aa2d31b63", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf382bfbf-79", "ovs_interfaceid": "f382bfbf-798f-4f17-87ca-ff778203bab3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75165) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 00:07:32 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-cbb71d49-b5e0-470e-8bcd-688cc0ef74e9 req-6e6fdc25-2cb1-4489-a152-ca5a20c0cec4 service nova] Acquired lock "refresh_cache-f465963f-1d0f-4ca3-a8b8-681566b7d40a" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:07:32 user nova-compute[75165]: DEBUG nova.network.neutron [req-cbb71d49-b5e0-470e-8bcd-688cc0ef74e9 req-6e6fdc25-2cb1-4489-a152-ca5a20c0cec4 service nova] [instance: f465963f-1d0f-4ca3-a8b8-681566b7d40a] Refreshing network info cache for port f382bfbf-798f-4f17-87ca-ff778203bab3 {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 00:07:32 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:32 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:32 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:32 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:32 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-8761496d-0cb4-491c-a886-275d93d9f08d tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f465963f-1d0f-4ca3-a8b8-681566b7d40a/disk --force-share --output=json" returned: 0 in 0.471s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:07:32 user nova-compute[75165]: DEBUG nova.virt.disk.api [None req-8761496d-0cb4-491c-a886-275d93d9f08d tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] Cannot resize image /opt/stack/data/nova/instances/f465963f-1d0f-4ca3-a8b8-681566b7d40a/disk to a smaller size. {{(pid=75165) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 00:07:32 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-8761496d-0cb4-491c-a886-275d93d9f08d tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] [instance: f465963f-1d0f-4ca3-a8b8-681566b7d40a] Created local disks {{(pid=75165) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 00:07:32 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-8761496d-0cb4-491c-a886-275d93d9f08d tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] [instance: f465963f-1d0f-4ca3-a8b8-681566b7d40a] Ensure instance console log exists: /opt/stack/data/nova/instances/f465963f-1d0f-4ca3-a8b8-681566b7d40a/console.log {{(pid=75165) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 00:07:32 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-8761496d-0cb4-491c-a886-275d93d9f08d tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:07:32 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-8761496d-0cb4-491c-a886-275d93d9f08d tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:07:32 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-8761496d-0cb4-491c-a886-275d93d9f08d tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:07:32 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-8761496d-0cb4-491c-a886-275d93d9f08d tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] [instance: f465963f-1d0f-4ca3-a8b8-681566b7d40a] Start _get_guest_xml network_info=[{"id": "f382bfbf-798f-4f17-87ca-ff778203bab3", "address": "fa:16:3e:67:95:5b", "network": {"id": "7da22085-d8b3-4dbe-b796-95cdc69f58fe", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1230661193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "509c01c3838743959bacaa4aa2d31b63", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf382bfbf-79", "ovs_interfaceid": "f382bfbf-798f-4f17-87ca-ff778203bab3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T00:07:18Z,direct_url=<?>,disk_format='qcow2',id=d4e6b02c-7adc-4509-8bf4-b40cfed6a5b2,min_disk=0,min_ram=0,name='',owner='0d096ffa36d54dc0860eb86574dee584',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T00:07:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'device_name': '/dev/sda', 'device_type': 'disk', 'encrypted': False, 'size': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'scsi', 'image_id': 'd4e6b02c-7adc-4509-8bf4-b40cfed6a5b2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75165) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 00:07:32 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-8761496d-0cb4-491c-a886-275d93d9f08d tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:07:32 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-8761496d-0cb4-491c-a886-275d93d9f08d tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:07:32 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-8761496d-0cb4-491c-a886-275d93d9f08d tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75165) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 00:07:32 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-8761496d-0cb4-491c-a886-275d93d9f08d tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] CPU controller missing on host. {{(pid=75165) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 00:07:32 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-8761496d-0cb4-491c-a886-275d93d9f08d tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75165) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 00:07:32 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-8761496d-0cb4-491c-a886-275d93d9f08d tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] CPU controller found on host. {{(pid=75165) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 00:07:32 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-8761496d-0cb4-491c-a886-275d93d9f08d tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75165) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 00:07:32 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-8761496d-0cb4-491c-a886-275d93d9f08d tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T00:03:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T00:07:18Z,direct_url=<?>,disk_format='qcow2',id=d4e6b02c-7adc-4509-8bf4-b40cfed6a5b2,min_disk=0,min_ram=0,name='',owner='0d096ffa36d54dc0860eb86574dee584',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T00:07:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 00:07:32 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-8761496d-0cb4-491c-a886-275d93d9f08d tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] Flavor limits 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 00:07:32 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-8761496d-0cb4-491c-a886-275d93d9f08d tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] Image limits 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 00:07:32 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-8761496d-0cb4-491c-a886-275d93d9f08d tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] Flavor pref 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 00:07:32 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-8761496d-0cb4-491c-a886-275d93d9f08d tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] Image pref 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 00:07:32 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-8761496d-0cb4-491c-a886-275d93d9f08d tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 00:07:32 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-8761496d-0cb4-491c-a886-275d93d9f08d tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 00:07:32 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-8761496d-0cb4-491c-a886-275d93d9f08d tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75165) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 00:07:32 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-8761496d-0cb4-491c-a886-275d93d9f08d tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] Got 1 possible topologies {{(pid=75165) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 00:07:32 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-8761496d-0cb4-491c-a886-275d93d9f08d tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 00:07:32 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-8761496d-0cb4-491c-a886-275d93d9f08d tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 00:07:32 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-8761496d-0cb4-491c-a886-275d93d9f08d tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T00:07:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1547104777',display_name='tempest-AttachSCSIVolumeTestJSON-server-1547104777',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1547104777',id=9,image_ref='d4e6b02c-7adc-4509-8bf4-b40cfed6a5b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJqJxcsWIvMFLaNIHcTwNIUmN7yofWeiByb0JW+AwSP8CCwkTGXaZxuvAVDka186nU9rgpz4j3iXefbxVEvMYRw11j/fUN/FSR2OQuPyYYNx3XAOTeKsM0v09GfO4xFxIA==',key_name='tempest-keypair-653354587',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='509c01c3838743959bacaa4aa2d31b63',ramdisk_id='',reservation_id='r-ibk3rjr2',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d4e6b02c-7adc-4509-8bf4-b40cfed6a5b2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1798603581',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1798603581-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T00:07:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='21fb86a371f74549b250005e42f68233',uuid=f465963f-1d0f-4ca3-a8b8-681566b7d40a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f382bfbf-798f-4f17-87ca-ff778203bab3", "address": "fa:16:3e:67:95:5b", "network": {"id": "7da22085-d8b3-4dbe-b796-95cdc69f58fe", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1230661193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "509c01c3838743959bacaa4aa2d31b63", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf382bfbf-79", "ovs_interfaceid": "f382bfbf-798f-4f17-87ca-ff778203bab3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75165) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 00:07:32 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-8761496d-0cb4-491c-a886-275d93d9f08d tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] Converting VIF {"id": "f382bfbf-798f-4f17-87ca-ff778203bab3", "address": "fa:16:3e:67:95:5b", "network": {"id": "7da22085-d8b3-4dbe-b796-95cdc69f58fe", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1230661193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "509c01c3838743959bacaa4aa2d31b63", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf382bfbf-79", "ovs_interfaceid": "f382bfbf-798f-4f17-87ca-ff778203bab3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:07:32 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-8761496d-0cb4-491c-a886-275d93d9f08d tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:95:5b,bridge_name='br-int',has_traffic_filtering=True,id=f382bfbf-798f-4f17-87ca-ff778203bab3,network=Network(7da22085-d8b3-4dbe-b796-95cdc69f58fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf382bfbf-79') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:07:32 user nova-compute[75165]: DEBUG nova.objects.instance [None req-8761496d-0cb4-491c-a886-275d93d9f08d tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] Lazy-loading 'pci_devices' on Instance uuid f465963f-1d0f-4ca3-a8b8-681566b7d40a {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:07:32 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-8761496d-0cb4-491c-a886-275d93d9f08d tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] [instance: f465963f-1d0f-4ca3-a8b8-681566b7d40a] End _get_guest_xml xml=<domain type="kvm">
Oct 26 00:07:32 user nova-compute[75165]:   <uuid>f465963f-1d0f-4ca3-a8b8-681566b7d40a</uuid>
Oct 26 00:07:32 user nova-compute[75165]:   <name>instance-00000009</name>
Oct 26 00:07:32 user nova-compute[75165]:   <memory>524288</memory>
Oct 26 00:07:32 user nova-compute[75165]:   <vcpu>1</vcpu>
Oct 26 00:07:32 user nova-compute[75165]:   <metadata>
Oct 26 00:07:32 user nova-compute[75165]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 00:07:32 user nova-compute[75165]:       <nova:package version="0.0.0"/>
Oct 26 00:07:32 user nova-compute[75165]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-1547104777</nova:name>
Oct 26 00:07:32 user nova-compute[75165]:       <nova:creationTime>2023-10-26 00:07:32</nova:creationTime>
Oct 26 00:07:32 user nova-compute[75165]:       <nova:flavor name="m1.tiny">
Oct 26 00:07:32 user nova-compute[75165]:         <nova:memory>512</nova:memory>
Oct 26 00:07:32 user nova-compute[75165]:         <nova:disk>1</nova:disk>
Oct 26 00:07:32 user nova-compute[75165]:         <nova:swap>0</nova:swap>
Oct 26 00:07:32 user nova-compute[75165]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 00:07:32 user nova-compute[75165]:         <nova:vcpus>1</nova:vcpus>
Oct 26 00:07:32 user nova-compute[75165]:       </nova:flavor>
Oct 26 00:07:32 user nova-compute[75165]:       <nova:owner>
Oct 26 00:07:32 user nova-compute[75165]:         <nova:user uuid="21fb86a371f74549b250005e42f68233">tempest-AttachSCSIVolumeTestJSON-1798603581-project-member</nova:user>
Oct 26 00:07:32 user nova-compute[75165]:         <nova:project uuid="509c01c3838743959bacaa4aa2d31b63">tempest-AttachSCSIVolumeTestJSON-1798603581</nova:project>
Oct 26 00:07:32 user nova-compute[75165]:       </nova:owner>
Oct 26 00:07:32 user nova-compute[75165]:       <nova:root type="image" uuid="d4e6b02c-7adc-4509-8bf4-b40cfed6a5b2"/>
Oct 26 00:07:32 user nova-compute[75165]:       <nova:ports>
Oct 26 00:07:32 user nova-compute[75165]:         <nova:port uuid="f382bfbf-798f-4f17-87ca-ff778203bab3">
Oct 26 00:07:32 user nova-compute[75165]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 26 00:07:32 user nova-compute[75165]:         </nova:port>
Oct 26 00:07:32 user nova-compute[75165]:       </nova:ports>
Oct 26 00:07:32 user nova-compute[75165]:     </nova:instance>
Oct 26 00:07:32 user nova-compute[75165]:   </metadata>
Oct 26 00:07:32 user nova-compute[75165]:   <sysinfo type="smbios">
Oct 26 00:07:32 user nova-compute[75165]:     <system>
Oct 26 00:07:32 user nova-compute[75165]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 00:07:32 user nova-compute[75165]:       <entry name="product">OpenStack Nova</entry>
Oct 26 00:07:32 user nova-compute[75165]:       <entry name="version">0.0.0</entry>
Oct 26 00:07:32 user nova-compute[75165]:       <entry name="serial">f465963f-1d0f-4ca3-a8b8-681566b7d40a</entry>
Oct 26 00:07:32 user nova-compute[75165]:       <entry name="uuid">f465963f-1d0f-4ca3-a8b8-681566b7d40a</entry>
Oct 26 00:07:32 user nova-compute[75165]:       <entry name="family">Virtual Machine</entry>
Oct 26 00:07:32 user nova-compute[75165]:     </system>
Oct 26 00:07:32 user nova-compute[75165]:   </sysinfo>
Oct 26 00:07:32 user nova-compute[75165]:   <os>
Oct 26 00:07:32 user nova-compute[75165]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 00:07:32 user nova-compute[75165]:     <boot dev="hd"/>
Oct 26 00:07:32 user nova-compute[75165]:     <smbios mode="sysinfo"/>
Oct 26 00:07:32 user nova-compute[75165]:   </os>
Oct 26 00:07:32 user nova-compute[75165]:   <features>
Oct 26 00:07:32 user nova-compute[75165]:     <acpi/>
Oct 26 00:07:32 user nova-compute[75165]:     <apic/>
Oct 26 00:07:32 user nova-compute[75165]:     <vmcoreinfo/>
Oct 26 00:07:32 user nova-compute[75165]:   </features>
Oct 26 00:07:32 user nova-compute[75165]:   <clock offset="utc">
Oct 26 00:07:32 user nova-compute[75165]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 00:07:32 user nova-compute[75165]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 00:07:32 user nova-compute[75165]:     <timer name="hpet" present="no"/>
Oct 26 00:07:32 user nova-compute[75165]:   </clock>
Oct 26 00:07:32 user nova-compute[75165]:   <cpu mode="custom" match="exact">
Oct 26 00:07:32 user nova-compute[75165]:     <model>Nehalem</model>
Oct 26 00:07:32 user nova-compute[75165]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 00:07:32 user nova-compute[75165]:   </cpu>
Oct 26 00:07:32 user nova-compute[75165]:   <devices>
Oct 26 00:07:32 user nova-compute[75165]:     <disk type="file" device="disk">
Oct 26 00:07:32 user nova-compute[75165]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 00:07:32 user nova-compute[75165]:       <source file="/opt/stack/data/nova/instances/f465963f-1d0f-4ca3-a8b8-681566b7d40a/disk"/>
Oct 26 00:07:32 user nova-compute[75165]:       <target dev="sda" bus="scsi"/>
Oct 26 00:07:32 user nova-compute[75165]:       <address type="drive" controller="0" unit="0"/>
Oct 26 00:07:32 user nova-compute[75165]:     </disk>
Oct 26 00:07:32 user nova-compute[75165]:     <disk type="file" device="cdrom">
Oct 26 00:07:32 user nova-compute[75165]:       <driver name="qemu" type="raw" cache="none"/>
Oct 26 00:07:32 user nova-compute[75165]:       <source file="/opt/stack/data/nova/instances/f465963f-1d0f-4ca3-a8b8-681566b7d40a/disk.config"/>
Oct 26 00:07:32 user nova-compute[75165]:       <target dev="sdb" bus="scsi"/>
Oct 26 00:07:32 user nova-compute[75165]:       <address type="drive" controller="0" unit="1"/>
Oct 26 00:07:32 user nova-compute[75165]:     </disk>
Oct 26 00:07:32 user nova-compute[75165]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Oct 26 00:07:32 user nova-compute[75165]:     <interface type="ethernet">
Oct 26 00:07:32 user nova-compute[75165]:       <mac address="fa:16:3e:67:95:5b"/>
Oct 26 00:07:32 user nova-compute[75165]:       <model type="virtio"/>
Oct 26 00:07:32 user nova-compute[75165]:       <mtu size="1442"/>
Oct 26 00:07:32 user nova-compute[75165]:       <target dev="tapf382bfbf-79"/>
Oct 26 00:07:32 user nova-compute[75165]:     </interface>
Oct 26 00:07:32 user nova-compute[75165]:     <serial type="pty">
Oct 26 00:07:32 user nova-compute[75165]:       <log file="/opt/stack/data/nova/instances/f465963f-1d0f-4ca3-a8b8-681566b7d40a/console.log" append="off"/>
Oct 26 00:07:32 user nova-compute[75165]:     </serial>
Oct 26 00:07:32 user nova-compute[75165]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 00:07:32 user nova-compute[75165]:     <video>
Oct 26 00:07:32 user nova-compute[75165]:       <model type="virtio"/>
Oct 26 00:07:32 user nova-compute[75165]:     </video>
Oct 26 00:07:32 user nova-compute[75165]:     <rng model="virtio">
Oct 26 00:07:32 user nova-compute[75165]:       <backend model="random">/dev/urandom</backend>
Oct 26 00:07:32 user nova-compute[75165]:     </rng>
Oct 26 00:07:32 user nova-compute[75165]:     <controller type="usb" index="0" model="none"/>
Oct 26 00:07:32 user nova-compute[75165]:     <memballoon model="virtio">
Oct 26 00:07:32 user nova-compute[75165]:       <stats period="10"/>
Oct 26 00:07:32 user nova-compute[75165]:     </memballoon>
Oct 26 00:07:32 user nova-compute[75165]:   </devices>
Oct 26 00:07:32 user nova-compute[75165]: </domain>
Oct 26 00:07:32 user nova-compute[75165]:  {{(pid=75165) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 00:07:32 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-8761496d-0cb4-491c-a886-275d93d9f08d tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T00:07:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1547104777',display_name='tempest-AttachSCSIVolumeTestJSON-server-1547104777',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1547104777',id=9,image_ref='d4e6b02c-7adc-4509-8bf4-b40cfed6a5b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJqJxcsWIvMFLaNIHcTwNIUmN7yofWeiByb0JW+AwSP8CCwkTGXaZxuvAVDka186nU9rgpz4j3iXefbxVEvMYRw11j/fUN/FSR2OQuPyYYNx3XAOTeKsM0v09GfO4xFxIA==',key_name='tempest-keypair-653354587',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='509c01c3838743959bacaa4aa2d31b63',ramdisk_id='',reservation_id='r-ibk3rjr2',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d4e6b02c-7adc-4509-8bf4-b40cfed6a5b2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1798603581',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1798603581-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T00:07:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='21fb86a371f74549b250005e42f68233',uuid=f465963f-1d0f-4ca3-a8b8-681566b7d40a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f382bfbf-798f-4f17-87ca-ff778203bab3", "address": "fa:16:3e:67:95:5b", "network": {"id": "7da22085-d8b3-4dbe-b796-95cdc69f58fe", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1230661193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "509c01c3838743959bacaa4aa2d31b63", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf382bfbf-79", "ovs_interfaceid": "f382bfbf-798f-4f17-87ca-ff778203bab3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 00:07:32 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-8761496d-0cb4-491c-a886-275d93d9f08d tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] Converting VIF {"id": "f382bfbf-798f-4f17-87ca-ff778203bab3", "address": "fa:16:3e:67:95:5b", "network": {"id": "7da22085-d8b3-4dbe-b796-95cdc69f58fe", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1230661193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "509c01c3838743959bacaa4aa2d31b63", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf382bfbf-79", "ovs_interfaceid": "f382bfbf-798f-4f17-87ca-ff778203bab3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:07:32 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-8761496d-0cb4-491c-a886-275d93d9f08d tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:95:5b,bridge_name='br-int',has_traffic_filtering=True,id=f382bfbf-798f-4f17-87ca-ff778203bab3,network=Network(7da22085-d8b3-4dbe-b796-95cdc69f58fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf382bfbf-79') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:07:32 user nova-compute[75165]: DEBUG os_vif [None req-8761496d-0cb4-491c-a886-275d93d9f08d tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:95:5b,bridge_name='br-int',has_traffic_filtering=True,id=f382bfbf-798f-4f17-87ca-ff778203bab3,network=Network(7da22085-d8b3-4dbe-b796-95cdc69f58fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf382bfbf-79') {{(pid=75165) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 00:07:32 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:32 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:07:32 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 00:07:32 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:32 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e9e45b3f-c56c-509b-b520-1dcec849ab72', '_type': 'linux-noop'}}, row=False) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:07:32 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:32 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:07:32 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:32 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:32 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf382bfbf-79, may_exist=True, interface_attrs={}) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:07:32 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf382bfbf-79, col_values=(('qos', UUID('f1eaee36-cb71-422d-80dd-d5148215676b')),), if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:07:32 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf382bfbf-79, col_values=(('external_ids', {'iface-id': 'f382bfbf-798f-4f17-87ca-ff778203bab3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:67:95:5b', 'vm-uuid': 'f465963f-1d0f-4ca3-a8b8-681566b7d40a'}),), if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:07:32 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:32 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:07:33 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:33 user nova-compute[75165]: INFO os_vif [None req-8761496d-0cb4-491c-a886-275d93d9f08d tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:95:5b,bridge_name='br-int',has_traffic_filtering=True,id=f382bfbf-798f-4f17-87ca-ff778203bab3,network=Network(7da22085-d8b3-4dbe-b796-95cdc69f58fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf382bfbf-79')
Oct 26 00:07:33 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:33 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:33 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:33 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-8761496d-0cb4-491c-a886-275d93d9f08d tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] No BDM found with device name sda, not building metadata. {{(pid=75165) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 00:07:33 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-8761496d-0cb4-491c-a886-275d93d9f08d tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75165) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 00:07:33 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-8761496d-0cb4-491c-a886-275d93d9f08d tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] No VIF found with MAC fa:16:3e:67:95:5b, not building metadata {{(pid=75165) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 00:07:33 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-8761496d-0cb4-491c-a886-275d93d9f08d tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] [instance: f465963f-1d0f-4ca3-a8b8-681566b7d40a] Using config drive
Oct 26 00:07:33 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:33 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:33 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:33 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:34 user nova-compute[75165]: DEBUG nova.network.neutron [req-cbb71d49-b5e0-470e-8bcd-688cc0ef74e9 req-6e6fdc25-2cb1-4489-a152-ca5a20c0cec4 service nova] [instance: f465963f-1d0f-4ca3-a8b8-681566b7d40a] Updated VIF entry in instance network info cache for port f382bfbf-798f-4f17-87ca-ff778203bab3. {{(pid=75165) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 00:07:34 user nova-compute[75165]: DEBUG nova.network.neutron [req-cbb71d49-b5e0-470e-8bcd-688cc0ef74e9 req-6e6fdc25-2cb1-4489-a152-ca5a20c0cec4 service nova] [instance: f465963f-1d0f-4ca3-a8b8-681566b7d40a] Updating instance_info_cache with network_info: [{"id": "f382bfbf-798f-4f17-87ca-ff778203bab3", "address": "fa:16:3e:67:95:5b", "network": {"id": "7da22085-d8b3-4dbe-b796-95cdc69f58fe", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1230661193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "509c01c3838743959bacaa4aa2d31b63", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf382bfbf-79", "ovs_interfaceid": "f382bfbf-798f-4f17-87ca-ff778203bab3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:07:34 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-cbb71d49-b5e0-470e-8bcd-688cc0ef74e9 req-6e6fdc25-2cb1-4489-a152-ca5a20c0cec4 service nova] Releasing lock "refresh_cache-f465963f-1d0f-4ca3-a8b8-681566b7d40a" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:07:34 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:34 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:34 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:34 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:34 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-8761496d-0cb4-491c-a886-275d93d9f08d tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] [instance: f465963f-1d0f-4ca3-a8b8-681566b7d40a] Creating config drive at /opt/stack/data/nova/instances/f465963f-1d0f-4ca3-a8b8-681566b7d40a/disk.config
Oct 26 00:07:34 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-8761496d-0cb4-491c-a886-275d93d9f08d tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/f465963f-1d0f-4ca3-a8b8-681566b7d40a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpqvw_8kaz {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:07:34 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-8761496d-0cb4-491c-a886-275d93d9f08d tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/f465963f-1d0f-4ca3-a8b8-681566b7d40a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpqvw_8kaz" returned: 0 in 0.090s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:07:35 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:35 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:35 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:35 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:35 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:36 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:37 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:37 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:37 user nova-compute[75165]: DEBUG nova.compute.manager [None req-26a64c2e-3ffa-417d-920d-0886e701b786 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] Instance event wait completed in 0 seconds for  {{(pid=75165) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 00:07:37 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-26a64c2e-3ffa-417d-920d-0886e701b786 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] Guest created on hypervisor {{(pid=75165) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 00:07:37 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] Instance spawned successfully.
Oct 26 00:07:37 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-26a64c2e-3ffa-417d-920d-0886e701b786 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 00:07:37 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-26a64c2e-3ffa-417d-920d-0886e701b786 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] Found default for hw_cdrom_bus of ide {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:07:37 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-26a64c2e-3ffa-417d-920d-0886e701b786 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] Found default for hw_disk_bus of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:07:37 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-26a64c2e-3ffa-417d-920d-0886e701b786 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] Found default for hw_input_bus of None {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:07:37 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-26a64c2e-3ffa-417d-920d-0886e701b786 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] Found default for hw_pointer_model of None {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:07:37 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-26a64c2e-3ffa-417d-920d-0886e701b786 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] Found default for hw_video_model of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:07:37 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-26a64c2e-3ffa-417d-920d-0886e701b786 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] Found default for hw_vif_model of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:07:37 user nova-compute[75165]: DEBUG nova.compute.manager [req-5b589d8d-ac3d-46fd-9136-b073cba9db8b req-5054f241-16c8-4108-b88b-c592122fd9f8 service nova] [instance: 9633e6bb-5e95-4994-92a2-9d8f85a946ff] Received event network-vif-plugged-6beaf63f-0750-4c6a-b0bd-ebfbca211ad1 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:07:37 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-5b589d8d-ac3d-46fd-9136-b073cba9db8b req-5054f241-16c8-4108-b88b-c592122fd9f8 service nova] Acquiring lock "9633e6bb-5e95-4994-92a2-9d8f85a946ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:07:37 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-5b589d8d-ac3d-46fd-9136-b073cba9db8b req-5054f241-16c8-4108-b88b-c592122fd9f8 service nova] Lock "9633e6bb-5e95-4994-92a2-9d8f85a946ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:07:37 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-5b589d8d-ac3d-46fd-9136-b073cba9db8b req-5054f241-16c8-4108-b88b-c592122fd9f8 service nova] Lock "9633e6bb-5e95-4994-92a2-9d8f85a946ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:07:37 user nova-compute[75165]: DEBUG nova.compute.manager [req-5b589d8d-ac3d-46fd-9136-b073cba9db8b req-5054f241-16c8-4108-b88b-c592122fd9f8 service nova] [instance: 9633e6bb-5e95-4994-92a2-9d8f85a946ff] No waiting events found dispatching network-vif-plugged-6beaf63f-0750-4c6a-b0bd-ebfbca211ad1 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:07:37 user nova-compute[75165]: WARNING nova.compute.manager [req-5b589d8d-ac3d-46fd-9136-b073cba9db8b req-5054f241-16c8-4108-b88b-c592122fd9f8 service nova] [instance: 9633e6bb-5e95-4994-92a2-9d8f85a946ff] Received unexpected event network-vif-plugged-6beaf63f-0750-4c6a-b0bd-ebfbca211ad1 for instance with vm_state active and task_state None.
Oct 26 00:07:37 user nova-compute[75165]: DEBUG nova.compute.manager [None req-fc7b823a-9e61-4fab-b9a0-528ca2ebc895 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] [instance: 6f9add59-cabe-4965-8fe3-524618550581] Instance event wait completed in 0 seconds for  {{(pid=75165) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 00:07:37 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-fc7b823a-9e61-4fab-b9a0-528ca2ebc895 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] [instance: 6f9add59-cabe-4965-8fe3-524618550581] Guest created on hypervisor {{(pid=75165) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 00:07:37 user nova-compute[75165]: INFO nova.compute.manager [None req-26a64c2e-3ffa-417d-920d-0886e701b786 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] Took 23.13 seconds to spawn the instance on the hypervisor.
Oct 26 00:07:37 user nova-compute[75165]: DEBUG nova.compute.manager [None req-26a64c2e-3ffa-417d-920d-0886e701b786 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] Checking state {{(pid=75165) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 00:07:37 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: 6f9add59-cabe-4965-8fe3-524618550581] Instance spawned successfully.
Oct 26 00:07:37 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-fc7b823a-9e61-4fab-b9a0-528ca2ebc895 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] [instance: 6f9add59-cabe-4965-8fe3-524618550581] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 00:07:37 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-fc7b823a-9e61-4fab-b9a0-528ca2ebc895 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] [instance: 6f9add59-cabe-4965-8fe3-524618550581] Found default for hw_cdrom_bus of ide {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:07:37 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-fc7b823a-9e61-4fab-b9a0-528ca2ebc895 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] [instance: 6f9add59-cabe-4965-8fe3-524618550581] Found default for hw_disk_bus of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:07:37 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-fc7b823a-9e61-4fab-b9a0-528ca2ebc895 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] [instance: 6f9add59-cabe-4965-8fe3-524618550581] Found default for hw_input_bus of None {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:07:37 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-fc7b823a-9e61-4fab-b9a0-528ca2ebc895 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] [instance: 6f9add59-cabe-4965-8fe3-524618550581] Found default for hw_pointer_model of None {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:07:37 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-fc7b823a-9e61-4fab-b9a0-528ca2ebc895 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] [instance: 6f9add59-cabe-4965-8fe3-524618550581] Found default for hw_video_model of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:07:37 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-fc7b823a-9e61-4fab-b9a0-528ca2ebc895 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] [instance: 6f9add59-cabe-4965-8fe3-524618550581] Found default for hw_vif_model of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:07:37 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:38 user nova-compute[75165]: INFO nova.compute.manager [None req-fc7b823a-9e61-4fab-b9a0-528ca2ebc895 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] [instance: 6f9add59-cabe-4965-8fe3-524618550581] Took 21.73 seconds to spawn the instance on the hypervisor.
Oct 26 00:07:38 user nova-compute[75165]: DEBUG nova.compute.manager [None req-fc7b823a-9e61-4fab-b9a0-528ca2ebc895 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] [instance: 6f9add59-cabe-4965-8fe3-524618550581] Checking state {{(pid=75165) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 00:07:38 user nova-compute[75165]: INFO nova.compute.manager [None req-26a64c2e-3ffa-417d-920d-0886e701b786 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] Took 24.61 seconds to build instance.
Oct 26 00:07:38 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-26a64c2e-3ffa-417d-920d-0886e701b786 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Lock "26a0b493-bb47-466e-95d5-945fc3849fa5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 24.771s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:07:38 user nova-compute[75165]: INFO nova.compute.manager [None req-fc7b823a-9e61-4fab-b9a0-528ca2ebc895 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] [instance: 6f9add59-cabe-4965-8fe3-524618550581] Took 23.69 seconds to build instance.
Oct 26 00:07:38 user nova-compute[75165]: DEBUG nova.compute.manager [None req-a2cf0630-846e-4208-9c81-8b7d5d545f44 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] Instance event wait completed in 0 seconds for  {{(pid=75165) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 00:07:38 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-a2cf0630-846e-4208-9c81-8b7d5d545f44 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] Guest created on hypervisor {{(pid=75165) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 00:07:38 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] Instance spawned successfully.
Oct 26 00:07:38 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-a2cf0630-846e-4208-9c81-8b7d5d545f44 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 00:07:38 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-fc7b823a-9e61-4fab-b9a0-528ca2ebc895 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Lock "6f9add59-cabe-4965-8fe3-524618550581" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 24.003s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:07:38 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-a2cf0630-846e-4208-9c81-8b7d5d545f44 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] Found default for hw_cdrom_bus of ide {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:07:38 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-a2cf0630-846e-4208-9c81-8b7d5d545f44 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] Found default for hw_disk_bus of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:07:38 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-a2cf0630-846e-4208-9c81-8b7d5d545f44 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] Found default for hw_input_bus of None {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:07:38 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-a2cf0630-846e-4208-9c81-8b7d5d545f44 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] Found default for hw_pointer_model of None {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:07:38 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-a2cf0630-846e-4208-9c81-8b7d5d545f44 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] Found default for hw_video_model of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:07:38 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-a2cf0630-846e-4208-9c81-8b7d5d545f44 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] Found default for hw_vif_model of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:07:38 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:38 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:38 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:38 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:38 user nova-compute[75165]: INFO nova.compute.manager [None req-a2cf0630-846e-4208-9c81-8b7d5d545f44 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] Took 22.98 seconds to spawn the instance on the hypervisor.
Oct 26 00:07:38 user nova-compute[75165]: DEBUG nova.compute.manager [None req-a2cf0630-846e-4208-9c81-8b7d5d545f44 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] Checking state {{(pid=75165) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 00:07:38 user nova-compute[75165]: INFO nova.compute.manager [None req-a2cf0630-846e-4208-9c81-8b7d5d545f44 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] Took 24.75 seconds to build instance.
Oct 26 00:07:38 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-a2cf0630-846e-4208-9c81-8b7d5d545f44 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Lock "3b153af2-c93b-47d2-ae8c-76cfd44e384c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 24.926s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:07:39 user nova-compute[75165]: DEBUG nova.compute.manager [req-728e7966-07e1-4d88-812c-0d9c3ca0af40 req-c1469871-d9ef-47bd-9795-dd687f9e1591 service nova] [instance: 9633e6bb-5e95-4994-92a2-9d8f85a946ff] Received event network-vif-plugged-6beaf63f-0750-4c6a-b0bd-ebfbca211ad1 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:07:39 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-728e7966-07e1-4d88-812c-0d9c3ca0af40 req-c1469871-d9ef-47bd-9795-dd687f9e1591 service nova] Acquiring lock "9633e6bb-5e95-4994-92a2-9d8f85a946ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:07:39 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-728e7966-07e1-4d88-812c-0d9c3ca0af40 req-c1469871-d9ef-47bd-9795-dd687f9e1591 service nova] Lock "9633e6bb-5e95-4994-92a2-9d8f85a946ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:07:39 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-728e7966-07e1-4d88-812c-0d9c3ca0af40 req-c1469871-d9ef-47bd-9795-dd687f9e1591 service nova] Lock "9633e6bb-5e95-4994-92a2-9d8f85a946ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:07:39 user nova-compute[75165]: DEBUG nova.compute.manager [req-728e7966-07e1-4d88-812c-0d9c3ca0af40 req-c1469871-d9ef-47bd-9795-dd687f9e1591 service nova] [instance: 9633e6bb-5e95-4994-92a2-9d8f85a946ff] No waiting events found dispatching network-vif-plugged-6beaf63f-0750-4c6a-b0bd-ebfbca211ad1 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:07:39 user nova-compute[75165]: WARNING nova.compute.manager [req-728e7966-07e1-4d88-812c-0d9c3ca0af40 req-c1469871-d9ef-47bd-9795-dd687f9e1591 service nova] [instance: 9633e6bb-5e95-4994-92a2-9d8f85a946ff] Received unexpected event network-vif-plugged-6beaf63f-0750-4c6a-b0bd-ebfbca211ad1 for instance with vm_state active and task_state None.
Oct 26 00:07:39 user nova-compute[75165]: DEBUG nova.compute.manager [req-728e7966-07e1-4d88-812c-0d9c3ca0af40 req-c1469871-d9ef-47bd-9795-dd687f9e1591 service nova] [instance: c4e44bfc-6a68-46ce-8335-aaaba5160d3e] Received event network-vif-plugged-842f3b7a-8da7-48d2-90f7-7241fbaab648 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:07:39 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-728e7966-07e1-4d88-812c-0d9c3ca0af40 req-c1469871-d9ef-47bd-9795-dd687f9e1591 service nova] Acquiring lock "c4e44bfc-6a68-46ce-8335-aaaba5160d3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:07:39 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-728e7966-07e1-4d88-812c-0d9c3ca0af40 req-c1469871-d9ef-47bd-9795-dd687f9e1591 service nova] Lock "c4e44bfc-6a68-46ce-8335-aaaba5160d3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:07:39 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-728e7966-07e1-4d88-812c-0d9c3ca0af40 req-c1469871-d9ef-47bd-9795-dd687f9e1591 service nova] Lock "c4e44bfc-6a68-46ce-8335-aaaba5160d3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:07:39 user nova-compute[75165]: DEBUG nova.compute.manager [req-728e7966-07e1-4d88-812c-0d9c3ca0af40 req-c1469871-d9ef-47bd-9795-dd687f9e1591 service nova] [instance: c4e44bfc-6a68-46ce-8335-aaaba5160d3e] No waiting events found dispatching network-vif-plugged-842f3b7a-8da7-48d2-90f7-7241fbaab648 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:07:39 user nova-compute[75165]: WARNING nova.compute.manager [req-728e7966-07e1-4d88-812c-0d9c3ca0af40 req-c1469871-d9ef-47bd-9795-dd687f9e1591 service nova] [instance: c4e44bfc-6a68-46ce-8335-aaaba5160d3e] Received unexpected event network-vif-plugged-842f3b7a-8da7-48d2-90f7-7241fbaab648 for instance with vm_state active and task_state None.
Oct 26 00:07:39 user nova-compute[75165]: DEBUG nova.compute.manager [req-728e7966-07e1-4d88-812c-0d9c3ca0af40 req-c1469871-d9ef-47bd-9795-dd687f9e1591 service nova] [instance: c4e44bfc-6a68-46ce-8335-aaaba5160d3e] Received event network-vif-plugged-842f3b7a-8da7-48d2-90f7-7241fbaab648 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:07:39 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-728e7966-07e1-4d88-812c-0d9c3ca0af40 req-c1469871-d9ef-47bd-9795-dd687f9e1591 service nova] Acquiring lock "c4e44bfc-6a68-46ce-8335-aaaba5160d3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:07:39 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-728e7966-07e1-4d88-812c-0d9c3ca0af40 req-c1469871-d9ef-47bd-9795-dd687f9e1591 service nova] Lock "c4e44bfc-6a68-46ce-8335-aaaba5160d3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:07:39 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-728e7966-07e1-4d88-812c-0d9c3ca0af40 req-c1469871-d9ef-47bd-9795-dd687f9e1591 service nova] Lock "c4e44bfc-6a68-46ce-8335-aaaba5160d3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:07:39 user nova-compute[75165]: DEBUG nova.compute.manager [req-728e7966-07e1-4d88-812c-0d9c3ca0af40 req-c1469871-d9ef-47bd-9795-dd687f9e1591 service nova] [instance: c4e44bfc-6a68-46ce-8335-aaaba5160d3e] No waiting events found dispatching network-vif-plugged-842f3b7a-8da7-48d2-90f7-7241fbaab648 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:07:39 user nova-compute[75165]: WARNING nova.compute.manager [req-728e7966-07e1-4d88-812c-0d9c3ca0af40 req-c1469871-d9ef-47bd-9795-dd687f9e1591 service nova] [instance: c4e44bfc-6a68-46ce-8335-aaaba5160d3e] Received unexpected event network-vif-plugged-842f3b7a-8da7-48d2-90f7-7241fbaab648 for instance with vm_state active and task_state None.
Oct 26 00:07:40 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:40 user nova-compute[75165]: DEBUG nova.compute.manager [None req-8761496d-0cb4-491c-a886-275d93d9f08d tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] [instance: f465963f-1d0f-4ca3-a8b8-681566b7d40a] Instance event wait completed in 0 seconds for  {{(pid=75165) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 00:07:40 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-8761496d-0cb4-491c-a886-275d93d9f08d tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] [instance: f465963f-1d0f-4ca3-a8b8-681566b7d40a] Guest created on hypervisor {{(pid=75165) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 00:07:40 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: f465963f-1d0f-4ca3-a8b8-681566b7d40a] Instance spawned successfully.
Oct 26 00:07:40 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-8761496d-0cb4-491c-a886-275d93d9f08d tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] [instance: f465963f-1d0f-4ca3-a8b8-681566b7d40a] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 00:07:40 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-8761496d-0cb4-491c-a886-275d93d9f08d tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] [instance: f465963f-1d0f-4ca3-a8b8-681566b7d40a] Found default for hw_input_bus of None {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:07:40 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-8761496d-0cb4-491c-a886-275d93d9f08d tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] [instance: f465963f-1d0f-4ca3-a8b8-681566b7d40a] Found default for hw_pointer_model of None {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:07:40 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-8761496d-0cb4-491c-a886-275d93d9f08d tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] [instance: f465963f-1d0f-4ca3-a8b8-681566b7d40a] Found default for hw_video_model of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:07:40 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-8761496d-0cb4-491c-a886-275d93d9f08d tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] [instance: f465963f-1d0f-4ca3-a8b8-681566b7d40a] Found default for hw_vif_model of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:07:41 user nova-compute[75165]: INFO nova.compute.manager [None req-8761496d-0cb4-491c-a886-275d93d9f08d tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] [instance: f465963f-1d0f-4ca3-a8b8-681566b7d40a] Took 12.65 seconds to spawn the instance on the hypervisor.
Oct 26 00:07:41 user nova-compute[75165]: DEBUG nova.compute.manager [None req-8761496d-0cb4-491c-a886-275d93d9f08d tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] [instance: f465963f-1d0f-4ca3-a8b8-681566b7d40a] Checking state {{(pid=75165) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 00:07:41 user nova-compute[75165]: INFO nova.compute.manager [None req-8761496d-0cb4-491c-a886-275d93d9f08d tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] [instance: f465963f-1d0f-4ca3-a8b8-681566b7d40a] Took 14.68 seconds to build instance.
Oct 26 00:07:41 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-8761496d-0cb4-491c-a886-275d93d9f08d tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] Lock "f465963f-1d0f-4ca3-a8b8-681566b7d40a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.121s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:07:42 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:45 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:45 user nova-compute[75165]: DEBUG nova.compute.manager [req-e2932640-c133-4e7a-9804-609b130dcf06 req-14263528-65f1-4856-a62e-1b275cbafd7c service nova] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] Received event network-vif-plugged-1d6d497c-7382-4dff-b136-d1220b05a838 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:07:45 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-e2932640-c133-4e7a-9804-609b130dcf06 req-14263528-65f1-4856-a62e-1b275cbafd7c service nova] Acquiring lock "26a0b493-bb47-466e-95d5-945fc3849fa5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:07:45 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-e2932640-c133-4e7a-9804-609b130dcf06 req-14263528-65f1-4856-a62e-1b275cbafd7c service nova] Lock "26a0b493-bb47-466e-95d5-945fc3849fa5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:07:45 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-e2932640-c133-4e7a-9804-609b130dcf06 req-14263528-65f1-4856-a62e-1b275cbafd7c service nova] Lock "26a0b493-bb47-466e-95d5-945fc3849fa5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:07:45 user nova-compute[75165]: DEBUG nova.compute.manager [req-e2932640-c133-4e7a-9804-609b130dcf06 req-14263528-65f1-4856-a62e-1b275cbafd7c service nova] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] No waiting events found dispatching network-vif-plugged-1d6d497c-7382-4dff-b136-d1220b05a838 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:07:45 user nova-compute[75165]: WARNING nova.compute.manager [req-e2932640-c133-4e7a-9804-609b130dcf06 req-14263528-65f1-4856-a62e-1b275cbafd7c service nova] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] Received unexpected event network-vif-plugged-1d6d497c-7382-4dff-b136-d1220b05a838 for instance with vm_state active and task_state None.
Oct 26 00:07:46 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-6df0e5c6-1c1c-4e66-addc-f8acbe0faa41 tempest-VolumesAssistedSnapshotsTest-1656989943 tempest-VolumesAssistedSnapshotsTest-1656989943-project-member] Acquiring lock "f326db85-74f6-4e60-9c55-46b2a59502d0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:07:46 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-6df0e5c6-1c1c-4e66-addc-f8acbe0faa41 tempest-VolumesAssistedSnapshotsTest-1656989943 tempest-VolumesAssistedSnapshotsTest-1656989943-project-member] Lock "f326db85-74f6-4e60-9c55-46b2a59502d0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:07:46 user nova-compute[75165]: DEBUG nova.compute.manager [None req-6df0e5c6-1c1c-4e66-addc-f8acbe0faa41 tempest-VolumesAssistedSnapshotsTest-1656989943 tempest-VolumesAssistedSnapshotsTest-1656989943-project-member] [instance: f326db85-74f6-4e60-9c55-46b2a59502d0] Starting instance... {{(pid=75165) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 00:07:46 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-6df0e5c6-1c1c-4e66-addc-f8acbe0faa41 tempest-VolumesAssistedSnapshotsTest-1656989943 tempest-VolumesAssistedSnapshotsTest-1656989943-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:07:46 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-6df0e5c6-1c1c-4e66-addc-f8acbe0faa41 tempest-VolumesAssistedSnapshotsTest-1656989943 tempest-VolumesAssistedSnapshotsTest-1656989943-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:07:46 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-6df0e5c6-1c1c-4e66-addc-f8acbe0faa41 tempest-VolumesAssistedSnapshotsTest-1656989943 tempest-VolumesAssistedSnapshotsTest-1656989943-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75165) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 00:07:46 user nova-compute[75165]: INFO nova.compute.claims [None req-6df0e5c6-1c1c-4e66-addc-f8acbe0faa41 tempest-VolumesAssistedSnapshotsTest-1656989943 tempest-VolumesAssistedSnapshotsTest-1656989943-project-member] [instance: f326db85-74f6-4e60-9c55-46b2a59502d0] Claim successful on node user
Oct 26 00:07:46 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:47 user nova-compute[75165]: DEBUG nova.compute.manager [req-bb04a005-89c0-4234-a737-58f3ef4b1c38 req-bf6b8d0f-59b5-481f-af0e-50e63558a1f8 service nova] [instance: 84c6b624-648b-40e2-a37e-ff08609bad84] Received event network-vif-plugged-2107529c-ec0e-4d1d-85b4-8605dcabc415 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:07:47 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-bb04a005-89c0-4234-a737-58f3ef4b1c38 req-bf6b8d0f-59b5-481f-af0e-50e63558a1f8 service nova] Acquiring lock "84c6b624-648b-40e2-a37e-ff08609bad84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:07:47 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-bb04a005-89c0-4234-a737-58f3ef4b1c38 req-bf6b8d0f-59b5-481f-af0e-50e63558a1f8 service nova] Lock "84c6b624-648b-40e2-a37e-ff08609bad84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:07:47 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-bb04a005-89c0-4234-a737-58f3ef4b1c38 req-bf6b8d0f-59b5-481f-af0e-50e63558a1f8 service nova] Lock "84c6b624-648b-40e2-a37e-ff08609bad84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:07:47 user nova-compute[75165]: DEBUG nova.compute.manager [req-bb04a005-89c0-4234-a737-58f3ef4b1c38 req-bf6b8d0f-59b5-481f-af0e-50e63558a1f8 service nova] [instance: 84c6b624-648b-40e2-a37e-ff08609bad84] No waiting events found dispatching network-vif-plugged-2107529c-ec0e-4d1d-85b4-8605dcabc415 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:07:47 user nova-compute[75165]: WARNING nova.compute.manager [req-bb04a005-89c0-4234-a737-58f3ef4b1c38 req-bf6b8d0f-59b5-481f-af0e-50e63558a1f8 service nova] [instance: 84c6b624-648b-40e2-a37e-ff08609bad84] Received unexpected event network-vif-plugged-2107529c-ec0e-4d1d-85b4-8605dcabc415 for instance with vm_state active and task_state None.
Oct 26 00:07:47 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-6df0e5c6-1c1c-4e66-addc-f8acbe0faa41 tempest-VolumesAssistedSnapshotsTest-1656989943 tempest-VolumesAssistedSnapshotsTest-1656989943-project-member] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:07:47 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-6df0e5c6-1c1c-4e66-addc-f8acbe0faa41 tempest-VolumesAssistedSnapshotsTest-1656989943 tempest-VolumesAssistedSnapshotsTest-1656989943-project-member] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:07:47 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:48 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-6df0e5c6-1c1c-4e66-addc-f8acbe0faa41 tempest-VolumesAssistedSnapshotsTest-1656989943 tempest-VolumesAssistedSnapshotsTest-1656989943-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.243s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:07:48 user nova-compute[75165]: DEBUG nova.compute.manager [None req-6df0e5c6-1c1c-4e66-addc-f8acbe0faa41 tempest-VolumesAssistedSnapshotsTest-1656989943 tempest-VolumesAssistedSnapshotsTest-1656989943-project-member] [instance: f326db85-74f6-4e60-9c55-46b2a59502d0] Start building networks asynchronously for instance. {{(pid=75165) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 00:07:48 user nova-compute[75165]: DEBUG nova.compute.manager [req-1cbc9240-0ff9-4133-afe3-4fb730e15862 req-d653a6c3-296e-489e-8607-7c62fa182884 service nova] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] Received event network-vif-plugged-1d6d497c-7382-4dff-b136-d1220b05a838 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:07:48 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-1cbc9240-0ff9-4133-afe3-4fb730e15862 req-d653a6c3-296e-489e-8607-7c62fa182884 service nova] Acquiring lock "26a0b493-bb47-466e-95d5-945fc3849fa5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:07:48 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-1cbc9240-0ff9-4133-afe3-4fb730e15862 req-d653a6c3-296e-489e-8607-7c62fa182884 service nova] Lock "26a0b493-bb47-466e-95d5-945fc3849fa5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.007s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:07:48 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-1cbc9240-0ff9-4133-afe3-4fb730e15862 req-d653a6c3-296e-489e-8607-7c62fa182884 service nova] Lock "26a0b493-bb47-466e-95d5-945fc3849fa5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:07:48 user nova-compute[75165]: DEBUG nova.compute.manager [req-1cbc9240-0ff9-4133-afe3-4fb730e15862 req-d653a6c3-296e-489e-8607-7c62fa182884 service nova] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] No waiting events found dispatching network-vif-plugged-1d6d497c-7382-4dff-b136-d1220b05a838 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:07:48 user nova-compute[75165]: WARNING nova.compute.manager [req-1cbc9240-0ff9-4133-afe3-4fb730e15862 req-d653a6c3-296e-489e-8607-7c62fa182884 service nova] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] Received unexpected event network-vif-plugged-1d6d497c-7382-4dff-b136-d1220b05a838 for instance with vm_state active and task_state None.
Oct 26 00:07:48 user nova-compute[75165]: DEBUG nova.compute.manager [None req-6df0e5c6-1c1c-4e66-addc-f8acbe0faa41 tempest-VolumesAssistedSnapshotsTest-1656989943 tempest-VolumesAssistedSnapshotsTest-1656989943-project-member] [instance: f326db85-74f6-4e60-9c55-46b2a59502d0] Allocating IP information in the background. {{(pid=75165) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 00:07:48 user nova-compute[75165]: DEBUG nova.network.neutron [None req-6df0e5c6-1c1c-4e66-addc-f8acbe0faa41 tempest-VolumesAssistedSnapshotsTest-1656989943 tempest-VolumesAssistedSnapshotsTest-1656989943-project-member] [instance: f326db85-74f6-4e60-9c55-46b2a59502d0] allocate_for_instance() {{(pid=75165) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 00:07:48 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-6df0e5c6-1c1c-4e66-addc-f8acbe0faa41 tempest-VolumesAssistedSnapshotsTest-1656989943 tempest-VolumesAssistedSnapshotsTest-1656989943-project-member] [instance: f326db85-74f6-4e60-9c55-46b2a59502d0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 00:07:48 user nova-compute[75165]: DEBUG nova.compute.manager [None req-6df0e5c6-1c1c-4e66-addc-f8acbe0faa41 tempest-VolumesAssistedSnapshotsTest-1656989943 tempest-VolumesAssistedSnapshotsTest-1656989943-project-member] [instance: f326db85-74f6-4e60-9c55-46b2a59502d0] Start building block device mappings for instance. {{(pid=75165) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 00:07:48 user nova-compute[75165]: DEBUG nova.policy [None req-6df0e5c6-1c1c-4e66-addc-f8acbe0faa41 tempest-VolumesAssistedSnapshotsTest-1656989943 tempest-VolumesAssistedSnapshotsTest-1656989943-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b26a2b84140e412589a813c9f0dac148', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc4d929d240d4d4d93d5926abe61df9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75165) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 00:07:48 user nova-compute[75165]: DEBUG nova.compute.manager [None req-6df0e5c6-1c1c-4e66-addc-f8acbe0faa41 tempest-VolumesAssistedSnapshotsTest-1656989943 tempest-VolumesAssistedSnapshotsTest-1656989943-project-member] [instance: f326db85-74f6-4e60-9c55-46b2a59502d0] Start spawning the instance on the hypervisor. {{(pid=75165) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 00:07:48 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-6df0e5c6-1c1c-4e66-addc-f8acbe0faa41 tempest-VolumesAssistedSnapshotsTest-1656989943 tempest-VolumesAssistedSnapshotsTest-1656989943-project-member] [instance: f326db85-74f6-4e60-9c55-46b2a59502d0] Creating instance directory {{(pid=75165) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 00:07:48 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-6df0e5c6-1c1c-4e66-addc-f8acbe0faa41 tempest-VolumesAssistedSnapshotsTest-1656989943 tempest-VolumesAssistedSnapshotsTest-1656989943-project-member] [instance: f326db85-74f6-4e60-9c55-46b2a59502d0] Creating image(s)
Oct 26 00:07:48 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-6df0e5c6-1c1c-4e66-addc-f8acbe0faa41 tempest-VolumesAssistedSnapshotsTest-1656989943 tempest-VolumesAssistedSnapshotsTest-1656989943-project-member] Acquiring lock "/opt/stack/data/nova/instances/f326db85-74f6-4e60-9c55-46b2a59502d0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:07:48 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-6df0e5c6-1c1c-4e66-addc-f8acbe0faa41 tempest-VolumesAssistedSnapshotsTest-1656989943 tempest-VolumesAssistedSnapshotsTest-1656989943-project-member] Lock "/opt/stack/data/nova/instances/f326db85-74f6-4e60-9c55-46b2a59502d0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:07:48 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-6df0e5c6-1c1c-4e66-addc-f8acbe0faa41 tempest-VolumesAssistedSnapshotsTest-1656989943 tempest-VolumesAssistedSnapshotsTest-1656989943-project-member] Lock "/opt/stack/data/nova/instances/f326db85-74f6-4e60-9c55-46b2a59502d0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:07:48 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-6df0e5c6-1c1c-4e66-addc-f8acbe0faa41 tempest-VolumesAssistedSnapshotsTest-1656989943 tempest-VolumesAssistedSnapshotsTest-1656989943-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:07:49 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-6df0e5c6-1c1c-4e66-addc-f8acbe0faa41 tempest-VolumesAssistedSnapshotsTest-1656989943 tempest-VolumesAssistedSnapshotsTest-1656989943-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json" returned: 0 in 0.296s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:07:49 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-6df0e5c6-1c1c-4e66-addc-f8acbe0faa41 tempest-VolumesAssistedSnapshotsTest-1656989943 tempest-VolumesAssistedSnapshotsTest-1656989943-project-member] Acquiring lock "7d3243421cf3fdc288b758f687a93103b7b95466" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:07:49 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-6df0e5c6-1c1c-4e66-addc-f8acbe0faa41 tempest-VolumesAssistedSnapshotsTest-1656989943 tempest-VolumesAssistedSnapshotsTest-1656989943-project-member] Lock "7d3243421cf3fdc288b758f687a93103b7b95466" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:07:49 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-6df0e5c6-1c1c-4e66-addc-f8acbe0faa41 tempest-VolumesAssistedSnapshotsTest-1656989943 tempest-VolumesAssistedSnapshotsTest-1656989943-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:07:49 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-c44639b7-24ff-456f-85ae-d61f41b82336 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] Acquiring lock "45625147-ff69-496a-a41e-e55f818a020a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:07:49 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-c44639b7-24ff-456f-85ae-d61f41b82336 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] Lock "45625147-ff69-496a-a41e-e55f818a020a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:07:49 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-6df0e5c6-1c1c-4e66-addc-f8acbe0faa41 tempest-VolumesAssistedSnapshotsTest-1656989943 tempest-VolumesAssistedSnapshotsTest-1656989943-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json" returned: 0 in 0.446s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:07:49 user nova-compute[75165]: DEBUG nova.compute.manager [req-234b9cc7-ca0d-4500-80b9-77dc31e21814 req-65af68e9-bb19-4362-bf6a-b7dbf83c7f56 service nova] [instance: 84c6b624-648b-40e2-a37e-ff08609bad84] Received event network-vif-plugged-2107529c-ec0e-4d1d-85b4-8605dcabc415 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:07:49 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-234b9cc7-ca0d-4500-80b9-77dc31e21814 req-65af68e9-bb19-4362-bf6a-b7dbf83c7f56 service nova] Acquiring lock "84c6b624-648b-40e2-a37e-ff08609bad84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:07:49 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-234b9cc7-ca0d-4500-80b9-77dc31e21814 req-65af68e9-bb19-4362-bf6a-b7dbf83c7f56 service nova] Lock "84c6b624-648b-40e2-a37e-ff08609bad84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:07:49 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-234b9cc7-ca0d-4500-80b9-77dc31e21814 req-65af68e9-bb19-4362-bf6a-b7dbf83c7f56 service nova] Lock "84c6b624-648b-40e2-a37e-ff08609bad84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:07:49 user nova-compute[75165]: DEBUG nova.compute.manager [req-234b9cc7-ca0d-4500-80b9-77dc31e21814 req-65af68e9-bb19-4362-bf6a-b7dbf83c7f56 service nova] [instance: 84c6b624-648b-40e2-a37e-ff08609bad84] No waiting events found dispatching network-vif-plugged-2107529c-ec0e-4d1d-85b4-8605dcabc415 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:07:49 user nova-compute[75165]: WARNING nova.compute.manager [req-234b9cc7-ca0d-4500-80b9-77dc31e21814 req-65af68e9-bb19-4362-bf6a-b7dbf83c7f56 service nova] [instance: 84c6b624-648b-40e2-a37e-ff08609bad84] Received unexpected event network-vif-plugged-2107529c-ec0e-4d1d-85b4-8605dcabc415 for instance with vm_state active and task_state None.
Oct 26 00:07:49 user nova-compute[75165]: DEBUG nova.compute.manager [req-234b9cc7-ca0d-4500-80b9-77dc31e21814 req-65af68e9-bb19-4362-bf6a-b7dbf83c7f56 service nova] [instance: 18dcf77e-fac2-4b38-ad1c-1f52ce14704a] Received event network-vif-plugged-7d1fdd51-5be0-40fd-bb7a-ef881af8f4f8 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:07:49 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-234b9cc7-ca0d-4500-80b9-77dc31e21814 req-65af68e9-bb19-4362-bf6a-b7dbf83c7f56 service nova] Acquiring lock "18dcf77e-fac2-4b38-ad1c-1f52ce14704a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:07:49 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-234b9cc7-ca0d-4500-80b9-77dc31e21814 req-65af68e9-bb19-4362-bf6a-b7dbf83c7f56 service nova] Lock "18dcf77e-fac2-4b38-ad1c-1f52ce14704a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:07:49 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-234b9cc7-ca0d-4500-80b9-77dc31e21814 req-65af68e9-bb19-4362-bf6a-b7dbf83c7f56 service nova] Lock "18dcf77e-fac2-4b38-ad1c-1f52ce14704a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:07:49 user nova-compute[75165]: DEBUG nova.compute.manager [req-234b9cc7-ca0d-4500-80b9-77dc31e21814 req-65af68e9-bb19-4362-bf6a-b7dbf83c7f56 service nova] [instance: 18dcf77e-fac2-4b38-ad1c-1f52ce14704a] No waiting events found dispatching network-vif-plugged-7d1fdd51-5be0-40fd-bb7a-ef881af8f4f8 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:07:49 user nova-compute[75165]: WARNING nova.compute.manager [req-234b9cc7-ca0d-4500-80b9-77dc31e21814 req-65af68e9-bb19-4362-bf6a-b7dbf83c7f56 service nova] [instance: 18dcf77e-fac2-4b38-ad1c-1f52ce14704a] Received unexpected event network-vif-plugged-7d1fdd51-5be0-40fd-bb7a-ef881af8f4f8 for instance with vm_state active and task_state None.
Oct 26 00:07:49 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-6df0e5c6-1c1c-4e66-addc-f8acbe0faa41 tempest-VolumesAssistedSnapshotsTest-1656989943 tempest-VolumesAssistedSnapshotsTest-1656989943-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466,backing_fmt=raw /opt/stack/data/nova/instances/f326db85-74f6-4e60-9c55-46b2a59502d0/disk 1073741824 {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:07:49 user nova-compute[75165]: DEBUG nova.compute.manager [None req-c44639b7-24ff-456f-85ae-d61f41b82336 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] [instance: 45625147-ff69-496a-a41e-e55f818a020a] Starting instance... {{(pid=75165) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 00:07:49 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-6df0e5c6-1c1c-4e66-addc-f8acbe0faa41 tempest-VolumesAssistedSnapshotsTest-1656989943 tempest-VolumesAssistedSnapshotsTest-1656989943-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466,backing_fmt=raw /opt/stack/data/nova/instances/f326db85-74f6-4e60-9c55-46b2a59502d0/disk 1073741824" returned: 0 in 0.108s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:07:49 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-6df0e5c6-1c1c-4e66-addc-f8acbe0faa41 tempest-VolumesAssistedSnapshotsTest-1656989943 tempest-VolumesAssistedSnapshotsTest-1656989943-project-member] Lock "7d3243421cf3fdc288b758f687a93103b7b95466" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.580s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:07:49 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-6df0e5c6-1c1c-4e66-addc-f8acbe0faa41 tempest-VolumesAssistedSnapshotsTest-1656989943 tempest-VolumesAssistedSnapshotsTest-1656989943-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:07:49 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-c44639b7-24ff-456f-85ae-d61f41b82336 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:07:49 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-c44639b7-24ff-456f-85ae-d61f41b82336 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.006s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:07:49 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-c44639b7-24ff-456f-85ae-d61f41b82336 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75165) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 00:07:49 user nova-compute[75165]: INFO nova.compute.claims [None req-c44639b7-24ff-456f-85ae-d61f41b82336 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] [instance: 45625147-ff69-496a-a41e-e55f818a020a] Claim successful on node user
Oct 26 00:07:50 user nova-compute[75165]: DEBUG nova.compute.manager [req-a2a0e07d-7cfb-453d-baa7-9bc30e3bc23c req-0fddacef-b616-4835-b134-1dd683ac7a1b service nova] [instance: a7eeb145-1565-4812-818b-fefda5f2436d] Received event network-vif-plugged-7a43d085-a683-4c49-a7c8-13b8f35c943d {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:07:50 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-a2a0e07d-7cfb-453d-baa7-9bc30e3bc23c req-0fddacef-b616-4835-b134-1dd683ac7a1b service nova] Acquiring lock "a7eeb145-1565-4812-818b-fefda5f2436d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:07:50 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-a2a0e07d-7cfb-453d-baa7-9bc30e3bc23c req-0fddacef-b616-4835-b134-1dd683ac7a1b service nova] Lock "a7eeb145-1565-4812-818b-fefda5f2436d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:07:50 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-a2a0e07d-7cfb-453d-baa7-9bc30e3bc23c req-0fddacef-b616-4835-b134-1dd683ac7a1b service nova] Lock "a7eeb145-1565-4812-818b-fefda5f2436d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:07:50 user nova-compute[75165]: DEBUG nova.compute.manager [req-a2a0e07d-7cfb-453d-baa7-9bc30e3bc23c req-0fddacef-b616-4835-b134-1dd683ac7a1b service nova] [instance: a7eeb145-1565-4812-818b-fefda5f2436d] No waiting events found dispatching network-vif-plugged-7a43d085-a683-4c49-a7c8-13b8f35c943d {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:07:50 user nova-compute[75165]: WARNING nova.compute.manager [req-a2a0e07d-7cfb-453d-baa7-9bc30e3bc23c req-0fddacef-b616-4835-b134-1dd683ac7a1b service nova] [instance: a7eeb145-1565-4812-818b-fefda5f2436d] Received unexpected event network-vif-plugged-7a43d085-a683-4c49-a7c8-13b8f35c943d for instance with vm_state active and task_state None.
Oct 26 00:07:50 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-6df0e5c6-1c1c-4e66-addc-f8acbe0faa41 tempest-VolumesAssistedSnapshotsTest-1656989943 tempest-VolumesAssistedSnapshotsTest-1656989943-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json" returned: 0 in 0.353s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:07:50 user nova-compute[75165]: DEBUG nova.virt.disk.api [None req-6df0e5c6-1c1c-4e66-addc-f8acbe0faa41 tempest-VolumesAssistedSnapshotsTest-1656989943 tempest-VolumesAssistedSnapshotsTest-1656989943-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f326db85-74f6-4e60-9c55-46b2a59502d0/disk. size=1073741824 {{(pid=75165) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 00:07:50 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-6df0e5c6-1c1c-4e66-addc-f8acbe0faa41 tempest-VolumesAssistedSnapshotsTest-1656989943 tempest-VolumesAssistedSnapshotsTest-1656989943-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f326db85-74f6-4e60-9c55-46b2a59502d0/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:07:50 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-6df0e5c6-1c1c-4e66-addc-f8acbe0faa41 tempest-VolumesAssistedSnapshotsTest-1656989943 tempest-VolumesAssistedSnapshotsTest-1656989943-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f326db85-74f6-4e60-9c55-46b2a59502d0/disk --force-share --output=json" returned: 0 in 0.315s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:07:50 user nova-compute[75165]: DEBUG nova.virt.disk.api [None req-6df0e5c6-1c1c-4e66-addc-f8acbe0faa41 tempest-VolumesAssistedSnapshotsTest-1656989943 tempest-VolumesAssistedSnapshotsTest-1656989943-project-member] Cannot resize image /opt/stack/data/nova/instances/f326db85-74f6-4e60-9c55-46b2a59502d0/disk to a smaller size. {{(pid=75165) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 00:07:50 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-6df0e5c6-1c1c-4e66-addc-f8acbe0faa41 tempest-VolumesAssistedSnapshotsTest-1656989943 tempest-VolumesAssistedSnapshotsTest-1656989943-project-member] [instance: f326db85-74f6-4e60-9c55-46b2a59502d0] Created local disks {{(pid=75165) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 00:07:50 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-6df0e5c6-1c1c-4e66-addc-f8acbe0faa41 tempest-VolumesAssistedSnapshotsTest-1656989943 tempest-VolumesAssistedSnapshotsTest-1656989943-project-member] [instance: f326db85-74f6-4e60-9c55-46b2a59502d0] Ensure instance console log exists: /opt/stack/data/nova/instances/f326db85-74f6-4e60-9c55-46b2a59502d0/console.log {{(pid=75165) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 00:07:50 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-6df0e5c6-1c1c-4e66-addc-f8acbe0faa41 tempest-VolumesAssistedSnapshotsTest-1656989943 tempest-VolumesAssistedSnapshotsTest-1656989943-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:07:50 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-6df0e5c6-1c1c-4e66-addc-f8acbe0faa41 tempest-VolumesAssistedSnapshotsTest-1656989943 tempest-VolumesAssistedSnapshotsTest-1656989943-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:07:50 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-6df0e5c6-1c1c-4e66-addc-f8acbe0faa41 tempest-VolumesAssistedSnapshotsTest-1656989943 tempest-VolumesAssistedSnapshotsTest-1656989943-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:07:50 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:50 user nova-compute[75165]: DEBUG nova.network.neutron [None req-6df0e5c6-1c1c-4e66-addc-f8acbe0faa41 tempest-VolumesAssistedSnapshotsTest-1656989943 tempest-VolumesAssistedSnapshotsTest-1656989943-project-member] [instance: f326db85-74f6-4e60-9c55-46b2a59502d0] Successfully created port: 26b16dce-35d4-4756-8eea-c3638f5b6c16 {{(pid=75165) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 00:07:50 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-c44639b7-24ff-456f-85ae-d61f41b82336 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:07:50 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-c44639b7-24ff-456f-85ae-d61f41b82336 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:07:50 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-c44639b7-24ff-456f-85ae-d61f41b82336 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.052s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:07:50 user nova-compute[75165]: DEBUG nova.compute.manager [None req-c44639b7-24ff-456f-85ae-d61f41b82336 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] [instance: 45625147-ff69-496a-a41e-e55f818a020a] Start building networks asynchronously for instance. {{(pid=75165) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 00:07:51 user nova-compute[75165]: DEBUG nova.compute.manager [None req-c44639b7-24ff-456f-85ae-d61f41b82336 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] [instance: 45625147-ff69-496a-a41e-e55f818a020a] Allocating IP information in the background. {{(pid=75165) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 00:07:51 user nova-compute[75165]: DEBUG nova.network.neutron [None req-c44639b7-24ff-456f-85ae-d61f41b82336 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] [instance: 45625147-ff69-496a-a41e-e55f818a020a] allocate_for_instance() {{(pid=75165) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 00:07:51 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-c44639b7-24ff-456f-85ae-d61f41b82336 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] [instance: 45625147-ff69-496a-a41e-e55f818a020a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 00:07:51 user nova-compute[75165]: DEBUG nova.compute.manager [None req-c44639b7-24ff-456f-85ae-d61f41b82336 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] [instance: 45625147-ff69-496a-a41e-e55f818a020a] Start building block device mappings for instance. {{(pid=75165) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 00:07:51 user nova-compute[75165]: DEBUG nova.compute.manager [None req-c44639b7-24ff-456f-85ae-d61f41b82336 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] [instance: 45625147-ff69-496a-a41e-e55f818a020a] Start spawning the instance on the hypervisor. {{(pid=75165) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 00:07:51 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-c44639b7-24ff-456f-85ae-d61f41b82336 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] [instance: 45625147-ff69-496a-a41e-e55f818a020a] Creating instance directory {{(pid=75165) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 00:07:51 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-c44639b7-24ff-456f-85ae-d61f41b82336 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] [instance: 45625147-ff69-496a-a41e-e55f818a020a] Creating image(s)
Oct 26 00:07:51 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-c44639b7-24ff-456f-85ae-d61f41b82336 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] Acquiring lock "/opt/stack/data/nova/instances/45625147-ff69-496a-a41e-e55f818a020a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:07:51 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-c44639b7-24ff-456f-85ae-d61f41b82336 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] Lock "/opt/stack/data/nova/instances/45625147-ff69-496a-a41e-e55f818a020a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:07:51 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-c44639b7-24ff-456f-85ae-d61f41b82336 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] Lock "/opt/stack/data/nova/instances/45625147-ff69-496a-a41e-e55f818a020a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:07:51 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-c44639b7-24ff-456f-85ae-d61f41b82336 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:07:51 user nova-compute[75165]: DEBUG nova.policy [None req-c44639b7-24ff-456f-85ae-d61f41b82336 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3bca70683da14dcb9023f9b15ae72d47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc552db87c094e77aee0361963486d93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75165) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 00:07:51 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-c44639b7-24ff-456f-85ae-d61f41b82336 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json" returned: 0 in 0.280s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:07:51 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-c44639b7-24ff-456f-85ae-d61f41b82336 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] Acquiring lock "7d3243421cf3fdc288b758f687a93103b7b95466" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:07:51 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-c44639b7-24ff-456f-85ae-d61f41b82336 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] Lock "7d3243421cf3fdc288b758f687a93103b7b95466" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.018s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:07:51 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-c44639b7-24ff-456f-85ae-d61f41b82336 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:07:51 user nova-compute[75165]: DEBUG nova.compute.manager [req-c1d4fa82-60eb-41a4-86e7-1556bee3af4d req-f6f4df0d-2d70-45fa-bad1-c806a98c6c4c service nova] [instance: 18dcf77e-fac2-4b38-ad1c-1f52ce14704a] Received event network-vif-plugged-7d1fdd51-5be0-40fd-bb7a-ef881af8f4f8 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:07:51 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-c1d4fa82-60eb-41a4-86e7-1556bee3af4d req-f6f4df0d-2d70-45fa-bad1-c806a98c6c4c service nova] Acquiring lock "18dcf77e-fac2-4b38-ad1c-1f52ce14704a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:07:51 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-c1d4fa82-60eb-41a4-86e7-1556bee3af4d req-f6f4df0d-2d70-45fa-bad1-c806a98c6c4c service nova] Lock "18dcf77e-fac2-4b38-ad1c-1f52ce14704a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:07:51 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-c1d4fa82-60eb-41a4-86e7-1556bee3af4d req-f6f4df0d-2d70-45fa-bad1-c806a98c6c4c service nova] Lock "18dcf77e-fac2-4b38-ad1c-1f52ce14704a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:07:51 user nova-compute[75165]: DEBUG nova.compute.manager [req-c1d4fa82-60eb-41a4-86e7-1556bee3af4d req-f6f4df0d-2d70-45fa-bad1-c806a98c6c4c service nova] [instance: 18dcf77e-fac2-4b38-ad1c-1f52ce14704a] No waiting events found dispatching network-vif-plugged-7d1fdd51-5be0-40fd-bb7a-ef881af8f4f8 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:07:51 user nova-compute[75165]: WARNING nova.compute.manager [req-c1d4fa82-60eb-41a4-86e7-1556bee3af4d req-f6f4df0d-2d70-45fa-bad1-c806a98c6c4c service nova] [instance: 18dcf77e-fac2-4b38-ad1c-1f52ce14704a] Received unexpected event network-vif-plugged-7d1fdd51-5be0-40fd-bb7a-ef881af8f4f8 for instance with vm_state active and task_state None.
Oct 26 00:07:51 user nova-compute[75165]: DEBUG nova.compute.manager [req-c1d4fa82-60eb-41a4-86e7-1556bee3af4d req-f6f4df0d-2d70-45fa-bad1-c806a98c6c4c service nova] [instance: 6f9add59-cabe-4965-8fe3-524618550581] Received event network-vif-plugged-50bf388e-b8ff-4924-9633-7e97d083a361 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:07:51 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-c1d4fa82-60eb-41a4-86e7-1556bee3af4d req-f6f4df0d-2d70-45fa-bad1-c806a98c6c4c service nova] Acquiring lock "6f9add59-cabe-4965-8fe3-524618550581-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:07:51 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-c1d4fa82-60eb-41a4-86e7-1556bee3af4d req-f6f4df0d-2d70-45fa-bad1-c806a98c6c4c service nova] Lock "6f9add59-cabe-4965-8fe3-524618550581-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:07:51 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-c1d4fa82-60eb-41a4-86e7-1556bee3af4d req-f6f4df0d-2d70-45fa-bad1-c806a98c6c4c service nova] Lock "6f9add59-cabe-4965-8fe3-524618550581-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:07:51 user nova-compute[75165]: DEBUG nova.compute.manager [req-c1d4fa82-60eb-41a4-86e7-1556bee3af4d req-f6f4df0d-2d70-45fa-bad1-c806a98c6c4c service nova] [instance: 6f9add59-cabe-4965-8fe3-524618550581] No waiting events found dispatching network-vif-plugged-50bf388e-b8ff-4924-9633-7e97d083a361 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:07:51 user nova-compute[75165]: WARNING nova.compute.manager [req-c1d4fa82-60eb-41a4-86e7-1556bee3af4d req-f6f4df0d-2d70-45fa-bad1-c806a98c6c4c service nova] [instance: 6f9add59-cabe-4965-8fe3-524618550581] Received unexpected event network-vif-plugged-50bf388e-b8ff-4924-9633-7e97d083a361 for instance with vm_state active and task_state None.
Oct 26 00:07:51 user nova-compute[75165]: DEBUG nova.compute.manager [req-c1d4fa82-60eb-41a4-86e7-1556bee3af4d req-f6f4df0d-2d70-45fa-bad1-c806a98c6c4c service nova] [instance: 6f9add59-cabe-4965-8fe3-524618550581] Received event network-vif-plugged-50bf388e-b8ff-4924-9633-7e97d083a361 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:07:51 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-c1d4fa82-60eb-41a4-86e7-1556bee3af4d req-f6f4df0d-2d70-45fa-bad1-c806a98c6c4c service nova] Acquiring lock "6f9add59-cabe-4965-8fe3-524618550581-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:07:51 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-c1d4fa82-60eb-41a4-86e7-1556bee3af4d req-f6f4df0d-2d70-45fa-bad1-c806a98c6c4c service nova] Lock "6f9add59-cabe-4965-8fe3-524618550581-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:07:51 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-c1d4fa82-60eb-41a4-86e7-1556bee3af4d req-f6f4df0d-2d70-45fa-bad1-c806a98c6c4c service nova] Lock "6f9add59-cabe-4965-8fe3-524618550581-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:07:51 user nova-compute[75165]: DEBUG nova.compute.manager [req-c1d4fa82-60eb-41a4-86e7-1556bee3af4d req-f6f4df0d-2d70-45fa-bad1-c806a98c6c4c service nova] [instance: 6f9add59-cabe-4965-8fe3-524618550581] No waiting events found dispatching network-vif-plugged-50bf388e-b8ff-4924-9633-7e97d083a361 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:07:51 user nova-compute[75165]: WARNING nova.compute.manager [req-c1d4fa82-60eb-41a4-86e7-1556bee3af4d req-f6f4df0d-2d70-45fa-bad1-c806a98c6c4c service nova] [instance: 6f9add59-cabe-4965-8fe3-524618550581] Received unexpected event network-vif-plugged-50bf388e-b8ff-4924-9633-7e97d083a361 for instance with vm_state active and task_state None.
Oct 26 00:07:51 user nova-compute[75165]: DEBUG nova.compute.manager [req-c1d4fa82-60eb-41a4-86e7-1556bee3af4d req-f6f4df0d-2d70-45fa-bad1-c806a98c6c4c service nova] [instance: f465963f-1d0f-4ca3-a8b8-681566b7d40a] Received event network-vif-plugged-f382bfbf-798f-4f17-87ca-ff778203bab3 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:07:51 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-c1d4fa82-60eb-41a4-86e7-1556bee3af4d req-f6f4df0d-2d70-45fa-bad1-c806a98c6c4c service nova] Acquiring lock "f465963f-1d0f-4ca3-a8b8-681566b7d40a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:07:51 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-c1d4fa82-60eb-41a4-86e7-1556bee3af4d req-f6f4df0d-2d70-45fa-bad1-c806a98c6c4c service nova] Lock "f465963f-1d0f-4ca3-a8b8-681566b7d40a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:07:51 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-c1d4fa82-60eb-41a4-86e7-1556bee3af4d req-f6f4df0d-2d70-45fa-bad1-c806a98c6c4c service nova] Lock "f465963f-1d0f-4ca3-a8b8-681566b7d40a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:07:51 user nova-compute[75165]: DEBUG nova.compute.manager [req-c1d4fa82-60eb-41a4-86e7-1556bee3af4d req-f6f4df0d-2d70-45fa-bad1-c806a98c6c4c service nova] [instance: f465963f-1d0f-4ca3-a8b8-681566b7d40a] No waiting events found dispatching network-vif-plugged-f382bfbf-798f-4f17-87ca-ff778203bab3 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:07:51 user nova-compute[75165]: WARNING nova.compute.manager [req-c1d4fa82-60eb-41a4-86e7-1556bee3af4d req-f6f4df0d-2d70-45fa-bad1-c806a98c6c4c service nova] [instance: f465963f-1d0f-4ca3-a8b8-681566b7d40a] Received unexpected event network-vif-plugged-f382bfbf-798f-4f17-87ca-ff778203bab3 for instance with vm_state active and task_state None.
Oct 26 00:07:51 user nova-compute[75165]: DEBUG nova.compute.manager [req-c1d4fa82-60eb-41a4-86e7-1556bee3af4d req-f6f4df0d-2d70-45fa-bad1-c806a98c6c4c service nova] [instance: f465963f-1d0f-4ca3-a8b8-681566b7d40a] Received event network-vif-plugged-f382bfbf-798f-4f17-87ca-ff778203bab3 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:07:51 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-c1d4fa82-60eb-41a4-86e7-1556bee3af4d req-f6f4df0d-2d70-45fa-bad1-c806a98c6c4c service nova] Acquiring lock "f465963f-1d0f-4ca3-a8b8-681566b7d40a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:07:51 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-c1d4fa82-60eb-41a4-86e7-1556bee3af4d req-f6f4df0d-2d70-45fa-bad1-c806a98c6c4c service nova] Lock "f465963f-1d0f-4ca3-a8b8-681566b7d40a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:07:51 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-c1d4fa82-60eb-41a4-86e7-1556bee3af4d req-f6f4df0d-2d70-45fa-bad1-c806a98c6c4c service nova] Lock "f465963f-1d0f-4ca3-a8b8-681566b7d40a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:07:51 user nova-compute[75165]: DEBUG nova.compute.manager [req-c1d4fa82-60eb-41a4-86e7-1556bee3af4d req-f6f4df0d-2d70-45fa-bad1-c806a98c6c4c service nova] [instance: f465963f-1d0f-4ca3-a8b8-681566b7d40a] No waiting events found dispatching network-vif-plugged-f382bfbf-798f-4f17-87ca-ff778203bab3 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:07:51 user nova-compute[75165]: WARNING nova.compute.manager [req-c1d4fa82-60eb-41a4-86e7-1556bee3af4d req-f6f4df0d-2d70-45fa-bad1-c806a98c6c4c service nova] [instance: f465963f-1d0f-4ca3-a8b8-681566b7d40a] Received unexpected event network-vif-plugged-f382bfbf-798f-4f17-87ca-ff778203bab3 for instance with vm_state active and task_state None.
Oct 26 00:07:51 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-c44639b7-24ff-456f-85ae-d61f41b82336 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json" returned: 0 in 0.287s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:07:51 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-c44639b7-24ff-456f-85ae-d61f41b82336 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466,backing_fmt=raw /opt/stack/data/nova/instances/45625147-ff69-496a-a41e-e55f818a020a/disk 1073741824 {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:07:51 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-c44639b7-24ff-456f-85ae-d61f41b82336 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466,backing_fmt=raw /opt/stack/data/nova/instances/45625147-ff69-496a-a41e-e55f818a020a/disk 1073741824" returned: 0 in 0.071s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:07:51 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-c44639b7-24ff-456f-85ae-d61f41b82336 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] Lock "7d3243421cf3fdc288b758f687a93103b7b95466" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.364s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:07:51 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-c44639b7-24ff-456f-85ae-d61f41b82336 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:07:52 user nova-compute[75165]: DEBUG nova.compute.manager [req-7b0b7d59-caf9-4aeb-9810-45c05e3156be req-f15a8127-4f7e-41e2-9d01-f79a0dea10c5 service nova] [instance: a7eeb145-1565-4812-818b-fefda5f2436d] Received event network-vif-plugged-7a43d085-a683-4c49-a7c8-13b8f35c943d {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:07:52 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-7b0b7d59-caf9-4aeb-9810-45c05e3156be req-f15a8127-4f7e-41e2-9d01-f79a0dea10c5 service nova] Acquiring lock "a7eeb145-1565-4812-818b-fefda5f2436d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:07:52 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-7b0b7d59-caf9-4aeb-9810-45c05e3156be req-f15a8127-4f7e-41e2-9d01-f79a0dea10c5 service nova] Lock "a7eeb145-1565-4812-818b-fefda5f2436d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:07:52 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-7b0b7d59-caf9-4aeb-9810-45c05e3156be req-f15a8127-4f7e-41e2-9d01-f79a0dea10c5 service nova] Lock "a7eeb145-1565-4812-818b-fefda5f2436d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:07:52 user nova-compute[75165]: DEBUG nova.compute.manager [req-7b0b7d59-caf9-4aeb-9810-45c05e3156be req-f15a8127-4f7e-41e2-9d01-f79a0dea10c5 service nova] [instance: a7eeb145-1565-4812-818b-fefda5f2436d] No waiting events found dispatching network-vif-plugged-7a43d085-a683-4c49-a7c8-13b8f35c943d {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:07:52 user nova-compute[75165]: WARNING nova.compute.manager [req-7b0b7d59-caf9-4aeb-9810-45c05e3156be req-f15a8127-4f7e-41e2-9d01-f79a0dea10c5 service nova] [instance: a7eeb145-1565-4812-818b-fefda5f2436d] Received unexpected event network-vif-plugged-7a43d085-a683-4c49-a7c8-13b8f35c943d for instance with vm_state active and task_state None.
Oct 26 00:07:52 user nova-compute[75165]: DEBUG nova.compute.manager [req-7b0b7d59-caf9-4aeb-9810-45c05e3156be req-f15a8127-4f7e-41e2-9d01-f79a0dea10c5 service nova] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] Received event network-vif-plugged-874a1698-c52c-444c-bed5-52633dbaeead {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:07:52 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-7b0b7d59-caf9-4aeb-9810-45c05e3156be req-f15a8127-4f7e-41e2-9d01-f79a0dea10c5 service nova] Acquiring lock "3b153af2-c93b-47d2-ae8c-76cfd44e384c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:07:52 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-7b0b7d59-caf9-4aeb-9810-45c05e3156be req-f15a8127-4f7e-41e2-9d01-f79a0dea10c5 service nova] Lock "3b153af2-c93b-47d2-ae8c-76cfd44e384c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:07:52 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-7b0b7d59-caf9-4aeb-9810-45c05e3156be req-f15a8127-4f7e-41e2-9d01-f79a0dea10c5 service nova] Lock "3b153af2-c93b-47d2-ae8c-76cfd44e384c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:07:52 user nova-compute[75165]: DEBUG nova.compute.manager [req-7b0b7d59-caf9-4aeb-9810-45c05e3156be req-f15a8127-4f7e-41e2-9d01-f79a0dea10c5 service nova] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] No waiting events found dispatching network-vif-plugged-874a1698-c52c-444c-bed5-52633dbaeead {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:07:52 user nova-compute[75165]: WARNING nova.compute.manager [req-7b0b7d59-caf9-4aeb-9810-45c05e3156be req-f15a8127-4f7e-41e2-9d01-f79a0dea10c5 service nova] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] Received unexpected event network-vif-plugged-874a1698-c52c-444c-bed5-52633dbaeead for instance with vm_state active and task_state None.
Oct 26 00:07:52 user nova-compute[75165]: DEBUG nova.compute.manager [req-7b0b7d59-caf9-4aeb-9810-45c05e3156be req-f15a8127-4f7e-41e2-9d01-f79a0dea10c5 service nova] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] Received event network-vif-plugged-874a1698-c52c-444c-bed5-52633dbaeead {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:07:52 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-7b0b7d59-caf9-4aeb-9810-45c05e3156be req-f15a8127-4f7e-41e2-9d01-f79a0dea10c5 service nova] Acquiring lock "3b153af2-c93b-47d2-ae8c-76cfd44e384c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:07:52 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-7b0b7d59-caf9-4aeb-9810-45c05e3156be req-f15a8127-4f7e-41e2-9d01-f79a0dea10c5 service nova] Lock "3b153af2-c93b-47d2-ae8c-76cfd44e384c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:07:52 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-7b0b7d59-caf9-4aeb-9810-45c05e3156be req-f15a8127-4f7e-41e2-9d01-f79a0dea10c5 service nova] Lock "3b153af2-c93b-47d2-ae8c-76cfd44e384c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:07:52 user nova-compute[75165]: DEBUG nova.compute.manager [req-7b0b7d59-caf9-4aeb-9810-45c05e3156be req-f15a8127-4f7e-41e2-9d01-f79a0dea10c5 service nova] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] No waiting events found dispatching network-vif-plugged-874a1698-c52c-444c-bed5-52633dbaeead {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:07:52 user nova-compute[75165]: WARNING nova.compute.manager [req-7b0b7d59-caf9-4aeb-9810-45c05e3156be req-f15a8127-4f7e-41e2-9d01-f79a0dea10c5 service nova] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] Received unexpected event network-vif-plugged-874a1698-c52c-444c-bed5-52633dbaeead for instance with vm_state active and task_state None.
Oct 26 00:07:52 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-c44639b7-24ff-456f-85ae-d61f41b82336 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json" returned: 0 in 0.255s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:07:52 user nova-compute[75165]: DEBUG nova.virt.disk.api [None req-c44639b7-24ff-456f-85ae-d61f41b82336 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] Checking if we can resize image /opt/stack/data/nova/instances/45625147-ff69-496a-a41e-e55f818a020a/disk. size=1073741824 {{(pid=75165) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 00:07:52 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-c44639b7-24ff-456f-85ae-d61f41b82336 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45625147-ff69-496a-a41e-e55f818a020a/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:07:52 user nova-compute[75165]: DEBUG nova.network.neutron [None req-6df0e5c6-1c1c-4e66-addc-f8acbe0faa41 tempest-VolumesAssistedSnapshotsTest-1656989943 tempest-VolumesAssistedSnapshotsTest-1656989943-project-member] [instance: f326db85-74f6-4e60-9c55-46b2a59502d0] Successfully updated port: 26b16dce-35d4-4756-8eea-c3638f5b6c16 {{(pid=75165) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 00:07:52 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-6df0e5c6-1c1c-4e66-addc-f8acbe0faa41 tempest-VolumesAssistedSnapshotsTest-1656989943 tempest-VolumesAssistedSnapshotsTest-1656989943-project-member] Acquiring lock "refresh_cache-f326db85-74f6-4e60-9c55-46b2a59502d0" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:07:52 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-6df0e5c6-1c1c-4e66-addc-f8acbe0faa41 tempest-VolumesAssistedSnapshotsTest-1656989943 tempest-VolumesAssistedSnapshotsTest-1656989943-project-member] Acquired lock "refresh_cache-f326db85-74f6-4e60-9c55-46b2a59502d0" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:07:52 user nova-compute[75165]: DEBUG nova.network.neutron [None req-6df0e5c6-1c1c-4e66-addc-f8acbe0faa41 tempest-VolumesAssistedSnapshotsTest-1656989943 tempest-VolumesAssistedSnapshotsTest-1656989943-project-member] [instance: f326db85-74f6-4e60-9c55-46b2a59502d0] Building network info cache for instance {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 00:07:52 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-c44639b7-24ff-456f-85ae-d61f41b82336 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45625147-ff69-496a-a41e-e55f818a020a/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:07:52 user nova-compute[75165]: DEBUG nova.virt.disk.api [None req-c44639b7-24ff-456f-85ae-d61f41b82336 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] Cannot resize image /opt/stack/data/nova/instances/45625147-ff69-496a-a41e-e55f818a020a/disk to a smaller size. {{(pid=75165) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 00:07:52 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-c44639b7-24ff-456f-85ae-d61f41b82336 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] [instance: 45625147-ff69-496a-a41e-e55f818a020a] Created local disks {{(pid=75165) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 00:07:52 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-c44639b7-24ff-456f-85ae-d61f41b82336 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] [instance: 45625147-ff69-496a-a41e-e55f818a020a] Ensure instance console log exists: /opt/stack/data/nova/instances/45625147-ff69-496a-a41e-e55f818a020a/console.log {{(pid=75165) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 00:07:52 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-c44639b7-24ff-456f-85ae-d61f41b82336 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:07:52 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-c44639b7-24ff-456f-85ae-d61f41b82336 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:07:52 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-c44639b7-24ff-456f-85ae-d61f41b82336 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:07:52 user nova-compute[75165]: DEBUG nova.network.neutron [None req-6df0e5c6-1c1c-4e66-addc-f8acbe0faa41 tempest-VolumesAssistedSnapshotsTest-1656989943 tempest-VolumesAssistedSnapshotsTest-1656989943-project-member] [instance: f326db85-74f6-4e60-9c55-46b2a59502d0] Instance cache missing network info. {{(pid=75165) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 00:07:52 user nova-compute[75165]: DEBUG nova.network.neutron [None req-c44639b7-24ff-456f-85ae-d61f41b82336 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] [instance: 45625147-ff69-496a-a41e-e55f818a020a] Successfully created port: 7fb6b434-f67e-4199-90c4-fa1fad18e7d3 {{(pid=75165) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 00:07:52 user nova-compute[75165]: DEBUG nova.network.neutron [None req-6df0e5c6-1c1c-4e66-addc-f8acbe0faa41 tempest-VolumesAssistedSnapshotsTest-1656989943 tempest-VolumesAssistedSnapshotsTest-1656989943-project-member] [instance: f326db85-74f6-4e60-9c55-46b2a59502d0] Updating instance_info_cache with network_info: [{"id": "26b16dce-35d4-4756-8eea-c3638f5b6c16", "address": "fa:16:3e:03:0d:40", "network": {"id": "2391bc4b-c0f5-4644-94d8-37a74146506d", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2088537358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc4d929d240d4d4d93d5926abe61df9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26b16dce-35", "ovs_interfaceid": "26b16dce-35d4-4756-8eea-c3638f5b6c16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:07:52 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-6df0e5c6-1c1c-4e66-addc-f8acbe0faa41 tempest-VolumesAssistedSnapshotsTest-1656989943 tempest-VolumesAssistedSnapshotsTest-1656989943-project-member] Releasing lock "refresh_cache-f326db85-74f6-4e60-9c55-46b2a59502d0" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:07:52 user nova-compute[75165]: DEBUG nova.compute.manager [None req-6df0e5c6-1c1c-4e66-addc-f8acbe0faa41 tempest-VolumesAssistedSnapshotsTest-1656989943 tempest-VolumesAssistedSnapshotsTest-1656989943-project-member] [instance: f326db85-74f6-4e60-9c55-46b2a59502d0] Instance network_info: |[{"id": "26b16dce-35d4-4756-8eea-c3638f5b6c16", "address": "fa:16:3e:03:0d:40", "network": {"id": "2391bc4b-c0f5-4644-94d8-37a74146506d", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2088537358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc4d929d240d4d4d93d5926abe61df9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26b16dce-35", "ovs_interfaceid": "26b16dce-35d4-4756-8eea-c3638f5b6c16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75165) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 00:07:52 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-6df0e5c6-1c1c-4e66-addc-f8acbe0faa41 tempest-VolumesAssistedSnapshotsTest-1656989943 tempest-VolumesAssistedSnapshotsTest-1656989943-project-member] [instance: f326db85-74f6-4e60-9c55-46b2a59502d0] Start _get_guest_xml network_info=[{"id": "26b16dce-35d4-4756-8eea-c3638f5b6c16", "address": "fa:16:3e:03:0d:40", "network": {"id": "2391bc4b-c0f5-4644-94d8-37a74146506d", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2088537358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc4d929d240d4d4d93d5926abe61df9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26b16dce-35", "ovs_interfaceid": "26b16dce-35d4-4756-8eea-c3638f5b6c16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T00:03:24Z,direct_url=<?>,disk_format='qcow2',id=bff0d8a1-739e-4c4d-9efa-b73ba7b76d01,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e56bbf444fd34c348475c73673611447',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T00:03:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'size': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': 'bff0d8a1-739e-4c4d-9efa-b73ba7b76d01'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75165) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 00:07:52 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-6df0e5c6-1c1c-4e66-addc-f8acbe0faa41 tempest-VolumesAssistedSnapshotsTest-1656989943 tempest-VolumesAssistedSnapshotsTest-1656989943-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:07:52 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-6df0e5c6-1c1c-4e66-addc-f8acbe0faa41 tempest-VolumesAssistedSnapshotsTest-1656989943 tempest-VolumesAssistedSnapshotsTest-1656989943-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:07:52 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:52 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-6df0e5c6-1c1c-4e66-addc-f8acbe0faa41 tempest-VolumesAssistedSnapshotsTest-1656989943 tempest-VolumesAssistedSnapshotsTest-1656989943-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75165) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 00:07:52 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-6df0e5c6-1c1c-4e66-addc-f8acbe0faa41 tempest-VolumesAssistedSnapshotsTest-1656989943 tempest-VolumesAssistedSnapshotsTest-1656989943-project-member] CPU controller missing on host. {{(pid=75165) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 00:07:52 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-6df0e5c6-1c1c-4e66-addc-f8acbe0faa41 tempest-VolumesAssistedSnapshotsTest-1656989943 tempest-VolumesAssistedSnapshotsTest-1656989943-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75165) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 00:07:52 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-6df0e5c6-1c1c-4e66-addc-f8acbe0faa41 tempest-VolumesAssistedSnapshotsTest-1656989943 tempest-VolumesAssistedSnapshotsTest-1656989943-project-member] CPU controller found on host. {{(pid=75165) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 00:07:52 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-6df0e5c6-1c1c-4e66-addc-f8acbe0faa41 tempest-VolumesAssistedSnapshotsTest-1656989943 tempest-VolumesAssistedSnapshotsTest-1656989943-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75165) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 00:07:52 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-6df0e5c6-1c1c-4e66-addc-f8acbe0faa41 tempest-VolumesAssistedSnapshotsTest-1656989943 tempest-VolumesAssistedSnapshotsTest-1656989943-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T00:03:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T00:03:24Z,direct_url=<?>,disk_format='qcow2',id=bff0d8a1-739e-4c4d-9efa-b73ba7b76d01,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e56bbf444fd34c348475c73673611447',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T00:03:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 00:07:52 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-6df0e5c6-1c1c-4e66-addc-f8acbe0faa41 tempest-VolumesAssistedSnapshotsTest-1656989943 tempest-VolumesAssistedSnapshotsTest-1656989943-project-member] Flavor limits 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 00:07:52 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-6df0e5c6-1c1c-4e66-addc-f8acbe0faa41 tempest-VolumesAssistedSnapshotsTest-1656989943 tempest-VolumesAssistedSnapshotsTest-1656989943-project-member] Image limits 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 00:07:52 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-6df0e5c6-1c1c-4e66-addc-f8acbe0faa41 tempest-VolumesAssistedSnapshotsTest-1656989943 tempest-VolumesAssistedSnapshotsTest-1656989943-project-member] Flavor pref 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 00:07:52 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-6df0e5c6-1c1c-4e66-addc-f8acbe0faa41 tempest-VolumesAssistedSnapshotsTest-1656989943 tempest-VolumesAssistedSnapshotsTest-1656989943-project-member] Image pref 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 00:07:52 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-6df0e5c6-1c1c-4e66-addc-f8acbe0faa41 tempest-VolumesAssistedSnapshotsTest-1656989943 tempest-VolumesAssistedSnapshotsTest-1656989943-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 00:07:52 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-6df0e5c6-1c1c-4e66-addc-f8acbe0faa41 tempest-VolumesAssistedSnapshotsTest-1656989943 tempest-VolumesAssistedSnapshotsTest-1656989943-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 00:07:52 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-6df0e5c6-1c1c-4e66-addc-f8acbe0faa41 tempest-VolumesAssistedSnapshotsTest-1656989943 tempest-VolumesAssistedSnapshotsTest-1656989943-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75165) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 00:07:52 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-6df0e5c6-1c1c-4e66-addc-f8acbe0faa41 tempest-VolumesAssistedSnapshotsTest-1656989943 tempest-VolumesAssistedSnapshotsTest-1656989943-project-member] Got 1 possible topologies {{(pid=75165) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 00:07:52 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-6df0e5c6-1c1c-4e66-addc-f8acbe0faa41 tempest-VolumesAssistedSnapshotsTest-1656989943 tempest-VolumesAssistedSnapshotsTest-1656989943-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 00:07:52 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-6df0e5c6-1c1c-4e66-addc-f8acbe0faa41 tempest-VolumesAssistedSnapshotsTest-1656989943 tempest-VolumesAssistedSnapshotsTest-1656989943-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 00:07:53 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-6df0e5c6-1c1c-4e66-addc-f8acbe0faa41 tempest-VolumesAssistedSnapshotsTest-1656989943 tempest-VolumesAssistedSnapshotsTest-1656989943-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:07:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1259026962',display_name='tempest-VolumesAssistedSnapshotsTest-server-1259026962',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1259026962',id=10,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMDDUCNXm1z9xh1P2F7lz2Mjgf0CnWTMHOuMjqQiq+R2lHBnDl1xyFtffR5YzWXTlUKQNpfMUgWrsz5T9aTtJvn7sOg1n9hznc7jP8vV48hpya4y0jDj/mKSGs/QZqFzMA==',key_name='tempest-keypair-1001302888',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fc4d929d240d4d4d93d5926abe61df9b',ramdisk_id='',reservation_id='r-7fsxrmj0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1656989943',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1656989943-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T00:07:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b26a2b84140e412589a813c9f0dac148',uuid=f326db85-74f6-4e60-9c55-46b2a59502d0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "26b16dce-35d4-4756-8eea-c3638f5b6c16", "address": "fa:16:3e:03:0d:40", "network": {"id": "2391bc4b-c0f5-4644-94d8-37a74146506d", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2088537358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc4d929d240d4d4d93d5926abe61df9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26b16dce-35", "ovs_interfaceid": "26b16dce-35d4-4756-8eea-c3638f5b6c16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75165) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 00:07:53 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-6df0e5c6-1c1c-4e66-addc-f8acbe0faa41 tempest-VolumesAssistedSnapshotsTest-1656989943 tempest-VolumesAssistedSnapshotsTest-1656989943-project-member] Converting VIF {"id": "26b16dce-35d4-4756-8eea-c3638f5b6c16", "address": "fa:16:3e:03:0d:40", "network": {"id": "2391bc4b-c0f5-4644-94d8-37a74146506d", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2088537358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc4d929d240d4d4d93d5926abe61df9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26b16dce-35", "ovs_interfaceid": "26b16dce-35d4-4756-8eea-c3638f5b6c16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:07:53 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-6df0e5c6-1c1c-4e66-addc-f8acbe0faa41 tempest-VolumesAssistedSnapshotsTest-1656989943 tempest-VolumesAssistedSnapshotsTest-1656989943-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:0d:40,bridge_name='br-int',has_traffic_filtering=True,id=26b16dce-35d4-4756-8eea-c3638f5b6c16,network=Network(2391bc4b-c0f5-4644-94d8-37a74146506d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26b16dce-35') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:07:53 user nova-compute[75165]: DEBUG nova.objects.instance [None req-6df0e5c6-1c1c-4e66-addc-f8acbe0faa41 tempest-VolumesAssistedSnapshotsTest-1656989943 tempest-VolumesAssistedSnapshotsTest-1656989943-project-member] Lazy-loading 'pci_devices' on Instance uuid f326db85-74f6-4e60-9c55-46b2a59502d0 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:07:53 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-6df0e5c6-1c1c-4e66-addc-f8acbe0faa41 tempest-VolumesAssistedSnapshotsTest-1656989943 tempest-VolumesAssistedSnapshotsTest-1656989943-project-member] [instance: f326db85-74f6-4e60-9c55-46b2a59502d0] End _get_guest_xml xml=<domain type="kvm">
Oct 26 00:07:53 user nova-compute[75165]:   <uuid>f326db85-74f6-4e60-9c55-46b2a59502d0</uuid>
Oct 26 00:07:53 user nova-compute[75165]:   <name>instance-0000000a</name>
Oct 26 00:07:53 user nova-compute[75165]:   <memory>524288</memory>
Oct 26 00:07:53 user nova-compute[75165]:   <vcpu>1</vcpu>
Oct 26 00:07:53 user nova-compute[75165]:   <metadata>
Oct 26 00:07:53 user nova-compute[75165]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 00:07:53 user nova-compute[75165]:       <nova:package version="0.0.0"/>
Oct 26 00:07:53 user nova-compute[75165]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-1259026962</nova:name>
Oct 26 00:07:53 user nova-compute[75165]:       <nova:creationTime>2023-10-26 00:07:52</nova:creationTime>
Oct 26 00:07:53 user nova-compute[75165]:       <nova:flavor name="m1.tiny">
Oct 26 00:07:53 user nova-compute[75165]:         <nova:memory>512</nova:memory>
Oct 26 00:07:53 user nova-compute[75165]:         <nova:disk>1</nova:disk>
Oct 26 00:07:53 user nova-compute[75165]:         <nova:swap>0</nova:swap>
Oct 26 00:07:53 user nova-compute[75165]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 00:07:53 user nova-compute[75165]:         <nova:vcpus>1</nova:vcpus>
Oct 26 00:07:53 user nova-compute[75165]:       </nova:flavor>
Oct 26 00:07:53 user nova-compute[75165]:       <nova:owner>
Oct 26 00:07:53 user nova-compute[75165]:         <nova:user uuid="b26a2b84140e412589a813c9f0dac148">tempest-VolumesAssistedSnapshotsTest-1656989943-project-member</nova:user>
Oct 26 00:07:53 user nova-compute[75165]:         <nova:project uuid="fc4d929d240d4d4d93d5926abe61df9b">tempest-VolumesAssistedSnapshotsTest-1656989943</nova:project>
Oct 26 00:07:53 user nova-compute[75165]:       </nova:owner>
Oct 26 00:07:53 user nova-compute[75165]:       <nova:root type="image" uuid="bff0d8a1-739e-4c4d-9efa-b73ba7b76d01"/>
Oct 26 00:07:53 user nova-compute[75165]:       <nova:ports>
Oct 26 00:07:53 user nova-compute[75165]:         <nova:port uuid="26b16dce-35d4-4756-8eea-c3638f5b6c16">
Oct 26 00:07:53 user nova-compute[75165]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 26 00:07:53 user nova-compute[75165]:         </nova:port>
Oct 26 00:07:53 user nova-compute[75165]:       </nova:ports>
Oct 26 00:07:53 user nova-compute[75165]:     </nova:instance>
Oct 26 00:07:53 user nova-compute[75165]:   </metadata>
Oct 26 00:07:53 user nova-compute[75165]:   <sysinfo type="smbios">
Oct 26 00:07:53 user nova-compute[75165]:     <system>
Oct 26 00:07:53 user nova-compute[75165]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 00:07:53 user nova-compute[75165]:       <entry name="product">OpenStack Nova</entry>
Oct 26 00:07:53 user nova-compute[75165]:       <entry name="version">0.0.0</entry>
Oct 26 00:07:53 user nova-compute[75165]:       <entry name="serial">f326db85-74f6-4e60-9c55-46b2a59502d0</entry>
Oct 26 00:07:53 user nova-compute[75165]:       <entry name="uuid">f326db85-74f6-4e60-9c55-46b2a59502d0</entry>
Oct 26 00:07:53 user nova-compute[75165]:       <entry name="family">Virtual Machine</entry>
Oct 26 00:07:53 user nova-compute[75165]:     </system>
Oct 26 00:07:53 user nova-compute[75165]:   </sysinfo>
Oct 26 00:07:53 user nova-compute[75165]:   <os>
Oct 26 00:07:53 user nova-compute[75165]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 00:07:53 user nova-compute[75165]:     <boot dev="hd"/>
Oct 26 00:07:53 user nova-compute[75165]:     <smbios mode="sysinfo"/>
Oct 26 00:07:53 user nova-compute[75165]:   </os>
Oct 26 00:07:53 user nova-compute[75165]:   <features>
Oct 26 00:07:53 user nova-compute[75165]:     <acpi/>
Oct 26 00:07:53 user nova-compute[75165]:     <apic/>
Oct 26 00:07:53 user nova-compute[75165]:     <vmcoreinfo/>
Oct 26 00:07:53 user nova-compute[75165]:   </features>
Oct 26 00:07:53 user nova-compute[75165]:   <clock offset="utc">
Oct 26 00:07:53 user nova-compute[75165]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 00:07:53 user nova-compute[75165]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 00:07:53 user nova-compute[75165]:     <timer name="hpet" present="no"/>
Oct 26 00:07:53 user nova-compute[75165]:   </clock>
Oct 26 00:07:53 user nova-compute[75165]:   <cpu mode="custom" match="exact">
Oct 26 00:07:53 user nova-compute[75165]:     <model>Nehalem</model>
Oct 26 00:07:53 user nova-compute[75165]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 00:07:53 user nova-compute[75165]:   </cpu>
Oct 26 00:07:53 user nova-compute[75165]:   <devices>
Oct 26 00:07:53 user nova-compute[75165]:     <disk type="file" device="disk">
Oct 26 00:07:53 user nova-compute[75165]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 00:07:53 user nova-compute[75165]:       <source file="/opt/stack/data/nova/instances/f326db85-74f6-4e60-9c55-46b2a59502d0/disk"/>
Oct 26 00:07:53 user nova-compute[75165]:       <target dev="vda" bus="virtio"/>
Oct 26 00:07:53 user nova-compute[75165]:     </disk>
Oct 26 00:07:53 user nova-compute[75165]:     <interface type="ethernet">
Oct 26 00:07:53 user nova-compute[75165]:       <mac address="fa:16:3e:03:0d:40"/>
Oct 26 00:07:53 user nova-compute[75165]:       <model type="virtio"/>
Oct 26 00:07:53 user nova-compute[75165]:       <mtu size="1442"/>
Oct 26 00:07:53 user nova-compute[75165]:       <target dev="tap26b16dce-35"/>
Oct 26 00:07:53 user nova-compute[75165]:     </interface>
Oct 26 00:07:53 user nova-compute[75165]:     <serial type="pty">
Oct 26 00:07:53 user nova-compute[75165]:       <log file="/opt/stack/data/nova/instances/f326db85-74f6-4e60-9c55-46b2a59502d0/console.log" append="off"/>
Oct 26 00:07:53 user nova-compute[75165]:     </serial>
Oct 26 00:07:53 user nova-compute[75165]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 00:07:53 user nova-compute[75165]:     <video>
Oct 26 00:07:53 user nova-compute[75165]:       <model type="virtio"/>
Oct 26 00:07:53 user nova-compute[75165]:     </video>
Oct 26 00:07:53 user nova-compute[75165]:     <rng model="virtio">
Oct 26 00:07:53 user nova-compute[75165]:       <backend model="random">/dev/urandom</backend>
Oct 26 00:07:53 user nova-compute[75165]:     </rng>
Oct 26 00:07:53 user nova-compute[75165]:     <controller type="usb" index="0" model="none"/>
Oct 26 00:07:53 user nova-compute[75165]:     <memballoon model="virtio">
Oct 26 00:07:53 user nova-compute[75165]:       <stats period="10"/>
Oct 26 00:07:53 user nova-compute[75165]:     </memballoon>
Oct 26 00:07:53 user nova-compute[75165]:   </devices>
Oct 26 00:07:53 user nova-compute[75165]: </domain>
Oct 26 00:07:53 user nova-compute[75165]:  {{(pid=75165) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 00:07:53 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-6df0e5c6-1c1c-4e66-addc-f8acbe0faa41 tempest-VolumesAssistedSnapshotsTest-1656989943 tempest-VolumesAssistedSnapshotsTest-1656989943-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:07:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1259026962',display_name='tempest-VolumesAssistedSnapshotsTest-server-1259026962',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1259026962',id=10,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMDDUCNXm1z9xh1P2F7lz2Mjgf0CnWTMHOuMjqQiq+R2lHBnDl1xyFtffR5YzWXTlUKQNpfMUgWrsz5T9aTtJvn7sOg1n9hznc7jP8vV48hpya4y0jDj/mKSGs/QZqFzMA==',key_name='tempest-keypair-1001302888',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fc4d929d240d4d4d93d5926abe61df9b',ramdisk_id='',reservation_id='r-7fsxrmj0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1656989943',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1656989943-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T00:07:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b26a2b84140e412589a813c9f0dac148',uuid=f326db85-74f6-4e60-9c55-46b2a59502d0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "26b16dce-35d4-4756-8eea-c3638f5b6c16", "address": "fa:16:3e:03:0d:40", "network": {"id": "2391bc4b-c0f5-4644-94d8-37a74146506d", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2088537358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc4d929d240d4d4d93d5926abe61df9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26b16dce-35", "ovs_interfaceid": "26b16dce-35d4-4756-8eea-c3638f5b6c16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 00:07:53 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-6df0e5c6-1c1c-4e66-addc-f8acbe0faa41 tempest-VolumesAssistedSnapshotsTest-1656989943 tempest-VolumesAssistedSnapshotsTest-1656989943-project-member] Converting VIF {"id": "26b16dce-35d4-4756-8eea-c3638f5b6c16", "address": "fa:16:3e:03:0d:40", "network": {"id": "2391bc4b-c0f5-4644-94d8-37a74146506d", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2088537358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc4d929d240d4d4d93d5926abe61df9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26b16dce-35", "ovs_interfaceid": "26b16dce-35d4-4756-8eea-c3638f5b6c16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:07:53 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-6df0e5c6-1c1c-4e66-addc-f8acbe0faa41 tempest-VolumesAssistedSnapshotsTest-1656989943 tempest-VolumesAssistedSnapshotsTest-1656989943-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:0d:40,bridge_name='br-int',has_traffic_filtering=True,id=26b16dce-35d4-4756-8eea-c3638f5b6c16,network=Network(2391bc4b-c0f5-4644-94d8-37a74146506d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26b16dce-35') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:07:53 user nova-compute[75165]: DEBUG os_vif [None req-6df0e5c6-1c1c-4e66-addc-f8acbe0faa41 tempest-VolumesAssistedSnapshotsTest-1656989943 tempest-VolumesAssistedSnapshotsTest-1656989943-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:0d:40,bridge_name='br-int',has_traffic_filtering=True,id=26b16dce-35d4-4756-8eea-c3638f5b6c16,network=Network(2391bc4b-c0f5-4644-94d8-37a74146506d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26b16dce-35') {{(pid=75165) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 00:07:53 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:53 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:07:53 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 00:07:53 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:53 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6529f2b5-034c-5170-8476-78e22fde7fa1', '_type': 'linux-noop'}}, row=False) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:07:53 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:53 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:53 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:53 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap26b16dce-35, may_exist=True, interface_attrs={}) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:07:53 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap26b16dce-35, col_values=(('qos', UUID('d1abd6d2-a0c9-49ab-b30f-62ca20a7b470')),), if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:07:53 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap26b16dce-35, col_values=(('external_ids', {'iface-id': '26b16dce-35d4-4756-8eea-c3638f5b6c16', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:03:0d:40', 'vm-uuid': 'f326db85-74f6-4e60-9c55-46b2a59502d0'}),), if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:07:53 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:07:53 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:53 user nova-compute[75165]: INFO os_vif [None req-6df0e5c6-1c1c-4e66-addc-f8acbe0faa41 tempest-VolumesAssistedSnapshotsTest-1656989943 tempest-VolumesAssistedSnapshotsTest-1656989943-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:0d:40,bridge_name='br-int',has_traffic_filtering=True,id=26b16dce-35d4-4756-8eea-c3638f5b6c16,network=Network(2391bc4b-c0f5-4644-94d8-37a74146506d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26b16dce-35')
Oct 26 00:07:53 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-6df0e5c6-1c1c-4e66-addc-f8acbe0faa41 tempest-VolumesAssistedSnapshotsTest-1656989943 tempest-VolumesAssistedSnapshotsTest-1656989943-project-member] No BDM found with device name vda, not building metadata. {{(pid=75165) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 00:07:53 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-6df0e5c6-1c1c-4e66-addc-f8acbe0faa41 tempest-VolumesAssistedSnapshotsTest-1656989943 tempest-VolumesAssistedSnapshotsTest-1656989943-project-member] No VIF found with MAC fa:16:3e:03:0d:40, not building metadata {{(pid=75165) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 00:07:53 user nova-compute[75165]: DEBUG nova.network.neutron [None req-c44639b7-24ff-456f-85ae-d61f41b82336 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] [instance: 45625147-ff69-496a-a41e-e55f818a020a] Successfully updated port: 7fb6b434-f67e-4199-90c4-fa1fad18e7d3 {{(pid=75165) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 00:07:53 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-c44639b7-24ff-456f-85ae-d61f41b82336 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] Acquiring lock "refresh_cache-45625147-ff69-496a-a41e-e55f818a020a" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:07:53 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-c44639b7-24ff-456f-85ae-d61f41b82336 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] Acquired lock "refresh_cache-45625147-ff69-496a-a41e-e55f818a020a" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:07:53 user nova-compute[75165]: DEBUG nova.network.neutron [None req-c44639b7-24ff-456f-85ae-d61f41b82336 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] [instance: 45625147-ff69-496a-a41e-e55f818a020a] Building network info cache for instance {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 00:07:53 user nova-compute[75165]: DEBUG nova.network.neutron [None req-c44639b7-24ff-456f-85ae-d61f41b82336 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] [instance: 45625147-ff69-496a-a41e-e55f818a020a] Instance cache missing network info. {{(pid=75165) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 00:07:53 user nova-compute[75165]: DEBUG nova.compute.manager [req-30705734-5d25-4127-9a66-13ea3399a073 req-d237c8bb-4623-47dd-8b2b-424a72310f2c service nova] [instance: f326db85-74f6-4e60-9c55-46b2a59502d0] Received event network-changed-26b16dce-35d4-4756-8eea-c3638f5b6c16 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:07:53 user nova-compute[75165]: DEBUG nova.compute.manager [req-30705734-5d25-4127-9a66-13ea3399a073 req-d237c8bb-4623-47dd-8b2b-424a72310f2c service nova] [instance: f326db85-74f6-4e60-9c55-46b2a59502d0] Refreshing instance network info cache due to event network-changed-26b16dce-35d4-4756-8eea-c3638f5b6c16. {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 00:07:53 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-30705734-5d25-4127-9a66-13ea3399a073 req-d237c8bb-4623-47dd-8b2b-424a72310f2c service nova] Acquiring lock "refresh_cache-f326db85-74f6-4e60-9c55-46b2a59502d0" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:07:53 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-30705734-5d25-4127-9a66-13ea3399a073 req-d237c8bb-4623-47dd-8b2b-424a72310f2c service nova] Acquired lock "refresh_cache-f326db85-74f6-4e60-9c55-46b2a59502d0" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:07:53 user nova-compute[75165]: DEBUG nova.network.neutron [req-30705734-5d25-4127-9a66-13ea3399a073 req-d237c8bb-4623-47dd-8b2b-424a72310f2c service nova] [instance: f326db85-74f6-4e60-9c55-46b2a59502d0] Refreshing network info cache for port 26b16dce-35d4-4756-8eea-c3638f5b6c16 {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 00:07:54 user nova-compute[75165]: DEBUG nova.network.neutron [None req-c44639b7-24ff-456f-85ae-d61f41b82336 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] [instance: 45625147-ff69-496a-a41e-e55f818a020a] Updating instance_info_cache with network_info: [{"id": "7fb6b434-f67e-4199-90c4-fa1fad18e7d3", "address": "fa:16:3e:1f:92:cd", "network": {"id": "54cfbfa8-e5be-4d9e-88fd-c086a6f8c834", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2062887918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc552db87c094e77aee0361963486d93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fb6b434-f6", "ovs_interfaceid": "7fb6b434-f67e-4199-90c4-fa1fad18e7d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:07:54 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-c44639b7-24ff-456f-85ae-d61f41b82336 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] Releasing lock "refresh_cache-45625147-ff69-496a-a41e-e55f818a020a" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:07:54 user nova-compute[75165]: DEBUG nova.compute.manager [None req-c44639b7-24ff-456f-85ae-d61f41b82336 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] [instance: 45625147-ff69-496a-a41e-e55f818a020a] Instance network_info: |[{"id": "7fb6b434-f67e-4199-90c4-fa1fad18e7d3", "address": "fa:16:3e:1f:92:cd", "network": {"id": "54cfbfa8-e5be-4d9e-88fd-c086a6f8c834", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2062887918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc552db87c094e77aee0361963486d93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fb6b434-f6", "ovs_interfaceid": "7fb6b434-f67e-4199-90c4-fa1fad18e7d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75165) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 00:07:54 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-c44639b7-24ff-456f-85ae-d61f41b82336 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] [instance: 45625147-ff69-496a-a41e-e55f818a020a] Start _get_guest_xml network_info=[{"id": "7fb6b434-f67e-4199-90c4-fa1fad18e7d3", "address": "fa:16:3e:1f:92:cd", "network": {"id": "54cfbfa8-e5be-4d9e-88fd-c086a6f8c834", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2062887918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc552db87c094e77aee0361963486d93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fb6b434-f6", "ovs_interfaceid": "7fb6b434-f67e-4199-90c4-fa1fad18e7d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T00:03:24Z,direct_url=<?>,disk_format='qcow2',id=bff0d8a1-739e-4c4d-9efa-b73ba7b76d01,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e56bbf444fd34c348475c73673611447',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T00:03:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'size': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': 'bff0d8a1-739e-4c4d-9efa-b73ba7b76d01'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75165) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 00:07:54 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-c44639b7-24ff-456f-85ae-d61f41b82336 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:07:54 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-c44639b7-24ff-456f-85ae-d61f41b82336 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:07:54 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-c44639b7-24ff-456f-85ae-d61f41b82336 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75165) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 00:07:54 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-c44639b7-24ff-456f-85ae-d61f41b82336 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] CPU controller missing on host. {{(pid=75165) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 00:07:54 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-c44639b7-24ff-456f-85ae-d61f41b82336 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75165) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 00:07:54 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-c44639b7-24ff-456f-85ae-d61f41b82336 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] CPU controller found on host. {{(pid=75165) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 00:07:54 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-c44639b7-24ff-456f-85ae-d61f41b82336 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75165) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 00:07:54 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-c44639b7-24ff-456f-85ae-d61f41b82336 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T00:03:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T00:03:24Z,direct_url=<?>,disk_format='qcow2',id=bff0d8a1-739e-4c4d-9efa-b73ba7b76d01,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e56bbf444fd34c348475c73673611447',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T00:03:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 00:07:54 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-c44639b7-24ff-456f-85ae-d61f41b82336 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] Flavor limits 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 00:07:54 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-c44639b7-24ff-456f-85ae-d61f41b82336 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] Image limits 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 00:07:54 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-c44639b7-24ff-456f-85ae-d61f41b82336 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] Flavor pref 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 00:07:54 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-c44639b7-24ff-456f-85ae-d61f41b82336 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] Image pref 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 00:07:54 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-c44639b7-24ff-456f-85ae-d61f41b82336 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 00:07:54 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-c44639b7-24ff-456f-85ae-d61f41b82336 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 00:07:54 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-c44639b7-24ff-456f-85ae-d61f41b82336 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75165) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 00:07:54 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-c44639b7-24ff-456f-85ae-d61f41b82336 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] Got 1 possible topologies {{(pid=75165) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 00:07:54 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-c44639b7-24ff-456f-85ae-d61f41b82336 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 00:07:54 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-c44639b7-24ff-456f-85ae-d61f41b82336 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 00:07:54 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-c44639b7-24ff-456f-85ae-d61f41b82336 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:07:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1723786526',display_name='tempest-TestVolumeSwap-server-1723786526',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1723786526',id=11,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGzvl8YzXucCRJmSg+rBvqsEIEBbGtA16LyHx9evlPcLmx8TBhVJw/r0t2RsVNke7YQun20Rwl8Ds1wLo3s2asOeduC/op42j/TTiGLAQDskai4R0VsuSVI+dDOoN49OJw==',key_name='tempest-keypair-885110349',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fc552db87c094e77aee0361963486d93',ramdisk_id='',reservation_id='r-uimpmxb3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1089431236',owner_user_name='tempest-TestVolumeSwap-1089431236-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T00:07:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3bca70683da14dcb9023f9b15ae72d47',uuid=45625147-ff69-496a-a41e-e55f818a020a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7fb6b434-f67e-4199-90c4-fa1fad18e7d3", "address": "fa:16:3e:1f:92:cd", "network": {"id": "54cfbfa8-e5be-4d9e-88fd-c086a6f8c834", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2062887918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc552db87c094e77aee0361963486d93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fb6b434-f6", "ovs_interfaceid": "7fb6b434-f67e-4199-90c4-fa1fad18e7d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75165) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 00:07:54 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-c44639b7-24ff-456f-85ae-d61f41b82336 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] Converting VIF {"id": "7fb6b434-f67e-4199-90c4-fa1fad18e7d3", "address": "fa:16:3e:1f:92:cd", "network": {"id": "54cfbfa8-e5be-4d9e-88fd-c086a6f8c834", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2062887918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc552db87c094e77aee0361963486d93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fb6b434-f6", "ovs_interfaceid": "7fb6b434-f67e-4199-90c4-fa1fad18e7d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:07:54 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-c44639b7-24ff-456f-85ae-d61f41b82336 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:92:cd,bridge_name='br-int',has_traffic_filtering=True,id=7fb6b434-f67e-4199-90c4-fa1fad18e7d3,network=Network(54cfbfa8-e5be-4d9e-88fd-c086a6f8c834),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7fb6b434-f6') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:07:54 user nova-compute[75165]: DEBUG nova.objects.instance [None req-c44639b7-24ff-456f-85ae-d61f41b82336 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] Lazy-loading 'pci_devices' on Instance uuid 45625147-ff69-496a-a41e-e55f818a020a {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:07:54 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-c44639b7-24ff-456f-85ae-d61f41b82336 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] [instance: 45625147-ff69-496a-a41e-e55f818a020a] End _get_guest_xml xml=<domain type="kvm">
Oct 26 00:07:54 user nova-compute[75165]:   <uuid>45625147-ff69-496a-a41e-e55f818a020a</uuid>
Oct 26 00:07:54 user nova-compute[75165]:   <name>instance-0000000b</name>
Oct 26 00:07:54 user nova-compute[75165]:   <memory>524288</memory>
Oct 26 00:07:54 user nova-compute[75165]:   <vcpu>1</vcpu>
Oct 26 00:07:54 user nova-compute[75165]:   <metadata>
Oct 26 00:07:54 user nova-compute[75165]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 00:07:54 user nova-compute[75165]:       <nova:package version="0.0.0"/>
Oct 26 00:07:54 user nova-compute[75165]:       <nova:name>tempest-TestVolumeSwap-server-1723786526</nova:name>
Oct 26 00:07:54 user nova-compute[75165]:       <nova:creationTime>2023-10-26 00:07:54</nova:creationTime>
Oct 26 00:07:54 user nova-compute[75165]:       <nova:flavor name="m1.tiny">
Oct 26 00:07:54 user nova-compute[75165]:         <nova:memory>512</nova:memory>
Oct 26 00:07:54 user nova-compute[75165]:         <nova:disk>1</nova:disk>
Oct 26 00:07:54 user nova-compute[75165]:         <nova:swap>0</nova:swap>
Oct 26 00:07:54 user nova-compute[75165]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 00:07:54 user nova-compute[75165]:         <nova:vcpus>1</nova:vcpus>
Oct 26 00:07:54 user nova-compute[75165]:       </nova:flavor>
Oct 26 00:07:54 user nova-compute[75165]:       <nova:owner>
Oct 26 00:07:54 user nova-compute[75165]:         <nova:user uuid="3bca70683da14dcb9023f9b15ae72d47">tempest-TestVolumeSwap-1089431236-project-member</nova:user>
Oct 26 00:07:54 user nova-compute[75165]:         <nova:project uuid="fc552db87c094e77aee0361963486d93">tempest-TestVolumeSwap-1089431236</nova:project>
Oct 26 00:07:54 user nova-compute[75165]:       </nova:owner>
Oct 26 00:07:54 user nova-compute[75165]:       <nova:root type="image" uuid="bff0d8a1-739e-4c4d-9efa-b73ba7b76d01"/>
Oct 26 00:07:54 user nova-compute[75165]:       <nova:ports>
Oct 26 00:07:54 user nova-compute[75165]:         <nova:port uuid="7fb6b434-f67e-4199-90c4-fa1fad18e7d3">
Oct 26 00:07:54 user nova-compute[75165]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 26 00:07:54 user nova-compute[75165]:         </nova:port>
Oct 26 00:07:54 user nova-compute[75165]:       </nova:ports>
Oct 26 00:07:54 user nova-compute[75165]:     </nova:instance>
Oct 26 00:07:54 user nova-compute[75165]:   </metadata>
Oct 26 00:07:54 user nova-compute[75165]:   <sysinfo type="smbios">
Oct 26 00:07:54 user nova-compute[75165]:     <system>
Oct 26 00:07:54 user nova-compute[75165]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 00:07:54 user nova-compute[75165]:       <entry name="product">OpenStack Nova</entry>
Oct 26 00:07:54 user nova-compute[75165]:       <entry name="version">0.0.0</entry>
Oct 26 00:07:54 user nova-compute[75165]:       <entry name="serial">45625147-ff69-496a-a41e-e55f818a020a</entry>
Oct 26 00:07:54 user nova-compute[75165]:       <entry name="uuid">45625147-ff69-496a-a41e-e55f818a020a</entry>
Oct 26 00:07:54 user nova-compute[75165]:       <entry name="family">Virtual Machine</entry>
Oct 26 00:07:54 user nova-compute[75165]:     </system>
Oct 26 00:07:54 user nova-compute[75165]:   </sysinfo>
Oct 26 00:07:54 user nova-compute[75165]:   <os>
Oct 26 00:07:54 user nova-compute[75165]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 00:07:54 user nova-compute[75165]:     <boot dev="hd"/>
Oct 26 00:07:54 user nova-compute[75165]:     <smbios mode="sysinfo"/>
Oct 26 00:07:54 user nova-compute[75165]:   </os>
Oct 26 00:07:54 user nova-compute[75165]:   <features>
Oct 26 00:07:54 user nova-compute[75165]:     <acpi/>
Oct 26 00:07:54 user nova-compute[75165]:     <apic/>
Oct 26 00:07:54 user nova-compute[75165]:     <vmcoreinfo/>
Oct 26 00:07:54 user nova-compute[75165]:   </features>
Oct 26 00:07:54 user nova-compute[75165]:   <clock offset="utc">
Oct 26 00:07:54 user nova-compute[75165]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 00:07:54 user nova-compute[75165]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 00:07:54 user nova-compute[75165]:     <timer name="hpet" present="no"/>
Oct 26 00:07:54 user nova-compute[75165]:   </clock>
Oct 26 00:07:54 user nova-compute[75165]:   <cpu mode="custom" match="exact">
Oct 26 00:07:54 user nova-compute[75165]:     <model>Nehalem</model>
Oct 26 00:07:54 user nova-compute[75165]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 00:07:54 user nova-compute[75165]:   </cpu>
Oct 26 00:07:54 user nova-compute[75165]:   <devices>
Oct 26 00:07:54 user nova-compute[75165]:     <disk type="file" device="disk">
Oct 26 00:07:54 user nova-compute[75165]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 00:07:54 user nova-compute[75165]:       <source file="/opt/stack/data/nova/instances/45625147-ff69-496a-a41e-e55f818a020a/disk"/>
Oct 26 00:07:54 user nova-compute[75165]:       <target dev="vda" bus="virtio"/>
Oct 26 00:07:54 user nova-compute[75165]:     </disk>
Oct 26 00:07:54 user nova-compute[75165]:     <interface type="ethernet">
Oct 26 00:07:54 user nova-compute[75165]:       <mac address="fa:16:3e:1f:92:cd"/>
Oct 26 00:07:54 user nova-compute[75165]:       <model type="virtio"/>
Oct 26 00:07:54 user nova-compute[75165]:       <mtu size="1442"/>
Oct 26 00:07:54 user nova-compute[75165]:       <target dev="tap7fb6b434-f6"/>
Oct 26 00:07:54 user nova-compute[75165]:     </interface>
Oct 26 00:07:54 user nova-compute[75165]:     <serial type="pty">
Oct 26 00:07:54 user nova-compute[75165]:       <log file="/opt/stack/data/nova/instances/45625147-ff69-496a-a41e-e55f818a020a/console.log" append="off"/>
Oct 26 00:07:54 user nova-compute[75165]:     </serial>
Oct 26 00:07:54 user nova-compute[75165]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 00:07:54 user nova-compute[75165]:     <video>
Oct 26 00:07:54 user nova-compute[75165]:       <model type="virtio"/>
Oct 26 00:07:54 user nova-compute[75165]:     </video>
Oct 26 00:07:54 user nova-compute[75165]:     <rng model="virtio">
Oct 26 00:07:54 user nova-compute[75165]:       <backend model="random">/dev/urandom</backend>
Oct 26 00:07:54 user nova-compute[75165]:     </rng>
Oct 26 00:07:54 user nova-compute[75165]:     <controller type="usb" index="0" model="none"/>
Oct 26 00:07:54 user nova-compute[75165]:     <memballoon model="virtio">
Oct 26 00:07:54 user nova-compute[75165]:       <stats period="10"/>
Oct 26 00:07:54 user nova-compute[75165]:     </memballoon>
Oct 26 00:07:54 user nova-compute[75165]:   </devices>
Oct 26 00:07:54 user nova-compute[75165]: </domain>
Oct 26 00:07:54 user nova-compute[75165]:  {{(pid=75165) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 00:07:54 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-c44639b7-24ff-456f-85ae-d61f41b82336 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:07:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1723786526',display_name='tempest-TestVolumeSwap-server-1723786526',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1723786526',id=11,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGzvl8YzXucCRJmSg+rBvqsEIEBbGtA16LyHx9evlPcLmx8TBhVJw/r0t2RsVNke7YQun20Rwl8Ds1wLo3s2asOeduC/op42j/TTiGLAQDskai4R0VsuSVI+dDOoN49OJw==',key_name='tempest-keypair-885110349',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fc552db87c094e77aee0361963486d93',ramdisk_id='',reservation_id='r-uimpmxb3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1089431236',owner_user_name='tempest-TestVolumeSwap-1089431236-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T00:07:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3bca70683da14dcb9023f9b15ae72d47',uuid=45625147-ff69-496a-a41e-e55f818a020a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7fb6b434-f67e-4199-90c4-fa1fad18e7d3", "address": "fa:16:3e:1f:92:cd", "network": {"id": "54cfbfa8-e5be-4d9e-88fd-c086a6f8c834", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2062887918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc552db87c094e77aee0361963486d93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fb6b434-f6", "ovs_interfaceid": "7fb6b434-f67e-4199-90c4-fa1fad18e7d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 00:07:54 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-c44639b7-24ff-456f-85ae-d61f41b82336 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] Converting VIF {"id": "7fb6b434-f67e-4199-90c4-fa1fad18e7d3", "address": "fa:16:3e:1f:92:cd", "network": {"id": "54cfbfa8-e5be-4d9e-88fd-c086a6f8c834", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2062887918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc552db87c094e77aee0361963486d93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fb6b434-f6", "ovs_interfaceid": "7fb6b434-f67e-4199-90c4-fa1fad18e7d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:07:54 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-c44639b7-24ff-456f-85ae-d61f41b82336 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:92:cd,bridge_name='br-int',has_traffic_filtering=True,id=7fb6b434-f67e-4199-90c4-fa1fad18e7d3,network=Network(54cfbfa8-e5be-4d9e-88fd-c086a6f8c834),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7fb6b434-f6') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:07:54 user nova-compute[75165]: DEBUG os_vif [None req-c44639b7-24ff-456f-85ae-d61f41b82336 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:92:cd,bridge_name='br-int',has_traffic_filtering=True,id=7fb6b434-f67e-4199-90c4-fa1fad18e7d3,network=Network(54cfbfa8-e5be-4d9e-88fd-c086a6f8c834),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7fb6b434-f6') {{(pid=75165) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 00:07:54 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:54 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:07:54 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 00:07:54 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:54 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'eba5a873-9bfe-56b3-8a0a-33af82b5460c', '_type': 'linux-noop'}}, row=False) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:07:54 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:07:54 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:54 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:54 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7fb6b434-f6, may_exist=True, interface_attrs={}) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:07:54 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7fb6b434-f6, col_values=(('qos', UUID('f7d25885-615a-49ef-b056-0d5ecf858fee')),), if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:07:54 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7fb6b434-f6, col_values=(('external_ids', {'iface-id': '7fb6b434-f67e-4199-90c4-fa1fad18e7d3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1f:92:cd', 'vm-uuid': '45625147-ff69-496a-a41e-e55f818a020a'}),), if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:07:54 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:54 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:07:54 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:54 user nova-compute[75165]: INFO os_vif [None req-c44639b7-24ff-456f-85ae-d61f41b82336 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:92:cd,bridge_name='br-int',has_traffic_filtering=True,id=7fb6b434-f67e-4199-90c4-fa1fad18e7d3,network=Network(54cfbfa8-e5be-4d9e-88fd-c086a6f8c834),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7fb6b434-f6')
Oct 26 00:07:54 user nova-compute[75165]: DEBUG nova.network.neutron [req-30705734-5d25-4127-9a66-13ea3399a073 req-d237c8bb-4623-47dd-8b2b-424a72310f2c service nova] [instance: f326db85-74f6-4e60-9c55-46b2a59502d0] Updated VIF entry in instance network info cache for port 26b16dce-35d4-4756-8eea-c3638f5b6c16. {{(pid=75165) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 00:07:54 user nova-compute[75165]: DEBUG nova.network.neutron [req-30705734-5d25-4127-9a66-13ea3399a073 req-d237c8bb-4623-47dd-8b2b-424a72310f2c service nova] [instance: f326db85-74f6-4e60-9c55-46b2a59502d0] Updating instance_info_cache with network_info: [{"id": "26b16dce-35d4-4756-8eea-c3638f5b6c16", "address": "fa:16:3e:03:0d:40", "network": {"id": "2391bc4b-c0f5-4644-94d8-37a74146506d", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2088537358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc4d929d240d4d4d93d5926abe61df9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26b16dce-35", "ovs_interfaceid": "26b16dce-35d4-4756-8eea-c3638f5b6c16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:07:54 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-30705734-5d25-4127-9a66-13ea3399a073 req-d237c8bb-4623-47dd-8b2b-424a72310f2c service nova] Releasing lock "refresh_cache-f326db85-74f6-4e60-9c55-46b2a59502d0" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:07:54 user nova-compute[75165]: DEBUG nova.compute.manager [req-30705734-5d25-4127-9a66-13ea3399a073 req-d237c8bb-4623-47dd-8b2b-424a72310f2c service nova] [instance: 45625147-ff69-496a-a41e-e55f818a020a] Received event network-changed-7fb6b434-f67e-4199-90c4-fa1fad18e7d3 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:07:54 user nova-compute[75165]: DEBUG nova.compute.manager [req-30705734-5d25-4127-9a66-13ea3399a073 req-d237c8bb-4623-47dd-8b2b-424a72310f2c service nova] [instance: 45625147-ff69-496a-a41e-e55f818a020a] Refreshing instance network info cache due to event network-changed-7fb6b434-f67e-4199-90c4-fa1fad18e7d3. {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 00:07:54 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-30705734-5d25-4127-9a66-13ea3399a073 req-d237c8bb-4623-47dd-8b2b-424a72310f2c service nova] Acquiring lock "refresh_cache-45625147-ff69-496a-a41e-e55f818a020a" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:07:54 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-30705734-5d25-4127-9a66-13ea3399a073 req-d237c8bb-4623-47dd-8b2b-424a72310f2c service nova] Acquired lock "refresh_cache-45625147-ff69-496a-a41e-e55f818a020a" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:07:54 user nova-compute[75165]: DEBUG nova.network.neutron [req-30705734-5d25-4127-9a66-13ea3399a073 req-d237c8bb-4623-47dd-8b2b-424a72310f2c service nova] [instance: 45625147-ff69-496a-a41e-e55f818a020a] Refreshing network info cache for port 7fb6b434-f67e-4199-90c4-fa1fad18e7d3 {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 00:07:54 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-c44639b7-24ff-456f-85ae-d61f41b82336 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] No BDM found with device name vda, not building metadata. {{(pid=75165) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 00:07:54 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-c44639b7-24ff-456f-85ae-d61f41b82336 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] No VIF found with MAC fa:16:3e:1f:92:cd, not building metadata {{(pid=75165) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 00:07:54 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:54 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:54 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:54 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:54 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:07:54 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Cleaning up deleted instances {{(pid=75165) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 26 00:07:54 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] There are 0 instances to clean {{(pid=75165) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 26 00:07:54 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:07:54 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75165) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 26 00:07:54 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:07:54 user nova-compute[75165]: DEBUG nova.compute.manager [req-4c2c20b8-7863-4ec0-bd69-456ccc5f9148 req-65938bca-d1f6-4655-9498-c0a963e4a173 service nova] [instance: f326db85-74f6-4e60-9c55-46b2a59502d0] Received event network-vif-plugged-26b16dce-35d4-4756-8eea-c3638f5b6c16 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:07:54 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-4c2c20b8-7863-4ec0-bd69-456ccc5f9148 req-65938bca-d1f6-4655-9498-c0a963e4a173 service nova] Acquiring lock "f326db85-74f6-4e60-9c55-46b2a59502d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:07:54 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-4c2c20b8-7863-4ec0-bd69-456ccc5f9148 req-65938bca-d1f6-4655-9498-c0a963e4a173 service nova] Lock "f326db85-74f6-4e60-9c55-46b2a59502d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:07:54 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-4c2c20b8-7863-4ec0-bd69-456ccc5f9148 req-65938bca-d1f6-4655-9498-c0a963e4a173 service nova] Lock "f326db85-74f6-4e60-9c55-46b2a59502d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:07:54 user nova-compute[75165]: DEBUG nova.compute.manager [req-4c2c20b8-7863-4ec0-bd69-456ccc5f9148 req-65938bca-d1f6-4655-9498-c0a963e4a173 service nova] [instance: f326db85-74f6-4e60-9c55-46b2a59502d0] No waiting events found dispatching network-vif-plugged-26b16dce-35d4-4756-8eea-c3638f5b6c16 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:07:54 user nova-compute[75165]: WARNING nova.compute.manager [req-4c2c20b8-7863-4ec0-bd69-456ccc5f9148 req-65938bca-d1f6-4655-9498-c0a963e4a173 service nova] [instance: f326db85-74f6-4e60-9c55-46b2a59502d0] Received unexpected event network-vif-plugged-26b16dce-35d4-4756-8eea-c3638f5b6c16 for instance with vm_state building and task_state spawning.
Oct 26 00:07:54 user nova-compute[75165]: DEBUG nova.network.neutron [req-30705734-5d25-4127-9a66-13ea3399a073 req-d237c8bb-4623-47dd-8b2b-424a72310f2c service nova] [instance: 45625147-ff69-496a-a41e-e55f818a020a] Updated VIF entry in instance network info cache for port 7fb6b434-f67e-4199-90c4-fa1fad18e7d3. {{(pid=75165) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 00:07:54 user nova-compute[75165]: DEBUG nova.network.neutron [req-30705734-5d25-4127-9a66-13ea3399a073 req-d237c8bb-4623-47dd-8b2b-424a72310f2c service nova] [instance: 45625147-ff69-496a-a41e-e55f818a020a] Updating instance_info_cache with network_info: [{"id": "7fb6b434-f67e-4199-90c4-fa1fad18e7d3", "address": "fa:16:3e:1f:92:cd", "network": {"id": "54cfbfa8-e5be-4d9e-88fd-c086a6f8c834", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2062887918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc552db87c094e77aee0361963486d93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fb6b434-f6", "ovs_interfaceid": "7fb6b434-f67e-4199-90c4-fa1fad18e7d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:07:55 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-30705734-5d25-4127-9a66-13ea3399a073 req-d237c8bb-4623-47dd-8b2b-424a72310f2c service nova] Releasing lock "refresh_cache-45625147-ff69-496a-a41e-e55f818a020a" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:07:55 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:55 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:55 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:55 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:55 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:56 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:56 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:56 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:56 user nova-compute[75165]: DEBUG nova.compute.manager [req-d0b89431-b90d-4e31-b4fd-b4da0fe96b18 req-4472a7ae-88be-4f93-850c-8e46132070b7 service nova] [instance: 45625147-ff69-496a-a41e-e55f818a020a] Received event network-vif-plugged-7fb6b434-f67e-4199-90c4-fa1fad18e7d3 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:07:56 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-d0b89431-b90d-4e31-b4fd-b4da0fe96b18 req-4472a7ae-88be-4f93-850c-8e46132070b7 service nova] Acquiring lock "45625147-ff69-496a-a41e-e55f818a020a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:07:56 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-d0b89431-b90d-4e31-b4fd-b4da0fe96b18 req-4472a7ae-88be-4f93-850c-8e46132070b7 service nova] Lock "45625147-ff69-496a-a41e-e55f818a020a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:07:56 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-d0b89431-b90d-4e31-b4fd-b4da0fe96b18 req-4472a7ae-88be-4f93-850c-8e46132070b7 service nova] Lock "45625147-ff69-496a-a41e-e55f818a020a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:07:56 user nova-compute[75165]: DEBUG nova.compute.manager [req-d0b89431-b90d-4e31-b4fd-b4da0fe96b18 req-4472a7ae-88be-4f93-850c-8e46132070b7 service nova] [instance: 45625147-ff69-496a-a41e-e55f818a020a] No waiting events found dispatching network-vif-plugged-7fb6b434-f67e-4199-90c4-fa1fad18e7d3 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:07:56 user nova-compute[75165]: WARNING nova.compute.manager [req-d0b89431-b90d-4e31-b4fd-b4da0fe96b18 req-4472a7ae-88be-4f93-850c-8e46132070b7 service nova] [instance: 45625147-ff69-496a-a41e-e55f818a020a] Received unexpected event network-vif-plugged-7fb6b434-f67e-4199-90c4-fa1fad18e7d3 for instance with vm_state building and task_state spawning.
Oct 26 00:07:56 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:07:56 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75165) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 00:07:57 user nova-compute[75165]: DEBUG nova.compute.manager [req-3564a6e6-8ebb-4654-a5a4-691dd5dec37e req-5d00f5ff-42af-477c-89a5-e4cddae815c2 service nova] [instance: f326db85-74f6-4e60-9c55-46b2a59502d0] Received event network-vif-plugged-26b16dce-35d4-4756-8eea-c3638f5b6c16 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:07:57 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-3564a6e6-8ebb-4654-a5a4-691dd5dec37e req-5d00f5ff-42af-477c-89a5-e4cddae815c2 service nova] Acquiring lock "f326db85-74f6-4e60-9c55-46b2a59502d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:07:57 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-3564a6e6-8ebb-4654-a5a4-691dd5dec37e req-5d00f5ff-42af-477c-89a5-e4cddae815c2 service nova] Lock "f326db85-74f6-4e60-9c55-46b2a59502d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:07:57 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-3564a6e6-8ebb-4654-a5a4-691dd5dec37e req-5d00f5ff-42af-477c-89a5-e4cddae815c2 service nova] Lock "f326db85-74f6-4e60-9c55-46b2a59502d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:07:57 user nova-compute[75165]: DEBUG nova.compute.manager [req-3564a6e6-8ebb-4654-a5a4-691dd5dec37e req-5d00f5ff-42af-477c-89a5-e4cddae815c2 service nova] [instance: f326db85-74f6-4e60-9c55-46b2a59502d0] No waiting events found dispatching network-vif-plugged-26b16dce-35d4-4756-8eea-c3638f5b6c16 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:07:57 user nova-compute[75165]: WARNING nova.compute.manager [req-3564a6e6-8ebb-4654-a5a4-691dd5dec37e req-5d00f5ff-42af-477c-89a5-e4cddae815c2 service nova] [instance: f326db85-74f6-4e60-9c55-46b2a59502d0] Received unexpected event network-vif-plugged-26b16dce-35d4-4756-8eea-c3638f5b6c16 for instance with vm_state building and task_state spawning.
Oct 26 00:07:57 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:57 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:57 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:57 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:58 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:07:58 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:07:58 user nova-compute[75165]: DEBUG nova.compute.manager [req-b6568370-0c09-4d71-8636-a0678cd36a32 req-1b76181f-4667-497c-b1f8-1d20461770b6 service nova] [instance: 45625147-ff69-496a-a41e-e55f818a020a] Received event network-vif-plugged-7fb6b434-f67e-4199-90c4-fa1fad18e7d3 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:07:58 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-b6568370-0c09-4d71-8636-a0678cd36a32 req-1b76181f-4667-497c-b1f8-1d20461770b6 service nova] Acquiring lock "45625147-ff69-496a-a41e-e55f818a020a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:07:58 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-b6568370-0c09-4d71-8636-a0678cd36a32 req-1b76181f-4667-497c-b1f8-1d20461770b6 service nova] Lock "45625147-ff69-496a-a41e-e55f818a020a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:07:58 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-b6568370-0c09-4d71-8636-a0678cd36a32 req-1b76181f-4667-497c-b1f8-1d20461770b6 service nova] Lock "45625147-ff69-496a-a41e-e55f818a020a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:07:58 user nova-compute[75165]: DEBUG nova.compute.manager [req-b6568370-0c09-4d71-8636-a0678cd36a32 req-1b76181f-4667-497c-b1f8-1d20461770b6 service nova] [instance: 45625147-ff69-496a-a41e-e55f818a020a] No waiting events found dispatching network-vif-plugged-7fb6b434-f67e-4199-90c4-fa1fad18e7d3 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:07:58 user nova-compute[75165]: WARNING nova.compute.manager [req-b6568370-0c09-4d71-8636-a0678cd36a32 req-1b76181f-4667-497c-b1f8-1d20461770b6 service nova] [instance: 45625147-ff69-496a-a41e-e55f818a020a] Received unexpected event network-vif-plugged-7fb6b434-f67e-4199-90c4-fa1fad18e7d3 for instance with vm_state building and task_state spawning.
Oct 26 00:07:59 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:07:59 user nova-compute[75165]: DEBUG nova.compute.manager [None req-c44639b7-24ff-456f-85ae-d61f41b82336 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] [instance: 45625147-ff69-496a-a41e-e55f818a020a] Instance event wait completed in 0 seconds for  {{(pid=75165) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 00:07:59 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-c44639b7-24ff-456f-85ae-d61f41b82336 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] [instance: 45625147-ff69-496a-a41e-e55f818a020a] Guest created on hypervisor {{(pid=75165) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 00:07:59 user nova-compute[75165]: DEBUG nova.compute.manager [None req-6df0e5c6-1c1c-4e66-addc-f8acbe0faa41 tempest-VolumesAssistedSnapshotsTest-1656989943 tempest-VolumesAssistedSnapshotsTest-1656989943-project-member] [instance: f326db85-74f6-4e60-9c55-46b2a59502d0] Instance event wait completed in 0 seconds for  {{(pid=75165) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 00:07:59 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-6df0e5c6-1c1c-4e66-addc-f8acbe0faa41 tempest-VolumesAssistedSnapshotsTest-1656989943 tempest-VolumesAssistedSnapshotsTest-1656989943-project-member] [instance: f326db85-74f6-4e60-9c55-46b2a59502d0] Guest created on hypervisor {{(pid=75165) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 00:07:59 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: 45625147-ff69-496a-a41e-e55f818a020a] Instance spawned successfully.
Oct 26 00:07:59 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-c44639b7-24ff-456f-85ae-d61f41b82336 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] [instance: 45625147-ff69-496a-a41e-e55f818a020a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 00:07:59 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: f326db85-74f6-4e60-9c55-46b2a59502d0] Instance spawned successfully.
Oct 26 00:07:59 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-6df0e5c6-1c1c-4e66-addc-f8acbe0faa41 tempest-VolumesAssistedSnapshotsTest-1656989943 tempest-VolumesAssistedSnapshotsTest-1656989943-project-member] [instance: f326db85-74f6-4e60-9c55-46b2a59502d0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 00:07:59 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-c44639b7-24ff-456f-85ae-d61f41b82336 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] [instance: 45625147-ff69-496a-a41e-e55f818a020a] Found default for hw_cdrom_bus of ide {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:07:59 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-c44639b7-24ff-456f-85ae-d61f41b82336 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] [instance: 45625147-ff69-496a-a41e-e55f818a020a] Found default for hw_disk_bus of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:07:59 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-c44639b7-24ff-456f-85ae-d61f41b82336 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] [instance: 45625147-ff69-496a-a41e-e55f818a020a] Found default for hw_input_bus of None {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:07:59 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-c44639b7-24ff-456f-85ae-d61f41b82336 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] [instance: 45625147-ff69-496a-a41e-e55f818a020a] Found default for hw_pointer_model of None {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:07:59 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-c44639b7-24ff-456f-85ae-d61f41b82336 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] [instance: 45625147-ff69-496a-a41e-e55f818a020a] Found default for hw_video_model of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:07:59 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-c44639b7-24ff-456f-85ae-d61f41b82336 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] [instance: 45625147-ff69-496a-a41e-e55f818a020a] Found default for hw_vif_model of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:07:59 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-6df0e5c6-1c1c-4e66-addc-f8acbe0faa41 tempest-VolumesAssistedSnapshotsTest-1656989943 tempest-VolumesAssistedSnapshotsTest-1656989943-project-member] [instance: f326db85-74f6-4e60-9c55-46b2a59502d0] Found default for hw_cdrom_bus of ide {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:07:59 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-6df0e5c6-1c1c-4e66-addc-f8acbe0faa41 tempest-VolumesAssistedSnapshotsTest-1656989943 tempest-VolumesAssistedSnapshotsTest-1656989943-project-member] [instance: f326db85-74f6-4e60-9c55-46b2a59502d0] Found default for hw_disk_bus of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:07:59 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-6df0e5c6-1c1c-4e66-addc-f8acbe0faa41 tempest-VolumesAssistedSnapshotsTest-1656989943 tempest-VolumesAssistedSnapshotsTest-1656989943-project-member] [instance: f326db85-74f6-4e60-9c55-46b2a59502d0] Found default for hw_input_bus of None {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:07:59 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-6df0e5c6-1c1c-4e66-addc-f8acbe0faa41 tempest-VolumesAssistedSnapshotsTest-1656989943 tempest-VolumesAssistedSnapshotsTest-1656989943-project-member] [instance: f326db85-74f6-4e60-9c55-46b2a59502d0] Found default for hw_pointer_model of None {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:07:59 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-6df0e5c6-1c1c-4e66-addc-f8acbe0faa41 tempest-VolumesAssistedSnapshotsTest-1656989943 tempest-VolumesAssistedSnapshotsTest-1656989943-project-member] [instance: f326db85-74f6-4e60-9c55-46b2a59502d0] Found default for hw_video_model of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:07:59 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-6df0e5c6-1c1c-4e66-addc-f8acbe0faa41 tempest-VolumesAssistedSnapshotsTest-1656989943 tempest-VolumesAssistedSnapshotsTest-1656989943-project-member] [instance: f326db85-74f6-4e60-9c55-46b2a59502d0] Found default for hw_vif_model of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:07:59 user nova-compute[75165]: INFO nova.compute.manager [None req-c44639b7-24ff-456f-85ae-d61f41b82336 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] [instance: 45625147-ff69-496a-a41e-e55f818a020a] Took 8.24 seconds to spawn the instance on the hypervisor.
Oct 26 00:07:59 user nova-compute[75165]: DEBUG nova.compute.manager [None req-c44639b7-24ff-456f-85ae-d61f41b82336 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] [instance: 45625147-ff69-496a-a41e-e55f818a020a] Checking state {{(pid=75165) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 00:07:59 user nova-compute[75165]: INFO nova.compute.manager [None req-6df0e5c6-1c1c-4e66-addc-f8acbe0faa41 tempest-VolumesAssistedSnapshotsTest-1656989943 tempest-VolumesAssistedSnapshotsTest-1656989943-project-member] [instance: f326db85-74f6-4e60-9c55-46b2a59502d0] Took 10.73 seconds to spawn the instance on the hypervisor.
Oct 26 00:07:59 user nova-compute[75165]: DEBUG nova.compute.manager [None req-6df0e5c6-1c1c-4e66-addc-f8acbe0faa41 tempest-VolumesAssistedSnapshotsTest-1656989943 tempest-VolumesAssistedSnapshotsTest-1656989943-project-member] [instance: f326db85-74f6-4e60-9c55-46b2a59502d0] Checking state {{(pid=75165) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 00:07:59 user nova-compute[75165]: INFO nova.compute.manager [None req-c44639b7-24ff-456f-85ae-d61f41b82336 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] [instance: 45625147-ff69-496a-a41e-e55f818a020a] Took 9.83 seconds to build instance.
Oct 26 00:07:59 user nova-compute[75165]: INFO nova.compute.manager [None req-6df0e5c6-1c1c-4e66-addc-f8acbe0faa41 tempest-VolumesAssistedSnapshotsTest-1656989943 tempest-VolumesAssistedSnapshotsTest-1656989943-project-member] [instance: f326db85-74f6-4e60-9c55-46b2a59502d0] Took 13.16 seconds to build instance.
Oct 26 00:07:59 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-c44639b7-24ff-456f-85ae-d61f41b82336 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] Lock "45625147-ff69-496a-a41e-e55f818a020a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.134s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:07:59 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-6df0e5c6-1c1c-4e66-addc-f8acbe0faa41 tempest-VolumesAssistedSnapshotsTest-1656989943 tempest-VolumesAssistedSnapshotsTest-1656989943-project-member] Lock "f326db85-74f6-4e60-9c55-46b2a59502d0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.391s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:07:59 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:07:59 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Starting heal instance info cache {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 00:07:59 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Rebuilding the list of instances to heal {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 00:07:59 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "refresh_cache-9633e6bb-5e95-4994-92a2-9d8f85a946ff" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:07:59 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquired lock "refresh_cache-9633e6bb-5e95-4994-92a2-9d8f85a946ff" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:07:59 user nova-compute[75165]: DEBUG nova.network.neutron [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: 9633e6bb-5e95-4994-92a2-9d8f85a946ff] Forcefully refreshing network info cache for instance {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 00:07:59 user nova-compute[75165]: DEBUG nova.objects.instance [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lazy-loading 'info_cache' on Instance uuid 9633e6bb-5e95-4994-92a2-9d8f85a946ff {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:08:00 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:08:00 user nova-compute[75165]: DEBUG nova.network.neutron [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: 9633e6bb-5e95-4994-92a2-9d8f85a946ff] Updating instance_info_cache with network_info: [{"id": "6beaf63f-0750-4c6a-b0bd-ebfbca211ad1", "address": "fa:16:3e:c1:5c:f3", "network": {"id": "6344595d-af28-41d8-9091-f7565d587f85", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-916895889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "410dcedc2c3c49c3990259eca1aee491", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6beaf63f-07", "ovs_interfaceid": "6beaf63f-0750-4c6a-b0bd-ebfbca211ad1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:08:00 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Releasing lock "refresh_cache-9633e6bb-5e95-4994-92a2-9d8f85a946ff" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:08:00 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: 9633e6bb-5e95-4994-92a2-9d8f85a946ff] Updated the network info_cache for instance {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 00:08:00 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:08:00 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:08:00 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:08:00 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:08:00 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:08:00 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:08:00 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:08:00 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75165) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 00:08:00 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9633e6bb-5e95-4994-92a2-9d8f85a946ff/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:08:01 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9633e6bb-5e95-4994-92a2-9d8f85a946ff/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:08:01 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9633e6bb-5e95-4994-92a2-9d8f85a946ff/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:08:01 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9633e6bb-5e95-4994-92a2-9d8f85a946ff/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:08:01 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84c6b624-648b-40e2-a37e-ff08609bad84/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:08:01 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84c6b624-648b-40e2-a37e-ff08609bad84/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:08:01 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84c6b624-648b-40e2-a37e-ff08609bad84/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:08:01 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84c6b624-648b-40e2-a37e-ff08609bad84/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:08:01 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7eeb145-1565-4812-818b-fefda5f2436d/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:08:02 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7eeb145-1565-4812-818b-fefda5f2436d/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:08:02 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7eeb145-1565-4812-818b-fefda5f2436d/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:08:02 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7eeb145-1565-4812-818b-fefda5f2436d/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:08:02 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45625147-ff69-496a-a41e-e55f818a020a/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:08:02 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45625147-ff69-496a-a41e-e55f818a020a/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:08:02 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45625147-ff69-496a-a41e-e55f818a020a/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:08:02 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45625147-ff69-496a-a41e-e55f818a020a/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:08:02 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18dcf77e-fac2-4b38-ad1c-1f52ce14704a/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:08:02 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18dcf77e-fac2-4b38-ad1c-1f52ce14704a/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:08:02 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18dcf77e-fac2-4b38-ad1c-1f52ce14704a/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:08:03 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18dcf77e-fac2-4b38-ad1c-1f52ce14704a/disk --force-share --output=json" returned: 0 in 0.290s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:08:03 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f9add59-cabe-4965-8fe3-524618550581/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:08:03 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f9add59-cabe-4965-8fe3-524618550581/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:08:03 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f9add59-cabe-4965-8fe3-524618550581/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:08:03 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f9add59-cabe-4965-8fe3-524618550581/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:08:03 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26a0b493-bb47-466e-95d5-945fc3849fa5/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:08:03 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26a0b493-bb47-466e-95d5-945fc3849fa5/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:08:03 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26a0b493-bb47-466e-95d5-945fc3849fa5/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:08:04 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26a0b493-bb47-466e-95d5-945fc3849fa5/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:08:04 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e44bfc-6a68-46ce-8335-aaaba5160d3e/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:08:04 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e44bfc-6a68-46ce-8335-aaaba5160d3e/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:08:04 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e44bfc-6a68-46ce-8335-aaaba5160d3e/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:08:04 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:08:04 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e44bfc-6a68-46ce-8335-aaaba5160d3e/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:08:04 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b153af2-c93b-47d2-ae8c-76cfd44e384c/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:08:04 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b153af2-c93b-47d2-ae8c-76cfd44e384c/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:08:04 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b153af2-c93b-47d2-ae8c-76cfd44e384c/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:08:04 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b153af2-c93b-47d2-ae8c-76cfd44e384c/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:08:04 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f465963f-1d0f-4ca3-a8b8-681566b7d40a/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:08:05 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f465963f-1d0f-4ca3-a8b8-681566b7d40a/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:08:05 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f465963f-1d0f-4ca3-a8b8-681566b7d40a/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:08:05 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f465963f-1d0f-4ca3-a8b8-681566b7d40a/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:08:05 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f326db85-74f6-4e60-9c55-46b2a59502d0/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:08:05 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:08:05 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f326db85-74f6-4e60-9c55-46b2a59502d0/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:08:05 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f326db85-74f6-4e60-9c55-46b2a59502d0/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:08:05 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f326db85-74f6-4e60-9c55-46b2a59502d0/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:08:06 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:08:06 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:08:06 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Hypervisor/Node resource view: name=user free_ram=7117MB free_disk=25.267677307128906GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75165) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 00:08:06 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:08:06 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:08:06 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 9633e6bb-5e95-4994-92a2-9d8f85a946ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:08:06 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 84c6b624-648b-40e2-a37e-ff08609bad84 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:08:06 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 18dcf77e-fac2-4b38-ad1c-1f52ce14704a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:08:06 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance c4e44bfc-6a68-46ce-8335-aaaba5160d3e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:08:06 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance a7eeb145-1565-4812-818b-fefda5f2436d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:08:06 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 26a0b493-bb47-466e-95d5-945fc3849fa5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:08:06 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 3b153af2-c93b-47d2-ae8c-76cfd44e384c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:08:06 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 6f9add59-cabe-4965-8fe3-524618550581 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:08:06 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance f465963f-1d0f-4ca3-a8b8-681566b7d40a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:08:06 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance f326db85-74f6-4e60-9c55-46b2a59502d0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:08:06 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 45625147-ff69-496a-a41e-e55f818a020a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:08:06 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75165) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 00:08:06 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75165) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 00:08:06 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Refreshing inventories for resource provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 26 00:08:06 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Updating ProviderTree inventory for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 26 00:08:06 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Updating inventory in ProviderTree for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 26 00:08:06 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Refreshing aggregate associations for resource provider 03214fd5-21d1-46ec-b6b0-6449b77ba230, aggregates: None {{(pid=75165) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 26 00:08:07 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Refreshing trait associations for resource provider 03214fd5-21d1-46ec-b6b0-6449b77ba230, traits: COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NODE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_TRUSTED_CERTS,COMPUTE_DEVICE_TAGGING,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO {{(pid=75165) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 26 00:08:07 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:08:07 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:08:07 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Compute_service record updated for user:user {{(pid=75165) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 00:08:07 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.160s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:08:07 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:08:09 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:08:10 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:08:14 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:08:15 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:08:19 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:08:20 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:08:24 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:08:25 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:08:29 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:08:30 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:08:34 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:08:39 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:08:39 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:08:39 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75165) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 00:08:39 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75165) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 00:08:39 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75165) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 00:08:39 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:08:44 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:08:49 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:08:50 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Acquiring lock "8d5569ce-1f18-4f37-a340-099ee152d548" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:08:50 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Lock "8d5569ce-1f18-4f37-a340-099ee152d548" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:08:50 user nova-compute[75165]: DEBUG nova.compute.manager [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Starting instance... {{(pid=75165) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 00:08:50 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:08:50 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:08:50 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75165) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 00:08:50 user nova-compute[75165]: INFO nova.compute.claims [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Claim successful on node user
Oct 26 00:08:50 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:08:50 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:08:50 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.469s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:08:50 user nova-compute[75165]: DEBUG nova.compute.manager [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Start building networks asynchronously for instance. {{(pid=75165) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 00:08:50 user nova-compute[75165]: DEBUG nova.compute.manager [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Allocating IP information in the background. {{(pid=75165) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 00:08:50 user nova-compute[75165]: DEBUG nova.network.neutron [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] allocate_for_instance() {{(pid=75165) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 00:08:50 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 00:08:51 user nova-compute[75165]: DEBUG nova.compute.manager [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Start building block device mappings for instance. {{(pid=75165) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 00:08:51 user nova-compute[75165]: INFO nova.virt.block_device [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Booting with volume f25f6e6a-9711-4455-82e8-c56648a08508 at /dev/vda
Oct 26 00:08:51 user nova-compute[75165]: DEBUG nova.policy [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd25920439307445387df8d37c662d602', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f1d0ea8cbf74f10b81a10d3a7a6e716', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75165) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 00:08:51 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:08:51 user nova-compute[75165]: DEBUG os_brick.utils [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:08:51 user nova-compute[75165]: INFO oslo.privsep.daemon [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpm163z20q/privsep.sock']
Oct 26 00:08:51 user sudo[86955]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpm163z20q/privsep.sock
Oct 26 00:08:51 user sudo[86955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Oct 26 00:08:51 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:08:51 user nova-compute[75165]: DEBUG nova.network.neutron [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Successfully created port: 3da752ae-77a3-4bc3-8885-76331bc2d7d8 {{(pid=75165) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 00:08:52 user nova-compute[75165]: DEBUG nova.network.neutron [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Successfully created port: c019e949-c6fc-4014-9e42-13ce1eb17786 {{(pid=75165) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 00:08:52 user sudo[86955]: pam_unix(sudo:session): session closed for user root
Oct 26 00:08:52 user nova-compute[75165]: INFO oslo.privsep.daemon [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Spawned new privsep daemon via rootwrap
Oct 26 00:08:52 user nova-compute[75165]: INFO oslo.privsep.daemon [-] privsep daemon starting
Oct 26 00:08:52 user nova-compute[75165]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Oct 26 00:08:52 user nova-compute[75165]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Oct 26 00:08:52 user nova-compute[75165]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 86976
Oct 26 00:08:52 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[69326f9a-8ba1-455d-8226-98daaffa80a1]: (2,) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:08:53 user nova-compute[75165]: DEBUG nova.network.neutron [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Successfully created port: 9cecd3d6-4945-4a4b-8d06-48b0d7768a17 {{(pid=75165) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 00:08:53 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:08:53 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:08:53 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0407041-f684-48f9-af63-b6d2f801d88d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa94814ccb35\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:08:53 user nova-compute[75165]: WARNING os_brick.initiator.connectors.nvmeof [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Oct 26 00:08:53 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:08:53 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:08:53 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed7b9063-42eb-482b-8c4b-9fed5c592e10]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:08:53 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:08:53 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:08:53 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[b65d8960-6581-4c55-afa0-9db274a36030]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:08:53 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[e148d833-8a42-441a-a864-32b2f16e5e5e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:08:53 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Running cmd (subprocess): nvme version {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:08:53 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] 'nvme version' failed. Not Retrying. {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 00:08:53 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] nvme not present on system {{(pid=75165) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 00:08:53 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:08:53 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 00:08:53 user nova-compute[75165]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 00:08:53 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b099ea1-0539-476b-9680-7cfc3e82f918]: (4, '') {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:08:53 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75165) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 00:08:53 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75165) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 00:08:53 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] LIGHTOS: no hostnqn found. {{(pid=75165) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 00:08:53 user nova-compute[75165]: DEBUG os_brick.utils [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] <== get_connector_properties: return (2074ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa94814ccb35', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:08:53 user nova-compute[75165]: DEBUG nova.virt.block_device [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Updating existing volume attachment record: d9736521-41cd-447d-8939-f3e62769f162 {{(pid=75165) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 00:08:53 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:08:53 user nova-compute[75165]: DEBUG nova.network.neutron [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Successfully created port: a04b8134-03e6-45f2-b6d7-3ea6a7deb81c {{(pid=75165) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 00:08:54 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:08:54 user nova-compute[75165]: DEBUG nova.network.neutron [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Successfully created port: 03ee4dbc-d46d-4127-a4e0-d308a1c8beae {{(pid=75165) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 00:08:54 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-80629f8b-eef8-4750-b09d-8ed35e4d1af0 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Acquiring lock "471df318-7d9f-4512-add6-b6612700e15d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:08:54 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-80629f8b-eef8-4750-b09d-8ed35e4d1af0 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Lock "471df318-7d9f-4512-add6-b6612700e15d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:08:54 user nova-compute[75165]: DEBUG nova.compute.manager [None req-80629f8b-eef8-4750-b09d-8ed35e4d1af0 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] [instance: 471df318-7d9f-4512-add6-b6612700e15d] Starting instance... {{(pid=75165) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 00:08:54 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-80629f8b-eef8-4750-b09d-8ed35e4d1af0 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:08:54 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-80629f8b-eef8-4750-b09d-8ed35e4d1af0 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:08:54 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-80629f8b-eef8-4750-b09d-8ed35e4d1af0 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75165) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 00:08:54 user nova-compute[75165]: INFO nova.compute.claims [None req-80629f8b-eef8-4750-b09d-8ed35e4d1af0 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] [instance: 471df318-7d9f-4512-add6-b6612700e15d] Claim successful on node user
Oct 26 00:08:55 user nova-compute[75165]: DEBUG nova.network.neutron [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Successfully updated port: 3da752ae-77a3-4bc3-8885-76331bc2d7d8 {{(pid=75165) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 00:08:55 user nova-compute[75165]: DEBUG nova.compute.manager [req-90054bdf-29b3-4e1b-ab71-181d211d3dee req-d5d550f6-d3d0-48cf-b34b-94b2138ef108 service nova] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Received event network-changed-3da752ae-77a3-4bc3-8885-76331bc2d7d8 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:08:55 user nova-compute[75165]: DEBUG nova.compute.manager [req-90054bdf-29b3-4e1b-ab71-181d211d3dee req-d5d550f6-d3d0-48cf-b34b-94b2138ef108 service nova] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Refreshing instance network info cache due to event network-changed-3da752ae-77a3-4bc3-8885-76331bc2d7d8. {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 00:08:55 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-90054bdf-29b3-4e1b-ab71-181d211d3dee req-d5d550f6-d3d0-48cf-b34b-94b2138ef108 service nova] Acquiring lock "refresh_cache-8d5569ce-1f18-4f37-a340-099ee152d548" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:08:55 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-90054bdf-29b3-4e1b-ab71-181d211d3dee req-d5d550f6-d3d0-48cf-b34b-94b2138ef108 service nova] Acquired lock "refresh_cache-8d5569ce-1f18-4f37-a340-099ee152d548" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:08:55 user nova-compute[75165]: DEBUG nova.network.neutron [req-90054bdf-29b3-4e1b-ab71-181d211d3dee req-d5d550f6-d3d0-48cf-b34b-94b2138ef108 service nova] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Refreshing network info cache for port 3da752ae-77a3-4bc3-8885-76331bc2d7d8 {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 00:08:55 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-80629f8b-eef8-4750-b09d-8ed35e4d1af0 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:08:55 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-80629f8b-eef8-4750-b09d-8ed35e4d1af0 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:08:55 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-80629f8b-eef8-4750-b09d-8ed35e4d1af0 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.635s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:08:55 user nova-compute[75165]: DEBUG nova.compute.manager [None req-80629f8b-eef8-4750-b09d-8ed35e4d1af0 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] [instance: 471df318-7d9f-4512-add6-b6612700e15d] Start building networks asynchronously for instance. {{(pid=75165) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 00:08:55 user nova-compute[75165]: DEBUG nova.network.neutron [req-90054bdf-29b3-4e1b-ab71-181d211d3dee req-d5d550f6-d3d0-48cf-b34b-94b2138ef108 service nova] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Instance cache missing network info. {{(pid=75165) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 00:08:55 user nova-compute[75165]: DEBUG nova.compute.manager [None req-80629f8b-eef8-4750-b09d-8ed35e4d1af0 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] [instance: 471df318-7d9f-4512-add6-b6612700e15d] Allocating IP information in the background. {{(pid=75165) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 00:08:55 user nova-compute[75165]: DEBUG nova.network.neutron [None req-80629f8b-eef8-4750-b09d-8ed35e4d1af0 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] [instance: 471df318-7d9f-4512-add6-b6612700e15d] allocate_for_instance() {{(pid=75165) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 00:08:55 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-80629f8b-eef8-4750-b09d-8ed35e4d1af0 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] [instance: 471df318-7d9f-4512-add6-b6612700e15d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 00:08:55 user nova-compute[75165]: DEBUG nova.compute.manager [None req-80629f8b-eef8-4750-b09d-8ed35e4d1af0 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] [instance: 471df318-7d9f-4512-add6-b6612700e15d] Start building block device mappings for instance. {{(pid=75165) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 00:08:55 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:08:55 user nova-compute[75165]: DEBUG nova.policy [None req-80629f8b-eef8-4750-b09d-8ed35e4d1af0 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd86fd0a8654f412d8c4e8e14d408d7ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '410dcedc2c3c49c3990259eca1aee491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75165) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 00:08:55 user nova-compute[75165]: DEBUG nova.compute.manager [None req-80629f8b-eef8-4750-b09d-8ed35e4d1af0 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] [instance: 471df318-7d9f-4512-add6-b6612700e15d] Start spawning the instance on the hypervisor. {{(pid=75165) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 00:08:55 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-80629f8b-eef8-4750-b09d-8ed35e4d1af0 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] [instance: 471df318-7d9f-4512-add6-b6612700e15d] Creating instance directory {{(pid=75165) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 00:08:55 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-80629f8b-eef8-4750-b09d-8ed35e4d1af0 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] [instance: 471df318-7d9f-4512-add6-b6612700e15d] Creating image(s)
Oct 26 00:08:55 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-80629f8b-eef8-4750-b09d-8ed35e4d1af0 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Acquiring lock "/opt/stack/data/nova/instances/471df318-7d9f-4512-add6-b6612700e15d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:08:55 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-80629f8b-eef8-4750-b09d-8ed35e4d1af0 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Lock "/opt/stack/data/nova/instances/471df318-7d9f-4512-add6-b6612700e15d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:08:55 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-80629f8b-eef8-4750-b09d-8ed35e4d1af0 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Lock "/opt/stack/data/nova/instances/471df318-7d9f-4512-add6-b6612700e15d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:08:55 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-80629f8b-eef8-4750-b09d-8ed35e4d1af0 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:08:55 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-80629f8b-eef8-4750-b09d-8ed35e4d1af0 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json" returned: 0 in 0.248s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:08:55 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-80629f8b-eef8-4750-b09d-8ed35e4d1af0 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Acquiring lock "7d3243421cf3fdc288b758f687a93103b7b95466" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:08:55 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-80629f8b-eef8-4750-b09d-8ed35e4d1af0 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Lock "7d3243421cf3fdc288b758f687a93103b7b95466" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:08:55 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-80629f8b-eef8-4750-b09d-8ed35e4d1af0 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:08:56 user nova-compute[75165]: DEBUG nova.network.neutron [req-90054bdf-29b3-4e1b-ab71-181d211d3dee req-d5d550f6-d3d0-48cf-b34b-94b2138ef108 service nova] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Updating instance_info_cache with network_info: [] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:08:56 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-80629f8b-eef8-4750-b09d-8ed35e4d1af0 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json" returned: 0 in 0.193s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:08:56 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-80629f8b-eef8-4750-b09d-8ed35e4d1af0 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466,backing_fmt=raw /opt/stack/data/nova/instances/471df318-7d9f-4512-add6-b6612700e15d/disk 1073741824 {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:08:56 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-90054bdf-29b3-4e1b-ab71-181d211d3dee req-d5d550f6-d3d0-48cf-b34b-94b2138ef108 service nova] Releasing lock "refresh_cache-8d5569ce-1f18-4f37-a340-099ee152d548" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:08:56 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-80629f8b-eef8-4750-b09d-8ed35e4d1af0 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466,backing_fmt=raw /opt/stack/data/nova/instances/471df318-7d9f-4512-add6-b6612700e15d/disk 1073741824" returned: 0 in 0.052s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:08:56 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-80629f8b-eef8-4750-b09d-8ed35e4d1af0 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Lock "7d3243421cf3fdc288b758f687a93103b7b95466" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.250s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:08:56 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-80629f8b-eef8-4750-b09d-8ed35e4d1af0 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:08:56 user nova-compute[75165]: DEBUG nova.network.neutron [None req-80629f8b-eef8-4750-b09d-8ed35e4d1af0 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] [instance: 471df318-7d9f-4512-add6-b6612700e15d] Successfully created port: f974b6d7-2580-4ea2-9e66-d24406b97fb8 {{(pid=75165) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 00:08:56 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-80629f8b-eef8-4750-b09d-8ed35e4d1af0 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json" returned: 0 in 0.189s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:08:56 user nova-compute[75165]: DEBUG nova.virt.disk.api [None req-80629f8b-eef8-4750-b09d-8ed35e4d1af0 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Checking if we can resize image /opt/stack/data/nova/instances/471df318-7d9f-4512-add6-b6612700e15d/disk. size=1073741824 {{(pid=75165) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 00:08:56 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-80629f8b-eef8-4750-b09d-8ed35e4d1af0 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/471df318-7d9f-4512-add6-b6612700e15d/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:08:56 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-80629f8b-eef8-4750-b09d-8ed35e4d1af0 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/471df318-7d9f-4512-add6-b6612700e15d/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:08:56 user nova-compute[75165]: DEBUG nova.virt.disk.api [None req-80629f8b-eef8-4750-b09d-8ed35e4d1af0 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Cannot resize image /opt/stack/data/nova/instances/471df318-7d9f-4512-add6-b6612700e15d/disk to a smaller size. {{(pid=75165) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 00:08:56 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-80629f8b-eef8-4750-b09d-8ed35e4d1af0 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] [instance: 471df318-7d9f-4512-add6-b6612700e15d] Created local disks {{(pid=75165) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 00:08:56 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-80629f8b-eef8-4750-b09d-8ed35e4d1af0 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] [instance: 471df318-7d9f-4512-add6-b6612700e15d] Ensure instance console log exists: /opt/stack/data/nova/instances/471df318-7d9f-4512-add6-b6612700e15d/console.log {{(pid=75165) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 00:08:56 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-80629f8b-eef8-4750-b09d-8ed35e4d1af0 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:08:56 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-80629f8b-eef8-4750-b09d-8ed35e4d1af0 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:08:56 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-80629f8b-eef8-4750-b09d-8ed35e4d1af0 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:08:56 user nova-compute[75165]: DEBUG nova.network.neutron [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Successfully updated port: b9583014-bb07-4337-97bb-30001c05475f {{(pid=75165) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 00:08:56 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:08:56 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75165) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 00:08:57 user nova-compute[75165]: DEBUG nova.network.neutron [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Successfully updated port: c51f288f-44b9-476b-9419-22ef8ae5c900 {{(pid=75165) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 00:08:57 user nova-compute[75165]: DEBUG nova.network.neutron [None req-80629f8b-eef8-4750-b09d-8ed35e4d1af0 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] [instance: 471df318-7d9f-4512-add6-b6612700e15d] Successfully updated port: f974b6d7-2580-4ea2-9e66-d24406b97fb8 {{(pid=75165) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 00:08:57 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-80629f8b-eef8-4750-b09d-8ed35e4d1af0 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Acquiring lock "refresh_cache-471df318-7d9f-4512-add6-b6612700e15d" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:08:57 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-80629f8b-eef8-4750-b09d-8ed35e4d1af0 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Acquired lock "refresh_cache-471df318-7d9f-4512-add6-b6612700e15d" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:08:57 user nova-compute[75165]: DEBUG nova.network.neutron [None req-80629f8b-eef8-4750-b09d-8ed35e4d1af0 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] [instance: 471df318-7d9f-4512-add6-b6612700e15d] Building network info cache for instance {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 00:08:57 user nova-compute[75165]: DEBUG nova.compute.manager [req-d493c5ca-7318-438e-af36-a6acdc10b03c req-0f0b4587-0787-4994-b50c-4ac006804263 service nova] [instance: 471df318-7d9f-4512-add6-b6612700e15d] Received event network-changed-f974b6d7-2580-4ea2-9e66-d24406b97fb8 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:08:57 user nova-compute[75165]: DEBUG nova.compute.manager [req-d493c5ca-7318-438e-af36-a6acdc10b03c req-0f0b4587-0787-4994-b50c-4ac006804263 service nova] [instance: 471df318-7d9f-4512-add6-b6612700e15d] Refreshing instance network info cache due to event network-changed-f974b6d7-2580-4ea2-9e66-d24406b97fb8. {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 00:08:57 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-d493c5ca-7318-438e-af36-a6acdc10b03c req-0f0b4587-0787-4994-b50c-4ac006804263 service nova] Acquiring lock "refresh_cache-471df318-7d9f-4512-add6-b6612700e15d" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:08:57 user nova-compute[75165]: DEBUG nova.compute.manager [req-38671c34-6be6-4dcf-94a3-ff31fc89ec74 req-7495132a-1e20-4b4e-810f-29207fdd9bec service nova] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Received event network-changed-b9583014-bb07-4337-97bb-30001c05475f {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:08:57 user nova-compute[75165]: DEBUG nova.compute.manager [req-38671c34-6be6-4dcf-94a3-ff31fc89ec74 req-7495132a-1e20-4b4e-810f-29207fdd9bec service nova] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Refreshing instance network info cache due to event network-changed-b9583014-bb07-4337-97bb-30001c05475f. {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 00:08:57 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-38671c34-6be6-4dcf-94a3-ff31fc89ec74 req-7495132a-1e20-4b4e-810f-29207fdd9bec service nova] Acquiring lock "refresh_cache-8d5569ce-1f18-4f37-a340-099ee152d548" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:08:57 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-38671c34-6be6-4dcf-94a3-ff31fc89ec74 req-7495132a-1e20-4b4e-810f-29207fdd9bec service nova] Acquired lock "refresh_cache-8d5569ce-1f18-4f37-a340-099ee152d548" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:08:57 user nova-compute[75165]: DEBUG nova.network.neutron [req-38671c34-6be6-4dcf-94a3-ff31fc89ec74 req-7495132a-1e20-4b4e-810f-29207fdd9bec service nova] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Refreshing network info cache for port b9583014-bb07-4337-97bb-30001c05475f {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 00:08:57 user nova-compute[75165]: DEBUG nova.network.neutron [None req-80629f8b-eef8-4750-b09d-8ed35e4d1af0 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] [instance: 471df318-7d9f-4512-add6-b6612700e15d] Instance cache missing network info. {{(pid=75165) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 00:08:57 user nova-compute[75165]: DEBUG nova.network.neutron [req-38671c34-6be6-4dcf-94a3-ff31fc89ec74 req-7495132a-1e20-4b4e-810f-29207fdd9bec service nova] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Instance cache missing network info. {{(pid=75165) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 00:08:57 user nova-compute[75165]: DEBUG nova.network.neutron [None req-80629f8b-eef8-4750-b09d-8ed35e4d1af0 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] [instance: 471df318-7d9f-4512-add6-b6612700e15d] Updating instance_info_cache with network_info: [{"id": "f974b6d7-2580-4ea2-9e66-d24406b97fb8", "address": "fa:16:3e:9c:82:dc", "network": {"id": "6344595d-af28-41d8-9091-f7565d587f85", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-916895889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "410dcedc2c3c49c3990259eca1aee491", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf974b6d7-25", "ovs_interfaceid": "f974b6d7-2580-4ea2-9e66-d24406b97fb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:08:57 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-80629f8b-eef8-4750-b09d-8ed35e4d1af0 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Releasing lock "refresh_cache-471df318-7d9f-4512-add6-b6612700e15d" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:08:57 user nova-compute[75165]: DEBUG nova.compute.manager [None req-80629f8b-eef8-4750-b09d-8ed35e4d1af0 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] [instance: 471df318-7d9f-4512-add6-b6612700e15d] Instance network_info: |[{"id": "f974b6d7-2580-4ea2-9e66-d24406b97fb8", "address": "fa:16:3e:9c:82:dc", "network": {"id": "6344595d-af28-41d8-9091-f7565d587f85", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-916895889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "410dcedc2c3c49c3990259eca1aee491", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf974b6d7-25", "ovs_interfaceid": "f974b6d7-2580-4ea2-9e66-d24406b97fb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75165) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 00:08:57 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-d493c5ca-7318-438e-af36-a6acdc10b03c req-0f0b4587-0787-4994-b50c-4ac006804263 service nova] Acquired lock "refresh_cache-471df318-7d9f-4512-add6-b6612700e15d" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:08:57 user nova-compute[75165]: DEBUG nova.network.neutron [req-d493c5ca-7318-438e-af36-a6acdc10b03c req-0f0b4587-0787-4994-b50c-4ac006804263 service nova] [instance: 471df318-7d9f-4512-add6-b6612700e15d] Refreshing network info cache for port f974b6d7-2580-4ea2-9e66-d24406b97fb8 {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 00:08:57 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-80629f8b-eef8-4750-b09d-8ed35e4d1af0 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] [instance: 471df318-7d9f-4512-add6-b6612700e15d] Start _get_guest_xml network_info=[{"id": "f974b6d7-2580-4ea2-9e66-d24406b97fb8", "address": "fa:16:3e:9c:82:dc", "network": {"id": "6344595d-af28-41d8-9091-f7565d587f85", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-916895889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "410dcedc2c3c49c3990259eca1aee491", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf974b6d7-25", "ovs_interfaceid": "f974b6d7-2580-4ea2-9e66-d24406b97fb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T00:03:24Z,direct_url=<?>,disk_format='qcow2',id=bff0d8a1-739e-4c4d-9efa-b73ba7b76d01,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e56bbf444fd34c348475c73673611447',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T00:03:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'size': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': 'bff0d8a1-739e-4c4d-9efa-b73ba7b76d01'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75165) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 00:08:57 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-80629f8b-eef8-4750-b09d-8ed35e4d1af0 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:08:57 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-80629f8b-eef8-4750-b09d-8ed35e4d1af0 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:08:57 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-80629f8b-eef8-4750-b09d-8ed35e4d1af0 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75165) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 00:08:57 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-80629f8b-eef8-4750-b09d-8ed35e4d1af0 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] CPU controller missing on host. {{(pid=75165) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 00:08:57 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-80629f8b-eef8-4750-b09d-8ed35e4d1af0 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75165) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 00:08:57 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-80629f8b-eef8-4750-b09d-8ed35e4d1af0 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] CPU controller found on host. {{(pid=75165) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 00:08:57 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-80629f8b-eef8-4750-b09d-8ed35e4d1af0 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75165) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 00:08:57 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-80629f8b-eef8-4750-b09d-8ed35e4d1af0 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T00:03:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T00:03:24Z,direct_url=<?>,disk_format='qcow2',id=bff0d8a1-739e-4c4d-9efa-b73ba7b76d01,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e56bbf444fd34c348475c73673611447',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T00:03:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 00:08:57 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-80629f8b-eef8-4750-b09d-8ed35e4d1af0 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Flavor limits 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 00:08:57 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-80629f8b-eef8-4750-b09d-8ed35e4d1af0 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Image limits 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 00:08:57 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-80629f8b-eef8-4750-b09d-8ed35e4d1af0 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Flavor pref 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 00:08:57 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-80629f8b-eef8-4750-b09d-8ed35e4d1af0 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Image pref 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 00:08:57 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-80629f8b-eef8-4750-b09d-8ed35e4d1af0 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 00:08:57 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-80629f8b-eef8-4750-b09d-8ed35e4d1af0 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 00:08:57 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-80629f8b-eef8-4750-b09d-8ed35e4d1af0 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75165) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 00:08:57 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-80629f8b-eef8-4750-b09d-8ed35e4d1af0 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Got 1 possible topologies {{(pid=75165) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 00:08:57 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-80629f8b-eef8-4750-b09d-8ed35e4d1af0 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 00:08:57 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-80629f8b-eef8-4750-b09d-8ed35e4d1af0 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 00:08:57 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-80629f8b-eef8-4750-b09d-8ed35e4d1af0 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:08:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-235174092',display_name='tempest-ServersNegativeTestJSON-server-235174092',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-235174092',id=13,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='410dcedc2c3c49c3990259eca1aee491',ramdisk_id='',reservation_id='r-9a2fvupw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-585947888',owner_user_name='tempest-ServersNegativeTestJSON-585947888-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T00:08:55Z,user_data=None,user_id='d86fd0a8654f412d8c4e8e14d408d7ed',uuid=471df318-7d9f-4512-add6-b6612700e15d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f974b6d7-2580-4ea2-9e66-d24406b97fb8", "address": "fa:16:3e:9c:82:dc", "network": {"id": "6344595d-af28-41d8-9091-f7565d587f85", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-916895889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "410dcedc2c3c49c3990259eca1aee491", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf974b6d7-25", "ovs_interfaceid": "f974b6d7-2580-4ea2-9e66-d24406b97fb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75165) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 00:08:57 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-80629f8b-eef8-4750-b09d-8ed35e4d1af0 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Converting VIF {"id": "f974b6d7-2580-4ea2-9e66-d24406b97fb8", "address": "fa:16:3e:9c:82:dc", "network": {"id": "6344595d-af28-41d8-9091-f7565d587f85", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-916895889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "410dcedc2c3c49c3990259eca1aee491", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf974b6d7-25", "ovs_interfaceid": "f974b6d7-2580-4ea2-9e66-d24406b97fb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:08:57 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-80629f8b-eef8-4750-b09d-8ed35e4d1af0 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:82:dc,bridge_name='br-int',has_traffic_filtering=True,id=f974b6d7-2580-4ea2-9e66-d24406b97fb8,network=Network(6344595d-af28-41d8-9091-f7565d587f85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf974b6d7-25') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:08:57 user nova-compute[75165]: DEBUG nova.objects.instance [None req-80629f8b-eef8-4750-b09d-8ed35e4d1af0 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Lazy-loading 'pci_devices' on Instance uuid 471df318-7d9f-4512-add6-b6612700e15d {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:08:57 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-80629f8b-eef8-4750-b09d-8ed35e4d1af0 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] [instance: 471df318-7d9f-4512-add6-b6612700e15d] End _get_guest_xml xml=<domain type="kvm">
Oct 26 00:08:57 user nova-compute[75165]:   <uuid>471df318-7d9f-4512-add6-b6612700e15d</uuid>
Oct 26 00:08:57 user nova-compute[75165]:   <name>instance-0000000d</name>
Oct 26 00:08:57 user nova-compute[75165]:   <memory>524288</memory>
Oct 26 00:08:57 user nova-compute[75165]:   <vcpu>1</vcpu>
Oct 26 00:08:57 user nova-compute[75165]:   <metadata>
Oct 26 00:08:57 user nova-compute[75165]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 00:08:57 user nova-compute[75165]:       <nova:package version="0.0.0"/>
Oct 26 00:08:57 user nova-compute[75165]:       <nova:name>tempest-ServersNegativeTestJSON-server-235174092</nova:name>
Oct 26 00:08:57 user nova-compute[75165]:       <nova:creationTime>2023-10-26 00:08:57</nova:creationTime>
Oct 26 00:08:57 user nova-compute[75165]:       <nova:flavor name="m1.tiny">
Oct 26 00:08:57 user nova-compute[75165]:         <nova:memory>512</nova:memory>
Oct 26 00:08:57 user nova-compute[75165]:         <nova:disk>1</nova:disk>
Oct 26 00:08:57 user nova-compute[75165]:         <nova:swap>0</nova:swap>
Oct 26 00:08:57 user nova-compute[75165]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 00:08:57 user nova-compute[75165]:         <nova:vcpus>1</nova:vcpus>
Oct 26 00:08:57 user nova-compute[75165]:       </nova:flavor>
Oct 26 00:08:57 user nova-compute[75165]:       <nova:owner>
Oct 26 00:08:57 user nova-compute[75165]:         <nova:user uuid="d86fd0a8654f412d8c4e8e14d408d7ed">tempest-ServersNegativeTestJSON-585947888-project-member</nova:user>
Oct 26 00:08:57 user nova-compute[75165]:         <nova:project uuid="410dcedc2c3c49c3990259eca1aee491">tempest-ServersNegativeTestJSON-585947888</nova:project>
Oct 26 00:08:57 user nova-compute[75165]:       </nova:owner>
Oct 26 00:08:57 user nova-compute[75165]:       <nova:root type="image" uuid="bff0d8a1-739e-4c4d-9efa-b73ba7b76d01"/>
Oct 26 00:08:57 user nova-compute[75165]:       <nova:ports>
Oct 26 00:08:57 user nova-compute[75165]:         <nova:port uuid="f974b6d7-2580-4ea2-9e66-d24406b97fb8">
Oct 26 00:08:57 user nova-compute[75165]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 26 00:08:57 user nova-compute[75165]:         </nova:port>
Oct 26 00:08:57 user nova-compute[75165]:       </nova:ports>
Oct 26 00:08:57 user nova-compute[75165]:     </nova:instance>
Oct 26 00:08:57 user nova-compute[75165]:   </metadata>
Oct 26 00:08:57 user nova-compute[75165]:   <sysinfo type="smbios">
Oct 26 00:08:57 user nova-compute[75165]:     <system>
Oct 26 00:08:57 user nova-compute[75165]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 00:08:57 user nova-compute[75165]:       <entry name="product">OpenStack Nova</entry>
Oct 26 00:08:57 user nova-compute[75165]:       <entry name="version">0.0.0</entry>
Oct 26 00:08:57 user nova-compute[75165]:       <entry name="serial">471df318-7d9f-4512-add6-b6612700e15d</entry>
Oct 26 00:08:57 user nova-compute[75165]:       <entry name="uuid">471df318-7d9f-4512-add6-b6612700e15d</entry>
Oct 26 00:08:57 user nova-compute[75165]:       <entry name="family">Virtual Machine</entry>
Oct 26 00:08:57 user nova-compute[75165]:     </system>
Oct 26 00:08:57 user nova-compute[75165]:   </sysinfo>
Oct 26 00:08:57 user nova-compute[75165]:   <os>
Oct 26 00:08:57 user nova-compute[75165]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 00:08:57 user nova-compute[75165]:     <boot dev="hd"/>
Oct 26 00:08:57 user nova-compute[75165]:     <smbios mode="sysinfo"/>
Oct 26 00:08:57 user nova-compute[75165]:   </os>
Oct 26 00:08:57 user nova-compute[75165]:   <features>
Oct 26 00:08:57 user nova-compute[75165]:     <acpi/>
Oct 26 00:08:57 user nova-compute[75165]:     <apic/>
Oct 26 00:08:57 user nova-compute[75165]:     <vmcoreinfo/>
Oct 26 00:08:57 user nova-compute[75165]:   </features>
Oct 26 00:08:57 user nova-compute[75165]:   <clock offset="utc">
Oct 26 00:08:57 user nova-compute[75165]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 00:08:57 user nova-compute[75165]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 00:08:57 user nova-compute[75165]:     <timer name="hpet" present="no"/>
Oct 26 00:08:57 user nova-compute[75165]:   </clock>
Oct 26 00:08:57 user nova-compute[75165]:   <cpu mode="custom" match="exact">
Oct 26 00:08:57 user nova-compute[75165]:     <model>Nehalem</model>
Oct 26 00:08:57 user nova-compute[75165]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 00:08:57 user nova-compute[75165]:   </cpu>
Oct 26 00:08:57 user nova-compute[75165]:   <devices>
Oct 26 00:08:57 user nova-compute[75165]:     <disk type="file" device="disk">
Oct 26 00:08:57 user nova-compute[75165]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 00:08:57 user nova-compute[75165]:       <source file="/opt/stack/data/nova/instances/471df318-7d9f-4512-add6-b6612700e15d/disk"/>
Oct 26 00:08:57 user nova-compute[75165]:       <target dev="vda" bus="virtio"/>
Oct 26 00:08:57 user nova-compute[75165]:     </disk>
Oct 26 00:08:57 user nova-compute[75165]:     <interface type="ethernet">
Oct 26 00:08:57 user nova-compute[75165]:       <mac address="fa:16:3e:9c:82:dc"/>
Oct 26 00:08:57 user nova-compute[75165]:       <model type="virtio"/>
Oct 26 00:08:57 user nova-compute[75165]:       <mtu size="1442"/>
Oct 26 00:08:57 user nova-compute[75165]:       <target dev="tapf974b6d7-25"/>
Oct 26 00:08:57 user nova-compute[75165]:     </interface>
Oct 26 00:08:57 user nova-compute[75165]:     <serial type="pty">
Oct 26 00:08:57 user nova-compute[75165]:       <log file="/opt/stack/data/nova/instances/471df318-7d9f-4512-add6-b6612700e15d/console.log" append="off"/>
Oct 26 00:08:57 user nova-compute[75165]:     </serial>
Oct 26 00:08:57 user nova-compute[75165]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 00:08:57 user nova-compute[75165]:     <video>
Oct 26 00:08:57 user nova-compute[75165]:       <model type="virtio"/>
Oct 26 00:08:57 user nova-compute[75165]:     </video>
Oct 26 00:08:57 user nova-compute[75165]:     <rng model="virtio">
Oct 26 00:08:57 user nova-compute[75165]:       <backend model="random">/dev/urandom</backend>
Oct 26 00:08:57 user nova-compute[75165]:     </rng>
Oct 26 00:08:57 user nova-compute[75165]:     <controller type="usb" index="0" model="none"/>
Oct 26 00:08:57 user nova-compute[75165]:     <memballoon model="virtio">
Oct 26 00:08:57 user nova-compute[75165]:       <stats period="10"/>
Oct 26 00:08:57 user nova-compute[75165]:     </memballoon>
Oct 26 00:08:57 user nova-compute[75165]:   </devices>
Oct 26 00:08:57 user nova-compute[75165]: </domain>
Oct 26 00:08:57 user nova-compute[75165]:  {{(pid=75165) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 00:08:57 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-80629f8b-eef8-4750-b09d-8ed35e4d1af0 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:08:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-235174092',display_name='tempest-ServersNegativeTestJSON-server-235174092',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-235174092',id=13,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='410dcedc2c3c49c3990259eca1aee491',ramdisk_id='',reservation_id='r-9a2fvupw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-585947888',owner_user_name='tempest-ServersNegativeTestJSON-585947888-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T00:08:55Z,user_data=None,user_id='d86fd0a8654f412d8c4e8e14d408d7ed',uuid=471df318-7d9f-4512-add6-b6612700e15d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f974b6d7-2580-4ea2-9e66-d24406b97fb8", "address": "fa:16:3e:9c:82:dc", "network": {"id": "6344595d-af28-41d8-9091-f7565d587f85", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-916895889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "410dcedc2c3c49c3990259eca1aee491", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf974b6d7-25", "ovs_interfaceid": "f974b6d7-2580-4ea2-9e66-d24406b97fb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 00:08:57 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-80629f8b-eef8-4750-b09d-8ed35e4d1af0 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Converting VIF {"id": "f974b6d7-2580-4ea2-9e66-d24406b97fb8", "address": "fa:16:3e:9c:82:dc", "network": {"id": "6344595d-af28-41d8-9091-f7565d587f85", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-916895889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "410dcedc2c3c49c3990259eca1aee491", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf974b6d7-25", "ovs_interfaceid": "f974b6d7-2580-4ea2-9e66-d24406b97fb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:08:57 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-80629f8b-eef8-4750-b09d-8ed35e4d1af0 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:82:dc,bridge_name='br-int',has_traffic_filtering=True,id=f974b6d7-2580-4ea2-9e66-d24406b97fb8,network=Network(6344595d-af28-41d8-9091-f7565d587f85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf974b6d7-25') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:08:57 user nova-compute[75165]: DEBUG os_vif [None req-80629f8b-eef8-4750-b09d-8ed35e4d1af0 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:82:dc,bridge_name='br-int',has_traffic_filtering=True,id=f974b6d7-2580-4ea2-9e66-d24406b97fb8,network=Network(6344595d-af28-41d8-9091-f7565d587f85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf974b6d7-25') {{(pid=75165) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 00:08:57 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:08:57 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:08:57 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 00:08:57 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:08:57 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '81fcd0d5-2d2a-5874-ab0d-cff0445c78ac', '_type': 'linux-noop'}}, row=False) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:08:57 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:08:57 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:08:57 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:08:57 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf974b6d7-25, may_exist=True, interface_attrs={}) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:08:57 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf974b6d7-25, col_values=(('qos', UUID('2ac53f2c-cbbd-4305-9683-c464ed65b38d')),), if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:08:57 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf974b6d7-25, col_values=(('external_ids', {'iface-id': 'f974b6d7-2580-4ea2-9e66-d24406b97fb8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9c:82:dc', 'vm-uuid': '471df318-7d9f-4512-add6-b6612700e15d'}),), if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:08:57 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:08:57 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:08:57 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:08:57 user nova-compute[75165]: INFO os_vif [None req-80629f8b-eef8-4750-b09d-8ed35e4d1af0 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:82:dc,bridge_name='br-int',has_traffic_filtering=True,id=f974b6d7-2580-4ea2-9e66-d24406b97fb8,network=Network(6344595d-af28-41d8-9091-f7565d587f85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf974b6d7-25')
Oct 26 00:08:57 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-80629f8b-eef8-4750-b09d-8ed35e4d1af0 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] No BDM found with device name vda, not building metadata. {{(pid=75165) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 00:08:57 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-80629f8b-eef8-4750-b09d-8ed35e4d1af0 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] No VIF found with MAC fa:16:3e:9c:82:dc, not building metadata {{(pid=75165) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 00:08:57 user nova-compute[75165]: DEBUG nova.network.neutron [req-38671c34-6be6-4dcf-94a3-ff31fc89ec74 req-7495132a-1e20-4b4e-810f-29207fdd9bec service nova] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Updating instance_info_cache with network_info: [] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:08:57 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-38671c34-6be6-4dcf-94a3-ff31fc89ec74 req-7495132a-1e20-4b4e-810f-29207fdd9bec service nova] Releasing lock "refresh_cache-8d5569ce-1f18-4f37-a340-099ee152d548" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:08:57 user nova-compute[75165]: DEBUG nova.compute.manager [req-38671c34-6be6-4dcf-94a3-ff31fc89ec74 req-7495132a-1e20-4b4e-810f-29207fdd9bec service nova] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Received event network-changed-c51f288f-44b9-476b-9419-22ef8ae5c900 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:08:57 user nova-compute[75165]: DEBUG nova.compute.manager [req-38671c34-6be6-4dcf-94a3-ff31fc89ec74 req-7495132a-1e20-4b4e-810f-29207fdd9bec service nova] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Refreshing instance network info cache due to event network-changed-c51f288f-44b9-476b-9419-22ef8ae5c900. {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 00:08:57 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-38671c34-6be6-4dcf-94a3-ff31fc89ec74 req-7495132a-1e20-4b4e-810f-29207fdd9bec service nova] Acquiring lock "refresh_cache-8d5569ce-1f18-4f37-a340-099ee152d548" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:08:57 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-38671c34-6be6-4dcf-94a3-ff31fc89ec74 req-7495132a-1e20-4b4e-810f-29207fdd9bec service nova] Acquired lock "refresh_cache-8d5569ce-1f18-4f37-a340-099ee152d548" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:08:57 user nova-compute[75165]: DEBUG nova.network.neutron [req-38671c34-6be6-4dcf-94a3-ff31fc89ec74 req-7495132a-1e20-4b4e-810f-29207fdd9bec service nova] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Refreshing network info cache for port c51f288f-44b9-476b-9419-22ef8ae5c900 {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 00:08:58 user nova-compute[75165]: DEBUG nova.network.neutron [req-38671c34-6be6-4dcf-94a3-ff31fc89ec74 req-7495132a-1e20-4b4e-810f-29207fdd9bec service nova] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Instance cache missing network info. {{(pid=75165) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 00:08:58 user nova-compute[75165]: DEBUG nova.network.neutron [req-d493c5ca-7318-438e-af36-a6acdc10b03c req-0f0b4587-0787-4994-b50c-4ac006804263 service nova] [instance: 471df318-7d9f-4512-add6-b6612700e15d] Updated VIF entry in instance network info cache for port f974b6d7-2580-4ea2-9e66-d24406b97fb8. {{(pid=75165) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 00:08:58 user nova-compute[75165]: DEBUG nova.network.neutron [req-d493c5ca-7318-438e-af36-a6acdc10b03c req-0f0b4587-0787-4994-b50c-4ac006804263 service nova] [instance: 471df318-7d9f-4512-add6-b6612700e15d] Updating instance_info_cache with network_info: [{"id": "f974b6d7-2580-4ea2-9e66-d24406b97fb8", "address": "fa:16:3e:9c:82:dc", "network": {"id": "6344595d-af28-41d8-9091-f7565d587f85", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-916895889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "410dcedc2c3c49c3990259eca1aee491", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf974b6d7-25", "ovs_interfaceid": "f974b6d7-2580-4ea2-9e66-d24406b97fb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:08:58 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-d493c5ca-7318-438e-af36-a6acdc10b03c req-0f0b4587-0787-4994-b50c-4ac006804263 service nova] Releasing lock "refresh_cache-471df318-7d9f-4512-add6-b6612700e15d" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:08:58 user nova-compute[75165]: INFO nova.compute.manager [None req-b3baaca2-f65e-4ba7-96d8-96d1730fa243 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: c4e44bfc-6a68-46ce-8335-aaaba5160d3e] Rescuing
Oct 26 00:08:58 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-b3baaca2-f65e-4ba7-96d8-96d1730fa243 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Acquiring lock "refresh_cache-c4e44bfc-6a68-46ce-8335-aaaba5160d3e" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:08:58 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-b3baaca2-f65e-4ba7-96d8-96d1730fa243 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Acquired lock "refresh_cache-c4e44bfc-6a68-46ce-8335-aaaba5160d3e" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:08:58 user nova-compute[75165]: DEBUG nova.network.neutron [None req-b3baaca2-f65e-4ba7-96d8-96d1730fa243 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: c4e44bfc-6a68-46ce-8335-aaaba5160d3e] Building network info cache for instance {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 00:08:58 user nova-compute[75165]: DEBUG nova.network.neutron [req-38671c34-6be6-4dcf-94a3-ff31fc89ec74 req-7495132a-1e20-4b4e-810f-29207fdd9bec service nova] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Updating instance_info_cache with network_info: [] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:08:58 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-38671c34-6be6-4dcf-94a3-ff31fc89ec74 req-7495132a-1e20-4b4e-810f-29207fdd9bec service nova] Releasing lock "refresh_cache-8d5569ce-1f18-4f37-a340-099ee152d548" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:08:58 user nova-compute[75165]: DEBUG nova.network.neutron [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Successfully updated port: c019e949-c6fc-4014-9e42-13ce1eb17786 {{(pid=75165) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 00:08:58 user nova-compute[75165]: DEBUG nova.network.neutron [None req-b3baaca2-f65e-4ba7-96d8-96d1730fa243 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: c4e44bfc-6a68-46ce-8335-aaaba5160d3e] Updating instance_info_cache with network_info: [{"id": "842f3b7a-8da7-48d2-90f7-7241fbaab648", "address": "fa:16:3e:1f:64:04", "network": {"id": "b31bac4b-1951-4ca3-8682-f1f24de0a5c3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1323234642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71aa69c0ea2d49e184e1e055ff3efa1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap842f3b7a-8d", "ovs_interfaceid": "842f3b7a-8da7-48d2-90f7-7241fbaab648", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:08:58 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-b3baaca2-f65e-4ba7-96d8-96d1730fa243 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Releasing lock "refresh_cache-c4e44bfc-6a68-46ce-8335-aaaba5160d3e" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:08:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:08:58 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:08:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:08:58 user nova-compute[75165]: DEBUG nova.network.neutron [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Successfully updated port: 9cecd3d6-4945-4a4b-8d06-48b0d7768a17 {{(pid=75165) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 00:08:59 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:08:59 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:08:59 user nova-compute[75165]: DEBUG nova.compute.manager [req-668bb1ad-8277-47cb-a373-b5ee124c7451 req-51a56feb-4908-4876-bc6a-9f36553a1a28 service nova] [instance: c4e44bfc-6a68-46ce-8335-aaaba5160d3e] Received event network-vif-unplugged-842f3b7a-8da7-48d2-90f7-7241fbaab648 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:08:59 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-668bb1ad-8277-47cb-a373-b5ee124c7451 req-51a56feb-4908-4876-bc6a-9f36553a1a28 service nova] Acquiring lock "c4e44bfc-6a68-46ce-8335-aaaba5160d3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:08:59 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-668bb1ad-8277-47cb-a373-b5ee124c7451 req-51a56feb-4908-4876-bc6a-9f36553a1a28 service nova] Lock "c4e44bfc-6a68-46ce-8335-aaaba5160d3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:08:59 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-668bb1ad-8277-47cb-a373-b5ee124c7451 req-51a56feb-4908-4876-bc6a-9f36553a1a28 service nova] Lock "c4e44bfc-6a68-46ce-8335-aaaba5160d3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:08:59 user nova-compute[75165]: DEBUG nova.compute.manager [req-668bb1ad-8277-47cb-a373-b5ee124c7451 req-51a56feb-4908-4876-bc6a-9f36553a1a28 service nova] [instance: c4e44bfc-6a68-46ce-8335-aaaba5160d3e] No waiting events found dispatching network-vif-unplugged-842f3b7a-8da7-48d2-90f7-7241fbaab648 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:08:59 user nova-compute[75165]: WARNING nova.compute.manager [req-668bb1ad-8277-47cb-a373-b5ee124c7451 req-51a56feb-4908-4876-bc6a-9f36553a1a28 service nova] [instance: c4e44bfc-6a68-46ce-8335-aaaba5160d3e] Received unexpected event network-vif-unplugged-842f3b7a-8da7-48d2-90f7-7241fbaab648 for instance with vm_state active and task_state rescuing.
Oct 26 00:08:59 user nova-compute[75165]: DEBUG nova.compute.manager [req-668bb1ad-8277-47cb-a373-b5ee124c7451 req-51a56feb-4908-4876-bc6a-9f36553a1a28 service nova] [instance: c4e44bfc-6a68-46ce-8335-aaaba5160d3e] Received event network-vif-plugged-842f3b7a-8da7-48d2-90f7-7241fbaab648 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:08:59 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-668bb1ad-8277-47cb-a373-b5ee124c7451 req-51a56feb-4908-4876-bc6a-9f36553a1a28 service nova] Acquiring lock "c4e44bfc-6a68-46ce-8335-aaaba5160d3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:08:59 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-668bb1ad-8277-47cb-a373-b5ee124c7451 req-51a56feb-4908-4876-bc6a-9f36553a1a28 service nova] Lock "c4e44bfc-6a68-46ce-8335-aaaba5160d3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:08:59 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-668bb1ad-8277-47cb-a373-b5ee124c7451 req-51a56feb-4908-4876-bc6a-9f36553a1a28 service nova] Lock "c4e44bfc-6a68-46ce-8335-aaaba5160d3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:08:59 user nova-compute[75165]: DEBUG nova.compute.manager [req-668bb1ad-8277-47cb-a373-b5ee124c7451 req-51a56feb-4908-4876-bc6a-9f36553a1a28 service nova] [instance: c4e44bfc-6a68-46ce-8335-aaaba5160d3e] No waiting events found dispatching network-vif-plugged-842f3b7a-8da7-48d2-90f7-7241fbaab648 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:08:59 user nova-compute[75165]: WARNING nova.compute.manager [req-668bb1ad-8277-47cb-a373-b5ee124c7451 req-51a56feb-4908-4876-bc6a-9f36553a1a28 service nova] [instance: c4e44bfc-6a68-46ce-8335-aaaba5160d3e] Received unexpected event network-vif-plugged-842f3b7a-8da7-48d2-90f7-7241fbaab648 for instance with vm_state active and task_state rescuing.
Oct 26 00:08:59 user nova-compute[75165]: DEBUG nova.compute.manager [req-19ad63cb-00a5-4833-b2ab-256a2101a71e req-5125e588-ecd1-4823-b3af-c3d511b356eb service nova] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Received event network-changed-c019e949-c6fc-4014-9e42-13ce1eb17786 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:08:59 user nova-compute[75165]: DEBUG nova.compute.manager [req-19ad63cb-00a5-4833-b2ab-256a2101a71e req-5125e588-ecd1-4823-b3af-c3d511b356eb service nova] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Refreshing instance network info cache due to event network-changed-c019e949-c6fc-4014-9e42-13ce1eb17786. {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 00:08:59 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-19ad63cb-00a5-4833-b2ab-256a2101a71e req-5125e588-ecd1-4823-b3af-c3d511b356eb service nova] Acquiring lock "refresh_cache-8d5569ce-1f18-4f37-a340-099ee152d548" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:08:59 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-19ad63cb-00a5-4833-b2ab-256a2101a71e req-5125e588-ecd1-4823-b3af-c3d511b356eb service nova] Acquired lock "refresh_cache-8d5569ce-1f18-4f37-a340-099ee152d548" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:08:59 user nova-compute[75165]: DEBUG nova.network.neutron [req-19ad63cb-00a5-4833-b2ab-256a2101a71e req-5125e588-ecd1-4823-b3af-c3d511b356eb service nova] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Refreshing network info cache for port c019e949-c6fc-4014-9e42-13ce1eb17786 {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 00:08:59 user nova-compute[75165]: DEBUG nova.network.neutron [req-19ad63cb-00a5-4833-b2ab-256a2101a71e req-5125e588-ecd1-4823-b3af-c3d511b356eb service nova] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Instance cache missing network info. {{(pid=75165) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 00:08:59 user nova-compute[75165]: DEBUG nova.network.neutron [req-19ad63cb-00a5-4833-b2ab-256a2101a71e req-5125e588-ecd1-4823-b3af-c3d511b356eb service nova] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Updating instance_info_cache with network_info: [] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:08:59 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-19ad63cb-00a5-4833-b2ab-256a2101a71e req-5125e588-ecd1-4823-b3af-c3d511b356eb service nova] Releasing lock "refresh_cache-8d5569ce-1f18-4f37-a340-099ee152d548" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:08:59 user nova-compute[75165]: DEBUG nova.compute.manager [req-19ad63cb-00a5-4833-b2ab-256a2101a71e req-5125e588-ecd1-4823-b3af-c3d511b356eb service nova] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Received event network-changed-9cecd3d6-4945-4a4b-8d06-48b0d7768a17 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:08:59 user nova-compute[75165]: DEBUG nova.compute.manager [req-19ad63cb-00a5-4833-b2ab-256a2101a71e req-5125e588-ecd1-4823-b3af-c3d511b356eb service nova] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Refreshing instance network info cache due to event network-changed-9cecd3d6-4945-4a4b-8d06-48b0d7768a17. {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 00:08:59 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-19ad63cb-00a5-4833-b2ab-256a2101a71e req-5125e588-ecd1-4823-b3af-c3d511b356eb service nova] Acquiring lock "refresh_cache-8d5569ce-1f18-4f37-a340-099ee152d548" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:08:59 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-19ad63cb-00a5-4833-b2ab-256a2101a71e req-5125e588-ecd1-4823-b3af-c3d511b356eb service nova] Acquired lock "refresh_cache-8d5569ce-1f18-4f37-a340-099ee152d548" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:08:59 user nova-compute[75165]: DEBUG nova.network.neutron [req-19ad63cb-00a5-4833-b2ab-256a2101a71e req-5125e588-ecd1-4823-b3af-c3d511b356eb service nova] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Refreshing network info cache for port 9cecd3d6-4945-4a4b-8d06-48b0d7768a17 {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 00:08:59 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:08:59 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: c4e44bfc-6a68-46ce-8335-aaaba5160d3e] Instance destroyed successfully.
Oct 26 00:08:59 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-b3baaca2-f65e-4ba7-96d8-96d1730fa243 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: c4e44bfc-6a68-46ce-8335-aaaba5160d3e] Attempting rescue
Oct 26 00:08:59 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-b3baaca2-f65e-4ba7-96d8-96d1730fa243 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75165) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 26 00:08:59 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:08:59 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-b3baaca2-f65e-4ba7-96d8-96d1730fa243 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: c4e44bfc-6a68-46ce-8335-aaaba5160d3e] Instance directory exists: not creating {{(pid=75165) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 26 00:08:59 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-b3baaca2-f65e-4ba7-96d8-96d1730fa243 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: c4e44bfc-6a68-46ce-8335-aaaba5160d3e] Creating image(s)
Oct 26 00:08:59 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-b3baaca2-f65e-4ba7-96d8-96d1730fa243 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Acquiring lock "/opt/stack/data/nova/instances/c4e44bfc-6a68-46ce-8335-aaaba5160d3e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:08:59 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-b3baaca2-f65e-4ba7-96d8-96d1730fa243 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Lock "/opt/stack/data/nova/instances/c4e44bfc-6a68-46ce-8335-aaaba5160d3e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:08:59 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-b3baaca2-f65e-4ba7-96d8-96d1730fa243 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Lock "/opt/stack/data/nova/instances/c4e44bfc-6a68-46ce-8335-aaaba5160d3e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:08:59 user nova-compute[75165]: DEBUG nova.objects.instance [None req-b3baaca2-f65e-4ba7-96d8-96d1730fa243 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Lazy-loading 'trusted_certs' on Instance uuid c4e44bfc-6a68-46ce-8335-aaaba5160d3e {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:08:59 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:08:59 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:08:59 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:08:59 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-b3baaca2-f65e-4ba7-96d8-96d1730fa243 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Acquiring lock "7d3243421cf3fdc288b758f687a93103b7b95466" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:08:59 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-b3baaca2-f65e-4ba7-96d8-96d1730fa243 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Lock "7d3243421cf3fdc288b758f687a93103b7b95466" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:08:59 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-b3baaca2-f65e-4ba7-96d8-96d1730fa243 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:08:59 user nova-compute[75165]: DEBUG nova.network.neutron [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Successfully updated port: a04b8134-03e6-45f2-b6d7-3ea6a7deb81c {{(pid=75165) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 00:08:59 user nova-compute[75165]: DEBUG nova.network.neutron [req-19ad63cb-00a5-4833-b2ab-256a2101a71e req-5125e588-ecd1-4823-b3af-c3d511b356eb service nova] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Instance cache missing network info. {{(pid=75165) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 00:09:00 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-b3baaca2-f65e-4ba7-96d8-96d1730fa243 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json" returned: 0 in 0.226s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:09:00 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-b3baaca2-f65e-4ba7-96d8-96d1730fa243 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466,backing_fmt=raw /opt/stack/data/nova/instances/c4e44bfc-6a68-46ce-8335-aaaba5160d3e/disk.rescue {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:09:00 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:09:00 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-b3baaca2-f65e-4ba7-96d8-96d1730fa243 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466,backing_fmt=raw /opt/stack/data/nova/instances/c4e44bfc-6a68-46ce-8335-aaaba5160d3e/disk.rescue" returned: 0 in 0.050s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:09:00 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-b3baaca2-f65e-4ba7-96d8-96d1730fa243 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Lock "7d3243421cf3fdc288b758f687a93103b7b95466" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.280s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:09:00 user nova-compute[75165]: DEBUG nova.objects.instance [None req-b3baaca2-f65e-4ba7-96d8-96d1730fa243 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Lazy-loading 'migration_context' on Instance uuid c4e44bfc-6a68-46ce-8335-aaaba5160d3e {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:09:00 user nova-compute[75165]: DEBUG nova.objects.base [None req-b3baaca2-f65e-4ba7-96d8-96d1730fa243 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Object Instance<c4e44bfc-6a68-46ce-8335-aaaba5160d3e> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75165) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 00:09:00 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-b3baaca2-f65e-4ba7-96d8-96d1730fa243 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: c4e44bfc-6a68-46ce-8335-aaaba5160d3e] Created local disks {{(pid=75165) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 00:09:00 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-b3baaca2-f65e-4ba7-96d8-96d1730fa243 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: c4e44bfc-6a68-46ce-8335-aaaba5160d3e] Start _get_guest_xml network_info=[{"id": "842f3b7a-8da7-48d2-90f7-7241fbaab648", "address": "fa:16:3e:1f:64:04", "network": {"id": "b31bac4b-1951-4ca3-8682-f1f24de0a5c3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1323234642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1323234642-network", "vif_mac": "fa:16:3e:1f:64:04"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71aa69c0ea2d49e184e1e055ff3efa1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap842f3b7a-8d", "ovs_interfaceid": "842f3b7a-8da7-48d2-90f7-7241fbaab648", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T00:03:24Z,direct_url=<?>,disk_format='qcow2',id=bff0d8a1-739e-4c4d-9efa-b73ba7b76d01,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e56bbf444fd34c348475c73673611447',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T00:03:26Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'bff0d8a1-739e-4c4d-9efa-b73ba7b76d01', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75165) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 00:09:00 user nova-compute[75165]: DEBUG nova.objects.instance [None req-b3baaca2-f65e-4ba7-96d8-96d1730fa243 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Lazy-loading 'resources' on Instance uuid c4e44bfc-6a68-46ce-8335-aaaba5160d3e {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:09:00 user nova-compute[75165]: DEBUG nova.network.neutron [req-19ad63cb-00a5-4833-b2ab-256a2101a71e req-5125e588-ecd1-4823-b3af-c3d511b356eb service nova] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Updating instance_info_cache with network_info: [] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:09:00 user nova-compute[75165]: DEBUG nova.objects.base [None req-b3baaca2-f65e-4ba7-96d8-96d1730fa243 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Object Instance<c4e44bfc-6a68-46ce-8335-aaaba5160d3e> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75165) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 00:09:00 user nova-compute[75165]: DEBUG nova.objects.instance [None req-b3baaca2-f65e-4ba7-96d8-96d1730fa243 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Lazy-loading 'numa_topology' on Instance uuid c4e44bfc-6a68-46ce-8335-aaaba5160d3e {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:09:00 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-19ad63cb-00a5-4833-b2ab-256a2101a71e req-5125e588-ecd1-4823-b3af-c3d511b356eb service nova] Releasing lock "refresh_cache-8d5569ce-1f18-4f37-a340-099ee152d548" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:09:00 user nova-compute[75165]: DEBUG nova.objects.base [None req-b3baaca2-f65e-4ba7-96d8-96d1730fa243 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Object Instance<c4e44bfc-6a68-46ce-8335-aaaba5160d3e> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75165) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 00:09:00 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-b3baaca2-f65e-4ba7-96d8-96d1730fa243 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:09:00 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-b3baaca2-f65e-4ba7-96d8-96d1730fa243 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:09:00 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-b3baaca2-f65e-4ba7-96d8-96d1730fa243 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75165) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 00:09:00 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-b3baaca2-f65e-4ba7-96d8-96d1730fa243 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] CPU controller missing on host. {{(pid=75165) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 00:09:00 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-b3baaca2-f65e-4ba7-96d8-96d1730fa243 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75165) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 00:09:00 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-b3baaca2-f65e-4ba7-96d8-96d1730fa243 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] CPU controller found on host. {{(pid=75165) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 00:09:00 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-b3baaca2-f65e-4ba7-96d8-96d1730fa243 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75165) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 00:09:00 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-b3baaca2-f65e-4ba7-96d8-96d1730fa243 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T00:03:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T00:03:24Z,direct_url=<?>,disk_format='qcow2',id=bff0d8a1-739e-4c4d-9efa-b73ba7b76d01,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e56bbf444fd34c348475c73673611447',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T00:03:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 00:09:00 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-b3baaca2-f65e-4ba7-96d8-96d1730fa243 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Flavor limits 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 00:09:00 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-b3baaca2-f65e-4ba7-96d8-96d1730fa243 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Image limits 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 00:09:00 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-b3baaca2-f65e-4ba7-96d8-96d1730fa243 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Flavor pref 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 00:09:00 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-b3baaca2-f65e-4ba7-96d8-96d1730fa243 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Image pref 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 00:09:00 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-b3baaca2-f65e-4ba7-96d8-96d1730fa243 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 00:09:00 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-b3baaca2-f65e-4ba7-96d8-96d1730fa243 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 00:09:00 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-b3baaca2-f65e-4ba7-96d8-96d1730fa243 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75165) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 00:09:00 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-b3baaca2-f65e-4ba7-96d8-96d1730fa243 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Got 1 possible topologies {{(pid=75165) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 00:09:00 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-b3baaca2-f65e-4ba7-96d8-96d1730fa243 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 00:09:00 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-b3baaca2-f65e-4ba7-96d8-96d1730fa243 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 00:09:00 user nova-compute[75165]: DEBUG nova.objects.instance [None req-b3baaca2-f65e-4ba7-96d8-96d1730fa243 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Lazy-loading 'vcpu_model' on Instance uuid c4e44bfc-6a68-46ce-8335-aaaba5160d3e {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:09:00 user nova-compute[75165]: DEBUG nova.objects.base [None req-b3baaca2-f65e-4ba7-96d8-96d1730fa243 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Object Instance<c4e44bfc-6a68-46ce-8335-aaaba5160d3e> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75165) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 00:09:00 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-b3baaca2-f65e-4ba7-96d8-96d1730fa243 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:07:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1155771609',display_name='tempest-ServerRescueNegativeTestJSON-server-1155771609',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1155771609',id=4,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-26T00:07:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='71aa69c0ea2d49e184e1e055ff3efa1d',ramdisk_id='',reservation_id='r-6fsjgoly',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-2141505807',owner_user_name='tempest-ServerRescueNegativeTestJSON-2141505807-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T00:07:28Z,user_data=None,user_id='67876ca3211b47bc99af08436edeb91f',uuid=c4e44bfc-6a68-46ce-8335-aaaba5160d3e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "842f3b7a-8da7-48d2-90f7-7241fbaab648", "address": "fa:16:3e:1f:64:04", "network": {"id": "b31bac4b-1951-4ca3-8682-f1f24de0a5c3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1323234642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1323234642-network", "vif_mac": "fa:16:3e:1f:64:04"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71aa69c0ea2d49e184e1e055ff3efa1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap842f3b7a-8d", "ovs_interfaceid": "842f3b7a-8da7-48d2-90f7-7241fbaab648", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75165) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 00:09:00 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-b3baaca2-f65e-4ba7-96d8-96d1730fa243 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Converting VIF {"id": "842f3b7a-8da7-48d2-90f7-7241fbaab648", "address": "fa:16:3e:1f:64:04", "network": {"id": "b31bac4b-1951-4ca3-8682-f1f24de0a5c3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1323234642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1323234642-network", "vif_mac": "fa:16:3e:1f:64:04"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71aa69c0ea2d49e184e1e055ff3efa1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap842f3b7a-8d", "ovs_interfaceid": "842f3b7a-8da7-48d2-90f7-7241fbaab648", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:09:00 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-b3baaca2-f65e-4ba7-96d8-96d1730fa243 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1f:64:04,bridge_name='br-int',has_traffic_filtering=True,id=842f3b7a-8da7-48d2-90f7-7241fbaab648,network=Network(b31bac4b-1951-4ca3-8682-f1f24de0a5c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap842f3b7a-8d') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:09:00 user nova-compute[75165]: DEBUG nova.objects.instance [None req-b3baaca2-f65e-4ba7-96d8-96d1730fa243 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Lazy-loading 'pci_devices' on Instance uuid c4e44bfc-6a68-46ce-8335-aaaba5160d3e {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:09:00 user nova-compute[75165]: DEBUG nova.objects.base [None req-b3baaca2-f65e-4ba7-96d8-96d1730fa243 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Object Instance<c4e44bfc-6a68-46ce-8335-aaaba5160d3e> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75165) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 00:09:00 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-b3baaca2-f65e-4ba7-96d8-96d1730fa243 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: c4e44bfc-6a68-46ce-8335-aaaba5160d3e] End _get_guest_xml xml=<domain type="kvm">
Oct 26 00:09:00 user nova-compute[75165]:   <uuid>c4e44bfc-6a68-46ce-8335-aaaba5160d3e</uuid>
Oct 26 00:09:00 user nova-compute[75165]:   <name>instance-00000004</name>
Oct 26 00:09:00 user nova-compute[75165]:   <memory>524288</memory>
Oct 26 00:09:00 user nova-compute[75165]:   <vcpu>1</vcpu>
Oct 26 00:09:00 user nova-compute[75165]:   <metadata>
Oct 26 00:09:00 user nova-compute[75165]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 00:09:00 user nova-compute[75165]:       <nova:package version="0.0.0"/>
Oct 26 00:09:00 user nova-compute[75165]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1155771609</nova:name>
Oct 26 00:09:00 user nova-compute[75165]:       <nova:creationTime>2023-10-26 00:09:00</nova:creationTime>
Oct 26 00:09:00 user nova-compute[75165]:       <nova:flavor name="m1.tiny">
Oct 26 00:09:00 user nova-compute[75165]:         <nova:memory>512</nova:memory>
Oct 26 00:09:00 user nova-compute[75165]:         <nova:disk>1</nova:disk>
Oct 26 00:09:00 user nova-compute[75165]:         <nova:swap>0</nova:swap>
Oct 26 00:09:00 user nova-compute[75165]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 00:09:00 user nova-compute[75165]:         <nova:vcpus>1</nova:vcpus>
Oct 26 00:09:00 user nova-compute[75165]:       </nova:flavor>
Oct 26 00:09:00 user nova-compute[75165]:       <nova:owner>
Oct 26 00:09:00 user nova-compute[75165]:         <nova:user uuid="67876ca3211b47bc99af08436edeb91f">tempest-ServerRescueNegativeTestJSON-2141505807-project-member</nova:user>
Oct 26 00:09:00 user nova-compute[75165]:         <nova:project uuid="71aa69c0ea2d49e184e1e055ff3efa1d">tempest-ServerRescueNegativeTestJSON-2141505807</nova:project>
Oct 26 00:09:00 user nova-compute[75165]:       </nova:owner>
Oct 26 00:09:00 user nova-compute[75165]:       <nova:root type="image" uuid="bff0d8a1-739e-4c4d-9efa-b73ba7b76d01"/>
Oct 26 00:09:00 user nova-compute[75165]:       <nova:ports>
Oct 26 00:09:00 user nova-compute[75165]:         <nova:port uuid="842f3b7a-8da7-48d2-90f7-7241fbaab648">
Oct 26 00:09:00 user nova-compute[75165]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 26 00:09:00 user nova-compute[75165]:         </nova:port>
Oct 26 00:09:00 user nova-compute[75165]:       </nova:ports>
Oct 26 00:09:00 user nova-compute[75165]:     </nova:instance>
Oct 26 00:09:00 user nova-compute[75165]:   </metadata>
Oct 26 00:09:00 user nova-compute[75165]:   <sysinfo type="smbios">
Oct 26 00:09:00 user nova-compute[75165]:     <system>
Oct 26 00:09:00 user nova-compute[75165]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 00:09:00 user nova-compute[75165]:       <entry name="product">OpenStack Nova</entry>
Oct 26 00:09:00 user nova-compute[75165]:       <entry name="version">0.0.0</entry>
Oct 26 00:09:00 user nova-compute[75165]:       <entry name="serial">c4e44bfc-6a68-46ce-8335-aaaba5160d3e</entry>
Oct 26 00:09:00 user nova-compute[75165]:       <entry name="uuid">c4e44bfc-6a68-46ce-8335-aaaba5160d3e</entry>
Oct 26 00:09:00 user nova-compute[75165]:       <entry name="family">Virtual Machine</entry>
Oct 26 00:09:00 user nova-compute[75165]:     </system>
Oct 26 00:09:00 user nova-compute[75165]:   </sysinfo>
Oct 26 00:09:00 user nova-compute[75165]:   <os>
Oct 26 00:09:00 user nova-compute[75165]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 00:09:00 user nova-compute[75165]:     <smbios mode="sysinfo"/>
Oct 26 00:09:00 user nova-compute[75165]:   </os>
Oct 26 00:09:00 user nova-compute[75165]:   <features>
Oct 26 00:09:00 user nova-compute[75165]:     <acpi/>
Oct 26 00:09:00 user nova-compute[75165]:     <apic/>
Oct 26 00:09:00 user nova-compute[75165]:     <vmcoreinfo/>
Oct 26 00:09:00 user nova-compute[75165]:   </features>
Oct 26 00:09:00 user nova-compute[75165]:   <clock offset="utc">
Oct 26 00:09:00 user nova-compute[75165]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 00:09:00 user nova-compute[75165]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 00:09:00 user nova-compute[75165]:     <timer name="hpet" present="no"/>
Oct 26 00:09:00 user nova-compute[75165]:   </clock>
Oct 26 00:09:00 user nova-compute[75165]:   <cpu mode="custom" match="exact">
Oct 26 00:09:00 user nova-compute[75165]:     <model>Nehalem</model>
Oct 26 00:09:00 user nova-compute[75165]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 00:09:00 user nova-compute[75165]:   </cpu>
Oct 26 00:09:00 user nova-compute[75165]:   <devices>
Oct 26 00:09:00 user nova-compute[75165]:     <disk type="file" device="disk">
Oct 26 00:09:00 user nova-compute[75165]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 00:09:00 user nova-compute[75165]:       <source file="/opt/stack/data/nova/instances/c4e44bfc-6a68-46ce-8335-aaaba5160d3e/disk.rescue"/>
Oct 26 00:09:00 user nova-compute[75165]:       <target dev="vda" bus="virtio"/>
Oct 26 00:09:00 user nova-compute[75165]:     </disk>
Oct 26 00:09:00 user nova-compute[75165]:     <disk type="file" device="disk">
Oct 26 00:09:00 user nova-compute[75165]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 00:09:00 user nova-compute[75165]:       <source file="/opt/stack/data/nova/instances/c4e44bfc-6a68-46ce-8335-aaaba5160d3e/disk"/>
Oct 26 00:09:00 user nova-compute[75165]:       <target dev="vdb" bus="virtio"/>
Oct 26 00:09:00 user nova-compute[75165]:     </disk>
Oct 26 00:09:00 user nova-compute[75165]:     <interface type="ethernet">
Oct 26 00:09:00 user nova-compute[75165]:       <mac address="fa:16:3e:1f:64:04"/>
Oct 26 00:09:00 user nova-compute[75165]:       <model type="virtio"/>
Oct 26 00:09:00 user nova-compute[75165]:       <mtu size="1442"/>
Oct 26 00:09:00 user nova-compute[75165]:       <target dev="tap842f3b7a-8d"/>
Oct 26 00:09:00 user nova-compute[75165]:     </interface>
Oct 26 00:09:00 user nova-compute[75165]:     <serial type="pty">
Oct 26 00:09:00 user nova-compute[75165]:       <log file="/opt/stack/data/nova/instances/c4e44bfc-6a68-46ce-8335-aaaba5160d3e/console.log" append="off"/>
Oct 26 00:09:00 user nova-compute[75165]:     </serial>
Oct 26 00:09:00 user nova-compute[75165]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 00:09:00 user nova-compute[75165]:     <video>
Oct 26 00:09:00 user nova-compute[75165]:       <model type="virtio"/>
Oct 26 00:09:00 user nova-compute[75165]:     </video>
Oct 26 00:09:00 user nova-compute[75165]:     <rng model="virtio">
Oct 26 00:09:00 user nova-compute[75165]:       <backend model="random">/dev/urandom</backend>
Oct 26 00:09:00 user nova-compute[75165]:     </rng>
Oct 26 00:09:00 user nova-compute[75165]:     <controller type="usb" index="0" model="none"/>
Oct 26 00:09:00 user nova-compute[75165]:     <memballoon model="virtio">
Oct 26 00:09:00 user nova-compute[75165]:       <stats period="10"/>
Oct 26 00:09:00 user nova-compute[75165]:     </memballoon>
Oct 26 00:09:00 user nova-compute[75165]:   </devices>
Oct 26 00:09:00 user nova-compute[75165]: </domain>
Oct 26 00:09:00 user nova-compute[75165]:  {{(pid=75165) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 00:09:00 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: c4e44bfc-6a68-46ce-8335-aaaba5160d3e] Instance destroyed successfully.
Oct 26 00:09:00 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-b3baaca2-f65e-4ba7-96d8-96d1730fa243 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] No BDM found with device name vda, not building metadata. {{(pid=75165) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 00:09:00 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-b3baaca2-f65e-4ba7-96d8-96d1730fa243 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75165) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 00:09:00 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-b3baaca2-f65e-4ba7-96d8-96d1730fa243 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] No VIF found with MAC fa:16:3e:1f:64:04, not building metadata {{(pid=75165) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 00:09:00 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:09:00 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-44c17bba-1c3f-439e-a95d-1af8251eeae9 tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] Acquiring lock "018ca455-eace-412d-86a3-d914b4af30d5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:09:00 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-44c17bba-1c3f-439e-a95d-1af8251eeae9 tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] Lock "018ca455-eace-412d-86a3-d914b4af30d5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:09:00 user nova-compute[75165]: DEBUG nova.compute.manager [None req-44c17bba-1c3f-439e-a95d-1af8251eeae9 tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] [instance: 018ca455-eace-412d-86a3-d914b4af30d5] Starting instance... {{(pid=75165) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 00:09:00 user nova-compute[75165]: DEBUG nova.network.neutron [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Successfully updated port: 03ee4dbc-d46d-4127-a4e0-d308a1c8beae {{(pid=75165) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 00:09:00 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-44c17bba-1c3f-439e-a95d-1af8251eeae9 tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:09:00 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-44c17bba-1c3f-439e-a95d-1af8251eeae9 tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:09:00 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-44c17bba-1c3f-439e-a95d-1af8251eeae9 tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75165) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 00:09:00 user nova-compute[75165]: INFO nova.compute.claims [None req-44c17bba-1c3f-439e-a95d-1af8251eeae9 tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] [instance: 018ca455-eace-412d-86a3-d914b4af30d5] Claim successful on node user
Oct 26 00:09:00 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Acquiring lock "refresh_cache-8d5569ce-1f18-4f37-a340-099ee152d548" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:09:00 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Acquired lock "refresh_cache-8d5569ce-1f18-4f37-a340-099ee152d548" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:09:00 user nova-compute[75165]: DEBUG nova.network.neutron [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Building network info cache for instance {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 00:09:00 user nova-compute[75165]: DEBUG nova.network.neutron [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Instance cache missing network info. {{(pid=75165) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 00:09:00 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:09:00 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Starting heal instance info cache {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 00:09:00 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "refresh_cache-84c6b624-648b-40e2-a37e-ff08609bad84" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:09:00 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquired lock "refresh_cache-84c6b624-648b-40e2-a37e-ff08609bad84" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:09:00 user nova-compute[75165]: DEBUG nova.network.neutron [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: 84c6b624-648b-40e2-a37e-ff08609bad84] Forcefully refreshing network info cache for instance {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 00:09:01 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-44c17bba-1c3f-439e-a95d-1af8251eeae9 tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:09:01 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-44c17bba-1c3f-439e-a95d-1af8251eeae9 tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:09:01 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-44c17bba-1c3f-439e-a95d-1af8251eeae9 tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.622s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:09:01 user nova-compute[75165]: DEBUG nova.compute.manager [None req-44c17bba-1c3f-439e-a95d-1af8251eeae9 tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] [instance: 018ca455-eace-412d-86a3-d914b4af30d5] Start building networks asynchronously for instance. {{(pid=75165) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 00:09:01 user nova-compute[75165]: DEBUG nova.compute.manager [None req-44c17bba-1c3f-439e-a95d-1af8251eeae9 tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] [instance: 018ca455-eace-412d-86a3-d914b4af30d5] Allocating IP information in the background. {{(pid=75165) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 00:09:01 user nova-compute[75165]: DEBUG nova.network.neutron [None req-44c17bba-1c3f-439e-a95d-1af8251eeae9 tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] [instance: 018ca455-eace-412d-86a3-d914b4af30d5] allocate_for_instance() {{(pid=75165) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 00:09:01 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-44c17bba-1c3f-439e-a95d-1af8251eeae9 tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] [instance: 018ca455-eace-412d-86a3-d914b4af30d5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 00:09:01 user nova-compute[75165]: DEBUG nova.compute.manager [req-5bb2b590-bac8-437d-bba8-b7d5fffffcbb req-2c61c613-543f-440e-b106-abedd7ec1e61 service nova] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Received event network-changed-a04b8134-03e6-45f2-b6d7-3ea6a7deb81c {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:09:01 user nova-compute[75165]: DEBUG nova.compute.manager [req-5bb2b590-bac8-437d-bba8-b7d5fffffcbb req-2c61c613-543f-440e-b106-abedd7ec1e61 service nova] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Refreshing instance network info cache due to event network-changed-a04b8134-03e6-45f2-b6d7-3ea6a7deb81c. {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 00:09:01 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-5bb2b590-bac8-437d-bba8-b7d5fffffcbb req-2c61c613-543f-440e-b106-abedd7ec1e61 service nova] Acquiring lock "refresh_cache-8d5569ce-1f18-4f37-a340-099ee152d548" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:09:01 user nova-compute[75165]: DEBUG nova.network.neutron [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: 84c6b624-648b-40e2-a37e-ff08609bad84] Updating instance_info_cache with network_info: [{"id": "2107529c-ec0e-4d1d-85b4-8605dcabc415", "address": "fa:16:3e:0c:8a:94", "network": {"id": "b31bac4b-1951-4ca3-8682-f1f24de0a5c3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1323234642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71aa69c0ea2d49e184e1e055ff3efa1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2107529c-ec", "ovs_interfaceid": "2107529c-ec0e-4d1d-85b4-8605dcabc415", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:09:01 user nova-compute[75165]: DEBUG nova.compute.manager [req-abf24ce4-ec8f-4dd7-bf9d-10b7c9f51ba2 req-1d1c147f-d6ba-4baa-9424-7014fde6671c service nova] [instance: 471df318-7d9f-4512-add6-b6612700e15d] Received event network-vif-plugged-f974b6d7-2580-4ea2-9e66-d24406b97fb8 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:09:01 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-abf24ce4-ec8f-4dd7-bf9d-10b7c9f51ba2 req-1d1c147f-d6ba-4baa-9424-7014fde6671c service nova] Acquiring lock "471df318-7d9f-4512-add6-b6612700e15d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:09:01 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-abf24ce4-ec8f-4dd7-bf9d-10b7c9f51ba2 req-1d1c147f-d6ba-4baa-9424-7014fde6671c service nova] Lock "471df318-7d9f-4512-add6-b6612700e15d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:09:01 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-abf24ce4-ec8f-4dd7-bf9d-10b7c9f51ba2 req-1d1c147f-d6ba-4baa-9424-7014fde6671c service nova] Lock "471df318-7d9f-4512-add6-b6612700e15d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:09:01 user nova-compute[75165]: DEBUG nova.compute.manager [req-abf24ce4-ec8f-4dd7-bf9d-10b7c9f51ba2 req-1d1c147f-d6ba-4baa-9424-7014fde6671c service nova] [instance: 471df318-7d9f-4512-add6-b6612700e15d] No waiting events found dispatching network-vif-plugged-f974b6d7-2580-4ea2-9e66-d24406b97fb8 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:09:01 user nova-compute[75165]: WARNING nova.compute.manager [req-abf24ce4-ec8f-4dd7-bf9d-10b7c9f51ba2 req-1d1c147f-d6ba-4baa-9424-7014fde6671c service nova] [instance: 471df318-7d9f-4512-add6-b6612700e15d] Received unexpected event network-vif-plugged-f974b6d7-2580-4ea2-9e66-d24406b97fb8 for instance with vm_state building and task_state spawning.
Oct 26 00:09:01 user nova-compute[75165]: DEBUG nova.compute.manager [req-abf24ce4-ec8f-4dd7-bf9d-10b7c9f51ba2 req-1d1c147f-d6ba-4baa-9424-7014fde6671c service nova] [instance: 471df318-7d9f-4512-add6-b6612700e15d] Received event network-vif-plugged-f974b6d7-2580-4ea2-9e66-d24406b97fb8 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:09:01 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-abf24ce4-ec8f-4dd7-bf9d-10b7c9f51ba2 req-1d1c147f-d6ba-4baa-9424-7014fde6671c service nova] Acquiring lock "471df318-7d9f-4512-add6-b6612700e15d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:09:01 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-abf24ce4-ec8f-4dd7-bf9d-10b7c9f51ba2 req-1d1c147f-d6ba-4baa-9424-7014fde6671c service nova] Lock "471df318-7d9f-4512-add6-b6612700e15d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:09:01 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-abf24ce4-ec8f-4dd7-bf9d-10b7c9f51ba2 req-1d1c147f-d6ba-4baa-9424-7014fde6671c service nova] Lock "471df318-7d9f-4512-add6-b6612700e15d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:09:01 user nova-compute[75165]: DEBUG nova.compute.manager [req-abf24ce4-ec8f-4dd7-bf9d-10b7c9f51ba2 req-1d1c147f-d6ba-4baa-9424-7014fde6671c service nova] [instance: 471df318-7d9f-4512-add6-b6612700e15d] No waiting events found dispatching network-vif-plugged-f974b6d7-2580-4ea2-9e66-d24406b97fb8 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:09:01 user nova-compute[75165]: WARNING nova.compute.manager [req-abf24ce4-ec8f-4dd7-bf9d-10b7c9f51ba2 req-1d1c147f-d6ba-4baa-9424-7014fde6671c service nova] [instance: 471df318-7d9f-4512-add6-b6612700e15d] Received unexpected event network-vif-plugged-f974b6d7-2580-4ea2-9e66-d24406b97fb8 for instance with vm_state building and task_state spawning.
Oct 26 00:09:01 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Releasing lock "refresh_cache-84c6b624-648b-40e2-a37e-ff08609bad84" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:09:01 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: 84c6b624-648b-40e2-a37e-ff08609bad84] Updated the network info_cache for instance {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 00:09:01 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:09:01 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:09:01 user nova-compute[75165]: DEBUG nova.compute.manager [None req-44c17bba-1c3f-439e-a95d-1af8251eeae9 tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] [instance: 018ca455-eace-412d-86a3-d914b4af30d5] Start building block device mappings for instance. {{(pid=75165) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 00:09:01 user nova-compute[75165]: DEBUG nova.policy [None req-44c17bba-1c3f-439e-a95d-1af8251eeae9 tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f1b35e426f0f488b9fab44fe85bcff98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c9acab3d48a43568a5096c8d786538d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75165) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 00:09:01 user nova-compute[75165]: DEBUG nova.compute.manager [None req-44c17bba-1c3f-439e-a95d-1af8251eeae9 tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] [instance: 018ca455-eace-412d-86a3-d914b4af30d5] Start spawning the instance on the hypervisor. {{(pid=75165) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 00:09:01 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-44c17bba-1c3f-439e-a95d-1af8251eeae9 tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] [instance: 018ca455-eace-412d-86a3-d914b4af30d5] Creating instance directory {{(pid=75165) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 00:09:01 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-44c17bba-1c3f-439e-a95d-1af8251eeae9 tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] [instance: 018ca455-eace-412d-86a3-d914b4af30d5] Creating image(s)
Oct 26 00:09:01 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-44c17bba-1c3f-439e-a95d-1af8251eeae9 tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] Acquiring lock "/opt/stack/data/nova/instances/018ca455-eace-412d-86a3-d914b4af30d5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:09:01 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-44c17bba-1c3f-439e-a95d-1af8251eeae9 tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] Lock "/opt/stack/data/nova/instances/018ca455-eace-412d-86a3-d914b4af30d5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:09:01 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-44c17bba-1c3f-439e-a95d-1af8251eeae9 tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] Lock "/opt/stack/data/nova/instances/018ca455-eace-412d-86a3-d914b4af30d5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:09:01 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-44c17bba-1c3f-439e-a95d-1af8251eeae9 tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:09:01 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-44c17bba-1c3f-439e-a95d-1af8251eeae9 tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json" returned: 0 in 0.171s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:09:01 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-44c17bba-1c3f-439e-a95d-1af8251eeae9 tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] Acquiring lock "7d3243421cf3fdc288b758f687a93103b7b95466" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:09:01 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-44c17bba-1c3f-439e-a95d-1af8251eeae9 tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] Lock "7d3243421cf3fdc288b758f687a93103b7b95466" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:09:01 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-44c17bba-1c3f-439e-a95d-1af8251eeae9 tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:09:01 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:09:01 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:09:01 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:09:01 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:09:01 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:09:01 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:09:01 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:09:01 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.003s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:09:01 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:09:01 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75165) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 00:09:02 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-44c17bba-1c3f-439e-a95d-1af8251eeae9 tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json" returned: 0 in 0.197s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:09:02 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-44c17bba-1c3f-439e-a95d-1af8251eeae9 tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466,backing_fmt=raw /opt/stack/data/nova/instances/018ca455-eace-412d-86a3-d914b4af30d5/disk 1073741824 {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:09:02 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-44c17bba-1c3f-439e-a95d-1af8251eeae9 tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466,backing_fmt=raw /opt/stack/data/nova/instances/018ca455-eace-412d-86a3-d914b4af30d5/disk 1073741824" returned: 0 in 0.059s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:09:02 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-44c17bba-1c3f-439e-a95d-1af8251eeae9 tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] Lock "7d3243421cf3fdc288b758f687a93103b7b95466" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.261s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:09:02 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-44c17bba-1c3f-439e-a95d-1af8251eeae9 tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:09:02 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:09:02 user nova-compute[75165]: DEBUG nova.compute.manager [None req-80629f8b-eef8-4750-b09d-8ed35e4d1af0 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] [instance: 471df318-7d9f-4512-add6-b6612700e15d] Instance event wait completed in 0 seconds for  {{(pid=75165) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 00:09:02 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-80629f8b-eef8-4750-b09d-8ed35e4d1af0 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] [instance: 471df318-7d9f-4512-add6-b6612700e15d] Guest created on hypervisor {{(pid=75165) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 00:09:02 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: 471df318-7d9f-4512-add6-b6612700e15d] Instance spawned successfully.
Oct 26 00:09:02 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-80629f8b-eef8-4750-b09d-8ed35e4d1af0 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] [instance: 471df318-7d9f-4512-add6-b6612700e15d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 00:09:02 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-80629f8b-eef8-4750-b09d-8ed35e4d1af0 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] [instance: 471df318-7d9f-4512-add6-b6612700e15d] Found default for hw_cdrom_bus of ide {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:09:02 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-80629f8b-eef8-4750-b09d-8ed35e4d1af0 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] [instance: 471df318-7d9f-4512-add6-b6612700e15d] Found default for hw_disk_bus of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:09:02 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-80629f8b-eef8-4750-b09d-8ed35e4d1af0 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] [instance: 471df318-7d9f-4512-add6-b6612700e15d] Found default for hw_input_bus of None {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:09:02 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-80629f8b-eef8-4750-b09d-8ed35e4d1af0 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] [instance: 471df318-7d9f-4512-add6-b6612700e15d] Found default for hw_pointer_model of None {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:09:02 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-80629f8b-eef8-4750-b09d-8ed35e4d1af0 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] [instance: 471df318-7d9f-4512-add6-b6612700e15d] Found default for hw_video_model of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:09:02 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-80629f8b-eef8-4750-b09d-8ed35e4d1af0 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] [instance: 471df318-7d9f-4512-add6-b6612700e15d] Found default for hw_vif_model of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:09:02 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-44c17bba-1c3f-439e-a95d-1af8251eeae9 tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json" returned: 0 in 0.195s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:09:02 user nova-compute[75165]: DEBUG nova.virt.disk.api [None req-44c17bba-1c3f-439e-a95d-1af8251eeae9 tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] Checking if we can resize image /opt/stack/data/nova/instances/018ca455-eace-412d-86a3-d914b4af30d5/disk. size=1073741824 {{(pid=75165) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 00:09:02 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-44c17bba-1c3f-439e-a95d-1af8251eeae9 tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/018ca455-eace-412d-86a3-d914b4af30d5/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:09:02 user nova-compute[75165]: INFO nova.compute.manager [None req-80629f8b-eef8-4750-b09d-8ed35e4d1af0 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] [instance: 471df318-7d9f-4512-add6-b6612700e15d] Took 6.81 seconds to spawn the instance on the hypervisor.
Oct 26 00:09:02 user nova-compute[75165]: DEBUG nova.compute.manager [None req-80629f8b-eef8-4750-b09d-8ed35e4d1af0 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] [instance: 471df318-7d9f-4512-add6-b6612700e15d] Checking state {{(pid=75165) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 00:09:02 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-44c17bba-1c3f-439e-a95d-1af8251eeae9 tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/018ca455-eace-412d-86a3-d914b4af30d5/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:09:02 user nova-compute[75165]: DEBUG nova.virt.disk.api [None req-44c17bba-1c3f-439e-a95d-1af8251eeae9 tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] Cannot resize image /opt/stack/data/nova/instances/018ca455-eace-412d-86a3-d914b4af30d5/disk to a smaller size. {{(pid=75165) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 00:09:02 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-44c17bba-1c3f-439e-a95d-1af8251eeae9 tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] [instance: 018ca455-eace-412d-86a3-d914b4af30d5] Created local disks {{(pid=75165) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 00:09:02 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-44c17bba-1c3f-439e-a95d-1af8251eeae9 tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] [instance: 018ca455-eace-412d-86a3-d914b4af30d5] Ensure instance console log exists: /opt/stack/data/nova/instances/018ca455-eace-412d-86a3-d914b4af30d5/console.log {{(pid=75165) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 00:09:02 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-44c17bba-1c3f-439e-a95d-1af8251eeae9 tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:09:02 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-44c17bba-1c3f-439e-a95d-1af8251eeae9 tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:09:02 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-44c17bba-1c3f-439e-a95d-1af8251eeae9 tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:09:02 user nova-compute[75165]: INFO nova.compute.manager [None req-80629f8b-eef8-4750-b09d-8ed35e4d1af0 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] [instance: 471df318-7d9f-4512-add6-b6612700e15d] Took 7.88 seconds to build instance.
Oct 26 00:09:02 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-80629f8b-eef8-4750-b09d-8ed35e4d1af0 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Lock "471df318-7d9f-4512-add6-b6612700e15d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.020s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:09:02 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9633e6bb-5e95-4994-92a2-9d8f85a946ff/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:09:02 user nova-compute[75165]: DEBUG nova.network.neutron [None req-44c17bba-1c3f-439e-a95d-1af8251eeae9 tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] [instance: 018ca455-eace-412d-86a3-d914b4af30d5] Successfully created port: 7752e050-4a35-4290-afb7-87d59ee07610 {{(pid=75165) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 00:09:02 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:09:02 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9633e6bb-5e95-4994-92a2-9d8f85a946ff/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:09:02 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9633e6bb-5e95-4994-92a2-9d8f85a946ff/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:09:03 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9633e6bb-5e95-4994-92a2-9d8f85a946ff/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:09:03 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84c6b624-648b-40e2-a37e-ff08609bad84/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:09:03 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84c6b624-648b-40e2-a37e-ff08609bad84/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:09:03 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84c6b624-648b-40e2-a37e-ff08609bad84/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:09:03 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84c6b624-648b-40e2-a37e-ff08609bad84/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:09:03 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7eeb145-1565-4812-818b-fefda5f2436d/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:09:03 user nova-compute[75165]: DEBUG nova.compute.manager [req-4700acab-8021-4897-96d7-b83cbc8ac08b req-922ef268-5d05-428f-a8fd-428df13ae974 service nova] [instance: c4e44bfc-6a68-46ce-8335-aaaba5160d3e] Received event network-vif-plugged-842f3b7a-8da7-48d2-90f7-7241fbaab648 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:09:03 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-4700acab-8021-4897-96d7-b83cbc8ac08b req-922ef268-5d05-428f-a8fd-428df13ae974 service nova] Acquiring lock "c4e44bfc-6a68-46ce-8335-aaaba5160d3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:09:03 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-4700acab-8021-4897-96d7-b83cbc8ac08b req-922ef268-5d05-428f-a8fd-428df13ae974 service nova] Lock "c4e44bfc-6a68-46ce-8335-aaaba5160d3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:09:03 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-4700acab-8021-4897-96d7-b83cbc8ac08b req-922ef268-5d05-428f-a8fd-428df13ae974 service nova] Lock "c4e44bfc-6a68-46ce-8335-aaaba5160d3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:09:03 user nova-compute[75165]: DEBUG nova.compute.manager [req-4700acab-8021-4897-96d7-b83cbc8ac08b req-922ef268-5d05-428f-a8fd-428df13ae974 service nova] [instance: c4e44bfc-6a68-46ce-8335-aaaba5160d3e] No waiting events found dispatching network-vif-plugged-842f3b7a-8da7-48d2-90f7-7241fbaab648 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:09:03 user nova-compute[75165]: WARNING nova.compute.manager [req-4700acab-8021-4897-96d7-b83cbc8ac08b req-922ef268-5d05-428f-a8fd-428df13ae974 service nova] [instance: c4e44bfc-6a68-46ce-8335-aaaba5160d3e] Received unexpected event network-vif-plugged-842f3b7a-8da7-48d2-90f7-7241fbaab648 for instance with vm_state active and task_state rescuing.
Oct 26 00:09:03 user nova-compute[75165]: DEBUG nova.compute.manager [req-4700acab-8021-4897-96d7-b83cbc8ac08b req-922ef268-5d05-428f-a8fd-428df13ae974 service nova] [instance: c4e44bfc-6a68-46ce-8335-aaaba5160d3e] Received event network-vif-plugged-842f3b7a-8da7-48d2-90f7-7241fbaab648 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:09:03 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-4700acab-8021-4897-96d7-b83cbc8ac08b req-922ef268-5d05-428f-a8fd-428df13ae974 service nova] Acquiring lock "c4e44bfc-6a68-46ce-8335-aaaba5160d3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:09:03 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-4700acab-8021-4897-96d7-b83cbc8ac08b req-922ef268-5d05-428f-a8fd-428df13ae974 service nova] Lock "c4e44bfc-6a68-46ce-8335-aaaba5160d3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:09:03 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-4700acab-8021-4897-96d7-b83cbc8ac08b req-922ef268-5d05-428f-a8fd-428df13ae974 service nova] Lock "c4e44bfc-6a68-46ce-8335-aaaba5160d3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:09:03 user nova-compute[75165]: DEBUG nova.compute.manager [req-4700acab-8021-4897-96d7-b83cbc8ac08b req-922ef268-5d05-428f-a8fd-428df13ae974 service nova] [instance: c4e44bfc-6a68-46ce-8335-aaaba5160d3e] No waiting events found dispatching network-vif-plugged-842f3b7a-8da7-48d2-90f7-7241fbaab648 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:09:03 user nova-compute[75165]: WARNING nova.compute.manager [req-4700acab-8021-4897-96d7-b83cbc8ac08b req-922ef268-5d05-428f-a8fd-428df13ae974 service nova] [instance: c4e44bfc-6a68-46ce-8335-aaaba5160d3e] Received unexpected event network-vif-plugged-842f3b7a-8da7-48d2-90f7-7241fbaab648 for instance with vm_state active and task_state rescuing.
Oct 26 00:09:03 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7eeb145-1565-4812-818b-fefda5f2436d/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:09:03 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7eeb145-1565-4812-818b-fefda5f2436d/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:09:03 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-3497df38-1888-4242-925b-9ba82d1c0be9 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] Acquiring lock "18dcf77e-fac2-4b38-ad1c-1f52ce14704a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:09:03 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-3497df38-1888-4242-925b-9ba82d1c0be9 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] Lock "18dcf77e-fac2-4b38-ad1c-1f52ce14704a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:09:03 user nova-compute[75165]: DEBUG nova.objects.instance [None req-3497df38-1888-4242-925b-9ba82d1c0be9 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] Lazy-loading 'flavor' on Instance uuid 18dcf77e-fac2-4b38-ad1c-1f52ce14704a {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:09:03 user nova-compute[75165]: DEBUG nova.network.neutron [None req-44c17bba-1c3f-439e-a95d-1af8251eeae9 tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] [instance: 018ca455-eace-412d-86a3-d914b4af30d5] Successfully updated port: 7752e050-4a35-4290-afb7-87d59ee07610 {{(pid=75165) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 00:09:03 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7eeb145-1565-4812-818b-fefda5f2436d/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:09:03 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-44c17bba-1c3f-439e-a95d-1af8251eeae9 tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] Acquiring lock "refresh_cache-018ca455-eace-412d-86a3-d914b4af30d5" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:09:03 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-44c17bba-1c3f-439e-a95d-1af8251eeae9 tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] Acquired lock "refresh_cache-018ca455-eace-412d-86a3-d914b4af30d5" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:09:03 user nova-compute[75165]: DEBUG nova.network.neutron [None req-44c17bba-1c3f-439e-a95d-1af8251eeae9 tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] [instance: 018ca455-eace-412d-86a3-d914b4af30d5] Building network info cache for instance {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 00:09:03 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45625147-ff69-496a-a41e-e55f818a020a/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:09:03 user nova-compute[75165]: DEBUG nova.compute.manager [req-86e60f43-6b2f-4318-ba22-7ec2f56ed5aa req-f881b248-1f51-42d6-9702-c0c574726267 service nova] [instance: 018ca455-eace-412d-86a3-d914b4af30d5] Received event network-changed-7752e050-4a35-4290-afb7-87d59ee07610 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:09:03 user nova-compute[75165]: DEBUG nova.compute.manager [req-86e60f43-6b2f-4318-ba22-7ec2f56ed5aa req-f881b248-1f51-42d6-9702-c0c574726267 service nova] [instance: 018ca455-eace-412d-86a3-d914b4af30d5] Refreshing instance network info cache due to event network-changed-7752e050-4a35-4290-afb7-87d59ee07610. {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 00:09:03 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-86e60f43-6b2f-4318-ba22-7ec2f56ed5aa req-f881b248-1f51-42d6-9702-c0c574726267 service nova] Acquiring lock "refresh_cache-018ca455-eace-412d-86a3-d914b4af30d5" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:09:03 user nova-compute[75165]: DEBUG nova.compute.manager [req-7f389374-3e15-43b6-8e38-cfc6288f9f0b req-ef734a35-bd08-4d59-9c07-ae73785ba3e8 service nova] [instance: a7eeb145-1565-4812-818b-fefda5f2436d] Received event network-changed-7a43d085-a683-4c49-a7c8-13b8f35c943d {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:09:03 user nova-compute[75165]: DEBUG nova.compute.manager [req-7f389374-3e15-43b6-8e38-cfc6288f9f0b req-ef734a35-bd08-4d59-9c07-ae73785ba3e8 service nova] [instance: a7eeb145-1565-4812-818b-fefda5f2436d] Refreshing instance network info cache due to event network-changed-7a43d085-a683-4c49-a7c8-13b8f35c943d. {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 00:09:03 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-7f389374-3e15-43b6-8e38-cfc6288f9f0b req-ef734a35-bd08-4d59-9c07-ae73785ba3e8 service nova] Acquiring lock "refresh_cache-a7eeb145-1565-4812-818b-fefda5f2436d" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:09:03 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-7f389374-3e15-43b6-8e38-cfc6288f9f0b req-ef734a35-bd08-4d59-9c07-ae73785ba3e8 service nova] Acquired lock "refresh_cache-a7eeb145-1565-4812-818b-fefda5f2436d" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:09:03 user nova-compute[75165]: DEBUG nova.network.neutron [req-7f389374-3e15-43b6-8e38-cfc6288f9f0b req-ef734a35-bd08-4d59-9c07-ae73785ba3e8 service nova] [instance: a7eeb145-1565-4812-818b-fefda5f2436d] Refreshing network info cache for port 7a43d085-a683-4c49-a7c8-13b8f35c943d {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 00:09:03 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-3497df38-1888-4242-925b-9ba82d1c0be9 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] Lock "18dcf77e-fac2-4b38-ad1c-1f52ce14704a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.166s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:09:04 user nova-compute[75165]: DEBUG nova.network.neutron [None req-44c17bba-1c3f-439e-a95d-1af8251eeae9 tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] [instance: 018ca455-eace-412d-86a3-d914b4af30d5] Instance cache missing network info. {{(pid=75165) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 00:09:04 user nova-compute[75165]: DEBUG nova.network.neutron [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Updating instance_info_cache with network_info: [{"id": "3da752ae-77a3-4bc3-8885-76331bc2d7d8", "address": "fa:16:3e:22:af:b4", "network": {"id": "a4a95519-4969-4c53-b078-46dab1ae12ac", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1704712535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f1d0ea8cbf74f10b81a10d3a7a6e716", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3da752ae-77", "ovs_interfaceid": "3da752ae-77a3-4bc3-8885-76331bc2d7d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b9583014-bb07-4337-97bb-30001c05475f", "address": "fa:16:3e:ca:f8:4e", "network": {"id": "b1b273e9-ac47-4985-9a15-ed6392eea58c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1944708022", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9f1d0ea8cbf74f10b81a10d3a7a6e716", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9583014-bb", "ovs_interfaceid": "b9583014-bb07-4337-97bb-30001c05475f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c51f288f-44b9-476b-9419-22ef8ae5c900", "address": "fa:16:3e:28:cd:e8", "network": {"id": "b1b273e9-ac47-4985-9a15-ed6392eea58c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1944708022", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.239", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9f1d0ea8cbf74f10b81a10d3a7a6e716", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc51f288f-44", "ovs_interfaceid": "c51f288f-44b9-476b-9419-22ef8ae5c900", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c019e949-c6fc-4014-9e42-13ce1eb17786", "address": "fa:16:3e:34:fd:75", "network": {"id": "b1b273e9-ac47-4985-9a15-ed6392eea58c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1944708022", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.220", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9f1d0ea8cbf74f10b81a10d3a7a6e716", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc019e949-c6", "ovs_interfaceid": "c019e949-c6fc-4014-9e42-13ce1eb17786", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9cecd3d6-4945-4a4b-8d06-48b0d7768a17", "address": "fa:16:3e:59:c6:53", "network": {"id": "b1b273e9-ac47-4985-9a15-ed6392eea58c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1944708022", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9f1d0ea8cbf74f10b81a10d3a7a6e716", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cecd3d6-49", "ovs_interfaceid": "9cecd3d6-4945-4a4b-8d06-48b0d7768a17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a04b8134-03e6-45f2-b6d7-3ea6a7deb81c", "address": "fa:16:3e:0a:29:45", "network": {"id": "75761f5b-dd19-4843-8db7-9cef3872583d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1377439333", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9f1d0ea8cbf74f10b81a10d3a7a6e716", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa04b8134-03", "ovs_interfaceid": "a04b8134-03e6-45f2-b6d7-3ea6a7deb81c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "03ee4dbc-d46d-4127-a4e0-d308a1c8beae", "address": "fa:16:3e:5b:46:e6", "network": {"id": "75761f5b-dd19-4843-8db7-9cef3872583d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1377439333", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9f1d0ea8cbf74f10b81a10d3a7a6e716", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03ee4dbc-d4", "ovs_interfaceid": "03ee4dbc-d46d-4127-a4e0-d308a1c8beae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:09:04 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Releasing lock "refresh_cache-8d5569ce-1f18-4f37-a340-099ee152d548" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:09:04 user nova-compute[75165]: DEBUG nova.compute.manager [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Instance network_info: |[{"id": "3da752ae-77a3-4bc3-8885-76331bc2d7d8", "address": "fa:16:3e:22:af:b4", "network": {"id": "a4a95519-4969-4c53-b078-46dab1ae12ac", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1704712535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f1d0ea8cbf74f10b81a10d3a7a6e716", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3da752ae-77", "ovs_interfaceid": "3da752ae-77a3-4bc3-8885-76331bc2d7d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b9583014-bb07-4337-97bb-30001c05475f", "address": "fa:16:3e:ca:f8:4e", "network": {"id": "b1b273e9-ac47-4985-9a15-ed6392eea58c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1944708022", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9f1d0ea8cbf74f10b81a10d3a7a6e716", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9583014-bb", "ovs_interfaceid": "b9583014-bb07-4337-97bb-30001c05475f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c51f288f-44b9-476b-9419-22ef8ae5c900", "address": "fa:16:3e:28:cd:e8", "network": {"id": "b1b273e9-ac47-4985-9a15-ed6392eea58c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1944708022", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.239", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9f1d0ea8cbf74f10b81a10d3a7a6e716", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc51f288f-44", "ovs_interfaceid": "c51f288f-44b9-476b-9419-22ef8ae5c900", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c019e949-c6fc-4014-9e42-13ce1eb17786", "address": "fa:16:3e:34:fd:75", "network": {"id": "b1b273e9-ac47-4985-9a15-ed6392eea58c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1944708022", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.220", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9f1d0ea8cbf74f10b81a10d3a7a6e716", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc019e949-c6", "ovs_interfaceid": "c019e949-c6fc-4014-9e42-13ce1eb17786", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9cecd3d6-4945-4a4b-8d06-48b0d7768a17", "address": "fa:16:3e:59:c6:53", "network": {"id": "b1b273e9-ac47-4985-9a15-ed6392eea58c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1944708022", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9f1d0ea8cbf74f10b81a10d3a7a6e716", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cecd3d6-49", "ovs_interfaceid": "9cecd3d6-4945-4a4b-8d06-48b0d7768a17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a04b8134-03e6-45f2-b6d7-3ea6a7deb81c", "address": "fa:16:3e:0a:29:45", "network": {"id": "75761f5b-dd19-4843-8db7-9cef3872583d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1377439333", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9f1d0ea8cbf74f10b81a10d3a7a6e716", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa04b8134-03", "ovs_interfaceid": "a04b8134-03e6-45f2-b6d7-3ea6a7deb81c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "03ee4dbc-d46d-4127-a4e0-d308a1c8beae", "address": "fa:16:3e:5b:46:e6", "network": {"id": "75761f5b-dd19-4843-8db7-9cef3872583d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1377439333", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9f1d0ea8cbf74f10b81a10d3a7a6e716", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03ee4dbc-d4", "ovs_interfaceid": "03ee4dbc-d46d-4127-a4e0-d308a1c8beae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75165) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 00:09:04 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-5bb2b590-bac8-437d-bba8-b7d5fffffcbb req-2c61c613-543f-440e-b106-abedd7ec1e61 service nova] Acquired lock "refresh_cache-8d5569ce-1f18-4f37-a340-099ee152d548" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:09:04 user nova-compute[75165]: DEBUG nova.network.neutron [req-5bb2b590-bac8-437d-bba8-b7d5fffffcbb req-2c61c613-543f-440e-b106-abedd7ec1e61 service nova] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Refreshing network info cache for port a04b8134-03e6-45f2-b6d7-3ea6a7deb81c {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 00:09:04 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45625147-ff69-496a-a41e-e55f818a020a/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:09:04 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45625147-ff69-496a-a41e-e55f818a020a/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:09:04 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-3497df38-1888-4242-925b-9ba82d1c0be9 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] Acquiring lock "18dcf77e-fac2-4b38-ad1c-1f52ce14704a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:09:04 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-3497df38-1888-4242-925b-9ba82d1c0be9 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] Lock "18dcf77e-fac2-4b38-ad1c-1f52ce14704a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:09:04 user nova-compute[75165]: INFO nova.compute.manager [None req-3497df38-1888-4242-925b-9ba82d1c0be9 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] [instance: 18dcf77e-fac2-4b38-ad1c-1f52ce14704a] Attaching volume ae81775c-f527-4e0d-b5f8-f8369c037b62 to /dev/vdb
Oct 26 00:09:04 user nova-compute[75165]: DEBUG os_brick.utils [None req-3497df38-1888-4242-925b-9ba82d1c0be9 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:09:04 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:09:04 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:09:04 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fcfed77-b522-4ed6-9377-33bac98ba135]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa94814ccb35\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:09:04 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:09:04 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:09:04 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbe7f226-5e11-45c8-8563-b8f238533f2a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:09:04 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:09:04 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:09:04 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ba97a39-a9d3-4ee4-ab53-d18ac0e1e164]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:09:04 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[50ab087b-4ef2-4cee-adbb-2b1c2b6e3170]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:09:04 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45625147-ff69-496a-a41e-e55f818a020a/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:09:04 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-3497df38-1888-4242-925b-9ba82d1c0be9 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] Running cmd (subprocess): nvme version {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:09:04 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-3497df38-1888-4242-925b-9ba82d1c0be9 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] 'nvme version' failed. Not Retrying. {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 00:09:04 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3497df38-1888-4242-925b-9ba82d1c0be9 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] nvme not present on system {{(pid=75165) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 00:09:04 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:09:04 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 00:09:04 user nova-compute[75165]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 00:09:04 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[50def47d-a796-47ab-b437-4f5273989633]: (4, '') {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:09:04 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-3497df38-1888-4242-925b-9ba82d1c0be9 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75165) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 00:09:04 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-3497df38-1888-4242-925b-9ba82d1c0be9 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75165) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 00:09:04 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-3497df38-1888-4242-925b-9ba82d1c0be9 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] LIGHTOS: no hostnqn found. {{(pid=75165) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 00:09:04 user nova-compute[75165]: DEBUG os_brick.utils [None req-3497df38-1888-4242-925b-9ba82d1c0be9 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa94814ccb35', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:09:04 user nova-compute[75165]: DEBUG nova.virt.block_device [None req-3497df38-1888-4242-925b-9ba82d1c0be9 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] [instance: 18dcf77e-fac2-4b38-ad1c-1f52ce14704a] Updating existing volume attachment record: 91bd0b4b-f8d0-48e9-875e-7e84b644fb66 {{(pid=75165) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 00:09:04 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18dcf77e-fac2-4b38-ad1c-1f52ce14704a/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:09:04 user nova-compute[75165]: DEBUG nova.compute.manager [None req-b3baaca2-f65e-4ba7-96d8-96d1730fa243 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: c4e44bfc-6a68-46ce-8335-aaaba5160d3e] Checking state {{(pid=75165) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 00:09:04 user nova-compute[75165]: DEBUG nova.network.neutron [None req-44c17bba-1c3f-439e-a95d-1af8251eeae9 tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] [instance: 018ca455-eace-412d-86a3-d914b4af30d5] Updating instance_info_cache with network_info: [{"id": "7752e050-4a35-4290-afb7-87d59ee07610", "address": "fa:16:3e:61:5c:ef", "network": {"id": "e571d376-bebd-49ff-b7ee-64a148f25b55", "bridge": "br-int", "label": "tempest-VolumesActionsTest-502796136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c9acab3d48a43568a5096c8d786538d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7752e050-4a", "ovs_interfaceid": "7752e050-4a35-4290-afb7-87d59ee07610", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:09:04 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-44c17bba-1c3f-439e-a95d-1af8251eeae9 tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] Releasing lock "refresh_cache-018ca455-eace-412d-86a3-d914b4af30d5" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:09:04 user nova-compute[75165]: DEBUG nova.compute.manager [None req-44c17bba-1c3f-439e-a95d-1af8251eeae9 tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] [instance: 018ca455-eace-412d-86a3-d914b4af30d5] Instance network_info: |[{"id": "7752e050-4a35-4290-afb7-87d59ee07610", "address": "fa:16:3e:61:5c:ef", "network": {"id": "e571d376-bebd-49ff-b7ee-64a148f25b55", "bridge": "br-int", "label": "tempest-VolumesActionsTest-502796136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c9acab3d48a43568a5096c8d786538d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7752e050-4a", "ovs_interfaceid": "7752e050-4a35-4290-afb7-87d59ee07610", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75165) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 00:09:04 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-86e60f43-6b2f-4318-ba22-7ec2f56ed5aa req-f881b248-1f51-42d6-9702-c0c574726267 service nova] Acquired lock "refresh_cache-018ca455-eace-412d-86a3-d914b4af30d5" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:09:04 user nova-compute[75165]: DEBUG nova.network.neutron [req-86e60f43-6b2f-4318-ba22-7ec2f56ed5aa req-f881b248-1f51-42d6-9702-c0c574726267 service nova] [instance: 018ca455-eace-412d-86a3-d914b4af30d5] Refreshing network info cache for port 7752e050-4a35-4290-afb7-87d59ee07610 {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 00:09:04 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-44c17bba-1c3f-439e-a95d-1af8251eeae9 tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] [instance: 018ca455-eace-412d-86a3-d914b4af30d5] Start _get_guest_xml network_info=[{"id": "7752e050-4a35-4290-afb7-87d59ee07610", "address": "fa:16:3e:61:5c:ef", "network": {"id": "e571d376-bebd-49ff-b7ee-64a148f25b55", "bridge": "br-int", "label": "tempest-VolumesActionsTest-502796136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c9acab3d48a43568a5096c8d786538d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7752e050-4a", "ovs_interfaceid": "7752e050-4a35-4290-afb7-87d59ee07610", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T00:03:24Z,direct_url=<?>,disk_format='qcow2',id=bff0d8a1-739e-4c4d-9efa-b73ba7b76d01,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e56bbf444fd34c348475c73673611447',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T00:03:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'size': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': 'bff0d8a1-739e-4c4d-9efa-b73ba7b76d01'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75165) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 00:09:04 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-44c17bba-1c3f-439e-a95d-1af8251eeae9 tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:09:04 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-44c17bba-1c3f-439e-a95d-1af8251eeae9 tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:09:04 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-44c17bba-1c3f-439e-a95d-1af8251eeae9 tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75165) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 00:09:04 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-44c17bba-1c3f-439e-a95d-1af8251eeae9 tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] CPU controller missing on host. {{(pid=75165) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 00:09:04 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-44c17bba-1c3f-439e-a95d-1af8251eeae9 tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75165) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 00:09:04 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-44c17bba-1c3f-439e-a95d-1af8251eeae9 tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] CPU controller found on host. {{(pid=75165) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 00:09:04 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-44c17bba-1c3f-439e-a95d-1af8251eeae9 tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75165) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 00:09:04 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-44c17bba-1c3f-439e-a95d-1af8251eeae9 tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T00:03:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T00:03:24Z,direct_url=<?>,disk_format='qcow2',id=bff0d8a1-739e-4c4d-9efa-b73ba7b76d01,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e56bbf444fd34c348475c73673611447',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T00:03:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 00:09:04 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-44c17bba-1c3f-439e-a95d-1af8251eeae9 tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] Flavor limits 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 00:09:04 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-44c17bba-1c3f-439e-a95d-1af8251eeae9 tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] Image limits 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 00:09:04 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-44c17bba-1c3f-439e-a95d-1af8251eeae9 tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] Flavor pref 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 00:09:04 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-44c17bba-1c3f-439e-a95d-1af8251eeae9 tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] Image pref 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 00:09:04 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-44c17bba-1c3f-439e-a95d-1af8251eeae9 tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 00:09:04 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-44c17bba-1c3f-439e-a95d-1af8251eeae9 tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 00:09:04 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-44c17bba-1c3f-439e-a95d-1af8251eeae9 tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75165) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 00:09:04 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-44c17bba-1c3f-439e-a95d-1af8251eeae9 tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] Got 1 possible topologies {{(pid=75165) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 00:09:04 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-44c17bba-1c3f-439e-a95d-1af8251eeae9 tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 00:09:04 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-44c17bba-1c3f-439e-a95d-1af8251eeae9 tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 00:09:04 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-44c17bba-1c3f-439e-a95d-1af8251eeae9 tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:08:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-803005234',display_name='tempest-VolumesActionsTest-instance-803005234',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-803005234',id=14,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7c9acab3d48a43568a5096c8d786538d',ramdisk_id='',reservation_id='r-32civ7b8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-229861779',owner_user_name='tempest-VolumesActionsTest-229861779-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T00:09:02Z,user_data=None,user_id='f1b35e426f0f488b9fab44fe85bcff98',uuid=018ca455-eace-412d-86a3-d914b4af30d5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7752e050-4a35-4290-afb7-87d59ee07610", "address": "fa:16:3e:61:5c:ef", "network": {"id": "e571d376-bebd-49ff-b7ee-64a148f25b55", "bridge": "br-int", "label": "tempest-VolumesActionsTest-502796136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c9acab3d48a43568a5096c8d786538d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7752e050-4a", "ovs_interfaceid": "7752e050-4a35-4290-afb7-87d59ee07610", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75165) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 00:09:04 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-44c17bba-1c3f-439e-a95d-1af8251eeae9 tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] Converting VIF {"id": "7752e050-4a35-4290-afb7-87d59ee07610", "address": "fa:16:3e:61:5c:ef", "network": {"id": "e571d376-bebd-49ff-b7ee-64a148f25b55", "bridge": "br-int", "label": "tempest-VolumesActionsTest-502796136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c9acab3d48a43568a5096c8d786538d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7752e050-4a", "ovs_interfaceid": "7752e050-4a35-4290-afb7-87d59ee07610", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:09:04 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-44c17bba-1c3f-439e-a95d-1af8251eeae9 tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:5c:ef,bridge_name='br-int',has_traffic_filtering=True,id=7752e050-4a35-4290-afb7-87d59ee07610,network=Network(e571d376-bebd-49ff-b7ee-64a148f25b55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7752e050-4a') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:09:04 user nova-compute[75165]: DEBUG nova.objects.instance [None req-44c17bba-1c3f-439e-a95d-1af8251eeae9 tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] Lazy-loading 'pci_devices' on Instance uuid 018ca455-eace-412d-86a3-d914b4af30d5 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:09:04 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18dcf77e-fac2-4b38-ad1c-1f52ce14704a/disk --force-share --output=json" returned: 0 in 0.279s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:09:04 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-44c17bba-1c3f-439e-a95d-1af8251eeae9 tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] [instance: 018ca455-eace-412d-86a3-d914b4af30d5] End _get_guest_xml xml=<domain type="kvm">
Oct 26 00:09:04 user nova-compute[75165]:   <uuid>018ca455-eace-412d-86a3-d914b4af30d5</uuid>
Oct 26 00:09:04 user nova-compute[75165]:   <name>instance-0000000e</name>
Oct 26 00:09:04 user nova-compute[75165]:   <memory>524288</memory>
Oct 26 00:09:04 user nova-compute[75165]:   <vcpu>1</vcpu>
Oct 26 00:09:04 user nova-compute[75165]:   <metadata>
Oct 26 00:09:04 user nova-compute[75165]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 00:09:04 user nova-compute[75165]:       <nova:package version="0.0.0"/>
Oct 26 00:09:04 user nova-compute[75165]:       <nova:name>tempest-VolumesActionsTest-instance-803005234</nova:name>
Oct 26 00:09:04 user nova-compute[75165]:       <nova:creationTime>2023-10-26 00:09:04</nova:creationTime>
Oct 26 00:09:04 user nova-compute[75165]:       <nova:flavor name="m1.tiny">
Oct 26 00:09:04 user nova-compute[75165]:         <nova:memory>512</nova:memory>
Oct 26 00:09:04 user nova-compute[75165]:         <nova:disk>1</nova:disk>
Oct 26 00:09:04 user nova-compute[75165]:         <nova:swap>0</nova:swap>
Oct 26 00:09:04 user nova-compute[75165]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 00:09:04 user nova-compute[75165]:         <nova:vcpus>1</nova:vcpus>
Oct 26 00:09:04 user nova-compute[75165]:       </nova:flavor>
Oct 26 00:09:04 user nova-compute[75165]:       <nova:owner>
Oct 26 00:09:04 user nova-compute[75165]:         <nova:user uuid="f1b35e426f0f488b9fab44fe85bcff98">tempest-VolumesActionsTest-229861779-project-member</nova:user>
Oct 26 00:09:04 user nova-compute[75165]:         <nova:project uuid="7c9acab3d48a43568a5096c8d786538d">tempest-VolumesActionsTest-229861779</nova:project>
Oct 26 00:09:04 user nova-compute[75165]:       </nova:owner>
Oct 26 00:09:04 user nova-compute[75165]:       <nova:root type="image" uuid="bff0d8a1-739e-4c4d-9efa-b73ba7b76d01"/>
Oct 26 00:09:04 user nova-compute[75165]:       <nova:ports>
Oct 26 00:09:04 user nova-compute[75165]:         <nova:port uuid="7752e050-4a35-4290-afb7-87d59ee07610">
Oct 26 00:09:04 user nova-compute[75165]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 26 00:09:04 user nova-compute[75165]:         </nova:port>
Oct 26 00:09:04 user nova-compute[75165]:       </nova:ports>
Oct 26 00:09:04 user nova-compute[75165]:     </nova:instance>
Oct 26 00:09:04 user nova-compute[75165]:   </metadata>
Oct 26 00:09:04 user nova-compute[75165]:   <sysinfo type="smbios">
Oct 26 00:09:04 user nova-compute[75165]:     <system>
Oct 26 00:09:04 user nova-compute[75165]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 00:09:04 user nova-compute[75165]:       <entry name="product">OpenStack Nova</entry>
Oct 26 00:09:04 user nova-compute[75165]:       <entry name="version">0.0.0</entry>
Oct 26 00:09:04 user nova-compute[75165]:       <entry name="serial">018ca455-eace-412d-86a3-d914b4af30d5</entry>
Oct 26 00:09:04 user nova-compute[75165]:       <entry name="uuid">018ca455-eace-412d-86a3-d914b4af30d5</entry>
Oct 26 00:09:04 user nova-compute[75165]:       <entry name="family">Virtual Machine</entry>
Oct 26 00:09:04 user nova-compute[75165]:     </system>
Oct 26 00:09:04 user nova-compute[75165]:   </sysinfo>
Oct 26 00:09:04 user nova-compute[75165]:   <os>
Oct 26 00:09:04 user nova-compute[75165]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 00:09:04 user nova-compute[75165]:     <boot dev="hd"/>
Oct 26 00:09:04 user nova-compute[75165]:     <smbios mode="sysinfo"/>
Oct 26 00:09:04 user nova-compute[75165]:   </os>
Oct 26 00:09:04 user nova-compute[75165]:   <features>
Oct 26 00:09:04 user nova-compute[75165]:     <acpi/>
Oct 26 00:09:04 user nova-compute[75165]:     <apic/>
Oct 26 00:09:04 user nova-compute[75165]:     <vmcoreinfo/>
Oct 26 00:09:04 user nova-compute[75165]:   </features>
Oct 26 00:09:04 user nova-compute[75165]:   <clock offset="utc">
Oct 26 00:09:04 user nova-compute[75165]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 00:09:04 user nova-compute[75165]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 00:09:04 user nova-compute[75165]:     <timer name="hpet" present="no"/>
Oct 26 00:09:04 user nova-compute[75165]:   </clock>
Oct 26 00:09:04 user nova-compute[75165]:   <cpu mode="custom" match="exact">
Oct 26 00:09:04 user nova-compute[75165]:     <model>Nehalem</model>
Oct 26 00:09:04 user nova-compute[75165]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 00:09:04 user nova-compute[75165]:   </cpu>
Oct 26 00:09:04 user nova-compute[75165]:   <devices>
Oct 26 00:09:04 user nova-compute[75165]:     <disk type="file" device="disk">
Oct 26 00:09:04 user nova-compute[75165]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 00:09:04 user nova-compute[75165]:       <source file="/opt/stack/data/nova/instances/018ca455-eace-412d-86a3-d914b4af30d5/disk"/>
Oct 26 00:09:04 user nova-compute[75165]:       <target dev="vda" bus="virtio"/>
Oct 26 00:09:04 user nova-compute[75165]:     </disk>
Oct 26 00:09:04 user nova-compute[75165]:     <interface type="ethernet">
Oct 26 00:09:04 user nova-compute[75165]:       <mac address="fa:16:3e:61:5c:ef"/>
Oct 26 00:09:04 user nova-compute[75165]:       <model type="virtio"/>
Oct 26 00:09:04 user nova-compute[75165]:       <mtu size="1442"/>
Oct 26 00:09:04 user nova-compute[75165]:       <target dev="tap7752e050-4a"/>
Oct 26 00:09:04 user nova-compute[75165]:     </interface>
Oct 26 00:09:04 user nova-compute[75165]:     <serial type="pty">
Oct 26 00:09:04 user nova-compute[75165]:       <log file="/opt/stack/data/nova/instances/018ca455-eace-412d-86a3-d914b4af30d5/console.log" append="off"/>
Oct 26 00:09:04 user nova-compute[75165]:     </serial>
Oct 26 00:09:04 user nova-compute[75165]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 00:09:04 user nova-compute[75165]:     <video>
Oct 26 00:09:04 user nova-compute[75165]:       <model type="virtio"/>
Oct 26 00:09:04 user nova-compute[75165]:     </video>
Oct 26 00:09:04 user nova-compute[75165]:     <rng model="virtio">
Oct 26 00:09:04 user nova-compute[75165]:       <backend model="random">/dev/urandom</backend>
Oct 26 00:09:04 user nova-compute[75165]:     </rng>
Oct 26 00:09:04 user nova-compute[75165]:     <controller type="usb" index="0" model="none"/>
Oct 26 00:09:04 user nova-compute[75165]:     <memballoon model="virtio">
Oct 26 00:09:04 user nova-compute[75165]:       <stats period="10"/>
Oct 26 00:09:04 user nova-compute[75165]:     </memballoon>
Oct 26 00:09:04 user nova-compute[75165]:   </devices>
Oct 26 00:09:04 user nova-compute[75165]: </domain>
Oct 26 00:09:04 user nova-compute[75165]:  {{(pid=75165) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 00:09:04 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-44c17bba-1c3f-439e-a95d-1af8251eeae9 tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:08:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-803005234',display_name='tempest-VolumesActionsTest-instance-803005234',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-803005234',id=14,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7c9acab3d48a43568a5096c8d786538d',ramdisk_id='',reservation_id='r-32civ7b8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-229861779',owner_user_name='tempest-VolumesActionsTest-229861779-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T00:09:02Z,user_data=None,user_id='f1b35e426f0f488b9fab44fe85bcff98',uuid=018ca455-eace-412d-86a3-d914b4af30d5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7752e050-4a35-4290-afb7-87d59ee07610", "address": "fa:16:3e:61:5c:ef", "network": {"id": "e571d376-bebd-49ff-b7ee-64a148f25b55", "bridge": "br-int", "label": "tempest-VolumesActionsTest-502796136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c9acab3d48a43568a5096c8d786538d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7752e050-4a", "ovs_interfaceid": "7752e050-4a35-4290-afb7-87d59ee07610", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 00:09:04 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-44c17bba-1c3f-439e-a95d-1af8251eeae9 tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] Converting VIF {"id": "7752e050-4a35-4290-afb7-87d59ee07610", "address": "fa:16:3e:61:5c:ef", "network": {"id": "e571d376-bebd-49ff-b7ee-64a148f25b55", "bridge": "br-int", "label": "tempest-VolumesActionsTest-502796136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c9acab3d48a43568a5096c8d786538d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7752e050-4a", "ovs_interfaceid": "7752e050-4a35-4290-afb7-87d59ee07610", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:09:04 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-44c17bba-1c3f-439e-a95d-1af8251eeae9 tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:5c:ef,bridge_name='br-int',has_traffic_filtering=True,id=7752e050-4a35-4290-afb7-87d59ee07610,network=Network(e571d376-bebd-49ff-b7ee-64a148f25b55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7752e050-4a') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:09:04 user nova-compute[75165]: DEBUG os_vif [None req-44c17bba-1c3f-439e-a95d-1af8251eeae9 tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:5c:ef,bridge_name='br-int',has_traffic_filtering=True,id=7752e050-4a35-4290-afb7-87d59ee07610,network=Network(e571d376-bebd-49ff-b7ee-64a148f25b55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7752e050-4a') {{(pid=75165) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 00:09:04 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18dcf77e-fac2-4b38-ad1c-1f52ce14704a/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:09:04 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:09:04 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:09:04 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 00:09:04 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:09:04 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '24403bc5-70cd-5e78-a480-2a1e98f0ae87', '_type': 'linux-noop'}}, row=False) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:09:04 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:09:04 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:09:04 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:09:04 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7752e050-4a, may_exist=True, interface_attrs={}) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:09:04 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7752e050-4a, col_values=(('qos', UUID('df188972-5f7e-498b-985c-6bd98d7e3ef4')),), if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:09:04 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7752e050-4a, col_values=(('external_ids', {'iface-id': '7752e050-4a35-4290-afb7-87d59ee07610', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:61:5c:ef', 'vm-uuid': '018ca455-eace-412d-86a3-d914b4af30d5'}),), if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:09:04 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:09:04 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:09:04 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:09:04 user nova-compute[75165]: INFO os_vif [None req-44c17bba-1c3f-439e-a95d-1af8251eeae9 tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:5c:ef,bridge_name='br-int',has_traffic_filtering=True,id=7752e050-4a35-4290-afb7-87d59ee07610,network=Network(e571d376-bebd-49ff-b7ee-64a148f25b55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7752e050-4a')
Oct 26 00:09:04 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-44c17bba-1c3f-439e-a95d-1af8251eeae9 tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] No BDM found with device name vda, not building metadata. {{(pid=75165) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 00:09:04 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-44c17bba-1c3f-439e-a95d-1af8251eeae9 tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] No VIF found with MAC fa:16:3e:61:5c:ef, not building metadata {{(pid=75165) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 00:09:04 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18dcf77e-fac2-4b38-ad1c-1f52ce14704a/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:09:04 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f9add59-cabe-4965-8fe3-524618550581/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:09:05 user nova-compute[75165]: DEBUG nova.network.neutron [req-5bb2b590-bac8-437d-bba8-b7d5fffffcbb req-2c61c613-543f-440e-b106-abedd7ec1e61 service nova] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Updated VIF entry in instance network info cache for port a04b8134-03e6-45f2-b6d7-3ea6a7deb81c. {{(pid=75165) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 00:09:05 user nova-compute[75165]: DEBUG nova.network.neutron [req-5bb2b590-bac8-437d-bba8-b7d5fffffcbb req-2c61c613-543f-440e-b106-abedd7ec1e61 service nova] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Updating instance_info_cache with network_info: [{"id": "3da752ae-77a3-4bc3-8885-76331bc2d7d8", "address": "fa:16:3e:22:af:b4", "network": {"id": "a4a95519-4969-4c53-b078-46dab1ae12ac", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1704712535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f1d0ea8cbf74f10b81a10d3a7a6e716", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3da752ae-77", "ovs_interfaceid": "3da752ae-77a3-4bc3-8885-76331bc2d7d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b9583014-bb07-4337-97bb-30001c05475f", "address": "fa:16:3e:ca:f8:4e", "network": {"id": "b1b273e9-ac47-4985-9a15-ed6392eea58c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1944708022", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9f1d0ea8cbf74f10b81a10d3a7a6e716", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9583014-bb", "ovs_interfaceid": "b9583014-bb07-4337-97bb-30001c05475f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c51f288f-44b9-476b-9419-22ef8ae5c900", "address": "fa:16:3e:28:cd:e8", "network": {"id": "b1b273e9-ac47-4985-9a15-ed6392eea58c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1944708022", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.239", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9f1d0ea8cbf74f10b81a10d3a7a6e716", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc51f288f-44", "ovs_interfaceid": "c51f288f-44b9-476b-9419-22ef8ae5c900", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c019e949-c6fc-4014-9e42-13ce1eb17786", "address": "fa:16:3e:34:fd:75", "network": {"id": "b1b273e9-ac47-4985-9a15-ed6392eea58c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1944708022", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.220", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9f1d0ea8cbf74f10b81a10d3a7a6e716", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc019e949-c6", "ovs_interfaceid": "c019e949-c6fc-4014-9e42-13ce1eb17786", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9cecd3d6-4945-4a4b-8d06-48b0d7768a17", "address": "fa:16:3e:59:c6:53", "network": {"id": "b1b273e9-ac47-4985-9a15-ed6392eea58c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1944708022", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9f1d0ea8cbf74f10b81a10d3a7a6e716", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cecd3d6-49", "ovs_interfaceid": "9cecd3d6-4945-4a4b-8d06-48b0d7768a17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a04b8134-03e6-45f2-b6d7-3ea6a7deb81c", "address": "fa:16:3e:0a:29:45", "network": {"id": "75761f5b-dd19-4843-8db7-9cef3872583d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1377439333", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9f1d0ea8cbf74f10b81a10d3a7a6e716", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa04b8134-03", "ovs_interfaceid": "a04b8134-03e6-45f2-b6d7-3ea6a7deb81c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "03ee4dbc-d46d-4127-a4e0-d308a1c8beae", "address": "fa:16:3e:5b:46:e6", "network": {"id": "75761f5b-dd19-4843-8db7-9cef3872583d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1377439333", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9f1d0ea8cbf74f10b81a10d3a7a6e716", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03ee4dbc-d4", "ovs_interfaceid": "03ee4dbc-d46d-4127-a4e0-d308a1c8beae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:09:05 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-5bb2b590-bac8-437d-bba8-b7d5fffffcbb req-2c61c613-543f-440e-b106-abedd7ec1e61 service nova] Releasing lock "refresh_cache-8d5569ce-1f18-4f37-a340-099ee152d548" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:09:05 user nova-compute[75165]: DEBUG nova.compute.manager [req-5bb2b590-bac8-437d-bba8-b7d5fffffcbb req-2c61c613-543f-440e-b106-abedd7ec1e61 service nova] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Received event network-changed-03ee4dbc-d46d-4127-a4e0-d308a1c8beae {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:09:05 user nova-compute[75165]: DEBUG nova.compute.manager [req-5bb2b590-bac8-437d-bba8-b7d5fffffcbb req-2c61c613-543f-440e-b106-abedd7ec1e61 service nova] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Refreshing instance network info cache due to event network-changed-03ee4dbc-d46d-4127-a4e0-d308a1c8beae. {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 00:09:05 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-5bb2b590-bac8-437d-bba8-b7d5fffffcbb req-2c61c613-543f-440e-b106-abedd7ec1e61 service nova] Acquiring lock "refresh_cache-8d5569ce-1f18-4f37-a340-099ee152d548" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:09:05 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-5bb2b590-bac8-437d-bba8-b7d5fffffcbb req-2c61c613-543f-440e-b106-abedd7ec1e61 service nova] Acquired lock "refresh_cache-8d5569ce-1f18-4f37-a340-099ee152d548" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:09:05 user nova-compute[75165]: DEBUG nova.network.neutron [req-5bb2b590-bac8-437d-bba8-b7d5fffffcbb req-2c61c613-543f-440e-b106-abedd7ec1e61 service nova] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Refreshing network info cache for port 03ee4dbc-d46d-4127-a4e0-d308a1c8beae {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 00:09:05 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f9add59-cabe-4965-8fe3-524618550581/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:09:05 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f9add59-cabe-4965-8fe3-524618550581/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:09:05 user nova-compute[75165]: DEBUG nova.network.neutron [req-86e60f43-6b2f-4318-ba22-7ec2f56ed5aa req-f881b248-1f51-42d6-9702-c0c574726267 service nova] [instance: 018ca455-eace-412d-86a3-d914b4af30d5] Updated VIF entry in instance network info cache for port 7752e050-4a35-4290-afb7-87d59ee07610. {{(pid=75165) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 00:09:05 user nova-compute[75165]: DEBUG nova.network.neutron [req-86e60f43-6b2f-4318-ba22-7ec2f56ed5aa req-f881b248-1f51-42d6-9702-c0c574726267 service nova] [instance: 018ca455-eace-412d-86a3-d914b4af30d5] Updating instance_info_cache with network_info: [{"id": "7752e050-4a35-4290-afb7-87d59ee07610", "address": "fa:16:3e:61:5c:ef", "network": {"id": "e571d376-bebd-49ff-b7ee-64a148f25b55", "bridge": "br-int", "label": "tempest-VolumesActionsTest-502796136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c9acab3d48a43568a5096c8d786538d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7752e050-4a", "ovs_interfaceid": "7752e050-4a35-4290-afb7-87d59ee07610", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:09:05 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-86e60f43-6b2f-4318-ba22-7ec2f56ed5aa req-f881b248-1f51-42d6-9702-c0c574726267 service nova] Releasing lock "refresh_cache-018ca455-eace-412d-86a3-d914b4af30d5" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:09:05 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f9add59-cabe-4965-8fe3-524618550581/disk --force-share --output=json" returned: 0 in 0.274s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:09:05 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26a0b493-bb47-466e-95d5-945fc3849fa5/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:09:05 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:09:05 user nova-compute[75165]: DEBUG nova.network.neutron [req-7f389374-3e15-43b6-8e38-cfc6288f9f0b req-ef734a35-bd08-4d59-9c07-ae73785ba3e8 service nova] [instance: a7eeb145-1565-4812-818b-fefda5f2436d] Updated VIF entry in instance network info cache for port 7a43d085-a683-4c49-a7c8-13b8f35c943d. {{(pid=75165) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 00:09:05 user nova-compute[75165]: DEBUG nova.network.neutron [req-7f389374-3e15-43b6-8e38-cfc6288f9f0b req-ef734a35-bd08-4d59-9c07-ae73785ba3e8 service nova] [instance: a7eeb145-1565-4812-818b-fefda5f2436d] Updating instance_info_cache with network_info: [{"id": "7a43d085-a683-4c49-a7c8-13b8f35c943d", "address": "fa:16:3e:e8:63:41", "network": {"id": "bd1c84f9-bba9-4a23-8bf2-17e65022136a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1557945804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2911497df44047d9a9ee36a5652298bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a43d085-a6", "ovs_interfaceid": "7a43d085-a683-4c49-a7c8-13b8f35c943d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:09:05 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-7f389374-3e15-43b6-8e38-cfc6288f9f0b req-ef734a35-bd08-4d59-9c07-ae73785ba3e8 service nova] Releasing lock "refresh_cache-a7eeb145-1565-4812-818b-fefda5f2436d" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:09:05 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26a0b493-bb47-466e-95d5-945fc3849fa5/disk --force-share --output=json" returned: 0 in 0.279s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:09:05 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26a0b493-bb47-466e-95d5-945fc3849fa5/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:09:06 user nova-compute[75165]: DEBUG nova.network.neutron [req-5bb2b590-bac8-437d-bba8-b7d5fffffcbb req-2c61c613-543f-440e-b106-abedd7ec1e61 service nova] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Updated VIF entry in instance network info cache for port 03ee4dbc-d46d-4127-a4e0-d308a1c8beae. {{(pid=75165) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 00:09:06 user nova-compute[75165]: DEBUG nova.network.neutron [req-5bb2b590-bac8-437d-bba8-b7d5fffffcbb req-2c61c613-543f-440e-b106-abedd7ec1e61 service nova] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Updating instance_info_cache with network_info: [{"id": "3da752ae-77a3-4bc3-8885-76331bc2d7d8", "address": "fa:16:3e:22:af:b4", "network": {"id": "a4a95519-4969-4c53-b078-46dab1ae12ac", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1704712535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f1d0ea8cbf74f10b81a10d3a7a6e716", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3da752ae-77", "ovs_interfaceid": "3da752ae-77a3-4bc3-8885-76331bc2d7d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b9583014-bb07-4337-97bb-30001c05475f", "address": "fa:16:3e:ca:f8:4e", "network": {"id": "b1b273e9-ac47-4985-9a15-ed6392eea58c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1944708022", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9f1d0ea8cbf74f10b81a10d3a7a6e716", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9583014-bb", "ovs_interfaceid": "b9583014-bb07-4337-97bb-30001c05475f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c51f288f-44b9-476b-9419-22ef8ae5c900", "address": "fa:16:3e:28:cd:e8", "network": {"id": "b1b273e9-ac47-4985-9a15-ed6392eea58c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1944708022", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.239", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9f1d0ea8cbf74f10b81a10d3a7a6e716", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc51f288f-44", "ovs_interfaceid": "c51f288f-44b9-476b-9419-22ef8ae5c900", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c019e949-c6fc-4014-9e42-13ce1eb17786", "address": "fa:16:3e:34:fd:75", "network": {"id": "b1b273e9-ac47-4985-9a15-ed6392eea58c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1944708022", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.220", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9f1d0ea8cbf74f10b81a10d3a7a6e716", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc019e949-c6", "ovs_interfaceid": "c019e949-c6fc-4014-9e42-13ce1eb17786", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9cecd3d6-4945-4a4b-8d06-48b0d7768a17", "address": "fa:16:3e:59:c6:53", "network": {"id": "b1b273e9-ac47-4985-9a15-ed6392eea58c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1944708022", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9f1d0ea8cbf74f10b81a10d3a7a6e716", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cecd3d6-49", "ovs_interfaceid": "9cecd3d6-4945-4a4b-8d06-48b0d7768a17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a04b8134-03e6-45f2-b6d7-3ea6a7deb81c", "address": "fa:16:3e:0a:29:45", "network": {"id": "75761f5b-dd19-4843-8db7-9cef3872583d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1377439333", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9f1d0ea8cbf74f10b81a10d3a7a6e716", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa04b8134-03", "ovs_interfaceid": "a04b8134-03e6-45f2-b6d7-3ea6a7deb81c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "03ee4dbc-d46d-4127-a4e0-d308a1c8beae", "address": "fa:16:3e:5b:46:e6", "network": {"id": "75761f5b-dd19-4843-8db7-9cef3872583d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1377439333", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9f1d0ea8cbf74f10b81a10d3a7a6e716", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03ee4dbc-d4", "ovs_interfaceid": "03ee4dbc-d46d-4127-a4e0-d308a1c8beae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:09:06 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-5bb2b590-bac8-437d-bba8-b7d5fffffcbb req-2c61c613-543f-440e-b106-abedd7ec1e61 service nova] Releasing lock "refresh_cache-8d5569ce-1f18-4f37-a340-099ee152d548" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:09:06 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26a0b493-bb47-466e-95d5-945fc3849fa5/disk --force-share --output=json" returned: 0 in 0.305s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:09:06 user nova-compute[75165]: DEBUG nova.compute.manager [req-4b062566-fd48-45e3-ae08-acc844969fef req-31c87bb3-8d62-4676-a661-2c2035766579 service nova] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] Received event network-changed-1d6d497c-7382-4dff-b136-d1220b05a838 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:09:06 user nova-compute[75165]: DEBUG nova.compute.manager [req-4b062566-fd48-45e3-ae08-acc844969fef req-31c87bb3-8d62-4676-a661-2c2035766579 service nova] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] Refreshing instance network info cache due to event network-changed-1d6d497c-7382-4dff-b136-d1220b05a838. {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 00:09:06 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-4b062566-fd48-45e3-ae08-acc844969fef req-31c87bb3-8d62-4676-a661-2c2035766579 service nova] Acquiring lock "refresh_cache-26a0b493-bb47-466e-95d5-945fc3849fa5" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:09:06 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-4b062566-fd48-45e3-ae08-acc844969fef req-31c87bb3-8d62-4676-a661-2c2035766579 service nova] Acquired lock "refresh_cache-26a0b493-bb47-466e-95d5-945fc3849fa5" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:09:06 user nova-compute[75165]: DEBUG nova.network.neutron [req-4b062566-fd48-45e3-ae08-acc844969fef req-31c87bb3-8d62-4676-a661-2c2035766579 service nova] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] Refreshing network info cache for port 1d6d497c-7382-4dff-b136-d1220b05a838 {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 00:09:06 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e44bfc-6a68-46ce-8335-aaaba5160d3e/disk.rescue --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:09:06 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e44bfc-6a68-46ce-8335-aaaba5160d3e/disk.rescue --force-share --output=json" returned: 0 in 0.259s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:09:06 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e44bfc-6a68-46ce-8335-aaaba5160d3e/disk.rescue --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:09:06 user nova-compute[75165]: DEBUG nova.compute.manager [req-3d4c38cb-edfe-448f-b2cd-b24fa5b7e039 req-e16b3043-9c20-45e0-bb60-0f256b5b868e service nova] [instance: 6f9add59-cabe-4965-8fe3-524618550581] Received event network-changed-50bf388e-b8ff-4924-9633-7e97d083a361 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:09:06 user nova-compute[75165]: DEBUG nova.compute.manager [req-3d4c38cb-edfe-448f-b2cd-b24fa5b7e039 req-e16b3043-9c20-45e0-bb60-0f256b5b868e service nova] [instance: 6f9add59-cabe-4965-8fe3-524618550581] Refreshing instance network info cache due to event network-changed-50bf388e-b8ff-4924-9633-7e97d083a361. {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 00:09:06 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-3d4c38cb-edfe-448f-b2cd-b24fa5b7e039 req-e16b3043-9c20-45e0-bb60-0f256b5b868e service nova] Acquiring lock "refresh_cache-6f9add59-cabe-4965-8fe3-524618550581" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:09:06 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-3d4c38cb-edfe-448f-b2cd-b24fa5b7e039 req-e16b3043-9c20-45e0-bb60-0f256b5b868e service nova] Acquired lock "refresh_cache-6f9add59-cabe-4965-8fe3-524618550581" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:09:06 user nova-compute[75165]: DEBUG nova.network.neutron [req-3d4c38cb-edfe-448f-b2cd-b24fa5b7e039 req-e16b3043-9c20-45e0-bb60-0f256b5b868e service nova] [instance: 6f9add59-cabe-4965-8fe3-524618550581] Refreshing network info cache for port 50bf388e-b8ff-4924-9633-7e97d083a361 {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 00:09:06 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e44bfc-6a68-46ce-8335-aaaba5160d3e/disk.rescue --force-share --output=json" returned: 0 in 0.259s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:09:06 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e44bfc-6a68-46ce-8335-aaaba5160d3e/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:09:06 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:09:06 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:09:06 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:09:06 user nova-compute[75165]: DEBUG nova.network.neutron [req-4b062566-fd48-45e3-ae08-acc844969fef req-31c87bb3-8d62-4676-a661-2c2035766579 service nova] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] Updated VIF entry in instance network info cache for port 1d6d497c-7382-4dff-b136-d1220b05a838. {{(pid=75165) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 00:09:06 user nova-compute[75165]: DEBUG nova.network.neutron [req-4b062566-fd48-45e3-ae08-acc844969fef req-31c87bb3-8d62-4676-a661-2c2035766579 service nova] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] Updating instance_info_cache with network_info: [{"id": "1d6d497c-7382-4dff-b136-d1220b05a838", "address": "fa:16:3e:d3:eb:fb", "network": {"id": "08c51c53-4819-493e-b4eb-df5d6024d43d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1633769998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9cbae16d09ed4474bb6653f08165a4e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d6d497c-73", "ovs_interfaceid": "1d6d497c-7382-4dff-b136-d1220b05a838", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:09:06 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e44bfc-6a68-46ce-8335-aaaba5160d3e/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:09:06 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e44bfc-6a68-46ce-8335-aaaba5160d3e/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:09:06 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-4b062566-fd48-45e3-ae08-acc844969fef req-31c87bb3-8d62-4676-a661-2c2035766579 service nova] Releasing lock "refresh_cache-26a0b493-bb47-466e-95d5-945fc3849fa5" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:09:06 user nova-compute[75165]: DEBUG nova.compute.manager [req-4b062566-fd48-45e3-ae08-acc844969fef req-31c87bb3-8d62-4676-a661-2c2035766579 service nova] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] Received event network-changed-874a1698-c52c-444c-bed5-52633dbaeead {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:09:06 user nova-compute[75165]: DEBUG nova.compute.manager [req-4b062566-fd48-45e3-ae08-acc844969fef req-31c87bb3-8d62-4676-a661-2c2035766579 service nova] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] Refreshing instance network info cache due to event network-changed-874a1698-c52c-444c-bed5-52633dbaeead. {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 00:09:06 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-4b062566-fd48-45e3-ae08-acc844969fef req-31c87bb3-8d62-4676-a661-2c2035766579 service nova] Acquiring lock "refresh_cache-3b153af2-c93b-47d2-ae8c-76cfd44e384c" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:09:06 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-4b062566-fd48-45e3-ae08-acc844969fef req-31c87bb3-8d62-4676-a661-2c2035766579 service nova] Acquired lock "refresh_cache-3b153af2-c93b-47d2-ae8c-76cfd44e384c" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:09:06 user nova-compute[75165]: DEBUG nova.network.neutron [req-4b062566-fd48-45e3-ae08-acc844969fef req-31c87bb3-8d62-4676-a661-2c2035766579 service nova] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] Refreshing network info cache for port 874a1698-c52c-444c-bed5-52633dbaeead {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 00:09:07 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e44bfc-6a68-46ce-8335-aaaba5160d3e/disk --force-share --output=json" returned: 0 in 0.306s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:09:07 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/471df318-7d9f-4512-add6-b6612700e15d/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:09:07 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/471df318-7d9f-4512-add6-b6612700e15d/disk --force-share --output=json" returned: 0 in 0.508s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:09:07 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:09:07 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/471df318-7d9f-4512-add6-b6612700e15d/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:09:07 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:09:07 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:09:07 user nova-compute[75165]: DEBUG nova.network.neutron [req-4b062566-fd48-45e3-ae08-acc844969fef req-31c87bb3-8d62-4676-a661-2c2035766579 service nova] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] Updated VIF entry in instance network info cache for port 874a1698-c52c-444c-bed5-52633dbaeead. {{(pid=75165) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 00:09:07 user nova-compute[75165]: DEBUG nova.network.neutron [req-4b062566-fd48-45e3-ae08-acc844969fef req-31c87bb3-8d62-4676-a661-2c2035766579 service nova] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] Updating instance_info_cache with network_info: [{"id": "874a1698-c52c-444c-bed5-52633dbaeead", "address": "fa:16:3e:75:45:79", "network": {"id": "30951418-d830-4042-9143-c736802150e9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-167387787-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0db2c49ee28f4b7b9fa990faddb9d3a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap874a1698-c5", "ovs_interfaceid": "874a1698-c52c-444c-bed5-52633dbaeead", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:09:08 user nova-compute[75165]: DEBUG nova.compute.manager [None req-6eca76c2-6931-4dbe-841f-19b2d132134e tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] Checking state {{(pid=75165) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 00:09:08 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/471df318-7d9f-4512-add6-b6612700e15d/disk --force-share --output=json" returned: 0 in 0.275s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:09:08 user nova-compute[75165]: DEBUG nova.network.neutron [req-3d4c38cb-edfe-448f-b2cd-b24fa5b7e039 req-e16b3043-9c20-45e0-bb60-0f256b5b868e service nova] [instance: 6f9add59-cabe-4965-8fe3-524618550581] Updated VIF entry in instance network info cache for port 50bf388e-b8ff-4924-9633-7e97d083a361. {{(pid=75165) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 00:09:08 user nova-compute[75165]: DEBUG nova.network.neutron [req-3d4c38cb-edfe-448f-b2cd-b24fa5b7e039 req-e16b3043-9c20-45e0-bb60-0f256b5b868e service nova] [instance: 6f9add59-cabe-4965-8fe3-524618550581] Updating instance_info_cache with network_info: [{"id": "50bf388e-b8ff-4924-9633-7e97d083a361", "address": "fa:16:3e:16:28:b9", "network": {"id": "f54e2e9f-5c1e-44ca-bd4b-9cf0747b0f72", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-806146051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "920152101768459baa71010b380ea8f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50bf388e-b8", "ovs_interfaceid": "50bf388e-b8ff-4924-9633-7e97d083a361", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:09:08 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-4b062566-fd48-45e3-ae08-acc844969fef req-31c87bb3-8d62-4676-a661-2c2035766579 service nova] Releasing lock "refresh_cache-3b153af2-c93b-47d2-ae8c-76cfd44e384c" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:09:08 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-3d4c38cb-edfe-448f-b2cd-b24fa5b7e039 req-e16b3043-9c20-45e0-bb60-0f256b5b868e service nova] Releasing lock "refresh_cache-6f9add59-cabe-4965-8fe3-524618550581" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:09:08 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b153af2-c93b-47d2-ae8c-76cfd44e384c/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:09:08 user nova-compute[75165]: INFO nova.compute.manager [None req-6eca76c2-6931-4dbe-841f-19b2d132134e tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] instance snapshotting
Oct 26 00:09:08 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-6eca76c2-6931-4dbe-841f-19b2d132134e tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] Beginning live snapshot process
Oct 26 00:09:08 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b153af2-c93b-47d2-ae8c-76cfd44e384c/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:09:08 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b153af2-c93b-47d2-ae8c-76cfd44e384c/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:09:08 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b153af2-c93b-47d2-ae8c-76cfd44e384c/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:09:08 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f465963f-1d0f-4ca3-a8b8-681566b7d40a/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:09:08 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-6eca76c2-6931-4dbe-841f-19b2d132134e tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26a0b493-bb47-466e-95d5-945fc3849fa5/disk --force-share --output=json -f qcow2 {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:09:08 user nova-compute[75165]: DEBUG nova.compute.manager [req-99db7a14-42ae-44fa-a81f-555688a55b13 req-bb5c53b0-9319-468e-ba1a-3b91d414283d service nova] [instance: 018ca455-eace-412d-86a3-d914b4af30d5] Received event network-vif-plugged-7752e050-4a35-4290-afb7-87d59ee07610 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:09:08 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-99db7a14-42ae-44fa-a81f-555688a55b13 req-bb5c53b0-9319-468e-ba1a-3b91d414283d service nova] Acquiring lock "018ca455-eace-412d-86a3-d914b4af30d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:09:08 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-99db7a14-42ae-44fa-a81f-555688a55b13 req-bb5c53b0-9319-468e-ba1a-3b91d414283d service nova] Lock "018ca455-eace-412d-86a3-d914b4af30d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:09:08 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-99db7a14-42ae-44fa-a81f-555688a55b13 req-bb5c53b0-9319-468e-ba1a-3b91d414283d service nova] Lock "018ca455-eace-412d-86a3-d914b4af30d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:09:08 user nova-compute[75165]: DEBUG nova.compute.manager [req-99db7a14-42ae-44fa-a81f-555688a55b13 req-bb5c53b0-9319-468e-ba1a-3b91d414283d service nova] [instance: 018ca455-eace-412d-86a3-d914b4af30d5] No waiting events found dispatching network-vif-plugged-7752e050-4a35-4290-afb7-87d59ee07610 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:09:08 user nova-compute[75165]: WARNING nova.compute.manager [req-99db7a14-42ae-44fa-a81f-555688a55b13 req-bb5c53b0-9319-468e-ba1a-3b91d414283d service nova] [instance: 018ca455-eace-412d-86a3-d914b4af30d5] Received unexpected event network-vif-plugged-7752e050-4a35-4290-afb7-87d59ee07610 for instance with vm_state building and task_state spawning.
Oct 26 00:09:08 user nova-compute[75165]: DEBUG nova.compute.manager [req-99db7a14-42ae-44fa-a81f-555688a55b13 req-bb5c53b0-9319-468e-ba1a-3b91d414283d service nova] [instance: 018ca455-eace-412d-86a3-d914b4af30d5] Received event network-vif-plugged-7752e050-4a35-4290-afb7-87d59ee07610 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:09:08 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-99db7a14-42ae-44fa-a81f-555688a55b13 req-bb5c53b0-9319-468e-ba1a-3b91d414283d service nova] Acquiring lock "018ca455-eace-412d-86a3-d914b4af30d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:09:08 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-99db7a14-42ae-44fa-a81f-555688a55b13 req-bb5c53b0-9319-468e-ba1a-3b91d414283d service nova] Lock "018ca455-eace-412d-86a3-d914b4af30d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:09:08 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-99db7a14-42ae-44fa-a81f-555688a55b13 req-bb5c53b0-9319-468e-ba1a-3b91d414283d service nova] Lock "018ca455-eace-412d-86a3-d914b4af30d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:09:08 user nova-compute[75165]: DEBUG nova.compute.manager [req-99db7a14-42ae-44fa-a81f-555688a55b13 req-bb5c53b0-9319-468e-ba1a-3b91d414283d service nova] [instance: 018ca455-eace-412d-86a3-d914b4af30d5] No waiting events found dispatching network-vif-plugged-7752e050-4a35-4290-afb7-87d59ee07610 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:09:08 user nova-compute[75165]: WARNING nova.compute.manager [req-99db7a14-42ae-44fa-a81f-555688a55b13 req-bb5c53b0-9319-468e-ba1a-3b91d414283d service nova] [instance: 018ca455-eace-412d-86a3-d914b4af30d5] Received unexpected event network-vif-plugged-7752e050-4a35-4290-afb7-87d59ee07610 for instance with vm_state building and task_state spawning.
Oct 26 00:09:08 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-6eca76c2-6931-4dbe-841f-19b2d132134e tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26a0b493-bb47-466e-95d5-945fc3849fa5/disk --force-share --output=json -f qcow2" returned: 0 in 0.195s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:09:08 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-6eca76c2-6931-4dbe-841f-19b2d132134e tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26a0b493-bb47-466e-95d5-945fc3849fa5/disk --force-share --output=json -f qcow2 {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:09:08 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f465963f-1d0f-4ca3-a8b8-681566b7d40a/disk --force-share --output=json" returned: 0 in 0.302s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:09:08 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f465963f-1d0f-4ca3-a8b8-681566b7d40a/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:09:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f465963f-1d0f-4ca3-a8b8-681566b7d40a/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:09:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-6eca76c2-6931-4dbe-841f-19b2d132134e tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26a0b493-bb47-466e-95d5-945fc3849fa5/disk --force-share --output=json -f qcow2" returned: 0 in 0.253s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:09:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-6eca76c2-6931-4dbe-841f-19b2d132134e tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:09:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f326db85-74f6-4e60-9c55-46b2a59502d0/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:09:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-6eca76c2-6931-4dbe-841f-19b2d132134e tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json" returned: 0 in 0.187s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:09:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-6eca76c2-6931-4dbe-841f-19b2d132134e tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmplnzi9brd/ba157151a83d4a6c8ce05a78bac9676a.delta 1073741824 {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:09:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f326db85-74f6-4e60-9c55-46b2a59502d0/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:09:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f326db85-74f6-4e60-9c55-46b2a59502d0/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:09:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-6eca76c2-6931-4dbe-841f-19b2d132134e tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmplnzi9brd/ba157151a83d4a6c8ce05a78bac9676a.delta 1073741824" returned: 0 in 0.096s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:09:09 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-6eca76c2-6931-4dbe-841f-19b2d132134e tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] Quiescing instance not available: QEMU guest agent is not enabled.
Oct 26 00:09:09 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-6eca76c2-6931-4dbe-841f-19b2d132134e tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Checking UEFI support for host arch (x86_64) {{(pid=75165) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Oct 26 00:09:09 user nova-compute[75165]: INFO nova.virt.libvirt.host [None req-6eca76c2-6931-4dbe-841f-19b2d132134e tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] UEFI support detected
Oct 26 00:09:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f326db85-74f6-4e60-9c55-46b2a59502d0/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:09:10 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:09:10 user nova-compute[75165]: DEBUG nova.compute.manager [None req-44c17bba-1c3f-439e-a95d-1af8251eeae9 tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] [instance: 018ca455-eace-412d-86a3-d914b4af30d5] Instance event wait completed in 0 seconds for  {{(pid=75165) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 00:09:10 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-44c17bba-1c3f-439e-a95d-1af8251eeae9 tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] [instance: 018ca455-eace-412d-86a3-d914b4af30d5] Guest created on hypervisor {{(pid=75165) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 00:09:10 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:09:10 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:09:10 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Hypervisor/Node resource view: name=user free_ram=6920MB free_disk=25.210540771484375GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75165) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 00:09:10 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:09:10 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:09:10 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: 018ca455-eace-412d-86a3-d914b4af30d5] Instance spawned successfully.
Oct 26 00:09:10 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-44c17bba-1c3f-439e-a95d-1af8251eeae9 tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] [instance: 018ca455-eace-412d-86a3-d914b4af30d5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 00:09:10 user nova-compute[75165]: DEBUG nova.virt.libvirt.guest [None req-6eca76c2-6931-4dbe-841f-19b2d132134e tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75165) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 26 00:09:10 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-44c17bba-1c3f-439e-a95d-1af8251eeae9 tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] [instance: 018ca455-eace-412d-86a3-d914b4af30d5] Found default for hw_cdrom_bus of ide {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:09:10 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-44c17bba-1c3f-439e-a95d-1af8251eeae9 tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] [instance: 018ca455-eace-412d-86a3-d914b4af30d5] Found default for hw_disk_bus of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:09:10 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-44c17bba-1c3f-439e-a95d-1af8251eeae9 tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] [instance: 018ca455-eace-412d-86a3-d914b4af30d5] Found default for hw_input_bus of None {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:09:10 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-44c17bba-1c3f-439e-a95d-1af8251eeae9 tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] [instance: 018ca455-eace-412d-86a3-d914b4af30d5] Found default for hw_pointer_model of None {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:09:10 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-44c17bba-1c3f-439e-a95d-1af8251eeae9 tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] [instance: 018ca455-eace-412d-86a3-d914b4af30d5] Found default for hw_video_model of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:09:10 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-44c17bba-1c3f-439e-a95d-1af8251eeae9 tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] [instance: 018ca455-eace-412d-86a3-d914b4af30d5] Found default for hw_vif_model of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:09:10 user nova-compute[75165]: INFO nova.compute.manager [None req-44c17bba-1c3f-439e-a95d-1af8251eeae9 tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] [instance: 018ca455-eace-412d-86a3-d914b4af30d5] Took 8.71 seconds to spawn the instance on the hypervisor.
Oct 26 00:09:10 user nova-compute[75165]: DEBUG nova.compute.manager [None req-44c17bba-1c3f-439e-a95d-1af8251eeae9 tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] [instance: 018ca455-eace-412d-86a3-d914b4af30d5] Checking state {{(pid=75165) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 00:09:10 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 9633e6bb-5e95-4994-92a2-9d8f85a946ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:09:10 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 84c6b624-648b-40e2-a37e-ff08609bad84 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:09:10 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 18dcf77e-fac2-4b38-ad1c-1f52ce14704a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:09:10 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance c4e44bfc-6a68-46ce-8335-aaaba5160d3e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:09:10 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance a7eeb145-1565-4812-818b-fefda5f2436d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:09:10 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 26a0b493-bb47-466e-95d5-945fc3849fa5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:09:10 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 3b153af2-c93b-47d2-ae8c-76cfd44e384c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:09:10 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 6f9add59-cabe-4965-8fe3-524618550581 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:09:10 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance f465963f-1d0f-4ca3-a8b8-681566b7d40a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:09:10 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance f326db85-74f6-4e60-9c55-46b2a59502d0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:09:10 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 45625147-ff69-496a-a41e-e55f818a020a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:09:10 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 8d5569ce-1f18-4f37-a340-099ee152d548 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:09:10 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 471df318-7d9f-4512-add6-b6612700e15d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:09:10 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 018ca455-eace-412d-86a3-d914b4af30d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:09:10 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=75165) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 00:09:10 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=13GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=75165) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 00:09:10 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:09:10 user nova-compute[75165]: INFO nova.compute.manager [None req-44c17bba-1c3f-439e-a95d-1af8251eeae9 tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] [instance: 018ca455-eace-412d-86a3-d914b4af30d5] Took 10.05 seconds to build instance.
Oct 26 00:09:10 user nova-compute[75165]: DEBUG nova.virt.libvirt.guest [None req-6eca76c2-6931-4dbe-841f-19b2d132134e tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] COPY block job progress, current cursor: 75104256 final cursor: 75497472 {{(pid=75165) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 26 00:09:10 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-44c17bba-1c3f-439e-a95d-1af8251eeae9 tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] Lock "018ca455-eace-412d-86a3-d914b4af30d5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.214s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:09:11 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:09:11 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:09:11 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Compute_service record updated for user:user {{(pid=75165) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 00:09:11 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.046s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:09:11 user nova-compute[75165]: DEBUG nova.virt.libvirt.guest [None req-6eca76c2-6931-4dbe-841f-19b2d132134e tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75165) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 26 00:09:11 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-6eca76c2-6931-4dbe-841f-19b2d132134e tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 26 00:09:11 user nova-compute[75165]: DEBUG nova.privsep.utils [None req-6eca76c2-6931-4dbe-841f-19b2d132134e tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75165) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 26 00:09:11 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-6eca76c2-6931-4dbe-841f-19b2d132134e tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmplnzi9brd/ba157151a83d4a6c8ce05a78bac9676a.delta /opt/stack/data/nova/instances/snapshots/tmplnzi9brd/ba157151a83d4a6c8ce05a78bac9676a {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:09:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-6eca76c2-6931-4dbe-841f-19b2d132134e tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmplnzi9brd/ba157151a83d4a6c8ce05a78bac9676a.delta /opt/stack/data/nova/instances/snapshots/tmplnzi9brd/ba157151a83d4a6c8ce05a78bac9676a" returned: 0 in 0.676s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:09:12 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-6eca76c2-6931-4dbe-841f-19b2d132134e tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] Snapshot extracted, beginning image upload
Oct 26 00:09:14 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-56a449a0-6fd7-4fc4-a137-208cdf38042a tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Acquiring lock "6f9add59-cabe-4965-8fe3-524618550581" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:09:14 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-56a449a0-6fd7-4fc4-a137-208cdf38042a tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Lock "6f9add59-cabe-4965-8fe3-524618550581" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:09:14 user nova-compute[75165]: INFO nova.compute.manager [None req-56a449a0-6fd7-4fc4-a137-208cdf38042a tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] [instance: 6f9add59-cabe-4965-8fe3-524618550581] Shelving
Oct 26 00:09:14 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:09:14 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:09:14 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:09:14 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:09:14 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:09:14 user nova-compute[75165]: DEBUG nova.compute.manager [req-55433285-3001-418b-8c6c-6dc89a35ffe4 req-6924e673-ea03-4356-81b2-61bab928cf2a service nova] [instance: 6f9add59-cabe-4965-8fe3-524618550581] Received event network-vif-unplugged-50bf388e-b8ff-4924-9633-7e97d083a361 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:09:14 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-55433285-3001-418b-8c6c-6dc89a35ffe4 req-6924e673-ea03-4356-81b2-61bab928cf2a service nova] Acquiring lock "6f9add59-cabe-4965-8fe3-524618550581-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:09:14 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-55433285-3001-418b-8c6c-6dc89a35ffe4 req-6924e673-ea03-4356-81b2-61bab928cf2a service nova] Lock "6f9add59-cabe-4965-8fe3-524618550581-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:09:14 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-55433285-3001-418b-8c6c-6dc89a35ffe4 req-6924e673-ea03-4356-81b2-61bab928cf2a service nova] Lock "6f9add59-cabe-4965-8fe3-524618550581-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:09:14 user nova-compute[75165]: DEBUG nova.compute.manager [req-55433285-3001-418b-8c6c-6dc89a35ffe4 req-6924e673-ea03-4356-81b2-61bab928cf2a service nova] [instance: 6f9add59-cabe-4965-8fe3-524618550581] No waiting events found dispatching network-vif-unplugged-50bf388e-b8ff-4924-9633-7e97d083a361 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:09:14 user nova-compute[75165]: WARNING nova.compute.manager [req-55433285-3001-418b-8c6c-6dc89a35ffe4 req-6924e673-ea03-4356-81b2-61bab928cf2a service nova] [instance: 6f9add59-cabe-4965-8fe3-524618550581] Received unexpected event network-vif-unplugged-50bf388e-b8ff-4924-9633-7e97d083a361 for instance with vm_state active and task_state shelving.
Oct 26 00:09:14 user nova-compute[75165]: INFO nova.virt.block_device [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Booting with volume 083f264a-3f29-48b4-9935-a73f4234e6d5 at /dev/vdb
Oct 26 00:09:14 user nova-compute[75165]: DEBUG os_brick.utils [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:09:14 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:09:14 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:09:14 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[85a6656d-c98d-4756-b882-1d491c205df3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa94814ccb35\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:09:14 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:09:14 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:09:14 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[246d258b-a87c-42a4-96a3-ea99f7b89e41]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:09:14 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:09:14 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:09:14 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[74beeb7d-a9a5-491e-b427-57390f655f98]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:09:14 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[0627cb57-9a46-4afe-a2d7-3d7d9ce8f379]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:09:14 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Running cmd (subprocess): nvme version {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:09:15 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] 'nvme version' failed. Not Retrying. {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 00:09:15 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] nvme not present on system {{(pid=75165) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 00:09:15 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:09:15 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 00:09:15 user nova-compute[75165]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 00:09:15 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[337ebb34-862d-40a9-ac76-67903cb08fca]: (4, '') {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:09:15 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75165) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 00:09:15 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75165) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 00:09:15 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] LIGHTOS: no hostnqn found. {{(pid=75165) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 00:09:15 user nova-compute[75165]: DEBUG os_brick.utils [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa94814ccb35', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:09:15 user nova-compute[75165]: DEBUG nova.virt.block_device [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Updating existing volume attachment record: 5f9beaa8-adc4-4d99-8828-6c0783191a71 {{(pid=75165) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 00:09:15 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:09:15 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-6eca76c2-6931-4dbe-841f-19b2d132134e tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] Snapshot image upload complete
Oct 26 00:09:15 user nova-compute[75165]: INFO nova.compute.manager [None req-6eca76c2-6931-4dbe-841f-19b2d132134e tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] Took 7.04 seconds to snapshot the instance on the hypervisor.
Oct 26 00:09:15 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: 6f9add59-cabe-4965-8fe3-524618550581] Instance destroyed successfully.
Oct 26 00:09:15 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-56a449a0-6fd7-4fc4-a137-208cdf38042a tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] [instance: 6f9add59-cabe-4965-8fe3-524618550581] Beginning cold snapshot process
Oct 26 00:09:15 user nova-compute[75165]: DEBUG nova.privsep.utils [None req-56a449a0-6fd7-4fc4-a137-208cdf38042a tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75165) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 26 00:09:15 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-56a449a0-6fd7-4fc4-a137-208cdf38042a tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/6f9add59-cabe-4965-8fe3-524618550581/disk /opt/stack/data/nova/instances/snapshots/tmpu__urtc9/c9c45e3af3b740bdaa98b36a4b025588 {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:09:15 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:09:16 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-56a449a0-6fd7-4fc4-a137-208cdf38042a tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/6f9add59-cabe-4965-8fe3-524618550581/disk /opt/stack/data/nova/instances/snapshots/tmpu__urtc9/c9c45e3af3b740bdaa98b36a4b025588" returned: 0 in 0.773s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:09:16 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-56a449a0-6fd7-4fc4-a137-208cdf38042a tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] [instance: 6f9add59-cabe-4965-8fe3-524618550581] Snapshot extracted, beginning image upload
Oct 26 00:09:16 user nova-compute[75165]: DEBUG nova.compute.manager [req-d86c1a18-bc93-41bd-b5b6-8e1a5dd759fb req-7bc462d8-4ae4-4076-a921-b06162786fb4 service nova] [instance: 6f9add59-cabe-4965-8fe3-524618550581] Received event network-vif-plugged-50bf388e-b8ff-4924-9633-7e97d083a361 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:09:16 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-d86c1a18-bc93-41bd-b5b6-8e1a5dd759fb req-7bc462d8-4ae4-4076-a921-b06162786fb4 service nova] Acquiring lock "6f9add59-cabe-4965-8fe3-524618550581-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:09:16 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-d86c1a18-bc93-41bd-b5b6-8e1a5dd759fb req-7bc462d8-4ae4-4076-a921-b06162786fb4 service nova] Lock "6f9add59-cabe-4965-8fe3-524618550581-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:09:16 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-d86c1a18-bc93-41bd-b5b6-8e1a5dd759fb req-7bc462d8-4ae4-4076-a921-b06162786fb4 service nova] Lock "6f9add59-cabe-4965-8fe3-524618550581-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:09:16 user nova-compute[75165]: DEBUG nova.compute.manager [req-d86c1a18-bc93-41bd-b5b6-8e1a5dd759fb req-7bc462d8-4ae4-4076-a921-b06162786fb4 service nova] [instance: 6f9add59-cabe-4965-8fe3-524618550581] No waiting events found dispatching network-vif-plugged-50bf388e-b8ff-4924-9633-7e97d083a361 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:09:16 user nova-compute[75165]: WARNING nova.compute.manager [req-d86c1a18-bc93-41bd-b5b6-8e1a5dd759fb req-7bc462d8-4ae4-4076-a921-b06162786fb4 service nova] [instance: 6f9add59-cabe-4965-8fe3-524618550581] Received unexpected event network-vif-plugged-50bf388e-b8ff-4924-9633-7e97d083a361 for instance with vm_state active and task_state shelving_image_uploading.
Oct 26 00:09:18 user nova-compute[75165]: DEBUG nova.compute.manager [req-91f24bf9-e5bd-4c27-b280-3674f6327114 req-9980add2-811b-4d01-bfce-e48aaba57a35 service nova] [instance: f465963f-1d0f-4ca3-a8b8-681566b7d40a] Received event network-changed-f382bfbf-798f-4f17-87ca-ff778203bab3 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:09:18 user nova-compute[75165]: DEBUG nova.compute.manager [req-91f24bf9-e5bd-4c27-b280-3674f6327114 req-9980add2-811b-4d01-bfce-e48aaba57a35 service nova] [instance: f465963f-1d0f-4ca3-a8b8-681566b7d40a] Refreshing instance network info cache due to event network-changed-f382bfbf-798f-4f17-87ca-ff778203bab3. {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 00:09:18 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-91f24bf9-e5bd-4c27-b280-3674f6327114 req-9980add2-811b-4d01-bfce-e48aaba57a35 service nova] Acquiring lock "refresh_cache-f465963f-1d0f-4ca3-a8b8-681566b7d40a" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:09:18 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-91f24bf9-e5bd-4c27-b280-3674f6327114 req-9980add2-811b-4d01-bfce-e48aaba57a35 service nova] Acquired lock "refresh_cache-f465963f-1d0f-4ca3-a8b8-681566b7d40a" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:09:18 user nova-compute[75165]: DEBUG nova.network.neutron [req-91f24bf9-e5bd-4c27-b280-3674f6327114 req-9980add2-811b-4d01-bfce-e48aaba57a35 service nova] [instance: f465963f-1d0f-4ca3-a8b8-681566b7d40a] Refreshing network info cache for port f382bfbf-798f-4f17-87ca-ff778203bab3 {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 00:09:19 user nova-compute[75165]: DEBUG nova.network.neutron [req-91f24bf9-e5bd-4c27-b280-3674f6327114 req-9980add2-811b-4d01-bfce-e48aaba57a35 service nova] [instance: f465963f-1d0f-4ca3-a8b8-681566b7d40a] Updated VIF entry in instance network info cache for port f382bfbf-798f-4f17-87ca-ff778203bab3. {{(pid=75165) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 00:09:19 user nova-compute[75165]: DEBUG nova.network.neutron [req-91f24bf9-e5bd-4c27-b280-3674f6327114 req-9980add2-811b-4d01-bfce-e48aaba57a35 service nova] [instance: f465963f-1d0f-4ca3-a8b8-681566b7d40a] Updating instance_info_cache with network_info: [{"id": "f382bfbf-798f-4f17-87ca-ff778203bab3", "address": "fa:16:3e:67:95:5b", "network": {"id": "7da22085-d8b3-4dbe-b796-95cdc69f58fe", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1230661193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "509c01c3838743959bacaa4aa2d31b63", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf382bfbf-79", "ovs_interfaceid": "f382bfbf-798f-4f17-87ca-ff778203bab3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:09:19 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-91f24bf9-e5bd-4c27-b280-3674f6327114 req-9980add2-811b-4d01-bfce-e48aaba57a35 service nova] Releasing lock "refresh_cache-f465963f-1d0f-4ca3-a8b8-681566b7d40a" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:09:19 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-56a449a0-6fd7-4fc4-a137-208cdf38042a tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] [instance: 6f9add59-cabe-4965-8fe3-524618550581] Snapshot image upload complete
Oct 26 00:09:19 user nova-compute[75165]: DEBUG nova.compute.manager [None req-56a449a0-6fd7-4fc4-a137-208cdf38042a tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] [instance: 6f9add59-cabe-4965-8fe3-524618550581] Checking state {{(pid=75165) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 00:09:19 user nova-compute[75165]: INFO nova.compute.manager [None req-56a449a0-6fd7-4fc4-a137-208cdf38042a tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] [instance: 6f9add59-cabe-4965-8fe3-524618550581] Shelve offloading
Oct 26 00:09:19 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: 6f9add59-cabe-4965-8fe3-524618550581] Instance destroyed successfully.
Oct 26 00:09:19 user nova-compute[75165]: DEBUG nova.compute.manager [None req-56a449a0-6fd7-4fc4-a137-208cdf38042a tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] [instance: 6f9add59-cabe-4965-8fe3-524618550581] Checking state {{(pid=75165) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 00:09:19 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-56a449a0-6fd7-4fc4-a137-208cdf38042a tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Acquiring lock "refresh_cache-6f9add59-cabe-4965-8fe3-524618550581" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:09:19 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-56a449a0-6fd7-4fc4-a137-208cdf38042a tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Acquired lock "refresh_cache-6f9add59-cabe-4965-8fe3-524618550581" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:09:19 user nova-compute[75165]: DEBUG nova.network.neutron [None req-56a449a0-6fd7-4fc4-a137-208cdf38042a tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] [instance: 6f9add59-cabe-4965-8fe3-524618550581] Building network info cache for instance {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 00:09:20 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:09:20 user nova-compute[75165]: DEBUG nova.network.neutron [None req-56a449a0-6fd7-4fc4-a137-208cdf38042a tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] [instance: 6f9add59-cabe-4965-8fe3-524618550581] Updating instance_info_cache with network_info: [{"id": "50bf388e-b8ff-4924-9633-7e97d083a361", "address": "fa:16:3e:16:28:b9", "network": {"id": "f54e2e9f-5c1e-44ca-bd4b-9cf0747b0f72", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-806146051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "920152101768459baa71010b380ea8f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50bf388e-b8", "ovs_interfaceid": "50bf388e-b8ff-4924-9633-7e97d083a361", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:09:20 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-56a449a0-6fd7-4fc4-a137-208cdf38042a tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Releasing lock "refresh_cache-6f9add59-cabe-4965-8fe3-524618550581" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:09:20 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:09:20 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: 6f9add59-cabe-4965-8fe3-524618550581] Instance destroyed successfully.
Oct 26 00:09:20 user nova-compute[75165]: DEBUG nova.objects.instance [None req-56a449a0-6fd7-4fc4-a137-208cdf38042a tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Lazy-loading 'resources' on Instance uuid 6f9add59-cabe-4965-8fe3-524618550581 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:09:20 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-56a449a0-6fd7-4fc4-a137-208cdf38042a tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:07:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-444593788',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-444593788',id=8,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPmLhpEGqHfWEDVp+Bb7MZzf/vrGL3uKzsxYYhytuWZRJqdFBvNBMiuBIa1UGxiNcAnbXigoebvMGsM57flYclfuZrrgJ5NcpyDMNxYszGc32IAq2Sr05Z1/NqZ2VCnXEw==',key_name='tempest-keypair-548689340',keypairs=<?>,launch_index=0,launched_at=2023-10-26T00:07:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='920152101768459baa71010b380ea8f1',ramdisk_id='',reservation_id='r-i1asnolo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-6636270',owner_user_name='tempest-AttachVolumeShelveTestJSON-6636270-project-member',shelved_at='2023-10-26T00:09:19.830795',shelved_host='user',shelved_image_id='5aa869d5-afcc-4629-94af-7f8f2484dc5a'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T00:09:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a40cb1b08014444686bd0adad03f6c68',uuid=6f9add59-cabe-4965-8fe3-524618550581,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "50bf388e-b8ff-4924-9633-7e97d083a361", "address": "fa:16:3e:16:28:b9", "network": {"id": "f54e2e9f-5c1e-44ca-bd4b-9cf0747b0f72", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-806146051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "920152101768459baa71010b380ea8f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50bf388e-b8", "ovs_interfaceid": "50bf388e-b8ff-4924-9633-7e97d083a361", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 00:09:20 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-56a449a0-6fd7-4fc4-a137-208cdf38042a tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Converting VIF {"id": "50bf388e-b8ff-4924-9633-7e97d083a361", "address": "fa:16:3e:16:28:b9", "network": {"id": "f54e2e9f-5c1e-44ca-bd4b-9cf0747b0f72", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-806146051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "920152101768459baa71010b380ea8f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50bf388e-b8", "ovs_interfaceid": "50bf388e-b8ff-4924-9633-7e97d083a361", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:09:20 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-56a449a0-6fd7-4fc4-a137-208cdf38042a tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:28:b9,bridge_name='br-int',has_traffic_filtering=True,id=50bf388e-b8ff-4924-9633-7e97d083a361,network=Network(f54e2e9f-5c1e-44ca-bd4b-9cf0747b0f72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50bf388e-b8') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:09:20 user nova-compute[75165]: DEBUG os_vif [None req-56a449a0-6fd7-4fc4-a137-208cdf38042a tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:28:b9,bridge_name='br-int',has_traffic_filtering=True,id=50bf388e-b8ff-4924-9633-7e97d083a361,network=Network(f54e2e9f-5c1e-44ca-bd4b-9cf0747b0f72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50bf388e-b8') {{(pid=75165) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 00:09:21 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:09:21 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap50bf388e-b8, bridge=br-int, if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:09:21 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:09:21 user nova-compute[75165]: DEBUG nova.compute.manager [req-8deb054b-a22f-477a-85fc-a1a63c913b29 req-31642610-4c14-4b42-8265-100cd0cb89b4 service nova] [instance: 6f9add59-cabe-4965-8fe3-524618550581] Received event network-changed-50bf388e-b8ff-4924-9633-7e97d083a361 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:09:21 user nova-compute[75165]: DEBUG nova.compute.manager [req-8deb054b-a22f-477a-85fc-a1a63c913b29 req-31642610-4c14-4b42-8265-100cd0cb89b4 service nova] [instance: 6f9add59-cabe-4965-8fe3-524618550581] Refreshing instance network info cache due to event network-changed-50bf388e-b8ff-4924-9633-7e97d083a361. {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 00:09:21 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-8deb054b-a22f-477a-85fc-a1a63c913b29 req-31642610-4c14-4b42-8265-100cd0cb89b4 service nova] Acquiring lock "refresh_cache-6f9add59-cabe-4965-8fe3-524618550581" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:09:21 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-8deb054b-a22f-477a-85fc-a1a63c913b29 req-31642610-4c14-4b42-8265-100cd0cb89b4 service nova] Acquired lock "refresh_cache-6f9add59-cabe-4965-8fe3-524618550581" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:09:21 user nova-compute[75165]: DEBUG nova.network.neutron [req-8deb054b-a22f-477a-85fc-a1a63c913b29 req-31642610-4c14-4b42-8265-100cd0cb89b4 service nova] [instance: 6f9add59-cabe-4965-8fe3-524618550581] Refreshing network info cache for port 50bf388e-b8ff-4924-9633-7e97d083a361 {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 00:09:21 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:09:21 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:09:21 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9ba866e0-f436-4ce7-911e-eb09e84375df) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:09:21 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:09:21 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:09:21 user nova-compute[75165]: INFO os_vif [None req-56a449a0-6fd7-4fc4-a137-208cdf38042a tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:28:b9,bridge_name='br-int',has_traffic_filtering=True,id=50bf388e-b8ff-4924-9633-7e97d083a361,network=Network(f54e2e9f-5c1e-44ca-bd4b-9cf0747b0f72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50bf388e-b8')
Oct 26 00:09:21 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-56a449a0-6fd7-4fc4-a137-208cdf38042a tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] [instance: 6f9add59-cabe-4965-8fe3-524618550581] Deleting instance files /opt/stack/data/nova/instances/6f9add59-cabe-4965-8fe3-524618550581_del
Oct 26 00:09:21 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-56a449a0-6fd7-4fc4-a137-208cdf38042a tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] [instance: 6f9add59-cabe-4965-8fe3-524618550581] Deletion of /opt/stack/data/nova/instances/6f9add59-cabe-4965-8fe3-524618550581_del complete
Oct 26 00:09:21 user nova-compute[75165]: INFO nova.scheduler.client.report [None req-56a449a0-6fd7-4fc4-a137-208cdf38042a tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Deleted allocations for instance 6f9add59-cabe-4965-8fe3-524618550581
Oct 26 00:09:21 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-56a449a0-6fd7-4fc4-a137-208cdf38042a tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:09:21 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-56a449a0-6fd7-4fc4-a137-208cdf38042a tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:09:21 user nova-compute[75165]: DEBUG nova.objects.instance [None req-56a449a0-6fd7-4fc4-a137-208cdf38042a tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Lazy-loading 'numa_topology' on Instance uuid 6f9add59-cabe-4965-8fe3-524618550581 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:09:21 user nova-compute[75165]: DEBUG nova.objects.base [None req-56a449a0-6fd7-4fc4-a137-208cdf38042a tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Object Instance<6f9add59-cabe-4965-8fe3-524618550581> lazy-loaded attributes: resources,numa_topology {{(pid=75165) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 00:09:21 user nova-compute[75165]: DEBUG nova.network.neutron [req-8deb054b-a22f-477a-85fc-a1a63c913b29 req-31642610-4c14-4b42-8265-100cd0cb89b4 service nova] [instance: 6f9add59-cabe-4965-8fe3-524618550581] Updated VIF entry in instance network info cache for port 50bf388e-b8ff-4924-9633-7e97d083a361. {{(pid=75165) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 00:09:21 user nova-compute[75165]: DEBUG nova.network.neutron [req-8deb054b-a22f-477a-85fc-a1a63c913b29 req-31642610-4c14-4b42-8265-100cd0cb89b4 service nova] [instance: 6f9add59-cabe-4965-8fe3-524618550581] Updating instance_info_cache with network_info: [{"id": "50bf388e-b8ff-4924-9633-7e97d083a361", "address": "fa:16:3e:16:28:b9", "network": {"id": "f54e2e9f-5c1e-44ca-bd4b-9cf0747b0f72", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-806146051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "920152101768459baa71010b380ea8f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap50bf388e-b8", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:09:21 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-8deb054b-a22f-477a-85fc-a1a63c913b29 req-31642610-4c14-4b42-8265-100cd0cb89b4 service nova] Releasing lock "refresh_cache-6f9add59-cabe-4965-8fe3-524618550581" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:09:21 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-56a449a0-6fd7-4fc4-a137-208cdf38042a tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:09:21 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-56a449a0-6fd7-4fc4-a137-208cdf38042a tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:09:21 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-56a449a0-6fd7-4fc4-a137-208cdf38042a tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.570s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:09:21 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-56a449a0-6fd7-4fc4-a137-208cdf38042a tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Lock "6f9add59-cabe-4965-8fe3-524618550581" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 7.741s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:09:23 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-e23ca2c9-99a1-4b46-a878-dc2a0fc428a2 tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] Acquiring lock "f465963f-1d0f-4ca3-a8b8-681566b7d40a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:09:23 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-e23ca2c9-99a1-4b46-a878-dc2a0fc428a2 tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] Lock "f465963f-1d0f-4ca3-a8b8-681566b7d40a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:09:23 user nova-compute[75165]: DEBUG nova.objects.instance [None req-e23ca2c9-99a1-4b46-a878-dc2a0fc428a2 tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] Lazy-loading 'flavor' on Instance uuid f465963f-1d0f-4ca3-a8b8-681566b7d40a {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:09:24 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-e23ca2c9-99a1-4b46-a878-dc2a0fc428a2 tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] Lock "f465963f-1d0f-4ca3-a8b8-681566b7d40a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.087s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:09:24 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-e23ca2c9-99a1-4b46-a878-dc2a0fc428a2 tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] Acquiring lock "f465963f-1d0f-4ca3-a8b8-681566b7d40a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:09:24 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-e23ca2c9-99a1-4b46-a878-dc2a0fc428a2 tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] Lock "f465963f-1d0f-4ca3-a8b8-681566b7d40a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:09:24 user nova-compute[75165]: INFO nova.compute.manager [None req-e23ca2c9-99a1-4b46-a878-dc2a0fc428a2 tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] [instance: f465963f-1d0f-4ca3-a8b8-681566b7d40a] Attaching volume b9d317ae-7dfa-4b25-9e3a-faa7ad5fed86 to /dev/sdc
Oct 26 00:09:24 user nova-compute[75165]: DEBUG os_brick.utils [None req-e23ca2c9-99a1-4b46-a878-dc2a0fc428a2 tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:09:24 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:09:24 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:09:24 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[03872a8c-9334-414e-9379-f70c30a442a1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa94814ccb35\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:09:24 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:09:24 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:09:24 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[104509d5-9327-4185-90fe-ba7509e1a038]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:09:24 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:09:24 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:09:24 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ac060f3-bac9-42ef-98ee-bc71a55daf2b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:09:24 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[2571d23e-e03d-4d52-9a7a-76f667664c50]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:09:24 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-e23ca2c9-99a1-4b46-a878-dc2a0fc428a2 tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] Running cmd (subprocess): nvme version {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:09:24 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-e23ca2c9-99a1-4b46-a878-dc2a0fc428a2 tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] 'nvme version' failed. Not Retrying. {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 00:09:24 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e23ca2c9-99a1-4b46-a878-dc2a0fc428a2 tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] nvme not present on system {{(pid=75165) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 00:09:24 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:09:24 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 00:09:24 user nova-compute[75165]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 00:09:24 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[999766dc-8c93-4e13-9091-626418decb92]: (4, '') {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:09:24 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-e23ca2c9-99a1-4b46-a878-dc2a0fc428a2 tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75165) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 00:09:24 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-e23ca2c9-99a1-4b46-a878-dc2a0fc428a2 tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75165) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 00:09:24 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-e23ca2c9-99a1-4b46-a878-dc2a0fc428a2 tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] LIGHTOS: no hostnqn found. {{(pid=75165) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 00:09:24 user nova-compute[75165]: DEBUG os_brick.utils [None req-e23ca2c9-99a1-4b46-a878-dc2a0fc428a2 tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa94814ccb35', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:09:24 user nova-compute[75165]: DEBUG nova.virt.block_device [None req-e23ca2c9-99a1-4b46-a878-dc2a0fc428a2 tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] [instance: f465963f-1d0f-4ca3-a8b8-681566b7d40a] Updating existing volume attachment record: e68bdba2-9501-428e-9032-bd006074f398 {{(pid=75165) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 00:09:24 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-3497df38-1888-4242-925b-9ba82d1c0be9 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:09:24 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-3497df38-1888-4242-925b-9ba82d1c0be9 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:09:24 user nova-compute[75165]: DEBUG os_brick.initiator.connector [None req-3497df38-1888-4242-925b-9ba82d1c0be9 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] Factory for ISCSI on None {{(pid=75165) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Oct 26 00:09:24 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-3497df38-1888-4242-925b-9ba82d1c0be9 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.011s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:09:24 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3497df38-1888-4242-925b-9ba82d1c0be9 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] [instance: 18dcf77e-fac2-4b38-ad1c-1f52ce14704a] Calling os-brick to attach iSCSI Volume {{(pid=75165) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 00:09:24 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-3497df38-1888-4242-925b-9ba82d1c0be9 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8bf8160e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ae81775c-f527-4e0d-b5f8-f8369c037b62', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lWbEquoO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:09:24 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-3497df38-1888-4242-925b-9ba82d1c0be9 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:09:24 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-3497df38-1888-4242-925b-9ba82d1c0be9 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:09:24 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-3497df38-1888-4242-925b-9ba82d1c0be9 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:09:24 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-3497df38-1888-4242-925b-9ba82d1c0be9 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:09:24 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-3497df38-1888-4242-925b-9ba82d1c0be9 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ae81775c-f527-4e0d-b5f8-f8369c037b62" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:09:24 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-3497df38-1888-4242-925b-9ba82d1c0be9 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ae81775c-f527-4e0d-b5f8-f8369c037b62" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:09:24 user nova-compute[75165]: INFO os_brick.initiator.connectors.iscsi [None req-3497df38-1888-4242-925b-9ba82d1c0be9 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 00:09:24 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae81775c-f527-4e0d-b5f8-f8369c037b62 -p 172.16.0.220:3260 {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:09:24 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae81775c-f527-4e0d-b5f8-f8369c037b62 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:09:24 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[98e99471-9b89-4325-b994-f29d6be11c38]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:09:24 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-3497df38-1888-4242-925b-9ba82d1c0be9 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 00:09:24 user nova-compute[75165]:  {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:09:24 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae81775c-f527-4e0d-b5f8-f8369c037b62 -p 172.16.0.220:3260 --interface default --op new {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:09:24 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae81775c-f527-4e0d-b5f8-f8369c037b62 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:09:24 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddd085f0-4e2d-4a75-8916-013c4667446d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ae81775c-f527-4e0d-b5f8-f8369c037b62] added\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:09:24 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-3497df38-1888-4242-925b-9ba82d1c0be9 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ae81775c-f527-4e0d-b5f8-f8369c037b62] added
Oct 26 00:09:24 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:09:24 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae81775c-f527-4e0d-b5f8-f8369c037b62 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:09:24 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae81775c-f527-4e0d-b5f8-f8369c037b62 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:09:24 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b463338-422c-4890-8c75-287f544d7876]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:09:24 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-3497df38-1888-4242-925b-9ba82d1c0be9 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:09:24 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae81775c-f527-4e0d-b5f8-f8369c037b62 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:09:24 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae81775c-f527-4e0d-b5f8-f8369c037b62 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:09:24 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[9450e70d-925d-4c96-aacd-b1c53e0fb56f]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:09:24 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-3497df38-1888-4242-925b-9ba82d1c0be9 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:09:24 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae81775c-f527-4e0d-b5f8-f8369c037b62 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lWbEquoO {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:09:24 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae81775c-f527-4e0d-b5f8-f8369c037b62 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lWbEquoO" returned: 0 in 0.017s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:09:24 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc9dd575-d2b7-46bd-a06d-c56c58978d93]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:09:24 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-3497df38-1888-4242-925b-9ba82d1c0be9 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lWbEquoO'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:09:24 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae81775c-f527-4e0d-b5f8-f8369c037b62 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:09:25 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae81775c-f527-4e0d-b5f8-f8369c037b62 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:09:25 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[b704b3eb-d0ef-4c71-ba6e-173990307175]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:09:25 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-3497df38-1888-4242-925b-9ba82d1c0be9 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:09:25 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:09:25 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.020s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:09:25 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb926fcc-de8c-4309-9eee-7ffe1e536e59]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:09:25 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-3497df38-1888-4242-925b-9ba82d1c0be9 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 26 00:09:25 user nova-compute[75165]:  {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:09:25 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-3497df38-1888-4242-925b-9ba82d1c0be9 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 26 00:09:25 user nova-compute[75165]:  {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:09:25 user nova-compute[75165]: WARNING os_brick.initiator.connectors.iscsi [None req-3497df38-1888-4242-925b-9ba82d1c0be9 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 26 00:09:25 user nova-compute[75165]: 
Oct 26 00:09:25 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae81775c-f527-4e0d-b5f8-f8369c037b62 -p 172.16.0.220:3260 --login {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:09:25 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae81775c-f527-4e0d-b5f8-f8369c037b62 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:09:25 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[e15572fa-45fa-4924-855e-2806a6722c3f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ae81775c-f527-4e0d-b5f8-f8369c037b62, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ae81775c-f527-4e0d-b5f8-f8369c037b62, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:09:25 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-3497df38-1888-4242-925b-9ba82d1c0be9 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ae81775c-f527-4e0d-b5f8-f8369c037b62, portal: 172.16.0.220,3260]
Oct 26 00:09:25 user nova-compute[75165]: Login to [iface: default, target: iqn.2010-10.org.openstack:ae81775c-f527-4e0d-b5f8-f8369c037b62, portal: 172.16.0.220,3260] successful.
Oct 26 00:09:25 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:09:25 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae81775c-f527-4e0d-b5f8-f8369c037b62 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:09:25 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae81775c-f527-4e0d-b5f8-f8369c037b62 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:09:25 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[d162aecf-2a56-4673-95e3-705faa732b74]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:09:25 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-3497df38-1888-4242-925b-9ba82d1c0be9 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:09:25 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:09:25 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:09:25 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[39883a24-f787-457d-aab8-68036725dcec]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae81775c-f527-4e0d-b5f8-f8369c037b62 (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:09:25 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-3497df38-1888-4242-925b-9ba82d1c0be9 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae81775c-f527-4e0d-b5f8-f8369c037b62 (non-flash)
Oct 26 00:09:25 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:09:25 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-3497df38-1888-4242-925b-9ba82d1c0be9 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae81775c-f527-4e0d-b5f8-f8369c037b62 (non-flash)
Oct 26 00:09:25 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:09:25 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-3497df38-1888-4242-925b-9ba82d1c0be9 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ae81775c-f527-4e0d-b5f8-f8369c037b62" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.282s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:09:25 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-3497df38-1888-4242-925b-9ba82d1c0be9 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] Connected to 172.16.0.220:3260 {{(pid=75165) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 00:09:25 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-3497df38-1888-4242-925b-9ba82d1c0be9 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=75165) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 00:09:25 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-3497df38-1888-4242-925b-9ba82d1c0be9 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75165) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 00:09:25 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:09:25 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.027s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:09:25 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f3b91d5-462f-4780-b8ed-b49c8997f045]: (4, ('- - 0', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:09:25 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-3497df38-1888-4242-925b-9ba82d1c0be9 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75165) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 00:09:25 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-3497df38-1888-4242-925b-9ba82d1c0be9 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:ae81775c-f527-4e0d-b5f8-f8369c037b62', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lWbEquoO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75165) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 00:09:25 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:09:26 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:09:26 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-3497df38-1888-4242-925b-9ba82d1c0be9 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.329s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:09:26 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-3497df38-1888-4242-925b-9ba82d1c0be9 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] <== connect_volume: return (1330ms) {'type': 'block', 'scsi_wwn': '23361366134626231', 'path': '/dev/sdb'} {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:09:26 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3497df38-1888-4242-925b-9ba82d1c0be9 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] [instance: 18dcf77e-fac2-4b38-ad1c-1f52ce14704a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23361366134626231', 'path': '/dev/sdb'} {{(pid=75165) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 00:09:26 user nova-compute[75165]: DEBUG nova.objects.instance [None req-3497df38-1888-4242-925b-9ba82d1c0be9 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] Lazy-loading 'flavor' on Instance uuid 18dcf77e-fac2-4b38-ad1c-1f52ce14704a {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:09:26 user nova-compute[75165]: DEBUG nova.virt.libvirt.guest [None req-3497df38-1888-4242-925b-9ba82d1c0be9 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 00:09:26 user nova-compute[75165]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 00:09:26 user nova-compute[75165]:   <source dev="/dev/sdb"/>
Oct 26 00:09:26 user nova-compute[75165]:   <target dev="vdb" bus="virtio"/>
Oct 26 00:09:26 user nova-compute[75165]:   <serial>ae81775c-f527-4e0d-b5f8-f8369c037b62</serial>
Oct 26 00:09:26 user nova-compute[75165]: </disk>
Oct 26 00:09:26 user nova-compute[75165]:  {{(pid=75165) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 00:09:26 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-3497df38-1888-4242-925b-9ba82d1c0be9 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] No BDM found with device name vda, not building metadata. {{(pid=75165) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 00:09:26 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-3497df38-1888-4242-925b-9ba82d1c0be9 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75165) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 00:09:26 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-3497df38-1888-4242-925b-9ba82d1c0be9 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] No VIF found with MAC fa:16:3e:4f:f1:44, not building metadata {{(pid=75165) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 00:09:26 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-3497df38-1888-4242-925b-9ba82d1c0be9 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] Lock "18dcf77e-fac2-4b38-ad1c-1f52ce14704a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 22.608s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:09:27 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-ebc5a915-9c90-46de-994c-9d1c7e7c7e12 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] Acquiring lock "18dcf77e-fac2-4b38-ad1c-1f52ce14704a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:09:27 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-ebc5a915-9c90-46de-994c-9d1c7e7c7e12 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] Lock "18dcf77e-fac2-4b38-ad1c-1f52ce14704a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:09:27 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-ebc5a915-9c90-46de-994c-9d1c7e7c7e12 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] Acquiring lock "18dcf77e-fac2-4b38-ad1c-1f52ce14704a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:09:27 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-ebc5a915-9c90-46de-994c-9d1c7e7c7e12 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] Lock "18dcf77e-fac2-4b38-ad1c-1f52ce14704a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:09:27 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-ebc5a915-9c90-46de-994c-9d1c7e7c7e12 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] Lock "18dcf77e-fac2-4b38-ad1c-1f52ce14704a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:09:27 user nova-compute[75165]: INFO nova.compute.manager [None req-ebc5a915-9c90-46de-994c-9d1c7e7c7e12 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] [instance: 18dcf77e-fac2-4b38-ad1c-1f52ce14704a] Terminating instance
Oct 26 00:09:27 user nova-compute[75165]: DEBUG nova.compute.manager [None req-ebc5a915-9c90-46de-994c-9d1c7e7c7e12 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] [instance: 18dcf77e-fac2-4b38-ad1c-1f52ce14704a] Start destroying the instance on the hypervisor. {{(pid=75165) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 00:09:27 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:09:27 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:09:27 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:09:27 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:09:27 user nova-compute[75165]: DEBUG nova.compute.manager [req-e990202d-920c-4af1-a895-9b89de8fcc65 req-c4be83df-126d-4a6f-bd1e-292980b99129 service nova] [instance: 18dcf77e-fac2-4b38-ad1c-1f52ce14704a] Received event network-vif-unplugged-7d1fdd51-5be0-40fd-bb7a-ef881af8f4f8 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:09:27 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-e990202d-920c-4af1-a895-9b89de8fcc65 req-c4be83df-126d-4a6f-bd1e-292980b99129 service nova] Acquiring lock "18dcf77e-fac2-4b38-ad1c-1f52ce14704a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:09:27 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-e990202d-920c-4af1-a895-9b89de8fcc65 req-c4be83df-126d-4a6f-bd1e-292980b99129 service nova] Lock "18dcf77e-fac2-4b38-ad1c-1f52ce14704a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:09:27 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-e990202d-920c-4af1-a895-9b89de8fcc65 req-c4be83df-126d-4a6f-bd1e-292980b99129 service nova] Lock "18dcf77e-fac2-4b38-ad1c-1f52ce14704a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:09:27 user nova-compute[75165]: DEBUG nova.compute.manager [req-e990202d-920c-4af1-a895-9b89de8fcc65 req-c4be83df-126d-4a6f-bd1e-292980b99129 service nova] [instance: 18dcf77e-fac2-4b38-ad1c-1f52ce14704a] No waiting events found dispatching network-vif-unplugged-7d1fdd51-5be0-40fd-bb7a-ef881af8f4f8 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:09:27 user nova-compute[75165]: DEBUG nova.compute.manager [req-e990202d-920c-4af1-a895-9b89de8fcc65 req-c4be83df-126d-4a6f-bd1e-292980b99129 service nova] [instance: 18dcf77e-fac2-4b38-ad1c-1f52ce14704a] Received event network-vif-unplugged-7d1fdd51-5be0-40fd-bb7a-ef881af8f4f8 for instance with task_state deleting. {{(pid=75165) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 00:09:28 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: 18dcf77e-fac2-4b38-ad1c-1f52ce14704a] Instance destroyed successfully.
Oct 26 00:09:28 user nova-compute[75165]: DEBUG nova.objects.instance [None req-ebc5a915-9c90-46de-994c-9d1c7e7c7e12 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] Lazy-loading 'resources' on Instance uuid 18dcf77e-fac2-4b38-ad1c-1f52ce14704a {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:09:28 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-ebc5a915-9c90-46de-994c-9d1c7e7c7e12 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:07:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-81328623',display_name='tempest-DeleteServersTestJSON-server-81328623',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-81328623',id=3,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-26T00:07:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dee554bb28784e6486c6c5fb2df68caf',ramdisk_id='',reservation_id='r-d0umixtb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-1293379709',owner_user_name='tempest-DeleteServersTestJSON-1293379709-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T00:07:27Z,user_data=None,user_id='ea4de283f02c40479a0bc185f9a06b8f',uuid=18dcf77e-fac2-4b38-ad1c-1f52ce14704a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7d1fdd51-5be0-40fd-bb7a-ef881af8f4f8", "address": "fa:16:3e:4f:f1:44", "network": {"id": "c4452fe5-2ef8-4c11-89ec-695fd0a8b67e", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-984180216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dee554bb28784e6486c6c5fb2df68caf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d1fdd51-5b", "ovs_interfaceid": "7d1fdd51-5be0-40fd-bb7a-ef881af8f4f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 00:09:28 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-ebc5a915-9c90-46de-994c-9d1c7e7c7e12 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] Converting VIF {"id": "7d1fdd51-5be0-40fd-bb7a-ef881af8f4f8", "address": "fa:16:3e:4f:f1:44", "network": {"id": "c4452fe5-2ef8-4c11-89ec-695fd0a8b67e", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-984180216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dee554bb28784e6486c6c5fb2df68caf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d1fdd51-5b", "ovs_interfaceid": "7d1fdd51-5be0-40fd-bb7a-ef881af8f4f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:09:28 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-ebc5a915-9c90-46de-994c-9d1c7e7c7e12 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:f1:44,bridge_name='br-int',has_traffic_filtering=True,id=7d1fdd51-5be0-40fd-bb7a-ef881af8f4f8,network=Network(c4452fe5-2ef8-4c11-89ec-695fd0a8b67e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d1fdd51-5b') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:09:28 user nova-compute[75165]: DEBUG os_vif [None req-ebc5a915-9c90-46de-994c-9d1c7e7c7e12 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:f1:44,bridge_name='br-int',has_traffic_filtering=True,id=7d1fdd51-5be0-40fd-bb7a-ef881af8f4f8,network=Network(c4452fe5-2ef8-4c11-89ec-695fd0a8b67e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d1fdd51-5b') {{(pid=75165) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 00:09:28 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:09:28 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7d1fdd51-5b, bridge=br-int, if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:09:28 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:09:28 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:09:28 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8db3adeb-1be4-4f9b-9bf2-b9b6bbd12160) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:09:28 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:09:28 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:09:28 user nova-compute[75165]: INFO os_vif [None req-ebc5a915-9c90-46de-994c-9d1c7e7c7e12 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:f1:44,bridge_name='br-int',has_traffic_filtering=True,id=7d1fdd51-5be0-40fd-bb7a-ef881af8f4f8,network=Network(c4452fe5-2ef8-4c11-89ec-695fd0a8b67e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d1fdd51-5b')
Oct 26 00:09:28 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ebc5a915-9c90-46de-994c-9d1c7e7c7e12 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] [instance: 18dcf77e-fac2-4b38-ad1c-1f52ce14704a] calling os-brick to detach iSCSI Volume {{(pid=75165) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 00:09:28 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebc5a915-9c90-46de-994c-9d1c7e7c7e12 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8bf8160e50>, {'target_iqn': 'iqn.2010-10.org.openstack:ae81775c-f527-4e0d-b5f8-f8369c037b62', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lWbEquoO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:09:28 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-ebc5a915-9c90-46de-994c-9d1c7e7c7e12 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:09:28 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-ebc5a915-9c90-46de-994c-9d1c7e7c7e12 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:09:28 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-ebc5a915-9c90-46de-994c-9d1c7e7c7e12 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:09:28 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:09:28 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:09:28 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[50453f7a-aa51-4194-9ce6-106ba8f24d2b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ae81775c-f527-4e0d-b5f8-f8369c037b62\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:09:28 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebc5a915-9c90-46de-994c-9d1c7e7c7e12 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 00:09:28 user nova-compute[75165]: No targets found.
Oct 26 00:09:28 user nova-compute[75165]: iSNS:
Oct 26 00:09:28 user nova-compute[75165]: No targets found.
Oct 26 00:09:28 user nova-compute[75165]: STATIC:
Oct 26 00:09:28 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:ae81775c-f527-4e0d-b5f8-f8369c037b62
Oct 26 00:09:28 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:09:28 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:09:28 user nova-compute[75165]: FIRMWARE:
Oct 26 00:09:28 user nova-compute[75165]: No targets found.
Oct 26 00:09:28 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:09:28 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebc5a915-9c90-46de-994c-9d1c7e7c7e12 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 00:09:28 user nova-compute[75165]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 00:09:28 user nova-compute[75165]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75165) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 00:09:28 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebc5a915-9c90-46de-994c-9d1c7e7c7e12 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ae81775c-f527-4e0d-b5f8-f8369c037b62', 0)] {{(pid=75165) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 00:09:28 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:09:28 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:09:28 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[955607df-7130-4796-976e-3c28a650ca2c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae81775c-f527-4e0d-b5f8-f8369c037b62\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:09:28 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:09:28 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:09:28 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d51e8ba-3d2c-4e8a-914f-c922c73cdb04]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae81775c-f527-4e0d-b5f8-f8369c037b62 (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:09:28 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebc5a915-9c90-46de-994c-9d1c7e7c7e12 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae81775c-f527-4e0d-b5f8-f8369c037b62 (non-flash)
Oct 26 00:09:28 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:09:28 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebc5a915-9c90-46de-994c-9d1c7e7c7e12 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae81775c-f527-4e0d-b5f8-f8369c037b62 (non-flash)
Oct 26 00:09:28 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:09:28 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebc5a915-9c90-46de-994c-9d1c7e7c7e12 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8bf82a00d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ae81775c-f527-4e0d-b5f8-f8369c037b62'): ({'sdb'}, set())}) {{(pid=75165) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 00:09:28 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-ebc5a915-9c90-46de-994c-9d1c7e7c7e12 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] Removing single pathed devices sdb {{(pid=75165) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 00:09:28 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:09:28 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:09:28 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc6ebfc6-86b4-4254-9d43-2f78e8c2bb87]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:09:28 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:09:28 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:09:28 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[92b923c3-d9b0-443a-b6ad-48f600b89435]: (4, ('ok\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:09:28 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-ebc5a915-9c90-46de-994c-9d1c7e7c7e12 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] Flushing IO for device /dev/sdb {{(pid=75165) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 00:09:28 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:09:28 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:09:28 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecdb7f8b-5213-466b-b4a3-13b7fce519bd]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:09:28 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-ebc5a915-9c90-46de-994c-9d1c7e7c7e12 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75165) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 00:09:28 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:09:28 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:09:28 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[c84952e0-7f07-4f42-949f-ead64dbf817d]: (4, ('1', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:09:28 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-ebc5a915-9c90-46de-994c-9d1c7e7c7e12 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75165) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 00:09:28 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-ebc5a915-9c90-46de-994c-9d1c7e7c7e12 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] SCSI volumes sdb have been removed. {{(pid=75165) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 00:09:28 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebc5a915-9c90-46de-994c-9d1c7e7c7e12 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ae81775c-f527-4e0d-b5f8-f8369c037b62')] {{(pid=75165) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 00:09:28 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae81775c-f527-4e0d-b5f8-f8369c037b62 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:09:28 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae81775c-f527-4e0d-b5f8-f8369c037b62 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:09:28 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[021f7e50-4f08-487d-8068-f5cb9e09c1e5]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:09:28 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebc5a915-9c90-46de-994c-9d1c7e7c7e12 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:09:28 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae81775c-f527-4e0d-b5f8-f8369c037b62 -p 172.16.0.220:3260 --logout {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:09:28 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae81775c-f527-4e0d-b5f8-f8369c037b62 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:09:28 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[77d7c917-7e21-4bad-b6e4-3528bf0feaa1]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:ae81775c-f527-4e0d-b5f8-f8369c037b62, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:ae81775c-f527-4e0d-b5f8-f8369c037b62, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:09:28 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebc5a915-9c90-46de-994c-9d1c7e7c7e12 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:ae81775c-f527-4e0d-b5f8-f8369c037b62, portal: 172.16.0.220,3260]
Oct 26 00:09:28 user nova-compute[75165]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:ae81775c-f527-4e0d-b5f8-f8369c037b62, portal: 172.16.0.220,3260] successful.
Oct 26 00:09:28 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:09:28 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae81775c-f527-4e0d-b5f8-f8369c037b62 -p 172.16.0.220:3260 --op delete {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:09:28 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae81775c-f527-4e0d-b5f8-f8369c037b62 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:09:28 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[c83c3140-37d0-49be-89f7-2908aa516f6d]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:09:28 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebc5a915-9c90-46de-994c-9d1c7e7c7e12 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:09:28 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-ebc5a915-9c90-46de-994c-9d1c7e7c7e12 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.281s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:09:28 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebc5a915-9c90-46de-994c-9d1c7e7c7e12 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] <== disconnect_volume: return (281ms) None {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:09:28 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ebc5a915-9c90-46de-994c-9d1c7e7c7e12 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] [instance: 18dcf77e-fac2-4b38-ad1c-1f52ce14704a] Disconnected iSCSI Volume {{(pid=75165) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 00:09:28 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-ebc5a915-9c90-46de-994c-9d1c7e7c7e12 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] [instance: 18dcf77e-fac2-4b38-ad1c-1f52ce14704a] Deleting instance files /opt/stack/data/nova/instances/18dcf77e-fac2-4b38-ad1c-1f52ce14704a_del
Oct 26 00:09:28 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-ebc5a915-9c90-46de-994c-9d1c7e7c7e12 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] [instance: 18dcf77e-fac2-4b38-ad1c-1f52ce14704a] Deletion of /opt/stack/data/nova/instances/18dcf77e-fac2-4b38-ad1c-1f52ce14704a_del complete
Oct 26 00:09:28 user nova-compute[75165]: INFO nova.compute.manager [None req-ebc5a915-9c90-46de-994c-9d1c7e7c7e12 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] [instance: 18dcf77e-fac2-4b38-ad1c-1f52ce14704a] Took 1.19 seconds to destroy the instance on the hypervisor.
Oct 26 00:09:28 user nova-compute[75165]: DEBUG oslo.service.loopingcall [None req-ebc5a915-9c90-46de-994c-9d1c7e7c7e12 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75165) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 00:09:28 user nova-compute[75165]: DEBUG nova.compute.manager [-] [instance: 18dcf77e-fac2-4b38-ad1c-1f52ce14704a] Deallocating network for instance {{(pid=75165) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 00:09:28 user nova-compute[75165]: DEBUG nova.network.neutron [-] [instance: 18dcf77e-fac2-4b38-ad1c-1f52ce14704a] deallocate_for_instance() {{(pid=75165) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 00:09:29 user nova-compute[75165]: DEBUG nova.network.neutron [-] [instance: 18dcf77e-fac2-4b38-ad1c-1f52ce14704a] Updating instance_info_cache with network_info: [] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:09:29 user nova-compute[75165]: INFO nova.compute.manager [-] [instance: 18dcf77e-fac2-4b38-ad1c-1f52ce14704a] Took 0.58 seconds to deallocate network for instance.
Oct 26 00:09:29 user nova-compute[75165]: DEBUG nova.compute.manager [req-9186e89c-16c0-4766-84d0-6b8945295693 req-fe3c7dbe-0e1a-47b7-b368-11f9c2acf7d8 service nova] [instance: 18dcf77e-fac2-4b38-ad1c-1f52ce14704a] Received event network-vif-deleted-7d1fdd51-5be0-40fd-bb7a-ef881af8f4f8 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:09:29 user nova-compute[75165]: INFO nova.compute.manager [req-9186e89c-16c0-4766-84d0-6b8945295693 req-fe3c7dbe-0e1a-47b7-b368-11f9c2acf7d8 service nova] [instance: 18dcf77e-fac2-4b38-ad1c-1f52ce14704a] Neutron deleted interface 7d1fdd51-5be0-40fd-bb7a-ef881af8f4f8; detaching it from the instance and deleting it from the info cache
Oct 26 00:09:29 user nova-compute[75165]: DEBUG nova.network.neutron [req-9186e89c-16c0-4766-84d0-6b8945295693 req-fe3c7dbe-0e1a-47b7-b368-11f9c2acf7d8 service nova] [instance: 18dcf77e-fac2-4b38-ad1c-1f52ce14704a] Updating instance_info_cache with network_info: [] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:09:29 user nova-compute[75165]: DEBUG nova.compute.manager [req-9186e89c-16c0-4766-84d0-6b8945295693 req-fe3c7dbe-0e1a-47b7-b368-11f9c2acf7d8 service nova] [instance: 18dcf77e-fac2-4b38-ad1c-1f52ce14704a] Detach interface failed, port_id=7d1fdd51-5be0-40fd-bb7a-ef881af8f4f8, reason: Instance 18dcf77e-fac2-4b38-ad1c-1f52ce14704a could not be found. {{(pid=75165) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 26 00:09:29 user nova-compute[75165]: DEBUG nova.compute.manager [req-5e8bd3a8-883d-4660-8bc7-a1ccabf7e0ad req-dce6aa99-b47c-4c8d-b0fe-b4b130955f7d service nova] [instance: 18dcf77e-fac2-4b38-ad1c-1f52ce14704a] Received event network-vif-plugged-7d1fdd51-5be0-40fd-bb7a-ef881af8f4f8 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:09:29 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-5e8bd3a8-883d-4660-8bc7-a1ccabf7e0ad req-dce6aa99-b47c-4c8d-b0fe-b4b130955f7d service nova] Acquiring lock "18dcf77e-fac2-4b38-ad1c-1f52ce14704a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:09:29 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-5e8bd3a8-883d-4660-8bc7-a1ccabf7e0ad req-dce6aa99-b47c-4c8d-b0fe-b4b130955f7d service nova] Lock "18dcf77e-fac2-4b38-ad1c-1f52ce14704a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:09:29 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-5e8bd3a8-883d-4660-8bc7-a1ccabf7e0ad req-dce6aa99-b47c-4c8d-b0fe-b4b130955f7d service nova] Lock "18dcf77e-fac2-4b38-ad1c-1f52ce14704a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:09:29 user nova-compute[75165]: DEBUG nova.compute.manager [req-5e8bd3a8-883d-4660-8bc7-a1ccabf7e0ad req-dce6aa99-b47c-4c8d-b0fe-b4b130955f7d service nova] [instance: 18dcf77e-fac2-4b38-ad1c-1f52ce14704a] No waiting events found dispatching network-vif-plugged-7d1fdd51-5be0-40fd-bb7a-ef881af8f4f8 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:09:29 user nova-compute[75165]: WARNING nova.compute.manager [req-5e8bd3a8-883d-4660-8bc7-a1ccabf7e0ad req-dce6aa99-b47c-4c8d-b0fe-b4b130955f7d service nova] [instance: 18dcf77e-fac2-4b38-ad1c-1f52ce14704a] Received unexpected event network-vif-plugged-7d1fdd51-5be0-40fd-bb7a-ef881af8f4f8 for instance with vm_state active and task_state deleting.
Oct 26 00:09:29 user nova-compute[75165]: INFO nova.compute.manager [None req-ebc5a915-9c90-46de-994c-9d1c7e7c7e12 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] [instance: 18dcf77e-fac2-4b38-ad1c-1f52ce14704a] Took 0.84 seconds to detach 1 volumes for instance.
Oct 26 00:09:30 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-ebc5a915-9c90-46de-994c-9d1c7e7c7e12 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:09:30 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-ebc5a915-9c90-46de-994c-9d1c7e7c7e12 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:09:30 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-ebc5a915-9c90-46de-994c-9d1c7e7c7e12 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:09:30 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-ebc5a915-9c90-46de-994c-9d1c7e7c7e12 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:09:30 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-ebc5a915-9c90-46de-994c-9d1c7e7c7e12 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.447s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:09:30 user nova-compute[75165]: INFO nova.scheduler.client.report [None req-ebc5a915-9c90-46de-994c-9d1c7e7c7e12 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] Deleted allocations for instance 18dcf77e-fac2-4b38-ad1c-1f52ce14704a
Oct 26 00:09:30 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:09:30 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-ebc5a915-9c90-46de-994c-9d1c7e7c7e12 tempest-DeleteServersTestJSON-1293379709 tempest-DeleteServersTestJSON-1293379709-project-member] Lock "18dcf77e-fac2-4b38-ad1c-1f52ce14704a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.278s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:09:33 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:09:33 user nova-compute[75165]: INFO nova.virt.block_device [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Booting with volume ff01f329-6dda-43b6-8da5-6a5c48fad211 at /dev/vdc
Oct 26 00:09:33 user nova-compute[75165]: DEBUG os_brick.utils [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:09:33 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:09:33 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:09:33 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cac793d-5ec6-46a3-9622-731d04f3f361]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa94814ccb35\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:09:33 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:09:33 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:09:33 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2649895-b72f-4406-9066-7b4715371c82]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:09:33 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:09:33 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:09:33 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[97714f9b-7add-4539-b9df-c886ff8c1a40]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:09:33 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d4a0944-35b6-4b0d-be08-26bf4e885cfd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:09:33 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Running cmd (subprocess): nvme version {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:09:34 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] 'nvme version' failed. Not Retrying. {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 00:09:34 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] nvme not present on system {{(pid=75165) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 00:09:34 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:09:34 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 00:09:34 user nova-compute[75165]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 00:09:34 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bb00dc3-1e97-497e-9601-d5b7c74f2b94]: (4, '') {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:09:34 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75165) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 00:09:34 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75165) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 00:09:34 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] LIGHTOS: no hostnqn found. {{(pid=75165) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 00:09:34 user nova-compute[75165]: DEBUG os_brick.utils [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa94814ccb35', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:09:34 user nova-compute[75165]: DEBUG nova.virt.block_device [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Updating existing volume attachment record: c35c6ee0-8c7a-4257-966c-591173394c4e {{(pid=75165) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 00:09:35 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:09:36 user nova-compute[75165]: DEBUG nova.compute.manager [req-926cf6f7-9d1a-44e4-9e47-1ec13e5bc436 req-b464b98d-e933-40f0-bef3-53d803e5ba90 service nova] [instance: f326db85-74f6-4e60-9c55-46b2a59502d0] Received event network-changed-26b16dce-35d4-4756-8eea-c3638f5b6c16 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:09:36 user nova-compute[75165]: DEBUG nova.compute.manager [req-926cf6f7-9d1a-44e4-9e47-1ec13e5bc436 req-b464b98d-e933-40f0-bef3-53d803e5ba90 service nova] [instance: f326db85-74f6-4e60-9c55-46b2a59502d0] Refreshing instance network info cache due to event network-changed-26b16dce-35d4-4756-8eea-c3638f5b6c16. {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 00:09:36 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-926cf6f7-9d1a-44e4-9e47-1ec13e5bc436 req-b464b98d-e933-40f0-bef3-53d803e5ba90 service nova] Acquiring lock "refresh_cache-f326db85-74f6-4e60-9c55-46b2a59502d0" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:09:36 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-926cf6f7-9d1a-44e4-9e47-1ec13e5bc436 req-b464b98d-e933-40f0-bef3-53d803e5ba90 service nova] Acquired lock "refresh_cache-f326db85-74f6-4e60-9c55-46b2a59502d0" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:09:36 user nova-compute[75165]: DEBUG nova.network.neutron [req-926cf6f7-9d1a-44e4-9e47-1ec13e5bc436 req-b464b98d-e933-40f0-bef3-53d803e5ba90 service nova] [instance: f326db85-74f6-4e60-9c55-46b2a59502d0] Refreshing network info cache for port 26b16dce-35d4-4756-8eea-c3638f5b6c16 {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 00:09:36 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-1cd5fd77-0e1b-4f30-a883-ced281608666 tempest-VolumesAssistedSnapshotsTest-2020880117 tempest-VolumesAssistedSnapshotsTest-2020880117-project-admin] Acquiring lock "f326db85-74f6-4e60-9c55-46b2a59502d0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:09:36 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-1cd5fd77-0e1b-4f30-a883-ced281608666 tempest-VolumesAssistedSnapshotsTest-2020880117 tempest-VolumesAssistedSnapshotsTest-2020880117-project-admin] Lock "f326db85-74f6-4e60-9c55-46b2a59502d0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:09:36 user nova-compute[75165]: DEBUG nova.objects.instance [None req-1cd5fd77-0e1b-4f30-a883-ced281608666 tempest-VolumesAssistedSnapshotsTest-2020880117 tempest-VolumesAssistedSnapshotsTest-2020880117-project-admin] Lazy-loading 'flavor' on Instance uuid f326db85-74f6-4e60-9c55-46b2a59502d0 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:09:36 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-1cd5fd77-0e1b-4f30-a883-ced281608666 tempest-VolumesAssistedSnapshotsTest-2020880117 tempest-VolumesAssistedSnapshotsTest-2020880117-project-admin] Lock "f326db85-74f6-4e60-9c55-46b2a59502d0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.089s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:09:36 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-1cd5fd77-0e1b-4f30-a883-ced281608666 tempest-VolumesAssistedSnapshotsTest-2020880117 tempest-VolumesAssistedSnapshotsTest-2020880117-project-admin] Acquiring lock "f326db85-74f6-4e60-9c55-46b2a59502d0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:09:36 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-1cd5fd77-0e1b-4f30-a883-ced281608666 tempest-VolumesAssistedSnapshotsTest-2020880117 tempest-VolumesAssistedSnapshotsTest-2020880117-project-admin] Lock "f326db85-74f6-4e60-9c55-46b2a59502d0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:09:36 user nova-compute[75165]: INFO nova.compute.manager [None req-1cd5fd77-0e1b-4f30-a883-ced281608666 tempest-VolumesAssistedSnapshotsTest-2020880117 tempest-VolumesAssistedSnapshotsTest-2020880117-project-admin] [instance: f326db85-74f6-4e60-9c55-46b2a59502d0] Attaching volume 014b6b5a-24b7-4afd-9fc3-50645f10fcd4 to /dev/vdb
Oct 26 00:09:36 user nova-compute[75165]: DEBUG os_brick.utils [None req-1cd5fd77-0e1b-4f30-a883-ced281608666 tempest-VolumesAssistedSnapshotsTest-2020880117 tempest-VolumesAssistedSnapshotsTest-2020880117-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:09:36 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:09:36 user nova-compute[75165]: DEBUG nova.network.neutron [req-926cf6f7-9d1a-44e4-9e47-1ec13e5bc436 req-b464b98d-e933-40f0-bef3-53d803e5ba90 service nova] [instance: f326db85-74f6-4e60-9c55-46b2a59502d0] Updated VIF entry in instance network info cache for port 26b16dce-35d4-4756-8eea-c3638f5b6c16. {{(pid=75165) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 00:09:36 user nova-compute[75165]: DEBUG nova.network.neutron [req-926cf6f7-9d1a-44e4-9e47-1ec13e5bc436 req-b464b98d-e933-40f0-bef3-53d803e5ba90 service nova] [instance: f326db85-74f6-4e60-9c55-46b2a59502d0] Updating instance_info_cache with network_info: [{"id": "26b16dce-35d4-4756-8eea-c3638f5b6c16", "address": "fa:16:3e:03:0d:40", "network": {"id": "2391bc4b-c0f5-4644-94d8-37a74146506d", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2088537358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc4d929d240d4d4d93d5926abe61df9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26b16dce-35", "ovs_interfaceid": "26b16dce-35d4-4756-8eea-c3638f5b6c16", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:09:36 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:09:36 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[22e85dbf-4ba0-4eba-842a-219ae8d488ba]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa94814ccb35\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:09:36 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:09:36 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-926cf6f7-9d1a-44e4-9e47-1ec13e5bc436 req-b464b98d-e933-40f0-bef3-53d803e5ba90 service nova] Releasing lock "refresh_cache-f326db85-74f6-4e60-9c55-46b2a59502d0" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:09:36 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:09:36 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dc4c3bf-ad0c-430d-bafc-cb663ceb9cfb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:09:36 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:09:36 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:09:36 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e35694f-c0ec-4fcc-9b4c-2cf76b00c330]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:09:36 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8570abe-00e5-4fcf-8219-07f980504d0e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:09:36 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-1cd5fd77-0e1b-4f30-a883-ced281608666 tempest-VolumesAssistedSnapshotsTest-2020880117 tempest-VolumesAssistedSnapshotsTest-2020880117-project-admin] Running cmd (subprocess): nvme version {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:09:36 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-1cd5fd77-0e1b-4f30-a883-ced281608666 tempest-VolumesAssistedSnapshotsTest-2020880117 tempest-VolumesAssistedSnapshotsTest-2020880117-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 00:09:36 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1cd5fd77-0e1b-4f30-a883-ced281608666 tempest-VolumesAssistedSnapshotsTest-2020880117 tempest-VolumesAssistedSnapshotsTest-2020880117-project-admin] nvme not present on system {{(pid=75165) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 00:09:36 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:09:36 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 00:09:36 user nova-compute[75165]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 00:09:36 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[97896d79-7d41-48b2-a502-bdbd26148a41]: (4, '') {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:09:36 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-1cd5fd77-0e1b-4f30-a883-ced281608666 tempest-VolumesAssistedSnapshotsTest-2020880117 tempest-VolumesAssistedSnapshotsTest-2020880117-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75165) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 00:09:36 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-1cd5fd77-0e1b-4f30-a883-ced281608666 tempest-VolumesAssistedSnapshotsTest-2020880117 tempest-VolumesAssistedSnapshotsTest-2020880117-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75165) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 00:09:36 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-1cd5fd77-0e1b-4f30-a883-ced281608666 tempest-VolumesAssistedSnapshotsTest-2020880117 tempest-VolumesAssistedSnapshotsTest-2020880117-project-admin] LIGHTOS: no hostnqn found. {{(pid=75165) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 00:09:36 user nova-compute[75165]: DEBUG os_brick.utils [None req-1cd5fd77-0e1b-4f30-a883-ced281608666 tempest-VolumesAssistedSnapshotsTest-2020880117 tempest-VolumesAssistedSnapshotsTest-2020880117-project-admin] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa94814ccb35', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:09:36 user nova-compute[75165]: DEBUG nova.virt.block_device [None req-1cd5fd77-0e1b-4f30-a883-ced281608666 tempest-VolumesAssistedSnapshotsTest-2020880117 tempest-VolumesAssistedSnapshotsTest-2020880117-project-admin] [instance: f326db85-74f6-4e60-9c55-46b2a59502d0] Updating existing volume attachment record: 0dd3bf72-bfdf-4826-a959-7966be06ca29 {{(pid=75165) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 00:09:38 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:09:39 user nova-compute[75165]: DEBUG nova.compute.manager [req-2cd9e1fb-f743-4092-b0bd-23854a3d72da req-2e940658-0d85-4c93-8342-eba76ac04d31 service nova] [instance: 45625147-ff69-496a-a41e-e55f818a020a] Received event network-changed-7fb6b434-f67e-4199-90c4-fa1fad18e7d3 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:09:39 user nova-compute[75165]: DEBUG nova.compute.manager [req-2cd9e1fb-f743-4092-b0bd-23854a3d72da req-2e940658-0d85-4c93-8342-eba76ac04d31 service nova] [instance: 45625147-ff69-496a-a41e-e55f818a020a] Refreshing instance network info cache due to event network-changed-7fb6b434-f67e-4199-90c4-fa1fad18e7d3. {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 00:09:39 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-2cd9e1fb-f743-4092-b0bd-23854a3d72da req-2e940658-0d85-4c93-8342-eba76ac04d31 service nova] Acquiring lock "refresh_cache-45625147-ff69-496a-a41e-e55f818a020a" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:09:39 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-2cd9e1fb-f743-4092-b0bd-23854a3d72da req-2e940658-0d85-4c93-8342-eba76ac04d31 service nova] Acquired lock "refresh_cache-45625147-ff69-496a-a41e-e55f818a020a" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:09:39 user nova-compute[75165]: DEBUG nova.network.neutron [req-2cd9e1fb-f743-4092-b0bd-23854a3d72da req-2e940658-0d85-4c93-8342-eba76ac04d31 service nova] [instance: 45625147-ff69-496a-a41e-e55f818a020a] Refreshing network info cache for port 7fb6b434-f67e-4199-90c4-fa1fad18e7d3 {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 00:09:39 user nova-compute[75165]: DEBUG nova.network.neutron [req-2cd9e1fb-f743-4092-b0bd-23854a3d72da req-2e940658-0d85-4c93-8342-eba76ac04d31 service nova] [instance: 45625147-ff69-496a-a41e-e55f818a020a] Updated VIF entry in instance network info cache for port 7fb6b434-f67e-4199-90c4-fa1fad18e7d3. {{(pid=75165) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 00:09:39 user nova-compute[75165]: DEBUG nova.network.neutron [req-2cd9e1fb-f743-4092-b0bd-23854a3d72da req-2e940658-0d85-4c93-8342-eba76ac04d31 service nova] [instance: 45625147-ff69-496a-a41e-e55f818a020a] Updating instance_info_cache with network_info: [{"id": "7fb6b434-f67e-4199-90c4-fa1fad18e7d3", "address": "fa:16:3e:1f:92:cd", "network": {"id": "54cfbfa8-e5be-4d9e-88fd-c086a6f8c834", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2062887918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc552db87c094e77aee0361963486d93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fb6b434-f6", "ovs_interfaceid": "7fb6b434-f67e-4199-90c4-fa1fad18e7d3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:09:39 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-2cd9e1fb-f743-4092-b0bd-23854a3d72da req-2e940658-0d85-4c93-8342-eba76ac04d31 service nova] Releasing lock "refresh_cache-45625147-ff69-496a-a41e-e55f818a020a" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:09:40 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:09:42 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e23ca2c9-99a1-4b46-a878-dc2a0fc428a2 tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] [instance: f465963f-1d0f-4ca3-a8b8-681566b7d40a] Calling os-brick to attach iSCSI Volume {{(pid=75165) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 00:09:42 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e23ca2c9-99a1-4b46-a878-dc2a0fc428a2 tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8bf8160e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b9d317ae-7dfa-4b25-9e3a-faa7ad5fed86', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wRVAMIZr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:09:42 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-e23ca2c9-99a1-4b46-a878-dc2a0fc428a2 tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:09:42 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-e23ca2c9-99a1-4b46-a878-dc2a0fc428a2 tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:09:42 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-e23ca2c9-99a1-4b46-a878-dc2a0fc428a2 tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:09:42 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-e23ca2c9-99a1-4b46-a878-dc2a0fc428a2 tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:09:42 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-e23ca2c9-99a1-4b46-a878-dc2a0fc428a2 tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b9d317ae-7dfa-4b25-9e3a-faa7ad5fed86" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:09:42 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-e23ca2c9-99a1-4b46-a878-dc2a0fc428a2 tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b9d317ae-7dfa-4b25-9e3a-faa7ad5fed86" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:09:42 user nova-compute[75165]: INFO os_brick.initiator.connectors.iscsi [None req-e23ca2c9-99a1-4b46-a878-dc2a0fc428a2 tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 00:09:42 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9d317ae-7dfa-4b25-9e3a-faa7ad5fed86 -p 172.16.0.220:3260 {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:09:42 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9d317ae-7dfa-4b25-9e3a-faa7ad5fed86 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:09:42 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[32939c1a-c2a6-4f09-9841-2cfe3810c8a4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:09:42 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e23ca2c9-99a1-4b46-a878-dc2a0fc428a2 tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 00:09:42 user nova-compute[75165]:  {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:09:42 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9d317ae-7dfa-4b25-9e3a-faa7ad5fed86 -p 172.16.0.220:3260 --interface default --op new {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:09:42 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9d317ae-7dfa-4b25-9e3a-faa7ad5fed86 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:09:42 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[c215de08-fa00-4511-b077-42152ae0a43f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b9d317ae-7dfa-4b25-9e3a-faa7ad5fed86] added\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:09:42 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e23ca2c9-99a1-4b46-a878-dc2a0fc428a2 tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b9d317ae-7dfa-4b25-9e3a-faa7ad5fed86] added
Oct 26 00:09:42 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:09:42 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9d317ae-7dfa-4b25-9e3a-faa7ad5fed86 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:09:42 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9d317ae-7dfa-4b25-9e3a-faa7ad5fed86 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:09:42 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1bf5417-9f51-4c64-a29c-ddb1909e9312]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:09:42 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e23ca2c9-99a1-4b46-a878-dc2a0fc428a2 tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:09:42 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9d317ae-7dfa-4b25-9e3a-faa7ad5fed86 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:09:42 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9d317ae-7dfa-4b25-9e3a-faa7ad5fed86 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:09:42 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[852182c3-d80f-4356-81ae-dd3acdc14ea5]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:09:42 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e23ca2c9-99a1-4b46-a878-dc2a0fc428a2 tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:09:42 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9d317ae-7dfa-4b25-9e3a-faa7ad5fed86 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wRVAMIZr {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:09:42 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9d317ae-7dfa-4b25-9e3a-faa7ad5fed86 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wRVAMIZr" returned: 0 in 0.018s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:09:42 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c07608f-3fc8-4549-94df-46090026d954]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:09:42 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e23ca2c9-99a1-4b46-a878-dc2a0fc428a2 tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wRVAMIZr'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:09:42 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9d317ae-7dfa-4b25-9e3a-faa7ad5fed86 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:09:42 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9d317ae-7dfa-4b25-9e3a-faa7ad5fed86 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:09:42 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ce0a801-648d-46e6-8124-505c917736a0]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:09:42 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e23ca2c9-99a1-4b46-a878-dc2a0fc428a2 tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:09:42 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:09:42 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-a4892d96-d229-4a21-851b-b4d9594b940d tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] Acquiring lock "45625147-ff69-496a-a41e-e55f818a020a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:09:42 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-a4892d96-d229-4a21-851b-b4d9594b940d tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] Lock "45625147-ff69-496a-a41e-e55f818a020a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:09:42 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:09:42 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[86db0296-3945-47ad-a358-19c718f3334d]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:09:42 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e23ca2c9-99a1-4b46-a878-dc2a0fc428a2 tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 26 00:09:42 user nova-compute[75165]:  {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:09:42 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e23ca2c9-99a1-4b46-a878-dc2a0fc428a2 tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 26 00:09:42 user nova-compute[75165]:  {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:09:42 user nova-compute[75165]: WARNING os_brick.initiator.connectors.iscsi [None req-e23ca2c9-99a1-4b46-a878-dc2a0fc428a2 tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 26 00:09:42 user nova-compute[75165]: 
Oct 26 00:09:42 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9d317ae-7dfa-4b25-9e3a-faa7ad5fed86 -p 172.16.0.220:3260 --login {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:09:42 user nova-compute[75165]: DEBUG nova.objects.instance [None req-a4892d96-d229-4a21-851b-b4d9594b940d tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] Lazy-loading 'flavor' on Instance uuid 45625147-ff69-496a-a41e-e55f818a020a {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:09:42 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-a4892d96-d229-4a21-851b-b4d9594b940d tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] Lock "45625147-ff69-496a-a41e-e55f818a020a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:09:42 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9d317ae-7dfa-4b25-9e3a-faa7ad5fed86 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:09:42 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[299fb4e8-55d5-4d2c-94ec-84b43a2b38ee]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b9d317ae-7dfa-4b25-9e3a-faa7ad5fed86, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b9d317ae-7dfa-4b25-9e3a-faa7ad5fed86, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:09:42 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e23ca2c9-99a1-4b46-a878-dc2a0fc428a2 tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b9d317ae-7dfa-4b25-9e3a-faa7ad5fed86, portal: 172.16.0.220,3260]
Oct 26 00:09:42 user nova-compute[75165]: Login to [iface: default, target: iqn.2010-10.org.openstack:b9d317ae-7dfa-4b25-9e3a-faa7ad5fed86, portal: 172.16.0.220,3260] successful.
Oct 26 00:09:42 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:09:42 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9d317ae-7dfa-4b25-9e3a-faa7ad5fed86 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:09:42 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9d317ae-7dfa-4b25-9e3a-faa7ad5fed86 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:09:42 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[19ac5f12-550e-455e-9dc6-4d7bda778f3e]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:09:42 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e23ca2c9-99a1-4b46-a878-dc2a0fc428a2 tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:09:42 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:09:42 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:09:42 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[1db17448-bcdf-4a69-83cf-d69025ad3218]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9d317ae-7dfa-4b25-9e3a-faa7ad5fed86 (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:09:42 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e23ca2c9-99a1-4b46-a878-dc2a0fc428a2 tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9d317ae-7dfa-4b25-9e3a-faa7ad5fed86 (non-flash)
Oct 26 00:09:42 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:09:42 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e23ca2c9-99a1-4b46-a878-dc2a0fc428a2 tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9d317ae-7dfa-4b25-9e3a-faa7ad5fed86 (non-flash)
Oct 26 00:09:42 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:09:42 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-e23ca2c9-99a1-4b46-a878-dc2a0fc428a2 tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b9d317ae-7dfa-4b25-9e3a-faa7ad5fed86" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.256s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:09:42 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e23ca2c9-99a1-4b46-a878-dc2a0fc428a2 tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] Connected to 172.16.0.220:3260 {{(pid=75165) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 00:09:42 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-e23ca2c9-99a1-4b46-a878-dc2a0fc428a2 tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] HCTL ('33', '-', '-', 0) found on session 3 with lun 0 {{(pid=75165) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 00:09:42 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-e23ca2c9-99a1-4b46-a878-dc2a0fc428a2 tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75165) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 00:09:42 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:09:42 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:09:42 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ea18331-b5be-4acc-a40c-4405868e3e87]: (4, ('- - 0', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:09:42 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-e23ca2c9-99a1-4b46-a878-dc2a0fc428a2 tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] Searching for a device in session 3 and hctl ['33', '*', '*', 0] yield: None {{(pid=75165) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 00:09:42 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-a4892d96-d229-4a21-851b-b4d9594b940d tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] Acquiring lock "45625147-ff69-496a-a41e-e55f818a020a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:09:42 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-a4892d96-d229-4a21-851b-b4d9594b940d tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] Lock "45625147-ff69-496a-a41e-e55f818a020a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:09:42 user nova-compute[75165]: INFO nova.compute.manager [None req-a4892d96-d229-4a21-851b-b4d9594b940d tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] [instance: 45625147-ff69-496a-a41e-e55f818a020a] Attaching volume 45f3fb95-eff9-4a9a-a50b-cdbfee3840d8 to /dev/vdb
Oct 26 00:09:42 user nova-compute[75165]: DEBUG os_brick.utils [None req-a4892d96-d229-4a21-851b-b4d9594b940d tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:09:42 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:09:42 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:09:42 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[c09abacf-0cfb-401d-a68a-9c1dd168a70a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa94814ccb35\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:09:42 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:09:42 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:09:42 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[8268d378-f4c5-4a05-ab06-d3e0d6292537]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:09:42 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:09:42 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:09:42 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff0153df-f5b6-4cad-b7b8-17d0c1857e89]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:09:42 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[34a57d70-e043-4208-9a31-9f352ffc8bf7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:09:42 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-a4892d96-d229-4a21-851b-b4d9594b940d tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] Running cmd (subprocess): nvme version {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:09:42 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-a4892d96-d229-4a21-851b-b4d9594b940d tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] 'nvme version' failed. Not Retrying. {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 00:09:42 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a4892d96-d229-4a21-851b-b4d9594b940d tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] nvme not present on system {{(pid=75165) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 00:09:42 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:09:42 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 00:09:42 user nova-compute[75165]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 00:09:42 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[252ee640-05a9-470f-8b16-14f007a29186]: (4, '') {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:09:42 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-a4892d96-d229-4a21-851b-b4d9594b940d tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75165) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 00:09:42 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-a4892d96-d229-4a21-851b-b4d9594b940d tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75165) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 00:09:42 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-a4892d96-d229-4a21-851b-b4d9594b940d tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] LIGHTOS: no hostnqn found. {{(pid=75165) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 00:09:42 user nova-compute[75165]: DEBUG os_brick.utils [None req-a4892d96-d229-4a21-851b-b4d9594b940d tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] <== get_connector_properties: return (109ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa94814ccb35', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:09:42 user nova-compute[75165]: DEBUG nova.virt.block_device [None req-a4892d96-d229-4a21-851b-b4d9594b940d tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] [instance: 45625147-ff69-496a-a41e-e55f818a020a] Updating existing volume attachment record: 0682b3dc-3884-4609-bc44-317a1a6802f1 {{(pid=75165) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 00:09:43 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:09:43 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-e23ca2c9-99a1-4b46-a878-dc2a0fc428a2 tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] Searching for a device in session 3 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75165) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 00:09:43 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e23ca2c9-99a1-4b46-a878-dc2a0fc428a2 tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:b9d317ae-7dfa-4b25-9e3a-faa7ad5fed86', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wRVAMIZr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75165) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 00:09:43 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-e23ca2c9-99a1-4b46-a878-dc2a0fc428a2 tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.288s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:09:43 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e23ca2c9-99a1-4b46-a878-dc2a0fc428a2 tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] <== connect_volume: return (1290ms) {'type': 'block', 'scsi_wwn': '23962646431356131', 'path': '/dev/sdb'} {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:09:43 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e23ca2c9-99a1-4b46-a878-dc2a0fc428a2 tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] [instance: f465963f-1d0f-4ca3-a8b8-681566b7d40a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23962646431356131', 'path': '/dev/sdb'} {{(pid=75165) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 00:09:43 user nova-compute[75165]: DEBUG nova.objects.instance [None req-e23ca2c9-99a1-4b46-a878-dc2a0fc428a2 tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] Lazy-loading 'flavor' on Instance uuid f465963f-1d0f-4ca3-a8b8-681566b7d40a {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:09:43 user nova-compute[75165]: DEBUG nova.virt.libvirt.guest [None req-e23ca2c9-99a1-4b46-a878-dc2a0fc428a2 tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 00:09:43 user nova-compute[75165]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 00:09:43 user nova-compute[75165]:   <source dev="/dev/sdb"/>
Oct 26 00:09:43 user nova-compute[75165]:   <target dev="sdc" bus="scsi"/>
Oct 26 00:09:43 user nova-compute[75165]:   <serial>b9d317ae-7dfa-4b25-9e3a-faa7ad5fed86</serial>
Oct 26 00:09:43 user nova-compute[75165]:   <address type="drive" controller="0" unit="2"/>
Oct 26 00:09:43 user nova-compute[75165]: </disk>
Oct 26 00:09:43 user nova-compute[75165]:  {{(pid=75165) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 00:09:44 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-e23ca2c9-99a1-4b46-a878-dc2a0fc428a2 tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] No BDM found with device name sda, not building metadata. {{(pid=75165) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 00:09:44 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-e23ca2c9-99a1-4b46-a878-dc2a0fc428a2 tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75165) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 00:09:44 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-e23ca2c9-99a1-4b46-a878-dc2a0fc428a2 tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] No BDM found with device name sdc, not building metadata. {{(pid=75165) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 00:09:44 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-e23ca2c9-99a1-4b46-a878-dc2a0fc428a2 tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] No VIF found with MAC fa:16:3e:67:95:5b, not building metadata {{(pid=75165) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 00:09:45 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:09:48 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:09:50 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:09:52 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-e23ca2c9-99a1-4b46-a878-dc2a0fc428a2 tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] Lock "f465963f-1d0f-4ca3-a8b8-681566b7d40a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 28.665s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:09:53 user nova-compute[75165]: DEBUG nova.compute.manager [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Start spawning the instance on the hypervisor. {{(pid=75165) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 00:09:53 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Creating instance directory {{(pid=75165) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 00:09:53 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Creating image(s)
Oct 26 00:09:53 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Did not create local disks {{(pid=75165) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 26 00:09:53 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Ensure instance console log exists: /opt/stack/data/nova/instances/8d5569ce-1f18-4f37-a340-099ee152d548/console.log {{(pid=75165) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 00:09:53 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:09:53 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:09:53 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:09:53 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Start _get_guest_xml network_info=[{"id": "3da752ae-77a3-4bc3-8885-76331bc2d7d8", "address": "fa:16:3e:22:af:b4", "network": {"id": "a4a95519-4969-4c53-b078-46dab1ae12ac", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1704712535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f1d0ea8cbf74f10b81a10d3a7a6e716", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3da752ae-77", "ovs_interfaceid": "3da752ae-77a3-4bc3-8885-76331bc2d7d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b9583014-bb07-4337-97bb-30001c05475f", "address": "fa:16:3e:ca:f8:4e", "network": {"id": "b1b273e9-ac47-4985-9a15-ed6392eea58c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1944708022", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9f1d0ea8cbf74f10b81a10d3a7a6e716", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9583014-bb", "ovs_interfaceid": "b9583014-bb07-4337-97bb-30001c05475f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c51f288f-44b9-476b-9419-22ef8ae5c900", "address": "fa:16:3e:28:cd:e8", "network": {"id": "b1b273e9-ac47-4985-9a15-ed6392eea58c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1944708022", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.239", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9f1d0ea8cbf74f10b81a10d3a7a6e716", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc51f288f-44", "ovs_interfaceid": "c51f288f-44b9-476b-9419-22ef8ae5c900", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c019e949-c6fc-4014-9e42-13ce1eb17786", "address": "fa:16:3e:34:fd:75", "network": {"id": "b1b273e9-ac47-4985-9a15-ed6392eea58c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1944708022", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.220", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9f1d0ea8cbf74f10b81a10d3a7a6e716", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc019e949-c6", "ovs_interfaceid": "c019e949-c6fc-4014-9e42-13ce1eb17786", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9cecd3d6-4945-4a4b-8d06-48b0d7768a17", "address": "fa:16:3e:59:c6:53", "network": {"id": "b1b273e9-ac47-4985-9a15-ed6392eea58c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1944708022", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9f1d0ea8cbf74f10b81a10d3a7a6e716", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cecd3d6-49", "ovs_interfaceid": "9cecd3d6-4945-4a4b-8d06-48b0d7768a17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a04b8134-03e6-45f2-b6d7-3ea6a7deb81c", "address": "fa:16:3e:0a:29:45", "network": {"id": "75761f5b-dd19-4843-8db7-9cef3872583d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1377439333", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9f1d0ea8cbf74f10b81a10d3a7a6e716", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa04b8134-03", "ovs_interfaceid": "a04b8134-03e6-45f2-b6d7-3ea6a7deb81c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "03ee4dbc-d46d-4127-a4e0-d308a1c8beae", "address": "fa:16:3e:5b:46:e6", "network": {"id": "75761f5b-dd19-4843-8db7-9cef3872583d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1377439333", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9f1d0ea8cbf74f10b81a10d3a7a6e716", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03ee4dbc-d4", "ovs_interfaceid": "03ee4dbc-d46d-4127-a4e0-d308a1c8beae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T00:03:24Z,direct_url=<?>,disk_format='qcow2',id=bff0d8a1-739e-4c4d-9efa-b73ba7b76d01,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e56bbf444fd34c348475c73673611447',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T00:03:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f25f6e6a-9711-4455-82e8-c56648a08508', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PNkbihUC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8d5569ce-1f18-4f37-a340-099ee152d548', 'attached_at': '', 'detached_at': '', 'volume_id': 'f25f6e6a-9711-4455-82e8-c56648a08508', 'serial': 'f25f6e6a-9711-4455-82e8-c56648a08508'}, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'attachment_id': 'd9736521-41cd-447d-8939-f3e62769f162', 'delete_on_termination': False, 'volume_type': None}, {'device_type': 'disk', 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:083f264a-3f29-48b4-9935-a73f4234e6d5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LApzvBig', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8d5569ce-1f18-4f37-a340-099ee152d548', 'attached_at': '', 'detached_at': '', 'volume_id': '083f264a-3f29-48b4-9935-a73f4234e6d5', 'serial': '083f264a-3f29-48b4-9935-a73f4234e6d5'}, 'guest_format': None, 'boot_index': 1, 'disk_bus': 'virtio', 'attachment_id': '5f9beaa8-adc4-4d99-8828-6c0783191a71', 'delete_on_termination': False, 'volume_type': None}, {'device_type': 'disk', 'mount_device': '/dev/vdc', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ff01f329-6dda-43b6-8da5-6a5c48fad211', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IfQbdwhn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8d5569ce-1f18-4f37-a340-099ee152d548', 'attached_at': '', 'detached_at': '', 'volume_id': 'ff01f329-6dda-43b6-8da5-6a5c48fad211', 'serial': 'ff01f329-6dda-43b6-8da5-6a5c48fad211'}, 'guest_format': None, 'boot_index': 2, 'disk_bus': 'virtio', 'attachment_id': 'c35c6ee0-8c7a-4257-966c-591173394c4e', 'delete_on_termination': False, 'volume_type': None} {{(pid=75165) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 00:09:53 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:09:53 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:09:53 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75165) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 00:09:53 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] CPU controller missing on host. {{(pid=75165) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 00:09:53 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75165) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 00:09:53 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] CPU controller found on host. {{(pid=75165) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 00:09:53 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75165) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 00:09:53 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T00:03:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T00:03:24Z,direct_url=<?>,disk_format='qcow2',id=bff0d8a1-739e-4c4d-9efa-b73ba7b76d01,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e56bbf444fd34c348475c73673611447',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T00:03:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 00:09:53 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Flavor limits 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 00:09:53 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Image limits 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 00:09:53 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Flavor pref 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 00:09:53 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Image pref 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 00:09:53 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 00:09:53 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 00:09:53 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75165) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 00:09:53 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Got 1 possible topologies {{(pid=75165) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 00:09:53 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 00:09:53 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 00:09:53 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Calling os-brick to attach iSCSI Volume {{(pid=75165) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 00:09:53 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8bf8160e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f25f6e6a-9711-4455-82e8-c56648a08508', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PNkbihUC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:09:53 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:09:53 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:09:53 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:09:53 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:09:53 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f25f6e6a-9711-4455-82e8-c56648a08508" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:09:53 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f25f6e6a-9711-4455-82e8-c56648a08508" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:09:53 user nova-compute[75165]: INFO os_brick.initiator.connectors.iscsi [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 00:09:53 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f25f6e6a-9711-4455-82e8-c56648a08508 -p 172.16.0.220:3260 {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:09:53 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f25f6e6a-9711-4455-82e8-c56648a08508 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:09:53 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[a892c566-c422-423f-84f5-f5dd77a24ac3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:09:53 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 00:09:53 user nova-compute[75165]:  {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:09:53 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f25f6e6a-9711-4455-82e8-c56648a08508 -p 172.16.0.220:3260 --interface default --op new {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:09:53 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f25f6e6a-9711-4455-82e8-c56648a08508 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:09:53 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c1096f7-2b1e-4de0-834d-fc0a7884362d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f25f6e6a-9711-4455-82e8-c56648a08508] added\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:09:53 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f25f6e6a-9711-4455-82e8-c56648a08508] added
Oct 26 00:09:53 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:09:53 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f25f6e6a-9711-4455-82e8-c56648a08508 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:09:53 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f25f6e6a-9711-4455-82e8-c56648a08508 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:09:53 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[199a5d0c-967c-4685-a9b1-74b529b7f059]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:09:53 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:09:53 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f25f6e6a-9711-4455-82e8-c56648a08508 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:09:53 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:09:53 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f25f6e6a-9711-4455-82e8-c56648a08508 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:09:53 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb570113-0ab6-4f8c-8147-aac05c4f5de8]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:09:53 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:09:53 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f25f6e6a-9711-4455-82e8-c56648a08508 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PNkbihUC {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:09:53 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f25f6e6a-9711-4455-82e8-c56648a08508 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PNkbihUC" returned: 0 in 0.017s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:09:53 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd7ddc74-8571-4bb9-ac03-474224ed7c57]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:09:53 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PNkbihUC'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:09:53 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f25f6e6a-9711-4455-82e8-c56648a08508 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:09:53 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f25f6e6a-9711-4455-82e8-c56648a08508 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:09:53 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[2733e60a-564f-40d0-b7b8-5e35519ad146]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:09:53 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:09:53 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:09:53 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:09:53 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[138f1fd7-c5a9-4d47-8644-1e257cd36805]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9d317ae-7dfa-4b25-9e3a-faa7ad5fed86 (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:09:53 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9d317ae-7dfa-4b25-9e3a-faa7ad5fed86 (non-flash)
Oct 26 00:09:53 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:09:53 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9d317ae-7dfa-4b25-9e3a-faa7ad5fed86 (non-flash)
Oct 26 00:09:53 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:09:53 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f25f6e6a-9711-4455-82e8-c56648a08508 -p 172.16.0.220:3260 --login {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:09:53 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f25f6e6a-9711-4455-82e8-c56648a08508 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:09:53 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cb0ffbb-3123-4289-b88c-c7abe2783774]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f25f6e6a-9711-4455-82e8-c56648a08508, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f25f6e6a-9711-4455-82e8-c56648a08508, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:09:53 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f25f6e6a-9711-4455-82e8-c56648a08508, portal: 172.16.0.220,3260]
Oct 26 00:09:53 user nova-compute[75165]: Login to [iface: default, target: iqn.2010-10.org.openstack:f25f6e6a-9711-4455-82e8-c56648a08508, portal: 172.16.0.220,3260] successful.
Oct 26 00:09:53 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:09:53 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f25f6e6a-9711-4455-82e8-c56648a08508 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:09:53 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f25f6e6a-9711-4455-82e8-c56648a08508 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.016s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:09:53 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[337bd0f9-bc2c-482a-a37b-5d6560a67316]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:09:53 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:09:53 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:09:53 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:09:53 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[60389bd1-3bd5-4f66-94b9-0bd794dabb16]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9d317ae-7dfa-4b25-9e3a-faa7ad5fed86 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f25f6e6a-9711-4455-82e8-c56648a08508 (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:09:53 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9d317ae-7dfa-4b25-9e3a-faa7ad5fed86 (non-flash)
Oct 26 00:09:53 user nova-compute[75165]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f25f6e6a-9711-4455-82e8-c56648a08508 (non-flash)
Oct 26 00:09:53 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:09:53 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9d317ae-7dfa-4b25-9e3a-faa7ad5fed86 (non-flash)
Oct 26 00:09:53 user nova-compute[75165]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f25f6e6a-9711-4455-82e8-c56648a08508 (non-flash)
Oct 26 00:09:53 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:09:53 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f25f6e6a-9711-4455-82e8-c56648a08508" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.249s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:09:53 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Connected to 172.16.0.220:3260 {{(pid=75165) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 00:09:53 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] HCTL ('34', '-', '-', 0) found on session 4 with lun 0 {{(pid=75165) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 00:09:53 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75165) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 00:09:53 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:09:53 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:09:53 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[93c48f97-8d23-4a47-a405-604d6679744a]: (4, ('- - 0', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:09:53 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Searching for a device in session 4 and hctl ['34', '*', '*', 0] yield: None {{(pid=75165) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 00:09:54 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-2518f958-008c-49dc-9f57-215a3de59c11 tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] Acquiring lock "f465963f-1d0f-4ca3-a8b8-681566b7d40a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:09:54 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-2518f958-008c-49dc-9f57-215a3de59c11 tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] Lock "f465963f-1d0f-4ca3-a8b8-681566b7d40a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:09:54 user nova-compute[75165]: INFO nova.compute.manager [None req-2518f958-008c-49dc-9f57-215a3de59c11 tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] [instance: f465963f-1d0f-4ca3-a8b8-681566b7d40a] Detaching volume b9d317ae-7dfa-4b25-9e3a-faa7ad5fed86
Oct 26 00:09:54 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Searching for a device in session 4 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75165) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 00:09:54 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:f25f6e6a-9711-4455-82e8-c56648a08508', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PNkbihUC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75165) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 00:09:54 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.277s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:09:54 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] <== connect_volume: return (1278ms) {'type': 'block', 'scsi_wwn': '26630633466613131', 'path': '/dev/sdc'} {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:09:54 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26630633466613131', 'path': '/dev/sdc'} {{(pid=75165) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 00:09:54 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Calling os-brick to attach iSCSI Volume {{(pid=75165) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 00:09:54 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8bf8160e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:083f264a-3f29-48b4-9935-a73f4234e6d5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LApzvBig', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:09:54 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:09:54 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:09:54 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:09:54 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:09:54 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:083f264a-3f29-48b4-9935-a73f4234e6d5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:09:54 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:083f264a-3f29-48b4-9935-a73f4234e6d5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:09:54 user nova-compute[75165]: INFO os_brick.initiator.connectors.iscsi [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 00:09:54 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:083f264a-3f29-48b4-9935-a73f4234e6d5 -p 172.16.0.220:3260 {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:09:54 user nova-compute[75165]: INFO nova.virt.block_device [None req-2518f958-008c-49dc-9f57-215a3de59c11 tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] [instance: f465963f-1d0f-4ca3-a8b8-681566b7d40a] Attempting to driver detach volume b9d317ae-7dfa-4b25-9e3a-faa7ad5fed86 from mountpoint /dev/sdc
Oct 26 00:09:54 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-2518f958-008c-49dc-9f57-215a3de59c11 tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] Attempting to detach device sdc from instance f465963f-1d0f-4ca3-a8b8-681566b7d40a from the persistent domain config. {{(pid=75165) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 00:09:54 user nova-compute[75165]: DEBUG nova.virt.libvirt.guest [None req-2518f958-008c-49dc-9f57-215a3de59c11 tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 00:09:54 user nova-compute[75165]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 00:09:54 user nova-compute[75165]:   <source dev="/dev/sdb"/>
Oct 26 00:09:54 user nova-compute[75165]:   <target dev="sdc" bus="scsi"/>
Oct 26 00:09:54 user nova-compute[75165]:   <serial>b9d317ae-7dfa-4b25-9e3a-faa7ad5fed86</serial>
Oct 26 00:09:54 user nova-compute[75165]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Oct 26 00:09:54 user nova-compute[75165]: </disk>
Oct 26 00:09:54 user nova-compute[75165]:  {{(pid=75165) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 00:09:54 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:083f264a-3f29-48b4-9935-a73f4234e6d5 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:09:54 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[34026ca2-95d9-4b9d-b3c0-395f6873ea82]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:09:54 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 00:09:54 user nova-compute[75165]:  {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:09:54 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:083f264a-3f29-48b4-9935-a73f4234e6d5 -p 172.16.0.220:3260 --interface default --op new {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:09:54 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-2518f958-008c-49dc-9f57-215a3de59c11 tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] Successfully detached device sdc from instance f465963f-1d0f-4ca3-a8b8-681566b7d40a from the persistent domain config.
Oct 26 00:09:54 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-2518f958-008c-49dc-9f57-215a3de59c11 tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance f465963f-1d0f-4ca3-a8b8-681566b7d40a from the live domain config. {{(pid=75165) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 00:09:54 user nova-compute[75165]: DEBUG nova.virt.libvirt.guest [None req-2518f958-008c-49dc-9f57-215a3de59c11 tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 00:09:54 user nova-compute[75165]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 00:09:54 user nova-compute[75165]:   <source dev="/dev/sdb"/>
Oct 26 00:09:54 user nova-compute[75165]:   <target dev="sdc" bus="scsi"/>
Oct 26 00:09:54 user nova-compute[75165]:   <serial>b9d317ae-7dfa-4b25-9e3a-faa7ad5fed86</serial>
Oct 26 00:09:54 user nova-compute[75165]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Oct 26 00:09:54 user nova-compute[75165]: </disk>
Oct 26 00:09:54 user nova-compute[75165]:  {{(pid=75165) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 00:09:54 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:083f264a-3f29-48b4-9935-a73f4234e6d5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:09:54 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3c2c622-4eaa-4a37-af37-b70e45ae6579]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:083f264a-3f29-48b4-9935-a73f4234e6d5] added\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:09:54 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:083f264a-3f29-48b4-9935-a73f4234e6d5] added
Oct 26 00:09:54 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:09:54 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:083f264a-3f29-48b4-9935-a73f4234e6d5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:09:54 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:083f264a-3f29-48b4-9935-a73f4234e6d5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:09:54 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3950b86-27f7-462c-b66d-9af90fdad29e]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:09:54 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:09:54 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:083f264a-3f29-48b4-9935-a73f4234e6d5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:09:54 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:083f264a-3f29-48b4-9935-a73f4234e6d5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:09:54 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[95f711fa-6ea2-4328-90c0-ecb57b21acc5]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:09:54 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:09:54 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:083f264a-3f29-48b4-9935-a73f4234e6d5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LApzvBig {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:09:54 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:083f264a-3f29-48b4-9935-a73f4234e6d5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LApzvBig" returned: 0 in 0.018s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:09:54 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[2efe1b5c-f5d9-4141-a58a-912851caedad]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:09:54 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LApzvBig'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:09:54 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:083f264a-3f29-48b4-9935-a73f4234e6d5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:09:54 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:083f264a-3f29-48b4-9935-a73f4234e6d5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:09:54 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[b840a11f-38e5-4689-98bf-54dfbdc2aee2]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:09:54 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:09:54 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:09:54 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:09:54 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[825a0813-9119-4dcd-854c-cf342d5237b6]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9d317ae-7dfa-4b25-9e3a-faa7ad5fed86 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f25f6e6a-9711-4455-82e8-c56648a08508 (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:09:54 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9d317ae-7dfa-4b25-9e3a-faa7ad5fed86 (non-flash)
Oct 26 00:09:54 user nova-compute[75165]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f25f6e6a-9711-4455-82e8-c56648a08508 (non-flash)
Oct 26 00:09:54 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:09:54 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9d317ae-7dfa-4b25-9e3a-faa7ad5fed86 (non-flash)
Oct 26 00:09:54 user nova-compute[75165]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f25f6e6a-9711-4455-82e8-c56648a08508 (non-flash)
Oct 26 00:09:54 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:09:54 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:083f264a-3f29-48b4-9935-a73f4234e6d5 -p 172.16.0.220:3260 --login {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:09:54 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:083f264a-3f29-48b4-9935-a73f4234e6d5 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:09:54 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe8fdd3d-55b5-425b-bee3-dc200f83d077]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:083f264a-3f29-48b4-9935-a73f4234e6d5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:083f264a-3f29-48b4-9935-a73f4234e6d5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:09:54 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:083f264a-3f29-48b4-9935-a73f4234e6d5, portal: 172.16.0.220,3260]
Oct 26 00:09:54 user nova-compute[75165]: Login to [iface: default, target: iqn.2010-10.org.openstack:083f264a-3f29-48b4-9935-a73f4234e6d5, portal: 172.16.0.220,3260] successful.
Oct 26 00:09:54 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:09:54 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:083f264a-3f29-48b4-9935-a73f4234e6d5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:09:54 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:083f264a-3f29-48b4-9935-a73f4234e6d5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:09:54 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae540e4d-5d56-4b65-bed5-bc7fa8f3e289]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:09:54 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:09:54 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:09:54 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:09:54 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e79fd6c-05f6-4346-95ba-626d62c6ecbe]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9d317ae-7dfa-4b25-9e3a-faa7ad5fed86 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f25f6e6a-9711-4455-82e8-c56648a08508 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:083f264a-3f29-48b4-9935-a73f4234e6d5 (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:09:54 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9d317ae-7dfa-4b25-9e3a-faa7ad5fed86 (non-flash)
Oct 26 00:09:54 user nova-compute[75165]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f25f6e6a-9711-4455-82e8-c56648a08508 (non-flash)
Oct 26 00:09:54 user nova-compute[75165]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:083f264a-3f29-48b4-9935-a73f4234e6d5 (non-flash)
Oct 26 00:09:54 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:09:54 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9d317ae-7dfa-4b25-9e3a-faa7ad5fed86 (non-flash)
Oct 26 00:09:54 user nova-compute[75165]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f25f6e6a-9711-4455-82e8-c56648a08508 (non-flash)
Oct 26 00:09:54 user nova-compute[75165]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:083f264a-3f29-48b4-9935-a73f4234e6d5 (non-flash)
Oct 26 00:09:54 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:09:54 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:083f264a-3f29-48b4-9935-a73f4234e6d5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.265s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:09:54 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Connected to 172.16.0.220:3260 {{(pid=75165) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 00:09:54 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] HCTL ('35', '-', '-', 0) found on session 5 with lun 0 {{(pid=75165) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 00:09:54 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75165) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 00:09:54 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:09:54 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:09:54 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3ea7c75-abe8-4666-b809-b8ec1baf1aeb]: (4, ('- - 0', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:09:54 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Searching for a device in session 5 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75165) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 00:09:54 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:083f264a-3f29-48b4-9935-a73f4234e6d5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LApzvBig', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75165) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 00:09:54 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-2518f958-008c-49dc-9f57-215a3de59c11 tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance f465963f-1d0f-4ca3-a8b8-681566b7d40a {{(pid=75165) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 00:09:55 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1cd5fd77-0e1b-4f30-a883-ced281608666 tempest-VolumesAssistedSnapshotsTest-2020880117 tempest-VolumesAssistedSnapshotsTest-2020880117-project-admin] [instance: f326db85-74f6-4e60-9c55-46b2a59502d0] Calling os-brick to attach iSCSI Volume {{(pid=75165) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 00:09:55 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cd5fd77-0e1b-4f30-a883-ced281608666 tempest-VolumesAssistedSnapshotsTest-2020880117 tempest-VolumesAssistedSnapshotsTest-2020880117-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8bf8160e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:014b6b5a-24b7-4afd-9fc3-50645f10fcd4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eCZNxjgk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:09:55 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-1cd5fd77-0e1b-4f30-a883-ced281608666 tempest-VolumesAssistedSnapshotsTest-2020880117 tempest-VolumesAssistedSnapshotsTest-2020880117-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:09:55 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-1cd5fd77-0e1b-4f30-a883-ced281608666 tempest-VolumesAssistedSnapshotsTest-2020880117 tempest-VolumesAssistedSnapshotsTest-2020880117-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:09:55 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:09:55 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.296s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:09:55 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] <== connect_volume: return (1298ms) {'type': 'block', 'scsi_wwn': '23136336138306265', 'path': '/dev/sdd'} {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:09:55 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23136336138306265', 'path': '/dev/sdd'} {{(pid=75165) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 00:09:55 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-1cd5fd77-0e1b-4f30-a883-ced281608666 tempest-VolumesAssistedSnapshotsTest-2020880117 tempest-VolumesAssistedSnapshotsTest-2020880117-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.293s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:09:55 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-1cd5fd77-0e1b-4f30-a883-ced281608666 tempest-VolumesAssistedSnapshotsTest-2020880117 tempest-VolumesAssistedSnapshotsTest-2020880117-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:09:55 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-1cd5fd77-0e1b-4f30-a883-ced281608666 tempest-VolumesAssistedSnapshotsTest-2020880117 tempest-VolumesAssistedSnapshotsTest-2020880117-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:014b6b5a-24b7-4afd-9fc3-50645f10fcd4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:09:55 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-1cd5fd77-0e1b-4f30-a883-ced281608666 tempest-VolumesAssistedSnapshotsTest-2020880117 tempest-VolumesAssistedSnapshotsTest-2020880117-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:014b6b5a-24b7-4afd-9fc3-50645f10fcd4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:09:55 user nova-compute[75165]: INFO os_brick.initiator.connectors.iscsi [None req-1cd5fd77-0e1b-4f30-a883-ced281608666 tempest-VolumesAssistedSnapshotsTest-2020880117 tempest-VolumesAssistedSnapshotsTest-2020880117-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 00:09:55 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:014b6b5a-24b7-4afd-9fc3-50645f10fcd4 -p 172.16.0.220:3260 {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:09:55 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:014b6b5a-24b7-4afd-9fc3-50645f10fcd4 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:09:55 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f2c8313-aa5b-4e32-8e71-0f005775dd2d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:09:55 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cd5fd77-0e1b-4f30-a883-ced281608666 tempest-VolumesAssistedSnapshotsTest-2020880117 tempest-VolumesAssistedSnapshotsTest-2020880117-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 00:09:55 user nova-compute[75165]:  {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:09:55 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:014b6b5a-24b7-4afd-9fc3-50645f10fcd4 -p 172.16.0.220:3260 --interface default --op new {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:09:55 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Calling os-brick to attach iSCSI Volume {{(pid=75165) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 00:09:55 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8bf8160e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ff01f329-6dda-43b6-8da5-6a5c48fad211', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IfQbdwhn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:09:55 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:09:55 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:09:55 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:014b6b5a-24b7-4afd-9fc3-50645f10fcd4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:09:55 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[713bdd94-5672-4a6c-8e23-4b34d8fb57c2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:014b6b5a-24b7-4afd-9fc3-50645f10fcd4] added\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:09:55 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cd5fd77-0e1b-4f30-a883-ced281608666 tempest-VolumesAssistedSnapshotsTest-2020880117 tempest-VolumesAssistedSnapshotsTest-2020880117-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:014b6b5a-24b7-4afd-9fc3-50645f10fcd4] added
Oct 26 00:09:55 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:09:55 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:014b6b5a-24b7-4afd-9fc3-50645f10fcd4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:09:55 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:014b6b5a-24b7-4afd-9fc3-50645f10fcd4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:09:55 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[a763916c-283f-420e-b3b6-ae4529caedc7]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:09:55 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cd5fd77-0e1b-4f30-a883-ced281608666 tempest-VolumesAssistedSnapshotsTest-2020880117 tempest-VolumesAssistedSnapshotsTest-2020880117-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:09:55 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:014b6b5a-24b7-4afd-9fc3-50645f10fcd4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:09:55 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:014b6b5a-24b7-4afd-9fc3-50645f10fcd4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:09:55 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[e98033cf-1b63-41da-b722-e95f6ef4e3ae]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:09:55 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cd5fd77-0e1b-4f30-a883-ced281608666 tempest-VolumesAssistedSnapshotsTest-2020880117 tempest-VolumesAssistedSnapshotsTest-2020880117-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:09:55 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:014b6b5a-24b7-4afd-9fc3-50645f10fcd4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eCZNxjgk {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:09:55 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:014b6b5a-24b7-4afd-9fc3-50645f10fcd4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eCZNxjgk" returned: 0 in 0.020s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:09:55 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4ed11ea-80ce-4a16-91ee-06f6d03084e2]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:09:55 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cd5fd77-0e1b-4f30-a883-ced281608666 tempest-VolumesAssistedSnapshotsTest-2020880117 tempest-VolumesAssistedSnapshotsTest-2020880117-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eCZNxjgk'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:09:55 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:014b6b5a-24b7-4afd-9fc3-50645f10fcd4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:09:55 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:014b6b5a-24b7-4afd-9fc3-50645f10fcd4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:09:55 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[28910ee6-1281-4cad-8290-09418b3a281c]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:09:55 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cd5fd77-0e1b-4f30-a883-ced281608666 tempest-VolumesAssistedSnapshotsTest-2020880117 tempest-VolumesAssistedSnapshotsTest-2020880117-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:09:55 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:09:55 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:09:55 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb9e9311-69bc-4891-b479-fe52ec36db1b]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9d317ae-7dfa-4b25-9e3a-faa7ad5fed86 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f25f6e6a-9711-4455-82e8-c56648a08508 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:083f264a-3f29-48b4-9935-a73f4234e6d5 (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:09:55 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cd5fd77-0e1b-4f30-a883-ced281608666 tempest-VolumesAssistedSnapshotsTest-2020880117 tempest-VolumesAssistedSnapshotsTest-2020880117-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9d317ae-7dfa-4b25-9e3a-faa7ad5fed86 (non-flash)
Oct 26 00:09:55 user nova-compute[75165]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f25f6e6a-9711-4455-82e8-c56648a08508 (non-flash)
Oct 26 00:09:55 user nova-compute[75165]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:083f264a-3f29-48b4-9935-a73f4234e6d5 (non-flash)
Oct 26 00:09:55 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:09:55 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cd5fd77-0e1b-4f30-a883-ced281608666 tempest-VolumesAssistedSnapshotsTest-2020880117 tempest-VolumesAssistedSnapshotsTest-2020880117-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9d317ae-7dfa-4b25-9e3a-faa7ad5fed86 (non-flash)
Oct 26 00:09:55 user nova-compute[75165]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f25f6e6a-9711-4455-82e8-c56648a08508 (non-flash)
Oct 26 00:09:55 user nova-compute[75165]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:083f264a-3f29-48b4-9935-a73f4234e6d5 (non-flash)
Oct 26 00:09:55 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:09:55 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:014b6b5a-24b7-4afd-9fc3-50645f10fcd4 -p 172.16.0.220:3260 --login {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:09:55 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:014b6b5a-24b7-4afd-9fc3-50645f10fcd4 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:09:55 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[97d5e93e-bf44-49a0-93ce-a540d9bca39f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:014b6b5a-24b7-4afd-9fc3-50645f10fcd4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:014b6b5a-24b7-4afd-9fc3-50645f10fcd4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:09:55 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cd5fd77-0e1b-4f30-a883-ced281608666 tempest-VolumesAssistedSnapshotsTest-2020880117 tempest-VolumesAssistedSnapshotsTest-2020880117-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:014b6b5a-24b7-4afd-9fc3-50645f10fcd4, portal: 172.16.0.220,3260]
Oct 26 00:09:55 user nova-compute[75165]: Login to [iface: default, target: iqn.2010-10.org.openstack:014b6b5a-24b7-4afd-9fc3-50645f10fcd4, portal: 172.16.0.220,3260] successful.
Oct 26 00:09:55 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:09:55 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:014b6b5a-24b7-4afd-9fc3-50645f10fcd4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:09:55 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:014b6b5a-24b7-4afd-9fc3-50645f10fcd4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:09:55 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[564a6087-0b3e-4686-b4af-5783ef032e12]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:09:55 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cd5fd77-0e1b-4f30-a883-ced281608666 tempest-VolumesAssistedSnapshotsTest-2020880117 tempest-VolumesAssistedSnapshotsTest-2020880117-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:09:55 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:09:55 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:09:55 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dbd7d77-bfce-48e2-bf39-df504e0f4ab7]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9d317ae-7dfa-4b25-9e3a-faa7ad5fed86 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f25f6e6a-9711-4455-82e8-c56648a08508 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:083f264a-3f29-48b4-9935-a73f4234e6d5 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:014b6b5a-24b7-4afd-9fc3-50645f10fcd4 (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:09:55 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cd5fd77-0e1b-4f30-a883-ced281608666 tempest-VolumesAssistedSnapshotsTest-2020880117 tempest-VolumesAssistedSnapshotsTest-2020880117-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9d317ae-7dfa-4b25-9e3a-faa7ad5fed86 (non-flash)
Oct 26 00:09:55 user nova-compute[75165]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f25f6e6a-9711-4455-82e8-c56648a08508 (non-flash)
Oct 26 00:09:55 user nova-compute[75165]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:083f264a-3f29-48b4-9935-a73f4234e6d5 (non-flash)
Oct 26 00:09:55 user nova-compute[75165]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:014b6b5a-24b7-4afd-9fc3-50645f10fcd4 (non-flash)
Oct 26 00:09:55 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:09:55 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cd5fd77-0e1b-4f30-a883-ced281608666 tempest-VolumesAssistedSnapshotsTest-2020880117 tempest-VolumesAssistedSnapshotsTest-2020880117-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9d317ae-7dfa-4b25-9e3a-faa7ad5fed86 (non-flash)
Oct 26 00:09:55 user nova-compute[75165]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f25f6e6a-9711-4455-82e8-c56648a08508 (non-flash)
Oct 26 00:09:55 user nova-compute[75165]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:083f264a-3f29-48b4-9935-a73f4234e6d5 (non-flash)
Oct 26 00:09:55 user nova-compute[75165]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:014b6b5a-24b7-4afd-9fc3-50645f10fcd4 (non-flash)
Oct 26 00:09:55 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:09:55 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-1cd5fd77-0e1b-4f30-a883-ced281608666 tempest-VolumesAssistedSnapshotsTest-2020880117 tempest-VolumesAssistedSnapshotsTest-2020880117-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:014b6b5a-24b7-4afd-9fc3-50645f10fcd4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:09:55 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cd5fd77-0e1b-4f30-a883-ced281608666 tempest-VolumesAssistedSnapshotsTest-2020880117 tempest-VolumesAssistedSnapshotsTest-2020880117-project-admin] Connected to 172.16.0.220:3260 {{(pid=75165) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 00:09:55 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-1cd5fd77-0e1b-4f30-a883-ced281608666 tempest-VolumesAssistedSnapshotsTest-2020880117 tempest-VolumesAssistedSnapshotsTest-2020880117-project-admin] HCTL ('36', '-', '-', 0) found on session 6 with lun 0 {{(pid=75165) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 00:09:55 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-1cd5fd77-0e1b-4f30-a883-ced281608666 tempest-VolumesAssistedSnapshotsTest-2020880117 tempest-VolumesAssistedSnapshotsTest-2020880117-project-admin] Scanning host 36 c: -, t: -, l: 0) {{(pid=75165) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 00:09:55 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:09:55 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:09:55 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[873218c5-8088-446d-9c9a-4f2959b434aa]: (4, ('- - 0', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:09:55 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-1cd5fd77-0e1b-4f30-a883-ced281608666 tempest-VolumesAssistedSnapshotsTest-2020880117 tempest-VolumesAssistedSnapshotsTest-2020880117-project-admin] Searching for a device in session 6 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75165) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 00:09:55 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cd5fd77-0e1b-4f30-a883-ced281608666 tempest-VolumesAssistedSnapshotsTest-2020880117 tempest-VolumesAssistedSnapshotsTest-2020880117-project-admin] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:014b6b5a-24b7-4afd-9fc3-50645f10fcd4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eCZNxjgk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75165) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 00:09:56 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-1cd5fd77-0e1b-4f30-a883-ced281608666 tempest-VolumesAssistedSnapshotsTest-2020880117 tempest-VolumesAssistedSnapshotsTest-2020880117-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.311s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:09:56 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cd5fd77-0e1b-4f30-a883-ced281608666 tempest-VolumesAssistedSnapshotsTest-2020880117 tempest-VolumesAssistedSnapshotsTest-2020880117-project-admin] <== connect_volume: return (1604ms) {'type': 'block', 'scsi_wwn': '26639393736316533', 'path': '/dev/sde'} {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:09:56 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1cd5fd77-0e1b-4f30-a883-ced281608666 tempest-VolumesAssistedSnapshotsTest-2020880117 tempest-VolumesAssistedSnapshotsTest-2020880117-project-admin] [instance: f326db85-74f6-4e60-9c55-46b2a59502d0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26639393736316533', 'path': '/dev/sde'} {{(pid=75165) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 00:09:56 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.273s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:09:56 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:09:56 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ff01f329-6dda-43b6-8da5-6a5c48fad211" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:09:56 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ff01f329-6dda-43b6-8da5-6a5c48fad211" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:09:56 user nova-compute[75165]: INFO os_brick.initiator.connectors.iscsi [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 00:09:56 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff01f329-6dda-43b6-8da5-6a5c48fad211 -p 172.16.0.220:3260 {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:09:56 user nova-compute[75165]: DEBUG nova.objects.instance [None req-1cd5fd77-0e1b-4f30-a883-ced281608666 tempest-VolumesAssistedSnapshotsTest-2020880117 tempest-VolumesAssistedSnapshotsTest-2020880117-project-admin] Lazy-loading 'flavor' on Instance uuid f326db85-74f6-4e60-9c55-46b2a59502d0 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:09:57 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff01f329-6dda-43b6-8da5-6a5c48fad211 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:09:57 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7f421cc-2832-468b-b9ae-cb1a34544be5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:09:57 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 00:09:57 user nova-compute[75165]:  {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:09:57 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff01f329-6dda-43b6-8da5-6a5c48fad211 -p 172.16.0.220:3260 --interface default --op new {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:09:57 user nova-compute[75165]: DEBUG nova.virt.libvirt.guest [None req-1cd5fd77-0e1b-4f30-a883-ced281608666 tempest-VolumesAssistedSnapshotsTest-2020880117 tempest-VolumesAssistedSnapshotsTest-2020880117-project-admin] attach device xml: <disk type="block" device="disk">
Oct 26 00:09:57 user nova-compute[75165]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 00:09:57 user nova-compute[75165]:   <source dev="/dev/sde"/>
Oct 26 00:09:57 user nova-compute[75165]:   <target dev="vdb" bus="virtio"/>
Oct 26 00:09:57 user nova-compute[75165]:   <serial>014b6b5a-24b7-4afd-9fc3-50645f10fcd4</serial>
Oct 26 00:09:57 user nova-compute[75165]: </disk>
Oct 26 00:09:57 user nova-compute[75165]:  {{(pid=75165) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 00:09:57 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff01f329-6dda-43b6-8da5-6a5c48fad211 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:09:57 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aee7fd6-43a5-4b1a-96ed-bbf3ffe47dd8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ff01f329-6dda-43b6-8da5-6a5c48fad211] added\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:09:57 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ff01f329-6dda-43b6-8da5-6a5c48fad211] added
Oct 26 00:09:57 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:09:57 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff01f329-6dda-43b6-8da5-6a5c48fad211 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:09:57 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff01f329-6dda-43b6-8da5-6a5c48fad211 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:09:57 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce240019-0482-4924-be7c-7bcec25c12fa]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:09:57 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:09:57 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff01f329-6dda-43b6-8da5-6a5c48fad211 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:09:57 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff01f329-6dda-43b6-8da5-6a5c48fad211 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:09:57 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a7f67c5-00e3-4f97-b938-afb7292a8b39]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:09:57 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:09:57 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff01f329-6dda-43b6-8da5-6a5c48fad211 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IfQbdwhn {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:09:57 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff01f329-6dda-43b6-8da5-6a5c48fad211 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IfQbdwhn" returned: 0 in 0.017s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:09:57 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a43f0b7-63ef-438a-b3b6-9c6cdfa3519f]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:09:57 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IfQbdwhn'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:09:57 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff01f329-6dda-43b6-8da5-6a5c48fad211 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:09:57 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff01f329-6dda-43b6-8da5-6a5c48fad211 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:09:57 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[f12ccd23-5055-4e91-8ac4-efe93300c9ab]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:09:57 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:09:57 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:09:57 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:09:57 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[e58cf8d8-ba30-4a79-a101-08a405ff7a72]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9d317ae-7dfa-4b25-9e3a-faa7ad5fed86 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f25f6e6a-9711-4455-82e8-c56648a08508 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:083f264a-3f29-48b4-9935-a73f4234e6d5 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:014b6b5a-24b7-4afd-9fc3-50645f10fcd4 (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:09:57 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9d317ae-7dfa-4b25-9e3a-faa7ad5fed86 (non-flash)
Oct 26 00:09:57 user nova-compute[75165]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f25f6e6a-9711-4455-82e8-c56648a08508 (non-flash)
Oct 26 00:09:57 user nova-compute[75165]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:083f264a-3f29-48b4-9935-a73f4234e6d5 (non-flash)
Oct 26 00:09:57 user nova-compute[75165]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:014b6b5a-24b7-4afd-9fc3-50645f10fcd4 (non-flash)
Oct 26 00:09:57 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:09:57 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9d317ae-7dfa-4b25-9e3a-faa7ad5fed86 (non-flash)
Oct 26 00:09:57 user nova-compute[75165]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f25f6e6a-9711-4455-82e8-c56648a08508 (non-flash)
Oct 26 00:09:57 user nova-compute[75165]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:083f264a-3f29-48b4-9935-a73f4234e6d5 (non-flash)
Oct 26 00:09:57 user nova-compute[75165]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:014b6b5a-24b7-4afd-9fc3-50645f10fcd4 (non-flash)
Oct 26 00:09:57 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:09:57 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff01f329-6dda-43b6-8da5-6a5c48fad211 -p 172.16.0.220:3260 --login {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:09:57 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff01f329-6dda-43b6-8da5-6a5c48fad211 -p 172.16.0.220:3260 --login" returned: 0 in 0.085s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:09:57 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a07228a-5786-4a84-8792-b0c54213780b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ff01f329-6dda-43b6-8da5-6a5c48fad211, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ff01f329-6dda-43b6-8da5-6a5c48fad211, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:09:57 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ff01f329-6dda-43b6-8da5-6a5c48fad211, portal: 172.16.0.220,3260]
Oct 26 00:09:57 user nova-compute[75165]: Login to [iface: default, target: iqn.2010-10.org.openstack:ff01f329-6dda-43b6-8da5-6a5c48fad211, portal: 172.16.0.220,3260] successful.
Oct 26 00:09:57 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:09:57 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff01f329-6dda-43b6-8da5-6a5c48fad211 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:09:57 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff01f329-6dda-43b6-8da5-6a5c48fad211 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:09:57 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[82557a18-df07-4058-a807-c256846d9fa0]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:09:57 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:09:57 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:09:57 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:09:57 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[2db10bd8-1a8d-4df9-ab9a-1899768fcb43]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9d317ae-7dfa-4b25-9e3a-faa7ad5fed86 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f25f6e6a-9711-4455-82e8-c56648a08508 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:083f264a-3f29-48b4-9935-a73f4234e6d5 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:014b6b5a-24b7-4afd-9fc3-50645f10fcd4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff01f329-6dda-43b6-8da5-6a5c48fad211 (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:09:57 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9d317ae-7dfa-4b25-9e3a-faa7ad5fed86 (non-flash)
Oct 26 00:09:57 user nova-compute[75165]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f25f6e6a-9711-4455-82e8-c56648a08508 (non-flash)
Oct 26 00:09:57 user nova-compute[75165]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:083f264a-3f29-48b4-9935-a73f4234e6d5 (non-flash)
Oct 26 00:09:57 user nova-compute[75165]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:014b6b5a-24b7-4afd-9fc3-50645f10fcd4 (non-flash)
Oct 26 00:09:57 user nova-compute[75165]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff01f329-6dda-43b6-8da5-6a5c48fad211 (non-flash)
Oct 26 00:09:57 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:09:57 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9d317ae-7dfa-4b25-9e3a-faa7ad5fed86 (non-flash)
Oct 26 00:09:57 user nova-compute[75165]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f25f6e6a-9711-4455-82e8-c56648a08508 (non-flash)
Oct 26 00:09:57 user nova-compute[75165]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:083f264a-3f29-48b4-9935-a73f4234e6d5 (non-flash)
Oct 26 00:09:57 user nova-compute[75165]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:014b6b5a-24b7-4afd-9fc3-50645f10fcd4 (non-flash)
Oct 26 00:09:57 user nova-compute[75165]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff01f329-6dda-43b6-8da5-6a5c48fad211 (non-flash)
Oct 26 00:09:57 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:09:57 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ff01f329-6dda-43b6-8da5-6a5c48fad211" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.330s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:09:57 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Connected to 172.16.0.220:3260 {{(pid=75165) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 00:09:57 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] HCTL ('37', '-', '-', 0) found on session 7 with lun 0 {{(pid=75165) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 00:09:57 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75165) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 00:09:57 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:09:57 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:09:57 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c7fe66e-391e-43d9-9541-cf17f94894fe]: (4, ('- - 0', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:09:57 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Searching for a device in session 7 and hctl ['37', '*', '*', 0] yield: None {{(pid=75165) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 00:09:57 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-1cd5fd77-0e1b-4f30-a883-ced281608666 tempest-VolumesAssistedSnapshotsTest-2020880117 tempest-VolumesAssistedSnapshotsTest-2020880117-project-admin] No BDM found with device name vda, not building metadata. {{(pid=75165) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 00:09:57 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-1cd5fd77-0e1b-4f30-a883-ced281608666 tempest-VolumesAssistedSnapshotsTest-2020880117 tempest-VolumesAssistedSnapshotsTest-2020880117-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=75165) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 00:09:57 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-1cd5fd77-0e1b-4f30-a883-ced281608666 tempest-VolumesAssistedSnapshotsTest-2020880117 tempest-VolumesAssistedSnapshotsTest-2020880117-project-admin] No VIF found with MAC fa:16:3e:03:0d:40, not building metadata {{(pid=75165) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 00:09:57 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-1cd5fd77-0e1b-4f30-a883-ced281608666 tempest-VolumesAssistedSnapshotsTest-2020880117 tempest-VolumesAssistedSnapshotsTest-2020880117-project-admin] Lock "f326db85-74f6-4e60-9c55-46b2a59502d0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.819s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Searching for a device in session 7 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75165) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:ff01f329-6dda-43b6-8da5-6a5c48fad211', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IfQbdwhn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75165) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.359s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] <== connect_volume: return (2631ms) {'type': 'block', 'scsi_wwn': '26165396464663330', 'path': '/dev/sdf'} {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26165396464663330', 'path': '/dev/sdf'} {{(pid=75165) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-d9a07c87-bdaa-4a90-b9ba-29e63a770992 tempest-VolumesAssistedSnapshotsTest-1896268326 tempest-VolumesAssistedSnapshotsTest-1896268326-project] [instance: f326db85-74f6-4e60-9c55-46b2a59502d0] volume_snapshot_create: create_info: {'snapshot_id': '7d08f9cc-fa60-4744-aa7d-67fde7a5932d', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=75165) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-d9a07c87-bdaa-4a90-b9ba-29e63a770992 tempest-VolumesAssistedSnapshotsTest-1896268326 tempest-VolumesAssistedSnapshotsTest-1896268326-project] [instance: f326db85-74f6-4e60-9c55-46b2a59502d0] snap xml: <domainsnapshot>
Oct 26 00:09:58 user nova-compute[75165]:   <disks>
Oct 26 00:09:58 user nova-compute[75165]:     <disk name="/dev/sde" snapshot="external" type="file">
Oct 26 00:09:58 user nova-compute[75165]:       <source file="/dev/new_file"/>
Oct 26 00:09:58 user nova-compute[75165]:     </disk>
Oct 26 00:09:58 user nova-compute[75165]:     <disk name="vda" snapshot="no"/>
Oct 26 00:09:58 user nova-compute[75165]:   </disks>
Oct 26 00:09:58 user nova-compute[75165]: </domainsnapshot>
Oct 26 00:09:58 user nova-compute[75165]:  {{(pid=75165) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG nova.objects.instance [None req-d9a07c87-bdaa-4a90-b9ba-29e63a770992 tempest-VolumesAssistedSnapshotsTest-1896268326 tempest-VolumesAssistedSnapshotsTest-1896268326-project] Lazy-loading 'system_metadata' on Instance uuid f326db85-74f6-4e60-9c55-46b2a59502d0 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T00:08:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-29517242',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-29517242',id=12,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCcUUhN8XRpaaJYv3vKPCPNNEkMMxDlKMi4jyG5F1k/oc6PfjbyEM9kim/n6zZPEK/ViRCrBDnWctXlihsGcJMeVYlhtqzvBMnS7wCLITtUfvAB80UeX7KgDk7Zm8Llyvw==',key_name='tempest-keypair-548626618',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9f1d0ea8cbf74f10b81a10d3a7a6e716',ramdisk_id='',reservation_id='r-y23b6svq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1432681902',owner_user_name='tempest-TaggedBootDevicesTest_v242-1432681902-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T00:08:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d25920439307445387df8d37c662d602',uuid=8d5569ce-1f18-4f37-a340-099ee152d548,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3da752ae-77a3-4bc3-8885-76331bc2d7d8", "address": "fa:16:3e:22:af:b4", "network": {"id": "a4a95519-4969-4c53-b078-46dab1ae12ac", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1704712535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f1d0ea8cbf74f10b81a10d3a7a6e716", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3da752ae-77", "ovs_interfaceid": "3da752ae-77a3-4bc3-8885-76331bc2d7d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75165) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Converting VIF {"id": "3da752ae-77a3-4bc3-8885-76331bc2d7d8", "address": "fa:16:3e:22:af:b4", "network": {"id": "a4a95519-4969-4c53-b078-46dab1ae12ac", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1704712535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f1d0ea8cbf74f10b81a10d3a7a6e716", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3da752ae-77", "ovs_interfaceid": "3da752ae-77a3-4bc3-8885-76331bc2d7d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:af:b4,bridge_name='br-int',has_traffic_filtering=True,id=3da752ae-77a3-4bc3-8885-76331bc2d7d8,network=Network(a4a95519-4969-4c53-b078-46dab1ae12ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3da752ae-77') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T00:08:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-29517242',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-29517242',id=12,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCcUUhN8XRpaaJYv3vKPCPNNEkMMxDlKMi4jyG5F1k/oc6PfjbyEM9kim/n6zZPEK/ViRCrBDnWctXlihsGcJMeVYlhtqzvBMnS7wCLITtUfvAB80UeX7KgDk7Zm8Llyvw==',key_name='tempest-keypair-548626618',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9f1d0ea8cbf74f10b81a10d3a7a6e716',ramdisk_id='',reservation_id='r-y23b6svq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1432681902',owner_user_name='tempest-TaggedBootDevicesTest_v242-1432681902-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T00:08:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d25920439307445387df8d37c662d602',uuid=8d5569ce-1f18-4f37-a340-099ee152d548,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b9583014-bb07-4337-97bb-30001c05475f", "address": "fa:16:3e:ca:f8:4e", "network": {"id": "b1b273e9-ac47-4985-9a15-ed6392eea58c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1944708022", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9f1d0ea8cbf74f10b81a10d3a7a6e716", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9583014-bb", "ovs_interfaceid": "b9583014-bb07-4337-97bb-30001c05475f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75165) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Converting VIF {"id": "b9583014-bb07-4337-97bb-30001c05475f", "address": "fa:16:3e:ca:f8:4e", "network": {"id": "b1b273e9-ac47-4985-9a15-ed6392eea58c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1944708022", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9f1d0ea8cbf74f10b81a10d3a7a6e716", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9583014-bb", "ovs_interfaceid": "b9583014-bb07-4337-97bb-30001c05475f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:f8:4e,bridge_name='br-int',has_traffic_filtering=True,id=b9583014-bb07-4337-97bb-30001c05475f,network=Network(b1b273e9-ac47-4985-9a15-ed6392eea58c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb9583014-bb') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T00:08:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-29517242',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-29517242',id=12,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCcUUhN8XRpaaJYv3vKPCPNNEkMMxDlKMi4jyG5F1k/oc6PfjbyEM9kim/n6zZPEK/ViRCrBDnWctXlihsGcJMeVYlhtqzvBMnS7wCLITtUfvAB80UeX7KgDk7Zm8Llyvw==',key_name='tempest-keypair-548626618',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9f1d0ea8cbf74f10b81a10d3a7a6e716',ramdisk_id='',reservation_id='r-y23b6svq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1432681902',owner_user_name='tempest-TaggedBootDevicesTest_v242-1432681902-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T00:08:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d25920439307445387df8d37c662d602',uuid=8d5569ce-1f18-4f37-a340-099ee152d548,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c51f288f-44b9-476b-9419-22ef8ae5c900", "address": "fa:16:3e:28:cd:e8", "network": {"id": "b1b273e9-ac47-4985-9a15-ed6392eea58c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1944708022", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.239", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9f1d0ea8cbf74f10b81a10d3a7a6e716", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc51f288f-44", "ovs_interfaceid": "c51f288f-44b9-476b-9419-22ef8ae5c900", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75165) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Converting VIF {"id": "c51f288f-44b9-476b-9419-22ef8ae5c900", "address": "fa:16:3e:28:cd:e8", "network": {"id": "b1b273e9-ac47-4985-9a15-ed6392eea58c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1944708022", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.239", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9f1d0ea8cbf74f10b81a10d3a7a6e716", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc51f288f-44", "ovs_interfaceid": "c51f288f-44b9-476b-9419-22ef8ae5c900", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:cd:e8,bridge_name='br-int',has_traffic_filtering=True,id=c51f288f-44b9-476b-9419-22ef8ae5c900,network=Network(b1b273e9-ac47-4985-9a15-ed6392eea58c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc51f288f-44') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T00:08:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-29517242',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-29517242',id=12,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCcUUhN8XRpaaJYv3vKPCPNNEkMMxDlKMi4jyG5F1k/oc6PfjbyEM9kim/n6zZPEK/ViRCrBDnWctXlihsGcJMeVYlhtqzvBMnS7wCLITtUfvAB80UeX7KgDk7Zm8Llyvw==',key_name='tempest-keypair-548626618',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9f1d0ea8cbf74f10b81a10d3a7a6e716',ramdisk_id='',reservation_id='r-y23b6svq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1432681902',owner_user_name='tempest-TaggedBootDevicesTest_v242-1432681902-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T00:08:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d25920439307445387df8d37c662d602',uuid=8d5569ce-1f18-4f37-a340-099ee152d548,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c019e949-c6fc-4014-9e42-13ce1eb17786", "address": "fa:16:3e:34:fd:75", "network": {"id": "b1b273e9-ac47-4985-9a15-ed6392eea58c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1944708022", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.220", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9f1d0ea8cbf74f10b81a10d3a7a6e716", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc019e949-c6", "ovs_interfaceid": "c019e949-c6fc-4014-9e42-13ce1eb17786", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75165) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Converting VIF {"id": "c019e949-c6fc-4014-9e42-13ce1eb17786", "address": "fa:16:3e:34:fd:75", "network": {"id": "b1b273e9-ac47-4985-9a15-ed6392eea58c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1944708022", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.220", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9f1d0ea8cbf74f10b81a10d3a7a6e716", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc019e949-c6", "ovs_interfaceid": "c019e949-c6fc-4014-9e42-13ce1eb17786", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:fd:75,bridge_name='br-int',has_traffic_filtering=True,id=c019e949-c6fc-4014-9e42-13ce1eb17786,network=Network(b1b273e9-ac47-4985-9a15-ed6392eea58c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc019e949-c6') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T00:08:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-29517242',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-29517242',id=12,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCcUUhN8XRpaaJYv3vKPCPNNEkMMxDlKMi4jyG5F1k/oc6PfjbyEM9kim/n6zZPEK/ViRCrBDnWctXlihsGcJMeVYlhtqzvBMnS7wCLITtUfvAB80UeX7KgDk7Zm8Llyvw==',key_name='tempest-keypair-548626618',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9f1d0ea8cbf74f10b81a10d3a7a6e716',ramdisk_id='',reservation_id='r-y23b6svq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1432681902',owner_user_name='tempest-TaggedBootDevicesTest_v242-1432681902-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T00:08:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d25920439307445387df8d37c662d602',uuid=8d5569ce-1f18-4f37-a340-099ee152d548,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9cecd3d6-4945-4a4b-8d06-48b0d7768a17", "address": "fa:16:3e:59:c6:53", "network": {"id": "b1b273e9-ac47-4985-9a15-ed6392eea58c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1944708022", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9f1d0ea8cbf74f10b81a10d3a7a6e716", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cecd3d6-49", "ovs_interfaceid": "9cecd3d6-4945-4a4b-8d06-48b0d7768a17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75165) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Converting VIF {"id": "9cecd3d6-4945-4a4b-8d06-48b0d7768a17", "address": "fa:16:3e:59:c6:53", "network": {"id": "b1b273e9-ac47-4985-9a15-ed6392eea58c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1944708022", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9f1d0ea8cbf74f10b81a10d3a7a6e716", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cecd3d6-49", "ovs_interfaceid": "9cecd3d6-4945-4a4b-8d06-48b0d7768a17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:c6:53,bridge_name='br-int',has_traffic_filtering=True,id=9cecd3d6-4945-4a4b-8d06-48b0d7768a17,network=Network(b1b273e9-ac47-4985-9a15-ed6392eea58c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cecd3d6-49') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T00:08:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-29517242',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-29517242',id=12,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCcUUhN8XRpaaJYv3vKPCPNNEkMMxDlKMi4jyG5F1k/oc6PfjbyEM9kim/n6zZPEK/ViRCrBDnWctXlihsGcJMeVYlhtqzvBMnS7wCLITtUfvAB80UeX7KgDk7Zm8Llyvw==',key_name='tempest-keypair-548626618',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9f1d0ea8cbf74f10b81a10d3a7a6e716',ramdisk_id='',reservation_id='r-y23b6svq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1432681902',owner_user_name='tempest-TaggedBootDevicesTest_v242-1432681902-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T00:08:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d25920439307445387df8d37c662d602',uuid=8d5569ce-1f18-4f37-a340-099ee152d548,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a04b8134-03e6-45f2-b6d7-3ea6a7deb81c", "address": "fa:16:3e:0a:29:45", "network": {"id": "75761f5b-dd19-4843-8db7-9cef3872583d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1377439333", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9f1d0ea8cbf74f10b81a10d3a7a6e716", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa04b8134-03", "ovs_interfaceid": "a04b8134-03e6-45f2-b6d7-3ea6a7deb81c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75165) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Converting VIF {"id": "a04b8134-03e6-45f2-b6d7-3ea6a7deb81c", "address": "fa:16:3e:0a:29:45", "network": {"id": "75761f5b-dd19-4843-8db7-9cef3872583d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1377439333", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9f1d0ea8cbf74f10b81a10d3a7a6e716", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa04b8134-03", "ovs_interfaceid": "a04b8134-03e6-45f2-b6d7-3ea6a7deb81c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:29:45,bridge_name='br-int',has_traffic_filtering=True,id=a04b8134-03e6-45f2-b6d7-3ea6a7deb81c,network=Network(75761f5b-dd19-4843-8db7-9cef3872583d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa04b8134-03') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T00:08:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-29517242',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-29517242',id=12,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCcUUhN8XRpaaJYv3vKPCPNNEkMMxDlKMi4jyG5F1k/oc6PfjbyEM9kim/n6zZPEK/ViRCrBDnWctXlihsGcJMeVYlhtqzvBMnS7wCLITtUfvAB80UeX7KgDk7Zm8Llyvw==',key_name='tempest-keypair-548626618',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9f1d0ea8cbf74f10b81a10d3a7a6e716',ramdisk_id='',reservation_id='r-y23b6svq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1432681902',owner_user_name='tempest-TaggedBootDevicesTest_v242-1432681902-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T00:08:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d25920439307445387df8d37c662d602',uuid=8d5569ce-1f18-4f37-a340-099ee152d548,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "03ee4dbc-d46d-4127-a4e0-d308a1c8beae", "address": "fa:16:3e:5b:46:e6", "network": {"id": "75761f5b-dd19-4843-8db7-9cef3872583d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1377439333", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9f1d0ea8cbf74f10b81a10d3a7a6e716", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03ee4dbc-d4", "ovs_interfaceid": "03ee4dbc-d46d-4127-a4e0-d308a1c8beae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75165) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Converting VIF {"id": "03ee4dbc-d46d-4127-a4e0-d308a1c8beae", "address": "fa:16:3e:5b:46:e6", "network": {"id": "75761f5b-dd19-4843-8db7-9cef3872583d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1377439333", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9f1d0ea8cbf74f10b81a10d3a7a6e716", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03ee4dbc-d4", "ovs_interfaceid": "03ee4dbc-d46d-4127-a4e0-d308a1c8beae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:46:e6,bridge_name='br-int',has_traffic_filtering=True,id=03ee4dbc-d46d-4127-a4e0-d308a1c8beae,network=Network(75761f5b-dd19-4843-8db7-9cef3872583d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03ee4dbc-d4') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG nova.objects.instance [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Lazy-loading 'pci_devices' on Instance uuid 8d5569ce-1f18-4f37-a340-099ee152d548 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] End _get_guest_xml xml=<domain type="kvm">
Oct 26 00:09:58 user nova-compute[75165]:   <uuid>8d5569ce-1f18-4f37-a340-099ee152d548</uuid>
Oct 26 00:09:58 user nova-compute[75165]:   <name>instance-0000000c</name>
Oct 26 00:09:58 user nova-compute[75165]:   <memory>524288</memory>
Oct 26 00:09:58 user nova-compute[75165]:   <vcpu>1</vcpu>
Oct 26 00:09:58 user nova-compute[75165]:   <metadata>
Oct 26 00:09:58 user nova-compute[75165]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 00:09:58 user nova-compute[75165]:       <nova:package version="0.0.0"/>
Oct 26 00:09:58 user nova-compute[75165]:       <nova:name>tempest-device-tagging-server-29517242</nova:name>
Oct 26 00:09:58 user nova-compute[75165]:       <nova:creationTime>2023-10-26 00:09:53</nova:creationTime>
Oct 26 00:09:58 user nova-compute[75165]:       <nova:flavor name="m1.tiny">
Oct 26 00:09:58 user nova-compute[75165]:         <nova:memory>512</nova:memory>
Oct 26 00:09:58 user nova-compute[75165]:         <nova:disk>1</nova:disk>
Oct 26 00:09:58 user nova-compute[75165]:         <nova:swap>0</nova:swap>
Oct 26 00:09:58 user nova-compute[75165]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 00:09:58 user nova-compute[75165]:         <nova:vcpus>1</nova:vcpus>
Oct 26 00:09:58 user nova-compute[75165]:       </nova:flavor>
Oct 26 00:09:58 user nova-compute[75165]:       <nova:owner>
Oct 26 00:09:58 user nova-compute[75165]:         <nova:user uuid="d25920439307445387df8d37c662d602">tempest-TaggedBootDevicesTest_v242-1432681902-project-member</nova:user>
Oct 26 00:09:58 user nova-compute[75165]:         <nova:project uuid="9f1d0ea8cbf74f10b81a10d3a7a6e716">tempest-TaggedBootDevicesTest_v242-1432681902</nova:project>
Oct 26 00:09:58 user nova-compute[75165]:       </nova:owner>
Oct 26 00:09:58 user nova-compute[75165]:       <nova:root type="image" uuid="bff0d8a1-739e-4c4d-9efa-b73ba7b76d01"/>
Oct 26 00:09:58 user nova-compute[75165]:       <nova:ports>
Oct 26 00:09:58 user nova-compute[75165]:         <nova:port uuid="3da752ae-77a3-4bc3-8885-76331bc2d7d8">
Oct 26 00:09:58 user nova-compute[75165]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 26 00:09:58 user nova-compute[75165]:         </nova:port>
Oct 26 00:09:58 user nova-compute[75165]:         <nova:port uuid="b9583014-bb07-4337-97bb-30001c05475f">
Oct 26 00:09:58 user nova-compute[75165]:           <nova:ip type="fixed" address="10.1.1.83" ipVersion="4"/>
Oct 26 00:09:58 user nova-compute[75165]:         </nova:port>
Oct 26 00:09:58 user nova-compute[75165]:         <nova:port uuid="c51f288f-44b9-476b-9419-22ef8ae5c900">
Oct 26 00:09:58 user nova-compute[75165]:           <nova:ip type="fixed" address="10.1.1.239" ipVersion="4"/>
Oct 26 00:09:58 user nova-compute[75165]:         </nova:port>
Oct 26 00:09:58 user nova-compute[75165]:         <nova:port uuid="c019e949-c6fc-4014-9e42-13ce1eb17786">
Oct 26 00:09:58 user nova-compute[75165]:           <nova:ip type="fixed" address="10.1.1.220" ipVersion="4"/>
Oct 26 00:09:58 user nova-compute[75165]:         </nova:port>
Oct 26 00:09:58 user nova-compute[75165]:         <nova:port uuid="9cecd3d6-4945-4a4b-8d06-48b0d7768a17">
Oct 26 00:09:58 user nova-compute[75165]:           <nova:ip type="fixed" address="10.1.1.236" ipVersion="4"/>
Oct 26 00:09:58 user nova-compute[75165]:         </nova:port>
Oct 26 00:09:58 user nova-compute[75165]:         <nova:port uuid="a04b8134-03e6-45f2-b6d7-3ea6a7deb81c">
Oct 26 00:09:58 user nova-compute[75165]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Oct 26 00:09:58 user nova-compute[75165]:         </nova:port>
Oct 26 00:09:58 user nova-compute[75165]:         <nova:port uuid="03ee4dbc-d46d-4127-a4e0-d308a1c8beae">
Oct 26 00:09:58 user nova-compute[75165]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Oct 26 00:09:58 user nova-compute[75165]:         </nova:port>
Oct 26 00:09:58 user nova-compute[75165]:       </nova:ports>
Oct 26 00:09:58 user nova-compute[75165]:     </nova:instance>
Oct 26 00:09:58 user nova-compute[75165]:   </metadata>
Oct 26 00:09:58 user nova-compute[75165]:   <sysinfo type="smbios">
Oct 26 00:09:58 user nova-compute[75165]:     <system>
Oct 26 00:09:58 user nova-compute[75165]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 00:09:58 user nova-compute[75165]:       <entry name="product">OpenStack Nova</entry>
Oct 26 00:09:58 user nova-compute[75165]:       <entry name="version">0.0.0</entry>
Oct 26 00:09:58 user nova-compute[75165]:       <entry name="serial">8d5569ce-1f18-4f37-a340-099ee152d548</entry>
Oct 26 00:09:58 user nova-compute[75165]:       <entry name="uuid">8d5569ce-1f18-4f37-a340-099ee152d548</entry>
Oct 26 00:09:58 user nova-compute[75165]:       <entry name="family">Virtual Machine</entry>
Oct 26 00:09:58 user nova-compute[75165]:     </system>
Oct 26 00:09:58 user nova-compute[75165]:   </sysinfo>
Oct 26 00:09:58 user nova-compute[75165]:   <os>
Oct 26 00:09:58 user nova-compute[75165]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 00:09:58 user nova-compute[75165]:     <boot dev="hd"/>
Oct 26 00:09:58 user nova-compute[75165]:     <smbios mode="sysinfo"/>
Oct 26 00:09:58 user nova-compute[75165]:   </os>
Oct 26 00:09:58 user nova-compute[75165]:   <features>
Oct 26 00:09:58 user nova-compute[75165]:     <acpi/>
Oct 26 00:09:58 user nova-compute[75165]:     <apic/>
Oct 26 00:09:58 user nova-compute[75165]:     <vmcoreinfo/>
Oct 26 00:09:58 user nova-compute[75165]:   </features>
Oct 26 00:09:58 user nova-compute[75165]:   <clock offset="utc">
Oct 26 00:09:58 user nova-compute[75165]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 00:09:58 user nova-compute[75165]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 00:09:58 user nova-compute[75165]:     <timer name="hpet" present="no"/>
Oct 26 00:09:58 user nova-compute[75165]:   </clock>
Oct 26 00:09:58 user nova-compute[75165]:   <cpu mode="custom" match="exact">
Oct 26 00:09:58 user nova-compute[75165]:     <model>Nehalem</model>
Oct 26 00:09:58 user nova-compute[75165]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 00:09:58 user nova-compute[75165]:   </cpu>
Oct 26 00:09:58 user nova-compute[75165]:   <devices>
Oct 26 00:09:58 user nova-compute[75165]:     <disk type="file" device="cdrom">
Oct 26 00:09:58 user nova-compute[75165]:       <driver name="qemu" type="raw" cache="none"/>
Oct 26 00:09:58 user nova-compute[75165]:       <source file="/opt/stack/data/nova/instances/8d5569ce-1f18-4f37-a340-099ee152d548/disk.config"/>
Oct 26 00:09:58 user nova-compute[75165]:       <target dev="hda" bus="ide"/>
Oct 26 00:09:58 user nova-compute[75165]:     </disk>
Oct 26 00:09:58 user nova-compute[75165]:     <disk type="block" device="disk">
Oct 26 00:09:58 user nova-compute[75165]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 00:09:58 user nova-compute[75165]:       <source dev="/dev/sdc"/>
Oct 26 00:09:58 user nova-compute[75165]:       <target dev="vda" bus="virtio"/>
Oct 26 00:09:58 user nova-compute[75165]:       <serial>f25f6e6a-9711-4455-82e8-c56648a08508</serial>
Oct 26 00:09:58 user nova-compute[75165]:     </disk>
Oct 26 00:09:58 user nova-compute[75165]:     <disk type="block" device="disk">
Oct 26 00:09:58 user nova-compute[75165]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 00:09:58 user nova-compute[75165]:       <source dev="/dev/sdd"/>
Oct 26 00:09:58 user nova-compute[75165]:       <target dev="vdb" bus="virtio"/>
Oct 26 00:09:58 user nova-compute[75165]:       <serial>083f264a-3f29-48b4-9935-a73f4234e6d5</serial>
Oct 26 00:09:58 user nova-compute[75165]:     </disk>
Oct 26 00:09:58 user nova-compute[75165]:     <disk type="block" device="disk">
Oct 26 00:09:58 user nova-compute[75165]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 00:09:58 user nova-compute[75165]:       <source dev="/dev/sdf"/>
Oct 26 00:09:58 user nova-compute[75165]:       <target dev="vdc" bus="virtio"/>
Oct 26 00:09:58 user nova-compute[75165]:       <serial>ff01f329-6dda-43b6-8da5-6a5c48fad211</serial>
Oct 26 00:09:58 user nova-compute[75165]:     </disk>
Oct 26 00:09:58 user nova-compute[75165]:     <interface type="ethernet">
Oct 26 00:09:58 user nova-compute[75165]:       <mac address="fa:16:3e:22:af:b4"/>
Oct 26 00:09:58 user nova-compute[75165]:       <model type="virtio"/>
Oct 26 00:09:58 user nova-compute[75165]:       <mtu size="1442"/>
Oct 26 00:09:58 user nova-compute[75165]:       <target dev="tap3da752ae-77"/>
Oct 26 00:09:58 user nova-compute[75165]:     </interface>
Oct 26 00:09:58 user nova-compute[75165]:     <interface type="ethernet">
Oct 26 00:09:58 user nova-compute[75165]:       <mac address="fa:16:3e:ca:f8:4e"/>
Oct 26 00:09:58 user nova-compute[75165]:       <model type="virtio"/>
Oct 26 00:09:58 user nova-compute[75165]:       <mtu size="1442"/>
Oct 26 00:09:58 user nova-compute[75165]:       <target dev="tapb9583014-bb"/>
Oct 26 00:09:58 user nova-compute[75165]:     </interface>
Oct 26 00:09:58 user nova-compute[75165]:     <interface type="ethernet">
Oct 26 00:09:58 user nova-compute[75165]:       <mac address="fa:16:3e:28:cd:e8"/>
Oct 26 00:09:58 user nova-compute[75165]:       <model type="virtio"/>
Oct 26 00:09:58 user nova-compute[75165]:       <mtu size="1442"/>
Oct 26 00:09:58 user nova-compute[75165]:       <target dev="tapc51f288f-44"/>
Oct 26 00:09:58 user nova-compute[75165]:     </interface>
Oct 26 00:09:58 user nova-compute[75165]:     <interface type="ethernet">
Oct 26 00:09:58 user nova-compute[75165]:       <mac address="fa:16:3e:34:fd:75"/>
Oct 26 00:09:58 user nova-compute[75165]:       <model type="virtio"/>
Oct 26 00:09:58 user nova-compute[75165]:       <mtu size="1442"/>
Oct 26 00:09:58 user nova-compute[75165]:       <target dev="tapc019e949-c6"/>
Oct 26 00:09:58 user nova-compute[75165]:     </interface>
Oct 26 00:09:58 user nova-compute[75165]:     <interface type="ethernet">
Oct 26 00:09:58 user nova-compute[75165]:       <mac address="fa:16:3e:59:c6:53"/>
Oct 26 00:09:58 user nova-compute[75165]:       <model type="virtio"/>
Oct 26 00:09:58 user nova-compute[75165]:       <mtu size="1442"/>
Oct 26 00:09:58 user nova-compute[75165]:       <target dev="tap9cecd3d6-49"/>
Oct 26 00:09:58 user nova-compute[75165]:     </interface>
Oct 26 00:09:58 user nova-compute[75165]:     <interface type="ethernet">
Oct 26 00:09:58 user nova-compute[75165]:       <mac address="fa:16:3e:0a:29:45"/>
Oct 26 00:09:58 user nova-compute[75165]:       <model type="virtio"/>
Oct 26 00:09:58 user nova-compute[75165]:       <mtu size="1442"/>
Oct 26 00:09:58 user nova-compute[75165]:       <target dev="tapa04b8134-03"/>
Oct 26 00:09:58 user nova-compute[75165]:     </interface>
Oct 26 00:09:58 user nova-compute[75165]:     <interface type="ethernet">
Oct 26 00:09:58 user nova-compute[75165]:       <mac address="fa:16:3e:5b:46:e6"/>
Oct 26 00:09:58 user nova-compute[75165]:       <model type="virtio"/>
Oct 26 00:09:58 user nova-compute[75165]:       <mtu size="1442"/>
Oct 26 00:09:58 user nova-compute[75165]:       <target dev="tap03ee4dbc-d4"/>
Oct 26 00:09:58 user nova-compute[75165]:     </interface>
Oct 26 00:09:58 user nova-compute[75165]:     <serial type="pty">
Oct 26 00:09:58 user nova-compute[75165]:       <log file="/opt/stack/data/nova/instances/8d5569ce-1f18-4f37-a340-099ee152d548/console.log" append="off"/>
Oct 26 00:09:58 user nova-compute[75165]:     </serial>
Oct 26 00:09:58 user nova-compute[75165]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 00:09:58 user nova-compute[75165]:     <video>
Oct 26 00:09:58 user nova-compute[75165]:       <model type="virtio"/>
Oct 26 00:09:58 user nova-compute[75165]:     </video>
Oct 26 00:09:58 user nova-compute[75165]:     <rng model="virtio">
Oct 26 00:09:58 user nova-compute[75165]:       <backend model="random">/dev/urandom</backend>
Oct 26 00:09:58 user nova-compute[75165]:     </rng>
Oct 26 00:09:58 user nova-compute[75165]:     <controller type="usb" index="0" model="none"/>
Oct 26 00:09:58 user nova-compute[75165]:     <memballoon model="virtio">
Oct 26 00:09:58 user nova-compute[75165]:       <stats period="10"/>
Oct 26 00:09:58 user nova-compute[75165]:     </memballoon>
Oct 26 00:09:58 user nova-compute[75165]:   </devices>
Oct 26 00:09:58 user nova-compute[75165]: </domain>
Oct 26 00:09:58 user nova-compute[75165]:  {{(pid=75165) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T00:08:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-29517242',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-29517242',id=12,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCcUUhN8XRpaaJYv3vKPCPNNEkMMxDlKMi4jyG5F1k/oc6PfjbyEM9kim/n6zZPEK/ViRCrBDnWctXlihsGcJMeVYlhtqzvBMnS7wCLITtUfvAB80UeX7KgDk7Zm8Llyvw==',key_name='tempest-keypair-548626618',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9f1d0ea8cbf74f10b81a10d3a7a6e716',ramdisk_id='',reservation_id='r-y23b6svq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1432681902',owner_user_name='tempest-TaggedBootDevicesTest_v242-1432681902-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T00:08:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d25920439307445387df8d37c662d602',uuid=8d5569ce-1f18-4f37-a340-099ee152d548,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3da752ae-77a3-4bc3-8885-76331bc2d7d8", "address": "fa:16:3e:22:af:b4", "network": {"id": "a4a95519-4969-4c53-b078-46dab1ae12ac", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1704712535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f1d0ea8cbf74f10b81a10d3a7a6e716", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3da752ae-77", "ovs_interfaceid": "3da752ae-77a3-4bc3-8885-76331bc2d7d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Converting VIF {"id": "3da752ae-77a3-4bc3-8885-76331bc2d7d8", "address": "fa:16:3e:22:af:b4", "network": {"id": "a4a95519-4969-4c53-b078-46dab1ae12ac", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1704712535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f1d0ea8cbf74f10b81a10d3a7a6e716", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3da752ae-77", "ovs_interfaceid": "3da752ae-77a3-4bc3-8885-76331bc2d7d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:af:b4,bridge_name='br-int',has_traffic_filtering=True,id=3da752ae-77a3-4bc3-8885-76331bc2d7d8,network=Network(a4a95519-4969-4c53-b078-46dab1ae12ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3da752ae-77') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG os_vif [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:af:b4,bridge_name='br-int',has_traffic_filtering=True,id=3da752ae-77a3-4bc3-8885-76331bc2d7d8,network=Network(a4a95519-4969-4c53-b078-46dab1ae12ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3da752ae-77') {{(pid=75165) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 00:09:58 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-d9a07c87-bdaa-4a90-b9ba-29e63a770992 tempest-VolumesAssistedSnapshotsTest-1896268326 tempest-VolumesAssistedSnapshotsTest-1896268326-project] [instance: f326db85-74f6-4e60-9c55-46b2a59502d0] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 26 00:09:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '43ab9d2c-cc9c-5c80-8456-64b65bc2002c', '_type': 'linux-noop'}}, row=False) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-f7eab4ad-5afc-447b-9241-a7ebc8541f76 tempest-VolumesAssistedSnapshotsTest-1896268326 tempest-VolumesAssistedSnapshotsTest-1896268326-project] [instance: f326db85-74f6-4e60-9c55-46b2a59502d0] volume_snapshot_delete: delete_info: {'volume_id': '014b6b5a-24b7-4afd-9fc3-50645f10fcd4'} {{(pid=75165) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver [None req-f7eab4ad-5afc-447b-9241-a7ebc8541f76 tempest-VolumesAssistedSnapshotsTest-1896268326 tempest-VolumesAssistedSnapshotsTest-1896268326-project] [instance: f326db85-74f6-4e60-9c55-46b2a59502d0] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver [instance: f326db85-74f6-4e60-9c55-46b2a59502d0] Traceback (most recent call last):
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver [instance: f326db85-74f6-4e60-9c55-46b2a59502d0]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver [instance: f326db85-74f6-4e60-9c55-46b2a59502d0]     self._volume_snapshot_delete(context, instance, volume_id,
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver [instance: f326db85-74f6-4e60-9c55-46b2a59502d0]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver [instance: f326db85-74f6-4e60-9c55-46b2a59502d0]     if delete_info['type'] != 'qcow2':
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver [instance: f326db85-74f6-4e60-9c55-46b2a59502d0] KeyError: 'type'
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver [instance: f326db85-74f6-4e60-9c55-46b2a59502d0] 
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver [None req-d9a07c87-bdaa-4a90-b9ba-29e63a770992 tempest-VolumesAssistedSnapshotsTest-1896268326 tempest-VolumesAssistedSnapshotsTest-1896268326-project] [instance: f326db85-74f6-4e60-9c55-46b2a59502d0] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver [instance: f326db85-74f6-4e60-9c55-46b2a59502d0] Traceback (most recent call last):
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver [instance: f326db85-74f6-4e60-9c55-46b2a59502d0]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver [instance: f326db85-74f6-4e60-9c55-46b2a59502d0]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver [instance: f326db85-74f6-4e60-9c55-46b2a59502d0]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver [instance: f326db85-74f6-4e60-9c55-46b2a59502d0]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver [instance: f326db85-74f6-4e60-9c55-46b2a59502d0]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver [instance: f326db85-74f6-4e60-9c55-46b2a59502d0]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver [instance: f326db85-74f6-4e60-9c55-46b2a59502d0]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver [instance: f326db85-74f6-4e60-9c55-46b2a59502d0]     rv = execute(f, *args, **kwargs)
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver [instance: f326db85-74f6-4e60-9c55-46b2a59502d0]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver [instance: f326db85-74f6-4e60-9c55-46b2a59502d0]     six.reraise(c, e, tb)
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver [instance: f326db85-74f6-4e60-9c55-46b2a59502d0]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver [instance: f326db85-74f6-4e60-9c55-46b2a59502d0]     raise value
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver [instance: f326db85-74f6-4e60-9c55-46b2a59502d0]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver [instance: f326db85-74f6-4e60-9c55-46b2a59502d0]     rv = meth(*args, **kwargs)
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver [instance: f326db85-74f6-4e60-9c55-46b2a59502d0]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver [instance: f326db85-74f6-4e60-9c55-46b2a59502d0]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver [instance: f326db85-74f6-4e60-9c55-46b2a59502d0] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver [instance: f326db85-74f6-4e60-9c55-46b2a59502d0] 
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver [None req-d9a07c87-bdaa-4a90-b9ba-29e63a770992 tempest-VolumesAssistedSnapshotsTest-1896268326 tempest-VolumesAssistedSnapshotsTest-1896268326-project] [instance: f326db85-74f6-4e60-9c55-46b2a59502d0] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver [instance: f326db85-74f6-4e60-9c55-46b2a59502d0] Traceback (most recent call last):
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver [instance: f326db85-74f6-4e60-9c55-46b2a59502d0]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver [instance: f326db85-74f6-4e60-9c55-46b2a59502d0]     self._volume_snapshot_create(context, instance, guest,
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver [instance: f326db85-74f6-4e60-9c55-46b2a59502d0]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver [instance: f326db85-74f6-4e60-9c55-46b2a59502d0]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver [instance: f326db85-74f6-4e60-9c55-46b2a59502d0]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver [instance: f326db85-74f6-4e60-9c55-46b2a59502d0]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver [instance: f326db85-74f6-4e60-9c55-46b2a59502d0]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver [instance: f326db85-74f6-4e60-9c55-46b2a59502d0]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver [instance: f326db85-74f6-4e60-9c55-46b2a59502d0]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver [instance: f326db85-74f6-4e60-9c55-46b2a59502d0]     rv = execute(f, *args, **kwargs)
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver [instance: f326db85-74f6-4e60-9c55-46b2a59502d0]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver [instance: f326db85-74f6-4e60-9c55-46b2a59502d0]     six.reraise(c, e, tb)
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver [instance: f326db85-74f6-4e60-9c55-46b2a59502d0]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver [instance: f326db85-74f6-4e60-9c55-46b2a59502d0]     raise value
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver [instance: f326db85-74f6-4e60-9c55-46b2a59502d0]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver [instance: f326db85-74f6-4e60-9c55-46b2a59502d0]     rv = meth(*args, **kwargs)
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver [instance: f326db85-74f6-4e60-9c55-46b2a59502d0]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver [instance: f326db85-74f6-4e60-9c55-46b2a59502d0]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver [instance: f326db85-74f6-4e60-9c55-46b2a59502d0] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver [instance: f326db85-74f6-4e60-9c55-46b2a59502d0] 
Oct 26 00:09:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3da752ae-77, may_exist=True, interface_attrs={}) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3da752ae-77, col_values=(('qos', UUID('63bed79d-0e4d-4c9f-bae0-60dfe4e92069')),), if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3da752ae-77, col_values=(('external_ids', {'iface-id': '3da752ae-77a3-4bc3-8885-76331bc2d7d8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:22:af:b4', 'vm-uuid': '8d5569ce-1f18-4f37-a340-099ee152d548'}),), if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:09:58 user nova-compute[75165]: INFO os_vif [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:af:b4,bridge_name='br-int',has_traffic_filtering=True,id=3da752ae-77a3-4bc3-8885-76331bc2d7d8,network=Network(a4a95519-4969-4c53-b078-46dab1ae12ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3da752ae-77')
Oct 26 00:09:58 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T00:08:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-29517242',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-29517242',id=12,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCcUUhN8XRpaaJYv3vKPCPNNEkMMxDlKMi4jyG5F1k/oc6PfjbyEM9kim/n6zZPEK/ViRCrBDnWctXlihsGcJMeVYlhtqzvBMnS7wCLITtUfvAB80UeX7KgDk7Zm8Llyvw==',key_name='tempest-keypair-548626618',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9f1d0ea8cbf74f10b81a10d3a7a6e716',ramdisk_id='',reservation_id='r-y23b6svq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1432681902',owner_user_name='tempest-TaggedBootDevicesTest_v242-1432681902-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T00:08:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d25920439307445387df8d37c662d602',uuid=8d5569ce-1f18-4f37-a340-099ee152d548,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b9583014-bb07-4337-97bb-30001c05475f", "address": "fa:16:3e:ca:f8:4e", "network": {"id": "b1b273e9-ac47-4985-9a15-ed6392eea58c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1944708022", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9f1d0ea8cbf74f10b81a10d3a7a6e716", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9583014-bb", "ovs_interfaceid": "b9583014-bb07-4337-97bb-30001c05475f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75165) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Converting VIF {"id": "b9583014-bb07-4337-97bb-30001c05475f", "address": "fa:16:3e:ca:f8:4e", "network": {"id": "b1b273e9-ac47-4985-9a15-ed6392eea58c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1944708022", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9f1d0ea8cbf74f10b81a10d3a7a6e716", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9583014-bb", "ovs_interfaceid": "b9583014-bb07-4337-97bb-30001c05475f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:f8:4e,bridge_name='br-int',has_traffic_filtering=True,id=b9583014-bb07-4337-97bb-30001c05475f,network=Network(b1b273e9-ac47-4985-9a15-ed6392eea58c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb9583014-bb') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG os_vif [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:f8:4e,bridge_name='br-int',has_traffic_filtering=True,id=b9583014-bb07-4337-97bb-30001c05475f,network=Network(b1b273e9-ac47-4985-9a15-ed6392eea58c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb9583014-bb') {{(pid=75165) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bd499744-3596-58f0-abbd-a41a02b1e966', '_type': 'linux-noop'}}, row=False) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb9583014-bb, may_exist=True, interface_attrs={}) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb9583014-bb, col_values=(('qos', UUID('80439a63-8d10-4d25-ad33-7b32ecd5367a')),), if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb9583014-bb, col_values=(('external_ids', {'iface-id': 'b9583014-bb07-4337-97bb-30001c05475f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ca:f8:4e', 'vm-uuid': '8d5569ce-1f18-4f37-a340-099ee152d548'}),), if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver [None req-f7eab4ad-5afc-447b-9241-a7ebc8541f76 tempest-VolumesAssistedSnapshotsTest-1896268326 tempest-VolumesAssistedSnapshotsTest-1896268326-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver 
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver 
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-7cb869c1-d9ea-4e60-b5da-805182948462)
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver 
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver 
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver 
Oct 26 00:09:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:09:58 user nova-compute[75165]: ERROR oslo_messaging.rpc.server [None req-f7eab4ad-5afc-447b-9241-a7ebc8541f76 tempest-VolumesAssistedSnapshotsTest-1896268326 tempest-VolumesAssistedSnapshotsTest-1896268326-project] Exception during message handling: KeyError: 'type'
Oct 26 00:09:58 user nova-compute[75165]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Oct 26 00:09:58 user nova-compute[75165]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Oct 26 00:09:58 user nova-compute[75165]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Oct 26 00:09:58 user nova-compute[75165]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Oct 26 00:09:58 user nova-compute[75165]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Oct 26 00:09:58 user nova-compute[75165]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Oct 26 00:09:58 user nova-compute[75165]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Oct 26 00:09:58 user nova-compute[75165]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Oct 26 00:09:58 user nova-compute[75165]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Oct 26 00:09:58 user nova-compute[75165]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Oct 26 00:09:58 user nova-compute[75165]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 26 00:09:58 user nova-compute[75165]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 26 00:09:58 user nova-compute[75165]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 26 00:09:58 user nova-compute[75165]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 26 00:09:58 user nova-compute[75165]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 26 00:09:58 user nova-compute[75165]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Oct 26 00:09:58 user nova-compute[75165]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Oct 26 00:09:58 user nova-compute[75165]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4516, in volume_snapshot_delete
Oct 26 00:09:58 user nova-compute[75165]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Oct 26 00:09:58 user nova-compute[75165]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Oct 26 00:09:58 user nova-compute[75165]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 26 00:09:58 user nova-compute[75165]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 26 00:09:58 user nova-compute[75165]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 26 00:09:58 user nova-compute[75165]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 26 00:09:58 user nova-compute[75165]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 26 00:09:58 user nova-compute[75165]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Oct 26 00:09:58 user nova-compute[75165]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Oct 26 00:09:58 user nova-compute[75165]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Oct 26 00:09:58 user nova-compute[75165]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Oct 26 00:09:58 user nova-compute[75165]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Oct 26 00:09:58 user nova-compute[75165]: ERROR oslo_messaging.rpc.server 
Oct 26 00:09:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver [None req-d9a07c87-bdaa-4a90-b9ba-29e63a770992 tempest-VolumesAssistedSnapshotsTest-1896268326 tempest-VolumesAssistedSnapshotsTest-1896268326-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 7d08f9cc-fa60-4744-aa7d-67fde7a5932d could not be found.
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver     raise value
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver 
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver 
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 7d08f9cc-fa60-4744-aa7d-67fde7a5932d could not be found. (HTTP 404) (Request-ID: req-1fe40867-99a0-448f-b42c-06f4863b7e72)
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver 
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver 
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 7d08f9cc-fa60-4744-aa7d-67fde7a5932d could not be found.
Oct 26 00:09:58 user nova-compute[75165]: ERROR nova.virt.libvirt.driver 
Oct 26 00:09:58 user nova-compute[75165]: ERROR oslo_messaging.rpc.server [None req-d9a07c87-bdaa-4a90-b9ba-29e63a770992 tempest-VolumesAssistedSnapshotsTest-1896268326 tempest-VolumesAssistedSnapshotsTest-1896268326-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 26 00:09:58 user nova-compute[75165]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Oct 26 00:09:58 user nova-compute[75165]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Oct 26 00:09:58 user nova-compute[75165]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Oct 26 00:09:58 user nova-compute[75165]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Oct 26 00:09:58 user nova-compute[75165]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Oct 26 00:09:58 user nova-compute[75165]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Oct 26 00:09:58 user nova-compute[75165]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Oct 26 00:09:58 user nova-compute[75165]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Oct 26 00:09:58 user nova-compute[75165]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Oct 26 00:09:58 user nova-compute[75165]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Oct 26 00:09:58 user nova-compute[75165]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 26 00:09:58 user nova-compute[75165]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 26 00:09:58 user nova-compute[75165]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 26 00:09:58 user nova-compute[75165]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 26 00:09:58 user nova-compute[75165]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 26 00:09:58 user nova-compute[75165]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Oct 26 00:09:58 user nova-compute[75165]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Oct 26 00:09:58 user nova-compute[75165]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4504, in volume_snapshot_create
Oct 26 00:09:58 user nova-compute[75165]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Oct 26 00:09:58 user nova-compute[75165]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Oct 26 00:09:58 user nova-compute[75165]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 26 00:09:58 user nova-compute[75165]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 26 00:09:58 user nova-compute[75165]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 26 00:09:58 user nova-compute[75165]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 26 00:09:58 user nova-compute[75165]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 26 00:09:58 user nova-compute[75165]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Oct 26 00:09:58 user nova-compute[75165]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Oct 26 00:09:58 user nova-compute[75165]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Oct 26 00:09:58 user nova-compute[75165]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Oct 26 00:09:58 user nova-compute[75165]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Oct 26 00:09:58 user nova-compute[75165]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Oct 26 00:09:58 user nova-compute[75165]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Oct 26 00:09:58 user nova-compute[75165]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Oct 26 00:09:58 user nova-compute[75165]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Oct 26 00:09:58 user nova-compute[75165]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Oct 26 00:09:58 user nova-compute[75165]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Oct 26 00:09:58 user nova-compute[75165]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Oct 26 00:09:58 user nova-compute[75165]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Oct 26 00:09:58 user nova-compute[75165]: ERROR oslo_messaging.rpc.server     raise value
Oct 26 00:09:58 user nova-compute[75165]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Oct 26 00:09:58 user nova-compute[75165]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Oct 26 00:09:58 user nova-compute[75165]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Oct 26 00:09:58 user nova-compute[75165]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Oct 26 00:09:58 user nova-compute[75165]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 26 00:09:58 user nova-compute[75165]: ERROR oslo_messaging.rpc.server 
Oct 26 00:09:58 user nova-compute[75165]: INFO os_vif [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:f8:4e,bridge_name='br-int',has_traffic_filtering=True,id=b9583014-bb07-4337-97bb-30001c05475f,network=Network(b1b273e9-ac47-4985-9a15-ed6392eea58c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb9583014-bb')
Oct 26 00:09:58 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T00:08:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-29517242',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-29517242',id=12,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCcUUhN8XRpaaJYv3vKPCPNNEkMMxDlKMi4jyG5F1k/oc6PfjbyEM9kim/n6zZPEK/ViRCrBDnWctXlihsGcJMeVYlhtqzvBMnS7wCLITtUfvAB80UeX7KgDk7Zm8Llyvw==',key_name='tempest-keypair-548626618',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9f1d0ea8cbf74f10b81a10d3a7a6e716',ramdisk_id='',reservation_id='r-y23b6svq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1432681902',owner_user_name='tempest-TaggedBootDevicesTest_v242-1432681902-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T00:08:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d25920439307445387df8d37c662d602',uuid=8d5569ce-1f18-4f37-a340-099ee152d548,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c51f288f-44b9-476b-9419-22ef8ae5c900", "address": "fa:16:3e:28:cd:e8", "network": {"id": "b1b273e9-ac47-4985-9a15-ed6392eea58c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1944708022", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.239", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9f1d0ea8cbf74f10b81a10d3a7a6e716", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc51f288f-44", "ovs_interfaceid": "c51f288f-44b9-476b-9419-22ef8ae5c900", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75165) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Converting VIF {"id": "c51f288f-44b9-476b-9419-22ef8ae5c900", "address": "fa:16:3e:28:cd:e8", "network": {"id": "b1b273e9-ac47-4985-9a15-ed6392eea58c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1944708022", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.239", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9f1d0ea8cbf74f10b81a10d3a7a6e716", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc51f288f-44", "ovs_interfaceid": "c51f288f-44b9-476b-9419-22ef8ae5c900", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:cd:e8,bridge_name='br-int',has_traffic_filtering=True,id=c51f288f-44b9-476b-9419-22ef8ae5c900,network=Network(b1b273e9-ac47-4985-9a15-ed6392eea58c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc51f288f-44') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG os_vif [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:cd:e8,bridge_name='br-int',has_traffic_filtering=True,id=c51f288f-44b9-476b-9419-22ef8ae5c900,network=Network(b1b273e9-ac47-4985-9a15-ed6392eea58c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc51f288f-44') {{(pid=75165) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2470b3e3-8ad9-538d-be76-7887d2fbd9c9', '_type': 'linux-noop'}}, row=False) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc51f288f-44, may_exist=True, interface_attrs={}) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc51f288f-44, col_values=(('qos', UUID('9d8ae01e-f605-4ba4-ab4f-c0e111277e44')),), if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc51f288f-44, col_values=(('external_ids', {'iface-id': 'c51f288f-44b9-476b-9419-22ef8ae5c900', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:28:cd:e8', 'vm-uuid': '8d5569ce-1f18-4f37-a340-099ee152d548'}),), if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:09:58 user nova-compute[75165]: INFO os_vif [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:cd:e8,bridge_name='br-int',has_traffic_filtering=True,id=c51f288f-44b9-476b-9419-22ef8ae5c900,network=Network(b1b273e9-ac47-4985-9a15-ed6392eea58c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc51f288f-44')
Oct 26 00:09:58 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T00:08:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-29517242',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-29517242',id=12,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCcUUhN8XRpaaJYv3vKPCPNNEkMMxDlKMi4jyG5F1k/oc6PfjbyEM9kim/n6zZPEK/ViRCrBDnWctXlihsGcJMeVYlhtqzvBMnS7wCLITtUfvAB80UeX7KgDk7Zm8Llyvw==',key_name='tempest-keypair-548626618',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9f1d0ea8cbf74f10b81a10d3a7a6e716',ramdisk_id='',reservation_id='r-y23b6svq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1432681902',owner_user_name='tempest-TaggedBootDevicesTest_v242-1432681902-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T00:08:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d25920439307445387df8d37c662d602',uuid=8d5569ce-1f18-4f37-a340-099ee152d548,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c019e949-c6fc-4014-9e42-13ce1eb17786", "address": "fa:16:3e:34:fd:75", "network": {"id": "b1b273e9-ac47-4985-9a15-ed6392eea58c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1944708022", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.220", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9f1d0ea8cbf74f10b81a10d3a7a6e716", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc019e949-c6", "ovs_interfaceid": "c019e949-c6fc-4014-9e42-13ce1eb17786", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Converting VIF {"id": "c019e949-c6fc-4014-9e42-13ce1eb17786", "address": "fa:16:3e:34:fd:75", "network": {"id": "b1b273e9-ac47-4985-9a15-ed6392eea58c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1944708022", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.220", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9f1d0ea8cbf74f10b81a10d3a7a6e716", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc019e949-c6", "ovs_interfaceid": "c019e949-c6fc-4014-9e42-13ce1eb17786", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:fd:75,bridge_name='br-int',has_traffic_filtering=True,id=c019e949-c6fc-4014-9e42-13ce1eb17786,network=Network(b1b273e9-ac47-4985-9a15-ed6392eea58c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc019e949-c6') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG os_vif [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:fd:75,bridge_name='br-int',has_traffic_filtering=True,id=c019e949-c6fc-4014-9e42-13ce1eb17786,network=Network(b1b273e9-ac47-4985-9a15-ed6392eea58c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc019e949-c6') {{(pid=75165) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0ab34d67-e8f6-5047-a211-06d205ea5898', '_type': 'linux-noop'}}, row=False) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc019e949-c6, may_exist=True, interface_attrs={}) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc019e949-c6, col_values=(('qos', UUID('0ff3afe6-ef92-45d8-80b3-4281434330ec')),), if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc019e949-c6, col_values=(('external_ids', {'iface-id': 'c019e949-c6fc-4014-9e42-13ce1eb17786', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:34:fd:75', 'vm-uuid': '8d5569ce-1f18-4f37-a340-099ee152d548'}),), if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:09:58 user nova-compute[75165]: INFO os_vif [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:fd:75,bridge_name='br-int',has_traffic_filtering=True,id=c019e949-c6fc-4014-9e42-13ce1eb17786,network=Network(b1b273e9-ac47-4985-9a15-ed6392eea58c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc019e949-c6')
Oct 26 00:09:58 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T00:08:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-29517242',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-29517242',id=12,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCcUUhN8XRpaaJYv3vKPCPNNEkMMxDlKMi4jyG5F1k/oc6PfjbyEM9kim/n6zZPEK/ViRCrBDnWctXlihsGcJMeVYlhtqzvBMnS7wCLITtUfvAB80UeX7KgDk7Zm8Llyvw==',key_name='tempest-keypair-548626618',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9f1d0ea8cbf74f10b81a10d3a7a6e716',ramdisk_id='',reservation_id='r-y23b6svq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1432681902',owner_user_name='tempest-TaggedBootDevicesTest_v242-1432681902-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T00:08:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d25920439307445387df8d37c662d602',uuid=8d5569ce-1f18-4f37-a340-099ee152d548,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9cecd3d6-4945-4a4b-8d06-48b0d7768a17", "address": "fa:16:3e:59:c6:53", "network": {"id": "b1b273e9-ac47-4985-9a15-ed6392eea58c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1944708022", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9f1d0ea8cbf74f10b81a10d3a7a6e716", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cecd3d6-49", "ovs_interfaceid": "9cecd3d6-4945-4a4b-8d06-48b0d7768a17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Converting VIF {"id": "9cecd3d6-4945-4a4b-8d06-48b0d7768a17", "address": "fa:16:3e:59:c6:53", "network": {"id": "b1b273e9-ac47-4985-9a15-ed6392eea58c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1944708022", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9f1d0ea8cbf74f10b81a10d3a7a6e716", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cecd3d6-49", "ovs_interfaceid": "9cecd3d6-4945-4a4b-8d06-48b0d7768a17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:c6:53,bridge_name='br-int',has_traffic_filtering=True,id=9cecd3d6-4945-4a4b-8d06-48b0d7768a17,network=Network(b1b273e9-ac47-4985-9a15-ed6392eea58c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cecd3d6-49') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG os_vif [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:c6:53,bridge_name='br-int',has_traffic_filtering=True,id=9cecd3d6-4945-4a4b-8d06-48b0d7768a17,network=Network(b1b273e9-ac47-4985-9a15-ed6392eea58c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cecd3d6-49') {{(pid=75165) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '91eac0cf-0f0c-5854-95e5-91c54c9ea20f', '_type': 'linux-noop'}}, row=False) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-01c62eee-4aec-435b-9e37-d65cd86cef91 tempest-VolumesAssistedSnapshotsTest-2020880117 tempest-VolumesAssistedSnapshotsTest-2020880117-project-admin] Acquiring lock "f326db85-74f6-4e60-9c55-46b2a59502d0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-01c62eee-4aec-435b-9e37-d65cd86cef91 tempest-VolumesAssistedSnapshotsTest-2020880117 tempest-VolumesAssistedSnapshotsTest-2020880117-project-admin] Lock "f326db85-74f6-4e60-9c55-46b2a59502d0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:09:58 user nova-compute[75165]: INFO nova.compute.manager [None req-01c62eee-4aec-435b-9e37-d65cd86cef91 tempest-VolumesAssistedSnapshotsTest-2020880117 tempest-VolumesAssistedSnapshotsTest-2020880117-project-admin] [instance: f326db85-74f6-4e60-9c55-46b2a59502d0] Detaching volume 014b6b5a-24b7-4afd-9fc3-50645f10fcd4
Oct 26 00:09:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9cecd3d6-49, may_exist=True, interface_attrs={}) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9cecd3d6-49, col_values=(('qos', UUID('13a7616a-7f64-4775-a644-924f3cdcf5aa')),), if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9cecd3d6-49, col_values=(('external_ids', {'iface-id': '9cecd3d6-4945-4a4b-8d06-48b0d7768a17', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:59:c6:53', 'vm-uuid': '8d5569ce-1f18-4f37-a340-099ee152d548'}),), if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:09:58 user nova-compute[75165]: INFO nova.virt.block_device [None req-01c62eee-4aec-435b-9e37-d65cd86cef91 tempest-VolumesAssistedSnapshotsTest-2020880117 tempest-VolumesAssistedSnapshotsTest-2020880117-project-admin] [instance: f326db85-74f6-4e60-9c55-46b2a59502d0] Attempting to driver detach volume 014b6b5a-24b7-4afd-9fc3-50645f10fcd4 from mountpoint /dev/vdb
Oct 26 00:09:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:09:58 user nova-compute[75165]: INFO os_vif [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:c6:53,bridge_name='br-int',has_traffic_filtering=True,id=9cecd3d6-4945-4a4b-8d06-48b0d7768a17,network=Network(b1b273e9-ac47-4985-9a15-ed6392eea58c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cecd3d6-49')
Oct 26 00:09:58 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T00:08:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-29517242',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-29517242',id=12,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCcUUhN8XRpaaJYv3vKPCPNNEkMMxDlKMi4jyG5F1k/oc6PfjbyEM9kim/n6zZPEK/ViRCrBDnWctXlihsGcJMeVYlhtqzvBMnS7wCLITtUfvAB80UeX7KgDk7Zm8Llyvw==',key_name='tempest-keypair-548626618',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9f1d0ea8cbf74f10b81a10d3a7a6e716',ramdisk_id='',reservation_id='r-y23b6svq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1432681902',owner_user_name='tempest-TaggedBootDevicesTest_v242-1432681902-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T00:08:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d25920439307445387df8d37c662d602',uuid=8d5569ce-1f18-4f37-a340-099ee152d548,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a04b8134-03e6-45f2-b6d7-3ea6a7deb81c", "address": "fa:16:3e:0a:29:45", "network": {"id": "75761f5b-dd19-4843-8db7-9cef3872583d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1377439333", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9f1d0ea8cbf74f10b81a10d3a7a6e716", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa04b8134-03", "ovs_interfaceid": "a04b8134-03e6-45f2-b6d7-3ea6a7deb81c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Converting VIF {"id": "a04b8134-03e6-45f2-b6d7-3ea6a7deb81c", "address": "fa:16:3e:0a:29:45", "network": {"id": "75761f5b-dd19-4843-8db7-9cef3872583d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1377439333", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9f1d0ea8cbf74f10b81a10d3a7a6e716", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa04b8134-03", "ovs_interfaceid": "a04b8134-03e6-45f2-b6d7-3ea6a7deb81c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:29:45,bridge_name='br-int',has_traffic_filtering=True,id=a04b8134-03e6-45f2-b6d7-3ea6a7deb81c,network=Network(75761f5b-dd19-4843-8db7-9cef3872583d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa04b8134-03') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG os_vif [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:29:45,bridge_name='br-int',has_traffic_filtering=True,id=a04b8134-03e6-45f2-b6d7-3ea6a7deb81c,network=Network(75761f5b-dd19-4843-8db7-9cef3872583d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa04b8134-03') {{(pid=75165) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd913a8a1-8d27-5fbf-b932-774f0447e68c', '_type': 'linux-noop'}}, row=False) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-01c62eee-4aec-435b-9e37-d65cd86cef91 tempest-VolumesAssistedSnapshotsTest-2020880117 tempest-VolumesAssistedSnapshotsTest-2020880117-project-admin] Attempting to detach device vdb from instance f326db85-74f6-4e60-9c55-46b2a59502d0 from the persistent domain config. {{(pid=75165) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG nova.virt.libvirt.guest [None req-01c62eee-4aec-435b-9e37-d65cd86cef91 tempest-VolumesAssistedSnapshotsTest-2020880117 tempest-VolumesAssistedSnapshotsTest-2020880117-project-admin] detach device xml: <disk type="block" device="disk">
Oct 26 00:09:58 user nova-compute[75165]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 00:09:58 user nova-compute[75165]:   <source dev="/dev/sde"/>
Oct 26 00:09:58 user nova-compute[75165]:   <target dev="vdb" bus="virtio"/>
Oct 26 00:09:58 user nova-compute[75165]:   <serial>014b6b5a-24b7-4afd-9fc3-50645f10fcd4</serial>
Oct 26 00:09:58 user nova-compute[75165]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 00:09:58 user nova-compute[75165]: </disk>
Oct 26 00:09:58 user nova-compute[75165]:  {{(pid=75165) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 00:09:58 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-01c62eee-4aec-435b-9e37-d65cd86cef91 tempest-VolumesAssistedSnapshotsTest-2020880117 tempest-VolumesAssistedSnapshotsTest-2020880117-project-admin] Successfully detached device vdb from instance f326db85-74f6-4e60-9c55-46b2a59502d0 from the persistent domain config.
Oct 26 00:09:58 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-01c62eee-4aec-435b-9e37-d65cd86cef91 tempest-VolumesAssistedSnapshotsTest-2020880117 tempest-VolumesAssistedSnapshotsTest-2020880117-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f326db85-74f6-4e60-9c55-46b2a59502d0 from the live domain config. {{(pid=75165) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG nova.virt.libvirt.guest [None req-01c62eee-4aec-435b-9e37-d65cd86cef91 tempest-VolumesAssistedSnapshotsTest-2020880117 tempest-VolumesAssistedSnapshotsTest-2020880117-project-admin] detach device xml: <disk type="block" device="disk">
Oct 26 00:09:58 user nova-compute[75165]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 00:09:58 user nova-compute[75165]:   <source dev="/dev/sde"/>
Oct 26 00:09:58 user nova-compute[75165]:   <target dev="vdb" bus="virtio"/>
Oct 26 00:09:58 user nova-compute[75165]:   <serial>014b6b5a-24b7-4afd-9fc3-50645f10fcd4</serial>
Oct 26 00:09:58 user nova-compute[75165]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 00:09:58 user nova-compute[75165]: </disk>
Oct 26 00:09:58 user nova-compute[75165]:  {{(pid=75165) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa04b8134-03, may_exist=True, interface_attrs={}) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa04b8134-03, col_values=(('qos', UUID('f6f74f87-ee7b-4c0c-a12d-fbc3d983c426')),), if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa04b8134-03, col_values=(('external_ids', {'iface-id': 'a04b8134-03e6-45f2-b6d7-3ea6a7deb81c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0a:29:45', 'vm-uuid': '8d5569ce-1f18-4f37-a340-099ee152d548'}),), if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:09:58 user nova-compute[75165]: INFO os_vif [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:29:45,bridge_name='br-int',has_traffic_filtering=True,id=a04b8134-03e6-45f2-b6d7-3ea6a7deb81c,network=Network(75761f5b-dd19-4843-8db7-9cef3872583d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa04b8134-03')
Oct 26 00:09:58 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T00:08:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-29517242',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-29517242',id=12,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCcUUhN8XRpaaJYv3vKPCPNNEkMMxDlKMi4jyG5F1k/oc6PfjbyEM9kim/n6zZPEK/ViRCrBDnWctXlihsGcJMeVYlhtqzvBMnS7wCLITtUfvAB80UeX7KgDk7Zm8Llyvw==',key_name='tempest-keypair-548626618',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9f1d0ea8cbf74f10b81a10d3a7a6e716',ramdisk_id='',reservation_id='r-y23b6svq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1432681902',owner_user_name='tempest-TaggedBootDevicesTest_v242-1432681902-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T00:08:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d25920439307445387df8d37c662d602',uuid=8d5569ce-1f18-4f37-a340-099ee152d548,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "03ee4dbc-d46d-4127-a4e0-d308a1c8beae", "address": "fa:16:3e:5b:46:e6", "network": {"id": "75761f5b-dd19-4843-8db7-9cef3872583d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1377439333", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9f1d0ea8cbf74f10b81a10d3a7a6e716", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03ee4dbc-d4", "ovs_interfaceid": "03ee4dbc-d46d-4127-a4e0-d308a1c8beae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Converting VIF {"id": "03ee4dbc-d46d-4127-a4e0-d308a1c8beae", "address": "fa:16:3e:5b:46:e6", "network": {"id": "75761f5b-dd19-4843-8db7-9cef3872583d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1377439333", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9f1d0ea8cbf74f10b81a10d3a7a6e716", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03ee4dbc-d4", "ovs_interfaceid": "03ee4dbc-d46d-4127-a4e0-d308a1c8beae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:46:e6,bridge_name='br-int',has_traffic_filtering=True,id=03ee4dbc-d46d-4127-a4e0-d308a1c8beae,network=Network(75761f5b-dd19-4843-8db7-9cef3872583d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03ee4dbc-d4') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG os_vif [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:46:e6,bridge_name='br-int',has_traffic_filtering=True,id=03ee4dbc-d46d-4127-a4e0-d308a1c8beae,network=Network(75761f5b-dd19-4843-8db7-9cef3872583d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03ee4dbc-d4') {{(pid=75165) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b84664b3-5cdb-585d-b534-88da70f00f28', '_type': 'linux-noop'}}, row=False) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:09:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:09:59 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:09:59 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:09:59 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap03ee4dbc-d4, may_exist=True, interface_attrs={}) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:09:59 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap03ee4dbc-d4, col_values=(('qos', UUID('4fc3b149-3b86-4613-9f89-0542c4516274')),), if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:09:59 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap03ee4dbc-d4, col_values=(('external_ids', {'iface-id': '03ee4dbc-d46d-4127-a4e0-d308a1c8beae', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5b:46:e6', 'vm-uuid': '8d5569ce-1f18-4f37-a340-099ee152d548'}),), if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:09:59 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:09:59 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:09:59 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:09:59 user nova-compute[75165]: INFO os_vif [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:46:e6,bridge_name='br-int',has_traffic_filtering=True,id=03ee4dbc-d46d-4127-a4e0-d308a1c8beae,network=Network(75761f5b-dd19-4843-8db7-9cef3872583d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03ee4dbc-d4')
Oct 26 00:09:59 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] No BDM found with device name hda, not building metadata. {{(pid=75165) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 00:09:59 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75165) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 00:09:59 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] No VIF found with MAC fa:16:3e:22:af:b4, not building metadata {{(pid=75165) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 00:09:59 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] No VIF found with MAC fa:16:3e:59:c6:53, not building metadata {{(pid=75165) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 00:09:59 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Using config drive
Oct 26 00:09:59 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-01c62eee-4aec-435b-9e37-d65cd86cef91 tempest-VolumesAssistedSnapshotsTest-2020880117 tempest-VolumesAssistedSnapshotsTest-2020880117-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f326db85-74f6-4e60-9c55-46b2a59502d0 {{(pid=75165) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 00:09:59 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Creating config drive at /opt/stack/data/nova/instances/8d5569ce-1f18-4f37-a340-099ee152d548/disk.config
Oct 26 00:09:59 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/8d5569ce-1f18-4f37-a340-099ee152d548/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpws4n4jwv {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:09:59 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/8d5569ce-1f18-4f37-a340-099ee152d548/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpws4n4jwv" returned: 0 in 0.073s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:10:00 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:10:00 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:10:00 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:10:00 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:10:01 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:10:01 user nova-compute[75165]: DEBUG nova.compute.manager [req-bf883448-f4da-44a6-b6ee-ac96293e33f8 req-86e3bad3-4214-4d0c-ab22-9fd9e2137020 service nova] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Received event network-vif-plugged-3da752ae-77a3-4bc3-8885-76331bc2d7d8 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:10:01 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-bf883448-f4da-44a6-b6ee-ac96293e33f8 req-86e3bad3-4214-4d0c-ab22-9fd9e2137020 service nova] Acquiring lock "8d5569ce-1f18-4f37-a340-099ee152d548-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:10:01 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-bf883448-f4da-44a6-b6ee-ac96293e33f8 req-86e3bad3-4214-4d0c-ab22-9fd9e2137020 service nova] Lock "8d5569ce-1f18-4f37-a340-099ee152d548-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:10:01 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-bf883448-f4da-44a6-b6ee-ac96293e33f8 req-86e3bad3-4214-4d0c-ab22-9fd9e2137020 service nova] Lock "8d5569ce-1f18-4f37-a340-099ee152d548-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:10:01 user nova-compute[75165]: DEBUG nova.compute.manager [req-bf883448-f4da-44a6-b6ee-ac96293e33f8 req-86e3bad3-4214-4d0c-ab22-9fd9e2137020 service nova] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] No waiting events found dispatching network-vif-plugged-3da752ae-77a3-4bc3-8885-76331bc2d7d8 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:10:01 user nova-compute[75165]: WARNING nova.compute.manager [req-bf883448-f4da-44a6-b6ee-ac96293e33f8 req-86e3bad3-4214-4d0c-ab22-9fd9e2137020 service nova] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Received unexpected event network-vif-plugged-3da752ae-77a3-4bc3-8885-76331bc2d7d8 for instance with vm_state building and task_state spawning.
Oct 26 00:10:01 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:10:01 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:10:01 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:10:01 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:10:01 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:10:01 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:10:01 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:10:01 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:10:01 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:10:01 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:10:01 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:10:02 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:10:02 user nova-compute[75165]: DEBUG nova.compute.manager [req-a79d7890-d5e4-40ad-a38d-09b0dbbacf29 req-41e6e3b1-51d5-4c40-82c6-eb8d4f88d407 service nova] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Received event network-vif-plugged-c019e949-c6fc-4014-9e42-13ce1eb17786 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:10:02 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-a79d7890-d5e4-40ad-a38d-09b0dbbacf29 req-41e6e3b1-51d5-4c40-82c6-eb8d4f88d407 service nova] Acquiring lock "8d5569ce-1f18-4f37-a340-099ee152d548-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:10:02 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-a79d7890-d5e4-40ad-a38d-09b0dbbacf29 req-41e6e3b1-51d5-4c40-82c6-eb8d4f88d407 service nova] Lock "8d5569ce-1f18-4f37-a340-099ee152d548-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:10:02 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-a79d7890-d5e4-40ad-a38d-09b0dbbacf29 req-41e6e3b1-51d5-4c40-82c6-eb8d4f88d407 service nova] Lock "8d5569ce-1f18-4f37-a340-099ee152d548-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:10:02 user nova-compute[75165]: DEBUG nova.compute.manager [req-a79d7890-d5e4-40ad-a38d-09b0dbbacf29 req-41e6e3b1-51d5-4c40-82c6-eb8d4f88d407 service nova] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] No waiting events found dispatching network-vif-plugged-c019e949-c6fc-4014-9e42-13ce1eb17786 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:10:02 user nova-compute[75165]: WARNING nova.compute.manager [req-a79d7890-d5e4-40ad-a38d-09b0dbbacf29 req-41e6e3b1-51d5-4c40-82c6-eb8d4f88d407 service nova] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Received unexpected event network-vif-plugged-c019e949-c6fc-4014-9e42-13ce1eb17786 for instance with vm_state building and task_state spawning.
Oct 26 00:10:02 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:10:02 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:10:02 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4892d96-d229-4a21-851b-b4d9594b940d tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] [instance: 45625147-ff69-496a-a41e-e55f818a020a] Calling os-brick to attach iSCSI Volume {{(pid=75165) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 00:10:02 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4892d96-d229-4a21-851b-b4d9594b940d tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8bf8160e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:45f3fb95-eff9-4a9a-a50b-cdbfee3840d8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ARaLnBGq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:10:02 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-a4892d96-d229-4a21-851b-b4d9594b940d tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:10:02 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-a4892d96-d229-4a21-851b-b4d9594b940d tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:10:02 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-a4892d96-d229-4a21-851b-b4d9594b940d tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:10:02 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-a4892d96-d229-4a21-851b-b4d9594b940d tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:10:02 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-a4892d96-d229-4a21-851b-b4d9594b940d tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:45f3fb95-eff9-4a9a-a50b-cdbfee3840d8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:10:02 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-a4892d96-d229-4a21-851b-b4d9594b940d tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:45f3fb95-eff9-4a9a-a50b-cdbfee3840d8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:10:02 user nova-compute[75165]: INFO os_brick.initiator.connectors.iscsi [None req-a4892d96-d229-4a21-851b-b4d9594b940d tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 00:10:02 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45f3fb95-eff9-4a9a-a50b-cdbfee3840d8 -p 172.16.0.220:3260 {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:10:02 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45f3fb95-eff9-4a9a-a50b-cdbfee3840d8 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:10:02 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[db4c870d-8c35-4e29-ab54-2ca1bd6d90da]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:10:02 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4892d96-d229-4a21-851b-b4d9594b940d tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 00:10:02 user nova-compute[75165]:  {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:10:02 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45f3fb95-eff9-4a9a-a50b-cdbfee3840d8 -p 172.16.0.220:3260 --interface default --op new {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:10:02 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45f3fb95-eff9-4a9a-a50b-cdbfee3840d8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:10:02 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[f347b0ac-7524-41eb-843d-a918a6461478]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:45f3fb95-eff9-4a9a-a50b-cdbfee3840d8] added\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:10:02 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4892d96-d229-4a21-851b-b4d9594b940d tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:45f3fb95-eff9-4a9a-a50b-cdbfee3840d8] added
Oct 26 00:10:02 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:10:02 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45f3fb95-eff9-4a9a-a50b-cdbfee3840d8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:10:02 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45f3fb95-eff9-4a9a-a50b-cdbfee3840d8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:10:02 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f8565b5-1bdb-4b12-a12d-e73e62d6b780]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:10:02 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:10:02 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4892d96-d229-4a21-851b-b4d9594b940d tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:10:02 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45f3fb95-eff9-4a9a-a50b-cdbfee3840d8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:10:02 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45f3fb95-eff9-4a9a-a50b-cdbfee3840d8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:10:02 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3e5aeb4-5c99-42e1-99ee-eacc46dfa15b]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:10:02 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4892d96-d229-4a21-851b-b4d9594b940d tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:10:02 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45f3fb95-eff9-4a9a-a50b-cdbfee3840d8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ARaLnBGq {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:10:02 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:10:02 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45f3fb95-eff9-4a9a-a50b-cdbfee3840d8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ARaLnBGq" returned: 0 in 0.024s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:10:02 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc5b2885-30f5-423e-9e08-2cb8647ea466]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:10:02 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4892d96-d229-4a21-851b-b4d9594b940d tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ARaLnBGq'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:10:02 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45f3fb95-eff9-4a9a-a50b-cdbfee3840d8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:10:02 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45f3fb95-eff9-4a9a-a50b-cdbfee3840d8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:10:02 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[b50288b4-0dec-4779-ab73-479e1248c14a]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:10:02 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4892d96-d229-4a21-851b-b4d9594b940d tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:10:02 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:10:02 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:10:02 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:10:02 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:10:02 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:10:02 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[9daf27b7-2ee2-4e57-936f-7d014e2e2819]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9d317ae-7dfa-4b25-9e3a-faa7ad5fed86 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f25f6e6a-9711-4455-82e8-c56648a08508 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:083f264a-3f29-48b4-9935-a73f4234e6d5 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:014b6b5a-24b7-4afd-9fc3-50645f10fcd4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff01f329-6dda-43b6-8da5-6a5c48fad211 (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:10:02 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4892d96-d229-4a21-851b-b4d9594b940d tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9d317ae-7dfa-4b25-9e3a-faa7ad5fed86 (non-flash)
Oct 26 00:10:02 user nova-compute[75165]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f25f6e6a-9711-4455-82e8-c56648a08508 (non-flash)
Oct 26 00:10:02 user nova-compute[75165]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:083f264a-3f29-48b4-9935-a73f4234e6d5 (non-flash)
Oct 26 00:10:02 user nova-compute[75165]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:014b6b5a-24b7-4afd-9fc3-50645f10fcd4 (non-flash)
Oct 26 00:10:02 user nova-compute[75165]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff01f329-6dda-43b6-8da5-6a5c48fad211 (non-flash)
Oct 26 00:10:02 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:10:02 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4892d96-d229-4a21-851b-b4d9594b940d tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9d317ae-7dfa-4b25-9e3a-faa7ad5fed86 (non-flash)
Oct 26 00:10:02 user nova-compute[75165]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f25f6e6a-9711-4455-82e8-c56648a08508 (non-flash)
Oct 26 00:10:02 user nova-compute[75165]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:083f264a-3f29-48b4-9935-a73f4234e6d5 (non-flash)
Oct 26 00:10:02 user nova-compute[75165]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:014b6b5a-24b7-4afd-9fc3-50645f10fcd4 (non-flash)
Oct 26 00:10:02 user nova-compute[75165]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff01f329-6dda-43b6-8da5-6a5c48fad211 (non-flash)
Oct 26 00:10:02 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:10:02 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45f3fb95-eff9-4a9a-a50b-cdbfee3840d8 -p 172.16.0.220:3260 --login {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:10:02 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:10:02 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45f3fb95-eff9-4a9a-a50b-cdbfee3840d8 -p 172.16.0.220:3260 --login" returned: 0 in 0.087s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:10:02 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff155057-11eb-4f37-837c-e900c49dff13]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:45f3fb95-eff9-4a9a-a50b-cdbfee3840d8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:45f3fb95-eff9-4a9a-a50b-cdbfee3840d8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:10:02 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4892d96-d229-4a21-851b-b4d9594b940d tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:45f3fb95-eff9-4a9a-a50b-cdbfee3840d8, portal: 172.16.0.220,3260]
Oct 26 00:10:02 user nova-compute[75165]: Login to [iface: default, target: iqn.2010-10.org.openstack:45f3fb95-eff9-4a9a-a50b-cdbfee3840d8, portal: 172.16.0.220,3260] successful.
Oct 26 00:10:02 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:10:02 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45f3fb95-eff9-4a9a-a50b-cdbfee3840d8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:10:02 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45f3fb95-eff9-4a9a-a50b-cdbfee3840d8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:10:02 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0ca715f-b7e2-4710-921d-002c9451f2dc]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:10:02 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4892d96-d229-4a21-851b-b4d9594b940d tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:10:02 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:10:02 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:10:02 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb8bec3a-1fac-445b-bbad-ebf34bfd2608]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9d317ae-7dfa-4b25-9e3a-faa7ad5fed86 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f25f6e6a-9711-4455-82e8-c56648a08508 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:083f264a-3f29-48b4-9935-a73f4234e6d5 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:014b6b5a-24b7-4afd-9fc3-50645f10fcd4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff01f329-6dda-43b6-8da5-6a5c48fad211 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45f3fb95-eff9-4a9a-a50b-cdbfee3840d8 (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:10:02 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4892d96-d229-4a21-851b-b4d9594b940d tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9d317ae-7dfa-4b25-9e3a-faa7ad5fed86 (non-flash)
Oct 26 00:10:02 user nova-compute[75165]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f25f6e6a-9711-4455-82e8-c56648a08508 (non-flash)
Oct 26 00:10:02 user nova-compute[75165]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:083f264a-3f29-48b4-9935-a73f4234e6d5 (non-flash)
Oct 26 00:10:02 user nova-compute[75165]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:014b6b5a-24b7-4afd-9fc3-50645f10fcd4 (non-flash)
Oct 26 00:10:02 user nova-compute[75165]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff01f329-6dda-43b6-8da5-6a5c48fad211 (non-flash)
Oct 26 00:10:02 user nova-compute[75165]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45f3fb95-eff9-4a9a-a50b-cdbfee3840d8 (non-flash)
Oct 26 00:10:02 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:10:02 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4892d96-d229-4a21-851b-b4d9594b940d tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9d317ae-7dfa-4b25-9e3a-faa7ad5fed86 (non-flash)
Oct 26 00:10:02 user nova-compute[75165]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f25f6e6a-9711-4455-82e8-c56648a08508 (non-flash)
Oct 26 00:10:02 user nova-compute[75165]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:083f264a-3f29-48b4-9935-a73f4234e6d5 (non-flash)
Oct 26 00:10:02 user nova-compute[75165]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:014b6b5a-24b7-4afd-9fc3-50645f10fcd4 (non-flash)
Oct 26 00:10:02 user nova-compute[75165]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff01f329-6dda-43b6-8da5-6a5c48fad211 (non-flash)
Oct 26 00:10:02 user nova-compute[75165]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45f3fb95-eff9-4a9a-a50b-cdbfee3840d8 (non-flash)
Oct 26 00:10:02 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:10:02 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-a4892d96-d229-4a21-851b-b4d9594b940d tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:45f3fb95-eff9-4a9a-a50b-cdbfee3840d8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.389s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:10:02 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4892d96-d229-4a21-851b-b4d9594b940d tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] Connected to 172.16.0.220:3260 {{(pid=75165) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 00:10:02 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-a4892d96-d229-4a21-851b-b4d9594b940d tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] HCTL ('38', '-', '-', 0) found on session 8 with lun 0 {{(pid=75165) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 00:10:02 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-a4892d96-d229-4a21-851b-b4d9594b940d tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75165) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 00:10:02 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:10:02 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:10:02 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.029s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:10:02 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[b32c22f8-a9b8-4977-8e08-251d451560d5]: (4, ('- - 0', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:10:02 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-a4892d96-d229-4a21-851b-b4d9594b940d tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] Searching for a device in session 8 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75165) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 00:10:02 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4892d96-d229-4a21-851b-b4d9594b940d tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:45f3fb95-eff9-4a9a-a50b-cdbfee3840d8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ARaLnBGq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75165) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 00:10:02 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:10:02 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:10:03 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:10:03 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:10:03 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:10:03 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:10:03 user nova-compute[75165]: DEBUG nova.compute.manager [req-47b3ff73-a644-449d-8df4-e329634e1cb1 req-6458ff18-4b0c-4840-9491-abfbcf5b7bd6 service nova] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Received event network-vif-plugged-3da752ae-77a3-4bc3-8885-76331bc2d7d8 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:10:03 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-47b3ff73-a644-449d-8df4-e329634e1cb1 req-6458ff18-4b0c-4840-9491-abfbcf5b7bd6 service nova] Acquiring lock "8d5569ce-1f18-4f37-a340-099ee152d548-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:10:03 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-47b3ff73-a644-449d-8df4-e329634e1cb1 req-6458ff18-4b0c-4840-9491-abfbcf5b7bd6 service nova] Lock "8d5569ce-1f18-4f37-a340-099ee152d548-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:10:03 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-47b3ff73-a644-449d-8df4-e329634e1cb1 req-6458ff18-4b0c-4840-9491-abfbcf5b7bd6 service nova] Lock "8d5569ce-1f18-4f37-a340-099ee152d548-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:10:03 user nova-compute[75165]: DEBUG nova.compute.manager [req-47b3ff73-a644-449d-8df4-e329634e1cb1 req-6458ff18-4b0c-4840-9491-abfbcf5b7bd6 service nova] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] No waiting events found dispatching network-vif-plugged-3da752ae-77a3-4bc3-8885-76331bc2d7d8 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:10:03 user nova-compute[75165]: WARNING nova.compute.manager [req-47b3ff73-a644-449d-8df4-e329634e1cb1 req-6458ff18-4b0c-4840-9491-abfbcf5b7bd6 service nova] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Received unexpected event network-vif-plugged-3da752ae-77a3-4bc3-8885-76331bc2d7d8 for instance with vm_state building and task_state spawning.
Oct 26 00:10:03 user nova-compute[75165]: DEBUG nova.compute.manager [req-47b3ff73-a644-449d-8df4-e329634e1cb1 req-6458ff18-4b0c-4840-9491-abfbcf5b7bd6 service nova] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Received event network-vif-plugged-b9583014-bb07-4337-97bb-30001c05475f {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:10:03 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-47b3ff73-a644-449d-8df4-e329634e1cb1 req-6458ff18-4b0c-4840-9491-abfbcf5b7bd6 service nova] Acquiring lock "8d5569ce-1f18-4f37-a340-099ee152d548-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:10:03 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-47b3ff73-a644-449d-8df4-e329634e1cb1 req-6458ff18-4b0c-4840-9491-abfbcf5b7bd6 service nova] Lock "8d5569ce-1f18-4f37-a340-099ee152d548-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:10:03 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-47b3ff73-a644-449d-8df4-e329634e1cb1 req-6458ff18-4b0c-4840-9491-abfbcf5b7bd6 service nova] Lock "8d5569ce-1f18-4f37-a340-099ee152d548-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:10:03 user nova-compute[75165]: DEBUG nova.compute.manager [req-47b3ff73-a644-449d-8df4-e329634e1cb1 req-6458ff18-4b0c-4840-9491-abfbcf5b7bd6 service nova] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] No waiting events found dispatching network-vif-plugged-b9583014-bb07-4337-97bb-30001c05475f {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:10:03 user nova-compute[75165]: WARNING nova.compute.manager [req-47b3ff73-a644-449d-8df4-e329634e1cb1 req-6458ff18-4b0c-4840-9491-abfbcf5b7bd6 service nova] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Received unexpected event network-vif-plugged-b9583014-bb07-4337-97bb-30001c05475f for instance with vm_state building and task_state spawning.
Oct 26 00:10:03 user nova-compute[75165]: DEBUG nova.compute.manager [req-47b3ff73-a644-449d-8df4-e329634e1cb1 req-6458ff18-4b0c-4840-9491-abfbcf5b7bd6 service nova] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Received event network-vif-plugged-b9583014-bb07-4337-97bb-30001c05475f {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:10:03 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-47b3ff73-a644-449d-8df4-e329634e1cb1 req-6458ff18-4b0c-4840-9491-abfbcf5b7bd6 service nova] Acquiring lock "8d5569ce-1f18-4f37-a340-099ee152d548-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:10:03 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-47b3ff73-a644-449d-8df4-e329634e1cb1 req-6458ff18-4b0c-4840-9491-abfbcf5b7bd6 service nova] Lock "8d5569ce-1f18-4f37-a340-099ee152d548-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:10:03 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-47b3ff73-a644-449d-8df4-e329634e1cb1 req-6458ff18-4b0c-4840-9491-abfbcf5b7bd6 service nova] Lock "8d5569ce-1f18-4f37-a340-099ee152d548-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:10:03 user nova-compute[75165]: DEBUG nova.compute.manager [req-47b3ff73-a644-449d-8df4-e329634e1cb1 req-6458ff18-4b0c-4840-9491-abfbcf5b7bd6 service nova] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] No waiting events found dispatching network-vif-plugged-b9583014-bb07-4337-97bb-30001c05475f {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:10:03 user nova-compute[75165]: WARNING nova.compute.manager [req-47b3ff73-a644-449d-8df4-e329634e1cb1 req-6458ff18-4b0c-4840-9491-abfbcf5b7bd6 service nova] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Received unexpected event network-vif-plugged-b9583014-bb07-4337-97bb-30001c05475f for instance with vm_state building and task_state spawning.
Oct 26 00:10:03 user nova-compute[75165]: DEBUG nova.compute.manager [req-47b3ff73-a644-449d-8df4-e329634e1cb1 req-6458ff18-4b0c-4840-9491-abfbcf5b7bd6 service nova] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Received event network-vif-plugged-c51f288f-44b9-476b-9419-22ef8ae5c900 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:10:03 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-47b3ff73-a644-449d-8df4-e329634e1cb1 req-6458ff18-4b0c-4840-9491-abfbcf5b7bd6 service nova] Acquiring lock "8d5569ce-1f18-4f37-a340-099ee152d548-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:10:03 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-47b3ff73-a644-449d-8df4-e329634e1cb1 req-6458ff18-4b0c-4840-9491-abfbcf5b7bd6 service nova] Lock "8d5569ce-1f18-4f37-a340-099ee152d548-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:10:03 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-47b3ff73-a644-449d-8df4-e329634e1cb1 req-6458ff18-4b0c-4840-9491-abfbcf5b7bd6 service nova] Lock "8d5569ce-1f18-4f37-a340-099ee152d548-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:10:03 user nova-compute[75165]: DEBUG nova.compute.manager [req-47b3ff73-a644-449d-8df4-e329634e1cb1 req-6458ff18-4b0c-4840-9491-abfbcf5b7bd6 service nova] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] No waiting events found dispatching network-vif-plugged-c51f288f-44b9-476b-9419-22ef8ae5c900 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:10:03 user nova-compute[75165]: WARNING nova.compute.manager [req-47b3ff73-a644-449d-8df4-e329634e1cb1 req-6458ff18-4b0c-4840-9491-abfbcf5b7bd6 service nova] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Received unexpected event network-vif-plugged-c51f288f-44b9-476b-9419-22ef8ae5c900 for instance with vm_state building and task_state spawning.
Oct 26 00:10:03 user nova-compute[75165]: DEBUG nova.compute.manager [req-47b3ff73-a644-449d-8df4-e329634e1cb1 req-6458ff18-4b0c-4840-9491-abfbcf5b7bd6 service nova] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Received event network-vif-plugged-c51f288f-44b9-476b-9419-22ef8ae5c900 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:10:03 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-47b3ff73-a644-449d-8df4-e329634e1cb1 req-6458ff18-4b0c-4840-9491-abfbcf5b7bd6 service nova] Acquiring lock "8d5569ce-1f18-4f37-a340-099ee152d548-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:10:03 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-47b3ff73-a644-449d-8df4-e329634e1cb1 req-6458ff18-4b0c-4840-9491-abfbcf5b7bd6 service nova] Lock "8d5569ce-1f18-4f37-a340-099ee152d548-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:10:03 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-47b3ff73-a644-449d-8df4-e329634e1cb1 req-6458ff18-4b0c-4840-9491-abfbcf5b7bd6 service nova] Lock "8d5569ce-1f18-4f37-a340-099ee152d548-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:10:03 user nova-compute[75165]: DEBUG nova.compute.manager [req-47b3ff73-a644-449d-8df4-e329634e1cb1 req-6458ff18-4b0c-4840-9491-abfbcf5b7bd6 service nova] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] No waiting events found dispatching network-vif-plugged-c51f288f-44b9-476b-9419-22ef8ae5c900 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:10:03 user nova-compute[75165]: WARNING nova.compute.manager [req-47b3ff73-a644-449d-8df4-e329634e1cb1 req-6458ff18-4b0c-4840-9491-abfbcf5b7bd6 service nova] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Received unexpected event network-vif-plugged-c51f288f-44b9-476b-9419-22ef8ae5c900 for instance with vm_state building and task_state spawning.
Oct 26 00:10:03 user nova-compute[75165]: DEBUG nova.compute.manager [req-47b3ff73-a644-449d-8df4-e329634e1cb1 req-6458ff18-4b0c-4840-9491-abfbcf5b7bd6 service nova] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Received event network-vif-plugged-9cecd3d6-4945-4a4b-8d06-48b0d7768a17 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:10:03 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-47b3ff73-a644-449d-8df4-e329634e1cb1 req-6458ff18-4b0c-4840-9491-abfbcf5b7bd6 service nova] Acquiring lock "8d5569ce-1f18-4f37-a340-099ee152d548-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:10:03 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-47b3ff73-a644-449d-8df4-e329634e1cb1 req-6458ff18-4b0c-4840-9491-abfbcf5b7bd6 service nova] Lock "8d5569ce-1f18-4f37-a340-099ee152d548-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:10:03 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-47b3ff73-a644-449d-8df4-e329634e1cb1 req-6458ff18-4b0c-4840-9491-abfbcf5b7bd6 service nova] Lock "8d5569ce-1f18-4f37-a340-099ee152d548-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:10:03 user nova-compute[75165]: DEBUG nova.compute.manager [req-47b3ff73-a644-449d-8df4-e329634e1cb1 req-6458ff18-4b0c-4840-9491-abfbcf5b7bd6 service nova] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] No waiting events found dispatching network-vif-plugged-9cecd3d6-4945-4a4b-8d06-48b0d7768a17 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:10:03 user nova-compute[75165]: WARNING nova.compute.manager [req-47b3ff73-a644-449d-8df4-e329634e1cb1 req-6458ff18-4b0c-4840-9491-abfbcf5b7bd6 service nova] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Received unexpected event network-vif-plugged-9cecd3d6-4945-4a4b-8d06-48b0d7768a17 for instance with vm_state building and task_state spawning.
Oct 26 00:10:03 user nova-compute[75165]: DEBUG nova.compute.manager [req-47b3ff73-a644-449d-8df4-e329634e1cb1 req-6458ff18-4b0c-4840-9491-abfbcf5b7bd6 service nova] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Received event network-vif-plugged-9cecd3d6-4945-4a4b-8d06-48b0d7768a17 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:10:03 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-47b3ff73-a644-449d-8df4-e329634e1cb1 req-6458ff18-4b0c-4840-9491-abfbcf5b7bd6 service nova] Acquiring lock "8d5569ce-1f18-4f37-a340-099ee152d548-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:10:03 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-47b3ff73-a644-449d-8df4-e329634e1cb1 req-6458ff18-4b0c-4840-9491-abfbcf5b7bd6 service nova] Lock "8d5569ce-1f18-4f37-a340-099ee152d548-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:10:03 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-47b3ff73-a644-449d-8df4-e329634e1cb1 req-6458ff18-4b0c-4840-9491-abfbcf5b7bd6 service nova] Lock "8d5569ce-1f18-4f37-a340-099ee152d548-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:10:03 user nova-compute[75165]: DEBUG nova.compute.manager [req-47b3ff73-a644-449d-8df4-e329634e1cb1 req-6458ff18-4b0c-4840-9491-abfbcf5b7bd6 service nova] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] No waiting events found dispatching network-vif-plugged-9cecd3d6-4945-4a4b-8d06-48b0d7768a17 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:10:03 user nova-compute[75165]: WARNING nova.compute.manager [req-47b3ff73-a644-449d-8df4-e329634e1cb1 req-6458ff18-4b0c-4840-9491-abfbcf5b7bd6 service nova] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Received unexpected event network-vif-plugged-9cecd3d6-4945-4a4b-8d06-48b0d7768a17 for instance with vm_state building and task_state spawning.
Oct 26 00:10:03 user nova-compute[75165]: DEBUG nova.compute.manager [req-47b3ff73-a644-449d-8df4-e329634e1cb1 req-6458ff18-4b0c-4840-9491-abfbcf5b7bd6 service nova] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Received event network-vif-plugged-a04b8134-03e6-45f2-b6d7-3ea6a7deb81c {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:10:03 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-47b3ff73-a644-449d-8df4-e329634e1cb1 req-6458ff18-4b0c-4840-9491-abfbcf5b7bd6 service nova] Acquiring lock "8d5569ce-1f18-4f37-a340-099ee152d548-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:10:03 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-47b3ff73-a644-449d-8df4-e329634e1cb1 req-6458ff18-4b0c-4840-9491-abfbcf5b7bd6 service nova] Lock "8d5569ce-1f18-4f37-a340-099ee152d548-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:10:03 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-47b3ff73-a644-449d-8df4-e329634e1cb1 req-6458ff18-4b0c-4840-9491-abfbcf5b7bd6 service nova] Lock "8d5569ce-1f18-4f37-a340-099ee152d548-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:10:03 user nova-compute[75165]: DEBUG nova.compute.manager [req-47b3ff73-a644-449d-8df4-e329634e1cb1 req-6458ff18-4b0c-4840-9491-abfbcf5b7bd6 service nova] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] No waiting events found dispatching network-vif-plugged-a04b8134-03e6-45f2-b6d7-3ea6a7deb81c {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:10:03 user nova-compute[75165]: WARNING nova.compute.manager [req-47b3ff73-a644-449d-8df4-e329634e1cb1 req-6458ff18-4b0c-4840-9491-abfbcf5b7bd6 service nova] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Received unexpected event network-vif-plugged-a04b8134-03e6-45f2-b6d7-3ea6a7deb81c for instance with vm_state building and task_state spawning.
Oct 26 00:10:03 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:10:03 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:10:03 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-a4892d96-d229-4a21-851b-b4d9594b940d tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.441s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:10:03 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4892d96-d229-4a21-851b-b4d9594b940d tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] <== connect_volume: return (1442ms) {'type': 'block', 'scsi_wwn': '26437306663616534', 'path': '/dev/sdg'} {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:10:03 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4892d96-d229-4a21-851b-b4d9594b940d tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] [instance: 45625147-ff69-496a-a41e-e55f818a020a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26437306663616534', 'path': '/dev/sdg'} {{(pid=75165) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 00:10:03 user nova-compute[75165]: DEBUG nova.objects.instance [None req-a4892d96-d229-4a21-851b-b4d9594b940d tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] Lazy-loading 'flavor' on Instance uuid 45625147-ff69-496a-a41e-e55f818a020a {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:10:03 user nova-compute[75165]: DEBUG nova.virt.libvirt.guest [None req-a4892d96-d229-4a21-851b-b4d9594b940d tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 00:10:03 user nova-compute[75165]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 00:10:03 user nova-compute[75165]:   <source dev="/dev/sdg"/>
Oct 26 00:10:03 user nova-compute[75165]:   <target dev="vdb" bus="virtio"/>
Oct 26 00:10:03 user nova-compute[75165]:   <serial>45f3fb95-eff9-4a9a-a50b-cdbfee3840d8</serial>
Oct 26 00:10:03 user nova-compute[75165]: </disk>
Oct 26 00:10:03 user nova-compute[75165]:  {{(pid=75165) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 00:10:04 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:10:04 user nova-compute[75165]: DEBUG nova.compute.manager [req-77885d24-7f32-4c33-8a63-3364528c4da2 req-3a82f558-2724-4b11-afd8-c45eb30cf638 service nova] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Received event network-vif-plugged-c019e949-c6fc-4014-9e42-13ce1eb17786 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:10:04 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-77885d24-7f32-4c33-8a63-3364528c4da2 req-3a82f558-2724-4b11-afd8-c45eb30cf638 service nova] Acquiring lock "8d5569ce-1f18-4f37-a340-099ee152d548-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:10:04 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-77885d24-7f32-4c33-8a63-3364528c4da2 req-3a82f558-2724-4b11-afd8-c45eb30cf638 service nova] Lock "8d5569ce-1f18-4f37-a340-099ee152d548-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:10:04 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-77885d24-7f32-4c33-8a63-3364528c4da2 req-3a82f558-2724-4b11-afd8-c45eb30cf638 service nova] Lock "8d5569ce-1f18-4f37-a340-099ee152d548-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:10:04 user nova-compute[75165]: DEBUG nova.compute.manager [req-77885d24-7f32-4c33-8a63-3364528c4da2 req-3a82f558-2724-4b11-afd8-c45eb30cf638 service nova] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] No waiting events found dispatching network-vif-plugged-c019e949-c6fc-4014-9e42-13ce1eb17786 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:10:04 user nova-compute[75165]: WARNING nova.compute.manager [req-77885d24-7f32-4c33-8a63-3364528c4da2 req-3a82f558-2724-4b11-afd8-c45eb30cf638 service nova] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Received unexpected event network-vif-plugged-c019e949-c6fc-4014-9e42-13ce1eb17786 for instance with vm_state building and task_state spawning.
Oct 26 00:10:04 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:10:04 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:10:04 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:10:04 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:10:04 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-a4892d96-d229-4a21-851b-b4d9594b940d tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] No BDM found with device name vda, not building metadata. {{(pid=75165) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 00:10:04 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-a4892d96-d229-4a21-851b-b4d9594b940d tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75165) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 00:10:04 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-a4892d96-d229-4a21-851b-b4d9594b940d tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] No VIF found with MAC fa:16:3e:1f:92:cd, not building metadata {{(pid=75165) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 00:10:04 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:10:04 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:10:04 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-a4892d96-d229-4a21-851b-b4d9594b940d tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] Lock "45625147-ff69-496a-a41e-e55f818a020a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.903s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:10:05 user nova-compute[75165]: DEBUG nova.compute.manager [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Instance event wait completed in 0 seconds for  {{(pid=75165) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 00:10:05 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Guest created on hypervisor {{(pid=75165) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 00:10:05 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Instance spawned successfully.
Oct 26 00:10:05 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 00:10:05 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Found default for hw_cdrom_bus of ide {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:10:05 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Found default for hw_disk_bus of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:10:05 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Found default for hw_input_bus of None {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:10:05 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Found default for hw_pointer_model of None {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:10:05 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Found default for hw_video_model of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:10:05 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Found default for hw_vif_model of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:10:05 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-b6d019fa-4b45-40eb-b525-357321587630 tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] Acquiring lock "45625147-ff69-496a-a41e-e55f818a020a" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:10:05 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-b6d019fa-4b45-40eb-b525-357321587630 tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] Lock "45625147-ff69-496a-a41e-e55f818a020a" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:10:05 user nova-compute[75165]: INFO nova.compute.manager [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Took 12.28 seconds to spawn the instance on the hypervisor.
Oct 26 00:10:05 user nova-compute[75165]: DEBUG nova.compute.manager [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Checking state {{(pid=75165) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 00:10:05 user nova-compute[75165]: DEBUG os_brick.utils [None req-b6d019fa-4b45-40eb-b525-357321587630 tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:10:05 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:10:05 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:10:05 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[64320d8a-da3f-498a-ad82-754f606f14d4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa94814ccb35\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:10:05 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:10:05 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:10:05 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[76355d41-388e-4092-a616-009ee85569f8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:10:05 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:10:05 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:10:05 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[04dbd254-b011-4944-8c23-92d7ae8d065a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:10:05 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea4bebad-6889-4cbb-ad15-dd337306c85f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:10:05 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-b6d019fa-4b45-40eb-b525-357321587630 tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] Running cmd (subprocess): nvme version {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:10:05 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-b6d019fa-4b45-40eb-b525-357321587630 tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 00:10:05 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b6d019fa-4b45-40eb-b525-357321587630 tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] nvme not present on system {{(pid=75165) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 00:10:05 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:10:05 user nova-compute[75165]: DEBUG nova.compute.manager [req-cc675ef8-0c66-48c9-b2a5-e52b2ad911ce req-ce4dc33a-b279-4e4d-a7d0-485a1806e297 service nova] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Received event network-vif-plugged-a04b8134-03e6-45f2-b6d7-3ea6a7deb81c {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:10:05 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-cc675ef8-0c66-48c9-b2a5-e52b2ad911ce req-ce4dc33a-b279-4e4d-a7d0-485a1806e297 service nova] Acquiring lock "8d5569ce-1f18-4f37-a340-099ee152d548-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:10:05 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-cc675ef8-0c66-48c9-b2a5-e52b2ad911ce req-ce4dc33a-b279-4e4d-a7d0-485a1806e297 service nova] Lock "8d5569ce-1f18-4f37-a340-099ee152d548-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:10:05 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-cc675ef8-0c66-48c9-b2a5-e52b2ad911ce req-ce4dc33a-b279-4e4d-a7d0-485a1806e297 service nova] Lock "8d5569ce-1f18-4f37-a340-099ee152d548-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:10:05 user nova-compute[75165]: DEBUG nova.compute.manager [req-cc675ef8-0c66-48c9-b2a5-e52b2ad911ce req-ce4dc33a-b279-4e4d-a7d0-485a1806e297 service nova] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] No waiting events found dispatching network-vif-plugged-a04b8134-03e6-45f2-b6d7-3ea6a7deb81c {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:10:05 user nova-compute[75165]: WARNING nova.compute.manager [req-cc675ef8-0c66-48c9-b2a5-e52b2ad911ce req-ce4dc33a-b279-4e4d-a7d0-485a1806e297 service nova] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Received unexpected event network-vif-plugged-a04b8134-03e6-45f2-b6d7-3ea6a7deb81c for instance with vm_state active and task_state None.
Oct 26 00:10:05 user nova-compute[75165]: DEBUG nova.compute.manager [req-cc675ef8-0c66-48c9-b2a5-e52b2ad911ce req-ce4dc33a-b279-4e4d-a7d0-485a1806e297 service nova] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Received event network-vif-plugged-03ee4dbc-d46d-4127-a4e0-d308a1c8beae {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:10:05 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-cc675ef8-0c66-48c9-b2a5-e52b2ad911ce req-ce4dc33a-b279-4e4d-a7d0-485a1806e297 service nova] Acquiring lock "8d5569ce-1f18-4f37-a340-099ee152d548-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:10:05 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-cc675ef8-0c66-48c9-b2a5-e52b2ad911ce req-ce4dc33a-b279-4e4d-a7d0-485a1806e297 service nova] Lock "8d5569ce-1f18-4f37-a340-099ee152d548-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:10:05 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-cc675ef8-0c66-48c9-b2a5-e52b2ad911ce req-ce4dc33a-b279-4e4d-a7d0-485a1806e297 service nova] Lock "8d5569ce-1f18-4f37-a340-099ee152d548-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:10:05 user nova-compute[75165]: DEBUG nova.compute.manager [req-cc675ef8-0c66-48c9-b2a5-e52b2ad911ce req-ce4dc33a-b279-4e4d-a7d0-485a1806e297 service nova] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] No waiting events found dispatching network-vif-plugged-03ee4dbc-d46d-4127-a4e0-d308a1c8beae {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:10:05 user nova-compute[75165]: WARNING nova.compute.manager [req-cc675ef8-0c66-48c9-b2a5-e52b2ad911ce req-ce4dc33a-b279-4e4d-a7d0-485a1806e297 service nova] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Received unexpected event network-vif-plugged-03ee4dbc-d46d-4127-a4e0-d308a1c8beae for instance with vm_state active and task_state None.
Oct 26 00:10:05 user nova-compute[75165]: DEBUG nova.compute.manager [req-cc675ef8-0c66-48c9-b2a5-e52b2ad911ce req-ce4dc33a-b279-4e4d-a7d0-485a1806e297 service nova] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Received event network-vif-plugged-03ee4dbc-d46d-4127-a4e0-d308a1c8beae {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:10:05 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-cc675ef8-0c66-48c9-b2a5-e52b2ad911ce req-ce4dc33a-b279-4e4d-a7d0-485a1806e297 service nova] Acquiring lock "8d5569ce-1f18-4f37-a340-099ee152d548-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:10:05 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-cc675ef8-0c66-48c9-b2a5-e52b2ad911ce req-ce4dc33a-b279-4e4d-a7d0-485a1806e297 service nova] Lock "8d5569ce-1f18-4f37-a340-099ee152d548-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:10:05 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-cc675ef8-0c66-48c9-b2a5-e52b2ad911ce req-ce4dc33a-b279-4e4d-a7d0-485a1806e297 service nova] Lock "8d5569ce-1f18-4f37-a340-099ee152d548-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:10:05 user nova-compute[75165]: DEBUG nova.compute.manager [req-cc675ef8-0c66-48c9-b2a5-e52b2ad911ce req-ce4dc33a-b279-4e4d-a7d0-485a1806e297 service nova] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] No waiting events found dispatching network-vif-plugged-03ee4dbc-d46d-4127-a4e0-d308a1c8beae {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:10:05 user nova-compute[75165]: WARNING nova.compute.manager [req-cc675ef8-0c66-48c9-b2a5-e52b2ad911ce req-ce4dc33a-b279-4e4d-a7d0-485a1806e297 service nova] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Received unexpected event network-vif-plugged-03ee4dbc-d46d-4127-a4e0-d308a1c8beae for instance with vm_state active and task_state None.
Oct 26 00:10:05 user nova-compute[75165]: INFO nova.compute.manager [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Took 75.05 seconds to build instance.
Oct 26 00:10:05 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 00:10:05 user nova-compute[75165]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 00:10:05 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[13c48ad9-9e1c-488e-878d-60ed8b9b73b6]: (4, '') {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:10:05 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-b6d019fa-4b45-40eb-b525-357321587630 tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75165) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 00:10:05 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-b6d019fa-4b45-40eb-b525-357321587630 tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75165) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 00:10:05 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-b6d019fa-4b45-40eb-b525-357321587630 tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] LIGHTOS: no hostnqn found. {{(pid=75165) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 00:10:05 user nova-compute[75165]: DEBUG os_brick.utils [None req-b6d019fa-4b45-40eb-b525-357321587630 tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] <== get_connector_properties: return (151ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa94814ccb35', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:10:05 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-e0b0e8ea-4bb2-47de-a1d3-0bff557959a2 tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Lock "8d5569ce-1f18-4f37-a340-099ee152d548" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 75.172s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:10:05 user nova-compute[75165]: INFO nova.compute.manager [None req-b6d019fa-4b45-40eb-b525-357321587630 tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] [instance: 45625147-ff69-496a-a41e-e55f818a020a] Swapping volume 45f3fb95-eff9-4a9a-a50b-cdbfee3840d8 for 6bea2b74-7b28-4314-9a5a-14a1eeaf4a67
Oct 26 00:10:05 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:10:08 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:10:08 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:10:08 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Starting heal instance info cache {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 00:10:08 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "refresh_cache-c4e44bfc-6a68-46ce-8335-aaaba5160d3e" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:10:08 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquired lock "refresh_cache-c4e44bfc-6a68-46ce-8335-aaaba5160d3e" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:10:08 user nova-compute[75165]: DEBUG nova.network.neutron [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: c4e44bfc-6a68-46ce-8335-aaaba5160d3e] Forcefully refreshing network info cache for instance {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 00:10:08 user nova-compute[75165]: DEBUG nova.network.neutron [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: c4e44bfc-6a68-46ce-8335-aaaba5160d3e] Updating instance_info_cache with network_info: [{"id": "842f3b7a-8da7-48d2-90f7-7241fbaab648", "address": "fa:16:3e:1f:64:04", "network": {"id": "b31bac4b-1951-4ca3-8682-f1f24de0a5c3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1323234642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71aa69c0ea2d49e184e1e055ff3efa1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap842f3b7a-8d", "ovs_interfaceid": "842f3b7a-8da7-48d2-90f7-7241fbaab648", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:10:08 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Releasing lock "refresh_cache-c4e44bfc-6a68-46ce-8335-aaaba5160d3e" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:10:08 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: c4e44bfc-6a68-46ce-8335-aaaba5160d3e] Updated the network info_cache for instance {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 00:10:08 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:10:08 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:10:08 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:10:08 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:10:08 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:10:08 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:10:08 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75165) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 00:10:08 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:10:08 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:10:08 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:10:08 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:10:08 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75165) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 00:10:08 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9633e6bb-5e95-4994-92a2-9d8f85a946ff/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:10:09 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:10:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9633e6bb-5e95-4994-92a2-9d8f85a946ff/disk --force-share --output=json" returned: 0 in 0.387s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:10:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9633e6bb-5e95-4994-92a2-9d8f85a946ff/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:10:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9633e6bb-5e95-4994-92a2-9d8f85a946ff/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:10:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84c6b624-648b-40e2-a37e-ff08609bad84/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:10:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84c6b624-648b-40e2-a37e-ff08609bad84/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:10:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84c6b624-648b-40e2-a37e-ff08609bad84/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:10:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84c6b624-648b-40e2-a37e-ff08609bad84/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:10:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7eeb145-1565-4812-818b-fefda5f2436d/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:10:10 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7eeb145-1565-4812-818b-fefda5f2436d/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:10:10 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7eeb145-1565-4812-818b-fefda5f2436d/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:10:10 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7eeb145-1565-4812-818b-fefda5f2436d/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:10:10 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45625147-ff69-496a-a41e-e55f818a020a/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:10:10 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:10:10 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45625147-ff69-496a-a41e-e55f818a020a/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:10:10 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45625147-ff69-496a-a41e-e55f818a020a/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:10:10 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45625147-ff69-496a-a41e-e55f818a020a/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:10:10 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=75165) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 00:10:10 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75165) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 00:10:10 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75165) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 00:10:10 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=75165) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 00:10:10 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/018ca455-eace-412d-86a3-d914b4af30d5/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:10:11 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/018ca455-eace-412d-86a3-d914b4af30d5/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:10:11 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/018ca455-eace-412d-86a3-d914b4af30d5/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:10:11 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/018ca455-eace-412d-86a3-d914b4af30d5/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:10:11 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26a0b493-bb47-466e-95d5-945fc3849fa5/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:10:11 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26a0b493-bb47-466e-95d5-945fc3849fa5/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:10:11 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26a0b493-bb47-466e-95d5-945fc3849fa5/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:10:11 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26a0b493-bb47-466e-95d5-945fc3849fa5/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:10:11 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e44bfc-6a68-46ce-8335-aaaba5160d3e/disk.rescue --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:10:11 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e44bfc-6a68-46ce-8335-aaaba5160d3e/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:10:11 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e44bfc-6a68-46ce-8335-aaaba5160d3e/disk.rescue --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:10:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e44bfc-6a68-46ce-8335-aaaba5160d3e/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:10:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e44bfc-6a68-46ce-8335-aaaba5160d3e/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:10:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e44bfc-6a68-46ce-8335-aaaba5160d3e/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:10:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e44bfc-6a68-46ce-8335-aaaba5160d3e/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:10:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e44bfc-6a68-46ce-8335-aaaba5160d3e/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:10:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/471df318-7d9f-4512-add6-b6612700e15d/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:10:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/471df318-7d9f-4512-add6-b6612700e15d/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:10:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/471df318-7d9f-4512-add6-b6612700e15d/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:10:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/471df318-7d9f-4512-add6-b6612700e15d/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:10:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b153af2-c93b-47d2-ae8c-76cfd44e384c/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:10:13 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b153af2-c93b-47d2-ae8c-76cfd44e384c/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:10:13 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b153af2-c93b-47d2-ae8c-76cfd44e384c/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:10:13 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b153af2-c93b-47d2-ae8c-76cfd44e384c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:10:13 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f465963f-1d0f-4ca3-a8b8-681566b7d40a/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:10:13 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f465963f-1d0f-4ca3-a8b8-681566b7d40a/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:10:13 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f465963f-1d0f-4ca3-a8b8-681566b7d40a/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:10:13 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f465963f-1d0f-4ca3-a8b8-681566b7d40a/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:10:13 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f326db85-74f6-4e60-9c55-46b2a59502d0/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:10:13 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f326db85-74f6-4e60-9c55-46b2a59502d0/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:10:13 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f326db85-74f6-4e60-9c55-46b2a59502d0/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:10:14 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:10:14 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f326db85-74f6-4e60-9c55-46b2a59502d0/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:10:14 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:10:14 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:10:14 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Hypervisor/Node resource view: name=user free_ram=6864MB free_disk=25.09868621826172GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75165) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 00:10:14 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:10:14 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:10:14 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 9633e6bb-5e95-4994-92a2-9d8f85a946ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:10:14 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 84c6b624-648b-40e2-a37e-ff08609bad84 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:10:14 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance c4e44bfc-6a68-46ce-8335-aaaba5160d3e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:10:14 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance a7eeb145-1565-4812-818b-fefda5f2436d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:10:14 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 26a0b493-bb47-466e-95d5-945fc3849fa5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:10:14 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 3b153af2-c93b-47d2-ae8c-76cfd44e384c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:10:14 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance f465963f-1d0f-4ca3-a8b8-681566b7d40a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:10:14 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance f326db85-74f6-4e60-9c55-46b2a59502d0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:10:14 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 45625147-ff69-496a-a41e-e55f818a020a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:10:14 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 8d5569ce-1f18-4f37-a340-099ee152d548 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:10:14 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 471df318-7d9f-4512-add6-b6612700e15d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:10:14 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 018ca455-eace-412d-86a3-d914b4af30d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:10:14 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75165) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 00:10:14 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75165) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 00:10:14 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-2518f958-008c-49dc-9f57-215a3de59c11 tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance f465963f-1d0f-4ca3-a8b8-681566b7d40a is timed out.
Oct 26 00:10:14 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-2518f958-008c-49dc-9f57-215a3de59c11 tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] Successfully detached device sdc from instance f465963f-1d0f-4ca3-a8b8-681566b7d40a from the live domain config.
Oct 26 00:10:14 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2518f958-008c-49dc-9f57-215a3de59c11 tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] [instance: f465963f-1d0f-4ca3-a8b8-681566b7d40a] calling os-brick to detach iSCSI Volume {{(pid=75165) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 00:10:14 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-2518f958-008c-49dc-9f57-215a3de59c11 tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8bf8160e50>, {'target_iqn': 'iqn.2010-10.org.openstack:b9d317ae-7dfa-4b25-9e3a-faa7ad5fed86', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wRVAMIZr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:10:14 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-2518f958-008c-49dc-9f57-215a3de59c11 tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:10:14 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-2518f958-008c-49dc-9f57-215a3de59c11 tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:10:14 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-2518f958-008c-49dc-9f57-215a3de59c11 tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:10:14 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:10:14 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:10:14 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e2b7d9f-06e4-4888-b3b3-e0edb6c3f90a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f25f6e6a-9711-4455-82e8-c56648a08508\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b9d317ae-7dfa-4b25-9e3a-faa7ad5fed86\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ff01f329-6dda-43b6-8da5-6a5c48fad211\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:014b6b5a-24b7-4afd-9fc3-50645f10fcd4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:083f264a-3f29-48b4-9935-a73f4234e6d5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:45f3fb95-eff9-4a9a-a50b-cdbfee3840d8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:10:14 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-2518f958-008c-49dc-9f57-215a3de59c11 tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 00:10:14 user nova-compute[75165]: No targets found.
Oct 26 00:10:14 user nova-compute[75165]: iSNS:
Oct 26 00:10:14 user nova-compute[75165]: No targets found.
Oct 26 00:10:14 user nova-compute[75165]: STATIC:
Oct 26 00:10:14 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:f25f6e6a-9711-4455-82e8-c56648a08508
Oct 26 00:10:14 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:10:14 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:10:14 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:b9d317ae-7dfa-4b25-9e3a-faa7ad5fed86
Oct 26 00:10:14 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:10:14 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:10:14 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:ff01f329-6dda-43b6-8da5-6a5c48fad211
Oct 26 00:10:14 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:10:14 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:10:14 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:014b6b5a-24b7-4afd-9fc3-50645f10fcd4
Oct 26 00:10:14 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:10:14 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:10:14 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:083f264a-3f29-48b4-9935-a73f4234e6d5
Oct 26 00:10:14 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:10:14 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:10:14 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:45f3fb95-eff9-4a9a-a50b-cdbfee3840d8
Oct 26 00:10:14 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:10:14 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:10:14 user nova-compute[75165]: FIRMWARE:
Oct 26 00:10:14 user nova-compute[75165]: No targets found.
Oct 26 00:10:14 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:10:14 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-2518f958-008c-49dc-9f57-215a3de59c11 tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 00:10:14 user nova-compute[75165]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 00:10:14 user nova-compute[75165]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75165) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 00:10:14 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-2518f958-008c-49dc-9f57-215a3de59c11 tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b9d317ae-7dfa-4b25-9e3a-faa7ad5fed86', 0)] {{(pid=75165) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 00:10:14 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:10:14 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:10:14 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[1796769c-ba87-4c6a-84fa-c992fb108574]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:014b6b5a-24b7-4afd-9fc3-50645f10fcd4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:083f264a-3f29-48b4-9935-a73f4234e6d5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45f3fb95-eff9-4a9a-a50b-cdbfee3840d8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b9d317ae-7dfa-4b25-9e3a-faa7ad5fed86\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f25f6e6a-9711-4455-82e8-c56648a08508\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ff01f329-6dda-43b6-8da5-6a5c48fad211\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:10:14 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:10:14 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:10:14 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[69ab9bc7-65b9-4981-be6f-0cc2ab054ae7]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9d317ae-7dfa-4b25-9e3a-faa7ad5fed86 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f25f6e6a-9711-4455-82e8-c56648a08508 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:083f264a-3f29-48b4-9935-a73f4234e6d5 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:014b6b5a-24b7-4afd-9fc3-50645f10fcd4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff01f329-6dda-43b6-8da5-6a5c48fad211 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45f3fb95-eff9-4a9a-a50b-cdbfee3840d8 (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:10:14 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-2518f958-008c-49dc-9f57-215a3de59c11 tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9d317ae-7dfa-4b25-9e3a-faa7ad5fed86 (non-flash)
Oct 26 00:10:14 user nova-compute[75165]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f25f6e6a-9711-4455-82e8-c56648a08508 (non-flash)
Oct 26 00:10:14 user nova-compute[75165]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:083f264a-3f29-48b4-9935-a73f4234e6d5 (non-flash)
Oct 26 00:10:14 user nova-compute[75165]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:014b6b5a-24b7-4afd-9fc3-50645f10fcd4 (non-flash)
Oct 26 00:10:14 user nova-compute[75165]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff01f329-6dda-43b6-8da5-6a5c48fad211 (non-flash)
Oct 26 00:10:14 user nova-compute[75165]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45f3fb95-eff9-4a9a-a50b-cdbfee3840d8 (non-flash)
Oct 26 00:10:14 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:10:14 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-2518f958-008c-49dc-9f57-215a3de59c11 tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9d317ae-7dfa-4b25-9e3a-faa7ad5fed86 (non-flash)
Oct 26 00:10:14 user nova-compute[75165]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f25f6e6a-9711-4455-82e8-c56648a08508 (non-flash)
Oct 26 00:10:14 user nova-compute[75165]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:083f264a-3f29-48b4-9935-a73f4234e6d5 (non-flash)
Oct 26 00:10:14 user nova-compute[75165]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:014b6b5a-24b7-4afd-9fc3-50645f10fcd4 (non-flash)
Oct 26 00:10:14 user nova-compute[75165]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff01f329-6dda-43b6-8da5-6a5c48fad211 (non-flash)
Oct 26 00:10:14 user nova-compute[75165]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45f3fb95-eff9-4a9a-a50b-cdbfee3840d8 (non-flash)
Oct 26 00:10:14 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:10:14 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-2518f958-008c-49dc-9f57-215a3de59c11 tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8be04abd90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b9d317ae-7dfa-4b25-9e3a-faa7ad5fed86'): ({'sdb'}, set())}) {{(pid=75165) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 00:10:14 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-2518f958-008c-49dc-9f57-215a3de59c11 tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] Removing single pathed devices sdb {{(pid=75165) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 00:10:14 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:10:14 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:10:14 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[09d121e0-9679-4c1e-99df-904ab017b014]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:10:14 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:10:14 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:10:14 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a3b36e2-bf81-446b-bdfa-190686b329cb]: (4, ('ok\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:10:14 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-2518f958-008c-49dc-9f57-215a3de59c11 tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] Flushing IO for device /dev/sdb {{(pid=75165) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 00:10:14 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:10:14 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:10:14 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[83ba07b9-c3b5-41a5-a2b1-325543e10a93]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:10:14 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-2518f958-008c-49dc-9f57-215a3de59c11 tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75165) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 00:10:14 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:10:14 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:10:14 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[3220cb60-63c0-421a-a9f0-f6084c749ed0]: (4, ('1', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:10:14 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-2518f958-008c-49dc-9f57-215a3de59c11 tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75165) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 00:10:14 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-2518f958-008c-49dc-9f57-215a3de59c11 tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] SCSI volumes sdb have been removed. {{(pid=75165) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 00:10:14 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-2518f958-008c-49dc-9f57-215a3de59c11 tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b9d317ae-7dfa-4b25-9e3a-faa7ad5fed86')] {{(pid=75165) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 00:10:15 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9d317ae-7dfa-4b25-9e3a-faa7ad5fed86 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:10:15 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9d317ae-7dfa-4b25-9e3a-faa7ad5fed86 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:10:15 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a64373e-149e-4253-a147-40975557de04]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:10:15 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-2518f958-008c-49dc-9f57-215a3de59c11 tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:10:15 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9d317ae-7dfa-4b25-9e3a-faa7ad5fed86 -p 172.16.0.220:3260 --logout {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:10:15 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9d317ae-7dfa-4b25-9e3a-faa7ad5fed86 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:10:15 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[d44761b1-24d6-4d73-ac50-766bbf8f7b57]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:b9d317ae-7dfa-4b25-9e3a-faa7ad5fed86, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:b9d317ae-7dfa-4b25-9e3a-faa7ad5fed86, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:10:15 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-2518f958-008c-49dc-9f57-215a3de59c11 tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:b9d317ae-7dfa-4b25-9e3a-faa7ad5fed86, portal: 172.16.0.220,3260]
Oct 26 00:10:15 user nova-compute[75165]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:b9d317ae-7dfa-4b25-9e3a-faa7ad5fed86, portal: 172.16.0.220,3260] successful.
Oct 26 00:10:15 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:10:15 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9d317ae-7dfa-4b25-9e3a-faa7ad5fed86 -p 172.16.0.220:3260 --op delete {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:10:15 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9d317ae-7dfa-4b25-9e3a-faa7ad5fed86 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:10:15 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[afa634c6-52e9-4b5d-91e8-442387c63abb]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:10:15 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-2518f958-008c-49dc-9f57-215a3de59c11 tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:10:15 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-2518f958-008c-49dc-9f57-215a3de59c11 tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.352s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:10:15 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-2518f958-008c-49dc-9f57-215a3de59c11 tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] <== disconnect_volume: return (354ms) None {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:10:15 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2518f958-008c-49dc-9f57-215a3de59c11 tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] [instance: f465963f-1d0f-4ca3-a8b8-681566b7d40a] Disconnected iSCSI Volume {{(pid=75165) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 00:10:15 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:10:15 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:10:15 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Compute_service record updated for user:user {{(pid=75165) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 00:10:15 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.668s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:10:19 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:10:19 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-01c62eee-4aec-435b-9e37-d65cd86cef91 tempest-VolumesAssistedSnapshotsTest-2020880117 tempest-VolumesAssistedSnapshotsTest-2020880117-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f326db85-74f6-4e60-9c55-46b2a59502d0 is timed out.
Oct 26 00:10:19 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-01c62eee-4aec-435b-9e37-d65cd86cef91 tempest-VolumesAssistedSnapshotsTest-2020880117 tempest-VolumesAssistedSnapshotsTest-2020880117-project-admin] Successfully detached device vdb from instance f326db85-74f6-4e60-9c55-46b2a59502d0 from the live domain config.
Oct 26 00:10:19 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01c62eee-4aec-435b-9e37-d65cd86cef91 tempest-VolumesAssistedSnapshotsTest-2020880117 tempest-VolumesAssistedSnapshotsTest-2020880117-project-admin] [instance: f326db85-74f6-4e60-9c55-46b2a59502d0] calling os-brick to detach iSCSI Volume {{(pid=75165) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 00:10:19 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-01c62eee-4aec-435b-9e37-d65cd86cef91 tempest-VolumesAssistedSnapshotsTest-2020880117 tempest-VolumesAssistedSnapshotsTest-2020880117-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8bf8160e50>, {'target_iqn': 'iqn.2010-10.org.openstack:014b6b5a-24b7-4afd-9fc3-50645f10fcd4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eCZNxjgk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:10:19 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-01c62eee-4aec-435b-9e37-d65cd86cef91 tempest-VolumesAssistedSnapshotsTest-2020880117 tempest-VolumesAssistedSnapshotsTest-2020880117-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:10:19 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-01c62eee-4aec-435b-9e37-d65cd86cef91 tempest-VolumesAssistedSnapshotsTest-2020880117 tempest-VolumesAssistedSnapshotsTest-2020880117-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:10:19 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-01c62eee-4aec-435b-9e37-d65cd86cef91 tempest-VolumesAssistedSnapshotsTest-2020880117 tempest-VolumesAssistedSnapshotsTest-2020880117-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:10:19 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:10:19 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:10:19 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[3499521e-771d-4d2d-a301-25f3c94bf68d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f25f6e6a-9711-4455-82e8-c56648a08508\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ff01f329-6dda-43b6-8da5-6a5c48fad211\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:014b6b5a-24b7-4afd-9fc3-50645f10fcd4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:083f264a-3f29-48b4-9935-a73f4234e6d5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:45f3fb95-eff9-4a9a-a50b-cdbfee3840d8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:10:19 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-01c62eee-4aec-435b-9e37-d65cd86cef91 tempest-VolumesAssistedSnapshotsTest-2020880117 tempest-VolumesAssistedSnapshotsTest-2020880117-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 00:10:19 user nova-compute[75165]: No targets found.
Oct 26 00:10:19 user nova-compute[75165]: iSNS:
Oct 26 00:10:19 user nova-compute[75165]: No targets found.
Oct 26 00:10:19 user nova-compute[75165]: STATIC:
Oct 26 00:10:19 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:f25f6e6a-9711-4455-82e8-c56648a08508
Oct 26 00:10:19 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:10:19 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:10:19 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:ff01f329-6dda-43b6-8da5-6a5c48fad211
Oct 26 00:10:19 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:10:19 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:10:19 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:014b6b5a-24b7-4afd-9fc3-50645f10fcd4
Oct 26 00:10:19 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:10:19 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:10:19 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:083f264a-3f29-48b4-9935-a73f4234e6d5
Oct 26 00:10:19 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:10:19 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:10:19 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:45f3fb95-eff9-4a9a-a50b-cdbfee3840d8
Oct 26 00:10:19 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:10:19 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:10:19 user nova-compute[75165]: FIRMWARE:
Oct 26 00:10:19 user nova-compute[75165]: No targets found.
Oct 26 00:10:19 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:10:19 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-01c62eee-4aec-435b-9e37-d65cd86cef91 tempest-VolumesAssistedSnapshotsTest-2020880117 tempest-VolumesAssistedSnapshotsTest-2020880117-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 00:10:19 user nova-compute[75165]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 00:10:19 user nova-compute[75165]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75165) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 00:10:19 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-01c62eee-4aec-435b-9e37-d65cd86cef91 tempest-VolumesAssistedSnapshotsTest-2020880117 tempest-VolumesAssistedSnapshotsTest-2020880117-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:014b6b5a-24b7-4afd-9fc3-50645f10fcd4', 0)] {{(pid=75165) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 00:10:19 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:10:19 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:10:19 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[93701361-0b42-454d-8ca1-96880ac0d8ff]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:014b6b5a-24b7-4afd-9fc3-50645f10fcd4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:083f264a-3f29-48b4-9935-a73f4234e6d5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45f3fb95-eff9-4a9a-a50b-cdbfee3840d8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f25f6e6a-9711-4455-82e8-c56648a08508\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ff01f329-6dda-43b6-8da5-6a5c48fad211\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:10:19 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:10:19 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:10:19 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c823a1c-bd08-425e-8bcb-3d715fcd3386]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f25f6e6a-9711-4455-82e8-c56648a08508 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:083f264a-3f29-48b4-9935-a73f4234e6d5 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:014b6b5a-24b7-4afd-9fc3-50645f10fcd4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff01f329-6dda-43b6-8da5-6a5c48fad211 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45f3fb95-eff9-4a9a-a50b-cdbfee3840d8 (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:10:19 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-01c62eee-4aec-435b-9e37-d65cd86cef91 tempest-VolumesAssistedSnapshotsTest-2020880117 tempest-VolumesAssistedSnapshotsTest-2020880117-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f25f6e6a-9711-4455-82e8-c56648a08508 (non-flash)
Oct 26 00:10:19 user nova-compute[75165]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:083f264a-3f29-48b4-9935-a73f4234e6d5 (non-flash)
Oct 26 00:10:19 user nova-compute[75165]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:014b6b5a-24b7-4afd-9fc3-50645f10fcd4 (non-flash)
Oct 26 00:10:19 user nova-compute[75165]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff01f329-6dda-43b6-8da5-6a5c48fad211 (non-flash)
Oct 26 00:10:19 user nova-compute[75165]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45f3fb95-eff9-4a9a-a50b-cdbfee3840d8 (non-flash)
Oct 26 00:10:19 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:10:19 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-01c62eee-4aec-435b-9e37-d65cd86cef91 tempest-VolumesAssistedSnapshotsTest-2020880117 tempest-VolumesAssistedSnapshotsTest-2020880117-project-admin] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f25f6e6a-9711-4455-82e8-c56648a08508 (non-flash)
Oct 26 00:10:19 user nova-compute[75165]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:083f264a-3f29-48b4-9935-a73f4234e6d5 (non-flash)
Oct 26 00:10:19 user nova-compute[75165]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:014b6b5a-24b7-4afd-9fc3-50645f10fcd4 (non-flash)
Oct 26 00:10:19 user nova-compute[75165]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff01f329-6dda-43b6-8da5-6a5c48fad211 (non-flash)
Oct 26 00:10:19 user nova-compute[75165]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45f3fb95-eff9-4a9a-a50b-cdbfee3840d8 (non-flash)
Oct 26 00:10:19 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:10:19 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-01c62eee-4aec-435b-9e37-d65cd86cef91 tempest-VolumesAssistedSnapshotsTest-2020880117 tempest-VolumesAssistedSnapshotsTest-2020880117-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8c0043d6c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:014b6b5a-24b7-4afd-9fc3-50645f10fcd4'): ({'sde'}, set())}) {{(pid=75165) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 00:10:19 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-01c62eee-4aec-435b-9e37-d65cd86cef91 tempest-VolumesAssistedSnapshotsTest-2020880117 tempest-VolumesAssistedSnapshotsTest-2020880117-project-admin] Removing single pathed devices sde {{(pid=75165) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 00:10:19 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:10:19 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:10:19 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1819a51-8a79-4182-a67a-05f2904a33ef]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:10:19 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:10:19 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:10:19 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[0669dacd-32e8-4d38-b77c-cce21b522281]: (4, ('ok\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:10:19 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-01c62eee-4aec-435b-9e37-d65cd86cef91 tempest-VolumesAssistedSnapshotsTest-2020880117 tempest-VolumesAssistedSnapshotsTest-2020880117-project-admin] Flushing IO for device /dev/sde {{(pid=75165) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 00:10:19 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:10:19 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:10:19 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[21df845f-fedd-405e-b565-07df86e3a8d3]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:10:19 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-01c62eee-4aec-435b-9e37-d65cd86cef91 tempest-VolumesAssistedSnapshotsTest-2020880117 tempest-VolumesAssistedSnapshotsTest-2020880117-project-admin] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75165) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 00:10:19 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:10:19 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.057s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:10:19 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[dabfc731-bede-458d-a192-02378313d561]: (4, ('1', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:10:19 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-01c62eee-4aec-435b-9e37-d65cd86cef91 tempest-VolumesAssistedSnapshotsTest-2020880117 tempest-VolumesAssistedSnapshotsTest-2020880117-project-admin] Checking to see if SCSI volumes sde have been removed. {{(pid=75165) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 00:10:19 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-01c62eee-4aec-435b-9e37-d65cd86cef91 tempest-VolumesAssistedSnapshotsTest-2020880117 tempest-VolumesAssistedSnapshotsTest-2020880117-project-admin] SCSI volumes sde have been removed. {{(pid=75165) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 00:10:19 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-01c62eee-4aec-435b-9e37-d65cd86cef91 tempest-VolumesAssistedSnapshotsTest-2020880117 tempest-VolumesAssistedSnapshotsTest-2020880117-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:014b6b5a-24b7-4afd-9fc3-50645f10fcd4')] {{(pid=75165) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 00:10:19 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:014b6b5a-24b7-4afd-9fc3-50645f10fcd4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:10:19 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:014b6b5a-24b7-4afd-9fc3-50645f10fcd4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.177s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:10:19 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6e3ebcb-1902-4f53-b0b2-cc41345c74c5]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:10:19 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-01c62eee-4aec-435b-9e37-d65cd86cef91 tempest-VolumesAssistedSnapshotsTest-2020880117 tempest-VolumesAssistedSnapshotsTest-2020880117-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:10:19 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:014b6b5a-24b7-4afd-9fc3-50645f10fcd4 -p 172.16.0.220:3260 --logout {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:10:19 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:014b6b5a-24b7-4afd-9fc3-50645f10fcd4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.209s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:10:19 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e2870af-6efc-47a8-b3e3-9af0f9ebeadf]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:014b6b5a-24b7-4afd-9fc3-50645f10fcd4, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:014b6b5a-24b7-4afd-9fc3-50645f10fcd4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:10:19 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-01c62eee-4aec-435b-9e37-d65cd86cef91 tempest-VolumesAssistedSnapshotsTest-2020880117 tempest-VolumesAssistedSnapshotsTest-2020880117-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:014b6b5a-24b7-4afd-9fc3-50645f10fcd4, portal: 172.16.0.220,3260]
Oct 26 00:10:19 user nova-compute[75165]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:014b6b5a-24b7-4afd-9fc3-50645f10fcd4, portal: 172.16.0.220,3260] successful.
Oct 26 00:10:19 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:10:19 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:014b6b5a-24b7-4afd-9fc3-50645f10fcd4 -p 172.16.0.220:3260 --op delete {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:10:19 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:014b6b5a-24b7-4afd-9fc3-50645f10fcd4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:10:19 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e73b254-b717-499f-be2b-991671361c6e]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:10:19 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-01c62eee-4aec-435b-9e37-d65cd86cef91 tempest-VolumesAssistedSnapshotsTest-2020880117 tempest-VolumesAssistedSnapshotsTest-2020880117-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:10:19 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-01c62eee-4aec-435b-9e37-d65cd86cef91 tempest-VolumesAssistedSnapshotsTest-2020880117 tempest-VolumesAssistedSnapshotsTest-2020880117-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.662s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:10:19 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-01c62eee-4aec-435b-9e37-d65cd86cef91 tempest-VolumesAssistedSnapshotsTest-2020880117 tempest-VolumesAssistedSnapshotsTest-2020880117-project-admin] <== disconnect_volume: return (662ms) None {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:10:19 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01c62eee-4aec-435b-9e37-d65cd86cef91 tempest-VolumesAssistedSnapshotsTest-2020880117 tempest-VolumesAssistedSnapshotsTest-2020880117-project-admin] [instance: f326db85-74f6-4e60-9c55-46b2a59502d0] Disconnected iSCSI Volume {{(pid=75165) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 00:10:24 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:10:25 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:10:26 user nova-compute[75165]: DEBUG nova.objects.instance [None req-2518f958-008c-49dc-9f57-215a3de59c11 tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] Lazy-loading 'flavor' on Instance uuid f465963f-1d0f-4ca3-a8b8-681566b7d40a {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:10:26 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-2518f958-008c-49dc-9f57-215a3de59c11 tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] Lock "f465963f-1d0f-4ca3-a8b8-681566b7d40a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 31.800s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:10:26 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-ab6012f9-405c-451d-bb83-af79e06c24a1 tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] Acquiring lock "f465963f-1d0f-4ca3-a8b8-681566b7d40a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:10:26 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-ab6012f9-405c-451d-bb83-af79e06c24a1 tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] Lock "f465963f-1d0f-4ca3-a8b8-681566b7d40a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:10:26 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-ab6012f9-405c-451d-bb83-af79e06c24a1 tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] Acquiring lock "f465963f-1d0f-4ca3-a8b8-681566b7d40a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:10:26 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-ab6012f9-405c-451d-bb83-af79e06c24a1 tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] Lock "f465963f-1d0f-4ca3-a8b8-681566b7d40a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:10:26 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-ab6012f9-405c-451d-bb83-af79e06c24a1 tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] Lock "f465963f-1d0f-4ca3-a8b8-681566b7d40a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:10:26 user nova-compute[75165]: INFO nova.compute.manager [None req-ab6012f9-405c-451d-bb83-af79e06c24a1 tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] [instance: f465963f-1d0f-4ca3-a8b8-681566b7d40a] Terminating instance
Oct 26 00:10:26 user nova-compute[75165]: DEBUG nova.compute.manager [None req-ab6012f9-405c-451d-bb83-af79e06c24a1 tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] [instance: f465963f-1d0f-4ca3-a8b8-681566b7d40a] Start destroying the instance on the hypervisor. {{(pid=75165) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 00:10:26 user nova-compute[75165]: DEBUG nova.objects.instance [None req-01c62eee-4aec-435b-9e37-d65cd86cef91 tempest-VolumesAssistedSnapshotsTest-2020880117 tempest-VolumesAssistedSnapshotsTest-2020880117-project-admin] Lazy-loading 'flavor' on Instance uuid f326db85-74f6-4e60-9c55-46b2a59502d0 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:10:26 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:10:26 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-01c62eee-4aec-435b-9e37-d65cd86cef91 tempest-VolumesAssistedSnapshotsTest-2020880117 tempest-VolumesAssistedSnapshotsTest-2020880117-project-admin] Lock "f326db85-74f6-4e60-9c55-46b2a59502d0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 27.918s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:10:26 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:10:26 user nova-compute[75165]: DEBUG nova.compute.manager [None req-b6d019fa-4b45-40eb-b525-357321587630 tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] [instance: 45625147-ff69-496a-a41e-e55f818a020a] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6bea2b74-7b28-4314-9a5a-14a1eeaf4a67', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CfQFXxYr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '45625147-ff69-496a-a41e-e55f818a020a', 'attached_at': '', 'detached_at': '', 'volume_id': '6bea2b74-7b28-4314-9a5a-14a1eeaf4a67', 'serial': '6bea2b74-7b28-4314-9a5a-14a1eeaf4a67'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:45f3fb95-eff9-4a9a-a50b-cdbfee3840d8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ARaLnBGq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, 'status': 'reserved', 'instance': '45625147-ff69-496a-a41e-e55f818a020a', 'attached_at': '', 'detached_at': '', 'volume_id': '45f3fb95-eff9-4a9a-a50b-cdbfee3840d8', 'serial'} {{(pid=75165) _swap_volume /opt/stack/nova/nova/compute/manager.py:7781}}
Oct 26 00:10:26 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6d019fa-4b45-40eb-b525-357321587630 tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] [instance: 45625147-ff69-496a-a41e-e55f818a020a] Calling os-brick to attach iSCSI Volume {{(pid=75165) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 00:10:26 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6d019fa-4b45-40eb-b525-357321587630 tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8bf8160e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6bea2b74-7b28-4314-9a5a-14a1eeaf4a67', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CfQFXxYr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:10:26 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-b6d019fa-4b45-40eb-b525-357321587630 tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:10:26 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-b6d019fa-4b45-40eb-b525-357321587630 tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:10:26 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-b6d019fa-4b45-40eb-b525-357321587630 tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:10:26 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-b6d019fa-4b45-40eb-b525-357321587630 tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:10:26 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-b6d019fa-4b45-40eb-b525-357321587630 tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6bea2b74-7b28-4314-9a5a-14a1eeaf4a67" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:10:26 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-b6d019fa-4b45-40eb-b525-357321587630 tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6bea2b74-7b28-4314-9a5a-14a1eeaf4a67" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:10:26 user nova-compute[75165]: INFO os_brick.initiator.connectors.iscsi [None req-b6d019fa-4b45-40eb-b525-357321587630 tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 00:10:26 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:10:26 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bea2b74-7b28-4314-9a5a-14a1eeaf4a67 -p 172.16.0.220:3260 {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:10:26 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bea2b74-7b28-4314-9a5a-14a1eeaf4a67 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:10:26 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce115e40-530a-4c64-8598-a5c325441deb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:10:26 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6d019fa-4b45-40eb-b525-357321587630 tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 00:10:26 user nova-compute[75165]:  {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:10:26 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bea2b74-7b28-4314-9a5a-14a1eeaf4a67 -p 172.16.0.220:3260 --interface default --op new {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:10:26 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bea2b74-7b28-4314-9a5a-14a1eeaf4a67 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:10:26 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef8c65f9-7a9e-4296-9e7e-f54bf5d04705]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6bea2b74-7b28-4314-9a5a-14a1eeaf4a67] added\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:10:26 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6d019fa-4b45-40eb-b525-357321587630 tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6bea2b74-7b28-4314-9a5a-14a1eeaf4a67] added
Oct 26 00:10:26 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:10:26 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bea2b74-7b28-4314-9a5a-14a1eeaf4a67 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:10:26 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bea2b74-7b28-4314-9a5a-14a1eeaf4a67 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:10:26 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae4dffa9-38b4-4aeb-8b7f-ae359fef2c5c]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:10:26 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6d019fa-4b45-40eb-b525-357321587630 tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:10:26 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bea2b74-7b28-4314-9a5a-14a1eeaf4a67 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:10:26 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bea2b74-7b28-4314-9a5a-14a1eeaf4a67 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:10:26 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[932fb038-63c7-4193-9cce-1f070c1ea941]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:10:26 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6d019fa-4b45-40eb-b525-357321587630 tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:10:26 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bea2b74-7b28-4314-9a5a-14a1eeaf4a67 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CfQFXxYr {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:10:26 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bea2b74-7b28-4314-9a5a-14a1eeaf4a67 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CfQFXxYr" returned: 0 in 0.018s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:10:26 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[870d478a-8aa3-4994-b2ea-f5258c6b3bf4]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:10:26 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6d019fa-4b45-40eb-b525-357321587630 tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CfQFXxYr'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:10:26 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bea2b74-7b28-4314-9a5a-14a1eeaf4a67 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:10:26 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bea2b74-7b28-4314-9a5a-14a1eeaf4a67 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:10:26 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[653f47ba-44d1-4666-abb4-5f23eac56e48]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:10:26 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6d019fa-4b45-40eb-b525-357321587630 tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:10:26 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:10:26 user nova-compute[75165]: DEBUG nova.compute.manager [req-2fa3861a-364b-42c8-a2b3-6b2d2fe0e8dc req-e6ed2f8a-6b55-4e2b-a0ad-c2bf784c524d service nova] [instance: f465963f-1d0f-4ca3-a8b8-681566b7d40a] Received event network-vif-unplugged-f382bfbf-798f-4f17-87ca-ff778203bab3 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:10:26 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-2fa3861a-364b-42c8-a2b3-6b2d2fe0e8dc req-e6ed2f8a-6b55-4e2b-a0ad-c2bf784c524d service nova] Acquiring lock "f465963f-1d0f-4ca3-a8b8-681566b7d40a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:10:26 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-2fa3861a-364b-42c8-a2b3-6b2d2fe0e8dc req-e6ed2f8a-6b55-4e2b-a0ad-c2bf784c524d service nova] Lock "f465963f-1d0f-4ca3-a8b8-681566b7d40a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:10:26 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-2fa3861a-364b-42c8-a2b3-6b2d2fe0e8dc req-e6ed2f8a-6b55-4e2b-a0ad-c2bf784c524d service nova] Lock "f465963f-1d0f-4ca3-a8b8-681566b7d40a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:10:26 user nova-compute[75165]: DEBUG nova.compute.manager [req-2fa3861a-364b-42c8-a2b3-6b2d2fe0e8dc req-e6ed2f8a-6b55-4e2b-a0ad-c2bf784c524d service nova] [instance: f465963f-1d0f-4ca3-a8b8-681566b7d40a] No waiting events found dispatching network-vif-unplugged-f382bfbf-798f-4f17-87ca-ff778203bab3 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:10:26 user nova-compute[75165]: DEBUG nova.compute.manager [req-2fa3861a-364b-42c8-a2b3-6b2d2fe0e8dc req-e6ed2f8a-6b55-4e2b-a0ad-c2bf784c524d service nova] [instance: f465963f-1d0f-4ca3-a8b8-681566b7d40a] Received event network-vif-unplugged-f382bfbf-798f-4f17-87ca-ff778203bab3 for instance with task_state deleting. {{(pid=75165) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 00:10:26 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:10:26 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[313c5150-826e-4aa4-afc1-2c2a5e7c0364]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f25f6e6a-9711-4455-82e8-c56648a08508 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:083f264a-3f29-48b4-9935-a73f4234e6d5 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff01f329-6dda-43b6-8da5-6a5c48fad211 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45f3fb95-eff9-4a9a-a50b-cdbfee3840d8 (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:10:26 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6d019fa-4b45-40eb-b525-357321587630 tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f25f6e6a-9711-4455-82e8-c56648a08508 (non-flash)
Oct 26 00:10:26 user nova-compute[75165]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:083f264a-3f29-48b4-9935-a73f4234e6d5 (non-flash)
Oct 26 00:10:26 user nova-compute[75165]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff01f329-6dda-43b6-8da5-6a5c48fad211 (non-flash)
Oct 26 00:10:26 user nova-compute[75165]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45f3fb95-eff9-4a9a-a50b-cdbfee3840d8 (non-flash)
Oct 26 00:10:26 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:10:26 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6d019fa-4b45-40eb-b525-357321587630 tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f25f6e6a-9711-4455-82e8-c56648a08508 (non-flash)
Oct 26 00:10:26 user nova-compute[75165]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:083f264a-3f29-48b4-9935-a73f4234e6d5 (non-flash)
Oct 26 00:10:26 user nova-compute[75165]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff01f329-6dda-43b6-8da5-6a5c48fad211 (non-flash)
Oct 26 00:10:26 user nova-compute[75165]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45f3fb95-eff9-4a9a-a50b-cdbfee3840d8 (non-flash)
Oct 26 00:10:26 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:10:26 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bea2b74-7b28-4314-9a5a-14a1eeaf4a67 -p 172.16.0.220:3260 --login {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:10:26 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bea2b74-7b28-4314-9a5a-14a1eeaf4a67 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:10:26 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccb27004-b65f-44be-bb5e-a5dbff372c3b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6bea2b74-7b28-4314-9a5a-14a1eeaf4a67, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6bea2b74-7b28-4314-9a5a-14a1eeaf4a67, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:10:26 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6d019fa-4b45-40eb-b525-357321587630 tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6bea2b74-7b28-4314-9a5a-14a1eeaf4a67, portal: 172.16.0.220,3260]
Oct 26 00:10:26 user nova-compute[75165]: Login to [iface: default, target: iqn.2010-10.org.openstack:6bea2b74-7b28-4314-9a5a-14a1eeaf4a67, portal: 172.16.0.220,3260] successful.
Oct 26 00:10:26 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:10:26 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bea2b74-7b28-4314-9a5a-14a1eeaf4a67 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:10:26 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bea2b74-7b28-4314-9a5a-14a1eeaf4a67 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:10:27 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f08d20a-8eb8-4ff2-9e14-e0856794529a]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:10:27 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6d019fa-4b45-40eb-b525-357321587630 tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:10:27 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:10:27 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:10:27 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6a6b90d-a0c2-4c77-a0a3-70eb232c5bdf]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f25f6e6a-9711-4455-82e8-c56648a08508 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:083f264a-3f29-48b4-9935-a73f4234e6d5 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff01f329-6dda-43b6-8da5-6a5c48fad211 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45f3fb95-eff9-4a9a-a50b-cdbfee3840d8 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bea2b74-7b28-4314-9a5a-14a1eeaf4a67 (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:10:27 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6d019fa-4b45-40eb-b525-357321587630 tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f25f6e6a-9711-4455-82e8-c56648a08508 (non-flash)
Oct 26 00:10:27 user nova-compute[75165]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:083f264a-3f29-48b4-9935-a73f4234e6d5 (non-flash)
Oct 26 00:10:27 user nova-compute[75165]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff01f329-6dda-43b6-8da5-6a5c48fad211 (non-flash)
Oct 26 00:10:27 user nova-compute[75165]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45f3fb95-eff9-4a9a-a50b-cdbfee3840d8 (non-flash)
Oct 26 00:10:27 user nova-compute[75165]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bea2b74-7b28-4314-9a5a-14a1eeaf4a67 (non-flash)
Oct 26 00:10:27 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:10:27 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6d019fa-4b45-40eb-b525-357321587630 tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f25f6e6a-9711-4455-82e8-c56648a08508 (non-flash)
Oct 26 00:10:27 user nova-compute[75165]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:083f264a-3f29-48b4-9935-a73f4234e6d5 (non-flash)
Oct 26 00:10:27 user nova-compute[75165]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff01f329-6dda-43b6-8da5-6a5c48fad211 (non-flash)
Oct 26 00:10:27 user nova-compute[75165]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45f3fb95-eff9-4a9a-a50b-cdbfee3840d8 (non-flash)
Oct 26 00:10:27 user nova-compute[75165]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bea2b74-7b28-4314-9a5a-14a1eeaf4a67 (non-flash)
Oct 26 00:10:27 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:10:27 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-b6d019fa-4b45-40eb-b525-357321587630 tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6bea2b74-7b28-4314-9a5a-14a1eeaf4a67" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.311s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:10:27 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6d019fa-4b45-40eb-b525-357321587630 tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] Connected to 172.16.0.220:3260 {{(pid=75165) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 00:10:27 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-b6d019fa-4b45-40eb-b525-357321587630 tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] HCTL ('33', '-', '-', 0) found on session 9 with lun 0 {{(pid=75165) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 00:10:27 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-b6d019fa-4b45-40eb-b525-357321587630 tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] Scanning host 33 c: -, t: -, l: 0) {{(pid=75165) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 00:10:27 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:10:27 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:10:27 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[589bc1e7-ecca-4309-bacc-01adda196615]: (4, ('- - 0', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:10:27 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-b6d019fa-4b45-40eb-b525-357321587630 tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] Searching for a device in session 9 and hctl ['33', '*', '*', 0] yield: None {{(pid=75165) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 00:10:27 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: f465963f-1d0f-4ca3-a8b8-681566b7d40a] Instance destroyed successfully.
Oct 26 00:10:27 user nova-compute[75165]: DEBUG nova.objects.instance [None req-ab6012f9-405c-451d-bb83-af79e06c24a1 tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] Lazy-loading 'resources' on Instance uuid f465963f-1d0f-4ca3-a8b8-681566b7d40a {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:10:27 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-ab6012f9-405c-451d-bb83-af79e06c24a1 tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T00:07:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1547104777',display_name='tempest-AttachSCSIVolumeTestJSON-server-1547104777',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1547104777',id=9,image_ref='d4e6b02c-7adc-4509-8bf4-b40cfed6a5b2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJqJxcsWIvMFLaNIHcTwNIUmN7yofWeiByb0JW+AwSP8CCwkTGXaZxuvAVDka186nU9rgpz4j3iXefbxVEvMYRw11j/fUN/FSR2OQuPyYYNx3XAOTeKsM0v09GfO4xFxIA==',key_name='tempest-keypair-653354587',keypairs=<?>,launch_index=0,launched_at=2023-10-26T00:07:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='509c01c3838743959bacaa4aa2d31b63',ramdisk_id='',reservation_id='r-ibk3rjr2',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d4e6b02c-7adc-4509-8bf4-b40cfed6a5b2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1798603581',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1798603581-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T00:07:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='21fb86a371f74549b250005e42f68233',uuid=f465963f-1d0f-4ca3-a8b8-681566b7d40a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f382bfbf-798f-4f17-87ca-ff778203bab3", "address": "fa:16:3e:67:95:5b", "network": {"id": "7da22085-d8b3-4dbe-b796-95cdc69f58fe", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1230661193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "509c01c3838743959bacaa4aa2d31b63", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf382bfbf-79", "ovs_interfaceid": "f382bfbf-798f-4f17-87ca-ff778203bab3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 00:10:27 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-ab6012f9-405c-451d-bb83-af79e06c24a1 tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] Converting VIF {"id": "f382bfbf-798f-4f17-87ca-ff778203bab3", "address": "fa:16:3e:67:95:5b", "network": {"id": "7da22085-d8b3-4dbe-b796-95cdc69f58fe", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1230661193-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "509c01c3838743959bacaa4aa2d31b63", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf382bfbf-79", "ovs_interfaceid": "f382bfbf-798f-4f17-87ca-ff778203bab3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:10:27 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-ab6012f9-405c-451d-bb83-af79e06c24a1 tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:67:95:5b,bridge_name='br-int',has_traffic_filtering=True,id=f382bfbf-798f-4f17-87ca-ff778203bab3,network=Network(7da22085-d8b3-4dbe-b796-95cdc69f58fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf382bfbf-79') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:10:27 user nova-compute[75165]: DEBUG os_vif [None req-ab6012f9-405c-451d-bb83-af79e06c24a1 tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:67:95:5b,bridge_name='br-int',has_traffic_filtering=True,id=f382bfbf-798f-4f17-87ca-ff778203bab3,network=Network(7da22085-d8b3-4dbe-b796-95cdc69f58fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf382bfbf-79') {{(pid=75165) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 00:10:27 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:10:27 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf382bfbf-79, bridge=br-int, if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:10:27 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:10:27 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:10:27 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:10:27 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f1eaee36-cb71-422d-80dd-d5148215676b) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:10:27 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:10:27 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:10:27 user nova-compute[75165]: INFO os_vif [None req-ab6012f9-405c-451d-bb83-af79e06c24a1 tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:67:95:5b,bridge_name='br-int',has_traffic_filtering=True,id=f382bfbf-798f-4f17-87ca-ff778203bab3,network=Network(7da22085-d8b3-4dbe-b796-95cdc69f58fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf382bfbf-79')
Oct 26 00:10:27 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-ab6012f9-405c-451d-bb83-af79e06c24a1 tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] [instance: f465963f-1d0f-4ca3-a8b8-681566b7d40a] Deleting instance files /opt/stack/data/nova/instances/f465963f-1d0f-4ca3-a8b8-681566b7d40a_del
Oct 26 00:10:27 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-ab6012f9-405c-451d-bb83-af79e06c24a1 tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] [instance: f465963f-1d0f-4ca3-a8b8-681566b7d40a] Deletion of /opt/stack/data/nova/instances/f465963f-1d0f-4ca3-a8b8-681566b7d40a_del complete
Oct 26 00:10:27 user nova-compute[75165]: INFO nova.compute.manager [None req-ab6012f9-405c-451d-bb83-af79e06c24a1 tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] [instance: f465963f-1d0f-4ca3-a8b8-681566b7d40a] Took 0.87 seconds to destroy the instance on the hypervisor.
Oct 26 00:10:27 user nova-compute[75165]: DEBUG oslo.service.loopingcall [None req-ab6012f9-405c-451d-bb83-af79e06c24a1 tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75165) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 00:10:27 user nova-compute[75165]: DEBUG nova.compute.manager [-] [instance: f465963f-1d0f-4ca3-a8b8-681566b7d40a] Deallocating network for instance {{(pid=75165) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 00:10:27 user nova-compute[75165]: DEBUG nova.network.neutron [-] [instance: f465963f-1d0f-4ca3-a8b8-681566b7d40a] deallocate_for_instance() {{(pid=75165) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 00:10:28 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-b6d019fa-4b45-40eb-b525-357321587630 tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] Searching for a device in session 9 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75165) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 00:10:28 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6d019fa-4b45-40eb-b525-357321587630 tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:6bea2b74-7b28-4314-9a5a-14a1eeaf4a67', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CfQFXxYr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75165) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 00:10:28 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-b6d019fa-4b45-40eb-b525-357321587630 tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.340s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:10:28 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6d019fa-4b45-40eb-b525-357321587630 tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] <== connect_volume: return (1343ms) {'type': 'block', 'scsi_wwn': '23334346661383261', 'path': '/dev/sdb'} {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:10:28 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6d019fa-4b45-40eb-b525-357321587630 tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] [instance: 45625147-ff69-496a-a41e-e55f818a020a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23334346661383261', 'path': '/dev/sdb'} {{(pid=75165) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 00:10:28 user nova-compute[75165]: DEBUG nova.objects.instance [None req-b6d019fa-4b45-40eb-b525-357321587630 tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] Lazy-loading 'flavor' on Instance uuid 45625147-ff69-496a-a41e-e55f818a020a {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:10:28 user nova-compute[75165]: DEBUG nova.network.neutron [-] [instance: f465963f-1d0f-4ca3-a8b8-681566b7d40a] Updating instance_info_cache with network_info: [] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:10:28 user nova-compute[75165]: INFO nova.compute.manager [-] [instance: f465963f-1d0f-4ca3-a8b8-681566b7d40a] Took 0.92 seconds to deallocate network for instance.
Oct 26 00:10:28 user nova-compute[75165]: DEBUG nova.compute.manager [req-3538c532-2032-4705-92c3-ca64e91f7a32 req-eb7aafd4-75b5-42ec-a91a-6a503f7ef227 service nova] [instance: f465963f-1d0f-4ca3-a8b8-681566b7d40a] Received event network-vif-deleted-f382bfbf-798f-4f17-87ca-ff778203bab3 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:10:28 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-ab6012f9-405c-451d-bb83-af79e06c24a1 tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:10:28 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-ab6012f9-405c-451d-bb83-af79e06c24a1 tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:10:28 user nova-compute[75165]: DEBUG nova.virt.libvirt.guest [None req-b6d019fa-4b45-40eb-b525-357321587630 tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=75165) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 26 00:10:28 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-ab6012f9-405c-451d-bb83-af79e06c24a1 tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:10:28 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-ab6012f9-405c-451d-bb83-af79e06c24a1 tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:10:28 user nova-compute[75165]: DEBUG nova.compute.manager [req-210de70e-7eb1-43c4-922a-ded6516b37cc req-7fd64268-338a-4170-81cc-8968adbfe6c3 service nova] [instance: f465963f-1d0f-4ca3-a8b8-681566b7d40a] Received event network-vif-plugged-f382bfbf-798f-4f17-87ca-ff778203bab3 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:10:28 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-210de70e-7eb1-43c4-922a-ded6516b37cc req-7fd64268-338a-4170-81cc-8968adbfe6c3 service nova] Acquiring lock "f465963f-1d0f-4ca3-a8b8-681566b7d40a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:10:28 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-210de70e-7eb1-43c4-922a-ded6516b37cc req-7fd64268-338a-4170-81cc-8968adbfe6c3 service nova] Lock "f465963f-1d0f-4ca3-a8b8-681566b7d40a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:10:28 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-210de70e-7eb1-43c4-922a-ded6516b37cc req-7fd64268-338a-4170-81cc-8968adbfe6c3 service nova] Lock "f465963f-1d0f-4ca3-a8b8-681566b7d40a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:10:28 user nova-compute[75165]: DEBUG nova.compute.manager [req-210de70e-7eb1-43c4-922a-ded6516b37cc req-7fd64268-338a-4170-81cc-8968adbfe6c3 service nova] [instance: f465963f-1d0f-4ca3-a8b8-681566b7d40a] No waiting events found dispatching network-vif-plugged-f382bfbf-798f-4f17-87ca-ff778203bab3 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:10:28 user nova-compute[75165]: WARNING nova.compute.manager [req-210de70e-7eb1-43c4-922a-ded6516b37cc req-7fd64268-338a-4170-81cc-8968adbfe6c3 service nova] [instance: f465963f-1d0f-4ca3-a8b8-681566b7d40a] Received unexpected event network-vif-plugged-f382bfbf-798f-4f17-87ca-ff778203bab3 for instance with vm_state deleted and task_state None.
Oct 26 00:10:29 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-ab6012f9-405c-451d-bb83-af79e06c24a1 tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.602s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:10:29 user nova-compute[75165]: DEBUG nova.virt.libvirt.guest [None req-b6d019fa-4b45-40eb-b525-357321587630 tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] COPY block job progress, current cursor: 139460608 final cursor: 1073741824 {{(pid=75165) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 26 00:10:29 user nova-compute[75165]: INFO nova.scheduler.client.report [None req-ab6012f9-405c-451d-bb83-af79e06c24a1 tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] Deleted allocations for instance f465963f-1d0f-4ca3-a8b8-681566b7d40a
Oct 26 00:10:29 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-ab6012f9-405c-451d-bb83-af79e06c24a1 tempest-AttachSCSIVolumeTestJSON-1798603581 tempest-AttachSCSIVolumeTestJSON-1798603581-project-member] Lock "f465963f-1d0f-4ca3-a8b8-681566b7d40a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.732s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:10:29 user nova-compute[75165]: DEBUG nova.virt.libvirt.guest [None req-b6d019fa-4b45-40eb-b525-357321587630 tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] COPY block job progress, current cursor: 261095424 final cursor: 1073741824 {{(pid=75165) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 26 00:10:30 user nova-compute[75165]: DEBUG nova.virt.libvirt.guest [None req-b6d019fa-4b45-40eb-b525-357321587630 tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] COPY block job progress, current cursor: 406847488 final cursor: 1073741824 {{(pid=75165) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 26 00:10:30 user nova-compute[75165]: DEBUG nova.virt.libvirt.guest [None req-b6d019fa-4b45-40eb-b525-357321587630 tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] COPY block job progress, current cursor: 543162368 final cursor: 1073741824 {{(pid=75165) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 26 00:10:30 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:10:31 user nova-compute[75165]: DEBUG nova.virt.libvirt.guest [None req-b6d019fa-4b45-40eb-b525-357321587630 tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] COPY block job progress, current cursor: 680525824 final cursor: 1073741824 {{(pid=75165) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 26 00:10:31 user nova-compute[75165]: DEBUG nova.virt.libvirt.guest [None req-b6d019fa-4b45-40eb-b525-357321587630 tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] COPY block job progress, current cursor: 809500672 final cursor: 1073741824 {{(pid=75165) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 26 00:10:32 user nova-compute[75165]: DEBUG nova.virt.libvirt.guest [None req-b6d019fa-4b45-40eb-b525-357321587630 tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] COPY block job progress, current cursor: 940572672 final cursor: 1073741824 {{(pid=75165) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 26 00:10:32 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:10:32 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:10:32 user nova-compute[75165]: DEBUG nova.virt.libvirt.guest [None req-b6d019fa-4b45-40eb-b525-357321587630 tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=75165) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 26 00:10:32 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6d019fa-4b45-40eb-b525-357321587630 tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] [instance: 45625147-ff69-496a-a41e-e55f818a020a] calling os-brick to detach iSCSI Volume {{(pid=75165) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 00:10:32 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6d019fa-4b45-40eb-b525-357321587630 tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8bf8160e50>, {'target_iqn': 'iqn.2010-10.org.openstack:45f3fb95-eff9-4a9a-a50b-cdbfee3840d8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ARaLnBGq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:10:32 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-b6d019fa-4b45-40eb-b525-357321587630 tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:10:32 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-b6d019fa-4b45-40eb-b525-357321587630 tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:10:32 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-b6d019fa-4b45-40eb-b525-357321587630 tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:10:32 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:10:32 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:10:32 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d828ed9-0e44-4510-82c2-d29c6e5f2de7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f25f6e6a-9711-4455-82e8-c56648a08508\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6bea2b74-7b28-4314-9a5a-14a1eeaf4a67\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ff01f329-6dda-43b6-8da5-6a5c48fad211\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:083f264a-3f29-48b4-9935-a73f4234e6d5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:45f3fb95-eff9-4a9a-a50b-cdbfee3840d8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:10:32 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6d019fa-4b45-40eb-b525-357321587630 tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 00:10:32 user nova-compute[75165]: No targets found.
Oct 26 00:10:32 user nova-compute[75165]: iSNS:
Oct 26 00:10:32 user nova-compute[75165]: No targets found.
Oct 26 00:10:32 user nova-compute[75165]: STATIC:
Oct 26 00:10:32 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:f25f6e6a-9711-4455-82e8-c56648a08508
Oct 26 00:10:32 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:10:32 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:10:32 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:6bea2b74-7b28-4314-9a5a-14a1eeaf4a67
Oct 26 00:10:32 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:10:32 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:10:32 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:ff01f329-6dda-43b6-8da5-6a5c48fad211
Oct 26 00:10:32 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:10:32 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:10:32 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:083f264a-3f29-48b4-9935-a73f4234e6d5
Oct 26 00:10:32 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:10:32 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:10:32 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:45f3fb95-eff9-4a9a-a50b-cdbfee3840d8
Oct 26 00:10:32 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:10:32 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:10:32 user nova-compute[75165]: FIRMWARE:
Oct 26 00:10:32 user nova-compute[75165]: No targets found.
Oct 26 00:10:32 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:10:32 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6d019fa-4b45-40eb-b525-357321587630 tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 00:10:32 user nova-compute[75165]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 00:10:32 user nova-compute[75165]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75165) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 00:10:32 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6d019fa-4b45-40eb-b525-357321587630 tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:45f3fb95-eff9-4a9a-a50b-cdbfee3840d8', 0)] {{(pid=75165) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 00:10:32 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:10:32 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:10:32 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[d18cfb84-7fd7-4368-8c95-0d9e8ae89352]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:083f264a-3f29-48b4-9935-a73f4234e6d5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45f3fb95-eff9-4a9a-a50b-cdbfee3840d8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6bea2b74-7b28-4314-9a5a-14a1eeaf4a67\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f25f6e6a-9711-4455-82e8-c56648a08508\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ff01f329-6dda-43b6-8da5-6a5c48fad211\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:10:32 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:10:32 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:10:32 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7977a32-d969-428b-9978-a6ecd715a56c]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f25f6e6a-9711-4455-82e8-c56648a08508 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:083f264a-3f29-48b4-9935-a73f4234e6d5 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff01f329-6dda-43b6-8da5-6a5c48fad211 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45f3fb95-eff9-4a9a-a50b-cdbfee3840d8 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bea2b74-7b28-4314-9a5a-14a1eeaf4a67 (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:10:32 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6d019fa-4b45-40eb-b525-357321587630 tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f25f6e6a-9711-4455-82e8-c56648a08508 (non-flash)
Oct 26 00:10:32 user nova-compute[75165]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:083f264a-3f29-48b4-9935-a73f4234e6d5 (non-flash)
Oct 26 00:10:32 user nova-compute[75165]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff01f329-6dda-43b6-8da5-6a5c48fad211 (non-flash)
Oct 26 00:10:32 user nova-compute[75165]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45f3fb95-eff9-4a9a-a50b-cdbfee3840d8 (non-flash)
Oct 26 00:10:32 user nova-compute[75165]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bea2b74-7b28-4314-9a5a-14a1eeaf4a67 (non-flash)
Oct 26 00:10:32 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:10:32 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6d019fa-4b45-40eb-b525-357321587630 tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f25f6e6a-9711-4455-82e8-c56648a08508 (non-flash)
Oct 26 00:10:32 user nova-compute[75165]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:083f264a-3f29-48b4-9935-a73f4234e6d5 (non-flash)
Oct 26 00:10:32 user nova-compute[75165]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff01f329-6dda-43b6-8da5-6a5c48fad211 (non-flash)
Oct 26 00:10:32 user nova-compute[75165]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45f3fb95-eff9-4a9a-a50b-cdbfee3840d8 (non-flash)
Oct 26 00:10:32 user nova-compute[75165]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bea2b74-7b28-4314-9a5a-14a1eeaf4a67 (non-flash)
Oct 26 00:10:32 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:10:32 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6d019fa-4b45-40eb-b525-357321587630 tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8bf8177910>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:45f3fb95-eff9-4a9a-a50b-cdbfee3840d8'): ({'sdg'}, set())}) {{(pid=75165) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 00:10:32 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-b6d019fa-4b45-40eb-b525-357321587630 tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] Removing single pathed devices sdg {{(pid=75165) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 00:10:32 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:10:32 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:10:32 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[95d526bd-b544-42f1-b579-c76dc3fe92d7]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:10:32 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:10:32 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.019s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:10:32 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b59f2dc-84eb-4f6a-9508-12c677fee149]: (4, ('ok\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:10:32 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-b6d019fa-4b45-40eb-b525-357321587630 tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] Flushing IO for device /dev/sdg {{(pid=75165) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 00:10:32 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:10:32 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.016s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:10:32 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d3ddd40-bf25-47a1-bbc3-6d127029628b]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:10:32 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-b6d019fa-4b45-40eb-b525-357321587630 tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75165) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 00:10:32 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:10:32 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.039s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:10:32 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf3398cd-f3eb-46cc-ae3b-4c8cfb866d1e]: (4, ('1', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:10:32 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-b6d019fa-4b45-40eb-b525-357321587630 tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] Checking to see if SCSI volumes sdg have been removed. {{(pid=75165) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 00:10:32 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-b6d019fa-4b45-40eb-b525-357321587630 tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] SCSI volumes sdg have been removed. {{(pid=75165) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 00:10:32 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6d019fa-4b45-40eb-b525-357321587630 tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:45f3fb95-eff9-4a9a-a50b-cdbfee3840d8')] {{(pid=75165) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 00:10:32 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45f3fb95-eff9-4a9a-a50b-cdbfee3840d8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:10:32 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45f3fb95-eff9-4a9a-a50b-cdbfee3840d8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:10:32 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[7734d9c2-f188-4d78-b4ae-9663d618fd62]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:10:32 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6d019fa-4b45-40eb-b525-357321587630 tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:10:32 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45f3fb95-eff9-4a9a-a50b-cdbfee3840d8 -p 172.16.0.220:3260 --logout {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:10:33 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45f3fb95-eff9-4a9a-a50b-cdbfee3840d8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:10:33 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[f229c91f-5c77-4fb3-b9c6-0287e7a8da0c]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:45f3fb95-eff9-4a9a-a50b-cdbfee3840d8, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:45f3fb95-eff9-4a9a-a50b-cdbfee3840d8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:10:33 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6d019fa-4b45-40eb-b525-357321587630 tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:45f3fb95-eff9-4a9a-a50b-cdbfee3840d8, portal: 172.16.0.220,3260]
Oct 26 00:10:33 user nova-compute[75165]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:45f3fb95-eff9-4a9a-a50b-cdbfee3840d8, portal: 172.16.0.220,3260] successful.
Oct 26 00:10:33 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:10:33 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45f3fb95-eff9-4a9a-a50b-cdbfee3840d8 -p 172.16.0.220:3260 --op delete {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:10:33 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45f3fb95-eff9-4a9a-a50b-cdbfee3840d8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:10:33 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d00f7ab-e74c-4d72-8a36-a7a38c12da08]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:10:33 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6d019fa-4b45-40eb-b525-357321587630 tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:10:33 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-b6d019fa-4b45-40eb-b525-357321587630 tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.331s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:10:33 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6d019fa-4b45-40eb-b525-357321587630 tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] <== disconnect_volume: return (332ms) None {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:10:33 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6d019fa-4b45-40eb-b525-357321587630 tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] [instance: 45625147-ff69-496a-a41e-e55f818a020a] Disconnected iSCSI Volume {{(pid=75165) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 00:10:33 user nova-compute[75165]: DEBUG nova.compute.manager [None req-b6d019fa-4b45-40eb-b525-357321587630 tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6bea2b74-7b28-4314-9a5a-14a1eeaf4a67', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CfQFXxYr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '45625147-ff69-496a-a41e-e55f818a020a', 'attached_at': '', 'detached_at': '', 'volume_id': '6bea2b74-7b28-4314-9a5a-14a1eeaf4a67', 'serial'} {{(pid=75165) _swap_volume /opt/stack/nova/nova/compute/manager.py:7790}}
Oct 26 00:10:33 user nova-compute[75165]: DEBUG nova.compute.manager [None req-b6d019fa-4b45-40eb-b525-357321587630 tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] [instance: 45625147-ff69-496a-a41e-e55f818a020a] swap_volume: removing Cinder connection for volume 45f3fb95-eff9-4a9a-a50b-cdbfee3840d8 {{(pid=75165) _swap_volume /opt/stack/nova/nova/compute/manager.py:7835}}
Oct 26 00:10:33 user nova-compute[75165]: DEBUG nova.compute.manager [None req-b6d019fa-4b45-40eb-b525-357321587630 tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] [instance: 45625147-ff69-496a-a41e-e55f818a020a] swap_volume: Updating volume 45f3fb95-eff9-4a9a-a50b-cdbfee3840d8 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:6bea2b74-7b28-4314-9a5a-14a1eeaf4a67", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "CfQFXxYr", "auth_password": "t0Dn7vkTAoh3ir", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdb", "volume_id": "6bea2b74-7b28-4314-9a5a-14a1eeaf4a67"}, "status": "reserved", "instance": "45625147-ff69-496a-a41e-e55f818a020a", "attached_at": "", "detached_at": "", "volume_id": "6bea2b74-7b28-4314-9a5a-14a1eeaf4a67", "serial": "6bea2b74-7b28-4314-9a5a-14a1eeaf4a67"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '6bea2b74-7b28-4314-9a5a-14a1eeaf4a67', 'no_device': None, 'attachment_id': '362e71df-c272-4157-ada0-10ba37482b8d'} {{(pid=75165) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7983}}
Oct 26 00:10:34 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-b6d019fa-4b45-40eb-b525-357321587630 tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] Lock "45625147-ff69-496a-a41e-e55f818a020a" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 28.742s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:10:35 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-28418a3a-1688-49da-91f5-a092de0a5f3c tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] Acquiring lock "45625147-ff69-496a-a41e-e55f818a020a" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:10:35 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-28418a3a-1688-49da-91f5-a092de0a5f3c tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] Lock "45625147-ff69-496a-a41e-e55f818a020a" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:10:35 user nova-compute[75165]: DEBUG os_brick.utils [None req-28418a3a-1688-49da-91f5-a092de0a5f3c tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:10:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:10:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:10:35 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e7d040d-26eb-4777-945e-df61fee40b6c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa94814ccb35\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:10:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:10:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:10:35 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec1eb42a-dc6c-418b-bee7-5c416bde18cd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:10:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:10:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:10:35 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcdf3f3b-73b4-4dd0-8396-54c7bbd1ce8a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:10:35 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[93d25f36-1c9e-4236-9993-1c5dec54d90a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:10:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-28418a3a-1688-49da-91f5-a092de0a5f3c tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] Running cmd (subprocess): nvme version {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:10:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-28418a3a-1688-49da-91f5-a092de0a5f3c tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 00:10:35 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.nvmeof [None req-28418a3a-1688-49da-91f5-a092de0a5f3c tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] nvme not present on system {{(pid=75165) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 00:10:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:10:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 00:10:35 user nova-compute[75165]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 00:10:35 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[22300810-d05a-49f6-bfa7-95b398b2b1c7]: (4, '') {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:10:35 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-28418a3a-1688-49da-91f5-a092de0a5f3c tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75165) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 00:10:35 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-28418a3a-1688-49da-91f5-a092de0a5f3c tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75165) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 00:10:35 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-28418a3a-1688-49da-91f5-a092de0a5f3c tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] LIGHTOS: no hostnqn found. {{(pid=75165) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 00:10:35 user nova-compute[75165]: DEBUG os_brick.utils [None req-28418a3a-1688-49da-91f5-a092de0a5f3c tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa94814ccb35', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:10:35 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:10:35 user nova-compute[75165]: INFO nova.compute.manager [None req-28418a3a-1688-49da-91f5-a092de0a5f3c tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] [instance: 45625147-ff69-496a-a41e-e55f818a020a] Swapping volume 6bea2b74-7b28-4314-9a5a-14a1eeaf4a67 for 45f3fb95-eff9-4a9a-a50b-cdbfee3840d8
Oct 26 00:10:37 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:10:38 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:10:40 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:10:40 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:10:42 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:10:44 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-728aa42a-9844-46d5-bfcd-0796c3c7bc34 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Acquiring lock "471df318-7d9f-4512-add6-b6612700e15d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:10:44 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-728aa42a-9844-46d5-bfcd-0796c3c7bc34 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Lock "471df318-7d9f-4512-add6-b6612700e15d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:10:44 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-728aa42a-9844-46d5-bfcd-0796c3c7bc34 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Acquiring lock "471df318-7d9f-4512-add6-b6612700e15d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:10:44 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-728aa42a-9844-46d5-bfcd-0796c3c7bc34 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Lock "471df318-7d9f-4512-add6-b6612700e15d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:10:44 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-728aa42a-9844-46d5-bfcd-0796c3c7bc34 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Lock "471df318-7d9f-4512-add6-b6612700e15d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:10:44 user nova-compute[75165]: INFO nova.compute.manager [None req-728aa42a-9844-46d5-bfcd-0796c3c7bc34 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] [instance: 471df318-7d9f-4512-add6-b6612700e15d] Terminating instance
Oct 26 00:10:44 user nova-compute[75165]: DEBUG nova.compute.manager [None req-728aa42a-9844-46d5-bfcd-0796c3c7bc34 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] [instance: 471df318-7d9f-4512-add6-b6612700e15d] Start destroying the instance on the hypervisor. {{(pid=75165) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 00:10:44 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:10:44 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:10:44 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:10:45 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:10:45 user nova-compute[75165]: DEBUG nova.compute.manager [req-8e8d3639-7217-4730-bf58-055a2f745ecb req-f9b4a90f-c4a1-4060-9602-afada8eda10f service nova] [instance: 471df318-7d9f-4512-add6-b6612700e15d] Received event network-vif-unplugged-f974b6d7-2580-4ea2-9e66-d24406b97fb8 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:10:45 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-8e8d3639-7217-4730-bf58-055a2f745ecb req-f9b4a90f-c4a1-4060-9602-afada8eda10f service nova] Acquiring lock "471df318-7d9f-4512-add6-b6612700e15d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:10:45 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-8e8d3639-7217-4730-bf58-055a2f745ecb req-f9b4a90f-c4a1-4060-9602-afada8eda10f service nova] Lock "471df318-7d9f-4512-add6-b6612700e15d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:10:45 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-8e8d3639-7217-4730-bf58-055a2f745ecb req-f9b4a90f-c4a1-4060-9602-afada8eda10f service nova] Lock "471df318-7d9f-4512-add6-b6612700e15d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:10:45 user nova-compute[75165]: DEBUG nova.compute.manager [req-8e8d3639-7217-4730-bf58-055a2f745ecb req-f9b4a90f-c4a1-4060-9602-afada8eda10f service nova] [instance: 471df318-7d9f-4512-add6-b6612700e15d] No waiting events found dispatching network-vif-unplugged-f974b6d7-2580-4ea2-9e66-d24406b97fb8 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:10:45 user nova-compute[75165]: DEBUG nova.compute.manager [req-8e8d3639-7217-4730-bf58-055a2f745ecb req-f9b4a90f-c4a1-4060-9602-afada8eda10f service nova] [instance: 471df318-7d9f-4512-add6-b6612700e15d] Received event network-vif-unplugged-f974b6d7-2580-4ea2-9e66-d24406b97fb8 for instance with task_state deleting. {{(pid=75165) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 00:10:45 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:10:45 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: 471df318-7d9f-4512-add6-b6612700e15d] Instance destroyed successfully.
Oct 26 00:10:45 user nova-compute[75165]: DEBUG nova.objects.instance [None req-728aa42a-9844-46d5-bfcd-0796c3c7bc34 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Lazy-loading 'resources' on Instance uuid 471df318-7d9f-4512-add6-b6612700e15d {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:10:45 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-728aa42a-9844-46d5-bfcd-0796c3c7bc34 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:08:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-235174092',display_name='tempest-ServersNegativeTestJSON-server-235174092',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-235174092',id=13,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-26T00:09:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='410dcedc2c3c49c3990259eca1aee491',ramdisk_id='',reservation_id='r-9a2fvupw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-585947888',owner_user_name='tempest-ServersNegativeTestJSON-585947888-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T00:09:02Z,user_data=None,user_id='d86fd0a8654f412d8c4e8e14d408d7ed',uuid=471df318-7d9f-4512-add6-b6612700e15d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f974b6d7-2580-4ea2-9e66-d24406b97fb8", "address": "fa:16:3e:9c:82:dc", "network": {"id": "6344595d-af28-41d8-9091-f7565d587f85", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-916895889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "410dcedc2c3c49c3990259eca1aee491", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf974b6d7-25", "ovs_interfaceid": "f974b6d7-2580-4ea2-9e66-d24406b97fb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 00:10:45 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-728aa42a-9844-46d5-bfcd-0796c3c7bc34 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Converting VIF {"id": "f974b6d7-2580-4ea2-9e66-d24406b97fb8", "address": "fa:16:3e:9c:82:dc", "network": {"id": "6344595d-af28-41d8-9091-f7565d587f85", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-916895889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "410dcedc2c3c49c3990259eca1aee491", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf974b6d7-25", "ovs_interfaceid": "f974b6d7-2580-4ea2-9e66-d24406b97fb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:10:45 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-728aa42a-9844-46d5-bfcd-0796c3c7bc34 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:82:dc,bridge_name='br-int',has_traffic_filtering=True,id=f974b6d7-2580-4ea2-9e66-d24406b97fb8,network=Network(6344595d-af28-41d8-9091-f7565d587f85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf974b6d7-25') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:10:45 user nova-compute[75165]: DEBUG os_vif [None req-728aa42a-9844-46d5-bfcd-0796c3c7bc34 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:82:dc,bridge_name='br-int',has_traffic_filtering=True,id=f974b6d7-2580-4ea2-9e66-d24406b97fb8,network=Network(6344595d-af28-41d8-9091-f7565d587f85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf974b6d7-25') {{(pid=75165) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 00:10:45 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:10:45 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf974b6d7-25, bridge=br-int, if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:10:45 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:10:45 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:10:45 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:10:45 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2ac53f2c-cbbd-4305-9683-c464ed65b38d) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:10:45 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:10:45 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:10:45 user nova-compute[75165]: INFO os_vif [None req-728aa42a-9844-46d5-bfcd-0796c3c7bc34 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:82:dc,bridge_name='br-int',has_traffic_filtering=True,id=f974b6d7-2580-4ea2-9e66-d24406b97fb8,network=Network(6344595d-af28-41d8-9091-f7565d587f85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf974b6d7-25')
Oct 26 00:10:45 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-728aa42a-9844-46d5-bfcd-0796c3c7bc34 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] [instance: 471df318-7d9f-4512-add6-b6612700e15d] Deleting instance files /opt/stack/data/nova/instances/471df318-7d9f-4512-add6-b6612700e15d_del
Oct 26 00:10:45 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-728aa42a-9844-46d5-bfcd-0796c3c7bc34 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] [instance: 471df318-7d9f-4512-add6-b6612700e15d] Deletion of /opt/stack/data/nova/instances/471df318-7d9f-4512-add6-b6612700e15d_del complete
Oct 26 00:10:45 user nova-compute[75165]: INFO nova.compute.manager [None req-728aa42a-9844-46d5-bfcd-0796c3c7bc34 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] [instance: 471df318-7d9f-4512-add6-b6612700e15d] Took 0.89 seconds to destroy the instance on the hypervisor.
Oct 26 00:10:45 user nova-compute[75165]: DEBUG oslo.service.loopingcall [None req-728aa42a-9844-46d5-bfcd-0796c3c7bc34 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75165) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 00:10:45 user nova-compute[75165]: DEBUG nova.compute.manager [-] [instance: 471df318-7d9f-4512-add6-b6612700e15d] Deallocating network for instance {{(pid=75165) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 00:10:45 user nova-compute[75165]: DEBUG nova.network.neutron [-] [instance: 471df318-7d9f-4512-add6-b6612700e15d] deallocate_for_instance() {{(pid=75165) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 00:10:45 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:10:46 user nova-compute[75165]: DEBUG nova.network.neutron [-] [instance: 471df318-7d9f-4512-add6-b6612700e15d] Updating instance_info_cache with network_info: [] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:10:46 user nova-compute[75165]: INFO nova.compute.manager [-] [instance: 471df318-7d9f-4512-add6-b6612700e15d] Took 0.54 seconds to deallocate network for instance.
Oct 26 00:10:46 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-728aa42a-9844-46d5-bfcd-0796c3c7bc34 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:10:46 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-728aa42a-9844-46d5-bfcd-0796c3c7bc34 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:10:46 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-728aa42a-9844-46d5-bfcd-0796c3c7bc34 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:10:46 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-728aa42a-9844-46d5-bfcd-0796c3c7bc34 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:10:46 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-728aa42a-9844-46d5-bfcd-0796c3c7bc34 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.398s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:10:46 user nova-compute[75165]: INFO nova.scheduler.client.report [None req-728aa42a-9844-46d5-bfcd-0796c3c7bc34 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Deleted allocations for instance 471df318-7d9f-4512-add6-b6612700e15d
Oct 26 00:10:46 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:10:46 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-728aa42a-9844-46d5-bfcd-0796c3c7bc34 tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Lock "471df318-7d9f-4512-add6-b6612700e15d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.096s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:10:47 user nova-compute[75165]: DEBUG nova.compute.manager [req-10c0abfe-1971-46cd-9977-05d56ecd6eee req-509827a6-8b8e-4e21-8473-6861c7d02af1 service nova] [instance: 471df318-7d9f-4512-add6-b6612700e15d] Received event network-vif-plugged-f974b6d7-2580-4ea2-9e66-d24406b97fb8 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:10:47 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-10c0abfe-1971-46cd-9977-05d56ecd6eee req-509827a6-8b8e-4e21-8473-6861c7d02af1 service nova] Acquiring lock "471df318-7d9f-4512-add6-b6612700e15d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:10:47 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-10c0abfe-1971-46cd-9977-05d56ecd6eee req-509827a6-8b8e-4e21-8473-6861c7d02af1 service nova] Lock "471df318-7d9f-4512-add6-b6612700e15d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:10:47 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-10c0abfe-1971-46cd-9977-05d56ecd6eee req-509827a6-8b8e-4e21-8473-6861c7d02af1 service nova] Lock "471df318-7d9f-4512-add6-b6612700e15d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:10:47 user nova-compute[75165]: DEBUG nova.compute.manager [req-10c0abfe-1971-46cd-9977-05d56ecd6eee req-509827a6-8b8e-4e21-8473-6861c7d02af1 service nova] [instance: 471df318-7d9f-4512-add6-b6612700e15d] No waiting events found dispatching network-vif-plugged-f974b6d7-2580-4ea2-9e66-d24406b97fb8 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:10:47 user nova-compute[75165]: WARNING nova.compute.manager [req-10c0abfe-1971-46cd-9977-05d56ecd6eee req-509827a6-8b8e-4e21-8473-6861c7d02af1 service nova] [instance: 471df318-7d9f-4512-add6-b6612700e15d] Received unexpected event network-vif-plugged-f974b6d7-2580-4ea2-9e66-d24406b97fb8 for instance with vm_state deleted and task_state None.
Oct 26 00:10:47 user nova-compute[75165]: DEBUG nova.compute.manager [req-10c0abfe-1971-46cd-9977-05d56ecd6eee req-509827a6-8b8e-4e21-8473-6861c7d02af1 service nova] [instance: 471df318-7d9f-4512-add6-b6612700e15d] Received event network-vif-deleted-f974b6d7-2580-4ea2-9e66-d24406b97fb8 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:10:50 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:10:50 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:10:54 user nova-compute[75165]: DEBUG nova.compute.manager [None req-28418a3a-1688-49da-91f5-a092de0a5f3c tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] [instance: 45625147-ff69-496a-a41e-e55f818a020a] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:45f3fb95-eff9-4a9a-a50b-cdbfee3840d8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ARaLnBGq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '45625147-ff69-496a-a41e-e55f818a020a', 'attached_at': '', 'detached_at': '', 'volume_id': '45f3fb95-eff9-4a9a-a50b-cdbfee3840d8', 'serial': '45f3fb95-eff9-4a9a-a50b-cdbfee3840d8'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6bea2b74-7b28-4314-9a5a-14a1eeaf4a67', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CfQFXxYr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'volume_id': '6bea2b74-7b28-4314-9a5a-14a1eeaf4a67'}, 'status': 'reserved', 'instance': '45625147-ff69-496a-a41e-e55f818a020a', 'attached_at': '', 'detached_at': '', 'volume_id': '6bea2b74-7b28-4314-9a5a-14a1eeaf4a67', 'serial'} {{(pid=75165) _swap_volume /opt/stack/nova/nova/compute/manager.py:7781}}
Oct 26 00:10:54 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28418a3a-1688-49da-91f5-a092de0a5f3c tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] [instance: 45625147-ff69-496a-a41e-e55f818a020a] Calling os-brick to attach iSCSI Volume {{(pid=75165) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 00:10:54 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-28418a3a-1688-49da-91f5-a092de0a5f3c tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8bf8160e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:45f3fb95-eff9-4a9a-a50b-cdbfee3840d8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ARaLnBGq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:10:54 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-28418a3a-1688-49da-91f5-a092de0a5f3c tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:10:54 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-28418a3a-1688-49da-91f5-a092de0a5f3c tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:10:54 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-28418a3a-1688-49da-91f5-a092de0a5f3c tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:10:54 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-28418a3a-1688-49da-91f5-a092de0a5f3c tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:10:54 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-28418a3a-1688-49da-91f5-a092de0a5f3c tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:45f3fb95-eff9-4a9a-a50b-cdbfee3840d8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:10:54 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-28418a3a-1688-49da-91f5-a092de0a5f3c tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:45f3fb95-eff9-4a9a-a50b-cdbfee3840d8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:10:54 user nova-compute[75165]: INFO os_brick.initiator.connectors.iscsi [None req-28418a3a-1688-49da-91f5-a092de0a5f3c tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 00:10:54 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45f3fb95-eff9-4a9a-a50b-cdbfee3840d8 -p 172.16.0.220:3260 {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:10:54 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45f3fb95-eff9-4a9a-a50b-cdbfee3840d8 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:10:54 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[945f5d00-abbd-4856-8e0e-63d319fd673e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:10:54 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-28418a3a-1688-49da-91f5-a092de0a5f3c tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 00:10:54 user nova-compute[75165]:  {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:10:54 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45f3fb95-eff9-4a9a-a50b-cdbfee3840d8 -p 172.16.0.220:3260 --interface default --op new {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:10:54 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45f3fb95-eff9-4a9a-a50b-cdbfee3840d8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:10:54 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f8eb4af-3c6d-48fa-aacf-533c7bfeefd5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:45f3fb95-eff9-4a9a-a50b-cdbfee3840d8] added\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:10:54 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-28418a3a-1688-49da-91f5-a092de0a5f3c tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:45f3fb95-eff9-4a9a-a50b-cdbfee3840d8] added
Oct 26 00:10:54 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:10:54 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45f3fb95-eff9-4a9a-a50b-cdbfee3840d8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:10:54 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45f3fb95-eff9-4a9a-a50b-cdbfee3840d8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:10:54 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[819156f9-3063-478c-b718-2fd1f04ef7f3]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:10:54 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-28418a3a-1688-49da-91f5-a092de0a5f3c tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:10:54 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45f3fb95-eff9-4a9a-a50b-cdbfee3840d8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:10:54 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45f3fb95-eff9-4a9a-a50b-cdbfee3840d8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:10:54 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eda305e-5a6d-4107-b7f5-a4589719c3bf]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:10:54 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-28418a3a-1688-49da-91f5-a092de0a5f3c tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:10:54 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45f3fb95-eff9-4a9a-a50b-cdbfee3840d8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ARaLnBGq {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:10:54 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45f3fb95-eff9-4a9a-a50b-cdbfee3840d8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ARaLnBGq" returned: 0 in 0.018s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:10:54 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0d6660f-473a-4b8a-b4b5-05a09a81c64a]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:10:54 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-28418a3a-1688-49da-91f5-a092de0a5f3c tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ARaLnBGq'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:10:54 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45f3fb95-eff9-4a9a-a50b-cdbfee3840d8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:10:54 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45f3fb95-eff9-4a9a-a50b-cdbfee3840d8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:10:54 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[c333ee1a-f1b2-491b-922a-52441fd95643]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:10:54 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-28418a3a-1688-49da-91f5-a092de0a5f3c tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:10:54 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:10:54 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:10:54 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[a60c7573-a078-466a-bdb3-fab875c5fbe8]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f25f6e6a-9711-4455-82e8-c56648a08508 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:083f264a-3f29-48b4-9935-a73f4234e6d5 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff01f329-6dda-43b6-8da5-6a5c48fad211 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bea2b74-7b28-4314-9a5a-14a1eeaf4a67 (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:10:54 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-28418a3a-1688-49da-91f5-a092de0a5f3c tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f25f6e6a-9711-4455-82e8-c56648a08508 (non-flash)
Oct 26 00:10:54 user nova-compute[75165]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:083f264a-3f29-48b4-9935-a73f4234e6d5 (non-flash)
Oct 26 00:10:54 user nova-compute[75165]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff01f329-6dda-43b6-8da5-6a5c48fad211 (non-flash)
Oct 26 00:10:54 user nova-compute[75165]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bea2b74-7b28-4314-9a5a-14a1eeaf4a67 (non-flash)
Oct 26 00:10:54 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:10:54 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-28418a3a-1688-49da-91f5-a092de0a5f3c tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f25f6e6a-9711-4455-82e8-c56648a08508 (non-flash)
Oct 26 00:10:54 user nova-compute[75165]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:083f264a-3f29-48b4-9935-a73f4234e6d5 (non-flash)
Oct 26 00:10:54 user nova-compute[75165]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff01f329-6dda-43b6-8da5-6a5c48fad211 (non-flash)
Oct 26 00:10:54 user nova-compute[75165]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bea2b74-7b28-4314-9a5a-14a1eeaf4a67 (non-flash)
Oct 26 00:10:54 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:10:54 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45f3fb95-eff9-4a9a-a50b-cdbfee3840d8 -p 172.16.0.220:3260 --login {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:10:54 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45f3fb95-eff9-4a9a-a50b-cdbfee3840d8 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:10:54 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd516b26-7f64-48e6-8986-12259be2c7b1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:45f3fb95-eff9-4a9a-a50b-cdbfee3840d8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:45f3fb95-eff9-4a9a-a50b-cdbfee3840d8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:10:54 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-28418a3a-1688-49da-91f5-a092de0a5f3c tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:45f3fb95-eff9-4a9a-a50b-cdbfee3840d8, portal: 172.16.0.220,3260]
Oct 26 00:10:54 user nova-compute[75165]: Login to [iface: default, target: iqn.2010-10.org.openstack:45f3fb95-eff9-4a9a-a50b-cdbfee3840d8, portal: 172.16.0.220,3260] successful.
Oct 26 00:10:54 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:10:54 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45f3fb95-eff9-4a9a-a50b-cdbfee3840d8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:10:54 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45f3fb95-eff9-4a9a-a50b-cdbfee3840d8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:10:54 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[430ca8e7-a8aa-4a6e-a8c1-0e945f68c445]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:10:54 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-28418a3a-1688-49da-91f5-a092de0a5f3c tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:10:54 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:10:54 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:10:54 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3cabe0c-4198-4615-841e-5c242960ef06]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45f3fb95-eff9-4a9a-a50b-cdbfee3840d8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f25f6e6a-9711-4455-82e8-c56648a08508 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:083f264a-3f29-48b4-9935-a73f4234e6d5 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff01f329-6dda-43b6-8da5-6a5c48fad211 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bea2b74-7b28-4314-9a5a-14a1eeaf4a67 (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:10:54 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-28418a3a-1688-49da-91f5-a092de0a5f3c tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45f3fb95-eff9-4a9a-a50b-cdbfee3840d8 (non-flash)
Oct 26 00:10:54 user nova-compute[75165]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f25f6e6a-9711-4455-82e8-c56648a08508 (non-flash)
Oct 26 00:10:54 user nova-compute[75165]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:083f264a-3f29-48b4-9935-a73f4234e6d5 (non-flash)
Oct 26 00:10:54 user nova-compute[75165]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff01f329-6dda-43b6-8da5-6a5c48fad211 (non-flash)
Oct 26 00:10:54 user nova-compute[75165]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bea2b74-7b28-4314-9a5a-14a1eeaf4a67 (non-flash)
Oct 26 00:10:54 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:10:54 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-28418a3a-1688-49da-91f5-a092de0a5f3c tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45f3fb95-eff9-4a9a-a50b-cdbfee3840d8 (non-flash)
Oct 26 00:10:54 user nova-compute[75165]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f25f6e6a-9711-4455-82e8-c56648a08508 (non-flash)
Oct 26 00:10:54 user nova-compute[75165]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:083f264a-3f29-48b4-9935-a73f4234e6d5 (non-flash)
Oct 26 00:10:54 user nova-compute[75165]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff01f329-6dda-43b6-8da5-6a5c48fad211 (non-flash)
Oct 26 00:10:54 user nova-compute[75165]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bea2b74-7b28-4314-9a5a-14a1eeaf4a67 (non-flash)
Oct 26 00:10:54 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:10:54 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-28418a3a-1688-49da-91f5-a092de0a5f3c tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:45f3fb95-eff9-4a9a-a50b-cdbfee3840d8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.289s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:10:54 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-28418a3a-1688-49da-91f5-a092de0a5f3c tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] Connected to 172.16.0.220:3260 {{(pid=75165) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 00:10:54 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-28418a3a-1688-49da-91f5-a092de0a5f3c tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] HCTL ('36', '-', '-', 0) found on session 10 with lun 0 {{(pid=75165) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 00:10:54 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-28418a3a-1688-49da-91f5-a092de0a5f3c tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] Scanning host 36 c: -, t: -, l: 0) {{(pid=75165) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 00:10:54 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:10:54 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:10:54 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[c02cdafa-b483-48dd-84dd-39e316c17a71]: (4, ('- - 0', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:10:54 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-28418a3a-1688-49da-91f5-a092de0a5f3c tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] Searching for a device in session 10 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75165) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 00:10:54 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-28418a3a-1688-49da-91f5-a092de0a5f3c tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:45f3fb95-eff9-4a9a-a50b-cdbfee3840d8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ARaLnBGq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75165) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 00:10:55 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:10:55 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:10:55 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-28418a3a-1688-49da-91f5-a092de0a5f3c tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.332s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:10:55 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-28418a3a-1688-49da-91f5-a092de0a5f3c tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] <== connect_volume: return (1336ms) {'type': 'block', 'scsi_wwn': '26437306663616534', 'path': '/dev/sde'} {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:10:55 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28418a3a-1688-49da-91f5-a092de0a5f3c tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] [instance: 45625147-ff69-496a-a41e-e55f818a020a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26437306663616534', 'path': '/dev/sde'} {{(pid=75165) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 00:10:55 user nova-compute[75165]: DEBUG nova.objects.instance [None req-28418a3a-1688-49da-91f5-a092de0a5f3c tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] Lazy-loading 'flavor' on Instance uuid 45625147-ff69-496a-a41e-e55f818a020a {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:10:56 user nova-compute[75165]: DEBUG nova.virt.libvirt.guest [None req-28418a3a-1688-49da-91f5-a092de0a5f3c tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=75165) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 26 00:10:56 user nova-compute[75165]: DEBUG nova.virt.libvirt.guest [None req-28418a3a-1688-49da-91f5-a092de0a5f3c tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] COPY block job progress, current cursor: 119537664 final cursor: 1073741824 {{(pid=75165) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 26 00:10:57 user nova-compute[75165]: DEBUG nova.virt.libvirt.guest [None req-28418a3a-1688-49da-91f5-a092de0a5f3c tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] COPY block job progress, current cursor: 289406976 final cursor: 1073741824 {{(pid=75165) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 26 00:10:57 user nova-compute[75165]: DEBUG nova.virt.libvirt.guest [None req-28418a3a-1688-49da-91f5-a092de0a5f3c tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] COPY block job progress, current cursor: 419430400 final cursor: 1073741824 {{(pid=75165) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 26 00:10:58 user nova-compute[75165]: DEBUG nova.virt.libvirt.guest [None req-28418a3a-1688-49da-91f5-a092de0a5f3c tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] COPY block job progress, current cursor: 553648128 final cursor: 1073741824 {{(pid=75165) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 26 00:10:59 user nova-compute[75165]: DEBUG nova.virt.libvirt.guest [None req-28418a3a-1688-49da-91f5-a092de0a5f3c tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] COPY block job progress, current cursor: 615514112 final cursor: 1073741824 {{(pid=75165) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 26 00:10:59 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-4679c8d2-97fb-409b-a092-b4f0eaeca0f4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Acquiring lock "22b9689c-5e83-4807-971f-5b244914b7e5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:10:59 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-4679c8d2-97fb-409b-a092-b4f0eaeca0f4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Lock "22b9689c-5e83-4807-971f-5b244914b7e5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:10:59 user nova-compute[75165]: DEBUG nova.compute.manager [None req-4679c8d2-97fb-409b-a092-b4f0eaeca0f4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: 22b9689c-5e83-4807-971f-5b244914b7e5] Starting instance... {{(pid=75165) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 00:10:59 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-4679c8d2-97fb-409b-a092-b4f0eaeca0f4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:10:59 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-4679c8d2-97fb-409b-a092-b4f0eaeca0f4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:10:59 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-4679c8d2-97fb-409b-a092-b4f0eaeca0f4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75165) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 00:10:59 user nova-compute[75165]: INFO nova.compute.claims [None req-4679c8d2-97fb-409b-a092-b4f0eaeca0f4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: 22b9689c-5e83-4807-971f-5b244914b7e5] Claim successful on node user
Oct 26 00:10:59 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-bd2a81ae-e799-45ba-aba9-995a5fdd45c6 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Acquiring lock "26a0b493-bb47-466e-95d5-945fc3849fa5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:10:59 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-bd2a81ae-e799-45ba-aba9-995a5fdd45c6 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Lock "26a0b493-bb47-466e-95d5-945fc3849fa5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:10:59 user nova-compute[75165]: DEBUG nova.objects.instance [None req-bd2a81ae-e799-45ba-aba9-995a5fdd45c6 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Lazy-loading 'flavor' on Instance uuid 26a0b493-bb47-466e-95d5-945fc3849fa5 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:10:59 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-bd2a81ae-e799-45ba-aba9-995a5fdd45c6 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Lock "26a0b493-bb47-466e-95d5-945fc3849fa5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.081s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:10:59 user nova-compute[75165]: DEBUG nova.virt.libvirt.guest [None req-28418a3a-1688-49da-91f5-a092de0a5f3c tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] COPY block job progress, current cursor: 789577728 final cursor: 1073741824 {{(pid=75165) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 26 00:10:59 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-bd2a81ae-e799-45ba-aba9-995a5fdd45c6 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Acquiring lock "26a0b493-bb47-466e-95d5-945fc3849fa5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:10:59 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-bd2a81ae-e799-45ba-aba9-995a5fdd45c6 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Lock "26a0b493-bb47-466e-95d5-945fc3849fa5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:10:59 user nova-compute[75165]: INFO nova.compute.manager [None req-bd2a81ae-e799-45ba-aba9-995a5fdd45c6 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] Attaching volume ce7241dd-04dd-4a96-b8a6-21fb4e678792 to /dev/vdb
Oct 26 00:10:59 user nova-compute[75165]: DEBUG os_brick.utils [None req-bd2a81ae-e799-45ba-aba9-995a5fdd45c6 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:10:59 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:10:59 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:10:59 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef08df65-0846-4f79-b351-8e030c2165cc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa94814ccb35\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:10:59 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:10:59 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:10:59 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[0282ae11-fb41-4162-84f3-3245f60df057]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:10:59 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:10:59 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:10:59 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[a11734e2-e704-416a-a26a-b574824758b6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:10:59 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[6956f4f4-90c3-4835-94c0-6ff277430393]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:10:59 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-bd2a81ae-e799-45ba-aba9-995a5fdd45c6 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Running cmd (subprocess): nvme version {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:00 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-bd2a81ae-e799-45ba-aba9-995a5fdd45c6 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] 'nvme version' failed. Not Retrying. {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 00:11:00 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bd2a81ae-e799-45ba-aba9-995a5fdd45c6 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] nvme not present on system {{(pid=75165) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 00:11:00 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:00 user nova-compute[75165]: DEBUG nova.virt.libvirt.guest [None req-28418a3a-1688-49da-91f5-a092de0a5f3c tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] COPY block job progress, current cursor: 951058432 final cursor: 1073741824 {{(pid=75165) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 26 00:11:00 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-4679c8d2-97fb-409b-a092-b4f0eaeca0f4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:11:00 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 00:11:00 user nova-compute[75165]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 00:11:00 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0a1c3ad-efa2-4141-a81f-b604ca541f74]: (4, '') {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:11:00 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-bd2a81ae-e799-45ba-aba9-995a5fdd45c6 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75165) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 00:11:00 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-bd2a81ae-e799-45ba-aba9-995a5fdd45c6 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75165) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 00:11:00 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-bd2a81ae-e799-45ba-aba9-995a5fdd45c6 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] LIGHTOS: no hostnqn found. {{(pid=75165) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 00:11:00 user nova-compute[75165]: DEBUG os_brick.utils [None req-bd2a81ae-e799-45ba-aba9-995a5fdd45c6 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] <== get_connector_properties: return (176ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa94814ccb35', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:11:00 user nova-compute[75165]: DEBUG nova.virt.block_device [None req-bd2a81ae-e799-45ba-aba9-995a5fdd45c6 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] Updating existing volume attachment record: f29a2fc1-e2a7-49d4-bee6-303e071ca12b {{(pid=75165) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 00:11:00 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-4679c8d2-97fb-409b-a092-b4f0eaeca0f4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:11:00 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-4679c8d2-97fb-409b-a092-b4f0eaeca0f4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.863s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:11:00 user nova-compute[75165]: DEBUG nova.compute.manager [None req-4679c8d2-97fb-409b-a092-b4f0eaeca0f4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: 22b9689c-5e83-4807-971f-5b244914b7e5] Start building networks asynchronously for instance. {{(pid=75165) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 00:11:00 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-0d680ba8-140d-41f2-aa61-b9323ffcddcc tempest-VolumesAssistedSnapshotsTest-1656989943 tempest-VolumesAssistedSnapshotsTest-1656989943-project-member] Acquiring lock "f326db85-74f6-4e60-9c55-46b2a59502d0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:11:00 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-0d680ba8-140d-41f2-aa61-b9323ffcddcc tempest-VolumesAssistedSnapshotsTest-1656989943 tempest-VolumesAssistedSnapshotsTest-1656989943-project-member] Lock "f326db85-74f6-4e60-9c55-46b2a59502d0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:11:00 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-0d680ba8-140d-41f2-aa61-b9323ffcddcc tempest-VolumesAssistedSnapshotsTest-1656989943 tempest-VolumesAssistedSnapshotsTest-1656989943-project-member] Acquiring lock "f326db85-74f6-4e60-9c55-46b2a59502d0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:11:00 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-0d680ba8-140d-41f2-aa61-b9323ffcddcc tempest-VolumesAssistedSnapshotsTest-1656989943 tempest-VolumesAssistedSnapshotsTest-1656989943-project-member] Lock "f326db85-74f6-4e60-9c55-46b2a59502d0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:11:00 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-0d680ba8-140d-41f2-aa61-b9323ffcddcc tempest-VolumesAssistedSnapshotsTest-1656989943 tempest-VolumesAssistedSnapshotsTest-1656989943-project-member] Lock "f326db85-74f6-4e60-9c55-46b2a59502d0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:11:00 user nova-compute[75165]: INFO nova.compute.manager [None req-0d680ba8-140d-41f2-aa61-b9323ffcddcc tempest-VolumesAssistedSnapshotsTest-1656989943 tempest-VolumesAssistedSnapshotsTest-1656989943-project-member] [instance: f326db85-74f6-4e60-9c55-46b2a59502d0] Terminating instance
Oct 26 00:11:00 user nova-compute[75165]: DEBUG nova.compute.manager [None req-0d680ba8-140d-41f2-aa61-b9323ffcddcc tempest-VolumesAssistedSnapshotsTest-1656989943 tempest-VolumesAssistedSnapshotsTest-1656989943-project-member] [instance: f326db85-74f6-4e60-9c55-46b2a59502d0] Start destroying the instance on the hypervisor. {{(pid=75165) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 00:11:00 user nova-compute[75165]: DEBUG nova.compute.manager [None req-4679c8d2-97fb-409b-a092-b4f0eaeca0f4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: 22b9689c-5e83-4807-971f-5b244914b7e5] Allocating IP information in the background. {{(pid=75165) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 00:11:00 user nova-compute[75165]: DEBUG nova.network.neutron [None req-4679c8d2-97fb-409b-a092-b4f0eaeca0f4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: 22b9689c-5e83-4807-971f-5b244914b7e5] allocate_for_instance() {{(pid=75165) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 00:11:00 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:00 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-4679c8d2-97fb-409b-a092-b4f0eaeca0f4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: 22b9689c-5e83-4807-971f-5b244914b7e5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 00:11:00 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:00 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:00 user nova-compute[75165]: DEBUG nova.compute.manager [None req-4679c8d2-97fb-409b-a092-b4f0eaeca0f4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: 22b9689c-5e83-4807-971f-5b244914b7e5] Start building block device mappings for instance. {{(pid=75165) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 00:11:00 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:00 user nova-compute[75165]: DEBUG nova.policy [None req-4679c8d2-97fb-409b-a092-b4f0eaeca0f4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5b3ce94f4c01446ebf79a1eba3833e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2911497df44047d9a9ee36a5652298bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75165) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 00:11:00 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:00 user nova-compute[75165]: DEBUG nova.virt.libvirt.guest [None req-28418a3a-1688-49da-91f5-a092de0a5f3c tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] COPY block job progress, current cursor: 1067450368 final cursor: 1073741824 {{(pid=75165) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 26 00:11:00 user nova-compute[75165]: DEBUG nova.compute.manager [None req-4679c8d2-97fb-409b-a092-b4f0eaeca0f4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: 22b9689c-5e83-4807-971f-5b244914b7e5] Start spawning the instance on the hypervisor. {{(pid=75165) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 00:11:00 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-4679c8d2-97fb-409b-a092-b4f0eaeca0f4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: 22b9689c-5e83-4807-971f-5b244914b7e5] Creating instance directory {{(pid=75165) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 00:11:00 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-4679c8d2-97fb-409b-a092-b4f0eaeca0f4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: 22b9689c-5e83-4807-971f-5b244914b7e5] Creating image(s)
Oct 26 00:11:00 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-4679c8d2-97fb-409b-a092-b4f0eaeca0f4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Acquiring lock "/opt/stack/data/nova/instances/22b9689c-5e83-4807-971f-5b244914b7e5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:11:00 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-4679c8d2-97fb-409b-a092-b4f0eaeca0f4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Lock "/opt/stack/data/nova/instances/22b9689c-5e83-4807-971f-5b244914b7e5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:11:00 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-4679c8d2-97fb-409b-a092-b4f0eaeca0f4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Lock "/opt/stack/data/nova/instances/22b9689c-5e83-4807-971f-5b244914b7e5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:11:00 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:00 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-4679c8d2-97fb-409b-a092-b4f0eaeca0f4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:00 user nova-compute[75165]: DEBUG nova.compute.manager [req-61cf1c6b-f47f-4f18-8504-9bf8be5ec559 req-9bcd8955-6126-433b-b5cd-74fe88f43a6a service nova] [instance: f326db85-74f6-4e60-9c55-46b2a59502d0] Received event network-vif-unplugged-26b16dce-35d4-4756-8eea-c3638f5b6c16 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:11:00 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-61cf1c6b-f47f-4f18-8504-9bf8be5ec559 req-9bcd8955-6126-433b-b5cd-74fe88f43a6a service nova] Acquiring lock "f326db85-74f6-4e60-9c55-46b2a59502d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:11:00 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-61cf1c6b-f47f-4f18-8504-9bf8be5ec559 req-9bcd8955-6126-433b-b5cd-74fe88f43a6a service nova] Lock "f326db85-74f6-4e60-9c55-46b2a59502d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:11:00 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-61cf1c6b-f47f-4f18-8504-9bf8be5ec559 req-9bcd8955-6126-433b-b5cd-74fe88f43a6a service nova] Lock "f326db85-74f6-4e60-9c55-46b2a59502d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:11:00 user nova-compute[75165]: DEBUG nova.compute.manager [req-61cf1c6b-f47f-4f18-8504-9bf8be5ec559 req-9bcd8955-6126-433b-b5cd-74fe88f43a6a service nova] [instance: f326db85-74f6-4e60-9c55-46b2a59502d0] No waiting events found dispatching network-vif-unplugged-26b16dce-35d4-4756-8eea-c3638f5b6c16 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:11:00 user nova-compute[75165]: DEBUG nova.compute.manager [req-61cf1c6b-f47f-4f18-8504-9bf8be5ec559 req-9bcd8955-6126-433b-b5cd-74fe88f43a6a service nova] [instance: f326db85-74f6-4e60-9c55-46b2a59502d0] Received event network-vif-unplugged-26b16dce-35d4-4756-8eea-c3638f5b6c16 for instance with task_state deleting. {{(pid=75165) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 00:11:00 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-4679c8d2-97fb-409b-a092-b4f0eaeca0f4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json" returned: 0 in 0.198s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:00 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-4679c8d2-97fb-409b-a092-b4f0eaeca0f4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Acquiring lock "7d3243421cf3fdc288b758f687a93103b7b95466" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:11:00 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-4679c8d2-97fb-409b-a092-b4f0eaeca0f4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Lock "7d3243421cf3fdc288b758f687a93103b7b95466" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:11:00 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-4679c8d2-97fb-409b-a092-b4f0eaeca0f4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:01 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: f326db85-74f6-4e60-9c55-46b2a59502d0] Instance destroyed successfully.
Oct 26 00:11:01 user nova-compute[75165]: DEBUG nova.objects.instance [None req-0d680ba8-140d-41f2-aa61-b9323ffcddcc tempest-VolumesAssistedSnapshotsTest-1656989943 tempest-VolumesAssistedSnapshotsTest-1656989943-project-member] Lazy-loading 'resources' on Instance uuid f326db85-74f6-4e60-9c55-46b2a59502d0 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:11:01 user nova-compute[75165]: DEBUG nova.virt.libvirt.guest [None req-28418a3a-1688-49da-91f5-a092de0a5f3c tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=75165) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 26 00:11:01 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-0d680ba8-140d-41f2-aa61-b9323ffcddcc tempest-VolumesAssistedSnapshotsTest-1656989943 tempest-VolumesAssistedSnapshotsTest-1656989943-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:07:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1259026962',display_name='tempest-VolumesAssistedSnapshotsTest-server-1259026962',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1259026962',id=10,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMDDUCNXm1z9xh1P2F7lz2Mjgf0CnWTMHOuMjqQiq+R2lHBnDl1xyFtffR5YzWXTlUKQNpfMUgWrsz5T9aTtJvn7sOg1n9hznc7jP8vV48hpya4y0jDj/mKSGs/QZqFzMA==',key_name='tempest-keypair-1001302888',keypairs=<?>,launch_index=0,launched_at=2023-10-26T00:07:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fc4d929d240d4d4d93d5926abe61df9b',ramdisk_id='',reservation_id='r-7fsxrmj0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1656989943',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1656989943-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T00:08:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b26a2b84140e412589a813c9f0dac148',uuid=f326db85-74f6-4e60-9c55-46b2a59502d0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "26b16dce-35d4-4756-8eea-c3638f5b6c16", "address": "fa:16:3e:03:0d:40", "network": {"id": "2391bc4b-c0f5-4644-94d8-37a74146506d", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2088537358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc4d929d240d4d4d93d5926abe61df9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26b16dce-35", "ovs_interfaceid": "26b16dce-35d4-4756-8eea-c3638f5b6c16", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 00:11:01 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-0d680ba8-140d-41f2-aa61-b9323ffcddcc tempest-VolumesAssistedSnapshotsTest-1656989943 tempest-VolumesAssistedSnapshotsTest-1656989943-project-member] Converting VIF {"id": "26b16dce-35d4-4756-8eea-c3638f5b6c16", "address": "fa:16:3e:03:0d:40", "network": {"id": "2391bc4b-c0f5-4644-94d8-37a74146506d", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2088537358-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc4d929d240d4d4d93d5926abe61df9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26b16dce-35", "ovs_interfaceid": "26b16dce-35d4-4756-8eea-c3638f5b6c16", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:11:01 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-0d680ba8-140d-41f2-aa61-b9323ffcddcc tempest-VolumesAssistedSnapshotsTest-1656989943 tempest-VolumesAssistedSnapshotsTest-1656989943-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:03:0d:40,bridge_name='br-int',has_traffic_filtering=True,id=26b16dce-35d4-4756-8eea-c3638f5b6c16,network=Network(2391bc4b-c0f5-4644-94d8-37a74146506d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26b16dce-35') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:11:01 user nova-compute[75165]: DEBUG os_vif [None req-0d680ba8-140d-41f2-aa61-b9323ffcddcc tempest-VolumesAssistedSnapshotsTest-1656989943 tempest-VolumesAssistedSnapshotsTest-1656989943-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:03:0d:40,bridge_name='br-int',has_traffic_filtering=True,id=26b16dce-35d4-4756-8eea-c3638f5b6c16,network=Network(2391bc4b-c0f5-4644-94d8-37a74146506d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26b16dce-35') {{(pid=75165) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 00:11:01 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:01 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap26b16dce-35, bridge=br-int, if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:11:01 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:01 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-4679c8d2-97fb-409b-a092-b4f0eaeca0f4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json" returned: 0 in 0.272s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:01 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:11:01 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-4679c8d2-97fb-409b-a092-b4f0eaeca0f4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466,backing_fmt=raw /opt/stack/data/nova/instances/22b9689c-5e83-4807-971f-5b244914b7e5/disk 1073741824 {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:01 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:01 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d1abd6d2-a0c9-49ab-b30f-62ca20a7b470) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:11:01 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:01 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:11:01 user nova-compute[75165]: INFO os_vif [None req-0d680ba8-140d-41f2-aa61-b9323ffcddcc tempest-VolumesAssistedSnapshotsTest-1656989943 tempest-VolumesAssistedSnapshotsTest-1656989943-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:03:0d:40,bridge_name='br-int',has_traffic_filtering=True,id=26b16dce-35d4-4756-8eea-c3638f5b6c16,network=Network(2391bc4b-c0f5-4644-94d8-37a74146506d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26b16dce-35')
Oct 26 00:11:01 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-0d680ba8-140d-41f2-aa61-b9323ffcddcc tempest-VolumesAssistedSnapshotsTest-1656989943 tempest-VolumesAssistedSnapshotsTest-1656989943-project-member] [instance: f326db85-74f6-4e60-9c55-46b2a59502d0] Deleting instance files /opt/stack/data/nova/instances/f326db85-74f6-4e60-9c55-46b2a59502d0_del
Oct 26 00:11:01 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-0d680ba8-140d-41f2-aa61-b9323ffcddcc tempest-VolumesAssistedSnapshotsTest-1656989943 tempest-VolumesAssistedSnapshotsTest-1656989943-project-member] [instance: f326db85-74f6-4e60-9c55-46b2a59502d0] Deletion of /opt/stack/data/nova/instances/f326db85-74f6-4e60-9c55-46b2a59502d0_del complete
Oct 26 00:11:01 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-4679c8d2-97fb-409b-a092-b4f0eaeca0f4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466,backing_fmt=raw /opt/stack/data/nova/instances/22b9689c-5e83-4807-971f-5b244914b7e5/disk 1073741824" returned: 0 in 0.072s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:01 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-4679c8d2-97fb-409b-a092-b4f0eaeca0f4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Lock "7d3243421cf3fdc288b758f687a93103b7b95466" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.351s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:11:01 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-4679c8d2-97fb-409b-a092-b4f0eaeca0f4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:01 user nova-compute[75165]: DEBUG nova.network.neutron [None req-4679c8d2-97fb-409b-a092-b4f0eaeca0f4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: 22b9689c-5e83-4807-971f-5b244914b7e5] Successfully created port: 15022d7e-be4a-480d-a612-31e1e689f43b {{(pid=75165) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 00:11:01 user nova-compute[75165]: INFO nova.compute.manager [None req-0d680ba8-140d-41f2-aa61-b9323ffcddcc tempest-VolumesAssistedSnapshotsTest-1656989943 tempest-VolumesAssistedSnapshotsTest-1656989943-project-member] [instance: f326db85-74f6-4e60-9c55-46b2a59502d0] Took 1.07 seconds to destroy the instance on the hypervisor.
Oct 26 00:11:01 user nova-compute[75165]: DEBUG oslo.service.loopingcall [None req-0d680ba8-140d-41f2-aa61-b9323ffcddcc tempest-VolumesAssistedSnapshotsTest-1656989943 tempest-VolumesAssistedSnapshotsTest-1656989943-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75165) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 00:11:01 user nova-compute[75165]: DEBUG nova.compute.manager [-] [instance: f326db85-74f6-4e60-9c55-46b2a59502d0] Deallocating network for instance {{(pid=75165) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 00:11:01 user nova-compute[75165]: DEBUG nova.network.neutron [-] [instance: f326db85-74f6-4e60-9c55-46b2a59502d0] deallocate_for_instance() {{(pid=75165) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 00:11:01 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28418a3a-1688-49da-91f5-a092de0a5f3c tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] [instance: 45625147-ff69-496a-a41e-e55f818a020a] calling os-brick to detach iSCSI Volume {{(pid=75165) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 00:11:01 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-28418a3a-1688-49da-91f5-a092de0a5f3c tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8bf8160e50>, {'target_iqn': 'iqn.2010-10.org.openstack:6bea2b74-7b28-4314-9a5a-14a1eeaf4a67', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CfQFXxYr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'volume_id': '6bea2b74-7b28-4314-9a5a-14a1eeaf4a67'}, None), 'kwargs': False}}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:11:01 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-28418a3a-1688-49da-91f5-a092de0a5f3c tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:11:01 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-28418a3a-1688-49da-91f5-a092de0a5f3c tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:11:01 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-28418a3a-1688-49da-91f5-a092de0a5f3c tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:11:01 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:01 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:01 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[45e642ff-6605-40b2-880d-eba8985dad79]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f25f6e6a-9711-4455-82e8-c56648a08508\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6bea2b74-7b28-4314-9a5a-14a1eeaf4a67\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ff01f329-6dda-43b6-8da5-6a5c48fad211\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:083f264a-3f29-48b4-9935-a73f4234e6d5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:45f3fb95-eff9-4a9a-a50b-cdbfee3840d8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:11:01 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-28418a3a-1688-49da-91f5-a092de0a5f3c tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 00:11:01 user nova-compute[75165]: No targets found.
Oct 26 00:11:01 user nova-compute[75165]: iSNS:
Oct 26 00:11:01 user nova-compute[75165]: No targets found.
Oct 26 00:11:01 user nova-compute[75165]: STATIC:
Oct 26 00:11:01 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:f25f6e6a-9711-4455-82e8-c56648a08508
Oct 26 00:11:01 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:11:01 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:11:01 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:6bea2b74-7b28-4314-9a5a-14a1eeaf4a67
Oct 26 00:11:01 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:11:01 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:11:01 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:ff01f329-6dda-43b6-8da5-6a5c48fad211
Oct 26 00:11:01 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:11:01 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:11:01 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:083f264a-3f29-48b4-9935-a73f4234e6d5
Oct 26 00:11:01 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:11:01 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:11:01 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:45f3fb95-eff9-4a9a-a50b-cdbfee3840d8
Oct 26 00:11:01 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:11:01 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:11:01 user nova-compute[75165]: FIRMWARE:
Oct 26 00:11:01 user nova-compute[75165]: No targets found.
Oct 26 00:11:01 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:11:01 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-28418a3a-1688-49da-91f5-a092de0a5f3c tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 00:11:01 user nova-compute[75165]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 00:11:01 user nova-compute[75165]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75165) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 00:11:01 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-28418a3a-1688-49da-91f5-a092de0a5f3c tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6bea2b74-7b28-4314-9a5a-14a1eeaf4a67', 0)] {{(pid=75165) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 00:11:01 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:01 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:01 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7692d84-bdcc-4ddc-9057-352e24b2ef4d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:083f264a-3f29-48b4-9935-a73f4234e6d5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45f3fb95-eff9-4a9a-a50b-cdbfee3840d8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6bea2b74-7b28-4314-9a5a-14a1eeaf4a67\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f25f6e6a-9711-4455-82e8-c56648a08508\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ff01f329-6dda-43b6-8da5-6a5c48fad211\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:11:01 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:01 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-4679c8d2-97fb-409b-a092-b4f0eaeca0f4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json" returned: 0 in 0.179s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:01 user nova-compute[75165]: DEBUG nova.virt.disk.api [None req-4679c8d2-97fb-409b-a092-b4f0eaeca0f4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Checking if we can resize image /opt/stack/data/nova/instances/22b9689c-5e83-4807-971f-5b244914b7e5/disk. size=1073741824 {{(pid=75165) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 00:11:01 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-4679c8d2-97fb-409b-a092-b4f0eaeca0f4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b9689c-5e83-4807-971f-5b244914b7e5/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:01 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:01 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[d91b7f6e-2381-46ab-acfb-74d1fe208572]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45f3fb95-eff9-4a9a-a50b-cdbfee3840d8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f25f6e6a-9711-4455-82e8-c56648a08508 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:083f264a-3f29-48b4-9935-a73f4234e6d5 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff01f329-6dda-43b6-8da5-6a5c48fad211 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bea2b74-7b28-4314-9a5a-14a1eeaf4a67 (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:11:01 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-28418a3a-1688-49da-91f5-a092de0a5f3c tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45f3fb95-eff9-4a9a-a50b-cdbfee3840d8 (non-flash)
Oct 26 00:11:01 user nova-compute[75165]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f25f6e6a-9711-4455-82e8-c56648a08508 (non-flash)
Oct 26 00:11:01 user nova-compute[75165]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:083f264a-3f29-48b4-9935-a73f4234e6d5 (non-flash)
Oct 26 00:11:01 user nova-compute[75165]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff01f329-6dda-43b6-8da5-6a5c48fad211 (non-flash)
Oct 26 00:11:01 user nova-compute[75165]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bea2b74-7b28-4314-9a5a-14a1eeaf4a67 (non-flash)
Oct 26 00:11:01 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:11:01 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-28418a3a-1688-49da-91f5-a092de0a5f3c tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45f3fb95-eff9-4a9a-a50b-cdbfee3840d8 (non-flash)
Oct 26 00:11:01 user nova-compute[75165]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f25f6e6a-9711-4455-82e8-c56648a08508 (non-flash)
Oct 26 00:11:01 user nova-compute[75165]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:083f264a-3f29-48b4-9935-a73f4234e6d5 (non-flash)
Oct 26 00:11:01 user nova-compute[75165]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff01f329-6dda-43b6-8da5-6a5c48fad211 (non-flash)
Oct 26 00:11:01 user nova-compute[75165]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bea2b74-7b28-4314-9a5a-14a1eeaf4a67 (non-flash)
Oct 26 00:11:01 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:11:01 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-28418a3a-1688-49da-91f5-a092de0a5f3c tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8bf82a1240>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6bea2b74-7b28-4314-9a5a-14a1eeaf4a67'): ({'sdb'}, set())}) {{(pid=75165) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 00:11:01 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-28418a3a-1688-49da-91f5-a092de0a5f3c tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] Removing single pathed devices sdb {{(pid=75165) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 00:11:01 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:01 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:01 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[99aa2ddb-8ef5-4190-ae75-8ab834676293]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:11:01 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:01 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:01 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[d70b43ba-7a89-4205-872a-942e20a85f7b]: (4, ('ok\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:11:01 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-28418a3a-1688-49da-91f5-a092de0a5f3c tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] Flushing IO for device /dev/sdb {{(pid=75165) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 00:11:01 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:01 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:01 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd7d4a8e-3b6a-48c2-8ec2-6e7b4cb32e2c]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:11:01 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-28418a3a-1688-49da-91f5-a092de0a5f3c tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75165) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 00:11:01 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:01 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-4679c8d2-97fb-409b-a092-b4f0eaeca0f4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b9689c-5e83-4807-971f-5b244914b7e5/disk --force-share --output=json" returned: 0 in 0.331s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:01 user nova-compute[75165]: DEBUG nova.virt.disk.api [None req-4679c8d2-97fb-409b-a092-b4f0eaeca0f4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Cannot resize image /opt/stack/data/nova/instances/22b9689c-5e83-4807-971f-5b244914b7e5/disk to a smaller size. {{(pid=75165) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 00:11:01 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-4679c8d2-97fb-409b-a092-b4f0eaeca0f4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: 22b9689c-5e83-4807-971f-5b244914b7e5] Created local disks {{(pid=75165) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 00:11:01 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-4679c8d2-97fb-409b-a092-b4f0eaeca0f4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: 22b9689c-5e83-4807-971f-5b244914b7e5] Ensure instance console log exists: /opt/stack/data/nova/instances/22b9689c-5e83-4807-971f-5b244914b7e5/console.log {{(pid=75165) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 00:11:01 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-4679c8d2-97fb-409b-a092-b4f0eaeca0f4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:11:01 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-4679c8d2-97fb-409b-a092-b4f0eaeca0f4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:11:01 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-4679c8d2-97fb-409b-a092-b4f0eaeca0f4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:11:01 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.061s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:01 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[9736c215-af24-4024-b2a0-838742141556]: (4, ('1', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:11:01 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-28418a3a-1688-49da-91f5-a092de0a5f3c tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] Checking to see if SCSI volumes sdb have been removed. {{(pid=75165) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 00:11:01 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-28418a3a-1688-49da-91f5-a092de0a5f3c tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] SCSI volumes sdb have been removed. {{(pid=75165) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 00:11:01 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-28418a3a-1688-49da-91f5-a092de0a5f3c tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6bea2b74-7b28-4314-9a5a-14a1eeaf4a67')] {{(pid=75165) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 00:11:01 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bea2b74-7b28-4314-9a5a-14a1eeaf4a67 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:01 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bea2b74-7b28-4314-9a5a-14a1eeaf4a67 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:01 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[7191e24e-3dab-4085-a466-10efb4a5a4ad]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:11:01 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-28418a3a-1688-49da-91f5-a092de0a5f3c tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:11:01 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bea2b74-7b28-4314-9a5a-14a1eeaf4a67 -p 172.16.0.220:3260 --logout {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:01 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:01 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bea2b74-7b28-4314-9a5a-14a1eeaf4a67 -p 172.16.0.220:3260 --logout" returned: 0 in 0.083s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:01 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5f9d26a-a157-4723-bda5-6e4f3e670320]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:6bea2b74-7b28-4314-9a5a-14a1eeaf4a67, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:6bea2b74-7b28-4314-9a5a-14a1eeaf4a67, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:11:01 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-28418a3a-1688-49da-91f5-a092de0a5f3c tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:6bea2b74-7b28-4314-9a5a-14a1eeaf4a67, portal: 172.16.0.220,3260]
Oct 26 00:11:01 user nova-compute[75165]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:6bea2b74-7b28-4314-9a5a-14a1eeaf4a67, portal: 172.16.0.220,3260] successful.
Oct 26 00:11:01 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:11:01 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bea2b74-7b28-4314-9a5a-14a1eeaf4a67 -p 172.16.0.220:3260 --op delete {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:01 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bea2b74-7b28-4314-9a5a-14a1eeaf4a67 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:01 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8a4d4bd-9050-43b5-a683-bcdae9fe2db5]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:11:01 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-28418a3a-1688-49da-91f5-a092de0a5f3c tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:11:01 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-28418a3a-1688-49da-91f5-a092de0a5f3c tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.621s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:11:01 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-28418a3a-1688-49da-91f5-a092de0a5f3c tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] <== disconnect_volume: return (624ms) None {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:11:01 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28418a3a-1688-49da-91f5-a092de0a5f3c tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] [instance: 45625147-ff69-496a-a41e-e55f818a020a] Disconnected iSCSI Volume {{(pid=75165) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 00:11:02 user nova-compute[75165]: DEBUG nova.compute.manager [None req-28418a3a-1688-49da-91f5-a092de0a5f3c tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:45f3fb95-eff9-4a9a-a50b-cdbfee3840d8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ARaLnBGq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '45625147-ff69-496a-a41e-e55f818a020a', 'attached_at': '', 'detached_at': '', 'volume_id': '45f3fb95-eff9-4a9a-a50b-cdbfee3840d8', 'serial'} {{(pid=75165) _swap_volume /opt/stack/nova/nova/compute/manager.py:7790}}
Oct 26 00:11:02 user nova-compute[75165]: DEBUG nova.compute.manager [None req-28418a3a-1688-49da-91f5-a092de0a5f3c tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] [instance: 45625147-ff69-496a-a41e-e55f818a020a] swap_volume: removing Cinder connection for volume 6bea2b74-7b28-4314-9a5a-14a1eeaf4a67 {{(pid=75165) _swap_volume /opt/stack/nova/nova/compute/manager.py:7835}}
Oct 26 00:11:02 user nova-compute[75165]: DEBUG nova.network.neutron [None req-4679c8d2-97fb-409b-a092-b4f0eaeca0f4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: 22b9689c-5e83-4807-971f-5b244914b7e5] Successfully updated port: 15022d7e-be4a-480d-a612-31e1e689f43b {{(pid=75165) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 00:11:02 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-4679c8d2-97fb-409b-a092-b4f0eaeca0f4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Acquiring lock "refresh_cache-22b9689c-5e83-4807-971f-5b244914b7e5" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:11:02 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-4679c8d2-97fb-409b-a092-b4f0eaeca0f4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Acquired lock "refresh_cache-22b9689c-5e83-4807-971f-5b244914b7e5" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:11:02 user nova-compute[75165]: DEBUG nova.network.neutron [None req-4679c8d2-97fb-409b-a092-b4f0eaeca0f4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: 22b9689c-5e83-4807-971f-5b244914b7e5] Building network info cache for instance {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 00:11:02 user nova-compute[75165]: DEBUG nova.compute.manager [req-38471698-34a4-431b-8a4f-58ff19551f68 req-33b60ab8-7eff-4e93-85ef-b4791036d519 service nova] [instance: 22b9689c-5e83-4807-971f-5b244914b7e5] Received event network-changed-15022d7e-be4a-480d-a612-31e1e689f43b {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:11:02 user nova-compute[75165]: DEBUG nova.compute.manager [req-38471698-34a4-431b-8a4f-58ff19551f68 req-33b60ab8-7eff-4e93-85ef-b4791036d519 service nova] [instance: 22b9689c-5e83-4807-971f-5b244914b7e5] Refreshing instance network info cache due to event network-changed-15022d7e-be4a-480d-a612-31e1e689f43b. {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 00:11:02 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-38471698-34a4-431b-8a4f-58ff19551f68 req-33b60ab8-7eff-4e93-85ef-b4791036d519 service nova] Acquiring lock "refresh_cache-22b9689c-5e83-4807-971f-5b244914b7e5" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:11:02 user nova-compute[75165]: DEBUG nova.network.neutron [None req-4679c8d2-97fb-409b-a092-b4f0eaeca0f4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: 22b9689c-5e83-4807-971f-5b244914b7e5] Instance cache missing network info. {{(pid=75165) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 00:11:02 user nova-compute[75165]: DEBUG nova.network.neutron [-] [instance: f326db85-74f6-4e60-9c55-46b2a59502d0] Updating instance_info_cache with network_info: [] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:11:02 user nova-compute[75165]: DEBUG nova.network.neutron [None req-4679c8d2-97fb-409b-a092-b4f0eaeca0f4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: 22b9689c-5e83-4807-971f-5b244914b7e5] Updating instance_info_cache with network_info: [{"id": "15022d7e-be4a-480d-a612-31e1e689f43b", "address": "fa:16:3e:23:d1:cb", "network": {"id": "bd1c84f9-bba9-4a23-8bf2-17e65022136a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1557945804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2911497df44047d9a9ee36a5652298bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15022d7e-be", "ovs_interfaceid": "15022d7e-be4a-480d-a612-31e1e689f43b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:11:02 user nova-compute[75165]: INFO nova.compute.manager [-] [instance: f326db85-74f6-4e60-9c55-46b2a59502d0] Took 1.30 seconds to deallocate network for instance.
Oct 26 00:11:02 user nova-compute[75165]: DEBUG nova.compute.manager [req-8ec322a3-2d75-4e98-881b-dd8cece6a8ba req-80a8f30c-5a2d-49f6-8d42-e4078771a99f service nova] [instance: f326db85-74f6-4e60-9c55-46b2a59502d0] Received event network-vif-deleted-26b16dce-35d4-4756-8eea-c3638f5b6c16 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:11:02 user nova-compute[75165]: INFO nova.compute.manager [req-8ec322a3-2d75-4e98-881b-dd8cece6a8ba req-80a8f30c-5a2d-49f6-8d42-e4078771a99f service nova] [instance: f326db85-74f6-4e60-9c55-46b2a59502d0] Neutron deleted interface 26b16dce-35d4-4756-8eea-c3638f5b6c16; detaching it from the instance and deleting it from the info cache
Oct 26 00:11:02 user nova-compute[75165]: DEBUG nova.network.neutron [req-8ec322a3-2d75-4e98-881b-dd8cece6a8ba req-80a8f30c-5a2d-49f6-8d42-e4078771a99f service nova] [instance: f326db85-74f6-4e60-9c55-46b2a59502d0] Updating instance_info_cache with network_info: [] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:11:02 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-4679c8d2-97fb-409b-a092-b4f0eaeca0f4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Releasing lock "refresh_cache-22b9689c-5e83-4807-971f-5b244914b7e5" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:11:02 user nova-compute[75165]: DEBUG nova.compute.manager [None req-4679c8d2-97fb-409b-a092-b4f0eaeca0f4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: 22b9689c-5e83-4807-971f-5b244914b7e5] Instance network_info: |[{"id": "15022d7e-be4a-480d-a612-31e1e689f43b", "address": "fa:16:3e:23:d1:cb", "network": {"id": "bd1c84f9-bba9-4a23-8bf2-17e65022136a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1557945804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2911497df44047d9a9ee36a5652298bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15022d7e-be", "ovs_interfaceid": "15022d7e-be4a-480d-a612-31e1e689f43b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75165) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 00:11:02 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-38471698-34a4-431b-8a4f-58ff19551f68 req-33b60ab8-7eff-4e93-85ef-b4791036d519 service nova] Acquired lock "refresh_cache-22b9689c-5e83-4807-971f-5b244914b7e5" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:11:02 user nova-compute[75165]: DEBUG nova.network.neutron [req-38471698-34a4-431b-8a4f-58ff19551f68 req-33b60ab8-7eff-4e93-85ef-b4791036d519 service nova] [instance: 22b9689c-5e83-4807-971f-5b244914b7e5] Refreshing network info cache for port 15022d7e-be4a-480d-a612-31e1e689f43b {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 00:11:02 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-4679c8d2-97fb-409b-a092-b4f0eaeca0f4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: 22b9689c-5e83-4807-971f-5b244914b7e5] Start _get_guest_xml network_info=[{"id": "15022d7e-be4a-480d-a612-31e1e689f43b", "address": "fa:16:3e:23:d1:cb", "network": {"id": "bd1c84f9-bba9-4a23-8bf2-17e65022136a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1557945804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2911497df44047d9a9ee36a5652298bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15022d7e-be", "ovs_interfaceid": "15022d7e-be4a-480d-a612-31e1e689f43b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T00:03:24Z,direct_url=<?>,disk_format='qcow2',id=bff0d8a1-739e-4c4d-9efa-b73ba7b76d01,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e56bbf444fd34c348475c73673611447',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T00:03:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'size': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': 'bff0d8a1-739e-4c4d-9efa-b73ba7b76d01'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75165) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 00:11:02 user nova-compute[75165]: DEBUG nova.compute.manager [req-8ec322a3-2d75-4e98-881b-dd8cece6a8ba req-80a8f30c-5a2d-49f6-8d42-e4078771a99f service nova] [instance: f326db85-74f6-4e60-9c55-46b2a59502d0] Detach interface failed, port_id=26b16dce-35d4-4756-8eea-c3638f5b6c16, reason: Instance f326db85-74f6-4e60-9c55-46b2a59502d0 could not be found. {{(pid=75165) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 26 00:11:02 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-4679c8d2-97fb-409b-a092-b4f0eaeca0f4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:11:02 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-4679c8d2-97fb-409b-a092-b4f0eaeca0f4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:11:02 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-0d680ba8-140d-41f2-aa61-b9323ffcddcc tempest-VolumesAssistedSnapshotsTest-1656989943 tempest-VolumesAssistedSnapshotsTest-1656989943-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:11:02 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-0d680ba8-140d-41f2-aa61-b9323ffcddcc tempest-VolumesAssistedSnapshotsTest-1656989943 tempest-VolumesAssistedSnapshotsTest-1656989943-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:11:02 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-4679c8d2-97fb-409b-a092-b4f0eaeca0f4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75165) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 00:11:02 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-4679c8d2-97fb-409b-a092-b4f0eaeca0f4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] CPU controller missing on host. {{(pid=75165) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 00:11:02 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-4679c8d2-97fb-409b-a092-b4f0eaeca0f4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75165) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 00:11:02 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-4679c8d2-97fb-409b-a092-b4f0eaeca0f4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] CPU controller found on host. {{(pid=75165) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 00:11:02 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-4679c8d2-97fb-409b-a092-b4f0eaeca0f4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75165) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 00:11:02 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-4679c8d2-97fb-409b-a092-b4f0eaeca0f4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T00:03:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T00:03:24Z,direct_url=<?>,disk_format='qcow2',id=bff0d8a1-739e-4c4d-9efa-b73ba7b76d01,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e56bbf444fd34c348475c73673611447',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T00:03:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 00:11:02 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-4679c8d2-97fb-409b-a092-b4f0eaeca0f4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Flavor limits 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 00:11:02 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-4679c8d2-97fb-409b-a092-b4f0eaeca0f4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Image limits 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 00:11:02 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-4679c8d2-97fb-409b-a092-b4f0eaeca0f4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Flavor pref 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 00:11:02 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-4679c8d2-97fb-409b-a092-b4f0eaeca0f4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Image pref 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 00:11:02 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-4679c8d2-97fb-409b-a092-b4f0eaeca0f4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 00:11:02 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-4679c8d2-97fb-409b-a092-b4f0eaeca0f4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 00:11:02 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-4679c8d2-97fb-409b-a092-b4f0eaeca0f4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75165) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 00:11:02 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-4679c8d2-97fb-409b-a092-b4f0eaeca0f4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Got 1 possible topologies {{(pid=75165) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 00:11:02 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-4679c8d2-97fb-409b-a092-b4f0eaeca0f4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 00:11:02 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-4679c8d2-97fb-409b-a092-b4f0eaeca0f4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 00:11:02 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-4679c8d2-97fb-409b-a092-b4f0eaeca0f4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:10:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1910763507',display_name='tempest-tempest.common.compute-instance-1910763507',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1910763507',id=15,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCbhvVGCZXABV5ClHwat9SYVr8+lkr4CuPT9Dr+1j4V+RKNDUlpTwy+TnUJZqw7wFY9APF0iWveIh7WwEW0pFasiIl6gv4XcNnJZaIxKvWAEAIXLwvXZamBlkbyJ/XzEvA==',key_name='tempest-keypair-730793300',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2911497df44047d9a9ee36a5652298bc',ramdisk_id='',reservation_id='r-h69c2nn0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1690932306',owner_user_name='tempest-ServerActionsTestOtherA-1690932306-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T00:11:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b3ce94f4c01446ebf79a1eba3833e01',uuid=22b9689c-5e83-4807-971f-5b244914b7e5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "15022d7e-be4a-480d-a612-31e1e689f43b", "address": "fa:16:3e:23:d1:cb", "network": {"id": "bd1c84f9-bba9-4a23-8bf2-17e65022136a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1557945804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2911497df44047d9a9ee36a5652298bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15022d7e-be", "ovs_interfaceid": "15022d7e-be4a-480d-a612-31e1e689f43b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75165) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 00:11:02 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-4679c8d2-97fb-409b-a092-b4f0eaeca0f4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Converting VIF {"id": "15022d7e-be4a-480d-a612-31e1e689f43b", "address": "fa:16:3e:23:d1:cb", "network": {"id": "bd1c84f9-bba9-4a23-8bf2-17e65022136a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1557945804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2911497df44047d9a9ee36a5652298bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15022d7e-be", "ovs_interfaceid": "15022d7e-be4a-480d-a612-31e1e689f43b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:11:02 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-4679c8d2-97fb-409b-a092-b4f0eaeca0f4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:d1:cb,bridge_name='br-int',has_traffic_filtering=True,id=15022d7e-be4a-480d-a612-31e1e689f43b,network=Network(bd1c84f9-bba9-4a23-8bf2-17e65022136a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15022d7e-be') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:11:02 user nova-compute[75165]: DEBUG nova.objects.instance [None req-4679c8d2-97fb-409b-a092-b4f0eaeca0f4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Lazy-loading 'pci_devices' on Instance uuid 22b9689c-5e83-4807-971f-5b244914b7e5 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:11:02 user nova-compute[75165]: DEBUG nova.compute.manager [req-494d712b-7335-47e0-85e6-c3d211e36a90 req-be4a3a73-0dc6-416a-aa3e-d7e9816efc71 service nova] [instance: f326db85-74f6-4e60-9c55-46b2a59502d0] Received event network-vif-plugged-26b16dce-35d4-4756-8eea-c3638f5b6c16 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:11:02 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-494d712b-7335-47e0-85e6-c3d211e36a90 req-be4a3a73-0dc6-416a-aa3e-d7e9816efc71 service nova] Acquiring lock "f326db85-74f6-4e60-9c55-46b2a59502d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:11:02 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-494d712b-7335-47e0-85e6-c3d211e36a90 req-be4a3a73-0dc6-416a-aa3e-d7e9816efc71 service nova] Lock "f326db85-74f6-4e60-9c55-46b2a59502d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:11:02 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-494d712b-7335-47e0-85e6-c3d211e36a90 req-be4a3a73-0dc6-416a-aa3e-d7e9816efc71 service nova] Lock "f326db85-74f6-4e60-9c55-46b2a59502d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:11:02 user nova-compute[75165]: DEBUG nova.compute.manager [req-494d712b-7335-47e0-85e6-c3d211e36a90 req-be4a3a73-0dc6-416a-aa3e-d7e9816efc71 service nova] [instance: f326db85-74f6-4e60-9c55-46b2a59502d0] No waiting events found dispatching network-vif-plugged-26b16dce-35d4-4756-8eea-c3638f5b6c16 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:11:02 user nova-compute[75165]: WARNING nova.compute.manager [req-494d712b-7335-47e0-85e6-c3d211e36a90 req-be4a3a73-0dc6-416a-aa3e-d7e9816efc71 service nova] [instance: f326db85-74f6-4e60-9c55-46b2a59502d0] Received unexpected event network-vif-plugged-26b16dce-35d4-4756-8eea-c3638f5b6c16 for instance with vm_state deleted and task_state None.
Oct 26 00:11:02 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-4679c8d2-97fb-409b-a092-b4f0eaeca0f4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: 22b9689c-5e83-4807-971f-5b244914b7e5] End _get_guest_xml xml=<domain type="kvm">
Oct 26 00:11:02 user nova-compute[75165]:   <uuid>22b9689c-5e83-4807-971f-5b244914b7e5</uuid>
Oct 26 00:11:02 user nova-compute[75165]:   <name>instance-0000000f</name>
Oct 26 00:11:02 user nova-compute[75165]:   <memory>524288</memory>
Oct 26 00:11:02 user nova-compute[75165]:   <vcpu>1</vcpu>
Oct 26 00:11:02 user nova-compute[75165]:   <metadata>
Oct 26 00:11:02 user nova-compute[75165]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 00:11:02 user nova-compute[75165]:       <nova:package version="0.0.0"/>
Oct 26 00:11:02 user nova-compute[75165]:       <nova:name>tempest-tempest.common.compute-instance-1910763507</nova:name>
Oct 26 00:11:02 user nova-compute[75165]:       <nova:creationTime>2023-10-26 00:11:02</nova:creationTime>
Oct 26 00:11:02 user nova-compute[75165]:       <nova:flavor name="m1.tiny">
Oct 26 00:11:02 user nova-compute[75165]:         <nova:memory>512</nova:memory>
Oct 26 00:11:02 user nova-compute[75165]:         <nova:disk>1</nova:disk>
Oct 26 00:11:02 user nova-compute[75165]:         <nova:swap>0</nova:swap>
Oct 26 00:11:02 user nova-compute[75165]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 00:11:02 user nova-compute[75165]:         <nova:vcpus>1</nova:vcpus>
Oct 26 00:11:02 user nova-compute[75165]:       </nova:flavor>
Oct 26 00:11:02 user nova-compute[75165]:       <nova:owner>
Oct 26 00:11:02 user nova-compute[75165]:         <nova:user uuid="5b3ce94f4c01446ebf79a1eba3833e01">tempest-ServerActionsTestOtherA-1690932306-project-member</nova:user>
Oct 26 00:11:02 user nova-compute[75165]:         <nova:project uuid="2911497df44047d9a9ee36a5652298bc">tempest-ServerActionsTestOtherA-1690932306</nova:project>
Oct 26 00:11:02 user nova-compute[75165]:       </nova:owner>
Oct 26 00:11:02 user nova-compute[75165]:       <nova:root type="image" uuid="bff0d8a1-739e-4c4d-9efa-b73ba7b76d01"/>
Oct 26 00:11:02 user nova-compute[75165]:       <nova:ports>
Oct 26 00:11:02 user nova-compute[75165]:         <nova:port uuid="15022d7e-be4a-480d-a612-31e1e689f43b">
Oct 26 00:11:02 user nova-compute[75165]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 26 00:11:02 user nova-compute[75165]:         </nova:port>
Oct 26 00:11:02 user nova-compute[75165]:       </nova:ports>
Oct 26 00:11:02 user nova-compute[75165]:     </nova:instance>
Oct 26 00:11:02 user nova-compute[75165]:   </metadata>
Oct 26 00:11:02 user nova-compute[75165]:   <sysinfo type="smbios">
Oct 26 00:11:02 user nova-compute[75165]:     <system>
Oct 26 00:11:02 user nova-compute[75165]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 00:11:02 user nova-compute[75165]:       <entry name="product">OpenStack Nova</entry>
Oct 26 00:11:02 user nova-compute[75165]:       <entry name="version">0.0.0</entry>
Oct 26 00:11:02 user nova-compute[75165]:       <entry name="serial">22b9689c-5e83-4807-971f-5b244914b7e5</entry>
Oct 26 00:11:02 user nova-compute[75165]:       <entry name="uuid">22b9689c-5e83-4807-971f-5b244914b7e5</entry>
Oct 26 00:11:02 user nova-compute[75165]:       <entry name="family">Virtual Machine</entry>
Oct 26 00:11:02 user nova-compute[75165]:     </system>
Oct 26 00:11:02 user nova-compute[75165]:   </sysinfo>
Oct 26 00:11:02 user nova-compute[75165]:   <os>
Oct 26 00:11:02 user nova-compute[75165]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 00:11:02 user nova-compute[75165]:     <boot dev="hd"/>
Oct 26 00:11:02 user nova-compute[75165]:     <smbios mode="sysinfo"/>
Oct 26 00:11:02 user nova-compute[75165]:   </os>
Oct 26 00:11:02 user nova-compute[75165]:   <features>
Oct 26 00:11:02 user nova-compute[75165]:     <acpi/>
Oct 26 00:11:02 user nova-compute[75165]:     <apic/>
Oct 26 00:11:02 user nova-compute[75165]:     <vmcoreinfo/>
Oct 26 00:11:02 user nova-compute[75165]:   </features>
Oct 26 00:11:02 user nova-compute[75165]:   <clock offset="utc">
Oct 26 00:11:02 user nova-compute[75165]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 00:11:02 user nova-compute[75165]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 00:11:02 user nova-compute[75165]:     <timer name="hpet" present="no"/>
Oct 26 00:11:02 user nova-compute[75165]:   </clock>
Oct 26 00:11:02 user nova-compute[75165]:   <cpu mode="custom" match="exact">
Oct 26 00:11:02 user nova-compute[75165]:     <model>Nehalem</model>
Oct 26 00:11:02 user nova-compute[75165]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 00:11:02 user nova-compute[75165]:   </cpu>
Oct 26 00:11:02 user nova-compute[75165]:   <devices>
Oct 26 00:11:02 user nova-compute[75165]:     <disk type="file" device="disk">
Oct 26 00:11:02 user nova-compute[75165]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 00:11:02 user nova-compute[75165]:       <source file="/opt/stack/data/nova/instances/22b9689c-5e83-4807-971f-5b244914b7e5/disk"/>
Oct 26 00:11:02 user nova-compute[75165]:       <target dev="vda" bus="virtio"/>
Oct 26 00:11:02 user nova-compute[75165]:     </disk>
Oct 26 00:11:02 user nova-compute[75165]:     <interface type="ethernet">
Oct 26 00:11:02 user nova-compute[75165]:       <mac address="fa:16:3e:23:d1:cb"/>
Oct 26 00:11:02 user nova-compute[75165]:       <model type="virtio"/>
Oct 26 00:11:02 user nova-compute[75165]:       <mtu size="1442"/>
Oct 26 00:11:02 user nova-compute[75165]:       <target dev="tap15022d7e-be"/>
Oct 26 00:11:02 user nova-compute[75165]:     </interface>
Oct 26 00:11:02 user nova-compute[75165]:     <serial type="pty">
Oct 26 00:11:02 user nova-compute[75165]:       <log file="/opt/stack/data/nova/instances/22b9689c-5e83-4807-971f-5b244914b7e5/console.log" append="off"/>
Oct 26 00:11:02 user nova-compute[75165]:     </serial>
Oct 26 00:11:02 user nova-compute[75165]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 00:11:02 user nova-compute[75165]:     <video>
Oct 26 00:11:02 user nova-compute[75165]:       <model type="virtio"/>
Oct 26 00:11:02 user nova-compute[75165]:     </video>
Oct 26 00:11:02 user nova-compute[75165]:     <rng model="virtio">
Oct 26 00:11:02 user nova-compute[75165]:       <backend model="random">/dev/urandom</backend>
Oct 26 00:11:02 user nova-compute[75165]:     </rng>
Oct 26 00:11:02 user nova-compute[75165]:     <controller type="usb" index="0" model="none"/>
Oct 26 00:11:02 user nova-compute[75165]:     <memballoon model="virtio">
Oct 26 00:11:02 user nova-compute[75165]:       <stats period="10"/>
Oct 26 00:11:02 user nova-compute[75165]:     </memballoon>
Oct 26 00:11:02 user nova-compute[75165]:   </devices>
Oct 26 00:11:02 user nova-compute[75165]: </domain>
Oct 26 00:11:02 user nova-compute[75165]:  {{(pid=75165) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 00:11:02 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-4679c8d2-97fb-409b-a092-b4f0eaeca0f4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:10:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1910763507',display_name='tempest-tempest.common.compute-instance-1910763507',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1910763507',id=15,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCbhvVGCZXABV5ClHwat9SYVr8+lkr4CuPT9Dr+1j4V+RKNDUlpTwy+TnUJZqw7wFY9APF0iWveIh7WwEW0pFasiIl6gv4XcNnJZaIxKvWAEAIXLwvXZamBlkbyJ/XzEvA==',key_name='tempest-keypair-730793300',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2911497df44047d9a9ee36a5652298bc',ramdisk_id='',reservation_id='r-h69c2nn0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1690932306',owner_user_name='tempest-ServerActionsTestOtherA-1690932306-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T00:11:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b3ce94f4c01446ebf79a1eba3833e01',uuid=22b9689c-5e83-4807-971f-5b244914b7e5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "15022d7e-be4a-480d-a612-31e1e689f43b", "address": "fa:16:3e:23:d1:cb", "network": {"id": "bd1c84f9-bba9-4a23-8bf2-17e65022136a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1557945804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2911497df44047d9a9ee36a5652298bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15022d7e-be", "ovs_interfaceid": "15022d7e-be4a-480d-a612-31e1e689f43b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 00:11:02 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-4679c8d2-97fb-409b-a092-b4f0eaeca0f4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Converting VIF {"id": "15022d7e-be4a-480d-a612-31e1e689f43b", "address": "fa:16:3e:23:d1:cb", "network": {"id": "bd1c84f9-bba9-4a23-8bf2-17e65022136a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1557945804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2911497df44047d9a9ee36a5652298bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15022d7e-be", "ovs_interfaceid": "15022d7e-be4a-480d-a612-31e1e689f43b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:11:02 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-4679c8d2-97fb-409b-a092-b4f0eaeca0f4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:d1:cb,bridge_name='br-int',has_traffic_filtering=True,id=15022d7e-be4a-480d-a612-31e1e689f43b,network=Network(bd1c84f9-bba9-4a23-8bf2-17e65022136a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15022d7e-be') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:11:02 user nova-compute[75165]: DEBUG os_vif [None req-4679c8d2-97fb-409b-a092-b4f0eaeca0f4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:d1:cb,bridge_name='br-int',has_traffic_filtering=True,id=15022d7e-be4a-480d-a612-31e1e689f43b,network=Network(bd1c84f9-bba9-4a23-8bf2-17e65022136a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15022d7e-be') {{(pid=75165) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 00:11:02 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:02 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:11:02 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 00:11:02 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-cdda5d3d-857d-442b-aef5-43818a052638 tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] Acquiring lock "018ca455-eace-412d-86a3-d914b4af30d5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:11:02 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-cdda5d3d-857d-442b-aef5-43818a052638 tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] Lock "018ca455-eace-412d-86a3-d914b4af30d5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:11:02 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-cdda5d3d-857d-442b-aef5-43818a052638 tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] Acquiring lock "018ca455-eace-412d-86a3-d914b4af30d5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:11:02 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-cdda5d3d-857d-442b-aef5-43818a052638 tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] Lock "018ca455-eace-412d-86a3-d914b4af30d5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:11:02 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-cdda5d3d-857d-442b-aef5-43818a052638 tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] Lock "018ca455-eace-412d-86a3-d914b4af30d5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:11:02 user nova-compute[75165]: INFO nova.compute.manager [None req-cdda5d3d-857d-442b-aef5-43818a052638 tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] [instance: 018ca455-eace-412d-86a3-d914b4af30d5] Terminating instance
Oct 26 00:11:02 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:02 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '10bd5dc4-1fb1-5faf-8aad-5879f75e1e56', '_type': 'linux-noop'}}, row=False) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:11:02 user nova-compute[75165]: DEBUG nova.compute.manager [None req-cdda5d3d-857d-442b-aef5-43818a052638 tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] [instance: 018ca455-eace-412d-86a3-d914b4af30d5] Start destroying the instance on the hypervisor. {{(pid=75165) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 00:11:02 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:02 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:11:02 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:02 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap15022d7e-be, may_exist=True, interface_attrs={}) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:11:02 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap15022d7e-be, col_values=(('qos', UUID('37674b94-fe36-4fc6-944a-94a29723428c')),), if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:11:02 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap15022d7e-be, col_values=(('external_ids', {'iface-id': '15022d7e-be4a-480d-a612-31e1e689f43b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:23:d1:cb', 'vm-uuid': '22b9689c-5e83-4807-971f-5b244914b7e5'}),), if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:11:02 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:02 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:11:02 user nova-compute[75165]: INFO os_vif [None req-4679c8d2-97fb-409b-a092-b4f0eaeca0f4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:d1:cb,bridge_name='br-int',has_traffic_filtering=True,id=15022d7e-be4a-480d-a612-31e1e689f43b,network=Network(bd1c84f9-bba9-4a23-8bf2-17e65022136a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15022d7e-be')
Oct 26 00:11:02 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-4679c8d2-97fb-409b-a092-b4f0eaeca0f4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] No BDM found with device name vda, not building metadata. {{(pid=75165) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 00:11:02 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-4679c8d2-97fb-409b-a092-b4f0eaeca0f4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] No VIF found with MAC fa:16:3e:23:d1:cb, not building metadata {{(pid=75165) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 00:11:02 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:02 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:03 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:03 user nova-compute[75165]: DEBUG nova.compute.manager [None req-28418a3a-1688-49da-91f5-a092de0a5f3c tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] [instance: 45625147-ff69-496a-a41e-e55f818a020a] swap_volume: Updating volume 6bea2b74-7b28-4314-9a5a-14a1eeaf4a67 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:45f3fb95-eff9-4a9a-a50b-cdbfee3840d8", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "ARaLnBGq", "auth_password": "fSu0RwyciDUhxq", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sde", "volume_id": "45f3fb95-eff9-4a9a-a50b-cdbfee3840d8"}, "status": "reserved", "instance": "45625147-ff69-496a-a41e-e55f818a020a", "attached_at": "", "detached_at": "", "volume_id": "45f3fb95-eff9-4a9a-a50b-cdbfee3840d8", "serial": "45f3fb95-eff9-4a9a-a50b-cdbfee3840d8"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '45f3fb95-eff9-4a9a-a50b-cdbfee3840d8', 'no_device': None, 'attachment_id': '892e4f88-f71f-41d0-bc68-b85f3aecb787'} {{(pid=75165) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7983}}
Oct 26 00:11:03 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:03 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-28418a3a-1688-49da-91f5-a092de0a5f3c tempest-TestVolumeSwap-78651013 tempest-TestVolumeSwap-78651013-project-admin] Lock "45625147-ff69-496a-a41e-e55f818a020a" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 27.738s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:11:03 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-0d680ba8-140d-41f2-aa61-b9323ffcddcc tempest-VolumesAssistedSnapshotsTest-1656989943 tempest-VolumesAssistedSnapshotsTest-1656989943-project-member] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:11:03 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-0d680ba8-140d-41f2-aa61-b9323ffcddcc tempest-VolumesAssistedSnapshotsTest-1656989943 tempest-VolumesAssistedSnapshotsTest-1656989943-project-member] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:11:03 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-0d680ba8-140d-41f2-aa61-b9323ffcddcc tempest-VolumesAssistedSnapshotsTest-1656989943 tempest-VolumesAssistedSnapshotsTest-1656989943-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.591s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:11:03 user nova-compute[75165]: INFO nova.scheduler.client.report [None req-0d680ba8-140d-41f2-aa61-b9323ffcddcc tempest-VolumesAssistedSnapshotsTest-1656989943 tempest-VolumesAssistedSnapshotsTest-1656989943-project-member] Deleted allocations for instance f326db85-74f6-4e60-9c55-46b2a59502d0
Oct 26 00:11:03 user nova-compute[75165]: DEBUG nova.network.neutron [req-38471698-34a4-431b-8a4f-58ff19551f68 req-33b60ab8-7eff-4e93-85ef-b4791036d519 service nova] [instance: 22b9689c-5e83-4807-971f-5b244914b7e5] Updated VIF entry in instance network info cache for port 15022d7e-be4a-480d-a612-31e1e689f43b. {{(pid=75165) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 00:11:03 user nova-compute[75165]: DEBUG nova.network.neutron [req-38471698-34a4-431b-8a4f-58ff19551f68 req-33b60ab8-7eff-4e93-85ef-b4791036d519 service nova] [instance: 22b9689c-5e83-4807-971f-5b244914b7e5] Updating instance_info_cache with network_info: [{"id": "15022d7e-be4a-480d-a612-31e1e689f43b", "address": "fa:16:3e:23:d1:cb", "network": {"id": "bd1c84f9-bba9-4a23-8bf2-17e65022136a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1557945804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2911497df44047d9a9ee36a5652298bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15022d7e-be", "ovs_interfaceid": "15022d7e-be4a-480d-a612-31e1e689f43b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:11:03 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-38471698-34a4-431b-8a4f-58ff19551f68 req-33b60ab8-7eff-4e93-85ef-b4791036d519 service nova] Releasing lock "refresh_cache-22b9689c-5e83-4807-971f-5b244914b7e5" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:11:03 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-0d680ba8-140d-41f2-aa61-b9323ffcddcc tempest-VolumesAssistedSnapshotsTest-1656989943 tempest-VolumesAssistedSnapshotsTest-1656989943-project-member] Lock "f326db85-74f6-4e60-9c55-46b2a59502d0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.226s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:11:03 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: 018ca455-eace-412d-86a3-d914b4af30d5] Instance destroyed successfully.
Oct 26 00:11:03 user nova-compute[75165]: DEBUG nova.objects.instance [None req-cdda5d3d-857d-442b-aef5-43818a052638 tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] Lazy-loading 'resources' on Instance uuid 018ca455-eace-412d-86a3-d914b4af30d5 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:11:03 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-cdda5d3d-857d-442b-aef5-43818a052638 tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:08:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-803005234',display_name='tempest-VolumesActionsTest-instance-803005234',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-803005234',id=14,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-26T00:09:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7c9acab3d48a43568a5096c8d786538d',ramdisk_id='',reservation_id='r-32civ7b8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-229861779',owner_user_name='tempest-VolumesActionsTest-229861779-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T00:09:10Z,user_data=None,user_id='f1b35e426f0f488b9fab44fe85bcff98',uuid=018ca455-eace-412d-86a3-d914b4af30d5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7752e050-4a35-4290-afb7-87d59ee07610", "address": "fa:16:3e:61:5c:ef", "network": {"id": "e571d376-bebd-49ff-b7ee-64a148f25b55", "bridge": "br-int", "label": "tempest-VolumesActionsTest-502796136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c9acab3d48a43568a5096c8d786538d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7752e050-4a", "ovs_interfaceid": "7752e050-4a35-4290-afb7-87d59ee07610", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 00:11:03 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-cdda5d3d-857d-442b-aef5-43818a052638 tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] Converting VIF {"id": "7752e050-4a35-4290-afb7-87d59ee07610", "address": "fa:16:3e:61:5c:ef", "network": {"id": "e571d376-bebd-49ff-b7ee-64a148f25b55", "bridge": "br-int", "label": "tempest-VolumesActionsTest-502796136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c9acab3d48a43568a5096c8d786538d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7752e050-4a", "ovs_interfaceid": "7752e050-4a35-4290-afb7-87d59ee07610", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:11:03 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-cdda5d3d-857d-442b-aef5-43818a052638 tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:5c:ef,bridge_name='br-int',has_traffic_filtering=True,id=7752e050-4a35-4290-afb7-87d59ee07610,network=Network(e571d376-bebd-49ff-b7ee-64a148f25b55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7752e050-4a') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:11:03 user nova-compute[75165]: DEBUG os_vif [None req-cdda5d3d-857d-442b-aef5-43818a052638 tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:5c:ef,bridge_name='br-int',has_traffic_filtering=True,id=7752e050-4a35-4290-afb7-87d59ee07610,network=Network(e571d376-bebd-49ff-b7ee-64a148f25b55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7752e050-4a') {{(pid=75165) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 00:11:03 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:03 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7752e050-4a, bridge=br-int, if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:11:03 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:03 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:11:03 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:03 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:03 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=df188972-5f7e-498b-985c-6bd98d7e3ef4) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:11:03 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:03 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:11:03 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:03 user nova-compute[75165]: INFO os_vif [None req-cdda5d3d-857d-442b-aef5-43818a052638 tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:5c:ef,bridge_name='br-int',has_traffic_filtering=True,id=7752e050-4a35-4290-afb7-87d59ee07610,network=Network(e571d376-bebd-49ff-b7ee-64a148f25b55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7752e050-4a')
Oct 26 00:11:03 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-cdda5d3d-857d-442b-aef5-43818a052638 tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] [instance: 018ca455-eace-412d-86a3-d914b4af30d5] Deleting instance files /opt/stack/data/nova/instances/018ca455-eace-412d-86a3-d914b4af30d5_del
Oct 26 00:11:03 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-cdda5d3d-857d-442b-aef5-43818a052638 tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] [instance: 018ca455-eace-412d-86a3-d914b4af30d5] Deletion of /opt/stack/data/nova/instances/018ca455-eace-412d-86a3-d914b4af30d5_del complete
Oct 26 00:11:04 user nova-compute[75165]: INFO nova.compute.manager [None req-cdda5d3d-857d-442b-aef5-43818a052638 tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] [instance: 018ca455-eace-412d-86a3-d914b4af30d5] Took 1.26 seconds to destroy the instance on the hypervisor.
Oct 26 00:11:04 user nova-compute[75165]: DEBUG oslo.service.loopingcall [None req-cdda5d3d-857d-442b-aef5-43818a052638 tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75165) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 00:11:04 user nova-compute[75165]: DEBUG nova.compute.manager [-] [instance: 018ca455-eace-412d-86a3-d914b4af30d5] Deallocating network for instance {{(pid=75165) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 00:11:04 user nova-compute[75165]: DEBUG nova.network.neutron [-] [instance: 018ca455-eace-412d-86a3-d914b4af30d5] deallocate_for_instance() {{(pid=75165) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 00:11:04 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-a64d9ade-7c26-4e00-b44d-dfae00d8b0f5 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] Acquiring lock "45625147-ff69-496a-a41e-e55f818a020a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:11:04 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-a64d9ade-7c26-4e00-b44d-dfae00d8b0f5 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] Lock "45625147-ff69-496a-a41e-e55f818a020a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:11:04 user nova-compute[75165]: INFO nova.compute.manager [None req-a64d9ade-7c26-4e00-b44d-dfae00d8b0f5 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] [instance: 45625147-ff69-496a-a41e-e55f818a020a] Detaching volume 45f3fb95-eff9-4a9a-a50b-cdbfee3840d8
Oct 26 00:11:04 user nova-compute[75165]: DEBUG nova.compute.manager [req-2b6fd21d-67d5-4b3b-b2a2-b0d7f492acbc req-4a0bdcf9-fe47-42e4-962b-d9978ea3eb4a service nova] [instance: 018ca455-eace-412d-86a3-d914b4af30d5] Received event network-vif-unplugged-7752e050-4a35-4290-afb7-87d59ee07610 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:11:04 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-2b6fd21d-67d5-4b3b-b2a2-b0d7f492acbc req-4a0bdcf9-fe47-42e4-962b-d9978ea3eb4a service nova] Acquiring lock "018ca455-eace-412d-86a3-d914b4af30d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:11:04 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-2b6fd21d-67d5-4b3b-b2a2-b0d7f492acbc req-4a0bdcf9-fe47-42e4-962b-d9978ea3eb4a service nova] Lock "018ca455-eace-412d-86a3-d914b4af30d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:11:04 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-2b6fd21d-67d5-4b3b-b2a2-b0d7f492acbc req-4a0bdcf9-fe47-42e4-962b-d9978ea3eb4a service nova] Lock "018ca455-eace-412d-86a3-d914b4af30d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:11:04 user nova-compute[75165]: DEBUG nova.compute.manager [req-2b6fd21d-67d5-4b3b-b2a2-b0d7f492acbc req-4a0bdcf9-fe47-42e4-962b-d9978ea3eb4a service nova] [instance: 018ca455-eace-412d-86a3-d914b4af30d5] No waiting events found dispatching network-vif-unplugged-7752e050-4a35-4290-afb7-87d59ee07610 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:11:04 user nova-compute[75165]: DEBUG nova.compute.manager [req-2b6fd21d-67d5-4b3b-b2a2-b0d7f492acbc req-4a0bdcf9-fe47-42e4-962b-d9978ea3eb4a service nova] [instance: 018ca455-eace-412d-86a3-d914b4af30d5] Received event network-vif-unplugged-7752e050-4a35-4290-afb7-87d59ee07610 for instance with task_state deleting. {{(pid=75165) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 00:11:04 user nova-compute[75165]: DEBUG nova.compute.manager [req-2b6fd21d-67d5-4b3b-b2a2-b0d7f492acbc req-4a0bdcf9-fe47-42e4-962b-d9978ea3eb4a service nova] [instance: 018ca455-eace-412d-86a3-d914b4af30d5] Received event network-vif-plugged-7752e050-4a35-4290-afb7-87d59ee07610 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:11:04 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-2b6fd21d-67d5-4b3b-b2a2-b0d7f492acbc req-4a0bdcf9-fe47-42e4-962b-d9978ea3eb4a service nova] Acquiring lock "018ca455-eace-412d-86a3-d914b4af30d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:11:04 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-2b6fd21d-67d5-4b3b-b2a2-b0d7f492acbc req-4a0bdcf9-fe47-42e4-962b-d9978ea3eb4a service nova] Lock "018ca455-eace-412d-86a3-d914b4af30d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:11:04 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-2b6fd21d-67d5-4b3b-b2a2-b0d7f492acbc req-4a0bdcf9-fe47-42e4-962b-d9978ea3eb4a service nova] Lock "018ca455-eace-412d-86a3-d914b4af30d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:11:04 user nova-compute[75165]: DEBUG nova.compute.manager [req-2b6fd21d-67d5-4b3b-b2a2-b0d7f492acbc req-4a0bdcf9-fe47-42e4-962b-d9978ea3eb4a service nova] [instance: 018ca455-eace-412d-86a3-d914b4af30d5] No waiting events found dispatching network-vif-plugged-7752e050-4a35-4290-afb7-87d59ee07610 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:11:04 user nova-compute[75165]: WARNING nova.compute.manager [req-2b6fd21d-67d5-4b3b-b2a2-b0d7f492acbc req-4a0bdcf9-fe47-42e4-962b-d9978ea3eb4a service nova] [instance: 018ca455-eace-412d-86a3-d914b4af30d5] Received unexpected event network-vif-plugged-7752e050-4a35-4290-afb7-87d59ee07610 for instance with vm_state active and task_state deleting.
Oct 26 00:11:04 user nova-compute[75165]: INFO nova.virt.block_device [None req-a64d9ade-7c26-4e00-b44d-dfae00d8b0f5 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] [instance: 45625147-ff69-496a-a41e-e55f818a020a] Attempting to driver detach volume 45f3fb95-eff9-4a9a-a50b-cdbfee3840d8 from mountpoint /dev/vdb
Oct 26 00:11:04 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-a64d9ade-7c26-4e00-b44d-dfae00d8b0f5 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] Attempting to detach device vdb from instance 45625147-ff69-496a-a41e-e55f818a020a from the persistent domain config. {{(pid=75165) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 00:11:04 user nova-compute[75165]: DEBUG nova.virt.libvirt.guest [None req-a64d9ade-7c26-4e00-b44d-dfae00d8b0f5 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 00:11:04 user nova-compute[75165]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 00:11:04 user nova-compute[75165]:   <source dev="/dev/sde"/>
Oct 26 00:11:04 user nova-compute[75165]:   <target dev="vdb" bus="virtio"/>
Oct 26 00:11:04 user nova-compute[75165]:   <serial>45f3fb95-eff9-4a9a-a50b-cdbfee3840d8</serial>
Oct 26 00:11:04 user nova-compute[75165]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 00:11:04 user nova-compute[75165]: </disk>
Oct 26 00:11:04 user nova-compute[75165]:  {{(pid=75165) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 00:11:04 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-a64d9ade-7c26-4e00-b44d-dfae00d8b0f5 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] Successfully detached device vdb from instance 45625147-ff69-496a-a41e-e55f818a020a from the persistent domain config.
Oct 26 00:11:04 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-a64d9ade-7c26-4e00-b44d-dfae00d8b0f5 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 45625147-ff69-496a-a41e-e55f818a020a from the live domain config. {{(pid=75165) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 00:11:04 user nova-compute[75165]: DEBUG nova.virt.libvirt.guest [None req-a64d9ade-7c26-4e00-b44d-dfae00d8b0f5 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 00:11:04 user nova-compute[75165]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 00:11:04 user nova-compute[75165]:   <source dev="/dev/sde"/>
Oct 26 00:11:04 user nova-compute[75165]:   <target dev="vdb" bus="virtio"/>
Oct 26 00:11:04 user nova-compute[75165]:   <serial>45f3fb95-eff9-4a9a-a50b-cdbfee3840d8</serial>
Oct 26 00:11:04 user nova-compute[75165]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 00:11:04 user nova-compute[75165]: </disk>
Oct 26 00:11:04 user nova-compute[75165]:  {{(pid=75165) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 00:11:04 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:04 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:04 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:04 user nova-compute[75165]: DEBUG nova.network.neutron [-] [instance: 018ca455-eace-412d-86a3-d914b4af30d5] Updating instance_info_cache with network_info: [] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:11:04 user nova-compute[75165]: INFO nova.compute.manager [-] [instance: 018ca455-eace-412d-86a3-d914b4af30d5] Took 0.80 seconds to deallocate network for instance.
Oct 26 00:11:04 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:04 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-a64d9ade-7c26-4e00-b44d-dfae00d8b0f5 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 45625147-ff69-496a-a41e-e55f818a020a {{(pid=75165) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 00:11:04 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-cdda5d3d-857d-442b-aef5-43818a052638 tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:11:04 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-cdda5d3d-857d-442b-aef5-43818a052638 tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:11:05 user nova-compute[75165]: DEBUG nova.compute.manager [req-4c09b475-57b0-4122-87ac-c4d7500a3f10 req-9cabf8de-2d5c-4962-8e32-3dbc9dafc2c4 service nova] [instance: 22b9689c-5e83-4807-971f-5b244914b7e5] Received event network-vif-plugged-15022d7e-be4a-480d-a612-31e1e689f43b {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:11:05 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-4c09b475-57b0-4122-87ac-c4d7500a3f10 req-9cabf8de-2d5c-4962-8e32-3dbc9dafc2c4 service nova] Acquiring lock "22b9689c-5e83-4807-971f-5b244914b7e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:11:05 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-4c09b475-57b0-4122-87ac-c4d7500a3f10 req-9cabf8de-2d5c-4962-8e32-3dbc9dafc2c4 service nova] Lock "22b9689c-5e83-4807-971f-5b244914b7e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:11:05 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-4c09b475-57b0-4122-87ac-c4d7500a3f10 req-9cabf8de-2d5c-4962-8e32-3dbc9dafc2c4 service nova] Lock "22b9689c-5e83-4807-971f-5b244914b7e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:11:05 user nova-compute[75165]: DEBUG nova.compute.manager [req-4c09b475-57b0-4122-87ac-c4d7500a3f10 req-9cabf8de-2d5c-4962-8e32-3dbc9dafc2c4 service nova] [instance: 22b9689c-5e83-4807-971f-5b244914b7e5] No waiting events found dispatching network-vif-plugged-15022d7e-be4a-480d-a612-31e1e689f43b {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:11:05 user nova-compute[75165]: WARNING nova.compute.manager [req-4c09b475-57b0-4122-87ac-c4d7500a3f10 req-9cabf8de-2d5c-4962-8e32-3dbc9dafc2c4 service nova] [instance: 22b9689c-5e83-4807-971f-5b244914b7e5] Received unexpected event network-vif-plugged-15022d7e-be4a-480d-a612-31e1e689f43b for instance with vm_state building and task_state spawning.
Oct 26 00:11:05 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-cdda5d3d-857d-442b-aef5-43818a052638 tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:11:05 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-cdda5d3d-857d-442b-aef5-43818a052638 tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:11:05 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-cdda5d3d-857d-442b-aef5-43818a052638 tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.452s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:11:05 user nova-compute[75165]: INFO nova.scheduler.client.report [None req-cdda5d3d-857d-442b-aef5-43818a052638 tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] Deleted allocations for instance 018ca455-eace-412d-86a3-d914b4af30d5
Oct 26 00:11:05 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-cdda5d3d-857d-442b-aef5-43818a052638 tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] Lock "018ca455-eace-412d-86a3-d914b4af30d5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.730s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:11:05 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:06 user nova-compute[75165]: DEBUG nova.compute.manager [req-71567e5d-1b47-4e1d-9a7c-66fb0ee429b1 req-e8c2781f-9bc9-44a3-8544-3e178c726ad5 service nova] [instance: 018ca455-eace-412d-86a3-d914b4af30d5] Received event network-vif-deleted-7752e050-4a35-4290-afb7-87d59ee07610 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:11:07 user nova-compute[75165]: DEBUG nova.compute.manager [req-8e1ae064-ddac-4355-8e9a-acff66bcc506 req-728e4be9-acec-4a72-ae0e-93cf5d4d95fd service nova] [instance: 22b9689c-5e83-4807-971f-5b244914b7e5] Received event network-vif-plugged-15022d7e-be4a-480d-a612-31e1e689f43b {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:11:07 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-8e1ae064-ddac-4355-8e9a-acff66bcc506 req-728e4be9-acec-4a72-ae0e-93cf5d4d95fd service nova] Acquiring lock "22b9689c-5e83-4807-971f-5b244914b7e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:11:07 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-8e1ae064-ddac-4355-8e9a-acff66bcc506 req-728e4be9-acec-4a72-ae0e-93cf5d4d95fd service nova] Lock "22b9689c-5e83-4807-971f-5b244914b7e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:11:07 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-8e1ae064-ddac-4355-8e9a-acff66bcc506 req-728e4be9-acec-4a72-ae0e-93cf5d4d95fd service nova] Lock "22b9689c-5e83-4807-971f-5b244914b7e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:11:07 user nova-compute[75165]: DEBUG nova.compute.manager [req-8e1ae064-ddac-4355-8e9a-acff66bcc506 req-728e4be9-acec-4a72-ae0e-93cf5d4d95fd service nova] [instance: 22b9689c-5e83-4807-971f-5b244914b7e5] No waiting events found dispatching network-vif-plugged-15022d7e-be4a-480d-a612-31e1e689f43b {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:11:07 user nova-compute[75165]: WARNING nova.compute.manager [req-8e1ae064-ddac-4355-8e9a-acff66bcc506 req-728e4be9-acec-4a72-ae0e-93cf5d4d95fd service nova] [instance: 22b9689c-5e83-4807-971f-5b244914b7e5] Received unexpected event network-vif-plugged-15022d7e-be4a-480d-a612-31e1e689f43b for instance with vm_state building and task_state spawning.
Oct 26 00:11:07 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-1391af4e-f17d-4343-b3d6-46a1950775f0 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Acquiring lock "6f9add59-cabe-4965-8fe3-524618550581" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:11:07 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-1391af4e-f17d-4343-b3d6-46a1950775f0 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Lock "6f9add59-cabe-4965-8fe3-524618550581" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:11:07 user nova-compute[75165]: INFO nova.compute.manager [None req-1391af4e-f17d-4343-b3d6-46a1950775f0 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] [instance: 6f9add59-cabe-4965-8fe3-524618550581] Unshelving
Oct 26 00:11:07 user nova-compute[75165]: DEBUG nova.compute.manager [None req-4679c8d2-97fb-409b-a092-b4f0eaeca0f4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: 22b9689c-5e83-4807-971f-5b244914b7e5] Instance event wait completed in 0 seconds for  {{(pid=75165) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 00:11:07 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-4679c8d2-97fb-409b-a092-b4f0eaeca0f4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: 22b9689c-5e83-4807-971f-5b244914b7e5] Guest created on hypervisor {{(pid=75165) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 00:11:07 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: 22b9689c-5e83-4807-971f-5b244914b7e5] Instance spawned successfully.
Oct 26 00:11:07 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-4679c8d2-97fb-409b-a092-b4f0eaeca0f4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: 22b9689c-5e83-4807-971f-5b244914b7e5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 00:11:07 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-4679c8d2-97fb-409b-a092-b4f0eaeca0f4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: 22b9689c-5e83-4807-971f-5b244914b7e5] Found default for hw_cdrom_bus of ide {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:11:07 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-4679c8d2-97fb-409b-a092-b4f0eaeca0f4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: 22b9689c-5e83-4807-971f-5b244914b7e5] Found default for hw_disk_bus of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:11:07 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-4679c8d2-97fb-409b-a092-b4f0eaeca0f4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: 22b9689c-5e83-4807-971f-5b244914b7e5] Found default for hw_input_bus of None {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:11:07 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-4679c8d2-97fb-409b-a092-b4f0eaeca0f4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: 22b9689c-5e83-4807-971f-5b244914b7e5] Found default for hw_pointer_model of None {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:11:07 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-4679c8d2-97fb-409b-a092-b4f0eaeca0f4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: 22b9689c-5e83-4807-971f-5b244914b7e5] Found default for hw_video_model of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:11:07 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-4679c8d2-97fb-409b-a092-b4f0eaeca0f4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: 22b9689c-5e83-4807-971f-5b244914b7e5] Found default for hw_vif_model of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:11:07 user nova-compute[75165]: INFO nova.virt.block_device [None req-1391af4e-f17d-4343-b3d6-46a1950775f0 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] [instance: 6f9add59-cabe-4965-8fe3-524618550581] Booting with volume 3664944a-e477-4f40-9b8f-2dce50a14ea8 at /dev/vdc
Oct 26 00:11:07 user nova-compute[75165]: INFO nova.compute.manager [None req-4679c8d2-97fb-409b-a092-b4f0eaeca0f4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: 22b9689c-5e83-4807-971f-5b244914b7e5] Took 7.34 seconds to spawn the instance on the hypervisor.
Oct 26 00:11:07 user nova-compute[75165]: DEBUG nova.compute.manager [None req-4679c8d2-97fb-409b-a092-b4f0eaeca0f4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: 22b9689c-5e83-4807-971f-5b244914b7e5] Checking state {{(pid=75165) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 00:11:07 user nova-compute[75165]: DEBUG os_brick.utils [None req-1391af4e-f17d-4343-b3d6-46a1950775f0 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:11:07 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:07 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:07 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d82ce0d-d5fd-4e18-9453-c4bfe8d86bf1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa94814ccb35\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:11:07 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:08 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:08 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3f8f990-79ee-4138-9b7f-387865ecfbcf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:11:08 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:08 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:08 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[5608c866-bcaf-4b5b-be25-84656ae45532]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:11:08 user nova-compute[75165]: INFO nova.compute.manager [None req-4679c8d2-97fb-409b-a092-b4f0eaeca0f4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: 22b9689c-5e83-4807-971f-5b244914b7e5] Took 8.82 seconds to build instance.
Oct 26 00:11:08 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe101c1f-918f-4a8f-9bff-1fd8787affc5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:11:08 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-1391af4e-f17d-4343-b3d6-46a1950775f0 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Running cmd (subprocess): nvme version {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:08 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-1391af4e-f17d-4343-b3d6-46a1950775f0 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] 'nvme version' failed. Not Retrying. {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 00:11:08 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1391af4e-f17d-4343-b3d6-46a1950775f0 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] nvme not present on system {{(pid=75165) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 00:11:08 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-4679c8d2-97fb-409b-a092-b4f0eaeca0f4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Lock "22b9689c-5e83-4807-971f-5b244914b7e5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.995s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:11:08 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:08 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 00:11:08 user nova-compute[75165]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 00:11:08 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[6659dcd2-4b59-435c-9516-969a829a4e4d]: (4, '') {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:11:08 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-1391af4e-f17d-4343-b3d6-46a1950775f0 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75165) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 00:11:08 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-1391af4e-f17d-4343-b3d6-46a1950775f0 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75165) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 00:11:08 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-1391af4e-f17d-4343-b3d6-46a1950775f0 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] LIGHTOS: no hostnqn found. {{(pid=75165) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 00:11:08 user nova-compute[75165]: DEBUG os_brick.utils [None req-1391af4e-f17d-4343-b3d6-46a1950775f0 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa94814ccb35', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:11:08 user nova-compute[75165]: DEBUG nova.virt.block_device [None req-1391af4e-f17d-4343-b3d6-46a1950775f0 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] [instance: 6f9add59-cabe-4965-8fe3-524618550581] Updating existing volume attachment record: 03e51995-17d3-4e40-bb5f-d5e803ca6470 {{(pid=75165) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 00:11:08 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-e3e2284f-7d0e-464b-9ede-cf52e5ebe9a0 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Acquiring lock "3b153af2-c93b-47d2-ae8c-76cfd44e384c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:11:08 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-e3e2284f-7d0e-464b-9ede-cf52e5ebe9a0 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Lock "3b153af2-c93b-47d2-ae8c-76cfd44e384c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:11:08 user nova-compute[75165]: DEBUG nova.objects.instance [None req-e3e2284f-7d0e-464b-9ede-cf52e5ebe9a0 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Lazy-loading 'flavor' on Instance uuid 3b153af2-c93b-47d2-ae8c-76cfd44e384c {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:11:08 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:09 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-e3e2284f-7d0e-464b-9ede-cf52e5ebe9a0 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Lock "3b153af2-c93b-47d2-ae8c-76cfd44e384c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.083s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:11:09 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-e3e2284f-7d0e-464b-9ede-cf52e5ebe9a0 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Acquiring lock "3b153af2-c93b-47d2-ae8c-76cfd44e384c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:11:09 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-e3e2284f-7d0e-464b-9ede-cf52e5ebe9a0 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Lock "3b153af2-c93b-47d2-ae8c-76cfd44e384c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:11:09 user nova-compute[75165]: INFO nova.compute.manager [None req-e3e2284f-7d0e-464b-9ede-cf52e5ebe9a0 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] Attaching volume bdb81c18-9a59-4d59-861d-f713e876159b to /dev/vdb
Oct 26 00:11:09 user nova-compute[75165]: DEBUG os_brick.utils [None req-e3e2284f-7d0e-464b-9ede-cf52e5ebe9a0 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:11:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:09 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[45c98bfa-cac0-4825-bc71-77065eb10515]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa94814ccb35\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:11:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:09 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e2419c6-1860-4a95-9781-58a2f88568d9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:11:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.012s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:09 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e591910-54f1-41ea-a5c6-543a7444d847]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:11:09 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[7227ae9c-ecfd-4fc7-be53-0ce8c077db5b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:11:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-e3e2284f-7d0e-464b-9ede-cf52e5ebe9a0 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Running cmd (subprocess): nvme version {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-e3e2284f-7d0e-464b-9ede-cf52e5ebe9a0 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] 'nvme version' failed. Not Retrying. {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 00:11:09 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e3e2284f-7d0e-464b-9ede-cf52e5ebe9a0 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] nvme not present on system {{(pid=75165) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 00:11:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 00:11:09 user nova-compute[75165]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 00:11:09 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a49f4f1-5c0f-4700-b683-4d8370d3c910]: (4, '') {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:11:09 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-e3e2284f-7d0e-464b-9ede-cf52e5ebe9a0 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75165) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 00:11:09 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-e3e2284f-7d0e-464b-9ede-cf52e5ebe9a0 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75165) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 00:11:09 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-e3e2284f-7d0e-464b-9ede-cf52e5ebe9a0 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] LIGHTOS: no hostnqn found. {{(pid=75165) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 00:11:09 user nova-compute[75165]: DEBUG os_brick.utils [None req-e3e2284f-7d0e-464b-9ede-cf52e5ebe9a0 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] <== get_connector_properties: return (109ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa94814ccb35', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:11:09 user nova-compute[75165]: DEBUG nova.virt.block_device [None req-e3e2284f-7d0e-464b-9ede-cf52e5ebe9a0 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] Updating existing volume attachment record: 0a470b73-92eb-4123-a01c-96b1da65cd1c {{(pid=75165) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 00:11:10 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:10 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:11:10 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:11:10 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:11:10 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Starting heal instance info cache {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 00:11:11 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "refresh_cache-a7eeb145-1565-4812-818b-fefda5f2436d" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:11:11 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquired lock "refresh_cache-a7eeb145-1565-4812-818b-fefda5f2436d" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:11:11 user nova-compute[75165]: DEBUG nova.network.neutron [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: a7eeb145-1565-4812-818b-fefda5f2436d] Forcefully refreshing network info cache for instance {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 00:11:11 user nova-compute[75165]: DEBUG nova.network.neutron [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: a7eeb145-1565-4812-818b-fefda5f2436d] Updating instance_info_cache with network_info: [{"id": "7a43d085-a683-4c49-a7c8-13b8f35c943d", "address": "fa:16:3e:e8:63:41", "network": {"id": "bd1c84f9-bba9-4a23-8bf2-17e65022136a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1557945804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2911497df44047d9a9ee36a5652298bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a43d085-a6", "ovs_interfaceid": "7a43d085-a683-4c49-a7c8-13b8f35c943d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:11:11 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Releasing lock "refresh_cache-a7eeb145-1565-4812-818b-fefda5f2436d" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:11:11 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: a7eeb145-1565-4812-818b-fefda5f2436d] Updated the network info_cache for instance {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 00:11:11 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:11:11 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:11:11 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:11:11 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:11:11 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:11:11 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:11:11 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75165) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 00:11:11 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:11:11 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:11:11 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:11:11 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:11:11 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75165) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 00:11:11 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9633e6bb-5e95-4994-92a2-9d8f85a946ff/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:11 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9633e6bb-5e95-4994-92a2-9d8f85a946ff/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:11 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9633e6bb-5e95-4994-92a2-9d8f85a946ff/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9633e6bb-5e95-4994-92a2-9d8f85a946ff/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84c6b624-648b-40e2-a37e-ff08609bad84/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84c6b624-648b-40e2-a37e-ff08609bad84/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84c6b624-648b-40e2-a37e-ff08609bad84/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84c6b624-648b-40e2-a37e-ff08609bad84/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7eeb145-1565-4812-818b-fefda5f2436d/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7eeb145-1565-4812-818b-fefda5f2436d/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7eeb145-1565-4812-818b-fefda5f2436d/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7eeb145-1565-4812-818b-fefda5f2436d/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45625147-ff69-496a-a41e-e55f818a020a/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:13 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45625147-ff69-496a-a41e-e55f818a020a/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:13 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45625147-ff69-496a-a41e-e55f818a020a/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:13 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45625147-ff69-496a-a41e-e55f818a020a/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:13 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75165) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 00:11:13 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75165) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 00:11:13 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=75165) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 00:11:13 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26a0b493-bb47-466e-95d5-945fc3849fa5/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:13 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26a0b493-bb47-466e-95d5-945fc3849fa5/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:13 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26a0b493-bb47-466e-95d5-945fc3849fa5/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:13 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26a0b493-bb47-466e-95d5-945fc3849fa5/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:13 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e44bfc-6a68-46ce-8335-aaaba5160d3e/disk.rescue --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:13 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e44bfc-6a68-46ce-8335-aaaba5160d3e/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:13 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e44bfc-6a68-46ce-8335-aaaba5160d3e/disk.rescue --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:13 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:14 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e44bfc-6a68-46ce-8335-aaaba5160d3e/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:14 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e44bfc-6a68-46ce-8335-aaaba5160d3e/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:14 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e44bfc-6a68-46ce-8335-aaaba5160d3e/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:14 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e44bfc-6a68-46ce-8335-aaaba5160d3e/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:14 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e44bfc-6a68-46ce-8335-aaaba5160d3e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:14 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b9689c-5e83-4807-971f-5b244914b7e5/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:14 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b9689c-5e83-4807-971f-5b244914b7e5/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:14 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b9689c-5e83-4807-971f-5b244914b7e5/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:14 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b9689c-5e83-4807-971f-5b244914b7e5/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:14 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b153af2-c93b-47d2-ae8c-76cfd44e384c/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:14 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b153af2-c93b-47d2-ae8c-76cfd44e384c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:14 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b153af2-c93b-47d2-ae8c-76cfd44e384c/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:15 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b153af2-c93b-47d2-ae8c-76cfd44e384c/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:15 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:11:15 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:11:15 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Hypervisor/Node resource view: name=user free_ram=7725MB free_disk=25.181610107421875GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75165) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 00:11:15 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:11:15 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:11:15 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 9633e6bb-5e95-4994-92a2-9d8f85a946ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:11:15 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 84c6b624-648b-40e2-a37e-ff08609bad84 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:11:15 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance c4e44bfc-6a68-46ce-8335-aaaba5160d3e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:11:15 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance a7eeb145-1565-4812-818b-fefda5f2436d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:11:15 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 26a0b493-bb47-466e-95d5-945fc3849fa5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:11:15 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 3b153af2-c93b-47d2-ae8c-76cfd44e384c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:11:15 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 45625147-ff69-496a-a41e-e55f818a020a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:11:15 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 8d5569ce-1f18-4f37-a340-099ee152d548 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:11:15 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 22b9689c-5e83-4807-971f-5b244914b7e5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:11:15 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 6f9add59-cabe-4965-8fe3-524618550581 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Oct 26 00:11:15 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75165) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 00:11:15 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75165) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 00:11:16 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:11:16 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:11:16 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Compute_service record updated for user:user {{(pid=75165) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 00:11:16 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.597s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:11:18 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:20 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd2a81ae-e799-45ba-aba9-995a5fdd45c6 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] Calling os-brick to attach iSCSI Volume {{(pid=75165) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 00:11:20 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd2a81ae-e799-45ba-aba9-995a5fdd45c6 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8bf8160e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IgNFaCRv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:11:20 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-bd2a81ae-e799-45ba-aba9-995a5fdd45c6 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:11:20 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-bd2a81ae-e799-45ba-aba9-995a5fdd45c6 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:11:20 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-bd2a81ae-e799-45ba-aba9-995a5fdd45c6 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:11:20 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-bd2a81ae-e799-45ba-aba9-995a5fdd45c6 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:11:20 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-bd2a81ae-e799-45ba-aba9-995a5fdd45c6 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:11:20 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-bd2a81ae-e799-45ba-aba9-995a5fdd45c6 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:11:20 user nova-compute[75165]: INFO os_brick.initiator.connectors.iscsi [None req-bd2a81ae-e799-45ba-aba9-995a5fdd45c6 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 00:11:20 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792 -p 172.16.0.220:3260 {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:20 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:20 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cfc615c-c28b-42f1-a08d-d43f23fc1fc9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:11:20 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd2a81ae-e799-45ba-aba9-995a5fdd45c6 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 00:11:20 user nova-compute[75165]:  {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:11:20 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792 -p 172.16.0.220:3260 --interface default --op new {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:20 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:20 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7a31481-0944-45ff-9a6c-5e4d341950d3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792] added\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:11:20 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd2a81ae-e799-45ba-aba9-995a5fdd45c6 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792] added
Oct 26 00:11:20 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:11:20 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:20 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:20 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c8b2924-bd4b-44c8-8722-4dc88065a9cc]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:11:20 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd2a81ae-e799-45ba-aba9-995a5fdd45c6 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:11:20 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:20 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:20 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac502687-0f2b-4750-bd7e-5be447027ccc]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:11:20 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd2a81ae-e799-45ba-aba9-995a5fdd45c6 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:11:20 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IgNFaCRv {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:20 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IgNFaCRv" returned: 0 in 0.023s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:20 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[67f75ef5-d666-425d-99ba-e9f5178d5b9d]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:11:20 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd2a81ae-e799-45ba-aba9-995a5fdd45c6 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IgNFaCRv'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:11:20 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:20 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:20 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[28854801-e16a-44ef-81b4-8ecde8f20f9e]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:11:20 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd2a81ae-e799-45ba-aba9-995a5fdd45c6 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:11:20 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:20 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:20 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ad4a9e5-a55a-47e4-aec2-323a1b27d2cb]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45f3fb95-eff9-4a9a-a50b-cdbfee3840d8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f25f6e6a-9711-4455-82e8-c56648a08508 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:083f264a-3f29-48b4-9935-a73f4234e6d5 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff01f329-6dda-43b6-8da5-6a5c48fad211 (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:11:20 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd2a81ae-e799-45ba-aba9-995a5fdd45c6 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45f3fb95-eff9-4a9a-a50b-cdbfee3840d8 (non-flash)
Oct 26 00:11:20 user nova-compute[75165]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f25f6e6a-9711-4455-82e8-c56648a08508 (non-flash)
Oct 26 00:11:20 user nova-compute[75165]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:083f264a-3f29-48b4-9935-a73f4234e6d5 (non-flash)
Oct 26 00:11:20 user nova-compute[75165]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff01f329-6dda-43b6-8da5-6a5c48fad211 (non-flash)
Oct 26 00:11:20 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:11:20 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd2a81ae-e799-45ba-aba9-995a5fdd45c6 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45f3fb95-eff9-4a9a-a50b-cdbfee3840d8 (non-flash)
Oct 26 00:11:20 user nova-compute[75165]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f25f6e6a-9711-4455-82e8-c56648a08508 (non-flash)
Oct 26 00:11:20 user nova-compute[75165]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:083f264a-3f29-48b4-9935-a73f4234e6d5 (non-flash)
Oct 26 00:11:20 user nova-compute[75165]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff01f329-6dda-43b6-8da5-6a5c48fad211 (non-flash)
Oct 26 00:11:20 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:11:20 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792 -p 172.16.0.220:3260 --login {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:20 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:20 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea3a5326-b812-476b-9857-9c4478a839a6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:11:20 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd2a81ae-e799-45ba-aba9-995a5fdd45c6 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792, portal: 172.16.0.220,3260]
Oct 26 00:11:20 user nova-compute[75165]: Login to [iface: default, target: iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792, portal: 172.16.0.220,3260] successful.
Oct 26 00:11:20 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:11:20 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:20 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:20 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[13ef5ae6-b882-4787-ba24-0b67abfc0e36]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:11:20 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd2a81ae-e799-45ba-aba9-995a5fdd45c6 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:11:20 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:20 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:20 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd9d5611-bfd8-4b1a-848b-e4e4357f8780]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45f3fb95-eff9-4a9a-a50b-cdbfee3840d8 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f25f6e6a-9711-4455-82e8-c56648a08508 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:083f264a-3f29-48b4-9935-a73f4234e6d5 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff01f329-6dda-43b6-8da5-6a5c48fad211 (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:11:20 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd2a81ae-e799-45ba-aba9-995a5fdd45c6 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45f3fb95-eff9-4a9a-a50b-cdbfee3840d8 (non-flash)
Oct 26 00:11:20 user nova-compute[75165]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792 (non-flash)
Oct 26 00:11:20 user nova-compute[75165]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f25f6e6a-9711-4455-82e8-c56648a08508 (non-flash)
Oct 26 00:11:20 user nova-compute[75165]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:083f264a-3f29-48b4-9935-a73f4234e6d5 (non-flash)
Oct 26 00:11:20 user nova-compute[75165]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff01f329-6dda-43b6-8da5-6a5c48fad211 (non-flash)
Oct 26 00:11:20 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:11:20 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd2a81ae-e799-45ba-aba9-995a5fdd45c6 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45f3fb95-eff9-4a9a-a50b-cdbfee3840d8 (non-flash)
Oct 26 00:11:20 user nova-compute[75165]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792 (non-flash)
Oct 26 00:11:20 user nova-compute[75165]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f25f6e6a-9711-4455-82e8-c56648a08508 (non-flash)
Oct 26 00:11:20 user nova-compute[75165]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:083f264a-3f29-48b4-9935-a73f4234e6d5 (non-flash)
Oct 26 00:11:20 user nova-compute[75165]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff01f329-6dda-43b6-8da5-6a5c48fad211 (non-flash)
Oct 26 00:11:20 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:11:20 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-bd2a81ae-e799-45ba-aba9-995a5fdd45c6 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.304s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:11:20 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd2a81ae-e799-45ba-aba9-995a5fdd45c6 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Connected to 172.16.0.220:3260 {{(pid=75165) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 00:11:20 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-bd2a81ae-e799-45ba-aba9-995a5fdd45c6 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] HCTL ('33', '-', '-', 0) found on session 11 with lun 0 {{(pid=75165) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 00:11:20 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-bd2a81ae-e799-45ba-aba9-995a5fdd45c6 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75165) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 00:11:20 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:20 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:20 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:20 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8e1b567-01ca-4fa7-a8d3-2eea480068af]: (4, ('- - 0', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:11:20 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-bd2a81ae-e799-45ba-aba9-995a5fdd45c6 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Searching for a device in session 11 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75165) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 00:11:20 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd2a81ae-e799-45ba-aba9-995a5fdd45c6 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IgNFaCRv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75165) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 00:11:21 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-bd2a81ae-e799-45ba-aba9-995a5fdd45c6 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.339s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:11:21 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd2a81ae-e799-45ba-aba9-995a5fdd45c6 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] <== connect_volume: return (1341ms) {'type': 'block', 'scsi_wwn': '23965336664653662', 'path': '/dev/sdb'} {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:11:21 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd2a81ae-e799-45ba-aba9-995a5fdd45c6 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23965336664653662', 'path': '/dev/sdb'} {{(pid=75165) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 00:11:21 user nova-compute[75165]: DEBUG nova.objects.instance [None req-bd2a81ae-e799-45ba-aba9-995a5fdd45c6 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Lazy-loading 'flavor' on Instance uuid 26a0b493-bb47-466e-95d5-945fc3849fa5 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:11:21 user nova-compute[75165]: DEBUG nova.virt.libvirt.guest [None req-bd2a81ae-e799-45ba-aba9-995a5fdd45c6 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 00:11:21 user nova-compute[75165]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 00:11:21 user nova-compute[75165]:   <source dev="/dev/sdb"/>
Oct 26 00:11:21 user nova-compute[75165]:   <target dev="vdb" bus="virtio"/>
Oct 26 00:11:21 user nova-compute[75165]:   <serial>ce7241dd-04dd-4a96-b8a6-21fb4e678792</serial>
Oct 26 00:11:21 user nova-compute[75165]: </disk>
Oct 26 00:11:21 user nova-compute[75165]:  {{(pid=75165) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 00:11:22 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-bd2a81ae-e799-45ba-aba9-995a5fdd45c6 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] No BDM found with device name vda, not building metadata. {{(pid=75165) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 00:11:22 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-bd2a81ae-e799-45ba-aba9-995a5fdd45c6 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75165) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 00:11:22 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-bd2a81ae-e799-45ba-aba9-995a5fdd45c6 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] No VIF found with MAC fa:16:3e:d3:eb:fb, not building metadata {{(pid=75165) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 00:11:22 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-bd2a81ae-e799-45ba-aba9-995a5fdd45c6 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Lock "26a0b493-bb47-466e-95d5-945fc3849fa5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 22.585s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:11:23 user nova-compute[75165]: INFO nova.compute.manager [None req-d2353baf-7fbd-40b8-88d7-cfc8f3627584 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] Rescuing
Oct 26 00:11:23 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-d2353baf-7fbd-40b8-88d7-cfc8f3627584 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Acquiring lock "refresh_cache-26a0b493-bb47-466e-95d5-945fc3849fa5" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:11:23 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-d2353baf-7fbd-40b8-88d7-cfc8f3627584 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Acquired lock "refresh_cache-26a0b493-bb47-466e-95d5-945fc3849fa5" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:11:23 user nova-compute[75165]: DEBUG nova.network.neutron [None req-d2353baf-7fbd-40b8-88d7-cfc8f3627584 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] Building network info cache for instance {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 00:11:23 user nova-compute[75165]: DEBUG nova.network.neutron [None req-d2353baf-7fbd-40b8-88d7-cfc8f3627584 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] Updating instance_info_cache with network_info: [{"id": "1d6d497c-7382-4dff-b136-d1220b05a838", "address": "fa:16:3e:d3:eb:fb", "network": {"id": "08c51c53-4819-493e-b4eb-df5d6024d43d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1633769998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9cbae16d09ed4474bb6653f08165a4e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d6d497c-73", "ovs_interfaceid": "1d6d497c-7382-4dff-b136-d1220b05a838", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:11:23 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-d2353baf-7fbd-40b8-88d7-cfc8f3627584 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Releasing lock "refresh_cache-26a0b493-bb47-466e-95d5-945fc3849fa5" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:11:23 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:24 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:24 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:24 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:24 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:24 user nova-compute[75165]: DEBUG nova.compute.manager [req-4325d677-f0a4-44c7-a8af-1001f7b593cd req-c1776695-b5f0-4f96-8d72-9004469426cf service nova] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] Received event network-vif-unplugged-1d6d497c-7382-4dff-b136-d1220b05a838 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:11:24 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-4325d677-f0a4-44c7-a8af-1001f7b593cd req-c1776695-b5f0-4f96-8d72-9004469426cf service nova] Acquiring lock "26a0b493-bb47-466e-95d5-945fc3849fa5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:11:24 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-4325d677-f0a4-44c7-a8af-1001f7b593cd req-c1776695-b5f0-4f96-8d72-9004469426cf service nova] Lock "26a0b493-bb47-466e-95d5-945fc3849fa5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:11:24 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-4325d677-f0a4-44c7-a8af-1001f7b593cd req-c1776695-b5f0-4f96-8d72-9004469426cf service nova] Lock "26a0b493-bb47-466e-95d5-945fc3849fa5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:11:24 user nova-compute[75165]: DEBUG nova.compute.manager [req-4325d677-f0a4-44c7-a8af-1001f7b593cd req-c1776695-b5f0-4f96-8d72-9004469426cf service nova] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] No waiting events found dispatching network-vif-unplugged-1d6d497c-7382-4dff-b136-d1220b05a838 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:11:24 user nova-compute[75165]: WARNING nova.compute.manager [req-4325d677-f0a4-44c7-a8af-1001f7b593cd req-c1776695-b5f0-4f96-8d72-9004469426cf service nova] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] Received unexpected event network-vif-unplugged-1d6d497c-7382-4dff-b136-d1220b05a838 for instance with vm_state active and task_state rescuing.
Oct 26 00:11:24 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:24 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:24 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:24 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:24 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] Instance destroyed successfully.
Oct 26 00:11:24 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-d2353baf-7fbd-40b8-88d7-cfc8f3627584 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] Attempting a stable device rescue
Oct 26 00:11:24 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-d2353baf-7fbd-40b8-88d7-cfc8f3627584 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=75165) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 26 00:11:24 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-d2353baf-7fbd-40b8-88d7-cfc8f3627584 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] Instance directory exists: not creating {{(pid=75165) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 26 00:11:24 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-d2353baf-7fbd-40b8-88d7-cfc8f3627584 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] Creating image(s)
Oct 26 00:11:24 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-d2353baf-7fbd-40b8-88d7-cfc8f3627584 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Acquiring lock "/opt/stack/data/nova/instances/26a0b493-bb47-466e-95d5-945fc3849fa5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:11:24 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-d2353baf-7fbd-40b8-88d7-cfc8f3627584 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Lock "/opt/stack/data/nova/instances/26a0b493-bb47-466e-95d5-945fc3849fa5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:11:24 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-d2353baf-7fbd-40b8-88d7-cfc8f3627584 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Lock "/opt/stack/data/nova/instances/26a0b493-bb47-466e-95d5-945fc3849fa5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:11:24 user nova-compute[75165]: DEBUG nova.objects.instance [None req-d2353baf-7fbd-40b8-88d7-cfc8f3627584 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Lazy-loading 'trusted_certs' on Instance uuid 26a0b493-bb47-466e-95d5-945fc3849fa5 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:11:24 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-d2353baf-7fbd-40b8-88d7-cfc8f3627584 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Acquiring lock "b577127b41c299d5026ed11175cf70dd549a1f0a" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:11:24 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-d2353baf-7fbd-40b8-88d7-cfc8f3627584 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Lock "b577127b41c299d5026ed11175cf70dd549a1f0a" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:11:24 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-a64d9ade-7c26-4e00-b44d-dfae00d8b0f5 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 45625147-ff69-496a-a41e-e55f818a020a is timed out.
Oct 26 00:11:24 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-a64d9ade-7c26-4e00-b44d-dfae00d8b0f5 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] Successfully detached device vdb from instance 45625147-ff69-496a-a41e-e55f818a020a from the live domain config.
Oct 26 00:11:24 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a64d9ade-7c26-4e00-b44d-dfae00d8b0f5 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] [instance: 45625147-ff69-496a-a41e-e55f818a020a] calling os-brick to detach iSCSI Volume {{(pid=75165) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 00:11:24 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-a64d9ade-7c26-4e00-b44d-dfae00d8b0f5 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8bf8160e50>, {'target_iqn': 'iqn.2010-10.org.openstack:45f3fb95-eff9-4a9a-a50b-cdbfee3840d8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ARaLnBGq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde', 'volume_id': '45f3fb95-eff9-4a9a-a50b-cdbfee3840d8'}, None), 'kwargs': False}}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:11:24 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-a64d9ade-7c26-4e00-b44d-dfae00d8b0f5 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:11:24 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-a64d9ade-7c26-4e00-b44d-dfae00d8b0f5 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:11:24 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-a64d9ade-7c26-4e00-b44d-dfae00d8b0f5 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:11:24 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:24 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:24 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:24 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[433cfb79-ff86-49ce-8b78-2438fbb81759]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f25f6e6a-9711-4455-82e8-c56648a08508\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ff01f329-6dda-43b6-8da5-6a5c48fad211\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:083f264a-3f29-48b4-9935-a73f4234e6d5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:45f3fb95-eff9-4a9a-a50b-cdbfee3840d8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:11:24 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-a64d9ade-7c26-4e00-b44d-dfae00d8b0f5 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 00:11:24 user nova-compute[75165]: No targets found.
Oct 26 00:11:24 user nova-compute[75165]: iSNS:
Oct 26 00:11:24 user nova-compute[75165]: No targets found.
Oct 26 00:11:24 user nova-compute[75165]: STATIC:
Oct 26 00:11:24 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792
Oct 26 00:11:24 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:11:24 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:11:24 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:f25f6e6a-9711-4455-82e8-c56648a08508
Oct 26 00:11:24 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:11:24 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:11:24 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:ff01f329-6dda-43b6-8da5-6a5c48fad211
Oct 26 00:11:24 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:11:24 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:11:24 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:083f264a-3f29-48b4-9935-a73f4234e6d5
Oct 26 00:11:24 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:11:24 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:11:24 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:45f3fb95-eff9-4a9a-a50b-cdbfee3840d8
Oct 26 00:11:24 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:11:24 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:11:24 user nova-compute[75165]: FIRMWARE:
Oct 26 00:11:24 user nova-compute[75165]: No targets found.
Oct 26 00:11:24 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:11:24 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-a64d9ade-7c26-4e00-b44d-dfae00d8b0f5 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 00:11:24 user nova-compute[75165]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 00:11:24 user nova-compute[75165]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75165) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 00:11:24 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-a64d9ade-7c26-4e00-b44d-dfae00d8b0f5 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:45f3fb95-eff9-4a9a-a50b-cdbfee3840d8', 0)] {{(pid=75165) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 00:11:24 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:25 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:25 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9782f8c-3a92-4377-b966-d69185899855]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:083f264a-3f29-48b4-9935-a73f4234e6d5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:45f3fb95-eff9-4a9a-a50b-cdbfee3840d8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f25f6e6a-9711-4455-82e8-c56648a08508\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ff01f329-6dda-43b6-8da5-6a5c48fad211\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:11:25 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:26 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-d2353baf-7fbd-40b8-88d7-cfc8f3627584 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b577127b41c299d5026ed11175cf70dd549a1f0a.part --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:26 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:26 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[61d4df52-755c-4244-b20a-46d63fe4f0de]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45f3fb95-eff9-4a9a-a50b-cdbfee3840d8 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f25f6e6a-9711-4455-82e8-c56648a08508 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:083f264a-3f29-48b4-9935-a73f4234e6d5 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff01f329-6dda-43b6-8da5-6a5c48fad211 (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:11:26 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:26 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-a64d9ade-7c26-4e00-b44d-dfae00d8b0f5 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45f3fb95-eff9-4a9a-a50b-cdbfee3840d8 (non-flash)
Oct 26 00:11:26 user nova-compute[75165]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792 (non-flash)
Oct 26 00:11:26 user nova-compute[75165]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f25f6e6a-9711-4455-82e8-c56648a08508 (non-flash)
Oct 26 00:11:26 user nova-compute[75165]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:083f264a-3f29-48b4-9935-a73f4234e6d5 (non-flash)
Oct 26 00:11:26 user nova-compute[75165]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff01f329-6dda-43b6-8da5-6a5c48fad211 (non-flash)
Oct 26 00:11:26 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:11:26 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-a64d9ade-7c26-4e00-b44d-dfae00d8b0f5 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:45f3fb95-eff9-4a9a-a50b-cdbfee3840d8 (non-flash)
Oct 26 00:11:26 user nova-compute[75165]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792 (non-flash)
Oct 26 00:11:26 user nova-compute[75165]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f25f6e6a-9711-4455-82e8-c56648a08508 (non-flash)
Oct 26 00:11:26 user nova-compute[75165]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:083f264a-3f29-48b4-9935-a73f4234e6d5 (non-flash)
Oct 26 00:11:26 user nova-compute[75165]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff01f329-6dda-43b6-8da5-6a5c48fad211 (non-flash)
Oct 26 00:11:26 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:11:26 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-a64d9ade-7c26-4e00-b44d-dfae00d8b0f5 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8bf833e3b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:45f3fb95-eff9-4a9a-a50b-cdbfee3840d8'): ({'sde'}, set())}) {{(pid=75165) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 00:11:26 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-a64d9ade-7c26-4e00-b44d-dfae00d8b0f5 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] Removing single pathed devices sde {{(pid=75165) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 00:11:26 user nova-compute[75165]: DEBUG nova.compute.manager [req-49c1bed2-7e40-4cf6-816a-b108ba7ff705 req-5f2a4c5e-1f97-442a-9f7e-771024212f63 service nova] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] Received event network-vif-plugged-1d6d497c-7382-4dff-b136-d1220b05a838 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:11:26 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-49c1bed2-7e40-4cf6-816a-b108ba7ff705 req-5f2a4c5e-1f97-442a-9f7e-771024212f63 service nova] Acquiring lock "26a0b493-bb47-466e-95d5-945fc3849fa5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:11:26 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-49c1bed2-7e40-4cf6-816a-b108ba7ff705 req-5f2a4c5e-1f97-442a-9f7e-771024212f63 service nova] Lock "26a0b493-bb47-466e-95d5-945fc3849fa5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:11:26 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-49c1bed2-7e40-4cf6-816a-b108ba7ff705 req-5f2a4c5e-1f97-442a-9f7e-771024212f63 service nova] Lock "26a0b493-bb47-466e-95d5-945fc3849fa5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:11:26 user nova-compute[75165]: DEBUG nova.compute.manager [req-49c1bed2-7e40-4cf6-816a-b108ba7ff705 req-5f2a4c5e-1f97-442a-9f7e-771024212f63 service nova] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] No waiting events found dispatching network-vif-plugged-1d6d497c-7382-4dff-b136-d1220b05a838 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:11:26 user nova-compute[75165]: WARNING nova.compute.manager [req-49c1bed2-7e40-4cf6-816a-b108ba7ff705 req-5f2a4c5e-1f97-442a-9f7e-771024212f63 service nova] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] Received unexpected event network-vif-plugged-1d6d497c-7382-4dff-b136-d1220b05a838 for instance with vm_state active and task_state rescuing.
Oct 26 00:11:26 user nova-compute[75165]: DEBUG nova.compute.manager [req-49c1bed2-7e40-4cf6-816a-b108ba7ff705 req-5f2a4c5e-1f97-442a-9f7e-771024212f63 service nova] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] Received event network-vif-plugged-1d6d497c-7382-4dff-b136-d1220b05a838 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:11:26 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-49c1bed2-7e40-4cf6-816a-b108ba7ff705 req-5f2a4c5e-1f97-442a-9f7e-771024212f63 service nova] Acquiring lock "26a0b493-bb47-466e-95d5-945fc3849fa5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:11:26 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-49c1bed2-7e40-4cf6-816a-b108ba7ff705 req-5f2a4c5e-1f97-442a-9f7e-771024212f63 service nova] Lock "26a0b493-bb47-466e-95d5-945fc3849fa5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:11:26 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-49c1bed2-7e40-4cf6-816a-b108ba7ff705 req-5f2a4c5e-1f97-442a-9f7e-771024212f63 service nova] Lock "26a0b493-bb47-466e-95d5-945fc3849fa5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:11:26 user nova-compute[75165]: DEBUG nova.compute.manager [req-49c1bed2-7e40-4cf6-816a-b108ba7ff705 req-5f2a4c5e-1f97-442a-9f7e-771024212f63 service nova] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] No waiting events found dispatching network-vif-plugged-1d6d497c-7382-4dff-b136-d1220b05a838 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:11:26 user nova-compute[75165]: WARNING nova.compute.manager [req-49c1bed2-7e40-4cf6-816a-b108ba7ff705 req-5f2a4c5e-1f97-442a-9f7e-771024212f63 service nova] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] Received unexpected event network-vif-plugged-1d6d497c-7382-4dff-b136-d1220b05a838 for instance with vm_state active and task_state rescuing.
Oct 26 00:11:26 user nova-compute[75165]: DEBUG nova.compute.manager [req-49c1bed2-7e40-4cf6-816a-b108ba7ff705 req-5f2a4c5e-1f97-442a-9f7e-771024212f63 service nova] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] Received event network-vif-plugged-1d6d497c-7382-4dff-b136-d1220b05a838 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:11:26 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-49c1bed2-7e40-4cf6-816a-b108ba7ff705 req-5f2a4c5e-1f97-442a-9f7e-771024212f63 service nova] Acquiring lock "26a0b493-bb47-466e-95d5-945fc3849fa5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:11:26 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-49c1bed2-7e40-4cf6-816a-b108ba7ff705 req-5f2a4c5e-1f97-442a-9f7e-771024212f63 service nova] Lock "26a0b493-bb47-466e-95d5-945fc3849fa5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:11:26 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-49c1bed2-7e40-4cf6-816a-b108ba7ff705 req-5f2a4c5e-1f97-442a-9f7e-771024212f63 service nova] Lock "26a0b493-bb47-466e-95d5-945fc3849fa5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:11:26 user nova-compute[75165]: DEBUG nova.compute.manager [req-49c1bed2-7e40-4cf6-816a-b108ba7ff705 req-5f2a4c5e-1f97-442a-9f7e-771024212f63 service nova] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] No waiting events found dispatching network-vif-plugged-1d6d497c-7382-4dff-b136-d1220b05a838 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:11:26 user nova-compute[75165]: WARNING nova.compute.manager [req-49c1bed2-7e40-4cf6-816a-b108ba7ff705 req-5f2a4c5e-1f97-442a-9f7e-771024212f63 service nova] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] Received unexpected event network-vif-plugged-1d6d497c-7382-4dff-b136-d1220b05a838 for instance with vm_state active and task_state rescuing.
Oct 26 00:11:26 user nova-compute[75165]: DEBUG nova.compute.manager [req-49c1bed2-7e40-4cf6-816a-b108ba7ff705 req-5f2a4c5e-1f97-442a-9f7e-771024212f63 service nova] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] Received event network-vif-unplugged-1d6d497c-7382-4dff-b136-d1220b05a838 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:11:26 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-49c1bed2-7e40-4cf6-816a-b108ba7ff705 req-5f2a4c5e-1f97-442a-9f7e-771024212f63 service nova] Acquiring lock "26a0b493-bb47-466e-95d5-945fc3849fa5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:11:26 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-49c1bed2-7e40-4cf6-816a-b108ba7ff705 req-5f2a4c5e-1f97-442a-9f7e-771024212f63 service nova] Lock "26a0b493-bb47-466e-95d5-945fc3849fa5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:11:26 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-49c1bed2-7e40-4cf6-816a-b108ba7ff705 req-5f2a4c5e-1f97-442a-9f7e-771024212f63 service nova] Lock "26a0b493-bb47-466e-95d5-945fc3849fa5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:11:26 user nova-compute[75165]: DEBUG nova.compute.manager [req-49c1bed2-7e40-4cf6-816a-b108ba7ff705 req-5f2a4c5e-1f97-442a-9f7e-771024212f63 service nova] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] No waiting events found dispatching network-vif-unplugged-1d6d497c-7382-4dff-b136-d1220b05a838 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:11:26 user nova-compute[75165]: WARNING nova.compute.manager [req-49c1bed2-7e40-4cf6-816a-b108ba7ff705 req-5f2a4c5e-1f97-442a-9f7e-771024212f63 service nova] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] Received unexpected event network-vif-unplugged-1d6d497c-7382-4dff-b136-d1220b05a838 for instance with vm_state active and task_state rescuing.
Oct 26 00:11:26 user nova-compute[75165]: DEBUG nova.compute.manager [req-49c1bed2-7e40-4cf6-816a-b108ba7ff705 req-5f2a4c5e-1f97-442a-9f7e-771024212f63 service nova] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] Received event network-vif-plugged-1d6d497c-7382-4dff-b136-d1220b05a838 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:11:26 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-49c1bed2-7e40-4cf6-816a-b108ba7ff705 req-5f2a4c5e-1f97-442a-9f7e-771024212f63 service nova] Acquiring lock "26a0b493-bb47-466e-95d5-945fc3849fa5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:11:26 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-49c1bed2-7e40-4cf6-816a-b108ba7ff705 req-5f2a4c5e-1f97-442a-9f7e-771024212f63 service nova] Lock "26a0b493-bb47-466e-95d5-945fc3849fa5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:11:26 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-49c1bed2-7e40-4cf6-816a-b108ba7ff705 req-5f2a4c5e-1f97-442a-9f7e-771024212f63 service nova] Lock "26a0b493-bb47-466e-95d5-945fc3849fa5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:11:26 user nova-compute[75165]: DEBUG nova.compute.manager [req-49c1bed2-7e40-4cf6-816a-b108ba7ff705 req-5f2a4c5e-1f97-442a-9f7e-771024212f63 service nova] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] No waiting events found dispatching network-vif-plugged-1d6d497c-7382-4dff-b136-d1220b05a838 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:11:26 user nova-compute[75165]: WARNING nova.compute.manager [req-49c1bed2-7e40-4cf6-816a-b108ba7ff705 req-5f2a4c5e-1f97-442a-9f7e-771024212f63 service nova] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] Received unexpected event network-vif-plugged-1d6d497c-7382-4dff-b136-d1220b05a838 for instance with vm_state active and task_state rescuing.
Oct 26 00:11:26 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:26 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.030s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:26 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[edd76614-69a7-4c0e-ad65-3bc0a83b1de3]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:11:26 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:26 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:26 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b448175-0321-462c-9e0b-237c41a5c040]: (4, ('ok\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:11:26 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-a64d9ade-7c26-4e00-b44d-dfae00d8b0f5 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] Flushing IO for device /dev/sde {{(pid=75165) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 00:11:26 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:26 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:26 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bd55e87-60a8-4058-bcab-1d910fd53365]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:11:26 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-a64d9ade-7c26-4e00-b44d-dfae00d8b0f5 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75165) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 00:11:26 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:26 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.036s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:26 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2861e86-1ace-4275-9f22-f31d4fd0f2a5]: (4, ('1', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:11:26 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-a64d9ade-7c26-4e00-b44d-dfae00d8b0f5 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75165) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 00:11:26 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-a64d9ade-7c26-4e00-b44d-dfae00d8b0f5 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] SCSI volumes sde have been removed. {{(pid=75165) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 00:11:26 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-a64d9ade-7c26-4e00-b44d-dfae00d8b0f5 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:45f3fb95-eff9-4a9a-a50b-cdbfee3840d8')] {{(pid=75165) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 00:11:26 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45f3fb95-eff9-4a9a-a50b-cdbfee3840d8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:26 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-d2353baf-7fbd-40b8-88d7-cfc8f3627584 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b577127b41c299d5026ed11175cf70dd549a1f0a.part --force-share --output=json" returned: 0 in 0.211s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:26 user nova-compute[75165]: DEBUG nova.virt.images [None req-d2353baf-7fbd-40b8-88d7-cfc8f3627584 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] 2ed86c40-019a-445f-ad8c-2b06e0ac9707 was qcow2, converting to raw {{(pid=75165) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 26 00:11:26 user nova-compute[75165]: DEBUG nova.privsep.utils [None req-d2353baf-7fbd-40b8-88d7-cfc8f3627584 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75165) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 26 00:11:26 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-d2353baf-7fbd-40b8-88d7-cfc8f3627584 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b577127b41c299d5026ed11175cf70dd549a1f0a.part /opt/stack/data/nova/instances/_base/b577127b41c299d5026ed11175cf70dd549a1f0a.converted {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:26 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45f3fb95-eff9-4a9a-a50b-cdbfee3840d8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:26 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[d26b9a4f-cff9-470b-b6ef-0ad25d76ad1d]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:11:26 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-a64d9ade-7c26-4e00-b44d-dfae00d8b0f5 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:11:26 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45f3fb95-eff9-4a9a-a50b-cdbfee3840d8 -p 172.16.0.220:3260 --logout {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:26 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45f3fb95-eff9-4a9a-a50b-cdbfee3840d8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:26 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed07b60c-b066-4e6d-8677-e03a9c2e6e1f]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:45f3fb95-eff9-4a9a-a50b-cdbfee3840d8, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:45f3fb95-eff9-4a9a-a50b-cdbfee3840d8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:11:26 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-a64d9ade-7c26-4e00-b44d-dfae00d8b0f5 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:45f3fb95-eff9-4a9a-a50b-cdbfee3840d8, portal: 172.16.0.220,3260]
Oct 26 00:11:26 user nova-compute[75165]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:45f3fb95-eff9-4a9a-a50b-cdbfee3840d8, portal: 172.16.0.220,3260] successful.
Oct 26 00:11:26 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:11:26 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:45f3fb95-eff9-4a9a-a50b-cdbfee3840d8 -p 172.16.0.220:3260 --op delete {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:26 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:45f3fb95-eff9-4a9a-a50b-cdbfee3840d8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.049s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:26 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[10699dbf-45c1-437c-8276-ca38974fde57]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:11:26 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-a64d9ade-7c26-4e00-b44d-dfae00d8b0f5 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:11:26 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-a64d9ade-7c26-4e00-b44d-dfae00d8b0f5 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 1.810s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:11:26 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-a64d9ade-7c26-4e00-b44d-dfae00d8b0f5 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] <== disconnect_volume: return (1813ms) None {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:11:26 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a64d9ade-7c26-4e00-b44d-dfae00d8b0f5 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] [instance: 45625147-ff69-496a-a41e-e55f818a020a] Disconnected iSCSI Volume {{(pid=75165) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 00:11:27 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-d2353baf-7fbd-40b8-88d7-cfc8f3627584 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b577127b41c299d5026ed11175cf70dd549a1f0a.part /opt/stack/data/nova/instances/_base/b577127b41c299d5026ed11175cf70dd549a1f0a.converted" returned: 0 in 0.552s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:27 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-d2353baf-7fbd-40b8-88d7-cfc8f3627584 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b577127b41c299d5026ed11175cf70dd549a1f0a.converted --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:27 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-d2353baf-7fbd-40b8-88d7-cfc8f3627584 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b577127b41c299d5026ed11175cf70dd549a1f0a.converted --force-share --output=json" returned: 0 in 0.194s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:27 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-d2353baf-7fbd-40b8-88d7-cfc8f3627584 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Lock "b577127b41c299d5026ed11175cf70dd549a1f0a" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.456s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:11:27 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-d2353baf-7fbd-40b8-88d7-cfc8f3627584 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Acquiring lock "b577127b41c299d5026ed11175cf70dd549a1f0a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:11:27 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-d2353baf-7fbd-40b8-88d7-cfc8f3627584 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Lock "b577127b41c299d5026ed11175cf70dd549a1f0a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:11:27 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-d2353baf-7fbd-40b8-88d7-cfc8f3627584 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b577127b41c299d5026ed11175cf70dd549a1f0a --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:27 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-d2353baf-7fbd-40b8-88d7-cfc8f3627584 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b577127b41c299d5026ed11175cf70dd549a1f0a --force-share --output=json" returned: 0 in 0.180s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:27 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-d2353baf-7fbd-40b8-88d7-cfc8f3627584 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b577127b41c299d5026ed11175cf70dd549a1f0a,backing_fmt=raw /opt/stack/data/nova/instances/26a0b493-bb47-466e-95d5-945fc3849fa5/disk.rescue {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:27 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-d2353baf-7fbd-40b8-88d7-cfc8f3627584 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b577127b41c299d5026ed11175cf70dd549a1f0a,backing_fmt=raw /opt/stack/data/nova/instances/26a0b493-bb47-466e-95d5-945fc3849fa5/disk.rescue" returned: 0 in 0.053s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:27 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-d2353baf-7fbd-40b8-88d7-cfc8f3627584 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Lock "b577127b41c299d5026ed11175cf70dd549a1f0a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:11:27 user nova-compute[75165]: DEBUG nova.objects.instance [None req-d2353baf-7fbd-40b8-88d7-cfc8f3627584 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Lazy-loading 'migration_context' on Instance uuid 26a0b493-bb47-466e-95d5-945fc3849fa5 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:11:27 user nova-compute[75165]: DEBUG nova.objects.base [None req-d2353baf-7fbd-40b8-88d7-cfc8f3627584 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Object Instance<26a0b493-bb47-466e-95d5-945fc3849fa5> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75165) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 00:11:27 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-d2353baf-7fbd-40b8-88d7-cfc8f3627584 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] Created local disks {{(pid=75165) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 00:11:27 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-d2353baf-7fbd-40b8-88d7-cfc8f3627584 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] Start _get_guest_xml network_info=[{"id": "1d6d497c-7382-4dff-b136-d1220b05a838", "address": "fa:16:3e:d3:eb:fb", "network": {"id": "08c51c53-4819-493e-b4eb-df5d6024d43d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1633769998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1633769998-network", "vif_mac": "fa:16:3e:d3:eb:fb"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9cbae16d09ed4474bb6653f08165a4e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d6d497c-73", "ovs_interfaceid": "1d6d497c-7382-4dff-b136-d1220b05a838", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T00:03:24Z,direct_url=<?>,disk_format='qcow2',id=bff0d8a1-739e-4c4d-9efa-b73ba7b76d01,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e56bbf444fd34c348475c73673611447',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T00:03:26Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '2ed86c40-019a-445f-ad8c-2b06e0ac9707', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'size': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': 'bff0d8a1-739e-4c4d-9efa-b73ba7b76d01'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IgNFaCRv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '26a0b493-bb47-466e-95d5-945fc3849fa5', 'attached_at': '', 'detached_at': '', 'volume_id': 'ce7241dd-04dd-4a96-b8a6-21fb4e678792', 'serial': 'ce7241dd-04dd-4a96-b8a6-21fb4e678792'}, 'guest_format': None, 'boot_index': None, 'disk_bus': 'virtio', 'attachment_id': 'f29a2fc1-e2a7-49d4-bee6-303e071ca12b', 'delete_on_termination': False, 'volume_type': None} {{(pid=75165) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 00:11:27 user nova-compute[75165]: DEBUG nova.objects.instance [None req-d2353baf-7fbd-40b8-88d7-cfc8f3627584 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Lazy-loading 'resources' on Instance uuid 26a0b493-bb47-466e-95d5-945fc3849fa5 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:11:27 user nova-compute[75165]: DEBUG nova.objects.base [None req-d2353baf-7fbd-40b8-88d7-cfc8f3627584 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Object Instance<26a0b493-bb47-466e-95d5-945fc3849fa5> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75165) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 00:11:27 user nova-compute[75165]: DEBUG nova.objects.instance [None req-d2353baf-7fbd-40b8-88d7-cfc8f3627584 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Lazy-loading 'numa_topology' on Instance uuid 26a0b493-bb47-466e-95d5-945fc3849fa5 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:11:27 user nova-compute[75165]: DEBUG nova.objects.base [None req-d2353baf-7fbd-40b8-88d7-cfc8f3627584 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Object Instance<26a0b493-bb47-466e-95d5-945fc3849fa5> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75165) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 00:11:27 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-d2353baf-7fbd-40b8-88d7-cfc8f3627584 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:11:27 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-d2353baf-7fbd-40b8-88d7-cfc8f3627584 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:11:27 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-d2353baf-7fbd-40b8-88d7-cfc8f3627584 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75165) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 00:11:27 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-d2353baf-7fbd-40b8-88d7-cfc8f3627584 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] CPU controller missing on host. {{(pid=75165) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 00:11:27 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-d2353baf-7fbd-40b8-88d7-cfc8f3627584 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75165) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 00:11:27 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-d2353baf-7fbd-40b8-88d7-cfc8f3627584 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] CPU controller found on host. {{(pid=75165) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 00:11:27 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-d2353baf-7fbd-40b8-88d7-cfc8f3627584 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75165) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 00:11:27 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-d2353baf-7fbd-40b8-88d7-cfc8f3627584 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T00:03:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T00:03:24Z,direct_url=<?>,disk_format='qcow2',id=bff0d8a1-739e-4c4d-9efa-b73ba7b76d01,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e56bbf444fd34c348475c73673611447',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T00:03:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 00:11:27 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-d2353baf-7fbd-40b8-88d7-cfc8f3627584 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Flavor limits 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 00:11:27 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-d2353baf-7fbd-40b8-88d7-cfc8f3627584 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Image limits 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 00:11:27 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-d2353baf-7fbd-40b8-88d7-cfc8f3627584 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Flavor pref 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 00:11:27 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-d2353baf-7fbd-40b8-88d7-cfc8f3627584 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Image pref 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 00:11:27 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-d2353baf-7fbd-40b8-88d7-cfc8f3627584 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 00:11:27 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-d2353baf-7fbd-40b8-88d7-cfc8f3627584 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 00:11:27 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-d2353baf-7fbd-40b8-88d7-cfc8f3627584 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75165) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 00:11:27 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-d2353baf-7fbd-40b8-88d7-cfc8f3627584 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Got 1 possible topologies {{(pid=75165) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 00:11:27 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-d2353baf-7fbd-40b8-88d7-cfc8f3627584 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 00:11:27 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-d2353baf-7fbd-40b8-88d7-cfc8f3627584 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 00:11:27 user nova-compute[75165]: DEBUG nova.objects.instance [None req-d2353baf-7fbd-40b8-88d7-cfc8f3627584 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Lazy-loading 'vcpu_model' on Instance uuid 26a0b493-bb47-466e-95d5-945fc3849fa5 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:11:27 user nova-compute[75165]: DEBUG nova.objects.base [None req-d2353baf-7fbd-40b8-88d7-cfc8f3627584 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Object Instance<26a0b493-bb47-466e-95d5-945fc3849fa5> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75165) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 00:11:27 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2353baf-7fbd-40b8-88d7-cfc8f3627584 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] Calling os-brick to attach iSCSI Volume {{(pid=75165) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 00:11:27 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2353baf-7fbd-40b8-88d7-cfc8f3627584 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8bf8160e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IgNFaCRv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:11:27 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-d2353baf-7fbd-40b8-88d7-cfc8f3627584 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:11:27 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-d2353baf-7fbd-40b8-88d7-cfc8f3627584 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:11:27 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-d2353baf-7fbd-40b8-88d7-cfc8f3627584 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:11:27 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-d2353baf-7fbd-40b8-88d7-cfc8f3627584 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:11:27 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-d2353baf-7fbd-40b8-88d7-cfc8f3627584 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:11:27 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-d2353baf-7fbd-40b8-88d7-cfc8f3627584 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:11:27 user nova-compute[75165]: INFO os_brick.initiator.connectors.iscsi [None req-d2353baf-7fbd-40b8-88d7-cfc8f3627584 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 00:11:27 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792 -p 172.16.0.220:3260 {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:27 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792 -p 172.16.0.220:3260" returned: 0 in 0.021s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:27 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c3033c5-0937-4a79-90bc-4e9a8884a8bb]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = IgNFaCRv\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:11:27 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2353baf-7fbd-40b8-88d7-cfc8f3627584 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Oct 26 00:11:27 user nova-compute[75165]: node.name = iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792
Oct 26 00:11:27 user nova-compute[75165]: node.tpgt = -1
Oct 26 00:11:27 user nova-compute[75165]: node.startup = automatic
Oct 26 00:11:27 user nova-compute[75165]: node.leading_login = No
Oct 26 00:11:27 user nova-compute[75165]: iface.iscsi_ifacename = default
Oct 26 00:11:27 user nova-compute[75165]: iface.net_ifacename = <empty>
Oct 26 00:11:27 user nova-compute[75165]: iface.ipaddress = <empty>
Oct 26 00:11:27 user nova-compute[75165]: iface.prefix_len = 0
Oct 26 00:11:27 user nova-compute[75165]: iface.hwaddress = <empty>
Oct 26 00:11:27 user nova-compute[75165]: iface.transport_name = tcp
Oct 26 00:11:27 user nova-compute[75165]: iface.initiatorname = <empty>
Oct 26 00:11:27 user nova-compute[75165]: iface.state = <empty>
Oct 26 00:11:27 user nova-compute[75165]: iface.vlan_id = 0
Oct 26 00:11:27 user nova-compute[75165]: iface.vlan_priority = 0
Oct 26 00:11:27 user nova-compute[75165]: iface.vlan_state = <empty>
Oct 26 00:11:27 user nova-compute[75165]: iface.iface_num = 0
Oct 26 00:11:27 user nova-compute[75165]: iface.mtu = 0
Oct 26 00:11:27 user nova-compute[75165]: iface.port = 0
Oct 26 00:11:27 user nova-compute[75165]: iface.bootproto = <empty>
Oct 26 00:11:27 user nova-compute[75165]: iface.subnet_mask = <empty>
Oct 26 00:11:27 user nova-compute[75165]: iface.gateway = <empty>
Oct 26 00:11:27 user nova-compute[75165]: iface.dhcp_alt_client_id_state = <empty>
Oct 26 00:11:27 user nova-compute[75165]: iface.dhcp_alt_client_id = <empty>
Oct 26 00:11:27 user nova-compute[75165]: iface.dhcp_dns = <empty>
Oct 26 00:11:27 user nova-compute[75165]: iface.dhcp_learn_iqn = <empty>
Oct 26 00:11:27 user nova-compute[75165]: iface.dhcp_req_vendor_id_state = <empty>
Oct 26 00:11:27 user nova-compute[75165]: iface.dhcp_vendor_id_state = <empty>
Oct 26 00:11:27 user nova-compute[75165]: iface.dhcp_vendor_id = <empty>
Oct 26 00:11:27 user nova-compute[75165]: iface.dhcp_slp_da = <empty>
Oct 26 00:11:27 user nova-compute[75165]: iface.fragmentation = <empty>
Oct 26 00:11:27 user nova-compute[75165]: iface.gratuitous_arp = <empty>
Oct 26 00:11:27 user nova-compute[75165]: iface.incoming_forwarding = <empty>
Oct 26 00:11:27 user nova-compute[75165]: iface.tos_state = <empty>
Oct 26 00:11:27 user nova-compute[75165]: iface.tos = 0
Oct 26 00:11:27 user nova-compute[75165]: iface.ttl = 0
Oct 26 00:11:27 user nova-compute[75165]: iface.delayed_ack = <empty>
Oct 26 00:11:27 user nova-compute[75165]: iface.tcp_nagle = <empty>
Oct 26 00:11:27 user nova-compute[75165]: iface.tcp_wsf_state = <empty>
Oct 26 00:11:27 user nova-compute[75165]: iface.tcp_wsf = 0
Oct 26 00:11:27 user nova-compute[75165]: iface.tcp_timer_scale = 0
Oct 26 00:11:27 user nova-compute[75165]: iface.tcp_timestamp = <empty>
Oct 26 00:11:27 user nova-compute[75165]: iface.redirect = <empty>
Oct 26 00:11:27 user nova-compute[75165]: iface.def_task_mgmt_timeout = 0
Oct 26 00:11:27 user nova-compute[75165]: iface.header_digest = <empty>
Oct 26 00:11:27 user nova-compute[75165]: iface.data_digest = <empty>
Oct 26 00:11:27 user nova-compute[75165]: iface.immediate_data = <empty>
Oct 26 00:11:27 user nova-compute[75165]: iface.initial_r2t = <empty>
Oct 26 00:11:27 user nova-compute[75165]: iface.data_seq_inorder = <empty>
Oct 26 00:11:27 user nova-compute[75165]: iface.data_pdu_inorder = <empty>
Oct 26 00:11:27 user nova-compute[75165]: iface.erl = 0
Oct 26 00:11:27 user nova-compute[75165]: iface.max_receive_data_len = 0
Oct 26 00:11:27 user nova-compute[75165]: iface.first_burst_len = 0
Oct 26 00:11:27 user nova-compute[75165]: iface.max_outstanding_r2t = 0
Oct 26 00:11:27 user nova-compute[75165]: iface.max_burst_len = 0
Oct 26 00:11:27 user nova-compute[75165]: iface.chap_auth = <empty>
Oct 26 00:11:27 user nova-compute[75165]: iface.bidi_chap = <empty>
Oct 26 00:11:27 user nova-compute[75165]: iface.strict_login_compliance = <empty>
Oct 26 00:11:27 user nova-compute[75165]: iface.discovery_auth = <empty>
Oct 26 00:11:27 user nova-compute[75165]: iface.discovery_logout = <empty>
Oct 26 00:11:27 user nova-compute[75165]: node.discovery_address = <empty>
Oct 26 00:11:27 user nova-compute[75165]: node.discovery_port = 0
Oct 26 00:11:27 user nova-compute[75165]: node.discovery_type = static
Oct 26 00:11:27 user nova-compute[75165]: node.session.initial_cmdsn = 0
Oct 26 00:11:27 user nova-compute[75165]: node.session.initial_login_retry_max = 8
Oct 26 00:11:27 user nova-compute[75165]: node.session.xmit_thread_priority = -20
Oct 26 00:11:27 user nova-compute[75165]: node.session.cmds_max = 128
Oct 26 00:11:27 user nova-compute[75165]: node.session.queue_depth = 32
Oct 26 00:11:27 user nova-compute[75165]: node.session.nr_sessions = 1
Oct 26 00:11:27 user nova-compute[75165]: node.session.auth.authmethod = CHAP
Oct 26 00:11:27 user nova-compute[75165]: node.session.auth.username = IgNFaCRv
Oct 26 00:11:27 user nova-compute[75165]: node.session.auth.password = ***
Oct 26 00:11:27 user nova-compute[75165]: node.session.auth.username_in = <empty>
Oct 26 00:11:27 user nova-compute[75165]: node.session.auth.password_in = <empty>
Oct 26 00:11:27 user nova-compute[75165]: node.session.auth.chap_algs = MD5
Oct 26 00:11:27 user nova-compute[75165]: node.session.timeo.replacement_timeout = 120
Oct 26 00:11:27 user nova-compute[75165]: node.session.err_timeo.abort_timeout = 15
Oct 26 00:11:27 user nova-compute[75165]: node.session.err_timeo.lu_reset_timeout = 30
Oct 26 00:11:27 user nova-compute[75165]: node.session.err_timeo.tgt_reset_timeout = 30
Oct 26 00:11:27 user nova-compute[75165]: node.session.err_timeo.host_reset_timeout = 60
Oct 26 00:11:27 user nova-compute[75165]: node.session.iscsi.FastAbort = Yes
Oct 26 00:11:27 user nova-compute[75165]: node.session.iscsi.InitialR2T = No
Oct 26 00:11:27 user nova-compute[75165]: node.session.iscsi.ImmediateData = Yes
Oct 26 00:11:27 user nova-compute[75165]: node.session.iscsi.FirstBurstLength = 262144
Oct 26 00:11:27 user nova-compute[75165]: node.session.iscsi.MaxBurstLength = 16776192
Oct 26 00:11:27 user nova-compute[75165]: node.session.iscsi.DefaultTime2Retain = 0
Oct 26 00:11:27 user nova-compute[75165]: node.session.iscsi.DefaultTime2Wait = 2
Oct 26 00:11:27 user nova-compute[75165]: node.session.iscsi.MaxConnections = 1
Oct 26 00:11:27 user nova-compute[75165]: node.session.iscsi.MaxOutstandingR2T = 1
Oct 26 00:11:27 user nova-compute[75165]: node.session.iscsi.ERL = 0
Oct 26 00:11:27 user nova-compute[75165]: node.session.scan = manual
Oct 26 00:11:27 user nova-compute[75165]: node.session.reopen_max = 0
Oct 26 00:11:27 user nova-compute[75165]: node.conn[0].address = 172.16.0.220
Oct 26 00:11:27 user nova-compute[75165]: node.conn[0].port = 3260
Oct 26 00:11:27 user nova-compute[75165]: node.conn[0].startup = manual
Oct 26 00:11:27 user nova-compute[75165]: node.conn[0].tcp.window_size = 524288
Oct 26 00:11:27 user nova-compute[75165]: node.conn[0].tcp.type_of_service = 0
Oct 26 00:11:27 user nova-compute[75165]: node.conn[0].timeo.logout_timeout = 15
Oct 26 00:11:27 user nova-compute[75165]: node.conn[0].timeo.login_timeout = 15
Oct 26 00:11:27 user nova-compute[75165]: node.conn[0].timeo.auth_timeout = 45
Oct 26 00:11:27 user nova-compute[75165]: node.conn[0].timeo.noop_out_interval = 5
Oct 26 00:11:27 user nova-compute[75165]: node.conn[0].timeo.noop_out_timeout = 5
Oct 26 00:11:27 user nova-compute[75165]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Oct 26 00:11:27 user nova-compute[75165]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Oct 26 00:11:27 user nova-compute[75165]: node.conn[0].iscsi.HeaderDigest = None
Oct 26 00:11:27 user nova-compute[75165]: node.conn[0].iscsi.DataDigest = None
Oct 26 00:11:27 user nova-compute[75165]: node.conn[0].iscsi.IFMarker = No
Oct 26 00:11:27 user nova-compute[75165]: node.conn[0].iscsi.OFMarker = No
Oct 26 00:11:27 user nova-compute[75165]: # END RECORD
Oct 26 00:11:27 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:11:27 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:27 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:27 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8855ace-ba37-47d4-8fe2-f226b8d2c695]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:11:27 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2353baf-7fbd-40b8-88d7-cfc8f3627584 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:11:27 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:27 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:27 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b3b0c2e-15a7-427d-b401-c9f253095bc4]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:11:27 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2353baf-7fbd-40b8-88d7-cfc8f3627584 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:11:27 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IgNFaCRv {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:27 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IgNFaCRv" returned: 0 in 0.019s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:27 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d89ae24-a6d1-4425-90e1-d3f63dc6d9e3]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:11:27 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2353baf-7fbd-40b8-88d7-cfc8f3627584 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IgNFaCRv'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:11:27 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:27 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:27 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[009c93b9-b54a-49c3-8b4b-5266ecec09e5]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:11:27 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2353baf-7fbd-40b8-88d7-cfc8f3627584 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:11:27 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:27 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:27 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[4659dd87-cbc4-414a-af7d-3b91f7739092]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f25f6e6a-9711-4455-82e8-c56648a08508 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:083f264a-3f29-48b4-9935-a73f4234e6d5 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff01f329-6dda-43b6-8da5-6a5c48fad211 (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:11:27 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2353baf-7fbd-40b8-88d7-cfc8f3627584 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792 (non-flash)
Oct 26 00:11:27 user nova-compute[75165]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f25f6e6a-9711-4455-82e8-c56648a08508 (non-flash)
Oct 26 00:11:27 user nova-compute[75165]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:083f264a-3f29-48b4-9935-a73f4234e6d5 (non-flash)
Oct 26 00:11:27 user nova-compute[75165]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff01f329-6dda-43b6-8da5-6a5c48fad211 (non-flash)
Oct 26 00:11:27 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:11:27 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2353baf-7fbd-40b8-88d7-cfc8f3627584 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792 (non-flash)
Oct 26 00:11:27 user nova-compute[75165]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f25f6e6a-9711-4455-82e8-c56648a08508 (non-flash)
Oct 26 00:11:27 user nova-compute[75165]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:083f264a-3f29-48b4-9935-a73f4234e6d5 (non-flash)
Oct 26 00:11:27 user nova-compute[75165]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff01f329-6dda-43b6-8da5-6a5c48fad211 (non-flash)
Oct 26 00:11:27 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:11:27 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-d2353baf-7fbd-40b8-88d7-cfc8f3627584 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.166s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:11:27 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2353baf-7fbd-40b8-88d7-cfc8f3627584 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Connected to 172.16.0.220:3260 {{(pid=75165) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 00:11:27 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-d2353baf-7fbd-40b8-88d7-cfc8f3627584 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] HCTL ('33', '0', '0', 0) found on session 11 with lun 0 {{(pid=75165) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 00:11:27 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-d2353baf-7fbd-40b8-88d7-cfc8f3627584 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=75165) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 00:11:27 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:27 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:27 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[269f99b7-d810-4416-9d8e-2af104829cfd]: (4, ('0 0 0', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:11:27 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-d2353baf-7fbd-40b8-88d7-cfc8f3627584 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Searching for a device in session 11 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=75165) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 00:11:27 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2353baf-7fbd-40b8-88d7-cfc8f3627584 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IgNFaCRv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75165) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 00:11:27 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-d2353baf-7fbd-40b8-88d7-cfc8f3627584 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.198s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:11:27 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2353baf-7fbd-40b8-88d7-cfc8f3627584 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] <== connect_volume: return (200ms) {'type': 'block', 'scsi_wwn': '23965336664653662', 'path': '/dev/sdb'} {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:11:27 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2353baf-7fbd-40b8-88d7-cfc8f3627584 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23965336664653662', 'path': '/dev/sdb'} {{(pid=75165) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 00:11:27 user nova-compute[75165]: DEBUG nova.objects.instance [None req-a64d9ade-7c26-4e00-b44d-dfae00d8b0f5 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] Lazy-loading 'flavor' on Instance uuid 45625147-ff69-496a-a41e-e55f818a020a {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:11:27 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-d2353baf-7fbd-40b8-88d7-cfc8f3627584 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:07:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-609329296',display_name='tempest-ServerStableDeviceRescueTest-server-609329296',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-609329296',id=6,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC4BNQ+GaWhIdYY5+kuVMESGWyvIRQoK5o0tz+YWgwiyxZJkfUowNPNzbMJ3GImV/y2wwOtRmsApdRZKOXSoI+VOZ3WRPGRkXXPlFnBMVzrbGW9ERsWeijK3p6uBV3K5Jg==',key_name='tempest-keypair-627775438',keypairs=<?>,launch_index=0,launched_at=2023-10-26T00:07:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9cbae16d09ed4474bb6653f08165a4e5',ramdisk_id='',reservation_id='r-y8rfmg08',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1585397509',owner_user_name='tempest-ServerStableDeviceRescueTest-1585397509-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T00:09:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7ac761f144034256baf6a2372a7b685c',uuid=26a0b493-bb47-466e-95d5-945fc3849fa5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1d6d497c-7382-4dff-b136-d1220b05a838", "address": "fa:16:3e:d3:eb:fb", "network": {"id": "08c51c53-4819-493e-b4eb-df5d6024d43d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1633769998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1633769998-network", "vif_mac": "fa:16:3e:d3:eb:fb"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9cbae16d09ed4474bb6653f08165a4e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d6d497c-73", "ovs_interfaceid": "1d6d497c-7382-4dff-b136-d1220b05a838", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75165) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 00:11:27 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-d2353baf-7fbd-40b8-88d7-cfc8f3627584 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Converting VIF {"id": "1d6d497c-7382-4dff-b136-d1220b05a838", "address": "fa:16:3e:d3:eb:fb", "network": {"id": "08c51c53-4819-493e-b4eb-df5d6024d43d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1633769998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1633769998-network", "vif_mac": "fa:16:3e:d3:eb:fb"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9cbae16d09ed4474bb6653f08165a4e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d6d497c-73", "ovs_interfaceid": "1d6d497c-7382-4dff-b136-d1220b05a838", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:11:27 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-d2353baf-7fbd-40b8-88d7-cfc8f3627584 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d3:eb:fb,bridge_name='br-int',has_traffic_filtering=True,id=1d6d497c-7382-4dff-b136-d1220b05a838,network=Network(08c51c53-4819-493e-b4eb-df5d6024d43d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d6d497c-73') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:11:27 user nova-compute[75165]: DEBUG nova.objects.instance [None req-d2353baf-7fbd-40b8-88d7-cfc8f3627584 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Lazy-loading 'pci_devices' on Instance uuid 26a0b493-bb47-466e-95d5-945fc3849fa5 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:11:28 user nova-compute[75165]: DEBUG nova.objects.base [None req-d2353baf-7fbd-40b8-88d7-cfc8f3627584 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Object Instance<26a0b493-bb47-466e-95d5-945fc3849fa5> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75165) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 00:11:28 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-d2353baf-7fbd-40b8-88d7-cfc8f3627584 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] End _get_guest_xml xml=<domain type="kvm">
Oct 26 00:11:28 user nova-compute[75165]:   <uuid>26a0b493-bb47-466e-95d5-945fc3849fa5</uuid>
Oct 26 00:11:28 user nova-compute[75165]:   <name>instance-00000006</name>
Oct 26 00:11:28 user nova-compute[75165]:   <memory>524288</memory>
Oct 26 00:11:28 user nova-compute[75165]:   <vcpu>1</vcpu>
Oct 26 00:11:28 user nova-compute[75165]:   <metadata>
Oct 26 00:11:28 user nova-compute[75165]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 00:11:28 user nova-compute[75165]:       <nova:package version="0.0.0"/>
Oct 26 00:11:28 user nova-compute[75165]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-609329296</nova:name>
Oct 26 00:11:28 user nova-compute[75165]:       <nova:creationTime>2023-10-26 00:11:27</nova:creationTime>
Oct 26 00:11:28 user nova-compute[75165]:       <nova:flavor name="m1.tiny">
Oct 26 00:11:28 user nova-compute[75165]:         <nova:memory>512</nova:memory>
Oct 26 00:11:28 user nova-compute[75165]:         <nova:disk>1</nova:disk>
Oct 26 00:11:28 user nova-compute[75165]:         <nova:swap>0</nova:swap>
Oct 26 00:11:28 user nova-compute[75165]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 00:11:28 user nova-compute[75165]:         <nova:vcpus>1</nova:vcpus>
Oct 26 00:11:28 user nova-compute[75165]:       </nova:flavor>
Oct 26 00:11:28 user nova-compute[75165]:       <nova:owner>
Oct 26 00:11:28 user nova-compute[75165]:         <nova:user uuid="7ac761f144034256baf6a2372a7b685c">tempest-ServerStableDeviceRescueTest-1585397509-project-member</nova:user>
Oct 26 00:11:28 user nova-compute[75165]:         <nova:project uuid="9cbae16d09ed4474bb6653f08165a4e5">tempest-ServerStableDeviceRescueTest-1585397509</nova:project>
Oct 26 00:11:28 user nova-compute[75165]:       </nova:owner>
Oct 26 00:11:28 user nova-compute[75165]:       <nova:root type="image" uuid="bff0d8a1-739e-4c4d-9efa-b73ba7b76d01"/>
Oct 26 00:11:28 user nova-compute[75165]:       <nova:ports>
Oct 26 00:11:28 user nova-compute[75165]:         <nova:port uuid="1d6d497c-7382-4dff-b136-d1220b05a838">
Oct 26 00:11:28 user nova-compute[75165]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 26 00:11:28 user nova-compute[75165]:         </nova:port>
Oct 26 00:11:28 user nova-compute[75165]:       </nova:ports>
Oct 26 00:11:28 user nova-compute[75165]:     </nova:instance>
Oct 26 00:11:28 user nova-compute[75165]:   </metadata>
Oct 26 00:11:28 user nova-compute[75165]:   <sysinfo type="smbios">
Oct 26 00:11:28 user nova-compute[75165]:     <system>
Oct 26 00:11:28 user nova-compute[75165]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 00:11:28 user nova-compute[75165]:       <entry name="product">OpenStack Nova</entry>
Oct 26 00:11:28 user nova-compute[75165]:       <entry name="version">0.0.0</entry>
Oct 26 00:11:28 user nova-compute[75165]:       <entry name="serial">26a0b493-bb47-466e-95d5-945fc3849fa5</entry>
Oct 26 00:11:28 user nova-compute[75165]:       <entry name="uuid">26a0b493-bb47-466e-95d5-945fc3849fa5</entry>
Oct 26 00:11:28 user nova-compute[75165]:       <entry name="family">Virtual Machine</entry>
Oct 26 00:11:28 user nova-compute[75165]:     </system>
Oct 26 00:11:28 user nova-compute[75165]:   </sysinfo>
Oct 26 00:11:28 user nova-compute[75165]:   <os>
Oct 26 00:11:28 user nova-compute[75165]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 00:11:28 user nova-compute[75165]:     <smbios mode="sysinfo"/>
Oct 26 00:11:28 user nova-compute[75165]:   </os>
Oct 26 00:11:28 user nova-compute[75165]:   <features>
Oct 26 00:11:28 user nova-compute[75165]:     <acpi/>
Oct 26 00:11:28 user nova-compute[75165]:     <apic/>
Oct 26 00:11:28 user nova-compute[75165]:     <vmcoreinfo/>
Oct 26 00:11:28 user nova-compute[75165]:   </features>
Oct 26 00:11:28 user nova-compute[75165]:   <clock offset="utc">
Oct 26 00:11:28 user nova-compute[75165]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 00:11:28 user nova-compute[75165]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 00:11:28 user nova-compute[75165]:     <timer name="hpet" present="no"/>
Oct 26 00:11:28 user nova-compute[75165]:   </clock>
Oct 26 00:11:28 user nova-compute[75165]:   <cpu mode="custom" match="exact">
Oct 26 00:11:28 user nova-compute[75165]:     <model>Nehalem</model>
Oct 26 00:11:28 user nova-compute[75165]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 00:11:28 user nova-compute[75165]:   </cpu>
Oct 26 00:11:28 user nova-compute[75165]:   <devices>
Oct 26 00:11:28 user nova-compute[75165]:     <disk type="file" device="disk">
Oct 26 00:11:28 user nova-compute[75165]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 00:11:28 user nova-compute[75165]:       <source file="/opt/stack/data/nova/instances/26a0b493-bb47-466e-95d5-945fc3849fa5/disk"/>
Oct 26 00:11:28 user nova-compute[75165]:       <target dev="vda" bus="virtio"/>
Oct 26 00:11:28 user nova-compute[75165]:     </disk>
Oct 26 00:11:28 user nova-compute[75165]:     <disk type="block" device="disk">
Oct 26 00:11:28 user nova-compute[75165]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 00:11:28 user nova-compute[75165]:       <source dev="/dev/sdb"/>
Oct 26 00:11:28 user nova-compute[75165]:       <target dev="vdb" bus="virtio"/>
Oct 26 00:11:28 user nova-compute[75165]:       <serial>ce7241dd-04dd-4a96-b8a6-21fb4e678792</serial>
Oct 26 00:11:28 user nova-compute[75165]:     </disk>
Oct 26 00:11:28 user nova-compute[75165]:     <disk type="file" device="disk">
Oct 26 00:11:28 user nova-compute[75165]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 00:11:28 user nova-compute[75165]:       <source file="/opt/stack/data/nova/instances/26a0b493-bb47-466e-95d5-945fc3849fa5/disk.rescue"/>
Oct 26 00:11:28 user nova-compute[75165]:       <target dev="vdc" bus="virtio"/>
Oct 26 00:11:28 user nova-compute[75165]:       <boot order="1"/>
Oct 26 00:11:28 user nova-compute[75165]:     </disk>
Oct 26 00:11:28 user nova-compute[75165]:     <interface type="ethernet">
Oct 26 00:11:28 user nova-compute[75165]:       <mac address="fa:16:3e:d3:eb:fb"/>
Oct 26 00:11:28 user nova-compute[75165]:       <model type="virtio"/>
Oct 26 00:11:28 user nova-compute[75165]:       <mtu size="1442"/>
Oct 26 00:11:28 user nova-compute[75165]:       <target dev="tap1d6d497c-73"/>
Oct 26 00:11:28 user nova-compute[75165]:     </interface>
Oct 26 00:11:28 user nova-compute[75165]:     <serial type="pty">
Oct 26 00:11:28 user nova-compute[75165]:       <log file="/opt/stack/data/nova/instances/26a0b493-bb47-466e-95d5-945fc3849fa5/console.log" append="off"/>
Oct 26 00:11:28 user nova-compute[75165]:     </serial>
Oct 26 00:11:28 user nova-compute[75165]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 00:11:28 user nova-compute[75165]:     <video>
Oct 26 00:11:28 user nova-compute[75165]:       <model type="virtio"/>
Oct 26 00:11:28 user nova-compute[75165]:     </video>
Oct 26 00:11:28 user nova-compute[75165]:     <rng model="virtio">
Oct 26 00:11:28 user nova-compute[75165]:       <backend model="random">/dev/urandom</backend>
Oct 26 00:11:28 user nova-compute[75165]:     </rng>
Oct 26 00:11:28 user nova-compute[75165]:     <controller type="usb" index="0" model="none"/>
Oct 26 00:11:28 user nova-compute[75165]:     <memballoon model="virtio">
Oct 26 00:11:28 user nova-compute[75165]:       <stats period="10"/>
Oct 26 00:11:28 user nova-compute[75165]:     </memballoon>
Oct 26 00:11:28 user nova-compute[75165]:   </devices>
Oct 26 00:11:28 user nova-compute[75165]: </domain>
Oct 26 00:11:28 user nova-compute[75165]:  {{(pid=75165) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 00:11:28 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-a64d9ade-7c26-4e00-b44d-dfae00d8b0f5 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] Lock "45625147-ff69-496a-a41e-e55f818a020a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.932s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:11:28 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] Instance destroyed successfully.
Oct 26 00:11:28 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-d2353baf-7fbd-40b8-88d7-cfc8f3627584 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] No BDM found with device name vda, not building metadata. {{(pid=75165) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 00:11:28 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-d2353baf-7fbd-40b8-88d7-cfc8f3627584 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75165) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 00:11:28 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-d2353baf-7fbd-40b8-88d7-cfc8f3627584 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75165) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 00:11:28 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-d2353baf-7fbd-40b8-88d7-cfc8f3627584 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] No VIF found with MAC fa:16:3e:d3:eb:fb, not building metadata {{(pid=75165) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 00:11:28 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:29 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:29 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:29 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:29 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:29 user nova-compute[75165]: DEBUG nova.compute.manager [req-0189a0fb-b048-4b71-87b7-42aeeda41472 req-9185e750-4eaf-4eed-8f10-52fae343b921 service nova] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] Received event network-vif-plugged-1d6d497c-7382-4dff-b136-d1220b05a838 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:11:29 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-0189a0fb-b048-4b71-87b7-42aeeda41472 req-9185e750-4eaf-4eed-8f10-52fae343b921 service nova] Acquiring lock "26a0b493-bb47-466e-95d5-945fc3849fa5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:11:29 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-0189a0fb-b048-4b71-87b7-42aeeda41472 req-9185e750-4eaf-4eed-8f10-52fae343b921 service nova] Lock "26a0b493-bb47-466e-95d5-945fc3849fa5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:11:29 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-0189a0fb-b048-4b71-87b7-42aeeda41472 req-9185e750-4eaf-4eed-8f10-52fae343b921 service nova] Lock "26a0b493-bb47-466e-95d5-945fc3849fa5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:11:29 user nova-compute[75165]: DEBUG nova.compute.manager [req-0189a0fb-b048-4b71-87b7-42aeeda41472 req-9185e750-4eaf-4eed-8f10-52fae343b921 service nova] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] No waiting events found dispatching network-vif-plugged-1d6d497c-7382-4dff-b136-d1220b05a838 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:11:29 user nova-compute[75165]: WARNING nova.compute.manager [req-0189a0fb-b048-4b71-87b7-42aeeda41472 req-9185e750-4eaf-4eed-8f10-52fae343b921 service nova] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] Received unexpected event network-vif-plugged-1d6d497c-7382-4dff-b136-d1220b05a838 for instance with vm_state active and task_state rescuing.
Oct 26 00:11:30 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:30 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:30 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:30 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:30 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3e2284f-7d0e-464b-9ede-cf52e5ebe9a0 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] Calling os-brick to attach iSCSI Volume {{(pid=75165) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 00:11:30 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3e2284f-7d0e-464b-9ede-cf52e5ebe9a0 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8bf8160e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AokCQquF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:11:30 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-e3e2284f-7d0e-464b-9ede-cf52e5ebe9a0 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:11:30 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-e3e2284f-7d0e-464b-9ede-cf52e5ebe9a0 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:11:30 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-e3e2284f-7d0e-464b-9ede-cf52e5ebe9a0 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:11:30 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-e3e2284f-7d0e-464b-9ede-cf52e5ebe9a0 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:11:30 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-e3e2284f-7d0e-464b-9ede-cf52e5ebe9a0 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:11:30 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-e3e2284f-7d0e-464b-9ede-cf52e5ebe9a0 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:11:30 user nova-compute[75165]: INFO os_brick.initiator.connectors.iscsi [None req-e3e2284f-7d0e-464b-9ede-cf52e5ebe9a0 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 00:11:30 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b -p 172.16.0.220:3260 {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:30 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:30 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bc5fb4c-588e-4f00-b2d8-2f4cfc038c85]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:11:30 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3e2284f-7d0e-464b-9ede-cf52e5ebe9a0 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 00:11:30 user nova-compute[75165]:  {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:11:30 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b -p 172.16.0.220:3260 --interface default --op new {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:30 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:30 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[8473fd9d-3938-442c-a6a4-490524758d30]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b] added\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:11:30 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3e2284f-7d0e-464b-9ede-cf52e5ebe9a0 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b] added
Oct 26 00:11:30 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:11:30 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:30 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:30 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab1fa2bb-9bf1-4ad2-b4b5-0aa537c8c77a]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:11:30 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3e2284f-7d0e-464b-9ede-cf52e5ebe9a0 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:11:30 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:30 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:30 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e899522-b808-4237-acde-d1f07b20f22b]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:11:30 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3e2284f-7d0e-464b-9ede-cf52e5ebe9a0 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:11:30 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AokCQquF {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:30 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AokCQquF" returned: 0 in 0.027s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:30 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[50295d88-8422-4e93-8fb7-0b1276a3c637]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:11:30 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3e2284f-7d0e-464b-9ede-cf52e5ebe9a0 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AokCQquF'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:11:30 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:30 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:30 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d754c01-211f-43b3-aa04-208d2d93f4ee]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:11:30 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3e2284f-7d0e-464b-9ede-cf52e5ebe9a0 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:11:30 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:30 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:30 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a2d985b-2c97-4af0-971e-cc4e98f906b4]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f25f6e6a-9711-4455-82e8-c56648a08508 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:083f264a-3f29-48b4-9935-a73f4234e6d5 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff01f329-6dda-43b6-8da5-6a5c48fad211 (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:11:30 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3e2284f-7d0e-464b-9ede-cf52e5ebe9a0 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792 (non-flash)
Oct 26 00:11:30 user nova-compute[75165]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f25f6e6a-9711-4455-82e8-c56648a08508 (non-flash)
Oct 26 00:11:30 user nova-compute[75165]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:083f264a-3f29-48b4-9935-a73f4234e6d5 (non-flash)
Oct 26 00:11:30 user nova-compute[75165]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff01f329-6dda-43b6-8da5-6a5c48fad211 (non-flash)
Oct 26 00:11:30 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:11:30 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3e2284f-7d0e-464b-9ede-cf52e5ebe9a0 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792 (non-flash)
Oct 26 00:11:30 user nova-compute[75165]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f25f6e6a-9711-4455-82e8-c56648a08508 (non-flash)
Oct 26 00:11:30 user nova-compute[75165]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:083f264a-3f29-48b4-9935-a73f4234e6d5 (non-flash)
Oct 26 00:11:30 user nova-compute[75165]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff01f329-6dda-43b6-8da5-6a5c48fad211 (non-flash)
Oct 26 00:11:30 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:11:30 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b -p 172.16.0.220:3260 --login {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:31 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b -p 172.16.0.220:3260 --login" returned: 0 in 0.085s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:31 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a46c97f-b68a-44ea-acaf-923d6dfdf765]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:11:31 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3e2284f-7d0e-464b-9ede-cf52e5ebe9a0 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b, portal: 172.16.0.220,3260]
Oct 26 00:11:31 user nova-compute[75165]: Login to [iface: default, target: iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b, portal: 172.16.0.220,3260] successful.
Oct 26 00:11:31 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:11:31 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:31 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:31 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[96070d4a-c66f-4cf7-b487-436c0246a883]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:11:31 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3e2284f-7d0e-464b-9ede-cf52e5ebe9a0 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:11:31 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:31 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:31 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[0649a7c8-6d53-4415-a630-33ec505739c5]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f25f6e6a-9711-4455-82e8-c56648a08508 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:083f264a-3f29-48b4-9935-a73f4234e6d5 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff01f329-6dda-43b6-8da5-6a5c48fad211 (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:11:31 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3e2284f-7d0e-464b-9ede-cf52e5ebe9a0 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792 (non-flash)
Oct 26 00:11:31 user nova-compute[75165]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b (non-flash)
Oct 26 00:11:31 user nova-compute[75165]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f25f6e6a-9711-4455-82e8-c56648a08508 (non-flash)
Oct 26 00:11:31 user nova-compute[75165]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:083f264a-3f29-48b4-9935-a73f4234e6d5 (non-flash)
Oct 26 00:11:31 user nova-compute[75165]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff01f329-6dda-43b6-8da5-6a5c48fad211 (non-flash)
Oct 26 00:11:31 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:11:31 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3e2284f-7d0e-464b-9ede-cf52e5ebe9a0 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792 (non-flash)
Oct 26 00:11:31 user nova-compute[75165]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b (non-flash)
Oct 26 00:11:31 user nova-compute[75165]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f25f6e6a-9711-4455-82e8-c56648a08508 (non-flash)
Oct 26 00:11:31 user nova-compute[75165]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:083f264a-3f29-48b4-9935-a73f4234e6d5 (non-flash)
Oct 26 00:11:31 user nova-compute[75165]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff01f329-6dda-43b6-8da5-6a5c48fad211 (non-flash)
Oct 26 00:11:31 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:11:31 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-e3e2284f-7d0e-464b-9ede-cf52e5ebe9a0 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.358s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:11:31 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3e2284f-7d0e-464b-9ede-cf52e5ebe9a0 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Connected to 172.16.0.220:3260 {{(pid=75165) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 00:11:31 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-e3e2284f-7d0e-464b-9ede-cf52e5ebe9a0 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] HCTL ('36', '-', '-', 0) found on session 12 with lun 0 {{(pid=75165) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 00:11:31 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-e3e2284f-7d0e-464b-9ede-cf52e5ebe9a0 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75165) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 00:11:31 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:31 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.024s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:31 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4907367-c4b7-494a-a60e-2c962aa04a0a]: (4, ('- - 0', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:11:31 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-e3e2284f-7d0e-464b-9ede-cf52e5ebe9a0 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Searching for a device in session 12 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75165) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 00:11:31 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3e2284f-7d0e-464b-9ede-cf52e5ebe9a0 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AokCQquF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75165) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 00:11:31 user nova-compute[75165]: DEBUG nova.compute.manager [req-15e360ef-2f48-4521-b3cf-f907d04c6e95 req-241256eb-0387-4c1a-9409-8bbc03a93ce9 service nova] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] Received event network-vif-plugged-1d6d497c-7382-4dff-b136-d1220b05a838 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:11:31 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-15e360ef-2f48-4521-b3cf-f907d04c6e95 req-241256eb-0387-4c1a-9409-8bbc03a93ce9 service nova] Acquiring lock "26a0b493-bb47-466e-95d5-945fc3849fa5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:11:31 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-15e360ef-2f48-4521-b3cf-f907d04c6e95 req-241256eb-0387-4c1a-9409-8bbc03a93ce9 service nova] Lock "26a0b493-bb47-466e-95d5-945fc3849fa5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:11:31 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-15e360ef-2f48-4521-b3cf-f907d04c6e95 req-241256eb-0387-4c1a-9409-8bbc03a93ce9 service nova] Lock "26a0b493-bb47-466e-95d5-945fc3849fa5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:11:31 user nova-compute[75165]: DEBUG nova.compute.manager [req-15e360ef-2f48-4521-b3cf-f907d04c6e95 req-241256eb-0387-4c1a-9409-8bbc03a93ce9 service nova] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] No waiting events found dispatching network-vif-plugged-1d6d497c-7382-4dff-b136-d1220b05a838 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:11:31 user nova-compute[75165]: WARNING nova.compute.manager [req-15e360ef-2f48-4521-b3cf-f907d04c6e95 req-241256eb-0387-4c1a-9409-8bbc03a93ce9 service nova] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] Received unexpected event network-vif-plugged-1d6d497c-7382-4dff-b136-d1220b05a838 for instance with vm_state active and task_state rescuing.
Oct 26 00:11:32 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-e3e2284f-7d0e-464b-9ede-cf52e5ebe9a0 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.404s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:11:32 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3e2284f-7d0e-464b-9ede-cf52e5ebe9a0 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] <== connect_volume: return (1407ms) {'type': 'block', 'scsi_wwn': '26462656239316661', 'path': '/dev/sde'} {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:11:32 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3e2284f-7d0e-464b-9ede-cf52e5ebe9a0 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26462656239316661', 'path': '/dev/sde'} {{(pid=75165) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 00:11:32 user nova-compute[75165]: DEBUG nova.objects.instance [None req-e3e2284f-7d0e-464b-9ede-cf52e5ebe9a0 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Lazy-loading 'flavor' on Instance uuid 3b153af2-c93b-47d2-ae8c-76cfd44e384c {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:11:32 user nova-compute[75165]: DEBUG nova.virt.libvirt.guest [None req-e3e2284f-7d0e-464b-9ede-cf52e5ebe9a0 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 00:11:32 user nova-compute[75165]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 00:11:32 user nova-compute[75165]:   <source dev="/dev/sde"/>
Oct 26 00:11:32 user nova-compute[75165]:   <target dev="vdb" bus="virtio"/>
Oct 26 00:11:32 user nova-compute[75165]:   <serial>bdb81c18-9a59-4d59-861d-f713e876159b</serial>
Oct 26 00:11:32 user nova-compute[75165]: </disk>
Oct 26 00:11:32 user nova-compute[75165]:  {{(pid=75165) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 00:11:32 user nova-compute[75165]: DEBUG nova.compute.manager [None req-d2353baf-7fbd-40b8-88d7-cfc8f3627584 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] Checking state {{(pid=75165) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 00:11:32 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-e3e2284f-7d0e-464b-9ede-cf52e5ebe9a0 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] No BDM found with device name vda, not building metadata. {{(pid=75165) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 00:11:32 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-e3e2284f-7d0e-464b-9ede-cf52e5ebe9a0 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75165) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 00:11:32 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-e3e2284f-7d0e-464b-9ede-cf52e5ebe9a0 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] No VIF found with MAC fa:16:3e:75:45:79, not building metadata {{(pid=75165) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 00:11:32 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-e3e2284f-7d0e-464b-9ede-cf52e5ebe9a0 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Lock "3b153af2-c93b-47d2-ae8c-76cfd44e384c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 23.627s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:11:33 user nova-compute[75165]: DEBUG nova.compute.manager [req-41d34967-c4d3-4ea3-8468-56f365e0b045 req-504e5af4-8488-4115-b78c-fb7eff17946e service nova] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Received event network-changed-3da752ae-77a3-4bc3-8885-76331bc2d7d8 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:11:33 user nova-compute[75165]: DEBUG nova.compute.manager [req-41d34967-c4d3-4ea3-8468-56f365e0b045 req-504e5af4-8488-4115-b78c-fb7eff17946e service nova] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Refreshing instance network info cache due to event network-changed-3da752ae-77a3-4bc3-8885-76331bc2d7d8. {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 00:11:33 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-41d34967-c4d3-4ea3-8468-56f365e0b045 req-504e5af4-8488-4115-b78c-fb7eff17946e service nova] Acquiring lock "refresh_cache-8d5569ce-1f18-4f37-a340-099ee152d548" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:11:33 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-41d34967-c4d3-4ea3-8468-56f365e0b045 req-504e5af4-8488-4115-b78c-fb7eff17946e service nova] Acquired lock "refresh_cache-8d5569ce-1f18-4f37-a340-099ee152d548" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:11:33 user nova-compute[75165]: DEBUG nova.network.neutron [req-41d34967-c4d3-4ea3-8468-56f365e0b045 req-504e5af4-8488-4115-b78c-fb7eff17946e service nova] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Refreshing network info cache for port 3da752ae-77a3-4bc3-8885-76331bc2d7d8 {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 00:11:33 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-1391af4e-f17d-4343-b3d6-46a1950775f0 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:11:33 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-1391af4e-f17d-4343-b3d6-46a1950775f0 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:11:33 user nova-compute[75165]: DEBUG nova.objects.instance [None req-1391af4e-f17d-4343-b3d6-46a1950775f0 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Lazy-loading 'pci_requests' on Instance uuid 6f9add59-cabe-4965-8fe3-524618550581 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:11:33 user nova-compute[75165]: DEBUG nova.objects.instance [None req-1391af4e-f17d-4343-b3d6-46a1950775f0 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Lazy-loading 'numa_topology' on Instance uuid 6f9add59-cabe-4965-8fe3-524618550581 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:11:33 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-1391af4e-f17d-4343-b3d6-46a1950775f0 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75165) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 00:11:33 user nova-compute[75165]: INFO nova.compute.claims [None req-1391af4e-f17d-4343-b3d6-46a1950775f0 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] [instance: 6f9add59-cabe-4965-8fe3-524618550581] Claim successful on node user
Oct 26 00:11:34 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:34 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-1391af4e-f17d-4343-b3d6-46a1950775f0 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:11:34 user nova-compute[75165]: DEBUG nova.network.neutron [req-41d34967-c4d3-4ea3-8468-56f365e0b045 req-504e5af4-8488-4115-b78c-fb7eff17946e service nova] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Updated VIF entry in instance network info cache for port 3da752ae-77a3-4bc3-8885-76331bc2d7d8. {{(pid=75165) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 00:11:34 user nova-compute[75165]: DEBUG nova.network.neutron [req-41d34967-c4d3-4ea3-8468-56f365e0b045 req-504e5af4-8488-4115-b78c-fb7eff17946e service nova] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Updating instance_info_cache with network_info: [{"id": "3da752ae-77a3-4bc3-8885-76331bc2d7d8", "address": "fa:16:3e:22:af:b4", "network": {"id": "a4a95519-4969-4c53-b078-46dab1ae12ac", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1704712535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f1d0ea8cbf74f10b81a10d3a7a6e716", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3da752ae-77", "ovs_interfaceid": "3da752ae-77a3-4bc3-8885-76331bc2d7d8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b9583014-bb07-4337-97bb-30001c05475f", "address": "fa:16:3e:ca:f8:4e", "network": {"id": "b1b273e9-ac47-4985-9a15-ed6392eea58c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1944708022", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9f1d0ea8cbf74f10b81a10d3a7a6e716", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9583014-bb", "ovs_interfaceid": "b9583014-bb07-4337-97bb-30001c05475f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c51f288f-44b9-476b-9419-22ef8ae5c900", "address": "fa:16:3e:28:cd:e8", "network": {"id": "b1b273e9-ac47-4985-9a15-ed6392eea58c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1944708022", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.239", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9f1d0ea8cbf74f10b81a10d3a7a6e716", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc51f288f-44", "ovs_interfaceid": "c51f288f-44b9-476b-9419-22ef8ae5c900", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c019e949-c6fc-4014-9e42-13ce1eb17786", "address": "fa:16:3e:34:fd:75", "network": {"id": "b1b273e9-ac47-4985-9a15-ed6392eea58c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1944708022", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.220", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9f1d0ea8cbf74f10b81a10d3a7a6e716", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc019e949-c6", "ovs_interfaceid": "c019e949-c6fc-4014-9e42-13ce1eb17786", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9cecd3d6-4945-4a4b-8d06-48b0d7768a17", "address": "fa:16:3e:59:c6:53", "network": {"id": "b1b273e9-ac47-4985-9a15-ed6392eea58c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1944708022", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9f1d0ea8cbf74f10b81a10d3a7a6e716", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cecd3d6-49", "ovs_interfaceid": "9cecd3d6-4945-4a4b-8d06-48b0d7768a17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a04b8134-03e6-45f2-b6d7-3ea6a7deb81c", "address": "fa:16:3e:0a:29:45", "network": {"id": "75761f5b-dd19-4843-8db7-9cef3872583d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1377439333", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9f1d0ea8cbf74f10b81a10d3a7a6e716", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa04b8134-03", "ovs_interfaceid": "a04b8134-03e6-45f2-b6d7-3ea6a7deb81c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "03ee4dbc-d46d-4127-a4e0-d308a1c8beae", "address": "fa:16:3e:5b:46:e6", "network": {"id": "75761f5b-dd19-4843-8db7-9cef3872583d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1377439333", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9f1d0ea8cbf74f10b81a10d3a7a6e716", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03ee4dbc-d4", "ovs_interfaceid": "03ee4dbc-d46d-4127-a4e0-d308a1c8beae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:11:34 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-1391af4e-f17d-4343-b3d6-46a1950775f0 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:11:34 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-41d34967-c4d3-4ea3-8468-56f365e0b045 req-504e5af4-8488-4115-b78c-fb7eff17946e service nova] Releasing lock "refresh_cache-8d5569ce-1f18-4f37-a340-099ee152d548" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:11:34 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-1391af4e-f17d-4343-b3d6-46a1950775f0 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.700s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:11:34 user nova-compute[75165]: INFO nova.network.neutron [None req-1391af4e-f17d-4343-b3d6-46a1950775f0 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] [instance: 6f9add59-cabe-4965-8fe3-524618550581] Updating port 50bf388e-b8ff-4924-9633-7e97d083a361 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Oct 26 00:11:35 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-1391af4e-f17d-4343-b3d6-46a1950775f0 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Acquiring lock "refresh_cache-6f9add59-cabe-4965-8fe3-524618550581" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:11:35 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-1391af4e-f17d-4343-b3d6-46a1950775f0 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Acquired lock "refresh_cache-6f9add59-cabe-4965-8fe3-524618550581" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:11:35 user nova-compute[75165]: DEBUG nova.network.neutron [None req-1391af4e-f17d-4343-b3d6-46a1950775f0 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] [instance: 6f9add59-cabe-4965-8fe3-524618550581] Building network info cache for instance {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 00:11:35 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:35 user nova-compute[75165]: DEBUG nova.compute.manager [req-608b26f4-bdef-40b3-80d6-15f67be3c0a4 req-529026ad-dcf0-4a56-a3aa-718153fbb4f6 service nova] [instance: 6f9add59-cabe-4965-8fe3-524618550581] Received event network-changed-50bf388e-b8ff-4924-9633-7e97d083a361 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:11:35 user nova-compute[75165]: DEBUG nova.compute.manager [req-608b26f4-bdef-40b3-80d6-15f67be3c0a4 req-529026ad-dcf0-4a56-a3aa-718153fbb4f6 service nova] [instance: 6f9add59-cabe-4965-8fe3-524618550581] Refreshing instance network info cache due to event network-changed-50bf388e-b8ff-4924-9633-7e97d083a361. {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 00:11:35 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-608b26f4-bdef-40b3-80d6-15f67be3c0a4 req-529026ad-dcf0-4a56-a3aa-718153fbb4f6 service nova] Acquiring lock "refresh_cache-6f9add59-cabe-4965-8fe3-524618550581" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:11:35 user nova-compute[75165]: DEBUG nova.compute.manager [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] Stashing vm_state: active {{(pid=75165) _prep_resize /opt/stack/nova/nova/compute/manager.py:5614}}
Oct 26 00:11:35 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:35 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-eca5f738-4e10-4c86-b050-c2dcb595d6fa tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Acquiring lock "8d5569ce-1f18-4f37-a340-099ee152d548" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:11:35 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-eca5f738-4e10-4c86-b050-c2dcb595d6fa tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Lock "8d5569ce-1f18-4f37-a340-099ee152d548" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:11:35 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-eca5f738-4e10-4c86-b050-c2dcb595d6fa tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Acquiring lock "8d5569ce-1f18-4f37-a340-099ee152d548-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:11:35 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-eca5f738-4e10-4c86-b050-c2dcb595d6fa tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Lock "8d5569ce-1f18-4f37-a340-099ee152d548-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:11:35 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-eca5f738-4e10-4c86-b050-c2dcb595d6fa tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Lock "8d5569ce-1f18-4f37-a340-099ee152d548-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:11:35 user nova-compute[75165]: INFO nova.compute.manager [None req-eca5f738-4e10-4c86-b050-c2dcb595d6fa tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Terminating instance
Oct 26 00:11:35 user nova-compute[75165]: DEBUG nova.compute.manager [None req-eca5f738-4e10-4c86-b050-c2dcb595d6fa tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Start destroying the instance on the hypervisor. {{(pid=75165) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 00:11:35 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:11:35 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:11:36 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75165) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 00:11:36 user nova-compute[75165]: INFO nova.compute.claims [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] Claim successful on node user
Oct 26 00:11:36 user nova-compute[75165]: DEBUG nova.network.neutron [None req-1391af4e-f17d-4343-b3d6-46a1950775f0 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] [instance: 6f9add59-cabe-4965-8fe3-524618550581] Updating instance_info_cache with network_info: [{"id": "50bf388e-b8ff-4924-9633-7e97d083a361", "address": "fa:16:3e:16:28:b9", "network": {"id": "f54e2e9f-5c1e-44ca-bd4b-9cf0747b0f72", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-806146051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "920152101768459baa71010b380ea8f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50bf388e-b8", "ovs_interfaceid": "50bf388e-b8ff-4924-9633-7e97d083a361", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:11:36 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:36 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-1391af4e-f17d-4343-b3d6-46a1950775f0 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Releasing lock "refresh_cache-6f9add59-cabe-4965-8fe3-524618550581" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:11:36 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-1391af4e-f17d-4343-b3d6-46a1950775f0 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] [instance: 6f9add59-cabe-4965-8fe3-524618550581] Creating instance directory {{(pid=75165) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 00:11:36 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-1391af4e-f17d-4343-b3d6-46a1950775f0 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] [instance: 6f9add59-cabe-4965-8fe3-524618550581] Creating image(s)
Oct 26 00:11:36 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-1391af4e-f17d-4343-b3d6-46a1950775f0 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Acquiring lock "/opt/stack/data/nova/instances/6f9add59-cabe-4965-8fe3-524618550581/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:11:36 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-1391af4e-f17d-4343-b3d6-46a1950775f0 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Lock "/opt/stack/data/nova/instances/6f9add59-cabe-4965-8fe3-524618550581/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.003s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:11:36 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-1391af4e-f17d-4343-b3d6-46a1950775f0 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Lock "/opt/stack/data/nova/instances/6f9add59-cabe-4965-8fe3-524618550581/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:11:36 user nova-compute[75165]: DEBUG nova.objects.instance [None req-1391af4e-f17d-4343-b3d6-46a1950775f0 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Lazy-loading 'trusted_certs' on Instance uuid 6f9add59-cabe-4965-8fe3-524618550581 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:11:36 user nova-compute[75165]: INFO nova.compute.resource_tracker [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] Updating resource usage from migration cc70c217-87db-48a3-b078-678e5f102287
Oct 26 00:11:36 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:36 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-608b26f4-bdef-40b3-80d6-15f67be3c0a4 req-529026ad-dcf0-4a56-a3aa-718153fbb4f6 service nova] Acquired lock "refresh_cache-6f9add59-cabe-4965-8fe3-524618550581" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:11:36 user nova-compute[75165]: DEBUG nova.network.neutron [req-608b26f4-bdef-40b3-80d6-15f67be3c0a4 req-529026ad-dcf0-4a56-a3aa-718153fbb4f6 service nova] [instance: 6f9add59-cabe-4965-8fe3-524618550581] Refreshing network info cache for port 50bf388e-b8ff-4924-9633-7e97d083a361 {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 00:11:36 user nova-compute[75165]: DEBUG nova.objects.base [None req-1391af4e-f17d-4343-b3d6-46a1950775f0 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Object Instance<6f9add59-cabe-4965-8fe3-524618550581> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75165) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 00:11:36 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-1391af4e-f17d-4343-b3d6-46a1950775f0 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Acquiring lock "db750091b70be3644b7e0b1b5770496167ab54cf" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:11:36 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-1391af4e-f17d-4343-b3d6-46a1950775f0 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Lock "db750091b70be3644b7e0b1b5770496167ab54cf" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:11:36 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:36 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:36 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:37 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-1391af4e-f17d-4343-b3d6-46a1950775f0 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db750091b70be3644b7e0b1b5770496167ab54cf.part --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:37 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:37 user nova-compute[75165]: DEBUG nova.compute.manager [req-8a38f49e-ddf3-4ccc-829a-36a3cb30156a req-7458b9e5-82ed-4c68-97f4-91d94b83754a service nova] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Received event network-vif-unplugged-c019e949-c6fc-4014-9e42-13ce1eb17786 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:11:37 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-8a38f49e-ddf3-4ccc-829a-36a3cb30156a req-7458b9e5-82ed-4c68-97f4-91d94b83754a service nova] Acquiring lock "8d5569ce-1f18-4f37-a340-099ee152d548-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:11:37 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-8a38f49e-ddf3-4ccc-829a-36a3cb30156a req-7458b9e5-82ed-4c68-97f4-91d94b83754a service nova] Lock "8d5569ce-1f18-4f37-a340-099ee152d548-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:11:37 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-8a38f49e-ddf3-4ccc-829a-36a3cb30156a req-7458b9e5-82ed-4c68-97f4-91d94b83754a service nova] Lock "8d5569ce-1f18-4f37-a340-099ee152d548-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:11:37 user nova-compute[75165]: DEBUG nova.compute.manager [req-8a38f49e-ddf3-4ccc-829a-36a3cb30156a req-7458b9e5-82ed-4c68-97f4-91d94b83754a service nova] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] No waiting events found dispatching network-vif-unplugged-c019e949-c6fc-4014-9e42-13ce1eb17786 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:11:37 user nova-compute[75165]: DEBUG nova.compute.manager [req-8a38f49e-ddf3-4ccc-829a-36a3cb30156a req-7458b9e5-82ed-4c68-97f4-91d94b83754a service nova] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Received event network-vif-unplugged-c019e949-c6fc-4014-9e42-13ce1eb17786 for instance with task_state deleting. {{(pid=75165) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 00:11:37 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:37 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:37 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-1391af4e-f17d-4343-b3d6-46a1950775f0 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db750091b70be3644b7e0b1b5770496167ab54cf.part --force-share --output=json" returned: 0 in 0.302s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:37 user nova-compute[75165]: DEBUG nova.virt.images [None req-1391af4e-f17d-4343-b3d6-46a1950775f0 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] 5aa869d5-afcc-4629-94af-7f8f2484dc5a was qcow2, converting to raw {{(pid=75165) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 26 00:11:37 user nova-compute[75165]: DEBUG nova.privsep.utils [None req-1391af4e-f17d-4343-b3d6-46a1950775f0 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75165) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 26 00:11:37 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-1391af4e-f17d-4343-b3d6-46a1950775f0 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/db750091b70be3644b7e0b1b5770496167ab54cf.part /opt/stack/data/nova/instances/_base/db750091b70be3644b7e0b1b5770496167ab54cf.converted {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:37 user nova-compute[75165]: DEBUG nova.compute.manager [req-3ebd549f-0191-4674-b3f1-5bea885e7aaf req-fa3ec5fe-480f-41d5-8ffc-c7f7b1e6a05b service nova] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Received event network-vif-unplugged-3da752ae-77a3-4bc3-8885-76331bc2d7d8 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:11:37 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-3ebd549f-0191-4674-b3f1-5bea885e7aaf req-fa3ec5fe-480f-41d5-8ffc-c7f7b1e6a05b service nova] Acquiring lock "8d5569ce-1f18-4f37-a340-099ee152d548-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:11:37 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-3ebd549f-0191-4674-b3f1-5bea885e7aaf req-fa3ec5fe-480f-41d5-8ffc-c7f7b1e6a05b service nova] Lock "8d5569ce-1f18-4f37-a340-099ee152d548-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:11:37 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-3ebd549f-0191-4674-b3f1-5bea885e7aaf req-fa3ec5fe-480f-41d5-8ffc-c7f7b1e6a05b service nova] Lock "8d5569ce-1f18-4f37-a340-099ee152d548-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:11:37 user nova-compute[75165]: DEBUG nova.compute.manager [req-3ebd549f-0191-4674-b3f1-5bea885e7aaf req-fa3ec5fe-480f-41d5-8ffc-c7f7b1e6a05b service nova] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] No waiting events found dispatching network-vif-unplugged-3da752ae-77a3-4bc3-8885-76331bc2d7d8 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:11:37 user nova-compute[75165]: DEBUG nova.compute.manager [req-3ebd549f-0191-4674-b3f1-5bea885e7aaf req-fa3ec5fe-480f-41d5-8ffc-c7f7b1e6a05b service nova] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Received event network-vif-unplugged-3da752ae-77a3-4bc3-8885-76331bc2d7d8 for instance with task_state deleting. {{(pid=75165) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 00:11:37 user nova-compute[75165]: DEBUG nova.compute.manager [req-3ebd549f-0191-4674-b3f1-5bea885e7aaf req-fa3ec5fe-480f-41d5-8ffc-c7f7b1e6a05b service nova] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Received event network-vif-plugged-3da752ae-77a3-4bc3-8885-76331bc2d7d8 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:11:37 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-3ebd549f-0191-4674-b3f1-5bea885e7aaf req-fa3ec5fe-480f-41d5-8ffc-c7f7b1e6a05b service nova] Acquiring lock "8d5569ce-1f18-4f37-a340-099ee152d548-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:11:37 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-3ebd549f-0191-4674-b3f1-5bea885e7aaf req-fa3ec5fe-480f-41d5-8ffc-c7f7b1e6a05b service nova] Lock "8d5569ce-1f18-4f37-a340-099ee152d548-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:11:37 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-3ebd549f-0191-4674-b3f1-5bea885e7aaf req-fa3ec5fe-480f-41d5-8ffc-c7f7b1e6a05b service nova] Lock "8d5569ce-1f18-4f37-a340-099ee152d548-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:11:37 user nova-compute[75165]: DEBUG nova.compute.manager [req-3ebd549f-0191-4674-b3f1-5bea885e7aaf req-fa3ec5fe-480f-41d5-8ffc-c7f7b1e6a05b service nova] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] No waiting events found dispatching network-vif-plugged-3da752ae-77a3-4bc3-8885-76331bc2d7d8 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:11:37 user nova-compute[75165]: WARNING nova.compute.manager [req-3ebd549f-0191-4674-b3f1-5bea885e7aaf req-fa3ec5fe-480f-41d5-8ffc-c7f7b1e6a05b service nova] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Received unexpected event network-vif-plugged-3da752ae-77a3-4bc3-8885-76331bc2d7d8 for instance with vm_state active and task_state deleting.
Oct 26 00:11:37 user nova-compute[75165]: DEBUG nova.compute.manager [req-3ebd549f-0191-4674-b3f1-5bea885e7aaf req-fa3ec5fe-480f-41d5-8ffc-c7f7b1e6a05b service nova] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Received event network-vif-unplugged-b9583014-bb07-4337-97bb-30001c05475f {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:11:37 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-3ebd549f-0191-4674-b3f1-5bea885e7aaf req-fa3ec5fe-480f-41d5-8ffc-c7f7b1e6a05b service nova] Acquiring lock "8d5569ce-1f18-4f37-a340-099ee152d548-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:11:37 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-3ebd549f-0191-4674-b3f1-5bea885e7aaf req-fa3ec5fe-480f-41d5-8ffc-c7f7b1e6a05b service nova] Lock "8d5569ce-1f18-4f37-a340-099ee152d548-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.012s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:11:37 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-3ebd549f-0191-4674-b3f1-5bea885e7aaf req-fa3ec5fe-480f-41d5-8ffc-c7f7b1e6a05b service nova] Lock "8d5569ce-1f18-4f37-a340-099ee152d548-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:11:37 user nova-compute[75165]: DEBUG nova.compute.manager [req-3ebd549f-0191-4674-b3f1-5bea885e7aaf req-fa3ec5fe-480f-41d5-8ffc-c7f7b1e6a05b service nova] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] No waiting events found dispatching network-vif-unplugged-b9583014-bb07-4337-97bb-30001c05475f {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:11:37 user nova-compute[75165]: DEBUG nova.compute.manager [req-3ebd549f-0191-4674-b3f1-5bea885e7aaf req-fa3ec5fe-480f-41d5-8ffc-c7f7b1e6a05b service nova] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Received event network-vif-unplugged-b9583014-bb07-4337-97bb-30001c05475f for instance with task_state deleting. {{(pid=75165) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 00:11:37 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:37 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:38 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:11:38 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Instance destroyed successfully.
Oct 26 00:11:38 user nova-compute[75165]: DEBUG nova.objects.instance [None req-eca5f738-4e10-4c86-b050-c2dcb595d6fa tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Lazy-loading 'resources' on Instance uuid 8d5569ce-1f18-4f37-a340-099ee152d548 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:11:38 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-1391af4e-f17d-4343-b3d6-46a1950775f0 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/db750091b70be3644b7e0b1b5770496167ab54cf.part /opt/stack/data/nova/instances/_base/db750091b70be3644b7e0b1b5770496167ab54cf.converted" returned: 0 in 0.547s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:38 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-1391af4e-f17d-4343-b3d6-46a1950775f0 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db750091b70be3644b7e0b1b5770496167ab54cf.converted --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:38 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:11:38 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-eca5f738-4e10-4c86-b050-c2dcb595d6fa tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T00:08:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-29517242',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-29517242',id=12,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCcUUhN8XRpaaJYv3vKPCPNNEkMMxDlKMi4jyG5F1k/oc6PfjbyEM9kim/n6zZPEK/ViRCrBDnWctXlihsGcJMeVYlhtqzvBMnS7wCLITtUfvAB80UeX7KgDk7Zm8Llyvw==',key_name='tempest-keypair-548626618',keypairs=<?>,launch_index=0,launched_at=2023-10-26T00:10:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9f1d0ea8cbf74f10b81a10d3a7a6e716',ramdisk_id='',reservation_id='r-y23b6svq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1432681902',owner_user_name='tempest-TaggedBootDevicesTest_v242-1432681902-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T00:10:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d25920439307445387df8d37c662d602',uuid=8d5569ce-1f18-4f37-a340-099ee152d548,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3da752ae-77a3-4bc3-8885-76331bc2d7d8", "address": "fa:16:3e:22:af:b4", "network": {"id": "a4a95519-4969-4c53-b078-46dab1ae12ac", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1704712535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f1d0ea8cbf74f10b81a10d3a7a6e716", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3da752ae-77", "ovs_interfaceid": "3da752ae-77a3-4bc3-8885-76331bc2d7d8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 00:11:38 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-eca5f738-4e10-4c86-b050-c2dcb595d6fa tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Converting VIF {"id": "3da752ae-77a3-4bc3-8885-76331bc2d7d8", "address": "fa:16:3e:22:af:b4", "network": {"id": "a4a95519-4969-4c53-b078-46dab1ae12ac", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1704712535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f1d0ea8cbf74f10b81a10d3a7a6e716", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3da752ae-77", "ovs_interfaceid": "3da752ae-77a3-4bc3-8885-76331bc2d7d8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:11:38 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-eca5f738-4e10-4c86-b050-c2dcb595d6fa tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:22:af:b4,bridge_name='br-int',has_traffic_filtering=True,id=3da752ae-77a3-4bc3-8885-76331bc2d7d8,network=Network(a4a95519-4969-4c53-b078-46dab1ae12ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3da752ae-77') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:11:38 user nova-compute[75165]: DEBUG os_vif [None req-eca5f738-4e10-4c86-b050-c2dcb595d6fa tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:22:af:b4,bridge_name='br-int',has_traffic_filtering=True,id=3da752ae-77a3-4bc3-8885-76331bc2d7d8,network=Network(a4a95519-4969-4c53-b078-46dab1ae12ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3da752ae-77') {{(pid=75165) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 00:11:38 user nova-compute[75165]: DEBUG nova.network.neutron [req-608b26f4-bdef-40b3-80d6-15f67be3c0a4 req-529026ad-dcf0-4a56-a3aa-718153fbb4f6 service nova] [instance: 6f9add59-cabe-4965-8fe3-524618550581] Updated VIF entry in instance network info cache for port 50bf388e-b8ff-4924-9633-7e97d083a361. {{(pid=75165) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 00:11:38 user nova-compute[75165]: DEBUG nova.network.neutron [req-608b26f4-bdef-40b3-80d6-15f67be3c0a4 req-529026ad-dcf0-4a56-a3aa-718153fbb4f6 service nova] [instance: 6f9add59-cabe-4965-8fe3-524618550581] Updating instance_info_cache with network_info: [{"id": "50bf388e-b8ff-4924-9633-7e97d083a361", "address": "fa:16:3e:16:28:b9", "network": {"id": "f54e2e9f-5c1e-44ca-bd4b-9cf0747b0f72", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-806146051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "920152101768459baa71010b380ea8f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50bf388e-b8", "ovs_interfaceid": "50bf388e-b8ff-4924-9633-7e97d083a361", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:11:38 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:38 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3da752ae-77, bridge=br-int, if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:11:38 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:38 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:11:38 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 2.375s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:11:38 user nova-compute[75165]: INFO nova.compute.manager [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] Migrating
Oct 26 00:11:38 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:11:38 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Acquired lock "compute-rpcapi-router" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:11:38 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-608b26f4-bdef-40b3-80d6-15f67be3c0a4 req-529026ad-dcf0-4a56-a3aa-718153fbb4f6 service nova] Releasing lock "refresh_cache-6f9add59-cabe-4965-8fe3-524618550581" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:11:38 user nova-compute[75165]: INFO nova.compute.rpcapi [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Oct 26 00:11:38 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Releasing lock "compute-rpcapi-router" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:11:38 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:38 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:38 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=63bed79d-0e4d-4c9f-bae0-60dfe4e92069) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:11:38 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Acquiring lock "refresh_cache-3b153af2-c93b-47d2-ae8c-76cfd44e384c" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:11:38 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Acquired lock "refresh_cache-3b153af2-c93b-47d2-ae8c-76cfd44e384c" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:11:38 user nova-compute[75165]: DEBUG nova.network.neutron [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] Building network info cache for instance {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 00:11:38 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:38 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:11:38 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-1391af4e-f17d-4343-b3d6-46a1950775f0 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db750091b70be3644b7e0b1b5770496167ab54cf.converted --force-share --output=json" returned: 0 in 0.271s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:38 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-1391af4e-f17d-4343-b3d6-46a1950775f0 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Lock "db750091b70be3644b7e0b1b5770496167ab54cf" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.333s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:11:38 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-1391af4e-f17d-4343-b3d6-46a1950775f0 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db750091b70be3644b7e0b1b5770496167ab54cf --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:38 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:38 user nova-compute[75165]: INFO os_vif [None req-eca5f738-4e10-4c86-b050-c2dcb595d6fa tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:22:af:b4,bridge_name='br-int',has_traffic_filtering=True,id=3da752ae-77a3-4bc3-8885-76331bc2d7d8,network=Network(a4a95519-4969-4c53-b078-46dab1ae12ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3da752ae-77')
Oct 26 00:11:38 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-eca5f738-4e10-4c86-b050-c2dcb595d6fa tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T00:08:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-29517242',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-29517242',id=12,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCcUUhN8XRpaaJYv3vKPCPNNEkMMxDlKMi4jyG5F1k/oc6PfjbyEM9kim/n6zZPEK/ViRCrBDnWctXlihsGcJMeVYlhtqzvBMnS7wCLITtUfvAB80UeX7KgDk7Zm8Llyvw==',key_name='tempest-keypair-548626618',keypairs=<?>,launch_index=0,launched_at=2023-10-26T00:10:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9f1d0ea8cbf74f10b81a10d3a7a6e716',ramdisk_id='',reservation_id='r-y23b6svq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1432681902',owner_user_name='tempest-TaggedBootDevicesTest_v242-1432681902-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T00:10:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d25920439307445387df8d37c662d602',uuid=8d5569ce-1f18-4f37-a340-099ee152d548,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b9583014-bb07-4337-97bb-30001c05475f", "address": "fa:16:3e:ca:f8:4e", "network": {"id": "b1b273e9-ac47-4985-9a15-ed6392eea58c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1944708022", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9f1d0ea8cbf74f10b81a10d3a7a6e716", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9583014-bb", "ovs_interfaceid": "b9583014-bb07-4337-97bb-30001c05475f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75165) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 00:11:38 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-eca5f738-4e10-4c86-b050-c2dcb595d6fa tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Converting VIF {"id": "b9583014-bb07-4337-97bb-30001c05475f", "address": "fa:16:3e:ca:f8:4e", "network": {"id": "b1b273e9-ac47-4985-9a15-ed6392eea58c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1944708022", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9f1d0ea8cbf74f10b81a10d3a7a6e716", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9583014-bb", "ovs_interfaceid": "b9583014-bb07-4337-97bb-30001c05475f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:11:38 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-eca5f738-4e10-4c86-b050-c2dcb595d6fa tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:f8:4e,bridge_name='br-int',has_traffic_filtering=True,id=b9583014-bb07-4337-97bb-30001c05475f,network=Network(b1b273e9-ac47-4985-9a15-ed6392eea58c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb9583014-bb') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:11:38 user nova-compute[75165]: DEBUG os_vif [None req-eca5f738-4e10-4c86-b050-c2dcb595d6fa tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:f8:4e,bridge_name='br-int',has_traffic_filtering=True,id=b9583014-bb07-4337-97bb-30001c05475f,network=Network(b1b273e9-ac47-4985-9a15-ed6392eea58c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb9583014-bb') {{(pid=75165) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 00:11:38 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:38 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb9583014-bb, bridge=br-int, if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:11:38 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:38 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:11:38 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:38 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:38 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=80439a63-8d10-4d25-ad33-7b32ecd5367a) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:11:38 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:38 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:11:38 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-1391af4e-f17d-4343-b3d6-46a1950775f0 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db750091b70be3644b7e0b1b5770496167ab54cf --force-share --output=json" returned: 0 in 0.243s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:38 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-1391af4e-f17d-4343-b3d6-46a1950775f0 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Acquiring lock "db750091b70be3644b7e0b1b5770496167ab54cf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:11:38 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-1391af4e-f17d-4343-b3d6-46a1950775f0 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Lock "db750091b70be3644b7e0b1b5770496167ab54cf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:11:38 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-1391af4e-f17d-4343-b3d6-46a1950775f0 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db750091b70be3644b7e0b1b5770496167ab54cf --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:38 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:38 user nova-compute[75165]: INFO os_vif [None req-eca5f738-4e10-4c86-b050-c2dcb595d6fa tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:f8:4e,bridge_name='br-int',has_traffic_filtering=True,id=b9583014-bb07-4337-97bb-30001c05475f,network=Network(b1b273e9-ac47-4985-9a15-ed6392eea58c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb9583014-bb')
Oct 26 00:11:38 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-eca5f738-4e10-4c86-b050-c2dcb595d6fa tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T00:08:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-29517242',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-29517242',id=12,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCcUUhN8XRpaaJYv3vKPCPNNEkMMxDlKMi4jyG5F1k/oc6PfjbyEM9kim/n6zZPEK/ViRCrBDnWctXlihsGcJMeVYlhtqzvBMnS7wCLITtUfvAB80UeX7KgDk7Zm8Llyvw==',key_name='tempest-keypair-548626618',keypairs=<?>,launch_index=0,launched_at=2023-10-26T00:10:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9f1d0ea8cbf74f10b81a10d3a7a6e716',ramdisk_id='',reservation_id='r-y23b6svq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1432681902',owner_user_name='tempest-TaggedBootDevicesTest_v242-1432681902-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T00:10:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d25920439307445387df8d37c662d602',uuid=8d5569ce-1f18-4f37-a340-099ee152d548,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c51f288f-44b9-476b-9419-22ef8ae5c900", "address": "fa:16:3e:28:cd:e8", "network": {"id": "b1b273e9-ac47-4985-9a15-ed6392eea58c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1944708022", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.239", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9f1d0ea8cbf74f10b81a10d3a7a6e716", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc51f288f-44", "ovs_interfaceid": "c51f288f-44b9-476b-9419-22ef8ae5c900", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75165) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 00:11:38 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-eca5f738-4e10-4c86-b050-c2dcb595d6fa tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Converting VIF {"id": "c51f288f-44b9-476b-9419-22ef8ae5c900", "address": "fa:16:3e:28:cd:e8", "network": {"id": "b1b273e9-ac47-4985-9a15-ed6392eea58c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1944708022", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.239", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9f1d0ea8cbf74f10b81a10d3a7a6e716", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc51f288f-44", "ovs_interfaceid": "c51f288f-44b9-476b-9419-22ef8ae5c900", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:11:38 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-eca5f738-4e10-4c86-b050-c2dcb595d6fa tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:cd:e8,bridge_name='br-int',has_traffic_filtering=True,id=c51f288f-44b9-476b-9419-22ef8ae5c900,network=Network(b1b273e9-ac47-4985-9a15-ed6392eea58c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc51f288f-44') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:11:38 user nova-compute[75165]: DEBUG os_vif [None req-eca5f738-4e10-4c86-b050-c2dcb595d6fa tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:cd:e8,bridge_name='br-int',has_traffic_filtering=True,id=c51f288f-44b9-476b-9419-22ef8ae5c900,network=Network(b1b273e9-ac47-4985-9a15-ed6392eea58c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc51f288f-44') {{(pid=75165) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 00:11:38 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:38 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc51f288f-44, bridge=br-int, if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:11:38 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:11:38 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-1391af4e-f17d-4343-b3d6-46a1950775f0 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db750091b70be3644b7e0b1b5770496167ab54cf --force-share --output=json" returned: 0 in 0.230s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:38 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-1391af4e-f17d-4343-b3d6-46a1950775f0 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/db750091b70be3644b7e0b1b5770496167ab54cf,backing_fmt=raw /opt/stack/data/nova/instances/6f9add59-cabe-4965-8fe3-524618550581/disk 1073741824 {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9d8ae01e-f605-4ba4-ab4f-c0e111277e44) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-1391af4e-f17d-4343-b3d6-46a1950775f0 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/db750091b70be3644b7e0b1b5770496167ab54cf,backing_fmt=raw /opt/stack/data/nova/instances/6f9add59-cabe-4965-8fe3-524618550581/disk 1073741824" returned: 0 in 0.123s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-1391af4e-f17d-4343-b3d6-46a1950775f0 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Lock "db750091b70be3644b7e0b1b5770496167ab54cf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.361s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-1391af4e-f17d-4343-b3d6-46a1950775f0 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db750091b70be3644b7e0b1b5770496167ab54cf --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:39 user nova-compute[75165]: INFO os_vif [None req-eca5f738-4e10-4c86-b050-c2dcb595d6fa tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:cd:e8,bridge_name='br-int',has_traffic_filtering=True,id=c51f288f-44b9-476b-9419-22ef8ae5c900,network=Network(b1b273e9-ac47-4985-9a15-ed6392eea58c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc51f288f-44')
Oct 26 00:11:39 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-eca5f738-4e10-4c86-b050-c2dcb595d6fa tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T00:08:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-29517242',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-29517242',id=12,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCcUUhN8XRpaaJYv3vKPCPNNEkMMxDlKMi4jyG5F1k/oc6PfjbyEM9kim/n6zZPEK/ViRCrBDnWctXlihsGcJMeVYlhtqzvBMnS7wCLITtUfvAB80UeX7KgDk7Zm8Llyvw==',key_name='tempest-keypair-548626618',keypairs=<?>,launch_index=0,launched_at=2023-10-26T00:10:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9f1d0ea8cbf74f10b81a10d3a7a6e716',ramdisk_id='',reservation_id='r-y23b6svq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1432681902',owner_user_name='tempest-TaggedBootDevicesTest_v242-1432681902-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T00:10:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d25920439307445387df8d37c662d602',uuid=8d5569ce-1f18-4f37-a340-099ee152d548,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c019e949-c6fc-4014-9e42-13ce1eb17786", "address": "fa:16:3e:34:fd:75", "network": {"id": "b1b273e9-ac47-4985-9a15-ed6392eea58c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1944708022", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.220", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9f1d0ea8cbf74f10b81a10d3a7a6e716", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc019e949-c6", "ovs_interfaceid": "c019e949-c6fc-4014-9e42-13ce1eb17786", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-eca5f738-4e10-4c86-b050-c2dcb595d6fa tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Converting VIF {"id": "c019e949-c6fc-4014-9e42-13ce1eb17786", "address": "fa:16:3e:34:fd:75", "network": {"id": "b1b273e9-ac47-4985-9a15-ed6392eea58c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1944708022", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.220", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9f1d0ea8cbf74f10b81a10d3a7a6e716", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc019e949-c6", "ovs_interfaceid": "c019e949-c6fc-4014-9e42-13ce1eb17786", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-eca5f738-4e10-4c86-b050-c2dcb595d6fa tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:fd:75,bridge_name='br-int',has_traffic_filtering=True,id=c019e949-c6fc-4014-9e42-13ce1eb17786,network=Network(b1b273e9-ac47-4985-9a15-ed6392eea58c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc019e949-c6') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG os_vif [None req-eca5f738-4e10-4c86-b050-c2dcb595d6fa tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:fd:75,bridge_name='br-int',has_traffic_filtering=True,id=c019e949-c6fc-4014-9e42-13ce1eb17786,network=Network(b1b273e9-ac47-4985-9a15-ed6392eea58c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc019e949-c6') {{(pid=75165) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc019e949-c6, bridge=br-int, if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0ff3afe6-ef92-45d8-80b3-4281434330ec) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG nova.compute.manager [req-b11d0ee7-3709-44f6-bb87-3177707231a4 req-0446f5ef-ddae-4bc7-b9df-152dd092088d service nova] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Received event network-vif-plugged-c019e949-c6fc-4014-9e42-13ce1eb17786 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-b11d0ee7-3709-44f6-bb87-3177707231a4 req-0446f5ef-ddae-4bc7-b9df-152dd092088d service nova] Acquiring lock "8d5569ce-1f18-4f37-a340-099ee152d548-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-b11d0ee7-3709-44f6-bb87-3177707231a4 req-0446f5ef-ddae-4bc7-b9df-152dd092088d service nova] Lock "8d5569ce-1f18-4f37-a340-099ee152d548-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-b11d0ee7-3709-44f6-bb87-3177707231a4 req-0446f5ef-ddae-4bc7-b9df-152dd092088d service nova] Lock "8d5569ce-1f18-4f37-a340-099ee152d548-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG nova.compute.manager [req-b11d0ee7-3709-44f6-bb87-3177707231a4 req-0446f5ef-ddae-4bc7-b9df-152dd092088d service nova] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] No waiting events found dispatching network-vif-plugged-c019e949-c6fc-4014-9e42-13ce1eb17786 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:11:39 user nova-compute[75165]: WARNING nova.compute.manager [req-b11d0ee7-3709-44f6-bb87-3177707231a4 req-0446f5ef-ddae-4bc7-b9df-152dd092088d service nova] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Received unexpected event network-vif-plugged-c019e949-c6fc-4014-9e42-13ce1eb17786 for instance with vm_state active and task_state deleting.
Oct 26 00:11:39 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-1391af4e-f17d-4343-b3d6-46a1950775f0 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db750091b70be3644b7e0b1b5770496167ab54cf --force-share --output=json" returned: 0 in 0.182s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG nova.objects.instance [None req-1391af4e-f17d-4343-b3d6-46a1950775f0 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Lazy-loading 'migration_context' on Instance uuid 6f9add59-cabe-4965-8fe3-524618550581 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:39 user nova-compute[75165]: INFO os_vif [None req-eca5f738-4e10-4c86-b050-c2dcb595d6fa tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:fd:75,bridge_name='br-int',has_traffic_filtering=True,id=c019e949-c6fc-4014-9e42-13ce1eb17786,network=Network(b1b273e9-ac47-4985-9a15-ed6392eea58c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc019e949-c6')
Oct 26 00:11:39 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-eca5f738-4e10-4c86-b050-c2dcb595d6fa tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T00:08:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-29517242',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-29517242',id=12,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCcUUhN8XRpaaJYv3vKPCPNNEkMMxDlKMi4jyG5F1k/oc6PfjbyEM9kim/n6zZPEK/ViRCrBDnWctXlihsGcJMeVYlhtqzvBMnS7wCLITtUfvAB80UeX7KgDk7Zm8Llyvw==',key_name='tempest-keypair-548626618',keypairs=<?>,launch_index=0,launched_at=2023-10-26T00:10:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9f1d0ea8cbf74f10b81a10d3a7a6e716',ramdisk_id='',reservation_id='r-y23b6svq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1432681902',owner_user_name='tempest-TaggedBootDevicesTest_v242-1432681902-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T00:10:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d25920439307445387df8d37c662d602',uuid=8d5569ce-1f18-4f37-a340-099ee152d548,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9cecd3d6-4945-4a4b-8d06-48b0d7768a17", "address": "fa:16:3e:59:c6:53", "network": {"id": "b1b273e9-ac47-4985-9a15-ed6392eea58c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1944708022", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9f1d0ea8cbf74f10b81a10d3a7a6e716", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cecd3d6-49", "ovs_interfaceid": "9cecd3d6-4945-4a4b-8d06-48b0d7768a17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-eca5f738-4e10-4c86-b050-c2dcb595d6fa tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Converting VIF {"id": "9cecd3d6-4945-4a4b-8d06-48b0d7768a17", "address": "fa:16:3e:59:c6:53", "network": {"id": "b1b273e9-ac47-4985-9a15-ed6392eea58c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1944708022", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9f1d0ea8cbf74f10b81a10d3a7a6e716", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cecd3d6-49", "ovs_interfaceid": "9cecd3d6-4945-4a4b-8d06-48b0d7768a17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-eca5f738-4e10-4c86-b050-c2dcb595d6fa tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:c6:53,bridge_name='br-int',has_traffic_filtering=True,id=9cecd3d6-4945-4a4b-8d06-48b0d7768a17,network=Network(b1b273e9-ac47-4985-9a15-ed6392eea58c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cecd3d6-49') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG os_vif [None req-eca5f738-4e10-4c86-b050-c2dcb595d6fa tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:c6:53,bridge_name='br-int',has_traffic_filtering=True,id=9cecd3d6-4945-4a4b-8d06-48b0d7768a17,network=Network(b1b273e9-ac47-4985-9a15-ed6392eea58c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cecd3d6-49') {{(pid=75165) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9cecd3d6-49, bridge=br-int, if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG nova.objects.base [None req-1391af4e-f17d-4343-b3d6-46a1950775f0 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Object Instance<6f9add59-cabe-4965-8fe3-524618550581> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75165) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 00:11:39 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-1391af4e-f17d-4343-b3d6-46a1950775f0 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] [instance: 6f9add59-cabe-4965-8fe3-524618550581] Rebasing disk image.
Oct 26 00:11:39 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-1391af4e-f17d-4343-b3d6-46a1950775f0 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=13a7616a-7f64-4775-a644-924f3cdcf5aa) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:39 user nova-compute[75165]: INFO os_vif [None req-eca5f738-4e10-4c86-b050-c2dcb595d6fa tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:c6:53,bridge_name='br-int',has_traffic_filtering=True,id=9cecd3d6-4945-4a4b-8d06-48b0d7768a17,network=Network(b1b273e9-ac47-4985-9a15-ed6392eea58c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cecd3d6-49')
Oct 26 00:11:39 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-eca5f738-4e10-4c86-b050-c2dcb595d6fa tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T00:08:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-29517242',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-29517242',id=12,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCcUUhN8XRpaaJYv3vKPCPNNEkMMxDlKMi4jyG5F1k/oc6PfjbyEM9kim/n6zZPEK/ViRCrBDnWctXlihsGcJMeVYlhtqzvBMnS7wCLITtUfvAB80UeX7KgDk7Zm8Llyvw==',key_name='tempest-keypair-548626618',keypairs=<?>,launch_index=0,launched_at=2023-10-26T00:10:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9f1d0ea8cbf74f10b81a10d3a7a6e716',ramdisk_id='',reservation_id='r-y23b6svq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1432681902',owner_user_name='tempest-TaggedBootDevicesTest_v242-1432681902-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T00:10:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d25920439307445387df8d37c662d602',uuid=8d5569ce-1f18-4f37-a340-099ee152d548,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a04b8134-03e6-45f2-b6d7-3ea6a7deb81c", "address": "fa:16:3e:0a:29:45", "network": {"id": "75761f5b-dd19-4843-8db7-9cef3872583d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1377439333", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9f1d0ea8cbf74f10b81a10d3a7a6e716", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa04b8134-03", "ovs_interfaceid": "a04b8134-03e6-45f2-b6d7-3ea6a7deb81c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-eca5f738-4e10-4c86-b050-c2dcb595d6fa tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Converting VIF {"id": "a04b8134-03e6-45f2-b6d7-3ea6a7deb81c", "address": "fa:16:3e:0a:29:45", "network": {"id": "75761f5b-dd19-4843-8db7-9cef3872583d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1377439333", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9f1d0ea8cbf74f10b81a10d3a7a6e716", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa04b8134-03", "ovs_interfaceid": "a04b8134-03e6-45f2-b6d7-3ea6a7deb81c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-eca5f738-4e10-4c86-b050-c2dcb595d6fa tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:29:45,bridge_name='br-int',has_traffic_filtering=True,id=a04b8134-03e6-45f2-b6d7-3ea6a7deb81c,network=Network(75761f5b-dd19-4843-8db7-9cef3872583d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa04b8134-03') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG os_vif [None req-eca5f738-4e10-4c86-b050-c2dcb595d6fa tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:29:45,bridge_name='br-int',has_traffic_filtering=True,id=a04b8134-03e6-45f2-b6d7-3ea6a7deb81c,network=Network(75761f5b-dd19-4843-8db7-9cef3872583d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa04b8134-03') {{(pid=75165) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa04b8134-03, bridge=br-int, if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f6f74f87-ee7b-4c0c-a12d-fbc3d983c426) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:39 user nova-compute[75165]: INFO os_vif [None req-eca5f738-4e10-4c86-b050-c2dcb595d6fa tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:29:45,bridge_name='br-int',has_traffic_filtering=True,id=a04b8134-03e6-45f2-b6d7-3ea6a7deb81c,network=Network(75761f5b-dd19-4843-8db7-9cef3872583d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa04b8134-03')
Oct 26 00:11:39 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-eca5f738-4e10-4c86-b050-c2dcb595d6fa tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T00:08:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-29517242',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-29517242',id=12,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCcUUhN8XRpaaJYv3vKPCPNNEkMMxDlKMi4jyG5F1k/oc6PfjbyEM9kim/n6zZPEK/ViRCrBDnWctXlihsGcJMeVYlhtqzvBMnS7wCLITtUfvAB80UeX7KgDk7Zm8Llyvw==',key_name='tempest-keypair-548626618',keypairs=<?>,launch_index=0,launched_at=2023-10-26T00:10:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9f1d0ea8cbf74f10b81a10d3a7a6e716',ramdisk_id='',reservation_id='r-y23b6svq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1432681902',owner_user_name='tempest-TaggedBootDevicesTest_v242-1432681902-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T00:10:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d25920439307445387df8d37c662d602',uuid=8d5569ce-1f18-4f37-a340-099ee152d548,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "03ee4dbc-d46d-4127-a4e0-d308a1c8beae", "address": "fa:16:3e:5b:46:e6", "network": {"id": "75761f5b-dd19-4843-8db7-9cef3872583d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1377439333", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9f1d0ea8cbf74f10b81a10d3a7a6e716", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03ee4dbc-d4", "ovs_interfaceid": "03ee4dbc-d46d-4127-a4e0-d308a1c8beae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-eca5f738-4e10-4c86-b050-c2dcb595d6fa tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Converting VIF {"id": "03ee4dbc-d46d-4127-a4e0-d308a1c8beae", "address": "fa:16:3e:5b:46:e6", "network": {"id": "75761f5b-dd19-4843-8db7-9cef3872583d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1377439333", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9f1d0ea8cbf74f10b81a10d3a7a6e716", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03ee4dbc-d4", "ovs_interfaceid": "03ee4dbc-d46d-4127-a4e0-d308a1c8beae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-eca5f738-4e10-4c86-b050-c2dcb595d6fa tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:46:e6,bridge_name='br-int',has_traffic_filtering=True,id=03ee4dbc-d46d-4127-a4e0-d308a1c8beae,network=Network(75761f5b-dd19-4843-8db7-9cef3872583d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03ee4dbc-d4') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG os_vif [None req-eca5f738-4e10-4c86-b050-c2dcb595d6fa tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:46:e6,bridge_name='br-int',has_traffic_filtering=True,id=03ee4dbc-d46d-4127-a4e0-d308a1c8beae,network=Network(75761f5b-dd19-4843-8db7-9cef3872583d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03ee4dbc-d4') {{(pid=75165) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap03ee4dbc-d4, bridge=br-int, if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4fc3b149-3b86-4613-9f89-0542c4516274) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:11:39 user nova-compute[75165]: INFO os_vif [None req-eca5f738-4e10-4c86-b050-c2dcb595d6fa tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:46:e6,bridge_name='br-int',has_traffic_filtering=True,id=03ee4dbc-d46d-4127-a4e0-d308a1c8beae,network=Network(75761f5b-dd19-4843-8db7-9cef3872583d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03ee4dbc-d4')
Oct 26 00:11:39 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eca5f738-4e10-4c86-b050-c2dcb595d6fa tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] calling os-brick to detach iSCSI Volume {{(pid=75165) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca5f738-4e10-4c86-b050-c2dcb595d6fa tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8bf8160e50>, {'target_iqn': 'iqn.2010-10.org.openstack:f25f6e6a-9711-4455-82e8-c56648a08508', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PNkbihUC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:11:39 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-eca5f738-4e10-4c86-b050-c2dcb595d6fa tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:11:39 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-eca5f738-4e10-4c86-b050-c2dcb595d6fa tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-eca5f738-4e10-4c86-b050-c2dcb595d6fa tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-1391af4e-f17d-4343-b3d6-46a1950775f0 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json" returned: 0 in 0.192s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-1391af4e-f17d-4343-b3d6-46a1950775f0 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 -F raw /opt/stack/data/nova/instances/6f9add59-cabe-4965-8fe3-524618550581/disk {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[700babc6-fb66-4ce9-82f1-ec5d6b8f6bfd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f25f6e6a-9711-4455-82e8-c56648a08508\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ff01f329-6dda-43b6-8da5-6a5c48fad211\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:083f264a-3f29-48b4-9935-a73f4234e6d5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca5f738-4e10-4c86-b050-c2dcb595d6fa tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 00:11:39 user nova-compute[75165]: No targets found.
Oct 26 00:11:39 user nova-compute[75165]: iSNS:
Oct 26 00:11:39 user nova-compute[75165]: No targets found.
Oct 26 00:11:39 user nova-compute[75165]: STATIC:
Oct 26 00:11:39 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792
Oct 26 00:11:39 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:11:39 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:11:39 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:f25f6e6a-9711-4455-82e8-c56648a08508
Oct 26 00:11:39 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:11:39 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:11:39 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:ff01f329-6dda-43b6-8da5-6a5c48fad211
Oct 26 00:11:39 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:11:39 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:11:39 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:083f264a-3f29-48b4-9935-a73f4234e6d5
Oct 26 00:11:39 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:11:39 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:11:39 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b
Oct 26 00:11:39 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:11:39 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:11:39 user nova-compute[75165]: FIRMWARE:
Oct 26 00:11:39 user nova-compute[75165]: No targets found.
Oct 26 00:11:39 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca5f738-4e10-4c86-b050-c2dcb595d6fa tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 00:11:39 user nova-compute[75165]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 00:11:39 user nova-compute[75165]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75165) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca5f738-4e10-4c86-b050-c2dcb595d6fa tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f25f6e6a-9711-4455-82e8-c56648a08508', 0)] {{(pid=75165) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4f26224-4b72-4dc2-b05c-49039339adda]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:083f264a-3f29-48b4-9935-a73f4234e6d5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f25f6e6a-9711-4455-82e8-c56648a08508\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ff01f329-6dda-43b6-8da5-6a5c48fad211\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[f049095a-b285-4391-9e3d-2614d0a6e927]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f25f6e6a-9711-4455-82e8-c56648a08508 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:083f264a-3f29-48b4-9935-a73f4234e6d5 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff01f329-6dda-43b6-8da5-6a5c48fad211 (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca5f738-4e10-4c86-b050-c2dcb595d6fa tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792 (non-flash)
Oct 26 00:11:39 user nova-compute[75165]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b (non-flash)
Oct 26 00:11:39 user nova-compute[75165]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f25f6e6a-9711-4455-82e8-c56648a08508 (non-flash)
Oct 26 00:11:39 user nova-compute[75165]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:083f264a-3f29-48b4-9935-a73f4234e6d5 (non-flash)
Oct 26 00:11:39 user nova-compute[75165]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff01f329-6dda-43b6-8da5-6a5c48fad211 (non-flash)
Oct 26 00:11:39 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca5f738-4e10-4c86-b050-c2dcb595d6fa tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792 (non-flash)
Oct 26 00:11:39 user nova-compute[75165]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b (non-flash)
Oct 26 00:11:39 user nova-compute[75165]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f25f6e6a-9711-4455-82e8-c56648a08508 (non-flash)
Oct 26 00:11:39 user nova-compute[75165]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:083f264a-3f29-48b4-9935-a73f4234e6d5 (non-flash)
Oct 26 00:11:39 user nova-compute[75165]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff01f329-6dda-43b6-8da5-6a5c48fad211 (non-flash)
Oct 26 00:11:39 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca5f738-4e10-4c86-b050-c2dcb595d6fa tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8be04a8dc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f25f6e6a-9711-4455-82e8-c56648a08508'): ({'sdc'}, set())}) {{(pid=75165) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-eca5f738-4e10-4c86-b050-c2dcb595d6fa tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Removing single pathed devices sdc {{(pid=75165) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG nova.network.neutron [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] Updating instance_info_cache with network_info: [{"id": "874a1698-c52c-444c-bed5-52633dbaeead", "address": "fa:16:3e:75:45:79", "network": {"id": "30951418-d830-4042-9143-c736802150e9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-167387787-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0db2c49ee28f4b7b9fa990faddb9d3a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap874a1698-c5", "ovs_interfaceid": "874a1698-c52c-444c-bed5-52633dbaeead", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.040s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6c9e792-fd4d-4392-bc5c-d6b43e8df8fa]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Releasing lock "refresh_cache-3b153af2-c93b-47d2-ae8c-76cfd44e384c" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.025s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb0f49e0-0496-454d-922b-5df21d5e4105]: (4, ('ok\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-eca5f738-4e10-4c86-b050-c2dcb595d6fa tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Flushing IO for device /dev/sdc {{(pid=75165) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG nova.compute.manager [req-d474fb16-4e69-4c8e-a23d-574fc9649ac1 req-6e78d2ee-7980-40a7-9216-eed81cfbc621 service nova] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Received event network-vif-plugged-b9583014-bb07-4337-97bb-30001c05475f {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-d474fb16-4e69-4c8e-a23d-574fc9649ac1 req-6e78d2ee-7980-40a7-9216-eed81cfbc621 service nova] Acquiring lock "8d5569ce-1f18-4f37-a340-099ee152d548-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-d474fb16-4e69-4c8e-a23d-574fc9649ac1 req-6e78d2ee-7980-40a7-9216-eed81cfbc621 service nova] Lock "8d5569ce-1f18-4f37-a340-099ee152d548-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-d474fb16-4e69-4c8e-a23d-574fc9649ac1 req-6e78d2ee-7980-40a7-9216-eed81cfbc621 service nova] Lock "8d5569ce-1f18-4f37-a340-099ee152d548-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG nova.compute.manager [req-d474fb16-4e69-4c8e-a23d-574fc9649ac1 req-6e78d2ee-7980-40a7-9216-eed81cfbc621 service nova] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] No waiting events found dispatching network-vif-plugged-b9583014-bb07-4337-97bb-30001c05475f {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:11:39 user nova-compute[75165]: WARNING nova.compute.manager [req-d474fb16-4e69-4c8e-a23d-574fc9649ac1 req-6e78d2ee-7980-40a7-9216-eed81cfbc621 service nova] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Received unexpected event network-vif-plugged-b9583014-bb07-4337-97bb-30001c05475f for instance with vm_state active and task_state deleting.
Oct 26 00:11:39 user nova-compute[75165]: DEBUG nova.compute.manager [req-d474fb16-4e69-4c8e-a23d-574fc9649ac1 req-6e78d2ee-7980-40a7-9216-eed81cfbc621 service nova] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Received event network-vif-unplugged-c51f288f-44b9-476b-9419-22ef8ae5c900 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-d474fb16-4e69-4c8e-a23d-574fc9649ac1 req-6e78d2ee-7980-40a7-9216-eed81cfbc621 service nova] Acquiring lock "8d5569ce-1f18-4f37-a340-099ee152d548-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-d474fb16-4e69-4c8e-a23d-574fc9649ac1 req-6e78d2ee-7980-40a7-9216-eed81cfbc621 service nova] Lock "8d5569ce-1f18-4f37-a340-099ee152d548-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-d474fb16-4e69-4c8e-a23d-574fc9649ac1 req-6e78d2ee-7980-40a7-9216-eed81cfbc621 service nova] Lock "8d5569ce-1f18-4f37-a340-099ee152d548-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG nova.compute.manager [req-d474fb16-4e69-4c8e-a23d-574fc9649ac1 req-6e78d2ee-7980-40a7-9216-eed81cfbc621 service nova] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] No waiting events found dispatching network-vif-unplugged-c51f288f-44b9-476b-9419-22ef8ae5c900 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG nova.compute.manager [req-d474fb16-4e69-4c8e-a23d-574fc9649ac1 req-6e78d2ee-7980-40a7-9216-eed81cfbc621 service nova] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Received event network-vif-unplugged-c51f288f-44b9-476b-9419-22ef8ae5c900 for instance with task_state deleting. {{(pid=75165) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG nova.compute.manager [req-d474fb16-4e69-4c8e-a23d-574fc9649ac1 req-6e78d2ee-7980-40a7-9216-eed81cfbc621 service nova] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Received event network-vif-plugged-c51f288f-44b9-476b-9419-22ef8ae5c900 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-d474fb16-4e69-4c8e-a23d-574fc9649ac1 req-6e78d2ee-7980-40a7-9216-eed81cfbc621 service nova] Acquiring lock "8d5569ce-1f18-4f37-a340-099ee152d548-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-d474fb16-4e69-4c8e-a23d-574fc9649ac1 req-6e78d2ee-7980-40a7-9216-eed81cfbc621 service nova] Lock "8d5569ce-1f18-4f37-a340-099ee152d548-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-d474fb16-4e69-4c8e-a23d-574fc9649ac1 req-6e78d2ee-7980-40a7-9216-eed81cfbc621 service nova] Lock "8d5569ce-1f18-4f37-a340-099ee152d548-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG nova.compute.manager [req-d474fb16-4e69-4c8e-a23d-574fc9649ac1 req-6e78d2ee-7980-40a7-9216-eed81cfbc621 service nova] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] No waiting events found dispatching network-vif-plugged-c51f288f-44b9-476b-9419-22ef8ae5c900 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:11:39 user nova-compute[75165]: WARNING nova.compute.manager [req-d474fb16-4e69-4c8e-a23d-574fc9649ac1 req-6e78d2ee-7980-40a7-9216-eed81cfbc621 service nova] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Received unexpected event network-vif-plugged-c51f288f-44b9-476b-9419-22ef8ae5c900 for instance with vm_state active and task_state deleting.
Oct 26 00:11:39 user nova-compute[75165]: DEBUG nova.compute.manager [req-d474fb16-4e69-4c8e-a23d-574fc9649ac1 req-6e78d2ee-7980-40a7-9216-eed81cfbc621 service nova] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Received event network-vif-unplugged-9cecd3d6-4945-4a4b-8d06-48b0d7768a17 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-d474fb16-4e69-4c8e-a23d-574fc9649ac1 req-6e78d2ee-7980-40a7-9216-eed81cfbc621 service nova] Acquiring lock "8d5569ce-1f18-4f37-a340-099ee152d548-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-d474fb16-4e69-4c8e-a23d-574fc9649ac1 req-6e78d2ee-7980-40a7-9216-eed81cfbc621 service nova] Lock "8d5569ce-1f18-4f37-a340-099ee152d548-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-d474fb16-4e69-4c8e-a23d-574fc9649ac1 req-6e78d2ee-7980-40a7-9216-eed81cfbc621 service nova] Lock "8d5569ce-1f18-4f37-a340-099ee152d548-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG nova.compute.manager [req-d474fb16-4e69-4c8e-a23d-574fc9649ac1 req-6e78d2ee-7980-40a7-9216-eed81cfbc621 service nova] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] No waiting events found dispatching network-vif-unplugged-9cecd3d6-4945-4a4b-8d06-48b0d7768a17 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG nova.compute.manager [req-d474fb16-4e69-4c8e-a23d-574fc9649ac1 req-6e78d2ee-7980-40a7-9216-eed81cfbc621 service nova] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Received event network-vif-unplugged-9cecd3d6-4945-4a4b-8d06-48b0d7768a17 for instance with task_state deleting. {{(pid=75165) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[f159abe0-f973-4a2d-839b-a10ce2587bd0]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-eca5f738-4e10-4c86-b050-c2dcb595d6fa tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75165) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.051s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[9673597f-185d-4819-9459-8a4eebf03341]: (4, ('1', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-eca5f738-4e10-4c86-b050-c2dcb595d6fa tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75165) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-eca5f738-4e10-4c86-b050-c2dcb595d6fa tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] SCSI volumes sdc have been removed. {{(pid=75165) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca5f738-4e10-4c86-b050-c2dcb595d6fa tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f25f6e6a-9711-4455-82e8-c56648a08508')] {{(pid=75165) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f25f6e6a-9711-4455-82e8-c56648a08508 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] Starting migrate_disk_and_power_off {{(pid=75165) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f25f6e6a-9711-4455-82e8-c56648a08508 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3acfd4a-4f72-4f81-9df7-d1bd76a5c304]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca5f738-4e10-4c86-b050-c2dcb595d6fa tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f25f6e6a-9711-4455-82e8-c56648a08508 -p 172.16.0.220:3260 --logout {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f25f6e6a-9711-4455-82e8-c56648a08508 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[0861c30e-813c-4abc-91ac-70cb41172697]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:f25f6e6a-9711-4455-82e8-c56648a08508, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:f25f6e6a-9711-4455-82e8-c56648a08508, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca5f738-4e10-4c86-b050-c2dcb595d6fa tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:f25f6e6a-9711-4455-82e8-c56648a08508, portal: 172.16.0.220,3260]
Oct 26 00:11:39 user nova-compute[75165]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:f25f6e6a-9711-4455-82e8-c56648a08508, portal: 172.16.0.220,3260] successful.
Oct 26 00:11:39 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f25f6e6a-9711-4455-82e8-c56648a08508 -p 172.16.0.220:3260 --op delete {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f25f6e6a-9711-4455-82e8-c56648a08508 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.046s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[c21927ad-c9da-41ad-a37e-026afc7573b8]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca5f738-4e10-4c86-b050-c2dcb595d6fa tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-eca5f738-4e10-4c86-b050-c2dcb595d6fa tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.480s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca5f738-4e10-4c86-b050-c2dcb595d6fa tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] <== disconnect_volume: return (483ms) None {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eca5f738-4e10-4c86-b050-c2dcb595d6fa tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Disconnected iSCSI Volume {{(pid=75165) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eca5f738-4e10-4c86-b050-c2dcb595d6fa tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] calling os-brick to detach iSCSI Volume {{(pid=75165) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca5f738-4e10-4c86-b050-c2dcb595d6fa tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8bf8160e50>, {'target_iqn': 'iqn.2010-10.org.openstack:083f264a-3f29-48b4-9935-a73f4234e6d5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LApzvBig', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:11:39 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-eca5f738-4e10-4c86-b050-c2dcb595d6fa tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:11:39 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-eca5f738-4e10-4c86-b050-c2dcb595d6fa tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-eca5f738-4e10-4c86-b050-c2dcb595d6fa tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:39 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:40 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:40 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:40 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[39750fc0-b53e-4ae5-ae93-0555ef79131c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ff01f329-6dda-43b6-8da5-6a5c48fad211\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:083f264a-3f29-48b4-9935-a73f4234e6d5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:11:40 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca5f738-4e10-4c86-b050-c2dcb595d6fa tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 00:11:40 user nova-compute[75165]: No targets found.
Oct 26 00:11:40 user nova-compute[75165]: iSNS:
Oct 26 00:11:40 user nova-compute[75165]: No targets found.
Oct 26 00:11:40 user nova-compute[75165]: STATIC:
Oct 26 00:11:40 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792
Oct 26 00:11:40 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:11:40 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:11:40 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:ff01f329-6dda-43b6-8da5-6a5c48fad211
Oct 26 00:11:40 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:11:40 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:11:40 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:083f264a-3f29-48b4-9935-a73f4234e6d5
Oct 26 00:11:40 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:11:40 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:11:40 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b
Oct 26 00:11:40 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:11:40 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:11:40 user nova-compute[75165]: FIRMWARE:
Oct 26 00:11:40 user nova-compute[75165]: No targets found.
Oct 26 00:11:40 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:11:40 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca5f738-4e10-4c86-b050-c2dcb595d6fa tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 00:11:40 user nova-compute[75165]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 00:11:40 user nova-compute[75165]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75165) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 00:11:40 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca5f738-4e10-4c86-b050-c2dcb595d6fa tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:083f264a-3f29-48b4-9935-a73f4234e6d5', 0)] {{(pid=75165) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 00:11:40 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:40 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.029s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:40 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[5920aee0-4100-4baf-9b6c-6a8fd7e19bab]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:083f264a-3f29-48b4-9935-a73f4234e6d5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ff01f329-6dda-43b6-8da5-6a5c48fad211\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:11:40 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:40 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:40 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4554e75-6dde-4925-9cc4-193c50e49dce]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:083f264a-3f29-48b4-9935-a73f4234e6d5 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff01f329-6dda-43b6-8da5-6a5c48fad211 (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:11:40 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca5f738-4e10-4c86-b050-c2dcb595d6fa tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792 (non-flash)
Oct 26 00:11:40 user nova-compute[75165]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b (non-flash)
Oct 26 00:11:40 user nova-compute[75165]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:083f264a-3f29-48b4-9935-a73f4234e6d5 (non-flash)
Oct 26 00:11:40 user nova-compute[75165]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff01f329-6dda-43b6-8da5-6a5c48fad211 (non-flash)
Oct 26 00:11:40 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:11:40 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca5f738-4e10-4c86-b050-c2dcb595d6fa tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792 (non-flash)
Oct 26 00:11:40 user nova-compute[75165]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b (non-flash)
Oct 26 00:11:40 user nova-compute[75165]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:083f264a-3f29-48b4-9935-a73f4234e6d5 (non-flash)
Oct 26 00:11:40 user nova-compute[75165]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff01f329-6dda-43b6-8da5-6a5c48fad211 (non-flash)
Oct 26 00:11:40 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:11:40 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca5f738-4e10-4c86-b050-c2dcb595d6fa tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8be04e5c60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:083f264a-3f29-48b4-9935-a73f4234e6d5'): ({'sdd'}, set())}) {{(pid=75165) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 00:11:40 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-eca5f738-4e10-4c86-b050-c2dcb595d6fa tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Removing single pathed devices sdd {{(pid=75165) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 00:11:40 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:40 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.029s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:40 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[18ee451d-cff9-4f43-a816-67dc8bfab784]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:11:40 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:40 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.025s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:40 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[66f39ddf-8069-45af-8665-836ce9c1ba18]: (4, ('ok\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:11:40 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-eca5f738-4e10-4c86-b050-c2dcb595d6fa tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Flushing IO for device /dev/sdd {{(pid=75165) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 00:11:40 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:40 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-25b7cf3b-70f7-42f9-ae34-60f1c9b0de36 tempest-TaggedBootDevicesTest-1951782657 tempest-TaggedBootDevicesTest-1951782657-project-member] Acquiring lock "0d674bd2-7546-41c8-a4cf-3e26ea91edb4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:11:40 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-25b7cf3b-70f7-42f9-ae34-60f1c9b0de36 tempest-TaggedBootDevicesTest-1951782657 tempest-TaggedBootDevicesTest-1951782657-project-member] Lock "0d674bd2-7546-41c8-a4cf-3e26ea91edb4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:11:40 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:40 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[80b2fd57-7883-4128-9db6-fa103b344663]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:11:40 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-eca5f738-4e10-4c86-b050-c2dcb595d6fa tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75165) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 00:11:40 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:40 user nova-compute[75165]: DEBUG nova.compute.manager [None req-25b7cf3b-70f7-42f9-ae34-60f1c9b0de36 tempest-TaggedBootDevicesTest-1951782657 tempest-TaggedBootDevicesTest-1951782657-project-member] [instance: 0d674bd2-7546-41c8-a4cf-3e26ea91edb4] Starting instance... {{(pid=75165) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 00:11:40 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.037s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:40 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[493f6602-e534-48bd-85a2-40696b1936f3]: (4, ('1', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:11:40 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-eca5f738-4e10-4c86-b050-c2dcb595d6fa tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75165) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 00:11:40 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-eca5f738-4e10-4c86-b050-c2dcb595d6fa tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] SCSI volumes sdd have been removed. {{(pid=75165) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 00:11:40 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca5f738-4e10-4c86-b050-c2dcb595d6fa tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:083f264a-3f29-48b4-9935-a73f4234e6d5')] {{(pid=75165) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 00:11:40 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:083f264a-3f29-48b4-9935-a73f4234e6d5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:40 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:083f264a-3f29-48b4-9935-a73f4234e6d5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:40 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[23e89c1d-e7ff-448c-98bd-9a4876e07e56]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:11:40 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca5f738-4e10-4c86-b050-c2dcb595d6fa tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:11:40 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:083f264a-3f29-48b4-9935-a73f4234e6d5 -p 172.16.0.220:3260 --logout {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:40 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-25b7cf3b-70f7-42f9-ae34-60f1c9b0de36 tempest-TaggedBootDevicesTest-1951782657 tempest-TaggedBootDevicesTest-1951782657-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:11:40 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-25b7cf3b-70f7-42f9-ae34-60f1c9b0de36 tempest-TaggedBootDevicesTest-1951782657 tempest-TaggedBootDevicesTest-1951782657-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:11:40 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:083f264a-3f29-48b4-9935-a73f4234e6d5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.099s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:40 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaad9c3a-1658-46ac-a4b4-d2f7c198c853]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:083f264a-3f29-48b4-9935-a73f4234e6d5, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:083f264a-3f29-48b4-9935-a73f4234e6d5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:11:40 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca5f738-4e10-4c86-b050-c2dcb595d6fa tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:083f264a-3f29-48b4-9935-a73f4234e6d5, portal: 172.16.0.220,3260]
Oct 26 00:11:40 user nova-compute[75165]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:083f264a-3f29-48b4-9935-a73f4234e6d5, portal: 172.16.0.220,3260] successful.
Oct 26 00:11:40 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:11:40 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-25b7cf3b-70f7-42f9-ae34-60f1c9b0de36 tempest-TaggedBootDevicesTest-1951782657 tempest-TaggedBootDevicesTest-1951782657-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75165) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 00:11:40 user nova-compute[75165]: INFO nova.compute.claims [None req-25b7cf3b-70f7-42f9-ae34-60f1c9b0de36 tempest-TaggedBootDevicesTest-1951782657 tempest-TaggedBootDevicesTest-1951782657-project-member] [instance: 0d674bd2-7546-41c8-a4cf-3e26ea91edb4] Claim successful on node user
Oct 26 00:11:40 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:083f264a-3f29-48b4-9935-a73f4234e6d5 -p 172.16.0.220:3260 --op delete {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:40 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:083f264a-3f29-48b4-9935-a73f4234e6d5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:40 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e6714a2-2a60-4239-b2cc-e8a90b8ce725]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:11:40 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca5f738-4e10-4c86-b050-c2dcb595d6fa tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:11:40 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-eca5f738-4e10-4c86-b050-c2dcb595d6fa tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.424s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:11:40 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca5f738-4e10-4c86-b050-c2dcb595d6fa tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] <== disconnect_volume: return (426ms) None {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:11:40 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eca5f738-4e10-4c86-b050-c2dcb595d6fa tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Disconnected iSCSI Volume {{(pid=75165) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 00:11:40 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eca5f738-4e10-4c86-b050-c2dcb595d6fa tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] calling os-brick to detach iSCSI Volume {{(pid=75165) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 00:11:40 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca5f738-4e10-4c86-b050-c2dcb595d6fa tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8bf8160e50>, {'target_iqn': 'iqn.2010-10.org.openstack:ff01f329-6dda-43b6-8da5-6a5c48fad211', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IfQbdwhn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:11:40 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-eca5f738-4e10-4c86-b050-c2dcb595d6fa tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:11:40 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-eca5f738-4e10-4c86-b050-c2dcb595d6fa tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:11:40 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-eca5f738-4e10-4c86-b050-c2dcb595d6fa tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:11:40 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:40 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.035s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:40 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[69e58d4d-46e6-4f0e-8de6-49176fcef3ce]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ff01f329-6dda-43b6-8da5-6a5c48fad211\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:11:40 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca5f738-4e10-4c86-b050-c2dcb595d6fa tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 00:11:40 user nova-compute[75165]: No targets found.
Oct 26 00:11:40 user nova-compute[75165]: iSNS:
Oct 26 00:11:40 user nova-compute[75165]: No targets found.
Oct 26 00:11:40 user nova-compute[75165]: STATIC:
Oct 26 00:11:40 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792
Oct 26 00:11:40 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:11:40 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:11:40 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:ff01f329-6dda-43b6-8da5-6a5c48fad211
Oct 26 00:11:40 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:11:40 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:11:40 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b
Oct 26 00:11:40 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:11:40 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:11:40 user nova-compute[75165]: FIRMWARE:
Oct 26 00:11:40 user nova-compute[75165]: No targets found.
Oct 26 00:11:40 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:11:40 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca5f738-4e10-4c86-b050-c2dcb595d6fa tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 00:11:40 user nova-compute[75165]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 00:11:40 user nova-compute[75165]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75165) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 00:11:40 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca5f738-4e10-4c86-b050-c2dcb595d6fa tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ff01f329-6dda-43b6-8da5-6a5c48fad211', 0)] {{(pid=75165) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 00:11:40 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:40 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:40 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8698eac-571c-4c34-8498-ad8647df64ed]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ff01f329-6dda-43b6-8da5-6a5c48fad211\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:11:40 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:40 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:40 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dbefa36-b144-4076-a3ae-3b5086cdecfa]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff01f329-6dda-43b6-8da5-6a5c48fad211 (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:11:40 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca5f738-4e10-4c86-b050-c2dcb595d6fa tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792 (non-flash)
Oct 26 00:11:40 user nova-compute[75165]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b (non-flash)
Oct 26 00:11:40 user nova-compute[75165]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff01f329-6dda-43b6-8da5-6a5c48fad211 (non-flash)
Oct 26 00:11:40 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:11:40 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca5f738-4e10-4c86-b050-c2dcb595d6fa tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792 (non-flash)
Oct 26 00:11:40 user nova-compute[75165]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b (non-flash)
Oct 26 00:11:40 user nova-compute[75165]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff01f329-6dda-43b6-8da5-6a5c48fad211 (non-flash)
Oct 26 00:11:40 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:11:40 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca5f738-4e10-4c86-b050-c2dcb595d6fa tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8c00136b00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ff01f329-6dda-43b6-8da5-6a5c48fad211'): ({'sdf'}, set())}) {{(pid=75165) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 00:11:40 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-eca5f738-4e10-4c86-b050-c2dcb595d6fa tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Removing single pathed devices sdf {{(pid=75165) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 00:11:40 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:40 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:40 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[af538cc8-8394-44f8-9943-93b81613fe18]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:11:40 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:40 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.022s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:40 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c32bf98-6f11-4756-93e5-0f0be521fefa]: (4, ('ok\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:11:40 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-eca5f738-4e10-4c86-b050-c2dcb595d6fa tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Flushing IO for device /dev/sdf {{(pid=75165) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 00:11:40 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:40 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.024s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:40 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8a5662e-e836-485f-bdf5-e957c2df4c21]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:11:40 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-eca5f738-4e10-4c86-b050-c2dcb595d6fa tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75165) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 00:11:40 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:40 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.059s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:40 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ad7a072-ca72-4b69-99b5-67063b4e11a3]: (4, ('1', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:11:40 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-eca5f738-4e10-4c86-b050-c2dcb595d6fa tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75165) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 00:11:40 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-eca5f738-4e10-4c86-b050-c2dcb595d6fa tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] SCSI volumes sdf have been removed. {{(pid=75165) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 00:11:40 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca5f738-4e10-4c86-b050-c2dcb595d6fa tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ff01f329-6dda-43b6-8da5-6a5c48fad211')] {{(pid=75165) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 00:11:40 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff01f329-6dda-43b6-8da5-6a5c48fad211 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:40 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] Instance destroyed successfully.
Oct 26 00:11:40 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:07:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1649801525',display_name='tempest-ServerActionsTestOtherB-server-1649801525',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1649801525',id=7,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOvLHGJ3GKBbD7yL0+CRyOJiq2ETP4pGNCe7wwUyptp7nQivcPunaHj7Jl8TaU2mAtfcWQAgpHGkK+GRkPrduKn69eOts5d8qkM1kDwYiMG7whEGtVeGR66PH/dfoMGjVA==',key_name='tempest-keypair-513358976',keypairs=<?>,launch_index=0,launched_at=2023-10-26T00:07:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0db2c49ee28f4b7b9fa990faddb9d3a9',ramdisk_id='',reservation_id='r-tna5v2cw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-238342146',owner_user_name='tempest-ServerActionsTestOtherB-238342146-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T00:11:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43f095bccf684d5a84b874439f2c58e0',uuid=3b153af2-c93b-47d2-ae8c-76cfd44e384c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "874a1698-c52c-444c-bed5-52633dbaeead", "address": "fa:16:3e:75:45:79", "network": {"id": "30951418-d830-4042-9143-c736802150e9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-167387787-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-167387787-network", "vif_mac": "fa:16:3e:75:45:79"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0db2c49ee28f4b7b9fa990faddb9d3a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap874a1698-c5", "ovs_interfaceid": "874a1698-c52c-444c-bed5-52633dbaeead", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 00:11:40 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Converting VIF {"id": "874a1698-c52c-444c-bed5-52633dbaeead", "address": "fa:16:3e:75:45:79", "network": {"id": "30951418-d830-4042-9143-c736802150e9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-167387787-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-167387787-network", "vif_mac": "fa:16:3e:75:45:79"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0db2c49ee28f4b7b9fa990faddb9d3a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap874a1698-c5", "ovs_interfaceid": "874a1698-c52c-444c-bed5-52633dbaeead", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:11:40 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:75:45:79,bridge_name='br-int',has_traffic_filtering=True,id=874a1698-c52c-444c-bed5-52633dbaeead,network=Network(30951418-d830-4042-9143-c736802150e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap874a1698-c5') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:11:40 user nova-compute[75165]: DEBUG os_vif [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:75:45:79,bridge_name='br-int',has_traffic_filtering=True,id=874a1698-c52c-444c-bed5-52633dbaeead,network=Network(30951418-d830-4042-9143-c736802150e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap874a1698-c5') {{(pid=75165) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 00:11:40 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:40 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap874a1698-c5, bridge=br-int, if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:11:40 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:40 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff01f329-6dda-43b6-8da5-6a5c48fad211 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.037s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:40 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[27f6b0f3-2971-4f3f-b3a7-5e3f339689ff]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:11:40 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca5f738-4e10-4c86-b050-c2dcb595d6fa tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:11:40 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:11:40 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:40 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2437f093-cbb3-4af7-8d0b-a827e2150978) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:11:40 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:40 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff01f329-6dda-43b6-8da5-6a5c48fad211 -p 172.16.0.220:3260 --logout {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:40 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:11:40 user nova-compute[75165]: INFO os_vif [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:75:45:79,bridge_name='br-int',has_traffic_filtering=True,id=874a1698-c52c-444c-bed5-52633dbaeead,network=Network(30951418-d830-4042-9143-c736802150e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap874a1698-c5')
Oct 26 00:11:40 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] calling os-brick to detach iSCSI Volume {{(pid=75165) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 00:11:40 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8bf8160e50>, {'target_iqn': 'iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AokCQquF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:11:40 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:11:40 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:11:40 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff01f329-6dda-43b6-8da5-6a5c48fad211 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:40 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[35b2260b-f1b6-4440-98d5-884f4e7f9212]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:ff01f329-6dda-43b6-8da5-6a5c48fad211, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:ff01f329-6dda-43b6-8da5-6a5c48fad211, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:11:40 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca5f738-4e10-4c86-b050-c2dcb595d6fa tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:ff01f329-6dda-43b6-8da5-6a5c48fad211, portal: 172.16.0.220,3260]
Oct 26 00:11:40 user nova-compute[75165]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:ff01f329-6dda-43b6-8da5-6a5c48fad211, portal: 172.16.0.220,3260] successful.
Oct 26 00:11:40 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:11:40 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff01f329-6dda-43b6-8da5-6a5c48fad211 -p 172.16.0.220:3260 --op delete {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:40 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff01f329-6dda-43b6-8da5-6a5c48fad211 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:40 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[67427f36-b032-45f3-a209-8516adb24ce7]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:11:40 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca5f738-4e10-4c86-b050-c2dcb595d6fa tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:11:40 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-eca5f738-4e10-4c86-b050-c2dcb595d6fa tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.432s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:11:40 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-eca5f738-4e10-4c86-b050-c2dcb595d6fa tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] <== disconnect_volume: return (434ms) None {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:11:40 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eca5f738-4e10-4c86-b050-c2dcb595d6fa tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Disconnected iSCSI Volume {{(pid=75165) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 00:11:40 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-eca5f738-4e10-4c86-b050-c2dcb595d6fa tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Deleting instance files /opt/stack/data/nova/instances/8d5569ce-1f18-4f37-a340-099ee152d548_del
Oct 26 00:11:40 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-eca5f738-4e10-4c86-b050-c2dcb595d6fa tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Deletion of /opt/stack/data/nova/instances/8d5569ce-1f18-4f37-a340-099ee152d548_del complete
Oct 26 00:11:40 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.105s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:11:40 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:40 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:40 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fbf9efb-1d1c-469e-999a-aa90e3efa714]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:11:40 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 00:11:40 user nova-compute[75165]: No targets found.
Oct 26 00:11:40 user nova-compute[75165]: iSNS:
Oct 26 00:11:40 user nova-compute[75165]: No targets found.
Oct 26 00:11:40 user nova-compute[75165]: STATIC:
Oct 26 00:11:40 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792
Oct 26 00:11:40 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:11:40 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:11:40 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b
Oct 26 00:11:40 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:11:40 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:11:40 user nova-compute[75165]: FIRMWARE:
Oct 26 00:11:40 user nova-compute[75165]: No targets found.
Oct 26 00:11:40 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:11:40 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 00:11:40 user nova-compute[75165]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 00:11:40 user nova-compute[75165]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75165) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 00:11:40 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b', 0)] {{(pid=75165) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 00:11:40 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:40 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.052s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:40 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[632df3e7-31ba-4658-b8d5-61f191b78856]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:11:40 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:40 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:40 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ae36824-55eb-4e54-9ce9-307935384ebb]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:11:40 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792 (non-flash)
Oct 26 00:11:40 user nova-compute[75165]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b (non-flash)
Oct 26 00:11:40 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:11:40 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792 (non-flash)
Oct 26 00:11:40 user nova-compute[75165]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b (non-flash)
Oct 26 00:11:40 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:11:40 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8be04e5120>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b'): ({'sde'}, set())}) {{(pid=75165) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 00:11:40 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Removing single pathed devices sde {{(pid=75165) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 00:11:40 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:40 user nova-compute[75165]: INFO nova.compute.manager [None req-eca5f738-4e10-4c86-b050-c2dcb595d6fa tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Took 5.05 seconds to destroy the instance on the hypervisor.
Oct 26 00:11:40 user nova-compute[75165]: DEBUG oslo.service.loopingcall [None req-eca5f738-4e10-4c86-b050-c2dcb595d6fa tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75165) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 00:11:40 user nova-compute[75165]: DEBUG nova.compute.manager [-] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Deallocating network for instance {{(pid=75165) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 00:11:40 user nova-compute[75165]: DEBUG nova.network.neutron [-] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] deallocate_for_instance() {{(pid=75165) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 00:11:41 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:41 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[2349775e-3708-46d0-8abc-a7400593c5da]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:11:41 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-25b7cf3b-70f7-42f9-ae34-60f1c9b0de36 tempest-TaggedBootDevicesTest-1951782657 tempest-TaggedBootDevicesTest-1951782657-project-member] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:11:41 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:41 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-25b7cf3b-70f7-42f9-ae34-60f1c9b0de36 tempest-TaggedBootDevicesTest-1951782657 tempest-TaggedBootDevicesTest-1951782657-project-member] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:11:41 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:41 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1f480d1-d9c0-4b5e-8bd7-7d77fb8de0a2]: (4, ('ok\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:11:41 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Flushing IO for device /dev/sde {{(pid=75165) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 00:11:41 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:41 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.017s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:41 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[e07d1fdd-9cb3-4c98-8d14-c5b0d5c3e7ba]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:11:41 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75165) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 00:11:41 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:41 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-25b7cf3b-70f7-42f9-ae34-60f1c9b0de36 tempest-TaggedBootDevicesTest-1951782657 tempest-TaggedBootDevicesTest-1951782657-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.838s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:11:41 user nova-compute[75165]: DEBUG nova.compute.manager [None req-25b7cf3b-70f7-42f9-ae34-60f1c9b0de36 tempest-TaggedBootDevicesTest-1951782657 tempest-TaggedBootDevicesTest-1951782657-project-member] [instance: 0d674bd2-7546-41c8-a4cf-3e26ea91edb4] Start building networks asynchronously for instance. {{(pid=75165) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 00:11:41 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.098s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:41 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfecbe30-b595-4095-9c86-9c460cf19614]: (4, ('1', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:11:41 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75165) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 00:11:41 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] SCSI volumes sde have been removed. {{(pid=75165) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 00:11:41 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b')] {{(pid=75165) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 00:11:41 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:41 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:41 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[91be6381-e751-451e-8d2d-c1f5820de016]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:11:41 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:11:41 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b -p 172.16.0.220:3260 --logout {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:41 user nova-compute[75165]: DEBUG nova.compute.manager [None req-25b7cf3b-70f7-42f9-ae34-60f1c9b0de36 tempest-TaggedBootDevicesTest-1951782657 tempest-TaggedBootDevicesTest-1951782657-project-member] [instance: 0d674bd2-7546-41c8-a4cf-3e26ea91edb4] Allocating IP information in the background. {{(pid=75165) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 00:11:41 user nova-compute[75165]: DEBUG nova.network.neutron [None req-25b7cf3b-70f7-42f9-ae34-60f1c9b0de36 tempest-TaggedBootDevicesTest-1951782657 tempest-TaggedBootDevicesTest-1951782657-project-member] [instance: 0d674bd2-7546-41c8-a4cf-3e26ea91edb4] allocate_for_instance() {{(pid=75165) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 00:11:41 user nova-compute[75165]: DEBUG nova.compute.manager [req-bac2622e-96ac-4101-aff9-0c9c6bc421f2 req-4e2effd8-c7b0-41bd-aee0-7be96be51490 service nova] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] Received event network-vif-unplugged-874a1698-c52c-444c-bed5-52633dbaeead {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:11:41 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-bac2622e-96ac-4101-aff9-0c9c6bc421f2 req-4e2effd8-c7b0-41bd-aee0-7be96be51490 service nova] Acquiring lock "3b153af2-c93b-47d2-ae8c-76cfd44e384c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:11:41 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-bac2622e-96ac-4101-aff9-0c9c6bc421f2 req-4e2effd8-c7b0-41bd-aee0-7be96be51490 service nova] Lock "3b153af2-c93b-47d2-ae8c-76cfd44e384c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:11:41 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-bac2622e-96ac-4101-aff9-0c9c6bc421f2 req-4e2effd8-c7b0-41bd-aee0-7be96be51490 service nova] Lock "3b153af2-c93b-47d2-ae8c-76cfd44e384c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:11:41 user nova-compute[75165]: DEBUG nova.compute.manager [req-bac2622e-96ac-4101-aff9-0c9c6bc421f2 req-4e2effd8-c7b0-41bd-aee0-7be96be51490 service nova] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] No waiting events found dispatching network-vif-unplugged-874a1698-c52c-444c-bed5-52633dbaeead {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:11:41 user nova-compute[75165]: WARNING nova.compute.manager [req-bac2622e-96ac-4101-aff9-0c9c6bc421f2 req-4e2effd8-c7b0-41bd-aee0-7be96be51490 service nova] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] Received unexpected event network-vif-unplugged-874a1698-c52c-444c-bed5-52633dbaeead for instance with vm_state active and task_state resize_migrating.
Oct 26 00:11:41 user nova-compute[75165]: DEBUG nova.compute.manager [req-bac2622e-96ac-4101-aff9-0c9c6bc421f2 req-4e2effd8-c7b0-41bd-aee0-7be96be51490 service nova] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] Received event network-vif-plugged-874a1698-c52c-444c-bed5-52633dbaeead {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:11:41 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-bac2622e-96ac-4101-aff9-0c9c6bc421f2 req-4e2effd8-c7b0-41bd-aee0-7be96be51490 service nova] Acquiring lock "3b153af2-c93b-47d2-ae8c-76cfd44e384c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:11:41 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-bac2622e-96ac-4101-aff9-0c9c6bc421f2 req-4e2effd8-c7b0-41bd-aee0-7be96be51490 service nova] Lock "3b153af2-c93b-47d2-ae8c-76cfd44e384c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:11:41 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-bac2622e-96ac-4101-aff9-0c9c6bc421f2 req-4e2effd8-c7b0-41bd-aee0-7be96be51490 service nova] Lock "3b153af2-c93b-47d2-ae8c-76cfd44e384c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:11:41 user nova-compute[75165]: DEBUG nova.compute.manager [req-bac2622e-96ac-4101-aff9-0c9c6bc421f2 req-4e2effd8-c7b0-41bd-aee0-7be96be51490 service nova] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] No waiting events found dispatching network-vif-plugged-874a1698-c52c-444c-bed5-52633dbaeead {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:11:41 user nova-compute[75165]: WARNING nova.compute.manager [req-bac2622e-96ac-4101-aff9-0c9c6bc421f2 req-4e2effd8-c7b0-41bd-aee0-7be96be51490 service nova] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] Received unexpected event network-vif-plugged-874a1698-c52c-444c-bed5-52633dbaeead for instance with vm_state active and task_state resize_migrating.
Oct 26 00:11:41 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:41 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[03a59fd7-886c-4ed0-8429-b7a971d1c245]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:11:41 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-25b7cf3b-70f7-42f9-ae34-60f1c9b0de36 tempest-TaggedBootDevicesTest-1951782657 tempest-TaggedBootDevicesTest-1951782657-project-member] [instance: 0d674bd2-7546-41c8-a4cf-3e26ea91edb4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 00:11:41 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b, portal: 172.16.0.220,3260]
Oct 26 00:11:41 user nova-compute[75165]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b, portal: 172.16.0.220,3260] successful.
Oct 26 00:11:41 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:11:41 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b -p 172.16.0.220:3260 --op delete {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:41 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:41 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[967bc1b3-6042-45af-afe2-66e68b059f59]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:11:41 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:11:41 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.558s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:11:41 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] <== disconnect_volume: return (663ms) None {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:11:41 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] Disconnected iSCSI Volume {{(pid=75165) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 00:11:41 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b153af2-c93b-47d2-ae8c-76cfd44e384c/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:41 user nova-compute[75165]: DEBUG nova.compute.manager [None req-25b7cf3b-70f7-42f9-ae34-60f1c9b0de36 tempest-TaggedBootDevicesTest-1951782657 tempest-TaggedBootDevicesTest-1951782657-project-member] [instance: 0d674bd2-7546-41c8-a4cf-3e26ea91edb4] Start building block device mappings for instance. {{(pid=75165) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 00:11:41 user nova-compute[75165]: DEBUG nova.policy [None req-25b7cf3b-70f7-42f9-ae34-60f1c9b0de36 tempest-TaggedBootDevicesTest-1951782657 tempest-TaggedBootDevicesTest-1951782657-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '707cd714958c4e908fa0d6c258a72a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd12c108abe0403d946f213bcd130ef2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75165) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 00:11:41 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b153af2-c93b-47d2-ae8c-76cfd44e384c/disk --force-share --output=json" returned: 0 in 0.318s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:41 user nova-compute[75165]: INFO nova.virt.block_device [None req-25b7cf3b-70f7-42f9-ae34-60f1c9b0de36 tempest-TaggedBootDevicesTest-1951782657 tempest-TaggedBootDevicesTest-1951782657-project-member] [instance: 0d674bd2-7546-41c8-a4cf-3e26ea91edb4] Booting with volume fa6fd683-7355-4a71-a2b9-a9f5846103c9 at /dev/vda
Oct 26 00:11:41 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b153af2-c93b-47d2-ae8c-76cfd44e384c/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:41 user nova-compute[75165]: DEBUG nova.compute.manager [req-827ad5f5-7fd6-4805-a05e-c67b44815a78 req-b272b1cb-0ce1-4bde-a888-9a164bb64bc2 service nova] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Received event network-vif-plugged-9cecd3d6-4945-4a4b-8d06-48b0d7768a17 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:11:41 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-827ad5f5-7fd6-4805-a05e-c67b44815a78 req-b272b1cb-0ce1-4bde-a888-9a164bb64bc2 service nova] Acquiring lock "8d5569ce-1f18-4f37-a340-099ee152d548-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:11:41 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-827ad5f5-7fd6-4805-a05e-c67b44815a78 req-b272b1cb-0ce1-4bde-a888-9a164bb64bc2 service nova] Lock "8d5569ce-1f18-4f37-a340-099ee152d548-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:11:41 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-827ad5f5-7fd6-4805-a05e-c67b44815a78 req-b272b1cb-0ce1-4bde-a888-9a164bb64bc2 service nova] Lock "8d5569ce-1f18-4f37-a340-099ee152d548-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:11:41 user nova-compute[75165]: DEBUG nova.compute.manager [req-827ad5f5-7fd6-4805-a05e-c67b44815a78 req-b272b1cb-0ce1-4bde-a888-9a164bb64bc2 service nova] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] No waiting events found dispatching network-vif-plugged-9cecd3d6-4945-4a4b-8d06-48b0d7768a17 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:11:41 user nova-compute[75165]: WARNING nova.compute.manager [req-827ad5f5-7fd6-4805-a05e-c67b44815a78 req-b272b1cb-0ce1-4bde-a888-9a164bb64bc2 service nova] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Received unexpected event network-vif-plugged-9cecd3d6-4945-4a4b-8d06-48b0d7768a17 for instance with vm_state active and task_state deleting.
Oct 26 00:11:41 user nova-compute[75165]: DEBUG nova.compute.manager [req-827ad5f5-7fd6-4805-a05e-c67b44815a78 req-b272b1cb-0ce1-4bde-a888-9a164bb64bc2 service nova] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Received event network-vif-unplugged-a04b8134-03e6-45f2-b6d7-3ea6a7deb81c {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:11:41 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-827ad5f5-7fd6-4805-a05e-c67b44815a78 req-b272b1cb-0ce1-4bde-a888-9a164bb64bc2 service nova] Acquiring lock "8d5569ce-1f18-4f37-a340-099ee152d548-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:11:41 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-827ad5f5-7fd6-4805-a05e-c67b44815a78 req-b272b1cb-0ce1-4bde-a888-9a164bb64bc2 service nova] Lock "8d5569ce-1f18-4f37-a340-099ee152d548-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:11:41 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-827ad5f5-7fd6-4805-a05e-c67b44815a78 req-b272b1cb-0ce1-4bde-a888-9a164bb64bc2 service nova] Lock "8d5569ce-1f18-4f37-a340-099ee152d548-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:11:41 user nova-compute[75165]: DEBUG nova.compute.manager [req-827ad5f5-7fd6-4805-a05e-c67b44815a78 req-b272b1cb-0ce1-4bde-a888-9a164bb64bc2 service nova] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] No waiting events found dispatching network-vif-unplugged-a04b8134-03e6-45f2-b6d7-3ea6a7deb81c {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:11:41 user nova-compute[75165]: DEBUG nova.compute.manager [req-827ad5f5-7fd6-4805-a05e-c67b44815a78 req-b272b1cb-0ce1-4bde-a888-9a164bb64bc2 service nova] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Received event network-vif-unplugged-a04b8134-03e6-45f2-b6d7-3ea6a7deb81c for instance with task_state deleting. {{(pid=75165) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 00:11:41 user nova-compute[75165]: DEBUG nova.compute.manager [req-827ad5f5-7fd6-4805-a05e-c67b44815a78 req-b272b1cb-0ce1-4bde-a888-9a164bb64bc2 service nova] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Received event network-vif-plugged-a04b8134-03e6-45f2-b6d7-3ea6a7deb81c {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:11:41 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-827ad5f5-7fd6-4805-a05e-c67b44815a78 req-b272b1cb-0ce1-4bde-a888-9a164bb64bc2 service nova] Acquiring lock "8d5569ce-1f18-4f37-a340-099ee152d548-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:11:41 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-827ad5f5-7fd6-4805-a05e-c67b44815a78 req-b272b1cb-0ce1-4bde-a888-9a164bb64bc2 service nova] Lock "8d5569ce-1f18-4f37-a340-099ee152d548-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:11:41 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-827ad5f5-7fd6-4805-a05e-c67b44815a78 req-b272b1cb-0ce1-4bde-a888-9a164bb64bc2 service nova] Lock "8d5569ce-1f18-4f37-a340-099ee152d548-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:11:41 user nova-compute[75165]: DEBUG nova.compute.manager [req-827ad5f5-7fd6-4805-a05e-c67b44815a78 req-b272b1cb-0ce1-4bde-a888-9a164bb64bc2 service nova] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] No waiting events found dispatching network-vif-plugged-a04b8134-03e6-45f2-b6d7-3ea6a7deb81c {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:11:41 user nova-compute[75165]: WARNING nova.compute.manager [req-827ad5f5-7fd6-4805-a05e-c67b44815a78 req-b272b1cb-0ce1-4bde-a888-9a164bb64bc2 service nova] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Received unexpected event network-vif-plugged-a04b8134-03e6-45f2-b6d7-3ea6a7deb81c for instance with vm_state active and task_state deleting.
Oct 26 00:11:41 user nova-compute[75165]: DEBUG nova.compute.manager [req-827ad5f5-7fd6-4805-a05e-c67b44815a78 req-b272b1cb-0ce1-4bde-a888-9a164bb64bc2 service nova] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Received event network-vif-unplugged-03ee4dbc-d46d-4127-a4e0-d308a1c8beae {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:11:41 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-827ad5f5-7fd6-4805-a05e-c67b44815a78 req-b272b1cb-0ce1-4bde-a888-9a164bb64bc2 service nova] Acquiring lock "8d5569ce-1f18-4f37-a340-099ee152d548-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:11:41 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-827ad5f5-7fd6-4805-a05e-c67b44815a78 req-b272b1cb-0ce1-4bde-a888-9a164bb64bc2 service nova] Lock "8d5569ce-1f18-4f37-a340-099ee152d548-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:11:41 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-827ad5f5-7fd6-4805-a05e-c67b44815a78 req-b272b1cb-0ce1-4bde-a888-9a164bb64bc2 service nova] Lock "8d5569ce-1f18-4f37-a340-099ee152d548-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:11:41 user nova-compute[75165]: DEBUG nova.compute.manager [req-827ad5f5-7fd6-4805-a05e-c67b44815a78 req-b272b1cb-0ce1-4bde-a888-9a164bb64bc2 service nova] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] No waiting events found dispatching network-vif-unplugged-03ee4dbc-d46d-4127-a4e0-d308a1c8beae {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:11:41 user nova-compute[75165]: DEBUG nova.compute.manager [req-827ad5f5-7fd6-4805-a05e-c67b44815a78 req-b272b1cb-0ce1-4bde-a888-9a164bb64bc2 service nova] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Received event network-vif-unplugged-03ee4dbc-d46d-4127-a4e0-d308a1c8beae for instance with task_state deleting. {{(pid=75165) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 00:11:41 user nova-compute[75165]: DEBUG os_brick.utils [None req-25b7cf3b-70f7-42f9-ae34-60f1c9b0de36 tempest-TaggedBootDevicesTest-1951782657 tempest-TaggedBootDevicesTest-1951782657-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:11:41 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:41 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b153af2-c93b-47d2-ae8c-76cfd44e384c/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:41 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75165) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 00:11:41 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/3b153af2-c93b-47d2-ae8c-76cfd44e384c_resize/disk /opt/stack/data/nova/instances/3b153af2-c93b-47d2-ae8c-76cfd44e384c/disk {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:42 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.022s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:42 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[084ac100-9fb7-4b25-8c0f-2692c001c974]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa94814ccb35\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:11:42 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:42 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.026s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:42 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[d322e946-1044-49a3-a0d4-3fba242822bc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:11:42 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:42 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:42 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.027s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:42 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8616278-e3f3-4895-9eca-3c6544387841]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:11:42 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[79649592-aef2-43a4-a677-7a2fd5edccbe]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:11:42 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-25b7cf3b-70f7-42f9-ae34-60f1c9b0de36 tempest-TaggedBootDevicesTest-1951782657 tempest-TaggedBootDevicesTest-1951782657-project-member] Running cmd (subprocess): nvme version {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:42 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-25b7cf3b-70f7-42f9-ae34-60f1c9b0de36 tempest-TaggedBootDevicesTest-1951782657 tempest-TaggedBootDevicesTest-1951782657-project-member] 'nvme version' failed. Not Retrying. {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 00:11:42 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.nvmeof [None req-25b7cf3b-70f7-42f9-ae34-60f1c9b0de36 tempest-TaggedBootDevicesTest-1951782657 tempest-TaggedBootDevicesTest-1951782657-project-member] nvme not present on system {{(pid=75165) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 00:11:42 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:42 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 00:11:42 user nova-compute[75165]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 00:11:42 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[be13daf2-4d16-4929-941b-7f31ee939361]: (4, '') {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:11:42 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-25b7cf3b-70f7-42f9-ae34-60f1c9b0de36 tempest-TaggedBootDevicesTest-1951782657 tempest-TaggedBootDevicesTest-1951782657-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75165) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 00:11:42 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-25b7cf3b-70f7-42f9-ae34-60f1c9b0de36 tempest-TaggedBootDevicesTest-1951782657 tempest-TaggedBootDevicesTest-1951782657-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75165) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 00:11:42 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-25b7cf3b-70f7-42f9-ae34-60f1c9b0de36 tempest-TaggedBootDevicesTest-1951782657 tempest-TaggedBootDevicesTest-1951782657-project-member] LIGHTOS: no hostnqn found. {{(pid=75165) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 00:11:42 user nova-compute[75165]: DEBUG os_brick.utils [None req-25b7cf3b-70f7-42f9-ae34-60f1c9b0de36 tempest-TaggedBootDevicesTest-1951782657 tempest-TaggedBootDevicesTest-1951782657-project-member] <== get_connector_properties: return (232ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa94814ccb35', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:11:42 user nova-compute[75165]: DEBUG nova.virt.block_device [None req-25b7cf3b-70f7-42f9-ae34-60f1c9b0de36 tempest-TaggedBootDevicesTest-1951782657 tempest-TaggedBootDevicesTest-1951782657-project-member] [instance: 0d674bd2-7546-41c8-a4cf-3e26ea91edb4] Updating existing volume attachment record: fb68e9de-6219-4be5-b00a-572dedf6d06a {{(pid=75165) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 00:11:42 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-1391af4e-f17d-4343-b3d6-46a1950775f0 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 -F raw /opt/stack/data/nova/instances/6f9add59-cabe-4965-8fe3-524618550581/disk" returned: 0 in 2.835s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:42 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-1391af4e-f17d-4343-b3d6-46a1950775f0 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] [instance: 6f9add59-cabe-4965-8fe3-524618550581] Created local disks {{(pid=75165) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 00:11:42 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-1391af4e-f17d-4343-b3d6-46a1950775f0 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] [instance: 6f9add59-cabe-4965-8fe3-524618550581] Ensure instance console log exists: /opt/stack/data/nova/instances/6f9add59-cabe-4965-8fe3-524618550581/console.log {{(pid=75165) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 00:11:42 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-1391af4e-f17d-4343-b3d6-46a1950775f0 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:11:42 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-1391af4e-f17d-4343-b3d6-46a1950775f0 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:11:42 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-1391af4e-f17d-4343-b3d6-46a1950775f0 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:11:42 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-1391af4e-f17d-4343-b3d6-46a1950775f0 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] [instance: 6f9add59-cabe-4965-8fe3-524618550581] Start _get_guest_xml network_info=[{"id": "50bf388e-b8ff-4924-9633-7e97d083a361", "address": "fa:16:3e:16:28:b9", "network": {"id": "f54e2e9f-5c1e-44ca-bd4b-9cf0747b0f72", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-806146051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "920152101768459baa71010b380ea8f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50bf388e-b8", "ovs_interfaceid": "50bf388e-b8ff-4924-9633-7e97d083a361", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='03a5147f37defaf3d6e9ec3b32eae0ff',container_format='bare',created_at=2023-10-26T00:09:14Z,direct_url=<?>,disk_format='qcow2',id=5aa869d5-afcc-4629-94af-7f8f2484dc5a,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-444593788-shelved',owner='920152101768459baa71010b380ea8f1',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-26T00:09:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'size': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': 'bff0d8a1-739e-4c4d-9efa-b73ba7b76d01'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'mount_device': '/dev/vdc', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3664944a-e477-4f40-9b8f-2dce50a14ea8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UxTrGBel', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '6f9add59-cabe-4965-8fe3-524618550581', 'attached_at': '', 'detached_at': '', 'volume_id': '3664944a-e477-4f40-9b8f-2dce50a14ea8', 'serial': '3664944a-e477-4f40-9b8f-2dce50a14ea8'}, 'guest_format': None, 'boot_index': None, 'disk_bus': 'virtio', 'attachment_id': '03e51995-17d3-4e40-bb5f-d5e803ca6470', 'delete_on_termination': False, 'volume_type': None} {{(pid=75165) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 00:11:42 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-1391af4e-f17d-4343-b3d6-46a1950775f0 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:11:42 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-1391af4e-f17d-4343-b3d6-46a1950775f0 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:11:42 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-1391af4e-f17d-4343-b3d6-46a1950775f0 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75165) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 00:11:42 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-1391af4e-f17d-4343-b3d6-46a1950775f0 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] CPU controller missing on host. {{(pid=75165) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 00:11:42 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-1391af4e-f17d-4343-b3d6-46a1950775f0 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75165) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 00:11:42 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-1391af4e-f17d-4343-b3d6-46a1950775f0 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] CPU controller found on host. {{(pid=75165) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 00:11:42 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-1391af4e-f17d-4343-b3d6-46a1950775f0 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75165) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 00:11:42 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-1391af4e-f17d-4343-b3d6-46a1950775f0 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T00:03:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='03a5147f37defaf3d6e9ec3b32eae0ff',container_format='bare',created_at=2023-10-26T00:09:14Z,direct_url=<?>,disk_format='qcow2',id=5aa869d5-afcc-4629-94af-7f8f2484dc5a,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-444593788-shelved',owner='920152101768459baa71010b380ea8f1',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-26T00:09:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 00:11:42 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-1391af4e-f17d-4343-b3d6-46a1950775f0 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Flavor limits 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 00:11:42 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-1391af4e-f17d-4343-b3d6-46a1950775f0 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Image limits 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 00:11:42 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-1391af4e-f17d-4343-b3d6-46a1950775f0 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Flavor pref 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 00:11:42 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-1391af4e-f17d-4343-b3d6-46a1950775f0 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Image pref 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 00:11:42 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-1391af4e-f17d-4343-b3d6-46a1950775f0 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 00:11:42 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-1391af4e-f17d-4343-b3d6-46a1950775f0 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 00:11:42 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-1391af4e-f17d-4343-b3d6-46a1950775f0 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75165) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 00:11:42 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-1391af4e-f17d-4343-b3d6-46a1950775f0 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Got 1 possible topologies {{(pid=75165) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 00:11:42 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-1391af4e-f17d-4343-b3d6-46a1950775f0 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 00:11:42 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-1391af4e-f17d-4343-b3d6-46a1950775f0 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 00:11:42 user nova-compute[75165]: DEBUG nova.objects.instance [None req-1391af4e-f17d-4343-b3d6-46a1950775f0 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6f9add59-cabe-4965-8fe3-524618550581 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:11:42 user nova-compute[75165]: DEBUG nova.objects.base [None req-1391af4e-f17d-4343-b3d6-46a1950775f0 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Object Instance<6f9add59-cabe-4965-8fe3-524618550581> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75165) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 00:11:42 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1391af4e-f17d-4343-b3d6-46a1950775f0 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] [instance: 6f9add59-cabe-4965-8fe3-524618550581] Calling os-brick to attach iSCSI Volume {{(pid=75165) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 00:11:42 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-1391af4e-f17d-4343-b3d6-46a1950775f0 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8bf8160e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3664944a-e477-4f40-9b8f-2dce50a14ea8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UxTrGBel', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:11:42 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-1391af4e-f17d-4343-b3d6-46a1950775f0 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:11:42 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-1391af4e-f17d-4343-b3d6-46a1950775f0 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:11:42 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-1391af4e-f17d-4343-b3d6-46a1950775f0 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:11:42 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-1391af4e-f17d-4343-b3d6-46a1950775f0 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:11:42 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-1391af4e-f17d-4343-b3d6-46a1950775f0 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3664944a-e477-4f40-9b8f-2dce50a14ea8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:11:42 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-1391af4e-f17d-4343-b3d6-46a1950775f0 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3664944a-e477-4f40-9b8f-2dce50a14ea8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:11:42 user nova-compute[75165]: INFO os_brick.initiator.connectors.iscsi [None req-1391af4e-f17d-4343-b3d6-46a1950775f0 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 00:11:42 user nova-compute[75165]: DEBUG nova.network.neutron [None req-25b7cf3b-70f7-42f9-ae34-60f1c9b0de36 tempest-TaggedBootDevicesTest-1951782657 tempest-TaggedBootDevicesTest-1951782657-project-member] [instance: 0d674bd2-7546-41c8-a4cf-3e26ea91edb4] Successfully created port: d43c2029-2e2c-4a0b-b357-3842f7ff6ef4 {{(pid=75165) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 00:11:42 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] CMD "cp -r /opt/stack/data/nova/instances/3b153af2-c93b-47d2-ae8c-76cfd44e384c_resize/disk /opt/stack/data/nova/instances/3b153af2-c93b-47d2-ae8c-76cfd44e384c/disk" returned: 0 in 0.470s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:42 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/3b153af2-c93b-47d2-ae8c-76cfd44e384c_resize/disk.info /opt/stack/data/nova/instances/3b153af2-c93b-47d2-ae8c-76cfd44e384c/disk.info {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:42 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3664944a-e477-4f40-9b8f-2dce50a14ea8 -p 172.16.0.220:3260 {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:42 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3664944a-e477-4f40-9b8f-2dce50a14ea8 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:42 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[a234b8ee-8595-47ec-b732-36a80d233f3a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:11:42 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-1391af4e-f17d-4343-b3d6-46a1950775f0 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 00:11:42 user nova-compute[75165]:  {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:11:42 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] CMD "cp -r /opt/stack/data/nova/instances/3b153af2-c93b-47d2-ae8c-76cfd44e384c_resize/disk.info /opt/stack/data/nova/instances/3b153af2-c93b-47d2-ae8c-76cfd44e384c/disk.info" returned: 0 in 0.044s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:42 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3664944a-e477-4f40-9b8f-2dce50a14ea8 -p 172.16.0.220:3260 --interface default --op new {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:42 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3664944a-e477-4f40-9b8f-2dce50a14ea8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:42 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[96d7f5f8-37f1-4ded-b2da-ce85820e041a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3664944a-e477-4f40-9b8f-2dce50a14ea8] added\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:11:42 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-1391af4e-f17d-4343-b3d6-46a1950775f0 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3664944a-e477-4f40-9b8f-2dce50a14ea8] added
Oct 26 00:11:42 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:11:42 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3664944a-e477-4f40-9b8f-2dce50a14ea8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:42 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3664944a-e477-4f40-9b8f-2dce50a14ea8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:42 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ddb0d8f-6571-4c9c-bfca-af3e71b8b01e]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:11:42 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-1391af4e-f17d-4343-b3d6-46a1950775f0 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:11:42 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3664944a-e477-4f40-9b8f-2dce50a14ea8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:42 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3664944a-e477-4f40-9b8f-2dce50a14ea8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:42 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfe3a6a6-7b77-418a-9e81-2bcc28881a4c]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:11:42 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-1391af4e-f17d-4343-b3d6-46a1950775f0 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:11:42 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3664944a-e477-4f40-9b8f-2dce50a14ea8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UxTrGBel {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:42 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3664944a-e477-4f40-9b8f-2dce50a14ea8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UxTrGBel" returned: 0 in 0.019s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:42 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[e23b781f-4dc8-42c2-a0bc-eb96ba32402a]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:11:42 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-1391af4e-f17d-4343-b3d6-46a1950775f0 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UxTrGBel'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:11:42 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3664944a-e477-4f40-9b8f-2dce50a14ea8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:42 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3664944a-e477-4f40-9b8f-2dce50a14ea8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:42 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ec8cd8f-e407-457e-9cbf-c53c0ed7189f]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:11:42 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-1391af4e-f17d-4343-b3d6-46a1950775f0 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:11:42 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:42 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:42 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab862233-f74f-403b-8ec3-981ae0611898]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792 (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:11:42 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-1391af4e-f17d-4343-b3d6-46a1950775f0 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792 (non-flash)
Oct 26 00:11:42 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:11:42 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-1391af4e-f17d-4343-b3d6-46a1950775f0 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792 (non-flash)
Oct 26 00:11:42 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:11:42 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3664944a-e477-4f40-9b8f-2dce50a14ea8 -p 172.16.0.220:3260 --login {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:42 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3664944a-e477-4f40-9b8f-2dce50a14ea8 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:42 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c27137e-cf74-4658-9785-28a4f43d13f6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3664944a-e477-4f40-9b8f-2dce50a14ea8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3664944a-e477-4f40-9b8f-2dce50a14ea8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:11:42 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-1391af4e-f17d-4343-b3d6-46a1950775f0 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3664944a-e477-4f40-9b8f-2dce50a14ea8, portal: 172.16.0.220,3260]
Oct 26 00:11:42 user nova-compute[75165]: Login to [iface: default, target: iqn.2010-10.org.openstack:3664944a-e477-4f40-9b8f-2dce50a14ea8, portal: 172.16.0.220,3260] successful.
Oct 26 00:11:42 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:11:42 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3664944a-e477-4f40-9b8f-2dce50a14ea8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:42 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3664944a-e477-4f40-9b8f-2dce50a14ea8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:42 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[1335c31d-c00d-4970-83f5-1c6539f40b26]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:11:42 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-1391af4e-f17d-4343-b3d6-46a1950775f0 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:11:42 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:42 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:42 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[e38b596e-1c79-4def-8ed9-b8e767cee4b5]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3664944a-e477-4f40-9b8f-2dce50a14ea8 (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:11:42 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-1391af4e-f17d-4343-b3d6-46a1950775f0 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792 (non-flash)
Oct 26 00:11:42 user nova-compute[75165]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3664944a-e477-4f40-9b8f-2dce50a14ea8 (non-flash)
Oct 26 00:11:42 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:11:42 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-1391af4e-f17d-4343-b3d6-46a1950775f0 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792 (non-flash)
Oct 26 00:11:42 user nova-compute[75165]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3664944a-e477-4f40-9b8f-2dce50a14ea8 (non-flash)
Oct 26 00:11:42 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:11:42 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-1391af4e-f17d-4343-b3d6-46a1950775f0 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3664944a-e477-4f40-9b8f-2dce50a14ea8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.348s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:11:42 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-1391af4e-f17d-4343-b3d6-46a1950775f0 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Connected to 172.16.0.220:3260 {{(pid=75165) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 00:11:42 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-1391af4e-f17d-4343-b3d6-46a1950775f0 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] HCTL ('34', '-', '-', 0) found on session 13 with lun 0 {{(pid=75165) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 00:11:42 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-1391af4e-f17d-4343-b3d6-46a1950775f0 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75165) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 00:11:42 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:42 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:42 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ee1aecc-9c5f-44d7-b138-f670146088a5]: (4, ('- - 0', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:11:42 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-1391af4e-f17d-4343-b3d6-46a1950775f0 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Searching for a device in session 13 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75165) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 00:11:42 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-1391af4e-f17d-4343-b3d6-46a1950775f0 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:3664944a-e477-4f40-9b8f-2dce50a14ea8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UxTrGBel', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75165) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 00:11:43 user nova-compute[75165]: DEBUG nova.network.neutron [None req-25b7cf3b-70f7-42f9-ae34-60f1c9b0de36 tempest-TaggedBootDevicesTest-1951782657 tempest-TaggedBootDevicesTest-1951782657-project-member] [instance: 0d674bd2-7546-41c8-a4cf-3e26ea91edb4] Successfully created port: 9786a81f-a18c-410b-bafc-ff11bfa432f3 {{(pid=75165) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 00:11:43 user nova-compute[75165]: DEBUG nova.network.neutron [None req-25b7cf3b-70f7-42f9-ae34-60f1c9b0de36 tempest-TaggedBootDevicesTest-1951782657 tempest-TaggedBootDevicesTest-1951782657-project-member] [instance: 0d674bd2-7546-41c8-a4cf-3e26ea91edb4] Successfully created port: bd100fe9-891f-42dc-8fbd-41d2322cd099 {{(pid=75165) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 00:11:43 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-1391af4e-f17d-4343-b3d6-46a1950775f0 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.391s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:11:43 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-1391af4e-f17d-4343-b3d6-46a1950775f0 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] <== connect_volume: return (1393ms) {'type': 'block', 'scsi_wwn': '26565626132346432', 'path': '/dev/sdc'} {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:11:43 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1391af4e-f17d-4343-b3d6-46a1950775f0 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] [instance: 6f9add59-cabe-4965-8fe3-524618550581] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26565626132346432', 'path': '/dev/sdc'} {{(pid=75165) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 00:11:43 user nova-compute[75165]: DEBUG nova.compute.manager [req-aabd7b20-0a6b-477b-a5b6-dd0b45ef0914 req-b2f8f0b9-ef84-46e4-868f-b44be55e2bf3 service nova] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Received event network-vif-plugged-03ee4dbc-d46d-4127-a4e0-d308a1c8beae {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:11:43 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-aabd7b20-0a6b-477b-a5b6-dd0b45ef0914 req-b2f8f0b9-ef84-46e4-868f-b44be55e2bf3 service nova] Acquiring lock "8d5569ce-1f18-4f37-a340-099ee152d548-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:11:43 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-aabd7b20-0a6b-477b-a5b6-dd0b45ef0914 req-b2f8f0b9-ef84-46e4-868f-b44be55e2bf3 service nova] Lock "8d5569ce-1f18-4f37-a340-099ee152d548-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:11:43 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-aabd7b20-0a6b-477b-a5b6-dd0b45ef0914 req-b2f8f0b9-ef84-46e4-868f-b44be55e2bf3 service nova] Lock "8d5569ce-1f18-4f37-a340-099ee152d548-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:11:43 user nova-compute[75165]: DEBUG nova.compute.manager [req-aabd7b20-0a6b-477b-a5b6-dd0b45ef0914 req-b2f8f0b9-ef84-46e4-868f-b44be55e2bf3 service nova] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] No waiting events found dispatching network-vif-plugged-03ee4dbc-d46d-4127-a4e0-d308a1c8beae {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:11:43 user nova-compute[75165]: WARNING nova.compute.manager [req-aabd7b20-0a6b-477b-a5b6-dd0b45ef0914 req-b2f8f0b9-ef84-46e4-868f-b44be55e2bf3 service nova] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Received unexpected event network-vif-plugged-03ee4dbc-d46d-4127-a4e0-d308a1c8beae for instance with vm_state active and task_state deleting.
Oct 26 00:11:43 user nova-compute[75165]: DEBUG nova.network.neutron [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] Port 874a1698-c52c-444c-bed5-52633dbaeead binding to destination host user is already ACTIVE {{(pid=75165) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Oct 26 00:11:43 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-1391af4e-f17d-4343-b3d6-46a1950775f0 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-26T00:07:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-444593788',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-444593788',id=8,image_ref='5aa869d5-afcc-4629-94af-7f8f2484dc5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-548689340',keypairs=<?>,launch_index=0,launched_at=2023-10-26T00:07:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='920152101768459baa71010b380ea8f1',ramdisk_id='',reservation_id='r-i1asnolo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-6636270',owner_user_name='tempest-AttachVolumeShelveTestJSON-6636270-project-member',shelved_at='2023-10-26T00:09:19.830795',shelved_host='user',shelved_image_id='5aa869d5-afcc-4629-94af-7f8f2484dc5a'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T00:11:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a40cb1b08014444686bd0adad03f6c68',uuid=6f9add59-cabe-4965-8fe3-524618550581,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "50bf388e-b8ff-4924-9633-7e97d083a361", "address": "fa:16:3e:16:28:b9", "network": {"id": "f54e2e9f-5c1e-44ca-bd4b-9cf0747b0f72", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-806146051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "920152101768459baa71010b380ea8f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50bf388e-b8", "ovs_interfaceid": "50bf388e-b8ff-4924-9633-7e97d083a361", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75165) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 00:11:43 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-1391af4e-f17d-4343-b3d6-46a1950775f0 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Converting VIF {"id": "50bf388e-b8ff-4924-9633-7e97d083a361", "address": "fa:16:3e:16:28:b9", "network": {"id": "f54e2e9f-5c1e-44ca-bd4b-9cf0747b0f72", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-806146051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "920152101768459baa71010b380ea8f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50bf388e-b8", "ovs_interfaceid": "50bf388e-b8ff-4924-9633-7e97d083a361", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:11:43 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-1391af4e-f17d-4343-b3d6-46a1950775f0 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:28:b9,bridge_name='br-int',has_traffic_filtering=True,id=50bf388e-b8ff-4924-9633-7e97d083a361,network=Network(f54e2e9f-5c1e-44ca-bd4b-9cf0747b0f72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50bf388e-b8') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:11:43 user nova-compute[75165]: DEBUG nova.objects.instance [None req-1391af4e-f17d-4343-b3d6-46a1950775f0 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Lazy-loading 'pci_devices' on Instance uuid 6f9add59-cabe-4965-8fe3-524618550581 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:11:43 user nova-compute[75165]: DEBUG nova.objects.base [None req-1391af4e-f17d-4343-b3d6-46a1950775f0 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Object Instance<6f9add59-cabe-4965-8fe3-524618550581> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75165) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 00:11:43 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-1391af4e-f17d-4343-b3d6-46a1950775f0 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] [instance: 6f9add59-cabe-4965-8fe3-524618550581] End _get_guest_xml xml=<domain type="kvm">
Oct 26 00:11:43 user nova-compute[75165]:   <uuid>6f9add59-cabe-4965-8fe3-524618550581</uuid>
Oct 26 00:11:43 user nova-compute[75165]:   <name>instance-00000008</name>
Oct 26 00:11:43 user nova-compute[75165]:   <memory>524288</memory>
Oct 26 00:11:43 user nova-compute[75165]:   <vcpu>1</vcpu>
Oct 26 00:11:43 user nova-compute[75165]:   <metadata>
Oct 26 00:11:43 user nova-compute[75165]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 00:11:43 user nova-compute[75165]:       <nova:package version="0.0.0"/>
Oct 26 00:11:43 user nova-compute[75165]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-444593788</nova:name>
Oct 26 00:11:43 user nova-compute[75165]:       <nova:creationTime>2023-10-26 00:11:42</nova:creationTime>
Oct 26 00:11:43 user nova-compute[75165]:       <nova:flavor name="m1.tiny">
Oct 26 00:11:43 user nova-compute[75165]:         <nova:memory>512</nova:memory>
Oct 26 00:11:43 user nova-compute[75165]:         <nova:disk>1</nova:disk>
Oct 26 00:11:43 user nova-compute[75165]:         <nova:swap>0</nova:swap>
Oct 26 00:11:43 user nova-compute[75165]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 00:11:43 user nova-compute[75165]:         <nova:vcpus>1</nova:vcpus>
Oct 26 00:11:43 user nova-compute[75165]:       </nova:flavor>
Oct 26 00:11:43 user nova-compute[75165]:       <nova:owner>
Oct 26 00:11:43 user nova-compute[75165]:         <nova:user uuid="a40cb1b08014444686bd0adad03f6c68">tempest-AttachVolumeShelveTestJSON-6636270-project-member</nova:user>
Oct 26 00:11:43 user nova-compute[75165]:         <nova:project uuid="920152101768459baa71010b380ea8f1">tempest-AttachVolumeShelveTestJSON-6636270</nova:project>
Oct 26 00:11:43 user nova-compute[75165]:       </nova:owner>
Oct 26 00:11:43 user nova-compute[75165]:       <nova:root type="image" uuid="5aa869d5-afcc-4629-94af-7f8f2484dc5a"/>
Oct 26 00:11:43 user nova-compute[75165]:       <nova:ports>
Oct 26 00:11:43 user nova-compute[75165]:         <nova:port uuid="50bf388e-b8ff-4924-9633-7e97d083a361">
Oct 26 00:11:43 user nova-compute[75165]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 26 00:11:43 user nova-compute[75165]:         </nova:port>
Oct 26 00:11:43 user nova-compute[75165]:       </nova:ports>
Oct 26 00:11:43 user nova-compute[75165]:     </nova:instance>
Oct 26 00:11:43 user nova-compute[75165]:   </metadata>
Oct 26 00:11:43 user nova-compute[75165]:   <sysinfo type="smbios">
Oct 26 00:11:43 user nova-compute[75165]:     <system>
Oct 26 00:11:43 user nova-compute[75165]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 00:11:43 user nova-compute[75165]:       <entry name="product">OpenStack Nova</entry>
Oct 26 00:11:43 user nova-compute[75165]:       <entry name="version">0.0.0</entry>
Oct 26 00:11:43 user nova-compute[75165]:       <entry name="serial">6f9add59-cabe-4965-8fe3-524618550581</entry>
Oct 26 00:11:43 user nova-compute[75165]:       <entry name="uuid">6f9add59-cabe-4965-8fe3-524618550581</entry>
Oct 26 00:11:43 user nova-compute[75165]:       <entry name="family">Virtual Machine</entry>
Oct 26 00:11:43 user nova-compute[75165]:     </system>
Oct 26 00:11:43 user nova-compute[75165]:   </sysinfo>
Oct 26 00:11:43 user nova-compute[75165]:   <os>
Oct 26 00:11:43 user nova-compute[75165]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 00:11:43 user nova-compute[75165]:     <boot dev="hd"/>
Oct 26 00:11:43 user nova-compute[75165]:     <smbios mode="sysinfo"/>
Oct 26 00:11:43 user nova-compute[75165]:   </os>
Oct 26 00:11:43 user nova-compute[75165]:   <features>
Oct 26 00:11:43 user nova-compute[75165]:     <acpi/>
Oct 26 00:11:43 user nova-compute[75165]:     <apic/>
Oct 26 00:11:43 user nova-compute[75165]:     <vmcoreinfo/>
Oct 26 00:11:43 user nova-compute[75165]:   </features>
Oct 26 00:11:43 user nova-compute[75165]:   <clock offset="utc">
Oct 26 00:11:43 user nova-compute[75165]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 00:11:43 user nova-compute[75165]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 00:11:43 user nova-compute[75165]:     <timer name="hpet" present="no"/>
Oct 26 00:11:43 user nova-compute[75165]:   </clock>
Oct 26 00:11:43 user nova-compute[75165]:   <cpu mode="custom" match="exact">
Oct 26 00:11:43 user nova-compute[75165]:     <model>Nehalem</model>
Oct 26 00:11:43 user nova-compute[75165]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 00:11:43 user nova-compute[75165]:   </cpu>
Oct 26 00:11:43 user nova-compute[75165]:   <devices>
Oct 26 00:11:43 user nova-compute[75165]:     <disk type="file" device="disk">
Oct 26 00:11:43 user nova-compute[75165]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 00:11:43 user nova-compute[75165]:       <source file="/opt/stack/data/nova/instances/6f9add59-cabe-4965-8fe3-524618550581/disk"/>
Oct 26 00:11:43 user nova-compute[75165]:       <target dev="vda" bus="virtio"/>
Oct 26 00:11:43 user nova-compute[75165]:     </disk>
Oct 26 00:11:43 user nova-compute[75165]:     <disk type="block" device="disk">
Oct 26 00:11:43 user nova-compute[75165]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 00:11:43 user nova-compute[75165]:       <source dev="/dev/sdc"/>
Oct 26 00:11:43 user nova-compute[75165]:       <target dev="vdc" bus="virtio"/>
Oct 26 00:11:43 user nova-compute[75165]:       <serial>3664944a-e477-4f40-9b8f-2dce50a14ea8</serial>
Oct 26 00:11:43 user nova-compute[75165]:     </disk>
Oct 26 00:11:43 user nova-compute[75165]:     <interface type="ethernet">
Oct 26 00:11:43 user nova-compute[75165]:       <mac address="fa:16:3e:16:28:b9"/>
Oct 26 00:11:43 user nova-compute[75165]:       <model type="virtio"/>
Oct 26 00:11:43 user nova-compute[75165]:       <mtu size="1442"/>
Oct 26 00:11:43 user nova-compute[75165]:       <target dev="tap50bf388e-b8"/>
Oct 26 00:11:43 user nova-compute[75165]:     </interface>
Oct 26 00:11:43 user nova-compute[75165]:     <serial type="pty">
Oct 26 00:11:43 user nova-compute[75165]:       <log file="/opt/stack/data/nova/instances/6f9add59-cabe-4965-8fe3-524618550581/console.log" append="off"/>
Oct 26 00:11:43 user nova-compute[75165]:     </serial>
Oct 26 00:11:43 user nova-compute[75165]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 00:11:43 user nova-compute[75165]:     <video>
Oct 26 00:11:43 user nova-compute[75165]:       <model type="virtio"/>
Oct 26 00:11:43 user nova-compute[75165]:     </video>
Oct 26 00:11:43 user nova-compute[75165]:     <rng model="virtio">
Oct 26 00:11:43 user nova-compute[75165]:       <backend model="random">/dev/urandom</backend>
Oct 26 00:11:43 user nova-compute[75165]:     </rng>
Oct 26 00:11:43 user nova-compute[75165]:     <controller type="usb" index="0" model="none"/>
Oct 26 00:11:43 user nova-compute[75165]:     <memballoon model="virtio">
Oct 26 00:11:43 user nova-compute[75165]:       <stats period="10"/>
Oct 26 00:11:43 user nova-compute[75165]:     </memballoon>
Oct 26 00:11:43 user nova-compute[75165]:   </devices>
Oct 26 00:11:43 user nova-compute[75165]: </domain>
Oct 26 00:11:43 user nova-compute[75165]:  {{(pid=75165) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 00:11:43 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-1391af4e-f17d-4343-b3d6-46a1950775f0 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-26T00:07:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-444593788',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-444593788',id=8,image_ref='5aa869d5-afcc-4629-94af-7f8f2484dc5a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-548689340',keypairs=<?>,launch_index=0,launched_at=2023-10-26T00:07:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='920152101768459baa71010b380ea8f1',ramdisk_id='',reservation_id='r-i1asnolo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-6636270',owner_user_name='tempest-AttachVolumeShelveTestJSON-6636270-project-member',shelved_at='2023-10-26T00:09:19.830795',shelved_host='user',shelved_image_id='5aa869d5-afcc-4629-94af-7f8f2484dc5a'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T00:11:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a40cb1b08014444686bd0adad03f6c68',uuid=6f9add59-cabe-4965-8fe3-524618550581,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "50bf388e-b8ff-4924-9633-7e97d083a361", "address": "fa:16:3e:16:28:b9", "network": {"id": "f54e2e9f-5c1e-44ca-bd4b-9cf0747b0f72", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-806146051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "920152101768459baa71010b380ea8f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50bf388e-b8", "ovs_interfaceid": "50bf388e-b8ff-4924-9633-7e97d083a361", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 00:11:43 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-1391af4e-f17d-4343-b3d6-46a1950775f0 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Converting VIF {"id": "50bf388e-b8ff-4924-9633-7e97d083a361", "address": "fa:16:3e:16:28:b9", "network": {"id": "f54e2e9f-5c1e-44ca-bd4b-9cf0747b0f72", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-806146051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "920152101768459baa71010b380ea8f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50bf388e-b8", "ovs_interfaceid": "50bf388e-b8ff-4924-9633-7e97d083a361", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:11:43 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-1391af4e-f17d-4343-b3d6-46a1950775f0 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:28:b9,bridge_name='br-int',has_traffic_filtering=True,id=50bf388e-b8ff-4924-9633-7e97d083a361,network=Network(f54e2e9f-5c1e-44ca-bd4b-9cf0747b0f72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50bf388e-b8') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:11:43 user nova-compute[75165]: DEBUG os_vif [None req-1391af4e-f17d-4343-b3d6-46a1950775f0 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:28:b9,bridge_name='br-int',has_traffic_filtering=True,id=50bf388e-b8ff-4924-9633-7e97d083a361,network=Network(f54e2e9f-5c1e-44ca-bd4b-9cf0747b0f72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50bf388e-b8') {{(pid=75165) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 00:11:43 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:43 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:11:43 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 00:11:43 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:43 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e2057e2d-c3da-512f-99d8-f15fefab5212', '_type': 'linux-noop'}}, row=False) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:11:43 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:43 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:11:43 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:43 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap50bf388e-b8, may_exist=True, interface_attrs={}) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:11:43 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap50bf388e-b8, col_values=(('qos', UUID('321eae0b-4477-4ddd-8c76-15168783de96')),), if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:11:43 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap50bf388e-b8, col_values=(('external_ids', {'iface-id': '50bf388e-b8ff-4924-9633-7e97d083a361', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:16:28:b9', 'vm-uuid': '6f9add59-cabe-4965-8fe3-524618550581'}),), if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:11:43 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:43 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:11:43 user nova-compute[75165]: INFO os_vif [None req-1391af4e-f17d-4343-b3d6-46a1950775f0 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:28:b9,bridge_name='br-int',has_traffic_filtering=True,id=50bf388e-b8ff-4924-9633-7e97d083a361,network=Network(f54e2e9f-5c1e-44ca-bd4b-9cf0747b0f72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50bf388e-b8')
Oct 26 00:11:44 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Acquiring lock "3b153af2-c93b-47d2-ae8c-76cfd44e384c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:11:44 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Lock "3b153af2-c93b-47d2-ae8c-76cfd44e384c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:11:44 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Lock "3b153af2-c93b-47d2-ae8c-76cfd44e384c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:11:44 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-1391af4e-f17d-4343-b3d6-46a1950775f0 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] No BDM found with device name vda, not building metadata. {{(pid=75165) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 00:11:44 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-1391af4e-f17d-4343-b3d6-46a1950775f0 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75165) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 00:11:44 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-1391af4e-f17d-4343-b3d6-46a1950775f0 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] No VIF found with MAC fa:16:3e:16:28:b9, not building metadata {{(pid=75165) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 00:11:44 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Acquiring lock "refresh_cache-3b153af2-c93b-47d2-ae8c-76cfd44e384c" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:11:44 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Acquired lock "refresh_cache-3b153af2-c93b-47d2-ae8c-76cfd44e384c" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:11:44 user nova-compute[75165]: DEBUG nova.network.neutron [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] Building network info cache for instance {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 00:11:44 user nova-compute[75165]: DEBUG nova.network.neutron [None req-25b7cf3b-70f7-42f9-ae34-60f1c9b0de36 tempest-TaggedBootDevicesTest-1951782657 tempest-TaggedBootDevicesTest-1951782657-project-member] [instance: 0d674bd2-7546-41c8-a4cf-3e26ea91edb4] Successfully created port: d82f307d-35a8-422d-b55d-12917be12db6 {{(pid=75165) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 00:11:44 user nova-compute[75165]: DEBUG nova.network.neutron [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] Updating instance_info_cache with network_info: [{"id": "874a1698-c52c-444c-bed5-52633dbaeead", "address": "fa:16:3e:75:45:79", "network": {"id": "30951418-d830-4042-9143-c736802150e9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-167387787-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0db2c49ee28f4b7b9fa990faddb9d3a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap874a1698-c5", "ovs_interfaceid": "874a1698-c52c-444c-bed5-52633dbaeead", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:11:44 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Releasing lock "refresh_cache-3b153af2-c93b-47d2-ae8c-76cfd44e384c" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:11:45 user nova-compute[75165]: DEBUG os_brick.utils [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:11:45 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:45 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:45 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[dabd9a42-9dbd-47ef-a7f6-6b530852c25e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa94814ccb35\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:11:45 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:45 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.027s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:45 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[5096b422-ea6f-4b7f-910d-16cd8ff0968f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:11:45 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:45 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:45 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[19da08fc-cf17-40fb-b974-7639860e0729]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:11:45 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eaf3c5b-c44a-4b8c-bee3-bc54197f32b1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:11:45 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Running cmd (subprocess): nvme version {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:45 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] 'nvme version' failed. Not Retrying. {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 00:11:45 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] nvme not present on system {{(pid=75165) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 00:11:45 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:45 user nova-compute[75165]: DEBUG nova.network.neutron [None req-25b7cf3b-70f7-42f9-ae34-60f1c9b0de36 tempest-TaggedBootDevicesTest-1951782657 tempest-TaggedBootDevicesTest-1951782657-project-member] [instance: 0d674bd2-7546-41c8-a4cf-3e26ea91edb4] Successfully created port: b3519c1c-0881-436a-8d24-dbba3a655564 {{(pid=75165) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 00:11:45 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 00:11:45 user nova-compute[75165]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 00:11:45 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[6df732a9-da8c-4ece-a7e1-5e56de504188]: (4, '') {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:11:45 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75165) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 00:11:45 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75165) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 00:11:45 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] LIGHTOS: no hostnqn found. {{(pid=75165) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 00:11:45 user nova-compute[75165]: DEBUG os_brick.utils [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] <== get_connector_properties: return (174ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa94814ccb35', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:11:45 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:45 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:45 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:45 user nova-compute[75165]: DEBUG nova.compute.manager [req-c60ea121-ff30-48d4-b149-c5b83fc86577 req-e68d329a-05d4-4d50-bfc3-ca26198edea7 service nova] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Received event network-vif-deleted-03ee4dbc-d46d-4127-a4e0-d308a1c8beae {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:11:45 user nova-compute[75165]: INFO nova.compute.manager [req-c60ea121-ff30-48d4-b149-c5b83fc86577 req-e68d329a-05d4-4d50-bfc3-ca26198edea7 service nova] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Neutron deleted interface 03ee4dbc-d46d-4127-a4e0-d308a1c8beae; detaching it from the instance and deleting it from the info cache
Oct 26 00:11:45 user nova-compute[75165]: DEBUG nova.network.neutron [req-c60ea121-ff30-48d4-b149-c5b83fc86577 req-e68d329a-05d4-4d50-bfc3-ca26198edea7 service nova] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Updating instance_info_cache with network_info: [{"id": "3da752ae-77a3-4bc3-8885-76331bc2d7d8", "address": "fa:16:3e:22:af:b4", "network": {"id": "a4a95519-4969-4c53-b078-46dab1ae12ac", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1704712535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f1d0ea8cbf74f10b81a10d3a7a6e716", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3da752ae-77", "ovs_interfaceid": "3da752ae-77a3-4bc3-8885-76331bc2d7d8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b9583014-bb07-4337-97bb-30001c05475f", "address": "fa:16:3e:ca:f8:4e", "network": {"id": "b1b273e9-ac47-4985-9a15-ed6392eea58c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1944708022", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9f1d0ea8cbf74f10b81a10d3a7a6e716", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9583014-bb", "ovs_interfaceid": "b9583014-bb07-4337-97bb-30001c05475f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c51f288f-44b9-476b-9419-22ef8ae5c900", "address": "fa:16:3e:28:cd:e8", "network": {"id": "b1b273e9-ac47-4985-9a15-ed6392eea58c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1944708022", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.239", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9f1d0ea8cbf74f10b81a10d3a7a6e716", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc51f288f-44", "ovs_interfaceid": "c51f288f-44b9-476b-9419-22ef8ae5c900", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c019e949-c6fc-4014-9e42-13ce1eb17786", "address": "fa:16:3e:34:fd:75", "network": {"id": "b1b273e9-ac47-4985-9a15-ed6392eea58c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1944708022", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.220", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9f1d0ea8cbf74f10b81a10d3a7a6e716", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc019e949-c6", "ovs_interfaceid": "c019e949-c6fc-4014-9e42-13ce1eb17786", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9cecd3d6-4945-4a4b-8d06-48b0d7768a17", "address": "fa:16:3e:59:c6:53", "network": {"id": "b1b273e9-ac47-4985-9a15-ed6392eea58c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1944708022", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9f1d0ea8cbf74f10b81a10d3a7a6e716", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cecd3d6-49", "ovs_interfaceid": "9cecd3d6-4945-4a4b-8d06-48b0d7768a17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a04b8134-03e6-45f2-b6d7-3ea6a7deb81c", "address": "fa:16:3e:0a:29:45", "network": {"id": "75761f5b-dd19-4843-8db7-9cef3872583d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1377439333", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "9f1d0ea8cbf74f10b81a10d3a7a6e716", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa04b8134-03", "ovs_interfaceid": "a04b8134-03e6-45f2-b6d7-3ea6a7deb81c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:11:46 user nova-compute[75165]: DEBUG nova.compute.manager [req-c60ea121-ff30-48d4-b149-c5b83fc86577 req-e68d329a-05d4-4d50-bfc3-ca26198edea7 service nova] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Detach interface failed, port_id=03ee4dbc-d46d-4127-a4e0-d308a1c8beae, reason: Instance 8d5569ce-1f18-4f37-a340-099ee152d548 could not be found. {{(pid=75165) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 26 00:11:46 user nova-compute[75165]: DEBUG nova.compute.manager [req-c60ea121-ff30-48d4-b149-c5b83fc86577 req-e68d329a-05d4-4d50-bfc3-ca26198edea7 service nova] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Received event network-vif-deleted-a04b8134-03e6-45f2-b6d7-3ea6a7deb81c {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:11:46 user nova-compute[75165]: INFO nova.compute.manager [req-c60ea121-ff30-48d4-b149-c5b83fc86577 req-e68d329a-05d4-4d50-bfc3-ca26198edea7 service nova] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Neutron deleted interface a04b8134-03e6-45f2-b6d7-3ea6a7deb81c; detaching it from the instance and deleting it from the info cache
Oct 26 00:11:46 user nova-compute[75165]: DEBUG nova.network.neutron [req-c60ea121-ff30-48d4-b149-c5b83fc86577 req-e68d329a-05d4-4d50-bfc3-ca26198edea7 service nova] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Updating instance_info_cache with network_info: [{"id": "3da752ae-77a3-4bc3-8885-76331bc2d7d8", "address": "fa:16:3e:22:af:b4", "network": {"id": "a4a95519-4969-4c53-b078-46dab1ae12ac", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1704712535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f1d0ea8cbf74f10b81a10d3a7a6e716", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3da752ae-77", "ovs_interfaceid": "3da752ae-77a3-4bc3-8885-76331bc2d7d8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b9583014-bb07-4337-97bb-30001c05475f", "address": "fa:16:3e:ca:f8:4e", "network": {"id": "b1b273e9-ac47-4985-9a15-ed6392eea58c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1944708022", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9f1d0ea8cbf74f10b81a10d3a7a6e716", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9583014-bb", "ovs_interfaceid": "b9583014-bb07-4337-97bb-30001c05475f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c51f288f-44b9-476b-9419-22ef8ae5c900", "address": "fa:16:3e:28:cd:e8", "network": {"id": "b1b273e9-ac47-4985-9a15-ed6392eea58c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1944708022", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.239", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9f1d0ea8cbf74f10b81a10d3a7a6e716", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc51f288f-44", "ovs_interfaceid": "c51f288f-44b9-476b-9419-22ef8ae5c900", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c019e949-c6fc-4014-9e42-13ce1eb17786", "address": "fa:16:3e:34:fd:75", "network": {"id": "b1b273e9-ac47-4985-9a15-ed6392eea58c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1944708022", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.220", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9f1d0ea8cbf74f10b81a10d3a7a6e716", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc019e949-c6", "ovs_interfaceid": "c019e949-c6fc-4014-9e42-13ce1eb17786", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9cecd3d6-4945-4a4b-8d06-48b0d7768a17", "address": "fa:16:3e:59:c6:53", "network": {"id": "b1b273e9-ac47-4985-9a15-ed6392eea58c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1944708022", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9f1d0ea8cbf74f10b81a10d3a7a6e716", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cecd3d6-49", "ovs_interfaceid": "9cecd3d6-4945-4a4b-8d06-48b0d7768a17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:11:46 user nova-compute[75165]: DEBUG nova.compute.manager [req-c60ea121-ff30-48d4-b149-c5b83fc86577 req-e68d329a-05d4-4d50-bfc3-ca26198edea7 service nova] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Detach interface failed, port_id=a04b8134-03e6-45f2-b6d7-3ea6a7deb81c, reason: Instance 8d5569ce-1f18-4f37-a340-099ee152d548 could not be found. {{(pid=75165) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 26 00:11:46 user nova-compute[75165]: DEBUG nova.compute.manager [req-c60ea121-ff30-48d4-b149-c5b83fc86577 req-e68d329a-05d4-4d50-bfc3-ca26198edea7 service nova] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Received event network-vif-deleted-3da752ae-77a3-4bc3-8885-76331bc2d7d8 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:11:46 user nova-compute[75165]: INFO nova.compute.manager [req-c60ea121-ff30-48d4-b149-c5b83fc86577 req-e68d329a-05d4-4d50-bfc3-ca26198edea7 service nova] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Neutron deleted interface 3da752ae-77a3-4bc3-8885-76331bc2d7d8; detaching it from the instance and deleting it from the info cache
Oct 26 00:11:46 user nova-compute[75165]: DEBUG nova.network.neutron [req-c60ea121-ff30-48d4-b149-c5b83fc86577 req-e68d329a-05d4-4d50-bfc3-ca26198edea7 service nova] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Updating instance_info_cache with network_info: [{"id": "b9583014-bb07-4337-97bb-30001c05475f", "address": "fa:16:3e:ca:f8:4e", "network": {"id": "b1b273e9-ac47-4985-9a15-ed6392eea58c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1944708022", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.83", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9f1d0ea8cbf74f10b81a10d3a7a6e716", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9583014-bb", "ovs_interfaceid": "b9583014-bb07-4337-97bb-30001c05475f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c51f288f-44b9-476b-9419-22ef8ae5c900", "address": "fa:16:3e:28:cd:e8", "network": {"id": "b1b273e9-ac47-4985-9a15-ed6392eea58c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1944708022", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.239", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9f1d0ea8cbf74f10b81a10d3a7a6e716", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc51f288f-44", "ovs_interfaceid": "c51f288f-44b9-476b-9419-22ef8ae5c900", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c019e949-c6fc-4014-9e42-13ce1eb17786", "address": "fa:16:3e:34:fd:75", "network": {"id": "b1b273e9-ac47-4985-9a15-ed6392eea58c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1944708022", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.220", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9f1d0ea8cbf74f10b81a10d3a7a6e716", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc019e949-c6", "ovs_interfaceid": "c019e949-c6fc-4014-9e42-13ce1eb17786", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9cecd3d6-4945-4a4b-8d06-48b0d7768a17", "address": "fa:16:3e:59:c6:53", "network": {"id": "b1b273e9-ac47-4985-9a15-ed6392eea58c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1944708022", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "9f1d0ea8cbf74f10b81a10d3a7a6e716", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cecd3d6-49", "ovs_interfaceid": "9cecd3d6-4945-4a4b-8d06-48b0d7768a17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:11:46 user nova-compute[75165]: DEBUG nova.compute.manager [req-c60ea121-ff30-48d4-b149-c5b83fc86577 req-e68d329a-05d4-4d50-bfc3-ca26198edea7 service nova] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Detach interface failed, port_id=3da752ae-77a3-4bc3-8885-76331bc2d7d8, reason: Instance 8d5569ce-1f18-4f37-a340-099ee152d548 could not be found. {{(pid=75165) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 26 00:11:46 user nova-compute[75165]: DEBUG nova.compute.manager [req-3eb421d4-e8b5-4885-af6a-60fd927ee31b req-8c67e985-4d06-4a1c-b514-c3f2f4c43578 service nova] [instance: 6f9add59-cabe-4965-8fe3-524618550581] Received event network-vif-plugged-50bf388e-b8ff-4924-9633-7e97d083a361 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:11:46 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-3eb421d4-e8b5-4885-af6a-60fd927ee31b req-8c67e985-4d06-4a1c-b514-c3f2f4c43578 service nova] Acquiring lock "6f9add59-cabe-4965-8fe3-524618550581-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:11:46 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-3eb421d4-e8b5-4885-af6a-60fd927ee31b req-8c67e985-4d06-4a1c-b514-c3f2f4c43578 service nova] Lock "6f9add59-cabe-4965-8fe3-524618550581-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:11:46 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-3eb421d4-e8b5-4885-af6a-60fd927ee31b req-8c67e985-4d06-4a1c-b514-c3f2f4c43578 service nova] Lock "6f9add59-cabe-4965-8fe3-524618550581-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:11:46 user nova-compute[75165]: DEBUG nova.compute.manager [req-3eb421d4-e8b5-4885-af6a-60fd927ee31b req-8c67e985-4d06-4a1c-b514-c3f2f4c43578 service nova] [instance: 6f9add59-cabe-4965-8fe3-524618550581] No waiting events found dispatching network-vif-plugged-50bf388e-b8ff-4924-9633-7e97d083a361 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:11:46 user nova-compute[75165]: WARNING nova.compute.manager [req-3eb421d4-e8b5-4885-af6a-60fd927ee31b req-8c67e985-4d06-4a1c-b514-c3f2f4c43578 service nova] [instance: 6f9add59-cabe-4965-8fe3-524618550581] Received unexpected event network-vif-plugged-50bf388e-b8ff-4924-9633-7e97d083a361 for instance with vm_state shelved_offloaded and task_state spawning.
Oct 26 00:11:46 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:46 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:46 user nova-compute[75165]: DEBUG nova.network.neutron [-] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Updating instance_info_cache with network_info: [] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:11:46 user nova-compute[75165]: INFO nova.compute.manager [-] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Took 5.55 seconds to deallocate network for instance.
Oct 26 00:11:46 user nova-compute[75165]: DEBUG nova.network.neutron [None req-25b7cf3b-70f7-42f9-ae34-60f1c9b0de36 tempest-TaggedBootDevicesTest-1951782657 tempest-TaggedBootDevicesTest-1951782657-project-member] [instance: 0d674bd2-7546-41c8-a4cf-3e26ea91edb4] Successfully updated port: d43c2029-2e2c-4a0b-b357-3842f7ff6ef4 {{(pid=75165) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 00:11:47 user nova-compute[75165]: DEBUG nova.network.neutron [None req-25b7cf3b-70f7-42f9-ae34-60f1c9b0de36 tempest-TaggedBootDevicesTest-1951782657 tempest-TaggedBootDevicesTest-1951782657-project-member] [instance: 0d674bd2-7546-41c8-a4cf-3e26ea91edb4] Successfully updated port: c0030fb9-8756-4bb4-bccd-81f641be1b1d {{(pid=75165) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 00:11:48 user nova-compute[75165]: DEBUG nova.compute.manager [req-4617c574-29eb-40e8-963b-9f4fd195f113 req-7293ce7d-af24-43b5-9ba5-9da233ea8738 service nova] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Received event network-vif-deleted-9cecd3d6-4945-4a4b-8d06-48b0d7768a17 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:11:48 user nova-compute[75165]: DEBUG nova.compute.manager [req-4617c574-29eb-40e8-963b-9f4fd195f113 req-7293ce7d-af24-43b5-9ba5-9da233ea8738 service nova] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Received event network-vif-deleted-c019e949-c6fc-4014-9e42-13ce1eb17786 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:11:48 user nova-compute[75165]: ERROR nova.volume.cinder [None req-25b7cf3b-70f7-42f9-ae34-60f1c9b0de36 tempest-TaggedBootDevicesTest-1951782657 tempest-TaggedBootDevicesTest-1951782657-project-member] Update attachment failed for attachment fb68e9de-6219-4be5-b00a-572dedf6d06a. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-b4159121-d7b9-45f6-8932-430ad976cf68) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-b4159121-d7b9-45f6-8932-430ad976cf68)
Oct 26 00:11:48 user nova-compute[75165]: ERROR nova.compute.manager [None req-25b7cf3b-70f7-42f9-ae34-60f1c9b0de36 tempest-TaggedBootDevicesTest-1951782657 tempest-TaggedBootDevicesTest-1951782657-project-member] [instance: 0d674bd2-7546-41c8-a4cf-3e26ea91edb4] Instance failed block device setup: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-b4159121-d7b9-45f6-8932-430ad976cf68)
Oct 26 00:11:48 user nova-compute[75165]: ERROR nova.compute.manager [instance: 0d674bd2-7546-41c8-a4cf-3e26ea91edb4] Traceback (most recent call last):
Oct 26 00:11:48 user nova-compute[75165]: ERROR nova.compute.manager [instance: 0d674bd2-7546-41c8-a4cf-3e26ea91edb4]   File "/opt/stack/nova/nova/compute/manager.py", line 2190, in _prep_block_device
Oct 26 00:11:48 user nova-compute[75165]: ERROR nova.compute.manager [instance: 0d674bd2-7546-41c8-a4cf-3e26ea91edb4]     driver_block_device.attach_block_devices(
Oct 26 00:11:48 user nova-compute[75165]: ERROR nova.compute.manager [instance: 0d674bd2-7546-41c8-a4cf-3e26ea91edb4]   File "/opt/stack/nova/nova/virt/block_device.py", line 936, in attach_block_devices
Oct 26 00:11:48 user nova-compute[75165]: ERROR nova.compute.manager [instance: 0d674bd2-7546-41c8-a4cf-3e26ea91edb4]     _log_and_attach(device)
Oct 26 00:11:48 user nova-compute[75165]: ERROR nova.compute.manager [instance: 0d674bd2-7546-41c8-a4cf-3e26ea91edb4]   File "/opt/stack/nova/nova/virt/block_device.py", line 933, in _log_and_attach
Oct 26 00:11:48 user nova-compute[75165]: ERROR nova.compute.manager [instance: 0d674bd2-7546-41c8-a4cf-3e26ea91edb4]     bdm.attach(*attach_args, **attach_kwargs)
Oct 26 00:11:48 user nova-compute[75165]: ERROR nova.compute.manager [instance: 0d674bd2-7546-41c8-a4cf-3e26ea91edb4]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Oct 26 00:11:48 user nova-compute[75165]: ERROR nova.compute.manager [instance: 0d674bd2-7546-41c8-a4cf-3e26ea91edb4]     ret_val = method(obj, context, *args, **kwargs)
Oct 26 00:11:48 user nova-compute[75165]: ERROR nova.compute.manager [instance: 0d674bd2-7546-41c8-a4cf-3e26ea91edb4]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Oct 26 00:11:48 user nova-compute[75165]: ERROR nova.compute.manager [instance: 0d674bd2-7546-41c8-a4cf-3e26ea91edb4]     self._do_attach(context, instance, volume, volume_api,
Oct 26 00:11:48 user nova-compute[75165]: ERROR nova.compute.manager [instance: 0d674bd2-7546-41c8-a4cf-3e26ea91edb4]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Oct 26 00:11:48 user nova-compute[75165]: ERROR nova.compute.manager [instance: 0d674bd2-7546-41c8-a4cf-3e26ea91edb4]     self._volume_attach(context, volume, connector, instance,
Oct 26 00:11:48 user nova-compute[75165]: ERROR nova.compute.manager [instance: 0d674bd2-7546-41c8-a4cf-3e26ea91edb4]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Oct 26 00:11:48 user nova-compute[75165]: ERROR nova.compute.manager [instance: 0d674bd2-7546-41c8-a4cf-3e26ea91edb4]     connection_info = volume_api.attachment_update(
Oct 26 00:11:48 user nova-compute[75165]: ERROR nova.compute.manager [instance: 0d674bd2-7546-41c8-a4cf-3e26ea91edb4]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 26 00:11:48 user nova-compute[75165]: ERROR nova.compute.manager [instance: 0d674bd2-7546-41c8-a4cf-3e26ea91edb4]     res = method(self, ctx, *args, **kwargs)
Oct 26 00:11:48 user nova-compute[75165]: ERROR nova.compute.manager [instance: 0d674bd2-7546-41c8-a4cf-3e26ea91edb4]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Oct 26 00:11:48 user nova-compute[75165]: ERROR nova.compute.manager [instance: 0d674bd2-7546-41c8-a4cf-3e26ea91edb4]     res = method(self, ctx, attachment_id, *args, **kwargs)
Oct 26 00:11:48 user nova-compute[75165]: ERROR nova.compute.manager [instance: 0d674bd2-7546-41c8-a4cf-3e26ea91edb4]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Oct 26 00:11:48 user nova-compute[75165]: ERROR nova.compute.manager [instance: 0d674bd2-7546-41c8-a4cf-3e26ea91edb4]     with excutils.save_and_reraise_exception():
Oct 26 00:11:48 user nova-compute[75165]: ERROR nova.compute.manager [instance: 0d674bd2-7546-41c8-a4cf-3e26ea91edb4]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 26 00:11:48 user nova-compute[75165]: ERROR nova.compute.manager [instance: 0d674bd2-7546-41c8-a4cf-3e26ea91edb4]     self.force_reraise()
Oct 26 00:11:48 user nova-compute[75165]: ERROR nova.compute.manager [instance: 0d674bd2-7546-41c8-a4cf-3e26ea91edb4]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 26 00:11:48 user nova-compute[75165]: ERROR nova.compute.manager [instance: 0d674bd2-7546-41c8-a4cf-3e26ea91edb4]     raise self.value
Oct 26 00:11:48 user nova-compute[75165]: ERROR nova.compute.manager [instance: 0d674bd2-7546-41c8-a4cf-3e26ea91edb4]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Oct 26 00:11:48 user nova-compute[75165]: ERROR nova.compute.manager [instance: 0d674bd2-7546-41c8-a4cf-3e26ea91edb4]     context, '3.44', skip_version_check=True).attachments.update(
Oct 26 00:11:48 user nova-compute[75165]: ERROR nova.compute.manager [instance: 0d674bd2-7546-41c8-a4cf-3e26ea91edb4]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Oct 26 00:11:48 user nova-compute[75165]: ERROR nova.compute.manager [instance: 0d674bd2-7546-41c8-a4cf-3e26ea91edb4]     return method.func(obj, *args, **kwargs)
Oct 26 00:11:48 user nova-compute[75165]: ERROR nova.compute.manager [instance: 0d674bd2-7546-41c8-a4cf-3e26ea91edb4]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Oct 26 00:11:48 user nova-compute[75165]: ERROR nova.compute.manager [instance: 0d674bd2-7546-41c8-a4cf-3e26ea91edb4]     resp = self._update('/attachments/%s' % id, body)
Oct 26 00:11:48 user nova-compute[75165]: ERROR nova.compute.manager [instance: 0d674bd2-7546-41c8-a4cf-3e26ea91edb4]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Oct 26 00:11:48 user nova-compute[75165]: ERROR nova.compute.manager [instance: 0d674bd2-7546-41c8-a4cf-3e26ea91edb4]     resp, body = self.api.client.put(url, body=body, **kwargs)
Oct 26 00:11:48 user nova-compute[75165]: ERROR nova.compute.manager [instance: 0d674bd2-7546-41c8-a4cf-3e26ea91edb4]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Oct 26 00:11:48 user nova-compute[75165]: ERROR nova.compute.manager [instance: 0d674bd2-7546-41c8-a4cf-3e26ea91edb4]     return self._cs_request(url, 'PUT', **kwargs)
Oct 26 00:11:48 user nova-compute[75165]: ERROR nova.compute.manager [instance: 0d674bd2-7546-41c8-a4cf-3e26ea91edb4]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 26 00:11:48 user nova-compute[75165]: ERROR nova.compute.manager [instance: 0d674bd2-7546-41c8-a4cf-3e26ea91edb4]     return self.request(url, method, **kwargs)
Oct 26 00:11:48 user nova-compute[75165]: ERROR nova.compute.manager [instance: 0d674bd2-7546-41c8-a4cf-3e26ea91edb4]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 26 00:11:48 user nova-compute[75165]: ERROR nova.compute.manager [instance: 0d674bd2-7546-41c8-a4cf-3e26ea91edb4]     raise exceptions.from_response(resp, body)
Oct 26 00:11:48 user nova-compute[75165]: ERROR nova.compute.manager [instance: 0d674bd2-7546-41c8-a4cf-3e26ea91edb4] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-b4159121-d7b9-45f6-8932-430ad976cf68)
Oct 26 00:11:48 user nova-compute[75165]: ERROR nova.compute.manager [instance: 0d674bd2-7546-41c8-a4cf-3e26ea91edb4] 
Oct 26 00:11:48 user nova-compute[75165]: DEBUG nova.compute.manager [None req-1391af4e-f17d-4343-b3d6-46a1950775f0 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] [instance: 6f9add59-cabe-4965-8fe3-524618550581] Instance event wait completed in 0 seconds for  {{(pid=75165) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 00:11:48 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-1391af4e-f17d-4343-b3d6-46a1950775f0 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] [instance: 6f9add59-cabe-4965-8fe3-524618550581] Guest created on hypervisor {{(pid=75165) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 00:11:48 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: 6f9add59-cabe-4965-8fe3-524618550581] Instance spawned successfully.
Oct 26 00:11:48 user nova-compute[75165]: DEBUG nova.compute.manager [req-61a9d7d5-0653-4223-b252-4aab682c649b req-999c0d2e-e37f-457f-94b1-e158c9e59502 service nova] [instance: 0d674bd2-7546-41c8-a4cf-3e26ea91edb4] Received event network-changed-d43c2029-2e2c-4a0b-b357-3842f7ff6ef4 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:11:48 user nova-compute[75165]: DEBUG nova.compute.manager [req-61a9d7d5-0653-4223-b252-4aab682c649b req-999c0d2e-e37f-457f-94b1-e158c9e59502 service nova] [instance: 0d674bd2-7546-41c8-a4cf-3e26ea91edb4] Refreshing instance network info cache due to event network-changed-d43c2029-2e2c-4a0b-b357-3842f7ff6ef4. {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 00:11:48 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-61a9d7d5-0653-4223-b252-4aab682c649b req-999c0d2e-e37f-457f-94b1-e158c9e59502 service nova] Acquiring lock "refresh_cache-0d674bd2-7546-41c8-a4cf-3e26ea91edb4" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:11:48 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-61a9d7d5-0653-4223-b252-4aab682c649b req-999c0d2e-e37f-457f-94b1-e158c9e59502 service nova] Acquired lock "refresh_cache-0d674bd2-7546-41c8-a4cf-3e26ea91edb4" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:11:48 user nova-compute[75165]: DEBUG nova.network.neutron [req-61a9d7d5-0653-4223-b252-4aab682c649b req-999c0d2e-e37f-457f-94b1-e158c9e59502 service nova] [instance: 0d674bd2-7546-41c8-a4cf-3e26ea91edb4] Refreshing network info cache for port d43c2029-2e2c-4a0b-b357-3842f7ff6ef4 {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 00:11:48 user nova-compute[75165]: DEBUG nova.network.neutron [req-61a9d7d5-0653-4223-b252-4aab682c649b req-999c0d2e-e37f-457f-94b1-e158c9e59502 service nova] [instance: 0d674bd2-7546-41c8-a4cf-3e26ea91edb4] Instance cache missing network info. {{(pid=75165) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 00:11:48 user nova-compute[75165]: DEBUG nova.network.neutron [req-61a9d7d5-0653-4223-b252-4aab682c649b req-999c0d2e-e37f-457f-94b1-e158c9e59502 service nova] [instance: 0d674bd2-7546-41c8-a4cf-3e26ea91edb4] Updating instance_info_cache with network_info: [] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:11:48 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-61a9d7d5-0653-4223-b252-4aab682c649b req-999c0d2e-e37f-457f-94b1-e158c9e59502 service nova] Releasing lock "refresh_cache-0d674bd2-7546-41c8-a4cf-3e26ea91edb4" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:11:48 user nova-compute[75165]: DEBUG nova.compute.manager [req-61a9d7d5-0653-4223-b252-4aab682c649b req-999c0d2e-e37f-457f-94b1-e158c9e59502 service nova] [instance: 6f9add59-cabe-4965-8fe3-524618550581] Received event network-vif-plugged-50bf388e-b8ff-4924-9633-7e97d083a361 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:11:48 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-61a9d7d5-0653-4223-b252-4aab682c649b req-999c0d2e-e37f-457f-94b1-e158c9e59502 service nova] Acquiring lock "6f9add59-cabe-4965-8fe3-524618550581-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:11:48 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-61a9d7d5-0653-4223-b252-4aab682c649b req-999c0d2e-e37f-457f-94b1-e158c9e59502 service nova] Lock "6f9add59-cabe-4965-8fe3-524618550581-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:11:48 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-61a9d7d5-0653-4223-b252-4aab682c649b req-999c0d2e-e37f-457f-94b1-e158c9e59502 service nova] Lock "6f9add59-cabe-4965-8fe3-524618550581-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:11:48 user nova-compute[75165]: DEBUG nova.compute.manager [req-61a9d7d5-0653-4223-b252-4aab682c649b req-999c0d2e-e37f-457f-94b1-e158c9e59502 service nova] [instance: 6f9add59-cabe-4965-8fe3-524618550581] No waiting events found dispatching network-vif-plugged-50bf388e-b8ff-4924-9633-7e97d083a361 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:11:48 user nova-compute[75165]: WARNING nova.compute.manager [req-61a9d7d5-0653-4223-b252-4aab682c649b req-999c0d2e-e37f-457f-94b1-e158c9e59502 service nova] [instance: 6f9add59-cabe-4965-8fe3-524618550581] Received unexpected event network-vif-plugged-50bf388e-b8ff-4924-9633-7e97d083a361 for instance with vm_state shelved_offloaded and task_state spawning.
Oct 26 00:11:48 user nova-compute[75165]: DEBUG nova.compute.manager [req-61a9d7d5-0653-4223-b252-4aab682c649b req-999c0d2e-e37f-457f-94b1-e158c9e59502 service nova] [instance: 0d674bd2-7546-41c8-a4cf-3e26ea91edb4] Received event network-changed-c0030fb9-8756-4bb4-bccd-81f641be1b1d {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:11:48 user nova-compute[75165]: DEBUG nova.compute.manager [req-61a9d7d5-0653-4223-b252-4aab682c649b req-999c0d2e-e37f-457f-94b1-e158c9e59502 service nova] [instance: 0d674bd2-7546-41c8-a4cf-3e26ea91edb4] Refreshing instance network info cache due to event network-changed-c0030fb9-8756-4bb4-bccd-81f641be1b1d. {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 00:11:48 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-61a9d7d5-0653-4223-b252-4aab682c649b req-999c0d2e-e37f-457f-94b1-e158c9e59502 service nova] Acquiring lock "refresh_cache-0d674bd2-7546-41c8-a4cf-3e26ea91edb4" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:11:48 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-61a9d7d5-0653-4223-b252-4aab682c649b req-999c0d2e-e37f-457f-94b1-e158c9e59502 service nova] Acquired lock "refresh_cache-0d674bd2-7546-41c8-a4cf-3e26ea91edb4" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:11:48 user nova-compute[75165]: DEBUG nova.network.neutron [req-61a9d7d5-0653-4223-b252-4aab682c649b req-999c0d2e-e37f-457f-94b1-e158c9e59502 service nova] [instance: 0d674bd2-7546-41c8-a4cf-3e26ea91edb4] Refreshing network info cache for port c0030fb9-8756-4bb4-bccd-81f641be1b1d {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 00:11:48 user nova-compute[75165]: DEBUG nova.compute.manager [None req-1391af4e-f17d-4343-b3d6-46a1950775f0 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] [instance: 6f9add59-cabe-4965-8fe3-524618550581] Checking state {{(pid=75165) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 00:11:48 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:49 user nova-compute[75165]: DEBUG nova.network.neutron [req-61a9d7d5-0653-4223-b252-4aab682c649b req-999c0d2e-e37f-457f-94b1-e158c9e59502 service nova] [instance: 0d674bd2-7546-41c8-a4cf-3e26ea91edb4] Instance cache missing network info. {{(pid=75165) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 00:11:49 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-1391af4e-f17d-4343-b3d6-46a1950775f0 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Lock "6f9add59-cabe-4965-8fe3-524618550581" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 41.278s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:11:49 user nova-compute[75165]: DEBUG nova.network.neutron [None req-25b7cf3b-70f7-42f9-ae34-60f1c9b0de36 tempest-TaggedBootDevicesTest-1951782657 tempest-TaggedBootDevicesTest-1951782657-project-member] [instance: 0d674bd2-7546-41c8-a4cf-3e26ea91edb4] Successfully updated port: 436df163-583d-40c7-b5cb-399cfa13e825 {{(pid=75165) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 00:11:49 user nova-compute[75165]: DEBUG nova.network.neutron [req-61a9d7d5-0653-4223-b252-4aab682c649b req-999c0d2e-e37f-457f-94b1-e158c9e59502 service nova] [instance: 0d674bd2-7546-41c8-a4cf-3e26ea91edb4] Updating instance_info_cache with network_info: [] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:11:49 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-61a9d7d5-0653-4223-b252-4aab682c649b req-999c0d2e-e37f-457f-94b1-e158c9e59502 service nova] Releasing lock "refresh_cache-0d674bd2-7546-41c8-a4cf-3e26ea91edb4" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:11:50 user nova-compute[75165]: INFO nova.compute.manager [None req-eca5f738-4e10-4c86-b050-c2dcb595d6fa tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] [instance: 8d5569ce-1f18-4f37-a340-099ee152d548] Took 3.60 seconds to detach 3 volumes for instance.
Oct 26 00:11:50 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-eca5f738-4e10-4c86-b050-c2dcb595d6fa tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:11:50 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-eca5f738-4e10-4c86-b050-c2dcb595d6fa tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:11:50 user nova-compute[75165]: DEBUG nova.compute.manager [req-6a60df02-f6ed-4f24-939d-6e4b347a0471 req-fe9efb2c-32cf-486a-8583-206bc2434de9 service nova] [instance: 0d674bd2-7546-41c8-a4cf-3e26ea91edb4] Received event network-changed-436df163-583d-40c7-b5cb-399cfa13e825 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:11:50 user nova-compute[75165]: DEBUG nova.compute.manager [req-6a60df02-f6ed-4f24-939d-6e4b347a0471 req-fe9efb2c-32cf-486a-8583-206bc2434de9 service nova] [instance: 0d674bd2-7546-41c8-a4cf-3e26ea91edb4] Refreshing instance network info cache due to event network-changed-436df163-583d-40c7-b5cb-399cfa13e825. {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 00:11:50 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-6a60df02-f6ed-4f24-939d-6e4b347a0471 req-fe9efb2c-32cf-486a-8583-206bc2434de9 service nova] Acquiring lock "refresh_cache-0d674bd2-7546-41c8-a4cf-3e26ea91edb4" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:11:50 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-6a60df02-f6ed-4f24-939d-6e4b347a0471 req-fe9efb2c-32cf-486a-8583-206bc2434de9 service nova] Acquired lock "refresh_cache-0d674bd2-7546-41c8-a4cf-3e26ea91edb4" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:11:50 user nova-compute[75165]: DEBUG nova.network.neutron [req-6a60df02-f6ed-4f24-939d-6e4b347a0471 req-fe9efb2c-32cf-486a-8583-206bc2434de9 service nova] [instance: 0d674bd2-7546-41c8-a4cf-3e26ea91edb4] Refreshing network info cache for port 436df163-583d-40c7-b5cb-399cfa13e825 {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 00:11:50 user nova-compute[75165]: DEBUG nova.network.neutron [req-6a60df02-f6ed-4f24-939d-6e4b347a0471 req-fe9efb2c-32cf-486a-8583-206bc2434de9 service nova] [instance: 0d674bd2-7546-41c8-a4cf-3e26ea91edb4] Instance cache missing network info. {{(pid=75165) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 00:11:50 user nova-compute[75165]: DEBUG nova.network.neutron [None req-25b7cf3b-70f7-42f9-ae34-60f1c9b0de36 tempest-TaggedBootDevicesTest-1951782657 tempest-TaggedBootDevicesTest-1951782657-project-member] [instance: 0d674bd2-7546-41c8-a4cf-3e26ea91edb4] Successfully updated port: 9786a81f-a18c-410b-bafc-ff11bfa432f3 {{(pid=75165) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 00:11:50 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:50 user nova-compute[75165]: DEBUG nova.network.neutron [req-6a60df02-f6ed-4f24-939d-6e4b347a0471 req-fe9efb2c-32cf-486a-8583-206bc2434de9 service nova] [instance: 0d674bd2-7546-41c8-a4cf-3e26ea91edb4] Updating instance_info_cache with network_info: [] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:11:50 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-eca5f738-4e10-4c86-b050-c2dcb595d6fa tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:11:50 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-6a60df02-f6ed-4f24-939d-6e4b347a0471 req-fe9efb2c-32cf-486a-8583-206bc2434de9 service nova] Releasing lock "refresh_cache-0d674bd2-7546-41c8-a4cf-3e26ea91edb4" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:11:50 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-eca5f738-4e10-4c86-b050-c2dcb595d6fa tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:11:50 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-eca5f738-4e10-4c86-b050-c2dcb595d6fa tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.554s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:11:50 user nova-compute[75165]: INFO nova.scheduler.client.report [None req-eca5f738-4e10-4c86-b050-c2dcb595d6fa tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Deleted allocations for instance 8d5569ce-1f18-4f37-a340-099ee152d548
Oct 26 00:11:50 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-eca5f738-4e10-4c86-b050-c2dcb595d6fa tempest-TaggedBootDevicesTest_v242-1432681902 tempest-TaggedBootDevicesTest_v242-1432681902-project-member] Lock "8d5569ce-1f18-4f37-a340-099ee152d548" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 15.020s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:11:51 user nova-compute[75165]: DEBUG nova.network.neutron [None req-25b7cf3b-70f7-42f9-ae34-60f1c9b0de36 tempest-TaggedBootDevicesTest-1951782657 tempest-TaggedBootDevicesTest-1951782657-project-member] [instance: 0d674bd2-7546-41c8-a4cf-3e26ea91edb4] Successfully updated port: bd100fe9-891f-42dc-8fbd-41d2322cd099 {{(pid=75165) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 00:11:52 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:52 user nova-compute[75165]: DEBUG nova.compute.manager [req-7c17f2f1-3170-48b7-b61c-df6321ac089e req-56077c3c-1e5b-45c4-9a50-faea9709d888 service nova] [instance: 0d674bd2-7546-41c8-a4cf-3e26ea91edb4] Received event network-changed-9786a81f-a18c-410b-bafc-ff11bfa432f3 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:11:52 user nova-compute[75165]: DEBUG nova.compute.manager [req-7c17f2f1-3170-48b7-b61c-df6321ac089e req-56077c3c-1e5b-45c4-9a50-faea9709d888 service nova] [instance: 0d674bd2-7546-41c8-a4cf-3e26ea91edb4] Refreshing instance network info cache due to event network-changed-9786a81f-a18c-410b-bafc-ff11bfa432f3. {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 00:11:52 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-7c17f2f1-3170-48b7-b61c-df6321ac089e req-56077c3c-1e5b-45c4-9a50-faea9709d888 service nova] Acquiring lock "refresh_cache-0d674bd2-7546-41c8-a4cf-3e26ea91edb4" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:11:52 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-7c17f2f1-3170-48b7-b61c-df6321ac089e req-56077c3c-1e5b-45c4-9a50-faea9709d888 service nova] Acquired lock "refresh_cache-0d674bd2-7546-41c8-a4cf-3e26ea91edb4" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:11:52 user nova-compute[75165]: DEBUG nova.network.neutron [req-7c17f2f1-3170-48b7-b61c-df6321ac089e req-56077c3c-1e5b-45c4-9a50-faea9709d888 service nova] [instance: 0d674bd2-7546-41c8-a4cf-3e26ea91edb4] Refreshing network info cache for port 9786a81f-a18c-410b-bafc-ff11bfa432f3 {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 00:11:52 user nova-compute[75165]: DEBUG nova.network.neutron [req-7c17f2f1-3170-48b7-b61c-df6321ac089e req-56077c3c-1e5b-45c4-9a50-faea9709d888 service nova] [instance: 0d674bd2-7546-41c8-a4cf-3e26ea91edb4] Instance cache missing network info. {{(pid=75165) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 00:11:52 user nova-compute[75165]: DEBUG nova.network.neutron [None req-25b7cf3b-70f7-42f9-ae34-60f1c9b0de36 tempest-TaggedBootDevicesTest-1951782657 tempest-TaggedBootDevicesTest-1951782657-project-member] [instance: 0d674bd2-7546-41c8-a4cf-3e26ea91edb4] Successfully updated port: d82f307d-35a8-422d-b55d-12917be12db6 {{(pid=75165) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 00:11:53 user nova-compute[75165]: DEBUG nova.network.neutron [req-7c17f2f1-3170-48b7-b61c-df6321ac089e req-56077c3c-1e5b-45c4-9a50-faea9709d888 service nova] [instance: 0d674bd2-7546-41c8-a4cf-3e26ea91edb4] Updating instance_info_cache with network_info: [] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:11:53 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-7c17f2f1-3170-48b7-b61c-df6321ac089e req-56077c3c-1e5b-45c4-9a50-faea9709d888 service nova] Releasing lock "refresh_cache-0d674bd2-7546-41c8-a4cf-3e26ea91edb4" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:11:53 user nova-compute[75165]: DEBUG nova.compute.manager [req-7c17f2f1-3170-48b7-b61c-df6321ac089e req-56077c3c-1e5b-45c4-9a50-faea9709d888 service nova] [instance: 0d674bd2-7546-41c8-a4cf-3e26ea91edb4] Received event network-changed-bd100fe9-891f-42dc-8fbd-41d2322cd099 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:11:53 user nova-compute[75165]: DEBUG nova.compute.manager [req-7c17f2f1-3170-48b7-b61c-df6321ac089e req-56077c3c-1e5b-45c4-9a50-faea9709d888 service nova] [instance: 0d674bd2-7546-41c8-a4cf-3e26ea91edb4] Refreshing instance network info cache due to event network-changed-bd100fe9-891f-42dc-8fbd-41d2322cd099. {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 00:11:53 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-7c17f2f1-3170-48b7-b61c-df6321ac089e req-56077c3c-1e5b-45c4-9a50-faea9709d888 service nova] Acquiring lock "refresh_cache-0d674bd2-7546-41c8-a4cf-3e26ea91edb4" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:11:53 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-7c17f2f1-3170-48b7-b61c-df6321ac089e req-56077c3c-1e5b-45c4-9a50-faea9709d888 service nova] Acquired lock "refresh_cache-0d674bd2-7546-41c8-a4cf-3e26ea91edb4" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:11:53 user nova-compute[75165]: DEBUG nova.network.neutron [req-7c17f2f1-3170-48b7-b61c-df6321ac089e req-56077c3c-1e5b-45c4-9a50-faea9709d888 service nova] [instance: 0d674bd2-7546-41c8-a4cf-3e26ea91edb4] Refreshing network info cache for port bd100fe9-891f-42dc-8fbd-41d2322cd099 {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 00:11:53 user nova-compute[75165]: DEBUG nova.network.neutron [req-7c17f2f1-3170-48b7-b61c-df6321ac089e req-56077c3c-1e5b-45c4-9a50-faea9709d888 service nova] [instance: 0d674bd2-7546-41c8-a4cf-3e26ea91edb4] Instance cache missing network info. {{(pid=75165) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 00:11:53 user nova-compute[75165]: DEBUG nova.network.neutron [req-7c17f2f1-3170-48b7-b61c-df6321ac089e req-56077c3c-1e5b-45c4-9a50-faea9709d888 service nova] [instance: 0d674bd2-7546-41c8-a4cf-3e26ea91edb4] Updating instance_info_cache with network_info: [] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:11:53 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-7c17f2f1-3170-48b7-b61c-df6321ac089e req-56077c3c-1e5b-45c4-9a50-faea9709d888 service nova] Releasing lock "refresh_cache-0d674bd2-7546-41c8-a4cf-3e26ea91edb4" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:11:53 user nova-compute[75165]: DEBUG nova.network.neutron [None req-25b7cf3b-70f7-42f9-ae34-60f1c9b0de36 tempest-TaggedBootDevicesTest-1951782657 tempest-TaggedBootDevicesTest-1951782657-project-member] [instance: 0d674bd2-7546-41c8-a4cf-3e26ea91edb4] Successfully updated port: b3519c1c-0881-436a-8d24-dbba3a655564 {{(pid=75165) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 00:11:53 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-25b7cf3b-70f7-42f9-ae34-60f1c9b0de36 tempest-TaggedBootDevicesTest-1951782657 tempest-TaggedBootDevicesTest-1951782657-project-member] Acquiring lock "refresh_cache-0d674bd2-7546-41c8-a4cf-3e26ea91edb4" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:11:53 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-25b7cf3b-70f7-42f9-ae34-60f1c9b0de36 tempest-TaggedBootDevicesTest-1951782657 tempest-TaggedBootDevicesTest-1951782657-project-member] Acquired lock "refresh_cache-0d674bd2-7546-41c8-a4cf-3e26ea91edb4" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:11:53 user nova-compute[75165]: DEBUG nova.network.neutron [None req-25b7cf3b-70f7-42f9-ae34-60f1c9b0de36 tempest-TaggedBootDevicesTest-1951782657 tempest-TaggedBootDevicesTest-1951782657-project-member] [instance: 0d674bd2-7546-41c8-a4cf-3e26ea91edb4] Building network info cache for instance {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 00:11:53 user nova-compute[75165]: DEBUG nova.network.neutron [None req-25b7cf3b-70f7-42f9-ae34-60f1c9b0de36 tempest-TaggedBootDevicesTest-1951782657 tempest-TaggedBootDevicesTest-1951782657-project-member] [instance: 0d674bd2-7546-41c8-a4cf-3e26ea91edb4] Instance cache missing network info. {{(pid=75165) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 00:11:53 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:54 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:54 user nova-compute[75165]: DEBUG nova.compute.manager [req-b36a051f-e96b-4ad3-87b0-505786dfc34c req-f94bf1dd-0d96-4fd6-9196-ad7ae54ef22b service nova] [instance: 0d674bd2-7546-41c8-a4cf-3e26ea91edb4] Received event network-changed-d82f307d-35a8-422d-b55d-12917be12db6 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:11:54 user nova-compute[75165]: DEBUG nova.compute.manager [req-b36a051f-e96b-4ad3-87b0-505786dfc34c req-f94bf1dd-0d96-4fd6-9196-ad7ae54ef22b service nova] [instance: 0d674bd2-7546-41c8-a4cf-3e26ea91edb4] Refreshing instance network info cache due to event network-changed-d82f307d-35a8-422d-b55d-12917be12db6. {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 00:11:54 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-b36a051f-e96b-4ad3-87b0-505786dfc34c req-f94bf1dd-0d96-4fd6-9196-ad7ae54ef22b service nova] Acquiring lock "refresh_cache-0d674bd2-7546-41c8-a4cf-3e26ea91edb4" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:11:54 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-f1c90eb7-c349-4a58-94ff-cc01e1bae746 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] Acquiring lock "45625147-ff69-496a-a41e-e55f818a020a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:11:54 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-f1c90eb7-c349-4a58-94ff-cc01e1bae746 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] Lock "45625147-ff69-496a-a41e-e55f818a020a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:11:54 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-f1c90eb7-c349-4a58-94ff-cc01e1bae746 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] Acquiring lock "45625147-ff69-496a-a41e-e55f818a020a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:11:54 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-f1c90eb7-c349-4a58-94ff-cc01e1bae746 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] Lock "45625147-ff69-496a-a41e-e55f818a020a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:11:54 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-f1c90eb7-c349-4a58-94ff-cc01e1bae746 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] Lock "45625147-ff69-496a-a41e-e55f818a020a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:11:54 user nova-compute[75165]: INFO nova.compute.manager [None req-f1c90eb7-c349-4a58-94ff-cc01e1bae746 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] [instance: 45625147-ff69-496a-a41e-e55f818a020a] Terminating instance
Oct 26 00:11:54 user nova-compute[75165]: DEBUG nova.compute.manager [None req-f1c90eb7-c349-4a58-94ff-cc01e1bae746 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] [instance: 45625147-ff69-496a-a41e-e55f818a020a] Start destroying the instance on the hypervisor. {{(pid=75165) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 00:11:54 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:54 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:54 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:54 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:55 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-b77af02b-ef0b-481e-ab99-10db43f9a8ec tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] Acquiring lock "b0edba5b-e4d8-4b0a-ace1-1f32c19f8bd0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:11:55 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-b77af02b-ef0b-481e-ab99-10db43f9a8ec tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] Lock "b0edba5b-e4d8-4b0a-ace1-1f32c19f8bd0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:11:55 user nova-compute[75165]: DEBUG nova.compute.manager [None req-b77af02b-ef0b-481e-ab99-10db43f9a8ec tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] [instance: b0edba5b-e4d8-4b0a-ace1-1f32c19f8bd0] Starting instance... {{(pid=75165) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 00:11:55 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-b77af02b-ef0b-481e-ab99-10db43f9a8ec tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:11:55 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-b77af02b-ef0b-481e-ab99-10db43f9a8ec tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:11:55 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-b77af02b-ef0b-481e-ab99-10db43f9a8ec tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75165) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 00:11:55 user nova-compute[75165]: INFO nova.compute.claims [None req-b77af02b-ef0b-481e-ab99-10db43f9a8ec tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] [instance: b0edba5b-e4d8-4b0a-ace1-1f32c19f8bd0] Claim successful on node user
Oct 26 00:11:55 user nova-compute[75165]: DEBUG nova.compute.manager [req-df509a43-300b-4f67-8854-585308572695 req-fe0114c7-9370-4f96-805f-24c369c28941 service nova] [instance: 45625147-ff69-496a-a41e-e55f818a020a] Received event network-vif-unplugged-7fb6b434-f67e-4199-90c4-fa1fad18e7d3 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:11:55 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-df509a43-300b-4f67-8854-585308572695 req-fe0114c7-9370-4f96-805f-24c369c28941 service nova] Acquiring lock "45625147-ff69-496a-a41e-e55f818a020a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:11:55 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-df509a43-300b-4f67-8854-585308572695 req-fe0114c7-9370-4f96-805f-24c369c28941 service nova] Lock "45625147-ff69-496a-a41e-e55f818a020a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:11:55 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-df509a43-300b-4f67-8854-585308572695 req-fe0114c7-9370-4f96-805f-24c369c28941 service nova] Lock "45625147-ff69-496a-a41e-e55f818a020a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:11:55 user nova-compute[75165]: DEBUG nova.compute.manager [req-df509a43-300b-4f67-8854-585308572695 req-fe0114c7-9370-4f96-805f-24c369c28941 service nova] [instance: 45625147-ff69-496a-a41e-e55f818a020a] No waiting events found dispatching network-vif-unplugged-7fb6b434-f67e-4199-90c4-fa1fad18e7d3 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:11:55 user nova-compute[75165]: DEBUG nova.compute.manager [req-df509a43-300b-4f67-8854-585308572695 req-fe0114c7-9370-4f96-805f-24c369c28941 service nova] [instance: 45625147-ff69-496a-a41e-e55f818a020a] Received event network-vif-unplugged-7fb6b434-f67e-4199-90c4-fa1fad18e7d3 for instance with task_state deleting. {{(pid=75165) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 00:11:55 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: 45625147-ff69-496a-a41e-e55f818a020a] Instance destroyed successfully.
Oct 26 00:11:55 user nova-compute[75165]: DEBUG nova.objects.instance [None req-f1c90eb7-c349-4a58-94ff-cc01e1bae746 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] Lazy-loading 'resources' on Instance uuid 45625147-ff69-496a-a41e-e55f818a020a {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:11:55 user nova-compute[75165]: INFO nova.compute.manager [None req-6db2beaf-9e50-49cf-9f49-fff9c060570f tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: 84c6b624-648b-40e2-a37e-ff08609bad84] Rescuing
Oct 26 00:11:55 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-6db2beaf-9e50-49cf-9f49-fff9c060570f tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Acquiring lock "refresh_cache-84c6b624-648b-40e2-a37e-ff08609bad84" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:11:55 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-6db2beaf-9e50-49cf-9f49-fff9c060570f tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Acquired lock "refresh_cache-84c6b624-648b-40e2-a37e-ff08609bad84" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:11:55 user nova-compute[75165]: DEBUG nova.network.neutron [None req-6db2beaf-9e50-49cf-9f49-fff9c060570f tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: 84c6b624-648b-40e2-a37e-ff08609bad84] Building network info cache for instance {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 00:11:55 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-f1c90eb7-c349-4a58-94ff-cc01e1bae746 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:07:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1723786526',display_name='tempest-TestVolumeSwap-server-1723786526',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1723786526',id=11,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGzvl8YzXucCRJmSg+rBvqsEIEBbGtA16LyHx9evlPcLmx8TBhVJw/r0t2RsVNke7YQun20Rwl8Ds1wLo3s2asOeduC/op42j/TTiGLAQDskai4R0VsuSVI+dDOoN49OJw==',key_name='tempest-keypair-885110349',keypairs=<?>,launch_index=0,launched_at=2023-10-26T00:07:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fc552db87c094e77aee0361963486d93',ramdisk_id='',reservation_id='r-uimpmxb3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-1089431236',owner_user_name='tempest-TestVolumeSwap-1089431236-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T00:08:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3bca70683da14dcb9023f9b15ae72d47',uuid=45625147-ff69-496a-a41e-e55f818a020a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7fb6b434-f67e-4199-90c4-fa1fad18e7d3", "address": "fa:16:3e:1f:92:cd", "network": {"id": "54cfbfa8-e5be-4d9e-88fd-c086a6f8c834", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2062887918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc552db87c094e77aee0361963486d93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fb6b434-f6", "ovs_interfaceid": "7fb6b434-f67e-4199-90c4-fa1fad18e7d3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 00:11:55 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-f1c90eb7-c349-4a58-94ff-cc01e1bae746 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] Converting VIF {"id": "7fb6b434-f67e-4199-90c4-fa1fad18e7d3", "address": "fa:16:3e:1f:92:cd", "network": {"id": "54cfbfa8-e5be-4d9e-88fd-c086a6f8c834", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2062887918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc552db87c094e77aee0361963486d93", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fb6b434-f6", "ovs_interfaceid": "7fb6b434-f67e-4199-90c4-fa1fad18e7d3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:11:55 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-f1c90eb7-c349-4a58-94ff-cc01e1bae746 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1f:92:cd,bridge_name='br-int',has_traffic_filtering=True,id=7fb6b434-f67e-4199-90c4-fa1fad18e7d3,network=Network(54cfbfa8-e5be-4d9e-88fd-c086a6f8c834),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7fb6b434-f6') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:11:55 user nova-compute[75165]: DEBUG os_vif [None req-f1c90eb7-c349-4a58-94ff-cc01e1bae746 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1f:92:cd,bridge_name='br-int',has_traffic_filtering=True,id=7fb6b434-f67e-4199-90c4-fa1fad18e7d3,network=Network(54cfbfa8-e5be-4d9e-88fd-c086a6f8c834),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7fb6b434-f6') {{(pid=75165) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 00:11:55 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:55 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7fb6b434-f6, bridge=br-int, if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:11:55 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:11:55 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:55 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f7d25885-615a-49ef-b056-0d5ecf858fee) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:11:55 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:55 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:11:55 user nova-compute[75165]: INFO os_vif [None req-f1c90eb7-c349-4a58-94ff-cc01e1bae746 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1f:92:cd,bridge_name='br-int',has_traffic_filtering=True,id=7fb6b434-f67e-4199-90c4-fa1fad18e7d3,network=Network(54cfbfa8-e5be-4d9e-88fd-c086a6f8c834),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7fb6b434-f6')
Oct 26 00:11:55 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-f1c90eb7-c349-4a58-94ff-cc01e1bae746 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] [instance: 45625147-ff69-496a-a41e-e55f818a020a] Deleting instance files /opt/stack/data/nova/instances/45625147-ff69-496a-a41e-e55f818a020a_del
Oct 26 00:11:55 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-f1c90eb7-c349-4a58-94ff-cc01e1bae746 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] [instance: 45625147-ff69-496a-a41e-e55f818a020a] Deletion of /opt/stack/data/nova/instances/45625147-ff69-496a-a41e-e55f818a020a_del complete
Oct 26 00:11:55 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:55 user nova-compute[75165]: INFO nova.compute.manager [None req-f1c90eb7-c349-4a58-94ff-cc01e1bae746 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] [instance: 45625147-ff69-496a-a41e-e55f818a020a] Took 1.18 seconds to destroy the instance on the hypervisor.
Oct 26 00:11:55 user nova-compute[75165]: DEBUG oslo.service.loopingcall [None req-f1c90eb7-c349-4a58-94ff-cc01e1bae746 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75165) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 00:11:55 user nova-compute[75165]: DEBUG nova.compute.manager [-] [instance: 45625147-ff69-496a-a41e-e55f818a020a] Deallocating network for instance {{(pid=75165) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 00:11:55 user nova-compute[75165]: DEBUG nova.network.neutron [-] [instance: 45625147-ff69-496a-a41e-e55f818a020a] deallocate_for_instance() {{(pid=75165) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 00:11:55 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-b77af02b-ef0b-481e-ab99-10db43f9a8ec tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:11:55 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-b77af02b-ef0b-481e-ab99-10db43f9a8ec tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:11:55 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-b77af02b-ef0b-481e-ab99-10db43f9a8ec tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.803s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:11:55 user nova-compute[75165]: DEBUG nova.compute.manager [None req-b77af02b-ef0b-481e-ab99-10db43f9a8ec tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] [instance: b0edba5b-e4d8-4b0a-ace1-1f32c19f8bd0] Start building networks asynchronously for instance. {{(pid=75165) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 00:11:56 user nova-compute[75165]: DEBUG nova.compute.manager [None req-b77af02b-ef0b-481e-ab99-10db43f9a8ec tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] [instance: b0edba5b-e4d8-4b0a-ace1-1f32c19f8bd0] Allocating IP information in the background. {{(pid=75165) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 00:11:56 user nova-compute[75165]: DEBUG nova.network.neutron [None req-b77af02b-ef0b-481e-ab99-10db43f9a8ec tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] [instance: b0edba5b-e4d8-4b0a-ace1-1f32c19f8bd0] allocate_for_instance() {{(pid=75165) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 00:11:56 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-b77af02b-ef0b-481e-ab99-10db43f9a8ec tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] [instance: b0edba5b-e4d8-4b0a-ace1-1f32c19f8bd0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 00:11:56 user nova-compute[75165]: DEBUG nova.compute.manager [None req-b77af02b-ef0b-481e-ab99-10db43f9a8ec tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] [instance: b0edba5b-e4d8-4b0a-ace1-1f32c19f8bd0] Start building block device mappings for instance. {{(pid=75165) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 00:11:56 user nova-compute[75165]: DEBUG nova.compute.manager [None req-b77af02b-ef0b-481e-ab99-10db43f9a8ec tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] [instance: b0edba5b-e4d8-4b0a-ace1-1f32c19f8bd0] Start spawning the instance on the hypervisor. {{(pid=75165) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 00:11:56 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-b77af02b-ef0b-481e-ab99-10db43f9a8ec tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] [instance: b0edba5b-e4d8-4b0a-ace1-1f32c19f8bd0] Creating instance directory {{(pid=75165) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 00:11:56 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-b77af02b-ef0b-481e-ab99-10db43f9a8ec tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] [instance: b0edba5b-e4d8-4b0a-ace1-1f32c19f8bd0] Creating image(s)
Oct 26 00:11:56 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-b77af02b-ef0b-481e-ab99-10db43f9a8ec tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] Acquiring lock "/opt/stack/data/nova/instances/b0edba5b-e4d8-4b0a-ace1-1f32c19f8bd0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:11:56 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-b77af02b-ef0b-481e-ab99-10db43f9a8ec tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] Lock "/opt/stack/data/nova/instances/b0edba5b-e4d8-4b0a-ace1-1f32c19f8bd0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:11:56 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-b77af02b-ef0b-481e-ab99-10db43f9a8ec tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] Lock "/opt/stack/data/nova/instances/b0edba5b-e4d8-4b0a-ace1-1f32c19f8bd0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:11:56 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-b77af02b-ef0b-481e-ab99-10db43f9a8ec tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:56 user nova-compute[75165]: DEBUG nova.policy [None req-b77af02b-ef0b-481e-ab99-10db43f9a8ec tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f1b35e426f0f488b9fab44fe85bcff98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c9acab3d48a43568a5096c8d786538d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75165) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 00:11:56 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-b77af02b-ef0b-481e-ab99-10db43f9a8ec tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json" returned: 0 in 0.223s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:56 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-b77af02b-ef0b-481e-ab99-10db43f9a8ec tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] Acquiring lock "7d3243421cf3fdc288b758f687a93103b7b95466" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:11:56 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-b77af02b-ef0b-481e-ab99-10db43f9a8ec tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] Lock "7d3243421cf3fdc288b758f687a93103b7b95466" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:11:56 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-b77af02b-ef0b-481e-ab99-10db43f9a8ec tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:56 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-b77af02b-ef0b-481e-ab99-10db43f9a8ec tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json" returned: 0 in 0.208s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:56 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-b77af02b-ef0b-481e-ab99-10db43f9a8ec tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466,backing_fmt=raw /opt/stack/data/nova/instances/b0edba5b-e4d8-4b0a-ace1-1f32c19f8bd0/disk 1073741824 {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:56 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-b77af02b-ef0b-481e-ab99-10db43f9a8ec tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466,backing_fmt=raw /opt/stack/data/nova/instances/b0edba5b-e4d8-4b0a-ace1-1f32c19f8bd0/disk 1073741824" returned: 0 in 0.059s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:56 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-b77af02b-ef0b-481e-ab99-10db43f9a8ec tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] Lock "7d3243421cf3fdc288b758f687a93103b7b95466" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.274s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:11:56 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-b77af02b-ef0b-481e-ab99-10db43f9a8ec tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:56 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-b77af02b-ef0b-481e-ab99-10db43f9a8ec tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json" returned: 0 in 0.206s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:56 user nova-compute[75165]: DEBUG nova.virt.disk.api [None req-b77af02b-ef0b-481e-ab99-10db43f9a8ec tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b0edba5b-e4d8-4b0a-ace1-1f32c19f8bd0/disk. size=1073741824 {{(pid=75165) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 00:11:56 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-b77af02b-ef0b-481e-ab99-10db43f9a8ec tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0edba5b-e4d8-4b0a-ace1-1f32c19f8bd0/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:57 user nova-compute[75165]: DEBUG nova.network.neutron [None req-25b7cf3b-70f7-42f9-ae34-60f1c9b0de36 tempest-TaggedBootDevicesTest-1951782657 tempest-TaggedBootDevicesTest-1951782657-project-member] [instance: 0d674bd2-7546-41c8-a4cf-3e26ea91edb4] Updating instance_info_cache with network_info: [{"id": "d43c2029-2e2c-4a0b-b357-3842f7ff6ef4", "address": "fa:16:3e:8f:db:86", "network": {"id": "9d1bd900-5a54-45e0-9d46-f14f210f80b3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1557334932-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd12c108abe0403d946f213bcd130ef2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd43c2029-2e", "ovs_interfaceid": "d43c2029-2e2c-4a0b-b357-3842f7ff6ef4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c0030fb9-8756-4bb4-bccd-81f641be1b1d", "address": "fa:16:3e:ec:9c:fe", "network": {"id": "61920581-973b-4c89-a36c-b0dfc6e2f4e4", "bridge": "br-int", "label": "tempest-device-tagging-net1-149272300", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fd12c108abe0403d946f213bcd130ef2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0030fb9-87", "ovs_interfaceid": "c0030fb9-8756-4bb4-bccd-81f641be1b1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "436df163-583d-40c7-b5cb-399cfa13e825", "address": "fa:16:3e:3e:2e:25", "network": {"id": "61920581-973b-4c89-a36c-b0dfc6e2f4e4", "bridge": "br-int", "label": "tempest-device-tagging-net1-149272300", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.247", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fd12c108abe0403d946f213bcd130ef2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap436df163-58", "ovs_interfaceid": "436df163-583d-40c7-b5cb-399cfa13e825", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9786a81f-a18c-410b-bafc-ff11bfa432f3", "address": "fa:16:3e:63:8e:05", "network": {"id": "61920581-973b-4c89-a36c-b0dfc6e2f4e4", "bridge": "br-int", "label": "tempest-device-tagging-net1-149272300", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fd12c108abe0403d946f213bcd130ef2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9786a81f-a1", "ovs_interfaceid": "9786a81f-a18c-410b-bafc-ff11bfa432f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bd100fe9-891f-42dc-8fbd-41d2322cd099", "address": "fa:16:3e:02:dc:c4", "network": {"id": "61920581-973b-4c89-a36c-b0dfc6e2f4e4", "bridge": "br-int", "label": "tempest-device-tagging-net1-149272300", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fd12c108abe0403d946f213bcd130ef2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd100fe9-89", "ovs_interfaceid": "bd100fe9-891f-42dc-8fbd-41d2322cd099", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d82f307d-35a8-422d-b55d-12917be12db6", "address": "fa:16:3e:d7:ec:e3", "network": {"id": "b584de90-889d-4482-b491-1278c381c537", "bridge": "br-int", "label": "tempest-device-tagging-net2-32906704", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fd12c108abe0403d946f213bcd130ef2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd82f307d-35", "ovs_interfaceid": "d82f307d-35a8-422d-b55d-12917be12db6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b3519c1c-0881-436a-8d24-dbba3a655564", "address": "fa:16:3e:f9:6e:de", "network": {"id": "b584de90-889d-4482-b491-1278c381c537", "bridge": "br-int", "label": "tempest-device-tagging-net2-32906704", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fd12c108abe0403d946f213bcd130ef2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3519c1c-08", "ovs_interfaceid": "b3519c1c-0881-436a-8d24-dbba3a655564", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:11:57 user nova-compute[75165]: DEBUG nova.network.neutron [None req-6db2beaf-9e50-49cf-9f49-fff9c060570f tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: 84c6b624-648b-40e2-a37e-ff08609bad84] Updating instance_info_cache with network_info: [{"id": "2107529c-ec0e-4d1d-85b4-8605dcabc415", "address": "fa:16:3e:0c:8a:94", "network": {"id": "b31bac4b-1951-4ca3-8682-f1f24de0a5c3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1323234642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71aa69c0ea2d49e184e1e055ff3efa1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2107529c-ec", "ovs_interfaceid": "2107529c-ec0e-4d1d-85b4-8605dcabc415", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:11:57 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-b77af02b-ef0b-481e-ab99-10db43f9a8ec tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0edba5b-e4d8-4b0a-ace1-1f32c19f8bd0/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:57 user nova-compute[75165]: DEBUG nova.virt.disk.api [None req-b77af02b-ef0b-481e-ab99-10db43f9a8ec tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] Cannot resize image /opt/stack/data/nova/instances/b0edba5b-e4d8-4b0a-ace1-1f32c19f8bd0/disk to a smaller size. {{(pid=75165) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 00:11:57 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-b77af02b-ef0b-481e-ab99-10db43f9a8ec tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] [instance: b0edba5b-e4d8-4b0a-ace1-1f32c19f8bd0] Created local disks {{(pid=75165) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 00:11:57 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-b77af02b-ef0b-481e-ab99-10db43f9a8ec tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] [instance: b0edba5b-e4d8-4b0a-ace1-1f32c19f8bd0] Ensure instance console log exists: /opt/stack/data/nova/instances/b0edba5b-e4d8-4b0a-ace1-1f32c19f8bd0/console.log {{(pid=75165) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 00:11:57 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-b77af02b-ef0b-481e-ab99-10db43f9a8ec tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:11:57 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-b77af02b-ef0b-481e-ab99-10db43f9a8ec tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:11:57 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-b77af02b-ef0b-481e-ab99-10db43f9a8ec tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:11:57 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-25b7cf3b-70f7-42f9-ae34-60f1c9b0de36 tempest-TaggedBootDevicesTest-1951782657 tempest-TaggedBootDevicesTest-1951782657-project-member] Releasing lock "refresh_cache-0d674bd2-7546-41c8-a4cf-3e26ea91edb4" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:11:57 user nova-compute[75165]: DEBUG nova.compute.manager [None req-25b7cf3b-70f7-42f9-ae34-60f1c9b0de36 tempest-TaggedBootDevicesTest-1951782657 tempest-TaggedBootDevicesTest-1951782657-project-member] [instance: 0d674bd2-7546-41c8-a4cf-3e26ea91edb4] Instance network_info: |[{"id": "d43c2029-2e2c-4a0b-b357-3842f7ff6ef4", "address": "fa:16:3e:8f:db:86", "network": {"id": "9d1bd900-5a54-45e0-9d46-f14f210f80b3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1557334932-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd12c108abe0403d946f213bcd130ef2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd43c2029-2e", "ovs_interfaceid": "d43c2029-2e2c-4a0b-b357-3842f7ff6ef4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c0030fb9-8756-4bb4-bccd-81f641be1b1d", "address": "fa:16:3e:ec:9c:fe", "network": {"id": "61920581-973b-4c89-a36c-b0dfc6e2f4e4", "bridge": "br-int", "label": "tempest-device-tagging-net1-149272300", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fd12c108abe0403d946f213bcd130ef2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0030fb9-87", "ovs_interfaceid": "c0030fb9-8756-4bb4-bccd-81f641be1b1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "436df163-583d-40c7-b5cb-399cfa13e825", "address": "fa:16:3e:3e:2e:25", "network": {"id": "61920581-973b-4c89-a36c-b0dfc6e2f4e4", "bridge": "br-int", "label": "tempest-device-tagging-net1-149272300", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.247", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fd12c108abe0403d946f213bcd130ef2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap436df163-58", "ovs_interfaceid": "436df163-583d-40c7-b5cb-399cfa13e825", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9786a81f-a18c-410b-bafc-ff11bfa432f3", "address": "fa:16:3e:63:8e:05", "network": {"id": "61920581-973b-4c89-a36c-b0dfc6e2f4e4", "bridge": "br-int", "label": "tempest-device-tagging-net1-149272300", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fd12c108abe0403d946f213bcd130ef2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9786a81f-a1", "ovs_interfaceid": "9786a81f-a18c-410b-bafc-ff11bfa432f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bd100fe9-891f-42dc-8fbd-41d2322cd099", "address": "fa:16:3e:02:dc:c4", "network": {"id": "61920581-973b-4c89-a36c-b0dfc6e2f4e4", "bridge": "br-int", "label": "tempest-device-tagging-net1-149272300", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fd12c108abe0403d946f213bcd130ef2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd100fe9-89", "ovs_interfaceid": "bd100fe9-891f-42dc-8fbd-41d2322cd099", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d82f307d-35a8-422d-b55d-12917be12db6", "address": "fa:16:3e:d7:ec:e3", "network": {"id": "b584de90-889d-4482-b491-1278c381c537", "bridge": "br-int", "label": "tempest-device-tagging-net2-32906704", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fd12c108abe0403d946f213bcd130ef2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd82f307d-35", "ovs_interfaceid": "d82f307d-35a8-422d-b55d-12917be12db6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b3519c1c-0881-436a-8d24-dbba3a655564", "address": "fa:16:3e:f9:6e:de", "network": {"id": "b584de90-889d-4482-b491-1278c381c537", "bridge": "br-int", "label": "tempest-device-tagging-net2-32906704", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fd12c108abe0403d946f213bcd130ef2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3519c1c-08", "ovs_interfaceid": "b3519c1c-0881-436a-8d24-dbba3a655564", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75165) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 00:11:57 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-b36a051f-e96b-4ad3-87b0-505786dfc34c req-f94bf1dd-0d96-4fd6-9196-ad7ae54ef22b service nova] Acquired lock "refresh_cache-0d674bd2-7546-41c8-a4cf-3e26ea91edb4" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:11:57 user nova-compute[75165]: DEBUG nova.network.neutron [req-b36a051f-e96b-4ad3-87b0-505786dfc34c req-f94bf1dd-0d96-4fd6-9196-ad7ae54ef22b service nova] [instance: 0d674bd2-7546-41c8-a4cf-3e26ea91edb4] Refreshing network info cache for port d82f307d-35a8-422d-b55d-12917be12db6 {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 00:11:57 user nova-compute[75165]: DEBUG nova.compute.claims [None req-25b7cf3b-70f7-42f9-ae34-60f1c9b0de36 tempest-TaggedBootDevicesTest-1951782657 tempest-TaggedBootDevicesTest-1951782657-project-member] [instance: 0d674bd2-7546-41c8-a4cf-3e26ea91edb4] Aborting claim: <nova.compute.claims.Claim object at 0x7f8bf8163550> {{(pid=75165) abort /opt/stack/nova/nova/compute/claims.py:84}}
Oct 26 00:11:57 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-25b7cf3b-70f7-42f9-ae34-60f1c9b0de36 tempest-TaggedBootDevicesTest-1951782657 tempest-TaggedBootDevicesTest-1951782657-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:11:57 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-25b7cf3b-70f7-42f9-ae34-60f1c9b0de36 tempest-TaggedBootDevicesTest-1951782657 tempest-TaggedBootDevicesTest-1951782657-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:11:57 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-6db2beaf-9e50-49cf-9f49-fff9c060570f tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Releasing lock "refresh_cache-84c6b624-648b-40e2-a37e-ff08609bad84" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:11:57 user nova-compute[75165]: DEBUG nova.network.neutron [-] [instance: 45625147-ff69-496a-a41e-e55f818a020a] Updating instance_info_cache with network_info: [] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:11:57 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:57 user nova-compute[75165]: DEBUG nova.compute.manager [req-c0a2c64b-0ece-48e0-a203-db94046b9f1c req-1dfc748a-3998-441b-8125-c827f7f26513 service nova] [instance: 45625147-ff69-496a-a41e-e55f818a020a] Received event network-vif-deleted-7fb6b434-f67e-4199-90c4-fa1fad18e7d3 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:11:57 user nova-compute[75165]: INFO nova.compute.manager [req-c0a2c64b-0ece-48e0-a203-db94046b9f1c req-1dfc748a-3998-441b-8125-c827f7f26513 service nova] [instance: 45625147-ff69-496a-a41e-e55f818a020a] Neutron deleted interface 7fb6b434-f67e-4199-90c4-fa1fad18e7d3; detaching it from the instance and deleting it from the info cache
Oct 26 00:11:57 user nova-compute[75165]: DEBUG nova.network.neutron [req-c0a2c64b-0ece-48e0-a203-db94046b9f1c req-1dfc748a-3998-441b-8125-c827f7f26513 service nova] [instance: 45625147-ff69-496a-a41e-e55f818a020a] Updating instance_info_cache with network_info: [] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:11:57 user nova-compute[75165]: INFO nova.compute.manager [-] [instance: 45625147-ff69-496a-a41e-e55f818a020a] Took 1.53 seconds to deallocate network for instance.
Oct 26 00:11:57 user nova-compute[75165]: DEBUG nova.compute.manager [req-c0a2c64b-0ece-48e0-a203-db94046b9f1c req-1dfc748a-3998-441b-8125-c827f7f26513 service nova] [instance: 45625147-ff69-496a-a41e-e55f818a020a] Detach interface failed, port_id=7fb6b434-f67e-4199-90c4-fa1fad18e7d3, reason: Instance 45625147-ff69-496a-a41e-e55f818a020a could not be found. {{(pid=75165) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 26 00:11:57 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-f1c90eb7-c349-4a58-94ff-cc01e1bae746 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:11:57 user nova-compute[75165]: DEBUG nova.compute.manager [req-cf027386-86f4-48c3-8fd6-f9665c3b984e req-953b7e92-94a7-4d89-8b0e-220a827bb019 service nova] [instance: 45625147-ff69-496a-a41e-e55f818a020a] Received event network-vif-plugged-7fb6b434-f67e-4199-90c4-fa1fad18e7d3 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:11:57 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-cf027386-86f4-48c3-8fd6-f9665c3b984e req-953b7e92-94a7-4d89-8b0e-220a827bb019 service nova] Acquiring lock "45625147-ff69-496a-a41e-e55f818a020a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:11:57 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-cf027386-86f4-48c3-8fd6-f9665c3b984e req-953b7e92-94a7-4d89-8b0e-220a827bb019 service nova] Lock "45625147-ff69-496a-a41e-e55f818a020a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:11:57 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-cf027386-86f4-48c3-8fd6-f9665c3b984e req-953b7e92-94a7-4d89-8b0e-220a827bb019 service nova] Lock "45625147-ff69-496a-a41e-e55f818a020a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:11:57 user nova-compute[75165]: DEBUG nova.compute.manager [req-cf027386-86f4-48c3-8fd6-f9665c3b984e req-953b7e92-94a7-4d89-8b0e-220a827bb019 service nova] [instance: 45625147-ff69-496a-a41e-e55f818a020a] No waiting events found dispatching network-vif-plugged-7fb6b434-f67e-4199-90c4-fa1fad18e7d3 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:11:57 user nova-compute[75165]: WARNING nova.compute.manager [req-cf027386-86f4-48c3-8fd6-f9665c3b984e req-953b7e92-94a7-4d89-8b0e-220a827bb019 service nova] [instance: 45625147-ff69-496a-a41e-e55f818a020a] Received unexpected event network-vif-plugged-7fb6b434-f67e-4199-90c4-fa1fad18e7d3 for instance with vm_state deleted and task_state None.
Oct 26 00:11:57 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:57 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:57 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:57 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:57 user nova-compute[75165]: DEBUG nova.network.neutron [None req-b77af02b-ef0b-481e-ab99-10db43f9a8ec tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] [instance: b0edba5b-e4d8-4b0a-ace1-1f32c19f8bd0] Successfully created port: e931a766-e43c-4224-bb52-9c8561f4aa6d {{(pid=75165) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 00:11:57 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-25b7cf3b-70f7-42f9-ae34-60f1c9b0de36 tempest-TaggedBootDevicesTest-1951782657 tempest-TaggedBootDevicesTest-1951782657-project-member] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:11:57 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-25b7cf3b-70f7-42f9-ae34-60f1c9b0de36 tempest-TaggedBootDevicesTest-1951782657 tempest-TaggedBootDevicesTest-1951782657-project-member] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:11:57 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-25b7cf3b-70f7-42f9-ae34-60f1c9b0de36 tempest-TaggedBootDevicesTest-1951782657 tempest-TaggedBootDevicesTest-1951782657-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.742s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:11:57 user nova-compute[75165]: DEBUG nova.compute.manager [None req-25b7cf3b-70f7-42f9-ae34-60f1c9b0de36 tempest-TaggedBootDevicesTest-1951782657 tempest-TaggedBootDevicesTest-1951782657-project-member] [instance: 0d674bd2-7546-41c8-a4cf-3e26ea91edb4] Build of instance 0d674bd2-7546-41c8-a4cf-3e26ea91edb4 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-b4159121-d7b9-45f6-8932-430ad976cf68) {{(pid=75165) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2660}}
Oct 26 00:11:57 user nova-compute[75165]: DEBUG nova.compute.utils [None req-25b7cf3b-70f7-42f9-ae34-60f1c9b0de36 tempest-TaggedBootDevicesTest-1951782657 tempest-TaggedBootDevicesTest-1951782657-project-member] [instance: 0d674bd2-7546-41c8-a4cf-3e26ea91edb4] Build of instance 0d674bd2-7546-41c8-a4cf-3e26ea91edb4 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: {{(pid=75165) notify_about_instance_usage /opt/stack/nova/nova/compute/utils.py:430}}
Oct 26 00:11:57 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-f1c90eb7-c349-4a58-94ff-cc01e1bae746 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.536s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:11:57 user nova-compute[75165]: ERROR nova.compute.manager [None req-25b7cf3b-70f7-42f9-ae34-60f1c9b0de36 tempest-TaggedBootDevicesTest-1951782657 tempest-TaggedBootDevicesTest-1951782657-project-member] [instance: 0d674bd2-7546-41c8-a4cf-3e26ea91edb4] Build of instance 0d674bd2-7546-41c8-a4cf-3e26ea91edb4 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-b4159121-d7b9-45f6-8932-430ad976cf68): nova.exception.BuildAbortException: Build of instance 0d674bd2-7546-41c8-a4cf-3e26ea91edb4 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-b4159121-d7b9-45f6-8932-430ad976cf68)
Oct 26 00:11:57 user nova-compute[75165]: DEBUG nova.compute.manager [None req-25b7cf3b-70f7-42f9-ae34-60f1c9b0de36 tempest-TaggedBootDevicesTest-1951782657 tempest-TaggedBootDevicesTest-1951782657-project-member] [instance: 0d674bd2-7546-41c8-a4cf-3e26ea91edb4] Unplugging VIFs for instance {{(pid=75165) _cleanup_allocated_networks /opt/stack/nova/nova/compute/manager.py:2996}}
Oct 26 00:11:57 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-25b7cf3b-70f7-42f9-ae34-60f1c9b0de36 tempest-TaggedBootDevicesTest-1951782657 tempest-TaggedBootDevicesTest-1951782657-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T00:11:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1583193110',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1583193110',id=16,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCOE5aEGfy8729XLfjxbQ8MnTI3JtYqQ2pmuatxUWqJmWL3286A5z9+zcJYYDtfkI6/Q2K2Nln3enoIqMgvr6AI999NfCxnCrKjTJ8SJyKKR9esgJAkBPLz26W3MPwoN+w==',key_name='tempest-keypair-1422522878',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fd12c108abe0403d946f213bcd130ef2',ramdisk_id='',reservation_id='r-ob3cbhwi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1951782657',owner_user_name='tempest-TaggedBootDevicesTest-1951782657-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T00:11:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='707cd714958c4e908fa0d6c258a72a03',uuid=0d674bd2-7546-41c8-a4cf-3e26ea91edb4,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d43c2029-2e2c-4a0b-b357-3842f7ff6ef4", "address": "fa:16:3e:8f:db:86", "network": {"id": "9d1bd900-5a54-45e0-9d46-f14f210f80b3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1557334932-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd12c108abe0403d946f213bcd130ef2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd43c2029-2e", "ovs_interfaceid": "d43c2029-2e2c-4a0b-b357-3842f7ff6ef4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 00:11:57 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-25b7cf3b-70f7-42f9-ae34-60f1c9b0de36 tempest-TaggedBootDevicesTest-1951782657 tempest-TaggedBootDevicesTest-1951782657-project-member] Converting VIF {"id": "d43c2029-2e2c-4a0b-b357-3842f7ff6ef4", "address": "fa:16:3e:8f:db:86", "network": {"id": "9d1bd900-5a54-45e0-9d46-f14f210f80b3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1557334932-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd12c108abe0403d946f213bcd130ef2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd43c2029-2e", "ovs_interfaceid": "d43c2029-2e2c-4a0b-b357-3842f7ff6ef4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:11:57 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-25b7cf3b-70f7-42f9-ae34-60f1c9b0de36 tempest-TaggedBootDevicesTest-1951782657 tempest-TaggedBootDevicesTest-1951782657-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:db:86,bridge_name='br-int',has_traffic_filtering=True,id=d43c2029-2e2c-4a0b-b357-3842f7ff6ef4,network=Network(9d1bd900-5a54-45e0-9d46-f14f210f80b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd43c2029-2e') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:11:57 user nova-compute[75165]: DEBUG os_vif [None req-25b7cf3b-70f7-42f9-ae34-60f1c9b0de36 tempest-TaggedBootDevicesTest-1951782657 tempest-TaggedBootDevicesTest-1951782657-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:db:86,bridge_name='br-int',has_traffic_filtering=True,id=d43c2029-2e2c-4a0b-b357-3842f7ff6ef4,network=Network(9d1bd900-5a54-45e0-9d46-f14f210f80b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd43c2029-2e') {{(pid=75165) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 00:11:57 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd43c2029-2e, bridge=br-int, if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:11:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 00:11:58 user nova-compute[75165]: INFO os_vif [None req-25b7cf3b-70f7-42f9-ae34-60f1c9b0de36 tempest-TaggedBootDevicesTest-1951782657 tempest-TaggedBootDevicesTest-1951782657-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:db:86,bridge_name='br-int',has_traffic_filtering=True,id=d43c2029-2e2c-4a0b-b357-3842f7ff6ef4,network=Network(9d1bd900-5a54-45e0-9d46-f14f210f80b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd43c2029-2e')
Oct 26 00:11:58 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-25b7cf3b-70f7-42f9-ae34-60f1c9b0de36 tempest-TaggedBootDevicesTest-1951782657 tempest-TaggedBootDevicesTest-1951782657-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T00:11:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1583193110',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1583193110',id=16,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCOE5aEGfy8729XLfjxbQ8MnTI3JtYqQ2pmuatxUWqJmWL3286A5z9+zcJYYDtfkI6/Q2K2Nln3enoIqMgvr6AI999NfCxnCrKjTJ8SJyKKR9esgJAkBPLz26W3MPwoN+w==',key_name='tempest-keypair-1422522878',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fd12c108abe0403d946f213bcd130ef2',ramdisk_id='',reservation_id='r-ob3cbhwi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1951782657',owner_user_name='tempest-TaggedBootDevicesTest-1951782657-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T00:11:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='707cd714958c4e908fa0d6c258a72a03',uuid=0d674bd2-7546-41c8-a4cf-3e26ea91edb4,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c0030fb9-8756-4bb4-bccd-81f641be1b1d", "address": "fa:16:3e:ec:9c:fe", "network": {"id": "61920581-973b-4c89-a36c-b0dfc6e2f4e4", "bridge": "br-int", "label": "tempest-device-tagging-net1-149272300", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fd12c108abe0403d946f213bcd130ef2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0030fb9-87", "ovs_interfaceid": "c0030fb9-8756-4bb4-bccd-81f641be1b1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75165) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 00:11:58 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-25b7cf3b-70f7-42f9-ae34-60f1c9b0de36 tempest-TaggedBootDevicesTest-1951782657 tempest-TaggedBootDevicesTest-1951782657-project-member] Converting VIF {"id": "c0030fb9-8756-4bb4-bccd-81f641be1b1d", "address": "fa:16:3e:ec:9c:fe", "network": {"id": "61920581-973b-4c89-a36c-b0dfc6e2f4e4", "bridge": "br-int", "label": "tempest-device-tagging-net1-149272300", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fd12c108abe0403d946f213bcd130ef2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0030fb9-87", "ovs_interfaceid": "c0030fb9-8756-4bb4-bccd-81f641be1b1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:11:58 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-25b7cf3b-70f7-42f9-ae34-60f1c9b0de36 tempest-TaggedBootDevicesTest-1951782657 tempest-TaggedBootDevicesTest-1951782657-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:9c:fe,bridge_name='br-int',has_traffic_filtering=True,id=c0030fb9-8756-4bb4-bccd-81f641be1b1d,network=Network(61920581-973b-4c89-a36c-b0dfc6e2f4e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc0030fb9-87') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:11:58 user nova-compute[75165]: DEBUG os_vif [None req-25b7cf3b-70f7-42f9-ae34-60f1c9b0de36 tempest-TaggedBootDevicesTest-1951782657 tempest-TaggedBootDevicesTest-1951782657-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:9c:fe,bridge_name='br-int',has_traffic_filtering=True,id=c0030fb9-8756-4bb4-bccd-81f641be1b1d,network=Network(61920581-973b-4c89-a36c-b0dfc6e2f4e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc0030fb9-87') {{(pid=75165) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 00:11:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc0030fb9-87, bridge=br-int, if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:11:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 00:11:58 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: 84c6b624-648b-40e2-a37e-ff08609bad84] Instance destroyed successfully.
Oct 26 00:11:58 user nova-compute[75165]: INFO os_vif [None req-25b7cf3b-70f7-42f9-ae34-60f1c9b0de36 tempest-TaggedBootDevicesTest-1951782657 tempest-TaggedBootDevicesTest-1951782657-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:9c:fe,bridge_name='br-int',has_traffic_filtering=True,id=c0030fb9-8756-4bb4-bccd-81f641be1b1d,network=Network(61920581-973b-4c89-a36c-b0dfc6e2f4e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc0030fb9-87')
Oct 26 00:11:58 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-25b7cf3b-70f7-42f9-ae34-60f1c9b0de36 tempest-TaggedBootDevicesTest-1951782657 tempest-TaggedBootDevicesTest-1951782657-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T00:11:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1583193110',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1583193110',id=16,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCOE5aEGfy8729XLfjxbQ8MnTI3JtYqQ2pmuatxUWqJmWL3286A5z9+zcJYYDtfkI6/Q2K2Nln3enoIqMgvr6AI999NfCxnCrKjTJ8SJyKKR9esgJAkBPLz26W3MPwoN+w==',key_name='tempest-keypair-1422522878',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fd12c108abe0403d946f213bcd130ef2',ramdisk_id='',reservation_id='r-ob3cbhwi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1951782657',owner_user_name='tempest-TaggedBootDevicesTest-1951782657-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T00:11:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='707cd714958c4e908fa0d6c258a72a03',uuid=0d674bd2-7546-41c8-a4cf-3e26ea91edb4,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "436df163-583d-40c7-b5cb-399cfa13e825", "address": "fa:16:3e:3e:2e:25", "network": {"id": "61920581-973b-4c89-a36c-b0dfc6e2f4e4", "bridge": "br-int", "label": "tempest-device-tagging-net1-149272300", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.247", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fd12c108abe0403d946f213bcd130ef2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap436df163-58", "ovs_interfaceid": "436df163-583d-40c7-b5cb-399cfa13e825", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75165) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 00:11:58 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-25b7cf3b-70f7-42f9-ae34-60f1c9b0de36 tempest-TaggedBootDevicesTest-1951782657 tempest-TaggedBootDevicesTest-1951782657-project-member] Converting VIF {"id": "436df163-583d-40c7-b5cb-399cfa13e825", "address": "fa:16:3e:3e:2e:25", "network": {"id": "61920581-973b-4c89-a36c-b0dfc6e2f4e4", "bridge": "br-int", "label": "tempest-device-tagging-net1-149272300", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.247", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fd12c108abe0403d946f213bcd130ef2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap436df163-58", "ovs_interfaceid": "436df163-583d-40c7-b5cb-399cfa13e825", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:11:58 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-25b7cf3b-70f7-42f9-ae34-60f1c9b0de36 tempest-TaggedBootDevicesTest-1951782657 tempest-TaggedBootDevicesTest-1951782657-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:2e:25,bridge_name='br-int',has_traffic_filtering=True,id=436df163-583d-40c7-b5cb-399cfa13e825,network=Network(61920581-973b-4c89-a36c-b0dfc6e2f4e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap436df163-58') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:11:58 user nova-compute[75165]: DEBUG os_vif [None req-25b7cf3b-70f7-42f9-ae34-60f1c9b0de36 tempest-TaggedBootDevicesTest-1951782657 tempest-TaggedBootDevicesTest-1951782657-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:2e:25,bridge_name='br-int',has_traffic_filtering=True,id=436df163-583d-40c7-b5cb-399cfa13e825,network=Network(61920581-973b-4c89-a36c-b0dfc6e2f4e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap436df163-58') {{(pid=75165) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 00:11:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap436df163-58, bridge=br-int, if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:11:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 00:11:58 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-6db2beaf-9e50-49cf-9f49-fff9c060570f tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: 84c6b624-648b-40e2-a37e-ff08609bad84] Attempting rescue
Oct 26 00:11:58 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-6db2beaf-9e50-49cf-9f49-fff9c060570f tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75165) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 26 00:11:58 user nova-compute[75165]: INFO os_vif [None req-25b7cf3b-70f7-42f9-ae34-60f1c9b0de36 tempest-TaggedBootDevicesTest-1951782657 tempest-TaggedBootDevicesTest-1951782657-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:2e:25,bridge_name='br-int',has_traffic_filtering=True,id=436df163-583d-40c7-b5cb-399cfa13e825,network=Network(61920581-973b-4c89-a36c-b0dfc6e2f4e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap436df163-58')
Oct 26 00:11:58 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-25b7cf3b-70f7-42f9-ae34-60f1c9b0de36 tempest-TaggedBootDevicesTest-1951782657 tempest-TaggedBootDevicesTest-1951782657-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T00:11:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1583193110',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1583193110',id=16,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCOE5aEGfy8729XLfjxbQ8MnTI3JtYqQ2pmuatxUWqJmWL3286A5z9+zcJYYDtfkI6/Q2K2Nln3enoIqMgvr6AI999NfCxnCrKjTJ8SJyKKR9esgJAkBPLz26W3MPwoN+w==',key_name='tempest-keypair-1422522878',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fd12c108abe0403d946f213bcd130ef2',ramdisk_id='',reservation_id='r-ob3cbhwi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1951782657',owner_user_name='tempest-TaggedBootDevicesTest-1951782657-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T00:11:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='707cd714958c4e908fa0d6c258a72a03',uuid=0d674bd2-7546-41c8-a4cf-3e26ea91edb4,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9786a81f-a18c-410b-bafc-ff11bfa432f3", "address": "fa:16:3e:63:8e:05", "network": {"id": "61920581-973b-4c89-a36c-b0dfc6e2f4e4", "bridge": "br-int", "label": "tempest-device-tagging-net1-149272300", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fd12c108abe0403d946f213bcd130ef2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9786a81f-a1", "ovs_interfaceid": "9786a81f-a18c-410b-bafc-ff11bfa432f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 00:11:58 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-25b7cf3b-70f7-42f9-ae34-60f1c9b0de36 tempest-TaggedBootDevicesTest-1951782657 tempest-TaggedBootDevicesTest-1951782657-project-member] Converting VIF {"id": "9786a81f-a18c-410b-bafc-ff11bfa432f3", "address": "fa:16:3e:63:8e:05", "network": {"id": "61920581-973b-4c89-a36c-b0dfc6e2f4e4", "bridge": "br-int", "label": "tempest-device-tagging-net1-149272300", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fd12c108abe0403d946f213bcd130ef2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9786a81f-a1", "ovs_interfaceid": "9786a81f-a18c-410b-bafc-ff11bfa432f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:11:58 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-25b7cf3b-70f7-42f9-ae34-60f1c9b0de36 tempest-TaggedBootDevicesTest-1951782657 tempest-TaggedBootDevicesTest-1951782657-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:8e:05,bridge_name='br-int',has_traffic_filtering=True,id=9786a81f-a18c-410b-bafc-ff11bfa432f3,network=Network(61920581-973b-4c89-a36c-b0dfc6e2f4e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9786a81f-a1') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:11:58 user nova-compute[75165]: DEBUG os_vif [None req-25b7cf3b-70f7-42f9-ae34-60f1c9b0de36 tempest-TaggedBootDevicesTest-1951782657 tempest-TaggedBootDevicesTest-1951782657-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:8e:05,bridge_name='br-int',has_traffic_filtering=True,id=9786a81f-a18c-410b-bafc-ff11bfa432f3,network=Network(61920581-973b-4c89-a36c-b0dfc6e2f4e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9786a81f-a1') {{(pid=75165) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 00:11:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9786a81f-a1, bridge=br-int, if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:11:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 00:11:58 user nova-compute[75165]: INFO os_vif [None req-25b7cf3b-70f7-42f9-ae34-60f1c9b0de36 tempest-TaggedBootDevicesTest-1951782657 tempest-TaggedBootDevicesTest-1951782657-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:8e:05,bridge_name='br-int',has_traffic_filtering=True,id=9786a81f-a18c-410b-bafc-ff11bfa432f3,network=Network(61920581-973b-4c89-a36c-b0dfc6e2f4e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9786a81f-a1')
Oct 26 00:11:58 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-25b7cf3b-70f7-42f9-ae34-60f1c9b0de36 tempest-TaggedBootDevicesTest-1951782657 tempest-TaggedBootDevicesTest-1951782657-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T00:11:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1583193110',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1583193110',id=16,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCOE5aEGfy8729XLfjxbQ8MnTI3JtYqQ2pmuatxUWqJmWL3286A5z9+zcJYYDtfkI6/Q2K2Nln3enoIqMgvr6AI999NfCxnCrKjTJ8SJyKKR9esgJAkBPLz26W3MPwoN+w==',key_name='tempest-keypair-1422522878',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fd12c108abe0403d946f213bcd130ef2',ramdisk_id='',reservation_id='r-ob3cbhwi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1951782657',owner_user_name='tempest-TaggedBootDevicesTest-1951782657-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T00:11:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='707cd714958c4e908fa0d6c258a72a03',uuid=0d674bd2-7546-41c8-a4cf-3e26ea91edb4,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bd100fe9-891f-42dc-8fbd-41d2322cd099", "address": "fa:16:3e:02:dc:c4", "network": {"id": "61920581-973b-4c89-a36c-b0dfc6e2f4e4", "bridge": "br-int", "label": "tempest-device-tagging-net1-149272300", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fd12c108abe0403d946f213bcd130ef2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd100fe9-89", "ovs_interfaceid": "bd100fe9-891f-42dc-8fbd-41d2322cd099", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 00:11:58 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-25b7cf3b-70f7-42f9-ae34-60f1c9b0de36 tempest-TaggedBootDevicesTest-1951782657 tempest-TaggedBootDevicesTest-1951782657-project-member] Converting VIF {"id": "bd100fe9-891f-42dc-8fbd-41d2322cd099", "address": "fa:16:3e:02:dc:c4", "network": {"id": "61920581-973b-4c89-a36c-b0dfc6e2f4e4", "bridge": "br-int", "label": "tempest-device-tagging-net1-149272300", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fd12c108abe0403d946f213bcd130ef2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd100fe9-89", "ovs_interfaceid": "bd100fe9-891f-42dc-8fbd-41d2322cd099", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:11:58 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-25b7cf3b-70f7-42f9-ae34-60f1c9b0de36 tempest-TaggedBootDevicesTest-1951782657 tempest-TaggedBootDevicesTest-1951782657-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:dc:c4,bridge_name='br-int',has_traffic_filtering=True,id=bd100fe9-891f-42dc-8fbd-41d2322cd099,network=Network(61920581-973b-4c89-a36c-b0dfc6e2f4e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd100fe9-89') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:11:58 user nova-compute[75165]: DEBUG os_vif [None req-25b7cf3b-70f7-42f9-ae34-60f1c9b0de36 tempest-TaggedBootDevicesTest-1951782657 tempest-TaggedBootDevicesTest-1951782657-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:dc:c4,bridge_name='br-int',has_traffic_filtering=True,id=bd100fe9-891f-42dc-8fbd-41d2322cd099,network=Network(61920581-973b-4c89-a36c-b0dfc6e2f4e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd100fe9-89') {{(pid=75165) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 00:11:58 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-6db2beaf-9e50-49cf-9f49-fff9c060570f tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: 84c6b624-648b-40e2-a37e-ff08609bad84] Instance directory exists: not creating {{(pid=75165) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 26 00:11:58 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-6db2beaf-9e50-49cf-9f49-fff9c060570f tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: 84c6b624-648b-40e2-a37e-ff08609bad84] Creating image(s)
Oct 26 00:11:58 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-6db2beaf-9e50-49cf-9f49-fff9c060570f tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Acquiring lock "/opt/stack/data/nova/instances/84c6b624-648b-40e2-a37e-ff08609bad84/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:11:58 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-6db2beaf-9e50-49cf-9f49-fff9c060570f tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Lock "/opt/stack/data/nova/instances/84c6b624-648b-40e2-a37e-ff08609bad84/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:11:58 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-6db2beaf-9e50-49cf-9f49-fff9c060570f tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Lock "/opt/stack/data/nova/instances/84c6b624-648b-40e2-a37e-ff08609bad84/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:11:58 user nova-compute[75165]: DEBUG nova.objects.instance [None req-6db2beaf-9e50-49cf-9f49-fff9c060570f tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Lazy-loading 'trusted_certs' on Instance uuid 84c6b624-648b-40e2-a37e-ff08609bad84 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:11:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbd100fe9-89, bridge=br-int, if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:11:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 00:11:58 user nova-compute[75165]: INFO os_vif [None req-25b7cf3b-70f7-42f9-ae34-60f1c9b0de36 tempest-TaggedBootDevicesTest-1951782657 tempest-TaggedBootDevicesTest-1951782657-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:dc:c4,bridge_name='br-int',has_traffic_filtering=True,id=bd100fe9-891f-42dc-8fbd-41d2322cd099,network=Network(61920581-973b-4c89-a36c-b0dfc6e2f4e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd100fe9-89')
Oct 26 00:11:58 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-25b7cf3b-70f7-42f9-ae34-60f1c9b0de36 tempest-TaggedBootDevicesTest-1951782657 tempest-TaggedBootDevicesTest-1951782657-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T00:11:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1583193110',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1583193110',id=16,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCOE5aEGfy8729XLfjxbQ8MnTI3JtYqQ2pmuatxUWqJmWL3286A5z9+zcJYYDtfkI6/Q2K2Nln3enoIqMgvr6AI999NfCxnCrKjTJ8SJyKKR9esgJAkBPLz26W3MPwoN+w==',key_name='tempest-keypair-1422522878',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fd12c108abe0403d946f213bcd130ef2',ramdisk_id='',reservation_id='r-ob3cbhwi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1951782657',owner_user_name='tempest-TaggedBootDevicesTest-1951782657-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T00:11:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='707cd714958c4e908fa0d6c258a72a03',uuid=0d674bd2-7546-41c8-a4cf-3e26ea91edb4,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d82f307d-35a8-422d-b55d-12917be12db6", "address": "fa:16:3e:d7:ec:e3", "network": {"id": "b584de90-889d-4482-b491-1278c381c537", "bridge": "br-int", "label": "tempest-device-tagging-net2-32906704", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fd12c108abe0403d946f213bcd130ef2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd82f307d-35", "ovs_interfaceid": "d82f307d-35a8-422d-b55d-12917be12db6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 00:11:58 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-25b7cf3b-70f7-42f9-ae34-60f1c9b0de36 tempest-TaggedBootDevicesTest-1951782657 tempest-TaggedBootDevicesTest-1951782657-project-member] Converting VIF {"id": "d82f307d-35a8-422d-b55d-12917be12db6", "address": "fa:16:3e:d7:ec:e3", "network": {"id": "b584de90-889d-4482-b491-1278c381c537", "bridge": "br-int", "label": "tempest-device-tagging-net2-32906704", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fd12c108abe0403d946f213bcd130ef2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd82f307d-35", "ovs_interfaceid": "d82f307d-35a8-422d-b55d-12917be12db6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:11:58 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-25b7cf3b-70f7-42f9-ae34-60f1c9b0de36 tempest-TaggedBootDevicesTest-1951782657 tempest-TaggedBootDevicesTest-1951782657-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:ec:e3,bridge_name='br-int',has_traffic_filtering=True,id=d82f307d-35a8-422d-b55d-12917be12db6,network=Network(b584de90-889d-4482-b491-1278c381c537),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd82f307d-35') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:11:58 user nova-compute[75165]: DEBUG os_vif [None req-25b7cf3b-70f7-42f9-ae34-60f1c9b0de36 tempest-TaggedBootDevicesTest-1951782657 tempest-TaggedBootDevicesTest-1951782657-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:ec:e3,bridge_name='br-int',has_traffic_filtering=True,id=d82f307d-35a8-422d-b55d-12917be12db6,network=Network(b584de90-889d-4482-b491-1278c381c537),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd82f307d-35') {{(pid=75165) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 00:11:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd82f307d-35, bridge=br-int, if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:11:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 00:11:58 user nova-compute[75165]: INFO os_vif [None req-25b7cf3b-70f7-42f9-ae34-60f1c9b0de36 tempest-TaggedBootDevicesTest-1951782657 tempest-TaggedBootDevicesTest-1951782657-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:ec:e3,bridge_name='br-int',has_traffic_filtering=True,id=d82f307d-35a8-422d-b55d-12917be12db6,network=Network(b584de90-889d-4482-b491-1278c381c537),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd82f307d-35')
Oct 26 00:11:58 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-25b7cf3b-70f7-42f9-ae34-60f1c9b0de36 tempest-TaggedBootDevicesTest-1951782657 tempest-TaggedBootDevicesTest-1951782657-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T00:11:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1583193110',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1583193110',id=16,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCOE5aEGfy8729XLfjxbQ8MnTI3JtYqQ2pmuatxUWqJmWL3286A5z9+zcJYYDtfkI6/Q2K2Nln3enoIqMgvr6AI999NfCxnCrKjTJ8SJyKKR9esgJAkBPLz26W3MPwoN+w==',key_name='tempest-keypair-1422522878',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fd12c108abe0403d946f213bcd130ef2',ramdisk_id='',reservation_id='r-ob3cbhwi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1951782657',owner_user_name='tempest-TaggedBootDevicesTest-1951782657-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T00:11:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='707cd714958c4e908fa0d6c258a72a03',uuid=0d674bd2-7546-41c8-a4cf-3e26ea91edb4,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b3519c1c-0881-436a-8d24-dbba3a655564", "address": "fa:16:3e:f9:6e:de", "network": {"id": "b584de90-889d-4482-b491-1278c381c537", "bridge": "br-int", "label": "tempest-device-tagging-net2-32906704", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fd12c108abe0403d946f213bcd130ef2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3519c1c-08", "ovs_interfaceid": "b3519c1c-0881-436a-8d24-dbba3a655564", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 00:11:58 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-25b7cf3b-70f7-42f9-ae34-60f1c9b0de36 tempest-TaggedBootDevicesTest-1951782657 tempest-TaggedBootDevicesTest-1951782657-project-member] Converting VIF {"id": "b3519c1c-0881-436a-8d24-dbba3a655564", "address": "fa:16:3e:f9:6e:de", "network": {"id": "b584de90-889d-4482-b491-1278c381c537", "bridge": "br-int", "label": "tempest-device-tagging-net2-32906704", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fd12c108abe0403d946f213bcd130ef2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3519c1c-08", "ovs_interfaceid": "b3519c1c-0881-436a-8d24-dbba3a655564", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:11:58 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-25b7cf3b-70f7-42f9-ae34-60f1c9b0de36 tempest-TaggedBootDevicesTest-1951782657 tempest-TaggedBootDevicesTest-1951782657-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:6e:de,bridge_name='br-int',has_traffic_filtering=True,id=b3519c1c-0881-436a-8d24-dbba3a655564,network=Network(b584de90-889d-4482-b491-1278c381c537),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3519c1c-08') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:11:58 user nova-compute[75165]: DEBUG os_vif [None req-25b7cf3b-70f7-42f9-ae34-60f1c9b0de36 tempest-TaggedBootDevicesTest-1951782657 tempest-TaggedBootDevicesTest-1951782657-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:6e:de,bridge_name='br-int',has_traffic_filtering=True,id=b3519c1c-0881-436a-8d24-dbba3a655564,network=Network(b584de90-889d-4482-b491-1278c381c537),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3519c1c-08') {{(pid=75165) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 00:11:58 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-6db2beaf-9e50-49cf-9f49-fff9c060570f tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Acquiring lock "7d3243421cf3fdc288b758f687a93103b7b95466" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:11:58 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-6db2beaf-9e50-49cf-9f49-fff9c060570f tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Lock "7d3243421cf3fdc288b758f687a93103b7b95466" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:11:58 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-6db2beaf-9e50-49cf-9f49-fff9c060570f tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:11:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb3519c1c-08, bridge=br-int, if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:11:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 00:11:58 user nova-compute[75165]: INFO os_vif [None req-25b7cf3b-70f7-42f9-ae34-60f1c9b0de36 tempest-TaggedBootDevicesTest-1951782657 tempest-TaggedBootDevicesTest-1951782657-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:6e:de,bridge_name='br-int',has_traffic_filtering=True,id=b3519c1c-0881-436a-8d24-dbba3a655564,network=Network(b584de90-889d-4482-b491-1278c381c537),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3519c1c-08')
Oct 26 00:11:58 user nova-compute[75165]: DEBUG nova.compute.manager [None req-25b7cf3b-70f7-42f9-ae34-60f1c9b0de36 tempest-TaggedBootDevicesTest-1951782657 tempest-TaggedBootDevicesTest-1951782657-project-member] [instance: 0d674bd2-7546-41c8-a4cf-3e26ea91edb4] Unplugged VIFs for instance {{(pid=75165) _cleanup_allocated_networks /opt/stack/nova/nova/compute/manager.py:3032}}
Oct 26 00:11:58 user nova-compute[75165]: DEBUG nova.compute.manager [None req-25b7cf3b-70f7-42f9-ae34-60f1c9b0de36 tempest-TaggedBootDevicesTest-1951782657 tempest-TaggedBootDevicesTest-1951782657-project-member] [instance: 0d674bd2-7546-41c8-a4cf-3e26ea91edb4] Deallocating network for instance {{(pid=75165) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 00:11:58 user nova-compute[75165]: DEBUG nova.network.neutron [None req-25b7cf3b-70f7-42f9-ae34-60f1c9b0de36 tempest-TaggedBootDevicesTest-1951782657 tempest-TaggedBootDevicesTest-1951782657-project-member] [instance: 0d674bd2-7546-41c8-a4cf-3e26ea91edb4] deallocate_for_instance() {{(pid=75165) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 00:11:58 user nova-compute[75165]: DEBUG nova.network.neutron [req-b36a051f-e96b-4ad3-87b0-505786dfc34c req-f94bf1dd-0d96-4fd6-9196-ad7ae54ef22b service nova] [instance: 0d674bd2-7546-41c8-a4cf-3e26ea91edb4] Updated VIF entry in instance network info cache for port d82f307d-35a8-422d-b55d-12917be12db6. {{(pid=75165) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 00:11:58 user nova-compute[75165]: DEBUG nova.network.neutron [req-b36a051f-e96b-4ad3-87b0-505786dfc34c req-f94bf1dd-0d96-4fd6-9196-ad7ae54ef22b service nova] [instance: 0d674bd2-7546-41c8-a4cf-3e26ea91edb4] Updating instance_info_cache with network_info: [{"id": "d43c2029-2e2c-4a0b-b357-3842f7ff6ef4", "address": "fa:16:3e:8f:db:86", "network": {"id": "9d1bd900-5a54-45e0-9d46-f14f210f80b3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1557334932-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd12c108abe0403d946f213bcd130ef2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd43c2029-2e", "ovs_interfaceid": "d43c2029-2e2c-4a0b-b357-3842f7ff6ef4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c0030fb9-8756-4bb4-bccd-81f641be1b1d", "address": "fa:16:3e:ec:9c:fe", "network": {"id": "61920581-973b-4c89-a36c-b0dfc6e2f4e4", "bridge": "br-int", "label": "tempest-device-tagging-net1-149272300", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fd12c108abe0403d946f213bcd130ef2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0030fb9-87", "ovs_interfaceid": "c0030fb9-8756-4bb4-bccd-81f641be1b1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "436df163-583d-40c7-b5cb-399cfa13e825", "address": "fa:16:3e:3e:2e:25", "network": {"id": "61920581-973b-4c89-a36c-b0dfc6e2f4e4", "bridge": "br-int", "label": "tempest-device-tagging-net1-149272300", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.247", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fd12c108abe0403d946f213bcd130ef2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap436df163-58", "ovs_interfaceid": "436df163-583d-40c7-b5cb-399cfa13e825", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9786a81f-a18c-410b-bafc-ff11bfa432f3", "address": "fa:16:3e:63:8e:05", "network": {"id": "61920581-973b-4c89-a36c-b0dfc6e2f4e4", "bridge": "br-int", "label": "tempest-device-tagging-net1-149272300", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fd12c108abe0403d946f213bcd130ef2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9786a81f-a1", "ovs_interfaceid": "9786a81f-a18c-410b-bafc-ff11bfa432f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bd100fe9-891f-42dc-8fbd-41d2322cd099", "address": "fa:16:3e:02:dc:c4", "network": {"id": "61920581-973b-4c89-a36c-b0dfc6e2f4e4", "bridge": "br-int", "label": "tempest-device-tagging-net1-149272300", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fd12c108abe0403d946f213bcd130ef2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd100fe9-89", "ovs_interfaceid": "bd100fe9-891f-42dc-8fbd-41d2322cd099", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d82f307d-35a8-422d-b55d-12917be12db6", "address": "fa:16:3e:d7:ec:e3", "network": {"id": "b584de90-889d-4482-b491-1278c381c537", "bridge": "br-int", "label": "tempest-device-tagging-net2-32906704", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fd12c108abe0403d946f213bcd130ef2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd82f307d-35", "ovs_interfaceid": "d82f307d-35a8-422d-b55d-12917be12db6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b3519c1c-0881-436a-8d24-dbba3a655564", "address": "fa:16:3e:f9:6e:de", "network": {"id": "b584de90-889d-4482-b491-1278c381c537", "bridge": "br-int", "label": "tempest-device-tagging-net2-32906704", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fd12c108abe0403d946f213bcd130ef2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3519c1c-08", "ovs_interfaceid": "b3519c1c-0881-436a-8d24-dbba3a655564", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:11:58 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-b36a051f-e96b-4ad3-87b0-505786dfc34c req-f94bf1dd-0d96-4fd6-9196-ad7ae54ef22b service nova] Releasing lock "refresh_cache-0d674bd2-7546-41c8-a4cf-3e26ea91edb4" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:11:58 user nova-compute[75165]: DEBUG nova.compute.manager [req-b36a051f-e96b-4ad3-87b0-505786dfc34c req-f94bf1dd-0d96-4fd6-9196-ad7ae54ef22b service nova] [instance: 0d674bd2-7546-41c8-a4cf-3e26ea91edb4] Received event network-changed-b3519c1c-0881-436a-8d24-dbba3a655564 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:11:58 user nova-compute[75165]: DEBUG nova.compute.manager [req-b36a051f-e96b-4ad3-87b0-505786dfc34c req-f94bf1dd-0d96-4fd6-9196-ad7ae54ef22b service nova] [instance: 0d674bd2-7546-41c8-a4cf-3e26ea91edb4] Refreshing instance network info cache due to event network-changed-b3519c1c-0881-436a-8d24-dbba3a655564. {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 00:11:58 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-b36a051f-e96b-4ad3-87b0-505786dfc34c req-f94bf1dd-0d96-4fd6-9196-ad7ae54ef22b service nova] Acquiring lock "refresh_cache-0d674bd2-7546-41c8-a4cf-3e26ea91edb4" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:11:58 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-b36a051f-e96b-4ad3-87b0-505786dfc34c req-f94bf1dd-0d96-4fd6-9196-ad7ae54ef22b service nova] Acquired lock "refresh_cache-0d674bd2-7546-41c8-a4cf-3e26ea91edb4" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:11:58 user nova-compute[75165]: DEBUG nova.network.neutron [req-b36a051f-e96b-4ad3-87b0-505786dfc34c req-f94bf1dd-0d96-4fd6-9196-ad7ae54ef22b service nova] [instance: 0d674bd2-7546-41c8-a4cf-3e26ea91edb4] Refreshing network info cache for port b3519c1c-0881-436a-8d24-dbba3a655564 {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 00:11:58 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-6db2beaf-9e50-49cf-9f49-fff9c060570f tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json" returned: 0 in 0.242s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:58 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-6db2beaf-9e50-49cf-9f49-fff9c060570f tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466,backing_fmt=raw /opt/stack/data/nova/instances/84c6b624-648b-40e2-a37e-ff08609bad84/disk.rescue {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:11:58 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-6db2beaf-9e50-49cf-9f49-fff9c060570f tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466,backing_fmt=raw /opt/stack/data/nova/instances/84c6b624-648b-40e2-a37e-ff08609bad84/disk.rescue" returned: 0 in 0.063s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:11:58 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-6db2beaf-9e50-49cf-9f49-fff9c060570f tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Lock "7d3243421cf3fdc288b758f687a93103b7b95466" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.310s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:11:58 user nova-compute[75165]: DEBUG nova.objects.instance [None req-6db2beaf-9e50-49cf-9f49-fff9c060570f tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Lazy-loading 'migration_context' on Instance uuid 84c6b624-648b-40e2-a37e-ff08609bad84 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:11:58 user nova-compute[75165]: DEBUG nova.objects.base [None req-6db2beaf-9e50-49cf-9f49-fff9c060570f tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Object Instance<84c6b624-648b-40e2-a37e-ff08609bad84> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75165) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 00:11:58 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-6db2beaf-9e50-49cf-9f49-fff9c060570f tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: 84c6b624-648b-40e2-a37e-ff08609bad84] Created local disks {{(pid=75165) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 00:11:58 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-6db2beaf-9e50-49cf-9f49-fff9c060570f tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: 84c6b624-648b-40e2-a37e-ff08609bad84] Start _get_guest_xml network_info=[{"id": "2107529c-ec0e-4d1d-85b4-8605dcabc415", "address": "fa:16:3e:0c:8a:94", "network": {"id": "b31bac4b-1951-4ca3-8682-f1f24de0a5c3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1323234642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1323234642-network", "vif_mac": "fa:16:3e:0c:8a:94"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71aa69c0ea2d49e184e1e055ff3efa1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2107529c-ec", "ovs_interfaceid": "2107529c-ec0e-4d1d-85b4-8605dcabc415", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T00:03:24Z,direct_url=<?>,disk_format='qcow2',id=bff0d8a1-739e-4c4d-9efa-b73ba7b76d01,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e56bbf444fd34c348475c73673611447',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T00:03:26Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'bff0d8a1-739e-4c4d-9efa-b73ba7b76d01', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75165) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 00:11:58 user nova-compute[75165]: DEBUG nova.objects.instance [None req-6db2beaf-9e50-49cf-9f49-fff9c060570f tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Lazy-loading 'resources' on Instance uuid 84c6b624-648b-40e2-a37e-ff08609bad84 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:11:58 user nova-compute[75165]: DEBUG nova.objects.base [None req-6db2beaf-9e50-49cf-9f49-fff9c060570f tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Object Instance<84c6b624-648b-40e2-a37e-ff08609bad84> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75165) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 00:11:58 user nova-compute[75165]: DEBUG nova.objects.instance [None req-6db2beaf-9e50-49cf-9f49-fff9c060570f tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Lazy-loading 'numa_topology' on Instance uuid 84c6b624-648b-40e2-a37e-ff08609bad84 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:11:58 user nova-compute[75165]: DEBUG nova.objects.base [None req-6db2beaf-9e50-49cf-9f49-fff9c060570f tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Object Instance<84c6b624-648b-40e2-a37e-ff08609bad84> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75165) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 00:11:58 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-6db2beaf-9e50-49cf-9f49-fff9c060570f tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:11:58 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-6db2beaf-9e50-49cf-9f49-fff9c060570f tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:11:58 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-6db2beaf-9e50-49cf-9f49-fff9c060570f tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75165) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 00:11:58 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-6db2beaf-9e50-49cf-9f49-fff9c060570f tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] CPU controller missing on host. {{(pid=75165) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 00:11:58 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-6db2beaf-9e50-49cf-9f49-fff9c060570f tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75165) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 00:11:58 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-6db2beaf-9e50-49cf-9f49-fff9c060570f tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] CPU controller found on host. {{(pid=75165) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 00:11:58 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-6db2beaf-9e50-49cf-9f49-fff9c060570f tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75165) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 00:11:58 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-6db2beaf-9e50-49cf-9f49-fff9c060570f tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T00:03:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T00:03:24Z,direct_url=<?>,disk_format='qcow2',id=bff0d8a1-739e-4c4d-9efa-b73ba7b76d01,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e56bbf444fd34c348475c73673611447',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T00:03:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 00:11:58 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-6db2beaf-9e50-49cf-9f49-fff9c060570f tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Flavor limits 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 00:11:58 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-6db2beaf-9e50-49cf-9f49-fff9c060570f tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Image limits 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 00:11:58 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-6db2beaf-9e50-49cf-9f49-fff9c060570f tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Flavor pref 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 00:11:58 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-6db2beaf-9e50-49cf-9f49-fff9c060570f tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Image pref 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 00:11:58 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-6db2beaf-9e50-49cf-9f49-fff9c060570f tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 00:11:58 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-6db2beaf-9e50-49cf-9f49-fff9c060570f tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 00:11:58 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-6db2beaf-9e50-49cf-9f49-fff9c060570f tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75165) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 00:11:58 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-6db2beaf-9e50-49cf-9f49-fff9c060570f tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Got 1 possible topologies {{(pid=75165) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 00:11:58 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-6db2beaf-9e50-49cf-9f49-fff9c060570f tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 00:11:58 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-6db2beaf-9e50-49cf-9f49-fff9c060570f tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 00:11:58 user nova-compute[75165]: DEBUG nova.objects.instance [None req-6db2beaf-9e50-49cf-9f49-fff9c060570f tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Lazy-loading 'vcpu_model' on Instance uuid 84c6b624-648b-40e2-a37e-ff08609bad84 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:11:58 user nova-compute[75165]: DEBUG nova.objects.base [None req-6db2beaf-9e50-49cf-9f49-fff9c060570f tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Object Instance<84c6b624-648b-40e2-a37e-ff08609bad84> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75165) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 00:11:58 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-6db2beaf-9e50-49cf-9f49-fff9c060570f tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:07:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1528860087',display_name='tempest-ServerRescueNegativeTestJSON-server-1528860087',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1528860087',id=2,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-26T00:07:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='71aa69c0ea2d49e184e1e055ff3efa1d',ramdisk_id='',reservation_id='r-oa51f9pk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-2141505807',owner_user_name='tempest-ServerRescueNegativeTestJSON-2141505807-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T00:07:27Z,user_data=None,user_id='67876ca3211b47bc99af08436edeb91f',uuid=84c6b624-648b-40e2-a37e-ff08609bad84,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2107529c-ec0e-4d1d-85b4-8605dcabc415", "address": "fa:16:3e:0c:8a:94", "network": {"id": "b31bac4b-1951-4ca3-8682-f1f24de0a5c3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1323234642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1323234642-network", "vif_mac": "fa:16:3e:0c:8a:94"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71aa69c0ea2d49e184e1e055ff3efa1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2107529c-ec", "ovs_interfaceid": "2107529c-ec0e-4d1d-85b4-8605dcabc415", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75165) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 00:11:58 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-6db2beaf-9e50-49cf-9f49-fff9c060570f tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Converting VIF {"id": "2107529c-ec0e-4d1d-85b4-8605dcabc415", "address": "fa:16:3e:0c:8a:94", "network": {"id": "b31bac4b-1951-4ca3-8682-f1f24de0a5c3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1323234642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1323234642-network", "vif_mac": "fa:16:3e:0c:8a:94"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71aa69c0ea2d49e184e1e055ff3efa1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2107529c-ec", "ovs_interfaceid": "2107529c-ec0e-4d1d-85b4-8605dcabc415", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:11:58 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-6db2beaf-9e50-49cf-9f49-fff9c060570f tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0c:8a:94,bridge_name='br-int',has_traffic_filtering=True,id=2107529c-ec0e-4d1d-85b4-8605dcabc415,network=Network(b31bac4b-1951-4ca3-8682-f1f24de0a5c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2107529c-ec') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:11:58 user nova-compute[75165]: DEBUG nova.objects.instance [None req-6db2beaf-9e50-49cf-9f49-fff9c060570f tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Lazy-loading 'pci_devices' on Instance uuid 84c6b624-648b-40e2-a37e-ff08609bad84 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:11:58 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-f1c90eb7-c349-4a58-94ff-cc01e1bae746 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:11:58 user nova-compute[75165]: DEBUG nova.objects.base [None req-6db2beaf-9e50-49cf-9f49-fff9c060570f tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Object Instance<84c6b624-648b-40e2-a37e-ff08609bad84> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75165) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 00:11:58 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-6db2beaf-9e50-49cf-9f49-fff9c060570f tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: 84c6b624-648b-40e2-a37e-ff08609bad84] End _get_guest_xml xml=<domain type="kvm">
Oct 26 00:11:58 user nova-compute[75165]:   <uuid>84c6b624-648b-40e2-a37e-ff08609bad84</uuid>
Oct 26 00:11:58 user nova-compute[75165]:   <name>instance-00000002</name>
Oct 26 00:11:58 user nova-compute[75165]:   <memory>524288</memory>
Oct 26 00:11:58 user nova-compute[75165]:   <vcpu>1</vcpu>
Oct 26 00:11:58 user nova-compute[75165]:   <metadata>
Oct 26 00:11:58 user nova-compute[75165]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 00:11:58 user nova-compute[75165]:       <nova:package version="0.0.0"/>
Oct 26 00:11:58 user nova-compute[75165]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1528860087</nova:name>
Oct 26 00:11:58 user nova-compute[75165]:       <nova:creationTime>2023-10-26 00:11:58</nova:creationTime>
Oct 26 00:11:58 user nova-compute[75165]:       <nova:flavor name="m1.tiny">
Oct 26 00:11:58 user nova-compute[75165]:         <nova:memory>512</nova:memory>
Oct 26 00:11:58 user nova-compute[75165]:         <nova:disk>1</nova:disk>
Oct 26 00:11:58 user nova-compute[75165]:         <nova:swap>0</nova:swap>
Oct 26 00:11:58 user nova-compute[75165]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 00:11:58 user nova-compute[75165]:         <nova:vcpus>1</nova:vcpus>
Oct 26 00:11:58 user nova-compute[75165]:       </nova:flavor>
Oct 26 00:11:58 user nova-compute[75165]:       <nova:owner>
Oct 26 00:11:58 user nova-compute[75165]:         <nova:user uuid="67876ca3211b47bc99af08436edeb91f">tempest-ServerRescueNegativeTestJSON-2141505807-project-member</nova:user>
Oct 26 00:11:58 user nova-compute[75165]:         <nova:project uuid="71aa69c0ea2d49e184e1e055ff3efa1d">tempest-ServerRescueNegativeTestJSON-2141505807</nova:project>
Oct 26 00:11:58 user nova-compute[75165]:       </nova:owner>
Oct 26 00:11:58 user nova-compute[75165]:       <nova:root type="image" uuid="bff0d8a1-739e-4c4d-9efa-b73ba7b76d01"/>
Oct 26 00:11:58 user nova-compute[75165]:       <nova:ports>
Oct 26 00:11:58 user nova-compute[75165]:         <nova:port uuid="2107529c-ec0e-4d1d-85b4-8605dcabc415">
Oct 26 00:11:58 user nova-compute[75165]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 26 00:11:58 user nova-compute[75165]:         </nova:port>
Oct 26 00:11:58 user nova-compute[75165]:       </nova:ports>
Oct 26 00:11:58 user nova-compute[75165]:     </nova:instance>
Oct 26 00:11:58 user nova-compute[75165]:   </metadata>
Oct 26 00:11:58 user nova-compute[75165]:   <sysinfo type="smbios">
Oct 26 00:11:58 user nova-compute[75165]:     <system>
Oct 26 00:11:58 user nova-compute[75165]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 00:11:58 user nova-compute[75165]:       <entry name="product">OpenStack Nova</entry>
Oct 26 00:11:58 user nova-compute[75165]:       <entry name="version">0.0.0</entry>
Oct 26 00:11:58 user nova-compute[75165]:       <entry name="serial">84c6b624-648b-40e2-a37e-ff08609bad84</entry>
Oct 26 00:11:58 user nova-compute[75165]:       <entry name="uuid">84c6b624-648b-40e2-a37e-ff08609bad84</entry>
Oct 26 00:11:58 user nova-compute[75165]:       <entry name="family">Virtual Machine</entry>
Oct 26 00:11:58 user nova-compute[75165]:     </system>
Oct 26 00:11:58 user nova-compute[75165]:   </sysinfo>
Oct 26 00:11:58 user nova-compute[75165]:   <os>
Oct 26 00:11:58 user nova-compute[75165]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 00:11:58 user nova-compute[75165]:     <smbios mode="sysinfo"/>
Oct 26 00:11:58 user nova-compute[75165]:   </os>
Oct 26 00:11:58 user nova-compute[75165]:   <features>
Oct 26 00:11:58 user nova-compute[75165]:     <acpi/>
Oct 26 00:11:58 user nova-compute[75165]:     <apic/>
Oct 26 00:11:58 user nova-compute[75165]:     <vmcoreinfo/>
Oct 26 00:11:58 user nova-compute[75165]:   </features>
Oct 26 00:11:58 user nova-compute[75165]:   <clock offset="utc">
Oct 26 00:11:58 user nova-compute[75165]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 00:11:58 user nova-compute[75165]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 00:11:58 user nova-compute[75165]:     <timer name="hpet" present="no"/>
Oct 26 00:11:58 user nova-compute[75165]:   </clock>
Oct 26 00:11:58 user nova-compute[75165]:   <cpu mode="custom" match="exact">
Oct 26 00:11:58 user nova-compute[75165]:     <model>Nehalem</model>
Oct 26 00:11:58 user nova-compute[75165]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 00:11:58 user nova-compute[75165]:   </cpu>
Oct 26 00:11:58 user nova-compute[75165]:   <devices>
Oct 26 00:11:58 user nova-compute[75165]:     <disk type="file" device="disk">
Oct 26 00:11:58 user nova-compute[75165]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 00:11:58 user nova-compute[75165]:       <source file="/opt/stack/data/nova/instances/84c6b624-648b-40e2-a37e-ff08609bad84/disk.rescue"/>
Oct 26 00:11:58 user nova-compute[75165]:       <target dev="vda" bus="virtio"/>
Oct 26 00:11:58 user nova-compute[75165]:     </disk>
Oct 26 00:11:58 user nova-compute[75165]:     <disk type="file" device="disk">
Oct 26 00:11:58 user nova-compute[75165]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 00:11:58 user nova-compute[75165]:       <source file="/opt/stack/data/nova/instances/84c6b624-648b-40e2-a37e-ff08609bad84/disk"/>
Oct 26 00:11:58 user nova-compute[75165]:       <target dev="vdb" bus="virtio"/>
Oct 26 00:11:58 user nova-compute[75165]:     </disk>
Oct 26 00:11:58 user nova-compute[75165]:     <interface type="ethernet">
Oct 26 00:11:58 user nova-compute[75165]:       <mac address="fa:16:3e:0c:8a:94"/>
Oct 26 00:11:58 user nova-compute[75165]:       <model type="virtio"/>
Oct 26 00:11:58 user nova-compute[75165]:       <mtu size="1442"/>
Oct 26 00:11:58 user nova-compute[75165]:       <target dev="tap2107529c-ec"/>
Oct 26 00:11:58 user nova-compute[75165]:     </interface>
Oct 26 00:11:58 user nova-compute[75165]:     <serial type="pty">
Oct 26 00:11:58 user nova-compute[75165]:       <log file="/opt/stack/data/nova/instances/84c6b624-648b-40e2-a37e-ff08609bad84/console.log" append="off"/>
Oct 26 00:11:58 user nova-compute[75165]:     </serial>
Oct 26 00:11:58 user nova-compute[75165]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 00:11:58 user nova-compute[75165]:     <video>
Oct 26 00:11:58 user nova-compute[75165]:       <model type="virtio"/>
Oct 26 00:11:58 user nova-compute[75165]:     </video>
Oct 26 00:11:58 user nova-compute[75165]:     <rng model="virtio">
Oct 26 00:11:58 user nova-compute[75165]:       <backend model="random">/dev/urandom</backend>
Oct 26 00:11:58 user nova-compute[75165]:     </rng>
Oct 26 00:11:58 user nova-compute[75165]:     <controller type="usb" index="0" model="none"/>
Oct 26 00:11:58 user nova-compute[75165]:     <memballoon model="virtio">
Oct 26 00:11:58 user nova-compute[75165]:       <stats period="10"/>
Oct 26 00:11:58 user nova-compute[75165]:     </memballoon>
Oct 26 00:11:58 user nova-compute[75165]:   </devices>
Oct 26 00:11:58 user nova-compute[75165]: </domain>
Oct 26 00:11:58 user nova-compute[75165]:  {{(pid=75165) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 00:11:58 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-f1c90eb7-c349-4a58-94ff-cc01e1bae746 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:11:58 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: 84c6b624-648b-40e2-a37e-ff08609bad84] Instance destroyed successfully.
Oct 26 00:11:58 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-f1c90eb7-c349-4a58-94ff-cc01e1bae746 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.694s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:11:58 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-6db2beaf-9e50-49cf-9f49-fff9c060570f tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] No BDM found with device name vda, not building metadata. {{(pid=75165) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 00:11:58 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-6db2beaf-9e50-49cf-9f49-fff9c060570f tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75165) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 00:11:58 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-6db2beaf-9e50-49cf-9f49-fff9c060570f tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] No VIF found with MAC fa:16:3e:0c:8a:94, not building metadata {{(pid=75165) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 00:11:58 user nova-compute[75165]: INFO nova.scheduler.client.report [None req-f1c90eb7-c349-4a58-94ff-cc01e1bae746 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] Deleted allocations for instance 45625147-ff69-496a-a41e-e55f818a020a
Oct 26 00:11:58 user nova-compute[75165]: DEBUG nova.network.neutron [req-b36a051f-e96b-4ad3-87b0-505786dfc34c req-f94bf1dd-0d96-4fd6-9196-ad7ae54ef22b service nova] [instance: 0d674bd2-7546-41c8-a4cf-3e26ea91edb4] Updated VIF entry in instance network info cache for port b3519c1c-0881-436a-8d24-dbba3a655564. {{(pid=75165) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 00:11:58 user nova-compute[75165]: DEBUG nova.network.neutron [req-b36a051f-e96b-4ad3-87b0-505786dfc34c req-f94bf1dd-0d96-4fd6-9196-ad7ae54ef22b service nova] [instance: 0d674bd2-7546-41c8-a4cf-3e26ea91edb4] Updating instance_info_cache with network_info: [{"id": "d43c2029-2e2c-4a0b-b357-3842f7ff6ef4", "address": "fa:16:3e:8f:db:86", "network": {"id": "9d1bd900-5a54-45e0-9d46-f14f210f80b3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1557334932-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd12c108abe0403d946f213bcd130ef2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd43c2029-2e", "ovs_interfaceid": "d43c2029-2e2c-4a0b-b357-3842f7ff6ef4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c0030fb9-8756-4bb4-bccd-81f641be1b1d", "address": "fa:16:3e:ec:9c:fe", "network": {"id": "61920581-973b-4c89-a36c-b0dfc6e2f4e4", "bridge": "br-int", "label": "tempest-device-tagging-net1-149272300", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fd12c108abe0403d946f213bcd130ef2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0030fb9-87", "ovs_interfaceid": "c0030fb9-8756-4bb4-bccd-81f641be1b1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "436df163-583d-40c7-b5cb-399cfa13e825", "address": "fa:16:3e:3e:2e:25", "network": {"id": "61920581-973b-4c89-a36c-b0dfc6e2f4e4", "bridge": "br-int", "label": "tempest-device-tagging-net1-149272300", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.247", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fd12c108abe0403d946f213bcd130ef2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap436df163-58", "ovs_interfaceid": "436df163-583d-40c7-b5cb-399cfa13e825", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9786a81f-a18c-410b-bafc-ff11bfa432f3", "address": "fa:16:3e:63:8e:05", "network": {"id": "61920581-973b-4c89-a36c-b0dfc6e2f4e4", "bridge": "br-int", "label": "tempest-device-tagging-net1-149272300", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fd12c108abe0403d946f213bcd130ef2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9786a81f-a1", "ovs_interfaceid": "9786a81f-a18c-410b-bafc-ff11bfa432f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bd100fe9-891f-42dc-8fbd-41d2322cd099", "address": "fa:16:3e:02:dc:c4", "network": {"id": "61920581-973b-4c89-a36c-b0dfc6e2f4e4", "bridge": "br-int", "label": "tempest-device-tagging-net1-149272300", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fd12c108abe0403d946f213bcd130ef2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd100fe9-89", "ovs_interfaceid": "bd100fe9-891f-42dc-8fbd-41d2322cd099", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d82f307d-35a8-422d-b55d-12917be12db6", "address": "fa:16:3e:d7:ec:e3", "network": {"id": "b584de90-889d-4482-b491-1278c381c537", "bridge": "br-int", "label": "tempest-device-tagging-net2-32906704", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fd12c108abe0403d946f213bcd130ef2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd82f307d-35", "ovs_interfaceid": "d82f307d-35a8-422d-b55d-12917be12db6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b3519c1c-0881-436a-8d24-dbba3a655564", "address": "fa:16:3e:f9:6e:de", "network": {"id": "b584de90-889d-4482-b491-1278c381c537", "bridge": "br-int", "label": "tempest-device-tagging-net2-32906704", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fd12c108abe0403d946f213bcd130ef2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3519c1c-08", "ovs_interfaceid": "b3519c1c-0881-436a-8d24-dbba3a655564", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:11:58 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-f1c90eb7-c349-4a58-94ff-cc01e1bae746 tempest-TestVolumeSwap-1089431236 tempest-TestVolumeSwap-1089431236-project-member] Lock "45625147-ff69-496a-a41e-e55f818a020a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.232s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:11:58 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-b36a051f-e96b-4ad3-87b0-505786dfc34c req-f94bf1dd-0d96-4fd6-9196-ad7ae54ef22b service nova] Releasing lock "refresh_cache-0d674bd2-7546-41c8-a4cf-3e26ea91edb4" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:11:59 user nova-compute[75165]: DEBUG nova.compute.manager [req-9834dd73-d119-477d-8c19-5731aad1c0e4 req-f06f720a-dc86-48ad-9387-aaf78fe19e47 service nova] [instance: 84c6b624-648b-40e2-a37e-ff08609bad84] Received event network-vif-unplugged-2107529c-ec0e-4d1d-85b4-8605dcabc415 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:11:59 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-9834dd73-d119-477d-8c19-5731aad1c0e4 req-f06f720a-dc86-48ad-9387-aaf78fe19e47 service nova] Acquiring lock "84c6b624-648b-40e2-a37e-ff08609bad84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:11:59 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-9834dd73-d119-477d-8c19-5731aad1c0e4 req-f06f720a-dc86-48ad-9387-aaf78fe19e47 service nova] Lock "84c6b624-648b-40e2-a37e-ff08609bad84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:11:59 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-9834dd73-d119-477d-8c19-5731aad1c0e4 req-f06f720a-dc86-48ad-9387-aaf78fe19e47 service nova] Lock "84c6b624-648b-40e2-a37e-ff08609bad84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:11:59 user nova-compute[75165]: DEBUG nova.compute.manager [req-9834dd73-d119-477d-8c19-5731aad1c0e4 req-f06f720a-dc86-48ad-9387-aaf78fe19e47 service nova] [instance: 84c6b624-648b-40e2-a37e-ff08609bad84] No waiting events found dispatching network-vif-unplugged-2107529c-ec0e-4d1d-85b4-8605dcabc415 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:11:59 user nova-compute[75165]: WARNING nova.compute.manager [req-9834dd73-d119-477d-8c19-5731aad1c0e4 req-f06f720a-dc86-48ad-9387-aaf78fe19e47 service nova] [instance: 84c6b624-648b-40e2-a37e-ff08609bad84] Received unexpected event network-vif-unplugged-2107529c-ec0e-4d1d-85b4-8605dcabc415 for instance with vm_state active and task_state rescuing.
Oct 26 00:11:59 user nova-compute[75165]: DEBUG nova.compute.manager [req-9834dd73-d119-477d-8c19-5731aad1c0e4 req-f06f720a-dc86-48ad-9387-aaf78fe19e47 service nova] [instance: 84c6b624-648b-40e2-a37e-ff08609bad84] Received event network-vif-plugged-2107529c-ec0e-4d1d-85b4-8605dcabc415 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:11:59 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-9834dd73-d119-477d-8c19-5731aad1c0e4 req-f06f720a-dc86-48ad-9387-aaf78fe19e47 service nova] Acquiring lock "84c6b624-648b-40e2-a37e-ff08609bad84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:11:59 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-9834dd73-d119-477d-8c19-5731aad1c0e4 req-f06f720a-dc86-48ad-9387-aaf78fe19e47 service nova] Lock "84c6b624-648b-40e2-a37e-ff08609bad84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:11:59 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-9834dd73-d119-477d-8c19-5731aad1c0e4 req-f06f720a-dc86-48ad-9387-aaf78fe19e47 service nova] Lock "84c6b624-648b-40e2-a37e-ff08609bad84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:11:59 user nova-compute[75165]: DEBUG nova.compute.manager [req-9834dd73-d119-477d-8c19-5731aad1c0e4 req-f06f720a-dc86-48ad-9387-aaf78fe19e47 service nova] [instance: 84c6b624-648b-40e2-a37e-ff08609bad84] No waiting events found dispatching network-vif-plugged-2107529c-ec0e-4d1d-85b4-8605dcabc415 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:11:59 user nova-compute[75165]: WARNING nova.compute.manager [req-9834dd73-d119-477d-8c19-5731aad1c0e4 req-f06f720a-dc86-48ad-9387-aaf78fe19e47 service nova] [instance: 84c6b624-648b-40e2-a37e-ff08609bad84] Received unexpected event network-vif-plugged-2107529c-ec0e-4d1d-85b4-8605dcabc415 for instance with vm_state active and task_state rescuing.
Oct 26 00:11:59 user nova-compute[75165]: DEBUG nova.network.neutron [None req-b77af02b-ef0b-481e-ab99-10db43f9a8ec tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] [instance: b0edba5b-e4d8-4b0a-ace1-1f32c19f8bd0] Successfully updated port: e931a766-e43c-4224-bb52-9c8561f4aa6d {{(pid=75165) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 00:11:59 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-b77af02b-ef0b-481e-ab99-10db43f9a8ec tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] Acquiring lock "refresh_cache-b0edba5b-e4d8-4b0a-ace1-1f32c19f8bd0" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:11:59 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-b77af02b-ef0b-481e-ab99-10db43f9a8ec tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] Acquired lock "refresh_cache-b0edba5b-e4d8-4b0a-ace1-1f32c19f8bd0" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:11:59 user nova-compute[75165]: DEBUG nova.network.neutron [None req-b77af02b-ef0b-481e-ab99-10db43f9a8ec tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] [instance: b0edba5b-e4d8-4b0a-ace1-1f32c19f8bd0] Building network info cache for instance {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 00:11:59 user nova-compute[75165]: DEBUG nova.compute.manager [req-301e4860-f6ee-440e-925c-228d3ae65d64 req-7d98322c-8839-4205-a641-bb3dd34d1947 service nova] [instance: b0edba5b-e4d8-4b0a-ace1-1f32c19f8bd0] Received event network-changed-e931a766-e43c-4224-bb52-9c8561f4aa6d {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:11:59 user nova-compute[75165]: DEBUG nova.compute.manager [req-301e4860-f6ee-440e-925c-228d3ae65d64 req-7d98322c-8839-4205-a641-bb3dd34d1947 service nova] [instance: b0edba5b-e4d8-4b0a-ace1-1f32c19f8bd0] Refreshing instance network info cache due to event network-changed-e931a766-e43c-4224-bb52-9c8561f4aa6d. {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 00:11:59 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-301e4860-f6ee-440e-925c-228d3ae65d64 req-7d98322c-8839-4205-a641-bb3dd34d1947 service nova] Acquiring lock "refresh_cache-b0edba5b-e4d8-4b0a-ace1-1f32c19f8bd0" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:11:59 user nova-compute[75165]: DEBUG nova.network.neutron [None req-b77af02b-ef0b-481e-ab99-10db43f9a8ec tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] [instance: b0edba5b-e4d8-4b0a-ace1-1f32c19f8bd0] Instance cache missing network info. {{(pid=75165) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 00:12:00 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:12:00 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:12:00 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:12:00 user nova-compute[75165]: DEBUG nova.network.neutron [None req-b77af02b-ef0b-481e-ab99-10db43f9a8ec tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] [instance: b0edba5b-e4d8-4b0a-ace1-1f32c19f8bd0] Updating instance_info_cache with network_info: [{"id": "e931a766-e43c-4224-bb52-9c8561f4aa6d", "address": "fa:16:3e:af:fa:87", "network": {"id": "e571d376-bebd-49ff-b7ee-64a148f25b55", "bridge": "br-int", "label": "tempest-VolumesActionsTest-502796136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c9acab3d48a43568a5096c8d786538d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape931a766-e4", "ovs_interfaceid": "e931a766-e43c-4224-bb52-9c8561f4aa6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:12:00 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-b77af02b-ef0b-481e-ab99-10db43f9a8ec tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] Releasing lock "refresh_cache-b0edba5b-e4d8-4b0a-ace1-1f32c19f8bd0" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:12:00 user nova-compute[75165]: DEBUG nova.compute.manager [None req-b77af02b-ef0b-481e-ab99-10db43f9a8ec tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] [instance: b0edba5b-e4d8-4b0a-ace1-1f32c19f8bd0] Instance network_info: |[{"id": "e931a766-e43c-4224-bb52-9c8561f4aa6d", "address": "fa:16:3e:af:fa:87", "network": {"id": "e571d376-bebd-49ff-b7ee-64a148f25b55", "bridge": "br-int", "label": "tempest-VolumesActionsTest-502796136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c9acab3d48a43568a5096c8d786538d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape931a766-e4", "ovs_interfaceid": "e931a766-e43c-4224-bb52-9c8561f4aa6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75165) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 00:12:00 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-301e4860-f6ee-440e-925c-228d3ae65d64 req-7d98322c-8839-4205-a641-bb3dd34d1947 service nova] Acquired lock "refresh_cache-b0edba5b-e4d8-4b0a-ace1-1f32c19f8bd0" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:12:00 user nova-compute[75165]: DEBUG nova.network.neutron [req-301e4860-f6ee-440e-925c-228d3ae65d64 req-7d98322c-8839-4205-a641-bb3dd34d1947 service nova] [instance: b0edba5b-e4d8-4b0a-ace1-1f32c19f8bd0] Refreshing network info cache for port e931a766-e43c-4224-bb52-9c8561f4aa6d {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 00:12:00 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-b77af02b-ef0b-481e-ab99-10db43f9a8ec tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] [instance: b0edba5b-e4d8-4b0a-ace1-1f32c19f8bd0] Start _get_guest_xml network_info=[{"id": "e931a766-e43c-4224-bb52-9c8561f4aa6d", "address": "fa:16:3e:af:fa:87", "network": {"id": "e571d376-bebd-49ff-b7ee-64a148f25b55", "bridge": "br-int", "label": "tempest-VolumesActionsTest-502796136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c9acab3d48a43568a5096c8d786538d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape931a766-e4", "ovs_interfaceid": "e931a766-e43c-4224-bb52-9c8561f4aa6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T00:03:24Z,direct_url=<?>,disk_format='qcow2',id=bff0d8a1-739e-4c4d-9efa-b73ba7b76d01,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e56bbf444fd34c348475c73673611447',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T00:03:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'size': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': 'bff0d8a1-739e-4c4d-9efa-b73ba7b76d01'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75165) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 00:12:00 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-b77af02b-ef0b-481e-ab99-10db43f9a8ec tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:12:00 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-b77af02b-ef0b-481e-ab99-10db43f9a8ec tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:12:00 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-b77af02b-ef0b-481e-ab99-10db43f9a8ec tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75165) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 00:12:00 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-b77af02b-ef0b-481e-ab99-10db43f9a8ec tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] CPU controller missing on host. {{(pid=75165) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 00:12:00 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-b77af02b-ef0b-481e-ab99-10db43f9a8ec tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75165) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 00:12:00 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-b77af02b-ef0b-481e-ab99-10db43f9a8ec tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] CPU controller found on host. {{(pid=75165) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 00:12:00 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-b77af02b-ef0b-481e-ab99-10db43f9a8ec tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75165) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 00:12:00 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-b77af02b-ef0b-481e-ab99-10db43f9a8ec tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T00:03:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T00:03:24Z,direct_url=<?>,disk_format='qcow2',id=bff0d8a1-739e-4c4d-9efa-b73ba7b76d01,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e56bbf444fd34c348475c73673611447',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T00:03:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 00:12:00 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-b77af02b-ef0b-481e-ab99-10db43f9a8ec tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] Flavor limits 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 00:12:00 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-b77af02b-ef0b-481e-ab99-10db43f9a8ec tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] Image limits 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 00:12:00 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-b77af02b-ef0b-481e-ab99-10db43f9a8ec tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] Flavor pref 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 00:12:00 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-b77af02b-ef0b-481e-ab99-10db43f9a8ec tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] Image pref 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 00:12:00 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-b77af02b-ef0b-481e-ab99-10db43f9a8ec tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 00:12:00 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-b77af02b-ef0b-481e-ab99-10db43f9a8ec tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 00:12:00 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-b77af02b-ef0b-481e-ab99-10db43f9a8ec tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75165) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 00:12:00 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-b77af02b-ef0b-481e-ab99-10db43f9a8ec tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] Got 1 possible topologies {{(pid=75165) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 00:12:00 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-b77af02b-ef0b-481e-ab99-10db43f9a8ec tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 00:12:00 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-b77af02b-ef0b-481e-ab99-10db43f9a8ec tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 00:12:00 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-b77af02b-ef0b-481e-ab99-10db43f9a8ec tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:11:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-800946363',display_name='tempest-VolumesActionsTest-instance-800946363',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-800946363',id=17,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7c9acab3d48a43568a5096c8d786538d',ramdisk_id='',reservation_id='r-tfbej80e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-229861779',owner_user_name='tempest-VolumesActionsTest-229861779-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T00:11:56Z,user_data=None,user_id='f1b35e426f0f488b9fab44fe85bcff98',uuid=b0edba5b-e4d8-4b0a-ace1-1f32c19f8bd0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e931a766-e43c-4224-bb52-9c8561f4aa6d", "address": "fa:16:3e:af:fa:87", "network": {"id": "e571d376-bebd-49ff-b7ee-64a148f25b55", "bridge": "br-int", "label": "tempest-VolumesActionsTest-502796136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c9acab3d48a43568a5096c8d786538d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape931a766-e4", "ovs_interfaceid": "e931a766-e43c-4224-bb52-9c8561f4aa6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75165) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 00:12:00 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-b77af02b-ef0b-481e-ab99-10db43f9a8ec tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] Converting VIF {"id": "e931a766-e43c-4224-bb52-9c8561f4aa6d", "address": "fa:16:3e:af:fa:87", "network": {"id": "e571d376-bebd-49ff-b7ee-64a148f25b55", "bridge": "br-int", "label": "tempest-VolumesActionsTest-502796136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c9acab3d48a43568a5096c8d786538d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape931a766-e4", "ovs_interfaceid": "e931a766-e43c-4224-bb52-9c8561f4aa6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:12:00 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-b77af02b-ef0b-481e-ab99-10db43f9a8ec tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:fa:87,bridge_name='br-int',has_traffic_filtering=True,id=e931a766-e43c-4224-bb52-9c8561f4aa6d,network=Network(e571d376-bebd-49ff-b7ee-64a148f25b55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape931a766-e4') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:12:00 user nova-compute[75165]: DEBUG nova.objects.instance [None req-b77af02b-ef0b-481e-ab99-10db43f9a8ec tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] Lazy-loading 'pci_devices' on Instance uuid b0edba5b-e4d8-4b0a-ace1-1f32c19f8bd0 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:12:00 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-b77af02b-ef0b-481e-ab99-10db43f9a8ec tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] [instance: b0edba5b-e4d8-4b0a-ace1-1f32c19f8bd0] End _get_guest_xml xml=<domain type="kvm">
Oct 26 00:12:00 user nova-compute[75165]:   <uuid>b0edba5b-e4d8-4b0a-ace1-1f32c19f8bd0</uuid>
Oct 26 00:12:00 user nova-compute[75165]:   <name>instance-00000011</name>
Oct 26 00:12:00 user nova-compute[75165]:   <memory>524288</memory>
Oct 26 00:12:00 user nova-compute[75165]:   <vcpu>1</vcpu>
Oct 26 00:12:00 user nova-compute[75165]:   <metadata>
Oct 26 00:12:00 user nova-compute[75165]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 00:12:00 user nova-compute[75165]:       <nova:package version="0.0.0"/>
Oct 26 00:12:00 user nova-compute[75165]:       <nova:name>tempest-VolumesActionsTest-instance-800946363</nova:name>
Oct 26 00:12:00 user nova-compute[75165]:       <nova:creationTime>2023-10-26 00:12:00</nova:creationTime>
Oct 26 00:12:00 user nova-compute[75165]:       <nova:flavor name="m1.tiny">
Oct 26 00:12:00 user nova-compute[75165]:         <nova:memory>512</nova:memory>
Oct 26 00:12:00 user nova-compute[75165]:         <nova:disk>1</nova:disk>
Oct 26 00:12:00 user nova-compute[75165]:         <nova:swap>0</nova:swap>
Oct 26 00:12:00 user nova-compute[75165]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 00:12:00 user nova-compute[75165]:         <nova:vcpus>1</nova:vcpus>
Oct 26 00:12:00 user nova-compute[75165]:       </nova:flavor>
Oct 26 00:12:00 user nova-compute[75165]:       <nova:owner>
Oct 26 00:12:00 user nova-compute[75165]:         <nova:user uuid="f1b35e426f0f488b9fab44fe85bcff98">tempest-VolumesActionsTest-229861779-project-member</nova:user>
Oct 26 00:12:00 user nova-compute[75165]:         <nova:project uuid="7c9acab3d48a43568a5096c8d786538d">tempest-VolumesActionsTest-229861779</nova:project>
Oct 26 00:12:00 user nova-compute[75165]:       </nova:owner>
Oct 26 00:12:00 user nova-compute[75165]:       <nova:root type="image" uuid="bff0d8a1-739e-4c4d-9efa-b73ba7b76d01"/>
Oct 26 00:12:00 user nova-compute[75165]:       <nova:ports>
Oct 26 00:12:00 user nova-compute[75165]:         <nova:port uuid="e931a766-e43c-4224-bb52-9c8561f4aa6d">
Oct 26 00:12:00 user nova-compute[75165]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 26 00:12:00 user nova-compute[75165]:         </nova:port>
Oct 26 00:12:00 user nova-compute[75165]:       </nova:ports>
Oct 26 00:12:00 user nova-compute[75165]:     </nova:instance>
Oct 26 00:12:00 user nova-compute[75165]:   </metadata>
Oct 26 00:12:00 user nova-compute[75165]:   <sysinfo type="smbios">
Oct 26 00:12:00 user nova-compute[75165]:     <system>
Oct 26 00:12:00 user nova-compute[75165]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 00:12:00 user nova-compute[75165]:       <entry name="product">OpenStack Nova</entry>
Oct 26 00:12:00 user nova-compute[75165]:       <entry name="version">0.0.0</entry>
Oct 26 00:12:00 user nova-compute[75165]:       <entry name="serial">b0edba5b-e4d8-4b0a-ace1-1f32c19f8bd0</entry>
Oct 26 00:12:00 user nova-compute[75165]:       <entry name="uuid">b0edba5b-e4d8-4b0a-ace1-1f32c19f8bd0</entry>
Oct 26 00:12:00 user nova-compute[75165]:       <entry name="family">Virtual Machine</entry>
Oct 26 00:12:00 user nova-compute[75165]:     </system>
Oct 26 00:12:00 user nova-compute[75165]:   </sysinfo>
Oct 26 00:12:00 user nova-compute[75165]:   <os>
Oct 26 00:12:00 user nova-compute[75165]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 00:12:00 user nova-compute[75165]:     <boot dev="hd"/>
Oct 26 00:12:00 user nova-compute[75165]:     <smbios mode="sysinfo"/>
Oct 26 00:12:00 user nova-compute[75165]:   </os>
Oct 26 00:12:00 user nova-compute[75165]:   <features>
Oct 26 00:12:00 user nova-compute[75165]:     <acpi/>
Oct 26 00:12:00 user nova-compute[75165]:     <apic/>
Oct 26 00:12:00 user nova-compute[75165]:     <vmcoreinfo/>
Oct 26 00:12:00 user nova-compute[75165]:   </features>
Oct 26 00:12:00 user nova-compute[75165]:   <clock offset="utc">
Oct 26 00:12:00 user nova-compute[75165]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 00:12:00 user nova-compute[75165]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 00:12:00 user nova-compute[75165]:     <timer name="hpet" present="no"/>
Oct 26 00:12:00 user nova-compute[75165]:   </clock>
Oct 26 00:12:00 user nova-compute[75165]:   <cpu mode="custom" match="exact">
Oct 26 00:12:00 user nova-compute[75165]:     <model>Nehalem</model>
Oct 26 00:12:00 user nova-compute[75165]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 00:12:00 user nova-compute[75165]:   </cpu>
Oct 26 00:12:00 user nova-compute[75165]:   <devices>
Oct 26 00:12:00 user nova-compute[75165]:     <disk type="file" device="disk">
Oct 26 00:12:00 user nova-compute[75165]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 00:12:00 user nova-compute[75165]:       <source file="/opt/stack/data/nova/instances/b0edba5b-e4d8-4b0a-ace1-1f32c19f8bd0/disk"/>
Oct 26 00:12:00 user nova-compute[75165]:       <target dev="vda" bus="virtio"/>
Oct 26 00:12:00 user nova-compute[75165]:     </disk>
Oct 26 00:12:00 user nova-compute[75165]:     <interface type="ethernet">
Oct 26 00:12:00 user nova-compute[75165]:       <mac address="fa:16:3e:af:fa:87"/>
Oct 26 00:12:00 user nova-compute[75165]:       <model type="virtio"/>
Oct 26 00:12:00 user nova-compute[75165]:       <mtu size="1442"/>
Oct 26 00:12:00 user nova-compute[75165]:       <target dev="tape931a766-e4"/>
Oct 26 00:12:00 user nova-compute[75165]:     </interface>
Oct 26 00:12:00 user nova-compute[75165]:     <serial type="pty">
Oct 26 00:12:00 user nova-compute[75165]:       <log file="/opt/stack/data/nova/instances/b0edba5b-e4d8-4b0a-ace1-1f32c19f8bd0/console.log" append="off"/>
Oct 26 00:12:00 user nova-compute[75165]:     </serial>
Oct 26 00:12:00 user nova-compute[75165]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 00:12:00 user nova-compute[75165]:     <video>
Oct 26 00:12:00 user nova-compute[75165]:       <model type="virtio"/>
Oct 26 00:12:00 user nova-compute[75165]:     </video>
Oct 26 00:12:00 user nova-compute[75165]:     <rng model="virtio">
Oct 26 00:12:00 user nova-compute[75165]:       <backend model="random">/dev/urandom</backend>
Oct 26 00:12:00 user nova-compute[75165]:     </rng>
Oct 26 00:12:00 user nova-compute[75165]:     <controller type="usb" index="0" model="none"/>
Oct 26 00:12:00 user nova-compute[75165]:     <memballoon model="virtio">
Oct 26 00:12:00 user nova-compute[75165]:       <stats period="10"/>
Oct 26 00:12:00 user nova-compute[75165]:     </memballoon>
Oct 26 00:12:00 user nova-compute[75165]:   </devices>
Oct 26 00:12:00 user nova-compute[75165]: </domain>
Oct 26 00:12:00 user nova-compute[75165]:  {{(pid=75165) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 00:12:00 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-b77af02b-ef0b-481e-ab99-10db43f9a8ec tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:11:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-800946363',display_name='tempest-VolumesActionsTest-instance-800946363',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-800946363',id=17,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7c9acab3d48a43568a5096c8d786538d',ramdisk_id='',reservation_id='r-tfbej80e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-229861779',owner_user_name='tempest-VolumesActionsTest-229861779-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T00:11:56Z,user_data=None,user_id='f1b35e426f0f488b9fab44fe85bcff98',uuid=b0edba5b-e4d8-4b0a-ace1-1f32c19f8bd0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e931a766-e43c-4224-bb52-9c8561f4aa6d", "address": "fa:16:3e:af:fa:87", "network": {"id": "e571d376-bebd-49ff-b7ee-64a148f25b55", "bridge": "br-int", "label": "tempest-VolumesActionsTest-502796136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c9acab3d48a43568a5096c8d786538d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape931a766-e4", "ovs_interfaceid": "e931a766-e43c-4224-bb52-9c8561f4aa6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 00:12:00 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-b77af02b-ef0b-481e-ab99-10db43f9a8ec tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] Converting VIF {"id": "e931a766-e43c-4224-bb52-9c8561f4aa6d", "address": "fa:16:3e:af:fa:87", "network": {"id": "e571d376-bebd-49ff-b7ee-64a148f25b55", "bridge": "br-int", "label": "tempest-VolumesActionsTest-502796136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c9acab3d48a43568a5096c8d786538d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape931a766-e4", "ovs_interfaceid": "e931a766-e43c-4224-bb52-9c8561f4aa6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:12:00 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-b77af02b-ef0b-481e-ab99-10db43f9a8ec tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:fa:87,bridge_name='br-int',has_traffic_filtering=True,id=e931a766-e43c-4224-bb52-9c8561f4aa6d,network=Network(e571d376-bebd-49ff-b7ee-64a148f25b55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape931a766-e4') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:12:00 user nova-compute[75165]: DEBUG os_vif [None req-b77af02b-ef0b-481e-ab99-10db43f9a8ec tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:fa:87,bridge_name='br-int',has_traffic_filtering=True,id=e931a766-e43c-4224-bb52-9c8561f4aa6d,network=Network(e571d376-bebd-49ff-b7ee-64a148f25b55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape931a766-e4') {{(pid=75165) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 00:12:00 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:12:00 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:12:00 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 00:12:00 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:12:00 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ff92d282-6274-5658-b020-af6f6f0df12d', '_type': 'linux-noop'}}, row=False) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:12:00 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:12:00 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:12:00 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:12:00 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape931a766-e4, may_exist=True, interface_attrs={}) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:12:00 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape931a766-e4, col_values=(('qos', UUID('ae7c99f8-accf-4077-a008-9f5a77a0fed1')),), if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:12:00 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape931a766-e4, col_values=(('external_ids', {'iface-id': 'e931a766-e43c-4224-bb52-9c8561f4aa6d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:af:fa:87', 'vm-uuid': 'b0edba5b-e4d8-4b0a-ace1-1f32c19f8bd0'}),), if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:12:00 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:12:00 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:12:00 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:12:00 user nova-compute[75165]: INFO os_vif [None req-b77af02b-ef0b-481e-ab99-10db43f9a8ec tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:fa:87,bridge_name='br-int',has_traffic_filtering=True,id=e931a766-e43c-4224-bb52-9c8561f4aa6d,network=Network(e571d376-bebd-49ff-b7ee-64a148f25b55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape931a766-e4')
Oct 26 00:12:00 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:12:00 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:12:00 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-b77af02b-ef0b-481e-ab99-10db43f9a8ec tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] No BDM found with device name vda, not building metadata. {{(pid=75165) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 00:12:00 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-b77af02b-ef0b-481e-ab99-10db43f9a8ec tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] No VIF found with MAC fa:16:3e:af:fa:87, not building metadata {{(pid=75165) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 00:12:00 user nova-compute[75165]: DEBUG nova.network.neutron [req-301e4860-f6ee-440e-925c-228d3ae65d64 req-7d98322c-8839-4205-a641-bb3dd34d1947 service nova] [instance: b0edba5b-e4d8-4b0a-ace1-1f32c19f8bd0] Updated VIF entry in instance network info cache for port e931a766-e43c-4224-bb52-9c8561f4aa6d. {{(pid=75165) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 00:12:00 user nova-compute[75165]: DEBUG nova.network.neutron [req-301e4860-f6ee-440e-925c-228d3ae65d64 req-7d98322c-8839-4205-a641-bb3dd34d1947 service nova] [instance: b0edba5b-e4d8-4b0a-ace1-1f32c19f8bd0] Updating instance_info_cache with network_info: [{"id": "e931a766-e43c-4224-bb52-9c8561f4aa6d", "address": "fa:16:3e:af:fa:87", "network": {"id": "e571d376-bebd-49ff-b7ee-64a148f25b55", "bridge": "br-int", "label": "tempest-VolumesActionsTest-502796136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c9acab3d48a43568a5096c8d786538d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape931a766-e4", "ovs_interfaceid": "e931a766-e43c-4224-bb52-9c8561f4aa6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:12:00 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:12:00 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:12:00 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-301e4860-f6ee-440e-925c-228d3ae65d64 req-7d98322c-8839-4205-a641-bb3dd34d1947 service nova] Releasing lock "refresh_cache-b0edba5b-e4d8-4b0a-ace1-1f32c19f8bd0" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:12:01 user nova-compute[75165]: DEBUG nova.compute.manager [req-e942cfd7-9fc2-4e66-aca8-676dcf4fb44e req-4e044ec5-c48e-46e4-a136-596e95070d83 service nova] [instance: 84c6b624-648b-40e2-a37e-ff08609bad84] Received event network-vif-plugged-2107529c-ec0e-4d1d-85b4-8605dcabc415 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:12:01 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-e942cfd7-9fc2-4e66-aca8-676dcf4fb44e req-4e044ec5-c48e-46e4-a136-596e95070d83 service nova] Acquiring lock "84c6b624-648b-40e2-a37e-ff08609bad84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:12:01 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-e942cfd7-9fc2-4e66-aca8-676dcf4fb44e req-4e044ec5-c48e-46e4-a136-596e95070d83 service nova] Lock "84c6b624-648b-40e2-a37e-ff08609bad84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:12:01 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-e942cfd7-9fc2-4e66-aca8-676dcf4fb44e req-4e044ec5-c48e-46e4-a136-596e95070d83 service nova] Lock "84c6b624-648b-40e2-a37e-ff08609bad84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:12:01 user nova-compute[75165]: DEBUG nova.compute.manager [req-e942cfd7-9fc2-4e66-aca8-676dcf4fb44e req-4e044ec5-c48e-46e4-a136-596e95070d83 service nova] [instance: 84c6b624-648b-40e2-a37e-ff08609bad84] No waiting events found dispatching network-vif-plugged-2107529c-ec0e-4d1d-85b4-8605dcabc415 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:12:01 user nova-compute[75165]: WARNING nova.compute.manager [req-e942cfd7-9fc2-4e66-aca8-676dcf4fb44e req-4e044ec5-c48e-46e4-a136-596e95070d83 service nova] [instance: 84c6b624-648b-40e2-a37e-ff08609bad84] Received unexpected event network-vif-plugged-2107529c-ec0e-4d1d-85b4-8605dcabc415 for instance with vm_state active and task_state rescuing.
Oct 26 00:12:01 user nova-compute[75165]: DEBUG nova.compute.manager [req-e942cfd7-9fc2-4e66-aca8-676dcf4fb44e req-4e044ec5-c48e-46e4-a136-596e95070d83 service nova] [instance: 84c6b624-648b-40e2-a37e-ff08609bad84] Received event network-vif-plugged-2107529c-ec0e-4d1d-85b4-8605dcabc415 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:12:01 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-e942cfd7-9fc2-4e66-aca8-676dcf4fb44e req-4e044ec5-c48e-46e4-a136-596e95070d83 service nova] Acquiring lock "84c6b624-648b-40e2-a37e-ff08609bad84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:12:01 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-e942cfd7-9fc2-4e66-aca8-676dcf4fb44e req-4e044ec5-c48e-46e4-a136-596e95070d83 service nova] Lock "84c6b624-648b-40e2-a37e-ff08609bad84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:12:01 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-e942cfd7-9fc2-4e66-aca8-676dcf4fb44e req-4e044ec5-c48e-46e4-a136-596e95070d83 service nova] Lock "84c6b624-648b-40e2-a37e-ff08609bad84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:12:01 user nova-compute[75165]: DEBUG nova.compute.manager [req-e942cfd7-9fc2-4e66-aca8-676dcf4fb44e req-4e044ec5-c48e-46e4-a136-596e95070d83 service nova] [instance: 84c6b624-648b-40e2-a37e-ff08609bad84] No waiting events found dispatching network-vif-plugged-2107529c-ec0e-4d1d-85b4-8605dcabc415 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:12:01 user nova-compute[75165]: WARNING nova.compute.manager [req-e942cfd7-9fc2-4e66-aca8-676dcf4fb44e req-4e044ec5-c48e-46e4-a136-596e95070d83 service nova] [instance: 84c6b624-648b-40e2-a37e-ff08609bad84] Received unexpected event network-vif-plugged-2107529c-ec0e-4d1d-85b4-8605dcabc415 for instance with vm_state active and task_state rescuing.
Oct 26 00:12:01 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:12:01 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:12:01 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:12:02 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:12:02 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:12:02 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:12:02 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:12:02 user nova-compute[75165]: DEBUG nova.network.neutron [None req-25b7cf3b-70f7-42f9-ae34-60f1c9b0de36 tempest-TaggedBootDevicesTest-1951782657 tempest-TaggedBootDevicesTest-1951782657-project-member] [instance: 0d674bd2-7546-41c8-a4cf-3e26ea91edb4] Updating instance_info_cache with network_info: [] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:12:02 user nova-compute[75165]: INFO nova.compute.manager [None req-25b7cf3b-70f7-42f9-ae34-60f1c9b0de36 tempest-TaggedBootDevicesTest-1951782657 tempest-TaggedBootDevicesTest-1951782657-project-member] [instance: 0d674bd2-7546-41c8-a4cf-3e26ea91edb4] Took 4.65 seconds to deallocate network for instance.
Oct 26 00:12:02 user nova-compute[75165]: DEBUG nova.compute.manager [None req-25b7cf3b-70f7-42f9-ae34-60f1c9b0de36 tempest-TaggedBootDevicesTest-1951782657 tempest-TaggedBootDevicesTest-1951782657-project-member] [instance: 0d674bd2-7546-41c8-a4cf-3e26ea91edb4] Detaching volume: fa6fd683-7355-4a71-a2b9-a9f5846103c9 {{(pid=75165) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3224}}
Oct 26 00:12:02 user nova-compute[75165]: INFO nova.compute.manager [None req-25b7cf3b-70f7-42f9-ae34-60f1c9b0de36 tempest-TaggedBootDevicesTest-1951782657 tempest-TaggedBootDevicesTest-1951782657-project-member] [instance: 0d674bd2-7546-41c8-a4cf-3e26ea91edb4] Detaching volume fa6fd683-7355-4a71-a2b9-a9f5846103c9
Oct 26 00:12:02 user nova-compute[75165]: DEBUG nova.virt.block_device [None req-25b7cf3b-70f7-42f9-ae34-60f1c9b0de36 tempest-TaggedBootDevicesTest-1951782657 tempest-TaggedBootDevicesTest-1951782657-project-member] [instance: 0d674bd2-7546-41c8-a4cf-3e26ea91edb4] Skipping driver_detach during remote rebuild. {{(pid=75165) _do_detach /opt/stack/nova/nova/virt/block_device.py:461}}
Oct 26 00:12:03 user nova-compute[75165]: WARNING nova.compute.manager [None req-25b7cf3b-70f7-42f9-ae34-60f1c9b0de36 tempest-TaggedBootDevicesTest-1951782657 tempest-TaggedBootDevicesTest-1951782657-project-member] Failed to detach volume: fa6fd683-7355-4a71-a2b9-a9f5846103c9 due to 'NoneType' object has no attribute 'devices'
Oct 26 00:12:03 user nova-compute[75165]: DEBUG nova.compute.manager [None req-25b7cf3b-70f7-42f9-ae34-60f1c9b0de36 tempest-TaggedBootDevicesTest-1951782657 tempest-TaggedBootDevicesTest-1951782657-project-member] [instance: 0d674bd2-7546-41c8-a4cf-3e26ea91edb4] Detaching volume: 785281cb-5065-4ad6-8f4e-c5032b925d8e {{(pid=75165) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3224}}
Oct 26 00:12:03 user nova-compute[75165]: INFO nova.compute.manager [None req-25b7cf3b-70f7-42f9-ae34-60f1c9b0de36 tempest-TaggedBootDevicesTest-1951782657 tempest-TaggedBootDevicesTest-1951782657-project-member] [instance: 0d674bd2-7546-41c8-a4cf-3e26ea91edb4] Detaching volume 785281cb-5065-4ad6-8f4e-c5032b925d8e
Oct 26 00:12:03 user nova-compute[75165]: DEBUG nova.virt.block_device [None req-25b7cf3b-70f7-42f9-ae34-60f1c9b0de36 tempest-TaggedBootDevicesTest-1951782657 tempest-TaggedBootDevicesTest-1951782657-project-member] [instance: 0d674bd2-7546-41c8-a4cf-3e26ea91edb4] Skipping driver_detach during remote rebuild. {{(pid=75165) _do_detach /opt/stack/nova/nova/virt/block_device.py:461}}
Oct 26 00:12:03 user nova-compute[75165]: WARNING nova.compute.manager [None req-25b7cf3b-70f7-42f9-ae34-60f1c9b0de36 tempest-TaggedBootDevicesTest-1951782657 tempest-TaggedBootDevicesTest-1951782657-project-member] Failed to detach volume: 785281cb-5065-4ad6-8f4e-c5032b925d8e due to 'NoneType' object has no attribute 'devices'
Oct 26 00:12:03 user nova-compute[75165]: DEBUG nova.compute.manager [None req-25b7cf3b-70f7-42f9-ae34-60f1c9b0de36 tempest-TaggedBootDevicesTest-1951782657 tempest-TaggedBootDevicesTest-1951782657-project-member] [instance: 0d674bd2-7546-41c8-a4cf-3e26ea91edb4] Detaching volume: 35d2bb7a-a872-41b5-b152-1094169004ed {{(pid=75165) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3224}}
Oct 26 00:12:03 user nova-compute[75165]: INFO nova.compute.manager [None req-25b7cf3b-70f7-42f9-ae34-60f1c9b0de36 tempest-TaggedBootDevicesTest-1951782657 tempest-TaggedBootDevicesTest-1951782657-project-member] [instance: 0d674bd2-7546-41c8-a4cf-3e26ea91edb4] Detaching volume 35d2bb7a-a872-41b5-b152-1094169004ed
Oct 26 00:12:03 user nova-compute[75165]: DEBUG nova.virt.block_device [None req-25b7cf3b-70f7-42f9-ae34-60f1c9b0de36 tempest-TaggedBootDevicesTest-1951782657 tempest-TaggedBootDevicesTest-1951782657-project-member] [instance: 0d674bd2-7546-41c8-a4cf-3e26ea91edb4] Skipping driver_detach during remote rebuild. {{(pid=75165) _do_detach /opt/stack/nova/nova/virt/block_device.py:461}}
Oct 26 00:12:03 user nova-compute[75165]: DEBUG nova.compute.manager [req-6d257744-912e-4397-82e6-d9b841f87d90 req-b467611e-65a1-43fa-9e12-9770006cf8ef service nova] [instance: b0edba5b-e4d8-4b0a-ace1-1f32c19f8bd0] Received event network-vif-plugged-e931a766-e43c-4224-bb52-9c8561f4aa6d {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:12:03 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-6d257744-912e-4397-82e6-d9b841f87d90 req-b467611e-65a1-43fa-9e12-9770006cf8ef service nova] Acquiring lock "b0edba5b-e4d8-4b0a-ace1-1f32c19f8bd0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:12:03 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-6d257744-912e-4397-82e6-d9b841f87d90 req-b467611e-65a1-43fa-9e12-9770006cf8ef service nova] Lock "b0edba5b-e4d8-4b0a-ace1-1f32c19f8bd0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:12:03 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-6d257744-912e-4397-82e6-d9b841f87d90 req-b467611e-65a1-43fa-9e12-9770006cf8ef service nova] Lock "b0edba5b-e4d8-4b0a-ace1-1f32c19f8bd0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:12:03 user nova-compute[75165]: DEBUG nova.compute.manager [req-6d257744-912e-4397-82e6-d9b841f87d90 req-b467611e-65a1-43fa-9e12-9770006cf8ef service nova] [instance: b0edba5b-e4d8-4b0a-ace1-1f32c19f8bd0] No waiting events found dispatching network-vif-plugged-e931a766-e43c-4224-bb52-9c8561f4aa6d {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:12:03 user nova-compute[75165]: WARNING nova.compute.manager [req-6d257744-912e-4397-82e6-d9b841f87d90 req-b467611e-65a1-43fa-9e12-9770006cf8ef service nova] [instance: b0edba5b-e4d8-4b0a-ace1-1f32c19f8bd0] Received unexpected event network-vif-plugged-e931a766-e43c-4224-bb52-9c8561f4aa6d for instance with vm_state building and task_state spawning.
Oct 26 00:12:03 user nova-compute[75165]: DEBUG nova.compute.manager [req-6d257744-912e-4397-82e6-d9b841f87d90 req-b467611e-65a1-43fa-9e12-9770006cf8ef service nova] [instance: b0edba5b-e4d8-4b0a-ace1-1f32c19f8bd0] Received event network-vif-plugged-e931a766-e43c-4224-bb52-9c8561f4aa6d {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:12:03 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-6d257744-912e-4397-82e6-d9b841f87d90 req-b467611e-65a1-43fa-9e12-9770006cf8ef service nova] Acquiring lock "b0edba5b-e4d8-4b0a-ace1-1f32c19f8bd0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:12:03 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-6d257744-912e-4397-82e6-d9b841f87d90 req-b467611e-65a1-43fa-9e12-9770006cf8ef service nova] Lock "b0edba5b-e4d8-4b0a-ace1-1f32c19f8bd0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:12:03 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-6d257744-912e-4397-82e6-d9b841f87d90 req-b467611e-65a1-43fa-9e12-9770006cf8ef service nova] Lock "b0edba5b-e4d8-4b0a-ace1-1f32c19f8bd0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:12:03 user nova-compute[75165]: DEBUG nova.compute.manager [req-6d257744-912e-4397-82e6-d9b841f87d90 req-b467611e-65a1-43fa-9e12-9770006cf8ef service nova] [instance: b0edba5b-e4d8-4b0a-ace1-1f32c19f8bd0] No waiting events found dispatching network-vif-plugged-e931a766-e43c-4224-bb52-9c8561f4aa6d {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:12:03 user nova-compute[75165]: WARNING nova.compute.manager [req-6d257744-912e-4397-82e6-d9b841f87d90 req-b467611e-65a1-43fa-9e12-9770006cf8ef service nova] [instance: b0edba5b-e4d8-4b0a-ace1-1f32c19f8bd0] Received unexpected event network-vif-plugged-e931a766-e43c-4224-bb52-9c8561f4aa6d for instance with vm_state building and task_state spawning.
Oct 26 00:12:03 user nova-compute[75165]: INFO nova.scheduler.client.report [None req-25b7cf3b-70f7-42f9-ae34-60f1c9b0de36 tempest-TaggedBootDevicesTest-1951782657 tempest-TaggedBootDevicesTest-1951782657-project-member] Deleted allocations for instance 0d674bd2-7546-41c8-a4cf-3e26ea91edb4
Oct 26 00:12:03 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-25b7cf3b-70f7-42f9-ae34-60f1c9b0de36 tempest-TaggedBootDevicesTest-1951782657 tempest-TaggedBootDevicesTest-1951782657-project-member] Lock "0d674bd2-7546-41c8-a4cf-3e26ea91edb4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 23.415s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:12:03 user nova-compute[75165]: DEBUG nova.compute.manager [None req-6db2beaf-9e50-49cf-9f49-fff9c060570f tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: 84c6b624-648b-40e2-a37e-ff08609bad84] Checking state {{(pid=75165) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 00:12:04 user nova-compute[75165]: DEBUG nova.compute.manager [None req-b77af02b-ef0b-481e-ab99-10db43f9a8ec tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] [instance: b0edba5b-e4d8-4b0a-ace1-1f32c19f8bd0] Instance event wait completed in 0 seconds for  {{(pid=75165) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 00:12:04 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-b77af02b-ef0b-481e-ab99-10db43f9a8ec tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] [instance: b0edba5b-e4d8-4b0a-ace1-1f32c19f8bd0] Guest created on hypervisor {{(pid=75165) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 00:12:04 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: b0edba5b-e4d8-4b0a-ace1-1f32c19f8bd0] Instance spawned successfully.
Oct 26 00:12:04 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-b77af02b-ef0b-481e-ab99-10db43f9a8ec tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] [instance: b0edba5b-e4d8-4b0a-ace1-1f32c19f8bd0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 00:12:04 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-b77af02b-ef0b-481e-ab99-10db43f9a8ec tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] [instance: b0edba5b-e4d8-4b0a-ace1-1f32c19f8bd0] Found default for hw_cdrom_bus of ide {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:12:04 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-b77af02b-ef0b-481e-ab99-10db43f9a8ec tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] [instance: b0edba5b-e4d8-4b0a-ace1-1f32c19f8bd0] Found default for hw_disk_bus of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:12:04 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-b77af02b-ef0b-481e-ab99-10db43f9a8ec tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] [instance: b0edba5b-e4d8-4b0a-ace1-1f32c19f8bd0] Found default for hw_input_bus of None {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:12:04 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-b77af02b-ef0b-481e-ab99-10db43f9a8ec tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] [instance: b0edba5b-e4d8-4b0a-ace1-1f32c19f8bd0] Found default for hw_pointer_model of None {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:12:04 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-b77af02b-ef0b-481e-ab99-10db43f9a8ec tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] [instance: b0edba5b-e4d8-4b0a-ace1-1f32c19f8bd0] Found default for hw_video_model of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:12:04 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-b77af02b-ef0b-481e-ab99-10db43f9a8ec tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] [instance: b0edba5b-e4d8-4b0a-ace1-1f32c19f8bd0] Found default for hw_vif_model of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:12:04 user nova-compute[75165]: INFO nova.compute.manager [None req-b77af02b-ef0b-481e-ab99-10db43f9a8ec tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] [instance: b0edba5b-e4d8-4b0a-ace1-1f32c19f8bd0] Took 8.18 seconds to spawn the instance on the hypervisor.
Oct 26 00:12:04 user nova-compute[75165]: DEBUG nova.compute.manager [None req-b77af02b-ef0b-481e-ab99-10db43f9a8ec tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] [instance: b0edba5b-e4d8-4b0a-ace1-1f32c19f8bd0] Checking state {{(pid=75165) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 00:12:04 user nova-compute[75165]: INFO nova.compute.manager [None req-b77af02b-ef0b-481e-ab99-10db43f9a8ec tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] [instance: b0edba5b-e4d8-4b0a-ace1-1f32c19f8bd0] Took 9.37 seconds to build instance.
Oct 26 00:12:04 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-b77af02b-ef0b-481e-ab99-10db43f9a8ec tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] Lock "b0edba5b-e4d8-4b0a-ace1-1f32c19f8bd0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.540s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:12:05 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:12:05 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:12:06 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:12:06 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:12:07 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] Starting finish_migration {{(pid=75165) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Oct 26 00:12:07 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] Instance directory exists: not creating {{(pid=75165) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 26 00:12:07 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] Creating image(s)
Oct 26 00:12:07 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:12:07 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json" returned: 0 in 0.203s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:12:07 user nova-compute[75165]: DEBUG nova.virt.disk.api [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3b153af2-c93b-47d2-ae8c-76cfd44e384c/disk. size=21474836480 {{(pid=75165) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 00:12:07 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b153af2-c93b-47d2-ae8c-76cfd44e384c/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:12:08 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b153af2-c93b-47d2-ae8c-76cfd44e384c/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:12:08 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/3b153af2-c93b-47d2-ae8c-76cfd44e384c/disk 21474836480 {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:12:08 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/3b153af2-c93b-47d2-ae8c-76cfd44e384c/disk 21474836480" returned: 0 in 0.048s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:12:08 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] Did not create local disks {{(pid=75165) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 26 00:12:08 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] Ensure instance console log exists: /opt/stack/data/nova/instances/3b153af2-c93b-47d2-ae8c-76cfd44e384c/console.log {{(pid=75165) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 00:12:08 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:12:08 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:12:08 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:12:08 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] Start _get_guest_xml network_info=[{"id": "874a1698-c52c-444c-bed5-52633dbaeead", "address": "fa:16:3e:75:45:79", "network": {"id": "30951418-d830-4042-9143-c736802150e9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-167387787-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-167387787-network", "vif_mac": "fa:16:3e:75:45:79"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0db2c49ee28f4b7b9fa990faddb9d3a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap874a1698-c5", "ovs_interfaceid": "874a1698-c52c-444c-bed5-52633dbaeead", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T00:03:24Z,direct_url=<?>,disk_format='qcow2',id=bff0d8a1-739e-4c4d-9efa-b73ba7b76d01,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e56bbf444fd34c348475c73673611447',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T00:03:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'size': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': 'bff0d8a1-739e-4c4d-9efa-b73ba7b76d01'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AokCQquF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '3b153af2-c93b-47d2-ae8c-76cfd44e384c', 'attached_at': '2023-10-26T00:12:07.000000', 'detached_at': '', 'volume_id': 'bdb81c18-9a59-4d59-861d-f713e876159b', 'serial': 'bdb81c18-9a59-4d59-861d-f713e876159b'}, 'guest_format': None, 'boot_index': None, 'disk_bus': 'virtio', 'attachment_id': 'ed113a34-15f5-4b9b-8bf2-8683090afcd5', 'delete_on_termination': False, 'volume_type': None} {{(pid=75165) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 00:12:08 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:12:08 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:12:08 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75165) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 00:12:08 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] CPU controller missing on host. {{(pid=75165) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 00:12:08 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75165) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 00:12:08 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] CPU controller found on host. {{(pid=75165) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 00:12:08 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75165) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 00:12:08 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T00:03:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T00:03:24Z,direct_url=<?>,disk_format='qcow2',id=bff0d8a1-739e-4c4d-9efa-b73ba7b76d01,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e56bbf444fd34c348475c73673611447',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T00:03:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 00:12:08 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Flavor limits 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 00:12:08 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Image limits 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 00:12:08 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Flavor pref 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 00:12:08 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Image pref 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 00:12:08 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 00:12:08 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 00:12:08 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75165) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 00:12:08 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Got 1 possible topologies {{(pid=75165) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 00:12:08 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 00:12:08 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 00:12:08 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] Calling os-brick to attach iSCSI Volume {{(pid=75165) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 00:12:08 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8bf8160e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AokCQquF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:12:08 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:12:08 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:12:08 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:12:08 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:12:08 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:12:08 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:12:08 user nova-compute[75165]: INFO os_brick.initiator.connectors.iscsi [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 00:12:08 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b -p 172.16.0.220:3260 {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:12:08 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:12:08 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[06ccc986-9ebb-4aad-9594-01cfd8095575]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:12:08 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 00:12:08 user nova-compute[75165]:  {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:12:08 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b -p 172.16.0.220:3260 --interface default --op new {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:12:08 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:12:08 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[31ab8f0c-9cc4-48c8-b62c-781c9652d3f2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b] added\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:12:08 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b] added
Oct 26 00:12:08 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:12:08 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:12:08 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:12:08 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ee23f7a-d04a-45cf-b7ae-3115323bfad4]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:12:08 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:12:08 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:12:08 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:12:08 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[098d7a31-208b-4e57-a6ce-b06482a12d5f]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:12:08 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:12:08 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AokCQquF {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:12:08 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AokCQquF" returned: 0 in 0.018s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:12:08 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[64c64b69-c32e-4765-8b4d-f5aba69208ac]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:12:08 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AokCQquF'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:12:08 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:12:08 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:12:08 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[d07d9435-fadb-4f6e-bcd5-0f6099b1a9c1]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:12:08 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:12:08 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:12:08 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:12:08 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[334b18f5-92d9-44c9-adf7-33bc4f9c91e7]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3664944a-e477-4f40-9b8f-2dce50a14ea8 (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:12:08 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792 (non-flash)
Oct 26 00:12:08 user nova-compute[75165]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3664944a-e477-4f40-9b8f-2dce50a14ea8 (non-flash)
Oct 26 00:12:08 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:12:08 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792 (non-flash)
Oct 26 00:12:08 user nova-compute[75165]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3664944a-e477-4f40-9b8f-2dce50a14ea8 (non-flash)
Oct 26 00:12:08 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:12:08 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b -p 172.16.0.220:3260 --login {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:12:08 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:12:08 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[68a5183b-c256-448a-ae15-e26e2418a0b1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:12:08 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b, portal: 172.16.0.220,3260]
Oct 26 00:12:08 user nova-compute[75165]: Login to [iface: default, target: iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b, portal: 172.16.0.220,3260] successful.
Oct 26 00:12:08 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:12:08 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:12:08 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:12:08 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab9ed418-c884-493b-9688-e4a37b33879f]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:12:08 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:12:08 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:12:08 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:12:08 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fbd13a8-4cc4-4ab6-873b-5b93a959e9f9]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3664944a-e477-4f40-9b8f-2dce50a14ea8 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:12:08 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792 (non-flash)
Oct 26 00:12:08 user nova-compute[75165]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3664944a-e477-4f40-9b8f-2dce50a14ea8 (non-flash)
Oct 26 00:12:08 user nova-compute[75165]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b (non-flash)
Oct 26 00:12:08 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:12:08 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792 (non-flash)
Oct 26 00:12:08 user nova-compute[75165]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3664944a-e477-4f40-9b8f-2dce50a14ea8 (non-flash)
Oct 26 00:12:08 user nova-compute[75165]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b (non-flash)
Oct 26 00:12:08 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:12:08 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.305s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:12:08 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Connected to 172.16.0.220:3260 {{(pid=75165) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 00:12:08 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] HCTL ('35', '-', '-', 0) found on session 14 with lun 0 {{(pid=75165) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 00:12:08 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75165) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 00:12:08 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:12:08 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:12:08 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[daa75392-99cb-4d05-9c3b-f9bfbb3429aa]: (4, ('- - 0', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:12:08 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Searching for a device in session 14 and hctl ['35', '*', '*', 0] yield: None {{(pid=75165) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 00:12:09 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Searching for a device in session 14 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75165) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 00:12:09 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AokCQquF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75165) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 00:12:09 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.339s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:12:09 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] <== connect_volume: return (1340ms) {'type': 'block', 'scsi_wwn': '26462656239316661', 'path': '/dev/sdd'} {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:12:09 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26462656239316661', 'path': '/dev/sdd'} {{(pid=75165) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 00:12:09 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:07:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1649801525',display_name='tempest-ServerActionsTestOtherB-server-1649801525',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1649801525',id=7,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOvLHGJ3GKBbD7yL0+CRyOJiq2ETP4pGNCe7wwUyptp7nQivcPunaHj7Jl8TaU2mAtfcWQAgpHGkK+GRkPrduKn69eOts5d8qkM1kDwYiMG7whEGtVeGR66PH/dfoMGjVA==',key_name='tempest-keypair-513358976',keypairs=<?>,launch_index=0,launched_at=2023-10-26T00:07:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0db2c49ee28f4b7b9fa990faddb9d3a9',ramdisk_id='',reservation_id='r-tna5v2cw',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-238342146',owner_user_name='tempest-ServerActionsTestOtherB-238342146-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T00:11:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43f095bccf684d5a84b874439f2c58e0',uuid=3b153af2-c93b-47d2-ae8c-76cfd44e384c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "874a1698-c52c-444c-bed5-52633dbaeead", "address": "fa:16:3e:75:45:79", "network": {"id": "30951418-d830-4042-9143-c736802150e9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-167387787-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-167387787-network", "vif_mac": "fa:16:3e:75:45:79"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0db2c49ee28f4b7b9fa990faddb9d3a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap874a1698-c5", "ovs_interfaceid": "874a1698-c52c-444c-bed5-52633dbaeead", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75165) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 00:12:09 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Converting VIF {"id": "874a1698-c52c-444c-bed5-52633dbaeead", "address": "fa:16:3e:75:45:79", "network": {"id": "30951418-d830-4042-9143-c736802150e9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-167387787-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-167387787-network", "vif_mac": "fa:16:3e:75:45:79"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0db2c49ee28f4b7b9fa990faddb9d3a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap874a1698-c5", "ovs_interfaceid": "874a1698-c52c-444c-bed5-52633dbaeead", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:12:09 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:45:79,bridge_name='br-int',has_traffic_filtering=True,id=874a1698-c52c-444c-bed5-52633dbaeead,network=Network(30951418-d830-4042-9143-c736802150e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap874a1698-c5') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:12:09 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] End _get_guest_xml xml=<domain type="kvm">
Oct 26 00:12:09 user nova-compute[75165]:   <uuid>3b153af2-c93b-47d2-ae8c-76cfd44e384c</uuid>
Oct 26 00:12:09 user nova-compute[75165]:   <name>instance-00000007</name>
Oct 26 00:12:09 user nova-compute[75165]:   <memory>2097152</memory>
Oct 26 00:12:09 user nova-compute[75165]:   <vcpu>1</vcpu>
Oct 26 00:12:09 user nova-compute[75165]:   <metadata>
Oct 26 00:12:09 user nova-compute[75165]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 00:12:09 user nova-compute[75165]:       <nova:package version="0.0.0"/>
Oct 26 00:12:09 user nova-compute[75165]:       <nova:name>tempest-ServerActionsTestOtherB-server-1649801525</nova:name>
Oct 26 00:12:09 user nova-compute[75165]:       <nova:creationTime>2023-10-26 00:12:08</nova:creationTime>
Oct 26 00:12:09 user nova-compute[75165]:       <nova:flavor name="m1.small">
Oct 26 00:12:09 user nova-compute[75165]:         <nova:memory>2048</nova:memory>
Oct 26 00:12:09 user nova-compute[75165]:         <nova:disk>20</nova:disk>
Oct 26 00:12:09 user nova-compute[75165]:         <nova:swap>0</nova:swap>
Oct 26 00:12:09 user nova-compute[75165]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 00:12:09 user nova-compute[75165]:         <nova:vcpus>1</nova:vcpus>
Oct 26 00:12:09 user nova-compute[75165]:       </nova:flavor>
Oct 26 00:12:09 user nova-compute[75165]:       <nova:owner>
Oct 26 00:12:09 user nova-compute[75165]:         <nova:user uuid="43f095bccf684d5a84b874439f2c58e0">tempest-ServerActionsTestOtherB-238342146-project-member</nova:user>
Oct 26 00:12:09 user nova-compute[75165]:         <nova:project uuid="0db2c49ee28f4b7b9fa990faddb9d3a9">tempest-ServerActionsTestOtherB-238342146</nova:project>
Oct 26 00:12:09 user nova-compute[75165]:       </nova:owner>
Oct 26 00:12:09 user nova-compute[75165]:       <nova:root type="image" uuid="bff0d8a1-739e-4c4d-9efa-b73ba7b76d01"/>
Oct 26 00:12:09 user nova-compute[75165]:       <nova:ports>
Oct 26 00:12:09 user nova-compute[75165]:         <nova:port uuid="874a1698-c52c-444c-bed5-52633dbaeead">
Oct 26 00:12:09 user nova-compute[75165]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 26 00:12:09 user nova-compute[75165]:         </nova:port>
Oct 26 00:12:09 user nova-compute[75165]:       </nova:ports>
Oct 26 00:12:09 user nova-compute[75165]:     </nova:instance>
Oct 26 00:12:09 user nova-compute[75165]:   </metadata>
Oct 26 00:12:09 user nova-compute[75165]:   <sysinfo type="smbios">
Oct 26 00:12:09 user nova-compute[75165]:     <system>
Oct 26 00:12:09 user nova-compute[75165]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 00:12:09 user nova-compute[75165]:       <entry name="product">OpenStack Nova</entry>
Oct 26 00:12:09 user nova-compute[75165]:       <entry name="version">0.0.0</entry>
Oct 26 00:12:09 user nova-compute[75165]:       <entry name="serial">3b153af2-c93b-47d2-ae8c-76cfd44e384c</entry>
Oct 26 00:12:09 user nova-compute[75165]:       <entry name="uuid">3b153af2-c93b-47d2-ae8c-76cfd44e384c</entry>
Oct 26 00:12:09 user nova-compute[75165]:       <entry name="family">Virtual Machine</entry>
Oct 26 00:12:09 user nova-compute[75165]:     </system>
Oct 26 00:12:09 user nova-compute[75165]:   </sysinfo>
Oct 26 00:12:09 user nova-compute[75165]:   <os>
Oct 26 00:12:09 user nova-compute[75165]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 00:12:09 user nova-compute[75165]:     <boot dev="hd"/>
Oct 26 00:12:09 user nova-compute[75165]:     <smbios mode="sysinfo"/>
Oct 26 00:12:09 user nova-compute[75165]:   </os>
Oct 26 00:12:09 user nova-compute[75165]:   <features>
Oct 26 00:12:09 user nova-compute[75165]:     <acpi/>
Oct 26 00:12:09 user nova-compute[75165]:     <apic/>
Oct 26 00:12:09 user nova-compute[75165]:     <vmcoreinfo/>
Oct 26 00:12:09 user nova-compute[75165]:   </features>
Oct 26 00:12:09 user nova-compute[75165]:   <clock offset="utc">
Oct 26 00:12:09 user nova-compute[75165]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 00:12:09 user nova-compute[75165]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 00:12:09 user nova-compute[75165]:     <timer name="hpet" present="no"/>
Oct 26 00:12:09 user nova-compute[75165]:   </clock>
Oct 26 00:12:09 user nova-compute[75165]:   <cpu mode="custom" match="exact">
Oct 26 00:12:09 user nova-compute[75165]:     <model>Nehalem</model>
Oct 26 00:12:09 user nova-compute[75165]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 00:12:09 user nova-compute[75165]:   </cpu>
Oct 26 00:12:09 user nova-compute[75165]:   <devices>
Oct 26 00:12:09 user nova-compute[75165]:     <disk type="file" device="disk">
Oct 26 00:12:09 user nova-compute[75165]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 00:12:09 user nova-compute[75165]:       <source file="/opt/stack/data/nova/instances/3b153af2-c93b-47d2-ae8c-76cfd44e384c/disk"/>
Oct 26 00:12:09 user nova-compute[75165]:       <target dev="vda" bus="virtio"/>
Oct 26 00:12:09 user nova-compute[75165]:     </disk>
Oct 26 00:12:09 user nova-compute[75165]:     <disk type="block" device="disk">
Oct 26 00:12:09 user nova-compute[75165]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 00:12:09 user nova-compute[75165]:       <source dev="/dev/sdd"/>
Oct 26 00:12:09 user nova-compute[75165]:       <target dev="vdb" bus="virtio"/>
Oct 26 00:12:09 user nova-compute[75165]:       <serial>bdb81c18-9a59-4d59-861d-f713e876159b</serial>
Oct 26 00:12:09 user nova-compute[75165]:     </disk>
Oct 26 00:12:09 user nova-compute[75165]:     <interface type="ethernet">
Oct 26 00:12:09 user nova-compute[75165]:       <mac address="fa:16:3e:75:45:79"/>
Oct 26 00:12:09 user nova-compute[75165]:       <model type="virtio"/>
Oct 26 00:12:09 user nova-compute[75165]:       <mtu size="1442"/>
Oct 26 00:12:09 user nova-compute[75165]:       <target dev="tap874a1698-c5"/>
Oct 26 00:12:09 user nova-compute[75165]:     </interface>
Oct 26 00:12:09 user nova-compute[75165]:     <serial type="pty">
Oct 26 00:12:09 user nova-compute[75165]:       <log file="/opt/stack/data/nova/instances/3b153af2-c93b-47d2-ae8c-76cfd44e384c/console.log" append="off"/>
Oct 26 00:12:09 user nova-compute[75165]:     </serial>
Oct 26 00:12:09 user nova-compute[75165]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 00:12:09 user nova-compute[75165]:     <video>
Oct 26 00:12:09 user nova-compute[75165]:       <model type="virtio"/>
Oct 26 00:12:09 user nova-compute[75165]:     </video>
Oct 26 00:12:09 user nova-compute[75165]:     <rng model="virtio">
Oct 26 00:12:09 user nova-compute[75165]:       <backend model="random">/dev/urandom</backend>
Oct 26 00:12:09 user nova-compute[75165]:     </rng>
Oct 26 00:12:09 user nova-compute[75165]:     <controller type="usb" index="0" model="none"/>
Oct 26 00:12:09 user nova-compute[75165]:     <memballoon model="virtio">
Oct 26 00:12:09 user nova-compute[75165]:       <stats period="10"/>
Oct 26 00:12:09 user nova-compute[75165]:     </memballoon>
Oct 26 00:12:09 user nova-compute[75165]:   </devices>
Oct 26 00:12:09 user nova-compute[75165]: </domain>
Oct 26 00:12:09 user nova-compute[75165]:  {{(pid=75165) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 00:12:09 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:07:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1649801525',display_name='tempest-ServerActionsTestOtherB-server-1649801525',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1649801525',id=7,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOvLHGJ3GKBbD7yL0+CRyOJiq2ETP4pGNCe7wwUyptp7nQivcPunaHj7Jl8TaU2mAtfcWQAgpHGkK+GRkPrduKn69eOts5d8qkM1kDwYiMG7whEGtVeGR66PH/dfoMGjVA==',key_name='tempest-keypair-513358976',keypairs=<?>,launch_index=0,launched_at=2023-10-26T00:07:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0db2c49ee28f4b7b9fa990faddb9d3a9',ramdisk_id='',reservation_id='r-tna5v2cw',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-238342146',owner_user_name='tempest-ServerActionsTestOtherB-238342146-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T00:11:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43f095bccf684d5a84b874439f2c58e0',uuid=3b153af2-c93b-47d2-ae8c-76cfd44e384c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "874a1698-c52c-444c-bed5-52633dbaeead", "address": "fa:16:3e:75:45:79", "network": {"id": "30951418-d830-4042-9143-c736802150e9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-167387787-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-167387787-network", "vif_mac": "fa:16:3e:75:45:79"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0db2c49ee28f4b7b9fa990faddb9d3a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap874a1698-c5", "ovs_interfaceid": "874a1698-c52c-444c-bed5-52633dbaeead", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 00:12:09 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Converting VIF {"id": "874a1698-c52c-444c-bed5-52633dbaeead", "address": "fa:16:3e:75:45:79", "network": {"id": "30951418-d830-4042-9143-c736802150e9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-167387787-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-167387787-network", "vif_mac": "fa:16:3e:75:45:79"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0db2c49ee28f4b7b9fa990faddb9d3a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap874a1698-c5", "ovs_interfaceid": "874a1698-c52c-444c-bed5-52633dbaeead", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:12:09 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:45:79,bridge_name='br-int',has_traffic_filtering=True,id=874a1698-c52c-444c-bed5-52633dbaeead,network=Network(30951418-d830-4042-9143-c736802150e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap874a1698-c5') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:12:09 user nova-compute[75165]: DEBUG os_vif [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:45:79,bridge_name='br-int',has_traffic_filtering=True,id=874a1698-c52c-444c-bed5-52633dbaeead,network=Network(30951418-d830-4042-9143-c736802150e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap874a1698-c5') {{(pid=75165) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 00:12:09 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:12:09 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:12:09 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 00:12:09 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:12:09 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4fd37b35-3e3c-57c4-8962-2fc6df59ac1d', '_type': 'linux-noop'}}, row=False) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:12:09 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:12:09 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:12:09 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:12:09 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap874a1698-c5, may_exist=True, interface_attrs={}) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:12:09 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap874a1698-c5, col_values=(('qos', UUID('61849163-96e9-4304-a263-fe02cec74289')),), if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:12:09 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap874a1698-c5, col_values=(('external_ids', {'iface-id': '874a1698-c52c-444c-bed5-52633dbaeead', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:75:45:79', 'vm-uuid': '3b153af2-c93b-47d2-ae8c-76cfd44e384c'}),), if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:12:09 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:12:09 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:12:09 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:12:09 user nova-compute[75165]: INFO os_vif [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:45:79,bridge_name='br-int',has_traffic_filtering=True,id=874a1698-c52c-444c-bed5-52633dbaeead,network=Network(30951418-d830-4042-9143-c736802150e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap874a1698-c5')
Oct 26 00:12:09 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] No BDM found with device name vda, not building metadata. {{(pid=75165) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 00:12:09 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75165) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 00:12:09 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] No VIF found with MAC fa:16:3e:75:45:79, not building metadata {{(pid=75165) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 00:12:10 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:12:11 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-391f5590-f135-42a7-a7d6-5cd64c833804 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Acquiring lock "3150d249-37a2-49c6-837a-3828480fa2b4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:12:11 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-391f5590-f135-42a7-a7d6-5cd64c833804 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Lock "3150d249-37a2-49c6-837a-3828480fa2b4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:12:11 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:12:11 user nova-compute[75165]: DEBUG nova.compute.manager [None req-391f5590-f135-42a7-a7d6-5cd64c833804 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] [instance: 3150d249-37a2-49c6-837a-3828480fa2b4] Starting instance... {{(pid=75165) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 00:12:11 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:12:11 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:12:11 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-391f5590-f135-42a7-a7d6-5cd64c833804 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:12:11 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-391f5590-f135-42a7-a7d6-5cd64c833804 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:12:11 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-391f5590-f135-42a7-a7d6-5cd64c833804 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75165) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 00:12:11 user nova-compute[75165]: INFO nova.compute.claims [None req-391f5590-f135-42a7-a7d6-5cd64c833804 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] [instance: 3150d249-37a2-49c6-837a-3828480fa2b4] Claim successful on node user
Oct 26 00:12:12 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-391f5590-f135-42a7-a7d6-5cd64c833804 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:12:12 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:12:12 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:12:12 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-391f5590-f135-42a7-a7d6-5cd64c833804 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:12:12 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:12:12 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-391f5590-f135-42a7-a7d6-5cd64c833804 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.825s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:12:12 user nova-compute[75165]: DEBUG nova.compute.manager [None req-391f5590-f135-42a7-a7d6-5cd64c833804 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] [instance: 3150d249-37a2-49c6-837a-3828480fa2b4] Start building networks asynchronously for instance. {{(pid=75165) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 00:12:12 user nova-compute[75165]: DEBUG nova.compute.manager [req-7aee8e51-ccfb-4ee0-a6c9-9126e0f38abb req-f0dcf301-78a9-49b3-9eca-3598ae6f4e35 service nova] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] Received event network-vif-plugged-874a1698-c52c-444c-bed5-52633dbaeead {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:12:12 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-7aee8e51-ccfb-4ee0-a6c9-9126e0f38abb req-f0dcf301-78a9-49b3-9eca-3598ae6f4e35 service nova] Acquiring lock "3b153af2-c93b-47d2-ae8c-76cfd44e384c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:12:12 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-7aee8e51-ccfb-4ee0-a6c9-9126e0f38abb req-f0dcf301-78a9-49b3-9eca-3598ae6f4e35 service nova] Lock "3b153af2-c93b-47d2-ae8c-76cfd44e384c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:12:12 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-7aee8e51-ccfb-4ee0-a6c9-9126e0f38abb req-f0dcf301-78a9-49b3-9eca-3598ae6f4e35 service nova] Lock "3b153af2-c93b-47d2-ae8c-76cfd44e384c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:12:12 user nova-compute[75165]: DEBUG nova.compute.manager [req-7aee8e51-ccfb-4ee0-a6c9-9126e0f38abb req-f0dcf301-78a9-49b3-9eca-3598ae6f4e35 service nova] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] No waiting events found dispatching network-vif-plugged-874a1698-c52c-444c-bed5-52633dbaeead {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:12:12 user nova-compute[75165]: WARNING nova.compute.manager [req-7aee8e51-ccfb-4ee0-a6c9-9126e0f38abb req-f0dcf301-78a9-49b3-9eca-3598ae6f4e35 service nova] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] Received unexpected event network-vif-plugged-874a1698-c52c-444c-bed5-52633dbaeead for instance with vm_state active and task_state resize_finish.
Oct 26 00:12:12 user nova-compute[75165]: DEBUG nova.compute.manager [None req-391f5590-f135-42a7-a7d6-5cd64c833804 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] [instance: 3150d249-37a2-49c6-837a-3828480fa2b4] Allocating IP information in the background. {{(pid=75165) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 00:12:12 user nova-compute[75165]: DEBUG nova.network.neutron [None req-391f5590-f135-42a7-a7d6-5cd64c833804 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] [instance: 3150d249-37a2-49c6-837a-3828480fa2b4] allocate_for_instance() {{(pid=75165) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 00:12:12 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-391f5590-f135-42a7-a7d6-5cd64c833804 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] [instance: 3150d249-37a2-49c6-837a-3828480fa2b4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 00:12:12 user nova-compute[75165]: DEBUG nova.compute.manager [None req-391f5590-f135-42a7-a7d6-5cd64c833804 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] [instance: 3150d249-37a2-49c6-837a-3828480fa2b4] Start building block device mappings for instance. {{(pid=75165) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 00:12:12 user nova-compute[75165]: DEBUG nova.policy [None req-391f5590-f135-42a7-a7d6-5cd64c833804 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2c153a25012b42d1869aacee733c754b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7043dc6e5575484b8747c13d3928f717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75165) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 00:12:12 user nova-compute[75165]: DEBUG nova.compute.manager [None req-391f5590-f135-42a7-a7d6-5cd64c833804 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] [instance: 3150d249-37a2-49c6-837a-3828480fa2b4] Start spawning the instance on the hypervisor. {{(pid=75165) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 00:12:12 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-391f5590-f135-42a7-a7d6-5cd64c833804 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] [instance: 3150d249-37a2-49c6-837a-3828480fa2b4] Creating instance directory {{(pid=75165) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 00:12:12 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-391f5590-f135-42a7-a7d6-5cd64c833804 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] [instance: 3150d249-37a2-49c6-837a-3828480fa2b4] Creating image(s)
Oct 26 00:12:12 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-391f5590-f135-42a7-a7d6-5cd64c833804 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Acquiring lock "/opt/stack/data/nova/instances/3150d249-37a2-49c6-837a-3828480fa2b4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:12:12 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-391f5590-f135-42a7-a7d6-5cd64c833804 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Lock "/opt/stack/data/nova/instances/3150d249-37a2-49c6-837a-3828480fa2b4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:12:12 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-391f5590-f135-42a7-a7d6-5cd64c833804 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Lock "/opt/stack/data/nova/instances/3150d249-37a2-49c6-837a-3828480fa2b4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:12:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-391f5590-f135-42a7-a7d6-5cd64c833804 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:12:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-391f5590-f135-42a7-a7d6-5cd64c833804 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json" returned: 0 in 0.176s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:12:12 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-391f5590-f135-42a7-a7d6-5cd64c833804 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Acquiring lock "7d3243421cf3fdc288b758f687a93103b7b95466" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:12:12 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-391f5590-f135-42a7-a7d6-5cd64c833804 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Lock "7d3243421cf3fdc288b758f687a93103b7b95466" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:12:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-391f5590-f135-42a7-a7d6-5cd64c833804 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:12:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-391f5590-f135-42a7-a7d6-5cd64c833804 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json" returned: 0 in 0.182s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:12:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-391f5590-f135-42a7-a7d6-5cd64c833804 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466,backing_fmt=raw /opt/stack/data/nova/instances/3150d249-37a2-49c6-837a-3828480fa2b4/disk 1073741824 {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:12:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-391f5590-f135-42a7-a7d6-5cd64c833804 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466,backing_fmt=raw /opt/stack/data/nova/instances/3150d249-37a2-49c6-837a-3828480fa2b4/disk 1073741824" returned: 0 in 0.056s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:12:12 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-391f5590-f135-42a7-a7d6-5cd64c833804 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Lock "7d3243421cf3fdc288b758f687a93103b7b95466" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:12:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-391f5590-f135-42a7-a7d6-5cd64c833804 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:12:13 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-391f5590-f135-42a7-a7d6-5cd64c833804 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json" returned: 0 in 0.189s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:12:13 user nova-compute[75165]: DEBUG nova.virt.disk.api [None req-391f5590-f135-42a7-a7d6-5cd64c833804 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3150d249-37a2-49c6-837a-3828480fa2b4/disk. size=1073741824 {{(pid=75165) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 00:12:13 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-391f5590-f135-42a7-a7d6-5cd64c833804 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3150d249-37a2-49c6-837a-3828480fa2b4/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:12:13 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-391f5590-f135-42a7-a7d6-5cd64c833804 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3150d249-37a2-49c6-837a-3828480fa2b4/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:12:13 user nova-compute[75165]: DEBUG nova.virt.disk.api [None req-391f5590-f135-42a7-a7d6-5cd64c833804 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Cannot resize image /opt/stack/data/nova/instances/3150d249-37a2-49c6-837a-3828480fa2b4/disk to a smaller size. {{(pid=75165) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 00:12:13 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-391f5590-f135-42a7-a7d6-5cd64c833804 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] [instance: 3150d249-37a2-49c6-837a-3828480fa2b4] Created local disks {{(pid=75165) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 00:12:13 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-391f5590-f135-42a7-a7d6-5cd64c833804 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] [instance: 3150d249-37a2-49c6-837a-3828480fa2b4] Ensure instance console log exists: /opt/stack/data/nova/instances/3150d249-37a2-49c6-837a-3828480fa2b4/console.log {{(pid=75165) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 00:12:13 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-391f5590-f135-42a7-a7d6-5cd64c833804 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:12:13 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-391f5590-f135-42a7-a7d6-5cd64c833804 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:12:13 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-391f5590-f135-42a7-a7d6-5cd64c833804 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:12:13 user nova-compute[75165]: DEBUG nova.network.neutron [None req-391f5590-f135-42a7-a7d6-5cd64c833804 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] [instance: 3150d249-37a2-49c6-837a-3828480fa2b4] Successfully created port: e959f8cc-deda-4ee5-8f46-7d5fbcb13a3b {{(pid=75165) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 00:12:13 user nova-compute[75165]: DEBUG nova.compute.manager [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] Instance event wait completed in 0 seconds for  {{(pid=75165) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 00:12:13 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] Instance running successfully.
Oct 26 00:12:13 user nova-compute[75165]: DEBUG nova.virt.libvirt.guest [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] Failed to set time: agent not configured {{(pid=75165) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Oct 26 00:12:13 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-7090af6a-bcf1-477b-9cb1-6b904853d191 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] finish_migration finished successfully. {{(pid=75165) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Oct 26 00:12:14 user nova-compute[75165]: DEBUG nova.network.neutron [None req-391f5590-f135-42a7-a7d6-5cd64c833804 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] [instance: 3150d249-37a2-49c6-837a-3828480fa2b4] Successfully updated port: e959f8cc-deda-4ee5-8f46-7d5fbcb13a3b {{(pid=75165) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 00:12:14 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-391f5590-f135-42a7-a7d6-5cd64c833804 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Acquiring lock "refresh_cache-3150d249-37a2-49c6-837a-3828480fa2b4" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:12:14 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-391f5590-f135-42a7-a7d6-5cd64c833804 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Acquired lock "refresh_cache-3150d249-37a2-49c6-837a-3828480fa2b4" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:12:14 user nova-compute[75165]: DEBUG nova.network.neutron [None req-391f5590-f135-42a7-a7d6-5cd64c833804 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] [instance: 3150d249-37a2-49c6-837a-3828480fa2b4] Building network info cache for instance {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 00:12:14 user nova-compute[75165]: DEBUG nova.network.neutron [None req-391f5590-f135-42a7-a7d6-5cd64c833804 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] [instance: 3150d249-37a2-49c6-837a-3828480fa2b4] Instance cache missing network info. {{(pid=75165) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 00:12:14 user nova-compute[75165]: DEBUG nova.compute.manager [req-588248dc-7e9c-4fe6-a5d9-d84cf6abef3f req-1ee7f41a-28b4-45b8-a3d2-e708d90ed6c7 service nova] [instance: 3150d249-37a2-49c6-837a-3828480fa2b4] Received event network-changed-e959f8cc-deda-4ee5-8f46-7d5fbcb13a3b {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:12:14 user nova-compute[75165]: DEBUG nova.compute.manager [req-588248dc-7e9c-4fe6-a5d9-d84cf6abef3f req-1ee7f41a-28b4-45b8-a3d2-e708d90ed6c7 service nova] [instance: 3150d249-37a2-49c6-837a-3828480fa2b4] Refreshing instance network info cache due to event network-changed-e959f8cc-deda-4ee5-8f46-7d5fbcb13a3b. {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 00:12:14 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-588248dc-7e9c-4fe6-a5d9-d84cf6abef3f req-1ee7f41a-28b4-45b8-a3d2-e708d90ed6c7 service nova] Acquiring lock "refresh_cache-3150d249-37a2-49c6-837a-3828480fa2b4" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:12:14 user nova-compute[75165]: DEBUG nova.compute.manager [req-608217d0-4ee9-4f80-b027-c85087c3cc58 req-7f188ecc-9463-4480-8b86-91454bfb2ea7 service nova] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] Received event network-vif-plugged-874a1698-c52c-444c-bed5-52633dbaeead {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:12:14 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-608217d0-4ee9-4f80-b027-c85087c3cc58 req-7f188ecc-9463-4480-8b86-91454bfb2ea7 service nova] Acquiring lock "3b153af2-c93b-47d2-ae8c-76cfd44e384c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:12:14 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-608217d0-4ee9-4f80-b027-c85087c3cc58 req-7f188ecc-9463-4480-8b86-91454bfb2ea7 service nova] Lock "3b153af2-c93b-47d2-ae8c-76cfd44e384c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:12:14 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-608217d0-4ee9-4f80-b027-c85087c3cc58 req-7f188ecc-9463-4480-8b86-91454bfb2ea7 service nova] Lock "3b153af2-c93b-47d2-ae8c-76cfd44e384c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:12:14 user nova-compute[75165]: DEBUG nova.compute.manager [req-608217d0-4ee9-4f80-b027-c85087c3cc58 req-7f188ecc-9463-4480-8b86-91454bfb2ea7 service nova] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] No waiting events found dispatching network-vif-plugged-874a1698-c52c-444c-bed5-52633dbaeead {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:12:14 user nova-compute[75165]: WARNING nova.compute.manager [req-608217d0-4ee9-4f80-b027-c85087c3cc58 req-7f188ecc-9463-4480-8b86-91454bfb2ea7 service nova] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] Received unexpected event network-vif-plugged-874a1698-c52c-444c-bed5-52633dbaeead for instance with vm_state resized and task_state None.
Oct 26 00:12:14 user nova-compute[75165]: DEBUG nova.network.neutron [None req-391f5590-f135-42a7-a7d6-5cd64c833804 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] [instance: 3150d249-37a2-49c6-837a-3828480fa2b4] Updating instance_info_cache with network_info: [{"id": "e959f8cc-deda-4ee5-8f46-7d5fbcb13a3b", "address": "fa:16:3e:45:96:61", "network": {"id": "158a2f37-110c-4873-af74-f8c483280159", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1353815059-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7043dc6e5575484b8747c13d3928f717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape959f8cc-de", "ovs_interfaceid": "e959f8cc-deda-4ee5-8f46-7d5fbcb13a3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:12:14 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-391f5590-f135-42a7-a7d6-5cd64c833804 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Releasing lock "refresh_cache-3150d249-37a2-49c6-837a-3828480fa2b4" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:12:14 user nova-compute[75165]: DEBUG nova.compute.manager [None req-391f5590-f135-42a7-a7d6-5cd64c833804 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] [instance: 3150d249-37a2-49c6-837a-3828480fa2b4] Instance network_info: |[{"id": "e959f8cc-deda-4ee5-8f46-7d5fbcb13a3b", "address": "fa:16:3e:45:96:61", "network": {"id": "158a2f37-110c-4873-af74-f8c483280159", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1353815059-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7043dc6e5575484b8747c13d3928f717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape959f8cc-de", "ovs_interfaceid": "e959f8cc-deda-4ee5-8f46-7d5fbcb13a3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75165) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 00:12:14 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-588248dc-7e9c-4fe6-a5d9-d84cf6abef3f req-1ee7f41a-28b4-45b8-a3d2-e708d90ed6c7 service nova] Acquired lock "refresh_cache-3150d249-37a2-49c6-837a-3828480fa2b4" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:12:14 user nova-compute[75165]: DEBUG nova.network.neutron [req-588248dc-7e9c-4fe6-a5d9-d84cf6abef3f req-1ee7f41a-28b4-45b8-a3d2-e708d90ed6c7 service nova] [instance: 3150d249-37a2-49c6-837a-3828480fa2b4] Refreshing network info cache for port e959f8cc-deda-4ee5-8f46-7d5fbcb13a3b {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 00:12:14 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-391f5590-f135-42a7-a7d6-5cd64c833804 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] [instance: 3150d249-37a2-49c6-837a-3828480fa2b4] Start _get_guest_xml network_info=[{"id": "e959f8cc-deda-4ee5-8f46-7d5fbcb13a3b", "address": "fa:16:3e:45:96:61", "network": {"id": "158a2f37-110c-4873-af74-f8c483280159", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1353815059-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7043dc6e5575484b8747c13d3928f717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape959f8cc-de", "ovs_interfaceid": "e959f8cc-deda-4ee5-8f46-7d5fbcb13a3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T00:03:24Z,direct_url=<?>,disk_format='qcow2',id=bff0d8a1-739e-4c4d-9efa-b73ba7b76d01,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e56bbf444fd34c348475c73673611447',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T00:03:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'size': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': 'bff0d8a1-739e-4c4d-9efa-b73ba7b76d01'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75165) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 00:12:14 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-391f5590-f135-42a7-a7d6-5cd64c833804 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:12:14 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-391f5590-f135-42a7-a7d6-5cd64c833804 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:12:14 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-391f5590-f135-42a7-a7d6-5cd64c833804 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75165) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 00:12:14 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-391f5590-f135-42a7-a7d6-5cd64c833804 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] CPU controller missing on host. {{(pid=75165) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 00:12:14 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-391f5590-f135-42a7-a7d6-5cd64c833804 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75165) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 00:12:14 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-391f5590-f135-42a7-a7d6-5cd64c833804 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] CPU controller found on host. {{(pid=75165) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 00:12:14 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-391f5590-f135-42a7-a7d6-5cd64c833804 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75165) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 00:12:14 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-391f5590-f135-42a7-a7d6-5cd64c833804 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T00:03:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T00:03:24Z,direct_url=<?>,disk_format='qcow2',id=bff0d8a1-739e-4c4d-9efa-b73ba7b76d01,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e56bbf444fd34c348475c73673611447',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T00:03:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 00:12:14 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-391f5590-f135-42a7-a7d6-5cd64c833804 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Flavor limits 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 00:12:14 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-391f5590-f135-42a7-a7d6-5cd64c833804 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Image limits 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 00:12:14 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-391f5590-f135-42a7-a7d6-5cd64c833804 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Flavor pref 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 00:12:14 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-391f5590-f135-42a7-a7d6-5cd64c833804 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Image pref 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 00:12:14 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-391f5590-f135-42a7-a7d6-5cd64c833804 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 00:12:14 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-391f5590-f135-42a7-a7d6-5cd64c833804 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 00:12:14 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-391f5590-f135-42a7-a7d6-5cd64c833804 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75165) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 00:12:14 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-391f5590-f135-42a7-a7d6-5cd64c833804 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Got 1 possible topologies {{(pid=75165) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 00:12:14 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-391f5590-f135-42a7-a7d6-5cd64c833804 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 00:12:14 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-391f5590-f135-42a7-a7d6-5cd64c833804 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 00:12:14 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-391f5590-f135-42a7-a7d6-5cd64c833804 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:12:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1958214188',display_name='tempest-VolumesAdminNegativeTest-server-1958214188',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1958214188',id=18,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJDMruTlHBDhYEEOzgW9OeGjwnXh2Go3Ic7gLbOiYZ5vAh8cL2+w7FnxMQJgYsq4iVtA4O+jc7OYn22swhiDZldM7uaDfqBsj/HSjlU3fDrHq4CGcm7dCkbPmKlup8Jx+Q==',key_name='tempest-keypair-324227546',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7043dc6e5575484b8747c13d3928f717',ramdisk_id='',reservation_id='r-vyds5cc6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1115603178',owner_user_name='tempest-VolumesAdminNegativeTest-1115603178-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T00:12:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2c153a25012b42d1869aacee733c754b',uuid=3150d249-37a2-49c6-837a-3828480fa2b4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e959f8cc-deda-4ee5-8f46-7d5fbcb13a3b", "address": "fa:16:3e:45:96:61", "network": {"id": "158a2f37-110c-4873-af74-f8c483280159", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1353815059-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7043dc6e5575484b8747c13d3928f717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape959f8cc-de", "ovs_interfaceid": "e959f8cc-deda-4ee5-8f46-7d5fbcb13a3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75165) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 00:12:14 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-391f5590-f135-42a7-a7d6-5cd64c833804 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Converting VIF {"id": "e959f8cc-deda-4ee5-8f46-7d5fbcb13a3b", "address": "fa:16:3e:45:96:61", "network": {"id": "158a2f37-110c-4873-af74-f8c483280159", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1353815059-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7043dc6e5575484b8747c13d3928f717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape959f8cc-de", "ovs_interfaceid": "e959f8cc-deda-4ee5-8f46-7d5fbcb13a3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:12:14 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-391f5590-f135-42a7-a7d6-5cd64c833804 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:96:61,bridge_name='br-int',has_traffic_filtering=True,id=e959f8cc-deda-4ee5-8f46-7d5fbcb13a3b,network=Network(158a2f37-110c-4873-af74-f8c483280159),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape959f8cc-de') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:12:14 user nova-compute[75165]: DEBUG nova.objects.instance [None req-391f5590-f135-42a7-a7d6-5cd64c833804 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Lazy-loading 'pci_devices' on Instance uuid 3150d249-37a2-49c6-837a-3828480fa2b4 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:12:14 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-391f5590-f135-42a7-a7d6-5cd64c833804 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] [instance: 3150d249-37a2-49c6-837a-3828480fa2b4] End _get_guest_xml xml=<domain type="kvm">
Oct 26 00:12:14 user nova-compute[75165]:   <uuid>3150d249-37a2-49c6-837a-3828480fa2b4</uuid>
Oct 26 00:12:14 user nova-compute[75165]:   <name>instance-00000012</name>
Oct 26 00:12:14 user nova-compute[75165]:   <memory>524288</memory>
Oct 26 00:12:14 user nova-compute[75165]:   <vcpu>1</vcpu>
Oct 26 00:12:14 user nova-compute[75165]:   <metadata>
Oct 26 00:12:14 user nova-compute[75165]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 00:12:14 user nova-compute[75165]:       <nova:package version="0.0.0"/>
Oct 26 00:12:14 user nova-compute[75165]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1958214188</nova:name>
Oct 26 00:12:14 user nova-compute[75165]:       <nova:creationTime>2023-10-26 00:12:14</nova:creationTime>
Oct 26 00:12:14 user nova-compute[75165]:       <nova:flavor name="m1.tiny">
Oct 26 00:12:14 user nova-compute[75165]:         <nova:memory>512</nova:memory>
Oct 26 00:12:14 user nova-compute[75165]:         <nova:disk>1</nova:disk>
Oct 26 00:12:14 user nova-compute[75165]:         <nova:swap>0</nova:swap>
Oct 26 00:12:14 user nova-compute[75165]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 00:12:14 user nova-compute[75165]:         <nova:vcpus>1</nova:vcpus>
Oct 26 00:12:14 user nova-compute[75165]:       </nova:flavor>
Oct 26 00:12:14 user nova-compute[75165]:       <nova:owner>
Oct 26 00:12:14 user nova-compute[75165]:         <nova:user uuid="2c153a25012b42d1869aacee733c754b">tempest-VolumesAdminNegativeTest-1115603178-project-member</nova:user>
Oct 26 00:12:14 user nova-compute[75165]:         <nova:project uuid="7043dc6e5575484b8747c13d3928f717">tempest-VolumesAdminNegativeTest-1115603178</nova:project>
Oct 26 00:12:14 user nova-compute[75165]:       </nova:owner>
Oct 26 00:12:14 user nova-compute[75165]:       <nova:root type="image" uuid="bff0d8a1-739e-4c4d-9efa-b73ba7b76d01"/>
Oct 26 00:12:14 user nova-compute[75165]:       <nova:ports>
Oct 26 00:12:14 user nova-compute[75165]:         <nova:port uuid="e959f8cc-deda-4ee5-8f46-7d5fbcb13a3b">
Oct 26 00:12:14 user nova-compute[75165]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 26 00:12:14 user nova-compute[75165]:         </nova:port>
Oct 26 00:12:14 user nova-compute[75165]:       </nova:ports>
Oct 26 00:12:14 user nova-compute[75165]:     </nova:instance>
Oct 26 00:12:14 user nova-compute[75165]:   </metadata>
Oct 26 00:12:14 user nova-compute[75165]:   <sysinfo type="smbios">
Oct 26 00:12:14 user nova-compute[75165]:     <system>
Oct 26 00:12:14 user nova-compute[75165]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 00:12:14 user nova-compute[75165]:       <entry name="product">OpenStack Nova</entry>
Oct 26 00:12:14 user nova-compute[75165]:       <entry name="version">0.0.0</entry>
Oct 26 00:12:14 user nova-compute[75165]:       <entry name="serial">3150d249-37a2-49c6-837a-3828480fa2b4</entry>
Oct 26 00:12:14 user nova-compute[75165]:       <entry name="uuid">3150d249-37a2-49c6-837a-3828480fa2b4</entry>
Oct 26 00:12:14 user nova-compute[75165]:       <entry name="family">Virtual Machine</entry>
Oct 26 00:12:14 user nova-compute[75165]:     </system>
Oct 26 00:12:14 user nova-compute[75165]:   </sysinfo>
Oct 26 00:12:14 user nova-compute[75165]:   <os>
Oct 26 00:12:14 user nova-compute[75165]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 00:12:14 user nova-compute[75165]:     <boot dev="hd"/>
Oct 26 00:12:14 user nova-compute[75165]:     <smbios mode="sysinfo"/>
Oct 26 00:12:14 user nova-compute[75165]:   </os>
Oct 26 00:12:14 user nova-compute[75165]:   <features>
Oct 26 00:12:14 user nova-compute[75165]:     <acpi/>
Oct 26 00:12:14 user nova-compute[75165]:     <apic/>
Oct 26 00:12:14 user nova-compute[75165]:     <vmcoreinfo/>
Oct 26 00:12:14 user nova-compute[75165]:   </features>
Oct 26 00:12:14 user nova-compute[75165]:   <clock offset="utc">
Oct 26 00:12:14 user nova-compute[75165]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 00:12:14 user nova-compute[75165]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 00:12:14 user nova-compute[75165]:     <timer name="hpet" present="no"/>
Oct 26 00:12:14 user nova-compute[75165]:   </clock>
Oct 26 00:12:14 user nova-compute[75165]:   <cpu mode="custom" match="exact">
Oct 26 00:12:14 user nova-compute[75165]:     <model>Nehalem</model>
Oct 26 00:12:14 user nova-compute[75165]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 00:12:14 user nova-compute[75165]:   </cpu>
Oct 26 00:12:14 user nova-compute[75165]:   <devices>
Oct 26 00:12:14 user nova-compute[75165]:     <disk type="file" device="disk">
Oct 26 00:12:14 user nova-compute[75165]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 00:12:14 user nova-compute[75165]:       <source file="/opt/stack/data/nova/instances/3150d249-37a2-49c6-837a-3828480fa2b4/disk"/>
Oct 26 00:12:14 user nova-compute[75165]:       <target dev="vda" bus="virtio"/>
Oct 26 00:12:14 user nova-compute[75165]:     </disk>
Oct 26 00:12:14 user nova-compute[75165]:     <interface type="ethernet">
Oct 26 00:12:14 user nova-compute[75165]:       <mac address="fa:16:3e:45:96:61"/>
Oct 26 00:12:14 user nova-compute[75165]:       <model type="virtio"/>
Oct 26 00:12:14 user nova-compute[75165]:       <mtu size="1442"/>
Oct 26 00:12:14 user nova-compute[75165]:       <target dev="tape959f8cc-de"/>
Oct 26 00:12:14 user nova-compute[75165]:     </interface>
Oct 26 00:12:14 user nova-compute[75165]:     <serial type="pty">
Oct 26 00:12:14 user nova-compute[75165]:       <log file="/opt/stack/data/nova/instances/3150d249-37a2-49c6-837a-3828480fa2b4/console.log" append="off"/>
Oct 26 00:12:14 user nova-compute[75165]:     </serial>
Oct 26 00:12:14 user nova-compute[75165]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 00:12:14 user nova-compute[75165]:     <video>
Oct 26 00:12:14 user nova-compute[75165]:       <model type="virtio"/>
Oct 26 00:12:14 user nova-compute[75165]:     </video>
Oct 26 00:12:14 user nova-compute[75165]:     <rng model="virtio">
Oct 26 00:12:14 user nova-compute[75165]:       <backend model="random">/dev/urandom</backend>
Oct 26 00:12:14 user nova-compute[75165]:     </rng>
Oct 26 00:12:14 user nova-compute[75165]:     <controller type="usb" index="0" model="none"/>
Oct 26 00:12:14 user nova-compute[75165]:     <memballoon model="virtio">
Oct 26 00:12:14 user nova-compute[75165]:       <stats period="10"/>
Oct 26 00:12:14 user nova-compute[75165]:     </memballoon>
Oct 26 00:12:14 user nova-compute[75165]:   </devices>
Oct 26 00:12:14 user nova-compute[75165]: </domain>
Oct 26 00:12:14 user nova-compute[75165]:  {{(pid=75165) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 00:12:14 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-391f5590-f135-42a7-a7d6-5cd64c833804 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:12:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1958214188',display_name='tempest-VolumesAdminNegativeTest-server-1958214188',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1958214188',id=18,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJDMruTlHBDhYEEOzgW9OeGjwnXh2Go3Ic7gLbOiYZ5vAh8cL2+w7FnxMQJgYsq4iVtA4O+jc7OYn22swhiDZldM7uaDfqBsj/HSjlU3fDrHq4CGcm7dCkbPmKlup8Jx+Q==',key_name='tempest-keypair-324227546',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7043dc6e5575484b8747c13d3928f717',ramdisk_id='',reservation_id='r-vyds5cc6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1115603178',owner_user_name='tempest-VolumesAdminNegativeTest-1115603178-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T00:12:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2c153a25012b42d1869aacee733c754b',uuid=3150d249-37a2-49c6-837a-3828480fa2b4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e959f8cc-deda-4ee5-8f46-7d5fbcb13a3b", "address": "fa:16:3e:45:96:61", "network": {"id": "158a2f37-110c-4873-af74-f8c483280159", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1353815059-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7043dc6e5575484b8747c13d3928f717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape959f8cc-de", "ovs_interfaceid": "e959f8cc-deda-4ee5-8f46-7d5fbcb13a3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 00:12:14 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-391f5590-f135-42a7-a7d6-5cd64c833804 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Converting VIF {"id": "e959f8cc-deda-4ee5-8f46-7d5fbcb13a3b", "address": "fa:16:3e:45:96:61", "network": {"id": "158a2f37-110c-4873-af74-f8c483280159", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1353815059-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7043dc6e5575484b8747c13d3928f717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape959f8cc-de", "ovs_interfaceid": "e959f8cc-deda-4ee5-8f46-7d5fbcb13a3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:12:14 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-391f5590-f135-42a7-a7d6-5cd64c833804 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:96:61,bridge_name='br-int',has_traffic_filtering=True,id=e959f8cc-deda-4ee5-8f46-7d5fbcb13a3b,network=Network(158a2f37-110c-4873-af74-f8c483280159),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape959f8cc-de') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:12:14 user nova-compute[75165]: DEBUG os_vif [None req-391f5590-f135-42a7-a7d6-5cd64c833804 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:96:61,bridge_name='br-int',has_traffic_filtering=True,id=e959f8cc-deda-4ee5-8f46-7d5fbcb13a3b,network=Network(158a2f37-110c-4873-af74-f8c483280159),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape959f8cc-de') {{(pid=75165) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 00:12:14 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:12:14 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:12:14 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 00:12:14 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:12:14 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'df404755-e7a4-54bb-beba-2e1492bfb566', '_type': 'linux-noop'}}, row=False) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:12:14 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:12:14 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:12:14 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:12:14 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape959f8cc-de, may_exist=True, interface_attrs={}) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:12:14 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape959f8cc-de, col_values=(('qos', UUID('14b36445-6237-4e63-8a07-96f540404e50')),), if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:12:14 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape959f8cc-de, col_values=(('external_ids', {'iface-id': 'e959f8cc-deda-4ee5-8f46-7d5fbcb13a3b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:45:96:61', 'vm-uuid': '3150d249-37a2-49c6-837a-3828480fa2b4'}),), if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:12:14 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:12:14 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:12:14 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:12:14 user nova-compute[75165]: INFO os_vif [None req-391f5590-f135-42a7-a7d6-5cd64c833804 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:96:61,bridge_name='br-int',has_traffic_filtering=True,id=e959f8cc-deda-4ee5-8f46-7d5fbcb13a3b,network=Network(158a2f37-110c-4873-af74-f8c483280159),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape959f8cc-de')
Oct 26 00:12:14 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-391f5590-f135-42a7-a7d6-5cd64c833804 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] No BDM found with device name vda, not building metadata. {{(pid=75165) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 00:12:14 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-391f5590-f135-42a7-a7d6-5cd64c833804 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] No VIF found with MAC fa:16:3e:45:96:61, not building metadata {{(pid=75165) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 00:12:14 user nova-compute[75165]: DEBUG nova.network.neutron [req-588248dc-7e9c-4fe6-a5d9-d84cf6abef3f req-1ee7f41a-28b4-45b8-a3d2-e708d90ed6c7 service nova] [instance: 3150d249-37a2-49c6-837a-3828480fa2b4] Updated VIF entry in instance network info cache for port e959f8cc-deda-4ee5-8f46-7d5fbcb13a3b. {{(pid=75165) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 00:12:14 user nova-compute[75165]: DEBUG nova.network.neutron [req-588248dc-7e9c-4fe6-a5d9-d84cf6abef3f req-1ee7f41a-28b4-45b8-a3d2-e708d90ed6c7 service nova] [instance: 3150d249-37a2-49c6-837a-3828480fa2b4] Updating instance_info_cache with network_info: [{"id": "e959f8cc-deda-4ee5-8f46-7d5fbcb13a3b", "address": "fa:16:3e:45:96:61", "network": {"id": "158a2f37-110c-4873-af74-f8c483280159", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1353815059-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7043dc6e5575484b8747c13d3928f717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape959f8cc-de", "ovs_interfaceid": "e959f8cc-deda-4ee5-8f46-7d5fbcb13a3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:12:14 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-588248dc-7e9c-4fe6-a5d9-d84cf6abef3f req-1ee7f41a-28b4-45b8-a3d2-e708d90ed6c7 service nova] Releasing lock "refresh_cache-3150d249-37a2-49c6-837a-3828480fa2b4" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:12:15 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:12:15 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:12:16 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:12:16 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:12:16 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:12:16 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:12:16 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:12:16 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Starting heal instance info cache {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 00:12:16 user nova-compute[75165]: DEBUG nova.compute.manager [req-1e4071df-e510-4d28-9ae0-67ae42526c0b req-7f139bfe-df9b-4643-8f1e-31d596f8aee4 service nova] [instance: 3150d249-37a2-49c6-837a-3828480fa2b4] Received event network-vif-plugged-e959f8cc-deda-4ee5-8f46-7d5fbcb13a3b {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:12:16 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-1e4071df-e510-4d28-9ae0-67ae42526c0b req-7f139bfe-df9b-4643-8f1e-31d596f8aee4 service nova] Acquiring lock "3150d249-37a2-49c6-837a-3828480fa2b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:12:16 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-1e4071df-e510-4d28-9ae0-67ae42526c0b req-7f139bfe-df9b-4643-8f1e-31d596f8aee4 service nova] Lock "3150d249-37a2-49c6-837a-3828480fa2b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:12:16 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-1e4071df-e510-4d28-9ae0-67ae42526c0b req-7f139bfe-df9b-4643-8f1e-31d596f8aee4 service nova] Lock "3150d249-37a2-49c6-837a-3828480fa2b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:12:16 user nova-compute[75165]: DEBUG nova.compute.manager [req-1e4071df-e510-4d28-9ae0-67ae42526c0b req-7f139bfe-df9b-4643-8f1e-31d596f8aee4 service nova] [instance: 3150d249-37a2-49c6-837a-3828480fa2b4] No waiting events found dispatching network-vif-plugged-e959f8cc-deda-4ee5-8f46-7d5fbcb13a3b {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:12:16 user nova-compute[75165]: WARNING nova.compute.manager [req-1e4071df-e510-4d28-9ae0-67ae42526c0b req-7f139bfe-df9b-4643-8f1e-31d596f8aee4 service nova] [instance: 3150d249-37a2-49c6-837a-3828480fa2b4] Received unexpected event network-vif-plugged-e959f8cc-deda-4ee5-8f46-7d5fbcb13a3b for instance with vm_state building and task_state spawning.
Oct 26 00:12:16 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "refresh_cache-26a0b493-bb47-466e-95d5-945fc3849fa5" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:12:16 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquired lock "refresh_cache-26a0b493-bb47-466e-95d5-945fc3849fa5" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:12:16 user nova-compute[75165]: DEBUG nova.network.neutron [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] Forcefully refreshing network info cache for instance {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 00:12:16 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:12:16 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:12:17 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:12:17 user nova-compute[75165]: DEBUG nova.network.neutron [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] Updating instance_info_cache with network_info: [{"id": "1d6d497c-7382-4dff-b136-d1220b05a838", "address": "fa:16:3e:d3:eb:fb", "network": {"id": "08c51c53-4819-493e-b4eb-df5d6024d43d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1633769998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9cbae16d09ed4474bb6653f08165a4e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d6d497c-73", "ovs_interfaceid": "1d6d497c-7382-4dff-b136-d1220b05a838", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:12:17 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Releasing lock "refresh_cache-26a0b493-bb47-466e-95d5-945fc3849fa5" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:12:17 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] Updated the network info_cache for instance {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 00:12:17 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:12:17 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:12:17 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:12:17 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:12:17 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:12:17 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:12:17 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75165) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 00:12:17 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:12:17 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:12:17 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:12:17 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:12:17 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75165) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 00:12:18 user nova-compute[75165]: DEBUG nova.compute.manager [None req-391f5590-f135-42a7-a7d6-5cd64c833804 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] [instance: 3150d249-37a2-49c6-837a-3828480fa2b4] Instance event wait completed in 0 seconds for  {{(pid=75165) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 00:12:18 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-391f5590-f135-42a7-a7d6-5cd64c833804 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] [instance: 3150d249-37a2-49c6-837a-3828480fa2b4] Guest created on hypervisor {{(pid=75165) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 00:12:18 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: 3150d249-37a2-49c6-837a-3828480fa2b4] Instance spawned successfully.
Oct 26 00:12:18 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-391f5590-f135-42a7-a7d6-5cd64c833804 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] [instance: 3150d249-37a2-49c6-837a-3828480fa2b4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 00:12:18 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-391f5590-f135-42a7-a7d6-5cd64c833804 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] [instance: 3150d249-37a2-49c6-837a-3828480fa2b4] Found default for hw_cdrom_bus of ide {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:12:18 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-391f5590-f135-42a7-a7d6-5cd64c833804 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] [instance: 3150d249-37a2-49c6-837a-3828480fa2b4] Found default for hw_disk_bus of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:12:18 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-391f5590-f135-42a7-a7d6-5cd64c833804 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] [instance: 3150d249-37a2-49c6-837a-3828480fa2b4] Found default for hw_input_bus of None {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:12:18 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-391f5590-f135-42a7-a7d6-5cd64c833804 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] [instance: 3150d249-37a2-49c6-837a-3828480fa2b4] Found default for hw_pointer_model of None {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:12:18 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-391f5590-f135-42a7-a7d6-5cd64c833804 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] [instance: 3150d249-37a2-49c6-837a-3828480fa2b4] Found default for hw_video_model of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:12:18 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-391f5590-f135-42a7-a7d6-5cd64c833804 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] [instance: 3150d249-37a2-49c6-837a-3828480fa2b4] Found default for hw_vif_model of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:12:18 user nova-compute[75165]: DEBUG nova.compute.manager [req-5ffbcb63-d15b-47c4-9d55-69074fbbf87e req-ff4a65cb-d1c3-47bc-bd12-2a568810f2b3 service nova] [instance: 3150d249-37a2-49c6-837a-3828480fa2b4] Received event network-vif-plugged-e959f8cc-deda-4ee5-8f46-7d5fbcb13a3b {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:12:18 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-5ffbcb63-d15b-47c4-9d55-69074fbbf87e req-ff4a65cb-d1c3-47bc-bd12-2a568810f2b3 service nova] Acquiring lock "3150d249-37a2-49c6-837a-3828480fa2b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:12:18 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-5ffbcb63-d15b-47c4-9d55-69074fbbf87e req-ff4a65cb-d1c3-47bc-bd12-2a568810f2b3 service nova] Lock "3150d249-37a2-49c6-837a-3828480fa2b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:12:18 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-5ffbcb63-d15b-47c4-9d55-69074fbbf87e req-ff4a65cb-d1c3-47bc-bd12-2a568810f2b3 service nova] Lock "3150d249-37a2-49c6-837a-3828480fa2b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:12:18 user nova-compute[75165]: DEBUG nova.compute.manager [req-5ffbcb63-d15b-47c4-9d55-69074fbbf87e req-ff4a65cb-d1c3-47bc-bd12-2a568810f2b3 service nova] [instance: 3150d249-37a2-49c6-837a-3828480fa2b4] No waiting events found dispatching network-vif-plugged-e959f8cc-deda-4ee5-8f46-7d5fbcb13a3b {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:12:18 user nova-compute[75165]: WARNING nova.compute.manager [req-5ffbcb63-d15b-47c4-9d55-69074fbbf87e req-ff4a65cb-d1c3-47bc-bd12-2a568810f2b3 service nova] [instance: 3150d249-37a2-49c6-837a-3828480fa2b4] Received unexpected event network-vif-plugged-e959f8cc-deda-4ee5-8f46-7d5fbcb13a3b for instance with vm_state building and task_state spawning.
Oct 26 00:12:18 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9633e6bb-5e95-4994-92a2-9d8f85a946ff/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:12:18 user nova-compute[75165]: INFO nova.compute.manager [None req-391f5590-f135-42a7-a7d6-5cd64c833804 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] [instance: 3150d249-37a2-49c6-837a-3828480fa2b4] Took 6.33 seconds to spawn the instance on the hypervisor.
Oct 26 00:12:18 user nova-compute[75165]: DEBUG nova.compute.manager [None req-391f5590-f135-42a7-a7d6-5cd64c833804 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] [instance: 3150d249-37a2-49c6-837a-3828480fa2b4] Checking state {{(pid=75165) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 00:12:18 user nova-compute[75165]: INFO nova.compute.manager [None req-391f5590-f135-42a7-a7d6-5cd64c833804 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] [instance: 3150d249-37a2-49c6-837a-3828480fa2b4] Took 7.63 seconds to build instance.
Oct 26 00:12:18 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-391f5590-f135-42a7-a7d6-5cd64c833804 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Lock "3150d249-37a2-49c6-837a-3828480fa2b4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.778s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:12:18 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9633e6bb-5e95-4994-92a2-9d8f85a946ff/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:12:18 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9633e6bb-5e95-4994-92a2-9d8f85a946ff/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:12:19 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9633e6bb-5e95-4994-92a2-9d8f85a946ff/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:12:19 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84c6b624-648b-40e2-a37e-ff08609bad84/disk.rescue --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:12:19 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84c6b624-648b-40e2-a37e-ff08609bad84/disk.rescue --force-share --output=json" returned: 0 in 0.208s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:12:19 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84c6b624-648b-40e2-a37e-ff08609bad84/disk.rescue --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:12:19 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:12:19 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84c6b624-648b-40e2-a37e-ff08609bad84/disk.rescue --force-share --output=json" returned: 0 in 0.204s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:12:19 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84c6b624-648b-40e2-a37e-ff08609bad84/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:12:19 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84c6b624-648b-40e2-a37e-ff08609bad84/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:12:19 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84c6b624-648b-40e2-a37e-ff08609bad84/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:12:20 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84c6b624-648b-40e2-a37e-ff08609bad84/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:12:20 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0edba5b-e4d8-4b0a-ace1-1f32c19f8bd0/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:12:20 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0edba5b-e4d8-4b0a-ace1-1f32c19f8bd0/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:12:20 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0edba5b-e4d8-4b0a-ace1-1f32c19f8bd0/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:12:20 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0edba5b-e4d8-4b0a-ace1-1f32c19f8bd0/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:12:20 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7eeb145-1565-4812-818b-fefda5f2436d/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:12:20 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7eeb145-1565-4812-818b-fefda5f2436d/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:12:20 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7eeb145-1565-4812-818b-fefda5f2436d/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:12:20 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:12:21 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7eeb145-1565-4812-818b-fefda5f2436d/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:12:21 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f9add59-cabe-4965-8fe3-524618550581/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:12:21 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f9add59-cabe-4965-8fe3-524618550581/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:12:21 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f9add59-cabe-4965-8fe3-524618550581/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:12:21 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f9add59-cabe-4965-8fe3-524618550581/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:12:21 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] skipping disk /dev/sdc (vdc) as it is a volume {{(pid=75165) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 00:12:21 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3150d249-37a2-49c6-837a-3828480fa2b4/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:12:21 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:12:21 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3150d249-37a2-49c6-837a-3828480fa2b4/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:12:21 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3150d249-37a2-49c6-837a-3828480fa2b4/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:12:21 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3150d249-37a2-49c6-837a-3828480fa2b4/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:12:21 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26a0b493-bb47-466e-95d5-945fc3849fa5/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:12:22 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26a0b493-bb47-466e-95d5-945fc3849fa5/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:12:22 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26a0b493-bb47-466e-95d5-945fc3849fa5/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:12:22 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26a0b493-bb47-466e-95d5-945fc3849fa5/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:12:22 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75165) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 00:12:22 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26a0b493-bb47-466e-95d5-945fc3849fa5/disk.rescue --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:12:22 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26a0b493-bb47-466e-95d5-945fc3849fa5/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:12:22 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26a0b493-bb47-466e-95d5-945fc3849fa5/disk.rescue --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:12:22 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26a0b493-bb47-466e-95d5-945fc3849fa5/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:12:22 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e44bfc-6a68-46ce-8335-aaaba5160d3e/disk.rescue --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:12:22 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e44bfc-6a68-46ce-8335-aaaba5160d3e/disk.rescue --force-share --output=json" returned: 0 in 0.203s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:12:22 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e44bfc-6a68-46ce-8335-aaaba5160d3e/disk.rescue --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:12:23 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e44bfc-6a68-46ce-8335-aaaba5160d3e/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:12:23 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e44bfc-6a68-46ce-8335-aaaba5160d3e/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:12:23 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e44bfc-6a68-46ce-8335-aaaba5160d3e/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:12:23 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e44bfc-6a68-46ce-8335-aaaba5160d3e/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:12:23 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e44bfc-6a68-46ce-8335-aaaba5160d3e/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:12:23 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b9689c-5e83-4807-971f-5b244914b7e5/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:12:23 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b9689c-5e83-4807-971f-5b244914b7e5/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:12:23 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b9689c-5e83-4807-971f-5b244914b7e5/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:12:23 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b9689c-5e83-4807-971f-5b244914b7e5/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:12:23 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b153af2-c93b-47d2-ae8c-76cfd44e384c/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:12:24 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b153af2-c93b-47d2-ae8c-76cfd44e384c/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:12:24 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b153af2-c93b-47d2-ae8c-76cfd44e384c/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:12:24 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b153af2-c93b-47d2-ae8c-76cfd44e384c/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:12:24 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75165) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 00:12:24 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:12:24 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:12:24 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:12:24 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Hypervisor/Node resource view: name=user free_ram=7565MB free_disk=25.053504943847656GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75165) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 00:12:24 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:12:24 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:12:24 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Applying migration context for instance 3b153af2-c93b-47d2-ae8c-76cfd44e384c as it has an incoming, in-progress migration cc70c217-87db-48a3-b078-678e5f102287. Migration status is finished {{(pid=75165) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Oct 26 00:12:24 user nova-compute[75165]: INFO nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] Updating resource usage from migration cc70c217-87db-48a3-b078-678e5f102287
Oct 26 00:12:25 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 9633e6bb-5e95-4994-92a2-9d8f85a946ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:12:25 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 84c6b624-648b-40e2-a37e-ff08609bad84 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:12:25 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance c4e44bfc-6a68-46ce-8335-aaaba5160d3e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:12:25 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance a7eeb145-1565-4812-818b-fefda5f2436d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:12:25 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 26a0b493-bb47-466e-95d5-945fc3849fa5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:12:25 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 22b9689c-5e83-4807-971f-5b244914b7e5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:12:25 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 6f9add59-cabe-4965-8fe3-524618550581 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:12:25 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Migration cc70c217-87db-48a3-b078-678e5f102287 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Oct 26 00:12:25 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 3b153af2-c93b-47d2-ae8c-76cfd44e384c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:12:25 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance b0edba5b-e4d8-4b0a-ace1-1f32c19f8bd0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:12:25 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 3150d249-37a2-49c6-837a-3828480fa2b4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:12:25 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75165) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 00:12:25 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=30GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75165) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 00:12:25 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:12:25 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:12:25 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Compute_service record updated for user:user {{(pid=75165) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 00:12:25 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.537s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:12:25 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:12:29 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:12:30 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:12:34 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:12:34 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-c873322a-8495-46bd-bcf5-484090bff5f0 tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] Acquiring lock "8f8ec77f-bf35-4b15-bd77-9f8407b09d0b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:12:34 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-c873322a-8495-46bd-bcf5-484090bff5f0 tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] Lock "8f8ec77f-bf35-4b15-bd77-9f8407b09d0b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:12:34 user nova-compute[75165]: DEBUG nova.compute.manager [None req-c873322a-8495-46bd-bcf5-484090bff5f0 tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] [instance: 8f8ec77f-bf35-4b15-bd77-9f8407b09d0b] Starting instance... {{(pid=75165) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 00:12:35 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-c873322a-8495-46bd-bcf5-484090bff5f0 tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:12:35 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-c873322a-8495-46bd-bcf5-484090bff5f0 tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:12:35 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-c873322a-8495-46bd-bcf5-484090bff5f0 tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75165) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 00:12:35 user nova-compute[75165]: INFO nova.compute.claims [None req-c873322a-8495-46bd-bcf5-484090bff5f0 tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] [instance: 8f8ec77f-bf35-4b15-bd77-9f8407b09d0b] Claim successful on node user
Oct 26 00:12:35 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-c873322a-8495-46bd-bcf5-484090bff5f0 tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:12:35 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-c873322a-8495-46bd-bcf5-484090bff5f0 tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:12:35 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-c873322a-8495-46bd-bcf5-484090bff5f0 tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.456s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:12:35 user nova-compute[75165]: DEBUG nova.compute.manager [None req-c873322a-8495-46bd-bcf5-484090bff5f0 tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] [instance: 8f8ec77f-bf35-4b15-bd77-9f8407b09d0b] Start building networks asynchronously for instance. {{(pid=75165) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 00:12:35 user nova-compute[75165]: DEBUG nova.compute.manager [None req-c873322a-8495-46bd-bcf5-484090bff5f0 tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] [instance: 8f8ec77f-bf35-4b15-bd77-9f8407b09d0b] Allocating IP information in the background. {{(pid=75165) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 00:12:35 user nova-compute[75165]: DEBUG nova.network.neutron [None req-c873322a-8495-46bd-bcf5-484090bff5f0 tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] [instance: 8f8ec77f-bf35-4b15-bd77-9f8407b09d0b] allocate_for_instance() {{(pid=75165) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 00:12:35 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-c873322a-8495-46bd-bcf5-484090bff5f0 tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] [instance: 8f8ec77f-bf35-4b15-bd77-9f8407b09d0b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 00:12:35 user nova-compute[75165]: DEBUG nova.compute.manager [None req-c873322a-8495-46bd-bcf5-484090bff5f0 tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] [instance: 8f8ec77f-bf35-4b15-bd77-9f8407b09d0b] Start building block device mappings for instance. {{(pid=75165) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 00:12:35 user nova-compute[75165]: DEBUG nova.policy [None req-c873322a-8495-46bd-bcf5-484090bff5f0 tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '93efb23845e441bc932910691dfaf023', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b9c2d1b1e4d9d885fa82f1625b5e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75165) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 00:12:35 user nova-compute[75165]: DEBUG nova.compute.manager [None req-c873322a-8495-46bd-bcf5-484090bff5f0 tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] [instance: 8f8ec77f-bf35-4b15-bd77-9f8407b09d0b] Start spawning the instance on the hypervisor. {{(pid=75165) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 00:12:35 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-c873322a-8495-46bd-bcf5-484090bff5f0 tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] [instance: 8f8ec77f-bf35-4b15-bd77-9f8407b09d0b] Creating instance directory {{(pid=75165) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 00:12:35 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-c873322a-8495-46bd-bcf5-484090bff5f0 tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] [instance: 8f8ec77f-bf35-4b15-bd77-9f8407b09d0b] Creating image(s)
Oct 26 00:12:35 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-c873322a-8495-46bd-bcf5-484090bff5f0 tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] Acquiring lock "/opt/stack/data/nova/instances/8f8ec77f-bf35-4b15-bd77-9f8407b09d0b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:12:35 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-c873322a-8495-46bd-bcf5-484090bff5f0 tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] Lock "/opt/stack/data/nova/instances/8f8ec77f-bf35-4b15-bd77-9f8407b09d0b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:12:35 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-c873322a-8495-46bd-bcf5-484090bff5f0 tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] Lock "/opt/stack/data/nova/instances/8f8ec77f-bf35-4b15-bd77-9f8407b09d0b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:12:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-c873322a-8495-46bd-bcf5-484090bff5f0 tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:12:35 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:12:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-c873322a-8495-46bd-bcf5-484090bff5f0 tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json" returned: 0 in 0.215s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:12:35 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-c873322a-8495-46bd-bcf5-484090bff5f0 tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] Acquiring lock "7d3243421cf3fdc288b758f687a93103b7b95466" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:12:35 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-c873322a-8495-46bd-bcf5-484090bff5f0 tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] Lock "7d3243421cf3fdc288b758f687a93103b7b95466" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:12:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-c873322a-8495-46bd-bcf5-484090bff5f0 tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:12:36 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-c873322a-8495-46bd-bcf5-484090bff5f0 tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json" returned: 0 in 0.200s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:12:36 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-c873322a-8495-46bd-bcf5-484090bff5f0 tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466,backing_fmt=raw /opt/stack/data/nova/instances/8f8ec77f-bf35-4b15-bd77-9f8407b09d0b/disk 1073741824 {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:12:36 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-c873322a-8495-46bd-bcf5-484090bff5f0 tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466,backing_fmt=raw /opt/stack/data/nova/instances/8f8ec77f-bf35-4b15-bd77-9f8407b09d0b/disk 1073741824" returned: 0 in 0.057s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:12:36 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-c873322a-8495-46bd-bcf5-484090bff5f0 tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] Lock "7d3243421cf3fdc288b758f687a93103b7b95466" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.265s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:12:36 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-c873322a-8495-46bd-bcf5-484090bff5f0 tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:12:36 user nova-compute[75165]: DEBUG nova.network.neutron [None req-c873322a-8495-46bd-bcf5-484090bff5f0 tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] [instance: 8f8ec77f-bf35-4b15-bd77-9f8407b09d0b] Successfully created port: 7f5b9415-3336-49cc-8909-c21c7003e6fe {{(pid=75165) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 00:12:36 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-c873322a-8495-46bd-bcf5-484090bff5f0 tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json" returned: 0 in 0.198s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:12:36 user nova-compute[75165]: DEBUG nova.virt.disk.api [None req-c873322a-8495-46bd-bcf5-484090bff5f0 tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8f8ec77f-bf35-4b15-bd77-9f8407b09d0b/disk. size=1073741824 {{(pid=75165) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 00:12:36 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-c873322a-8495-46bd-bcf5-484090bff5f0 tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f8ec77f-bf35-4b15-bd77-9f8407b09d0b/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:12:36 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-c873322a-8495-46bd-bcf5-484090bff5f0 tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f8ec77f-bf35-4b15-bd77-9f8407b09d0b/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:12:36 user nova-compute[75165]: DEBUG nova.virt.disk.api [None req-c873322a-8495-46bd-bcf5-484090bff5f0 tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] Cannot resize image /opt/stack/data/nova/instances/8f8ec77f-bf35-4b15-bd77-9f8407b09d0b/disk to a smaller size. {{(pid=75165) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 00:12:36 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-c873322a-8495-46bd-bcf5-484090bff5f0 tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] [instance: 8f8ec77f-bf35-4b15-bd77-9f8407b09d0b] Created local disks {{(pid=75165) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 00:12:36 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-c873322a-8495-46bd-bcf5-484090bff5f0 tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] [instance: 8f8ec77f-bf35-4b15-bd77-9f8407b09d0b] Ensure instance console log exists: /opt/stack/data/nova/instances/8f8ec77f-bf35-4b15-bd77-9f8407b09d0b/console.log {{(pid=75165) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 00:12:36 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-c873322a-8495-46bd-bcf5-484090bff5f0 tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:12:36 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-c873322a-8495-46bd-bcf5-484090bff5f0 tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:12:36 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-c873322a-8495-46bd-bcf5-484090bff5f0 tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:12:37 user nova-compute[75165]: DEBUG nova.network.neutron [None req-c873322a-8495-46bd-bcf5-484090bff5f0 tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] [instance: 8f8ec77f-bf35-4b15-bd77-9f8407b09d0b] Successfully updated port: 7f5b9415-3336-49cc-8909-c21c7003e6fe {{(pid=75165) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 00:12:37 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-c873322a-8495-46bd-bcf5-484090bff5f0 tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] Acquiring lock "refresh_cache-8f8ec77f-bf35-4b15-bd77-9f8407b09d0b" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:12:37 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-c873322a-8495-46bd-bcf5-484090bff5f0 tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] Acquired lock "refresh_cache-8f8ec77f-bf35-4b15-bd77-9f8407b09d0b" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:12:37 user nova-compute[75165]: DEBUG nova.network.neutron [None req-c873322a-8495-46bd-bcf5-484090bff5f0 tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] [instance: 8f8ec77f-bf35-4b15-bd77-9f8407b09d0b] Building network info cache for instance {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 00:12:37 user nova-compute[75165]: DEBUG nova.compute.manager [req-6f4f1d8c-8767-40fa-acdd-743493d175a5 req-88cdfa6a-d960-4336-a154-792eab056419 service nova] [instance: 8f8ec77f-bf35-4b15-bd77-9f8407b09d0b] Received event network-changed-7f5b9415-3336-49cc-8909-c21c7003e6fe {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:12:37 user nova-compute[75165]: DEBUG nova.compute.manager [req-6f4f1d8c-8767-40fa-acdd-743493d175a5 req-88cdfa6a-d960-4336-a154-792eab056419 service nova] [instance: 8f8ec77f-bf35-4b15-bd77-9f8407b09d0b] Refreshing instance network info cache due to event network-changed-7f5b9415-3336-49cc-8909-c21c7003e6fe. {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 00:12:37 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-6f4f1d8c-8767-40fa-acdd-743493d175a5 req-88cdfa6a-d960-4336-a154-792eab056419 service nova] Acquiring lock "refresh_cache-8f8ec77f-bf35-4b15-bd77-9f8407b09d0b" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:12:37 user nova-compute[75165]: DEBUG nova.network.neutron [None req-c873322a-8495-46bd-bcf5-484090bff5f0 tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] [instance: 8f8ec77f-bf35-4b15-bd77-9f8407b09d0b] Instance cache missing network info. {{(pid=75165) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 00:12:37 user nova-compute[75165]: DEBUG nova.network.neutron [None req-c873322a-8495-46bd-bcf5-484090bff5f0 tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] [instance: 8f8ec77f-bf35-4b15-bd77-9f8407b09d0b] Updating instance_info_cache with network_info: [{"id": "7f5b9415-3336-49cc-8909-c21c7003e6fe", "address": "fa:16:3e:c8:5c:77", "network": {"id": "493a3a47-a5c0-4b54-a13e-e5c39f80e90a", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-218779534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da5b9c2d1b1e4d9d885fa82f1625b5e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f5b9415-33", "ovs_interfaceid": "7f5b9415-3336-49cc-8909-c21c7003e6fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:12:37 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-c873322a-8495-46bd-bcf5-484090bff5f0 tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] Releasing lock "refresh_cache-8f8ec77f-bf35-4b15-bd77-9f8407b09d0b" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:12:37 user nova-compute[75165]: DEBUG nova.compute.manager [None req-c873322a-8495-46bd-bcf5-484090bff5f0 tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] [instance: 8f8ec77f-bf35-4b15-bd77-9f8407b09d0b] Instance network_info: |[{"id": "7f5b9415-3336-49cc-8909-c21c7003e6fe", "address": "fa:16:3e:c8:5c:77", "network": {"id": "493a3a47-a5c0-4b54-a13e-e5c39f80e90a", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-218779534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da5b9c2d1b1e4d9d885fa82f1625b5e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f5b9415-33", "ovs_interfaceid": "7f5b9415-3336-49cc-8909-c21c7003e6fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75165) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 00:12:37 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-6f4f1d8c-8767-40fa-acdd-743493d175a5 req-88cdfa6a-d960-4336-a154-792eab056419 service nova] Acquired lock "refresh_cache-8f8ec77f-bf35-4b15-bd77-9f8407b09d0b" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:12:37 user nova-compute[75165]: DEBUG nova.network.neutron [req-6f4f1d8c-8767-40fa-acdd-743493d175a5 req-88cdfa6a-d960-4336-a154-792eab056419 service nova] [instance: 8f8ec77f-bf35-4b15-bd77-9f8407b09d0b] Refreshing network info cache for port 7f5b9415-3336-49cc-8909-c21c7003e6fe {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 00:12:37 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-c873322a-8495-46bd-bcf5-484090bff5f0 tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] [instance: 8f8ec77f-bf35-4b15-bd77-9f8407b09d0b] Start _get_guest_xml network_info=[{"id": "7f5b9415-3336-49cc-8909-c21c7003e6fe", "address": "fa:16:3e:c8:5c:77", "network": {"id": "493a3a47-a5c0-4b54-a13e-e5c39f80e90a", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-218779534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da5b9c2d1b1e4d9d885fa82f1625b5e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f5b9415-33", "ovs_interfaceid": "7f5b9415-3336-49cc-8909-c21c7003e6fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T00:03:24Z,direct_url=<?>,disk_format='qcow2',id=bff0d8a1-739e-4c4d-9efa-b73ba7b76d01,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e56bbf444fd34c348475c73673611447',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T00:03:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'size': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': 'bff0d8a1-739e-4c4d-9efa-b73ba7b76d01'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75165) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 00:12:37 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-c873322a-8495-46bd-bcf5-484090bff5f0 tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:12:37 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-c873322a-8495-46bd-bcf5-484090bff5f0 tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:12:37 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-c873322a-8495-46bd-bcf5-484090bff5f0 tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75165) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 00:12:37 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-c873322a-8495-46bd-bcf5-484090bff5f0 tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] CPU controller missing on host. {{(pid=75165) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 00:12:37 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-c873322a-8495-46bd-bcf5-484090bff5f0 tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75165) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 00:12:37 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-c873322a-8495-46bd-bcf5-484090bff5f0 tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] CPU controller found on host. {{(pid=75165) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 00:12:37 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-c873322a-8495-46bd-bcf5-484090bff5f0 tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75165) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 00:12:37 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-c873322a-8495-46bd-bcf5-484090bff5f0 tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T00:03:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T00:03:24Z,direct_url=<?>,disk_format='qcow2',id=bff0d8a1-739e-4c4d-9efa-b73ba7b76d01,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e56bbf444fd34c348475c73673611447',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T00:03:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 00:12:37 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-c873322a-8495-46bd-bcf5-484090bff5f0 tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] Flavor limits 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 00:12:37 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-c873322a-8495-46bd-bcf5-484090bff5f0 tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] Image limits 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 00:12:37 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-c873322a-8495-46bd-bcf5-484090bff5f0 tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] Flavor pref 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 00:12:37 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-c873322a-8495-46bd-bcf5-484090bff5f0 tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] Image pref 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 00:12:37 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-c873322a-8495-46bd-bcf5-484090bff5f0 tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 00:12:37 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-c873322a-8495-46bd-bcf5-484090bff5f0 tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 00:12:37 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-c873322a-8495-46bd-bcf5-484090bff5f0 tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75165) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 00:12:37 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-c873322a-8495-46bd-bcf5-484090bff5f0 tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] Got 1 possible topologies {{(pid=75165) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 00:12:37 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-c873322a-8495-46bd-bcf5-484090bff5f0 tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 00:12:37 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-c873322a-8495-46bd-bcf5-484090bff5f0 tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 00:12:37 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-c873322a-8495-46bd-bcf5-484090bff5f0 tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T00:12:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1656940732',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1656940732',id=19,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN+wbYUhWvc0Q8Ki4GTS2Tn91hUUyA5mHnOcmOrTkWVgToMqNtiT9k+t+ZtOfljqpTvTwcwIhu3LxiFs8eVVq6KIF4bfjQF4bPry0REDa8gn1PrkrDV91CuU9Osr0XBN6A==',key_name='tempest-keypair-1700446792',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='da5b9c2d1b1e4d9d885fa82f1625b5e0',ramdisk_id='',reservation_id='r-wb7qp03s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-950905423',owner_user_name='tempest-TaggedAttachmentsTest-950905423-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T00:12:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='93efb23845e441bc932910691dfaf023',uuid=8f8ec77f-bf35-4b15-bd77-9f8407b09d0b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7f5b9415-3336-49cc-8909-c21c7003e6fe", "address": "fa:16:3e:c8:5c:77", "network": {"id": "493a3a47-a5c0-4b54-a13e-e5c39f80e90a", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-218779534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da5b9c2d1b1e4d9d885fa82f1625b5e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f5b9415-33", "ovs_interfaceid": "7f5b9415-3336-49cc-8909-c21c7003e6fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75165) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 00:12:37 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-c873322a-8495-46bd-bcf5-484090bff5f0 tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] Converting VIF {"id": "7f5b9415-3336-49cc-8909-c21c7003e6fe", "address": "fa:16:3e:c8:5c:77", "network": {"id": "493a3a47-a5c0-4b54-a13e-e5c39f80e90a", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-218779534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da5b9c2d1b1e4d9d885fa82f1625b5e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f5b9415-33", "ovs_interfaceid": "7f5b9415-3336-49cc-8909-c21c7003e6fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:12:37 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-c873322a-8495-46bd-bcf5-484090bff5f0 tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:5c:77,bridge_name='br-int',has_traffic_filtering=True,id=7f5b9415-3336-49cc-8909-c21c7003e6fe,network=Network(493a3a47-a5c0-4b54-a13e-e5c39f80e90a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f5b9415-33') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:12:37 user nova-compute[75165]: DEBUG nova.objects.instance [None req-c873322a-8495-46bd-bcf5-484090bff5f0 tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] Lazy-loading 'pci_devices' on Instance uuid 8f8ec77f-bf35-4b15-bd77-9f8407b09d0b {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:12:37 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-c873322a-8495-46bd-bcf5-484090bff5f0 tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] [instance: 8f8ec77f-bf35-4b15-bd77-9f8407b09d0b] End _get_guest_xml xml=<domain type="kvm">
Oct 26 00:12:37 user nova-compute[75165]:   <uuid>8f8ec77f-bf35-4b15-bd77-9f8407b09d0b</uuid>
Oct 26 00:12:37 user nova-compute[75165]:   <name>instance-00000013</name>
Oct 26 00:12:37 user nova-compute[75165]:   <memory>524288</memory>
Oct 26 00:12:37 user nova-compute[75165]:   <vcpu>1</vcpu>
Oct 26 00:12:37 user nova-compute[75165]:   <metadata>
Oct 26 00:12:37 user nova-compute[75165]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 00:12:37 user nova-compute[75165]:       <nova:package version="0.0.0"/>
Oct 26 00:12:37 user nova-compute[75165]:       <nova:name>tempest-device-tagging-server-1656940732</nova:name>
Oct 26 00:12:37 user nova-compute[75165]:       <nova:creationTime>2023-10-26 00:12:37</nova:creationTime>
Oct 26 00:12:37 user nova-compute[75165]:       <nova:flavor name="m1.tiny">
Oct 26 00:12:37 user nova-compute[75165]:         <nova:memory>512</nova:memory>
Oct 26 00:12:37 user nova-compute[75165]:         <nova:disk>1</nova:disk>
Oct 26 00:12:37 user nova-compute[75165]:         <nova:swap>0</nova:swap>
Oct 26 00:12:37 user nova-compute[75165]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 00:12:37 user nova-compute[75165]:         <nova:vcpus>1</nova:vcpus>
Oct 26 00:12:37 user nova-compute[75165]:       </nova:flavor>
Oct 26 00:12:37 user nova-compute[75165]:       <nova:owner>
Oct 26 00:12:37 user nova-compute[75165]:         <nova:user uuid="93efb23845e441bc932910691dfaf023">tempest-TaggedAttachmentsTest-950905423-project-member</nova:user>
Oct 26 00:12:37 user nova-compute[75165]:         <nova:project uuid="da5b9c2d1b1e4d9d885fa82f1625b5e0">tempest-TaggedAttachmentsTest-950905423</nova:project>
Oct 26 00:12:37 user nova-compute[75165]:       </nova:owner>
Oct 26 00:12:37 user nova-compute[75165]:       <nova:root type="image" uuid="bff0d8a1-739e-4c4d-9efa-b73ba7b76d01"/>
Oct 26 00:12:37 user nova-compute[75165]:       <nova:ports>
Oct 26 00:12:37 user nova-compute[75165]:         <nova:port uuid="7f5b9415-3336-49cc-8909-c21c7003e6fe">
Oct 26 00:12:37 user nova-compute[75165]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 26 00:12:37 user nova-compute[75165]:         </nova:port>
Oct 26 00:12:37 user nova-compute[75165]:       </nova:ports>
Oct 26 00:12:37 user nova-compute[75165]:     </nova:instance>
Oct 26 00:12:37 user nova-compute[75165]:   </metadata>
Oct 26 00:12:37 user nova-compute[75165]:   <sysinfo type="smbios">
Oct 26 00:12:37 user nova-compute[75165]:     <system>
Oct 26 00:12:37 user nova-compute[75165]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 00:12:37 user nova-compute[75165]:       <entry name="product">OpenStack Nova</entry>
Oct 26 00:12:37 user nova-compute[75165]:       <entry name="version">0.0.0</entry>
Oct 26 00:12:37 user nova-compute[75165]:       <entry name="serial">8f8ec77f-bf35-4b15-bd77-9f8407b09d0b</entry>
Oct 26 00:12:37 user nova-compute[75165]:       <entry name="uuid">8f8ec77f-bf35-4b15-bd77-9f8407b09d0b</entry>
Oct 26 00:12:37 user nova-compute[75165]:       <entry name="family">Virtual Machine</entry>
Oct 26 00:12:37 user nova-compute[75165]:     </system>
Oct 26 00:12:37 user nova-compute[75165]:   </sysinfo>
Oct 26 00:12:37 user nova-compute[75165]:   <os>
Oct 26 00:12:37 user nova-compute[75165]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 00:12:37 user nova-compute[75165]:     <boot dev="hd"/>
Oct 26 00:12:37 user nova-compute[75165]:     <smbios mode="sysinfo"/>
Oct 26 00:12:37 user nova-compute[75165]:   </os>
Oct 26 00:12:37 user nova-compute[75165]:   <features>
Oct 26 00:12:37 user nova-compute[75165]:     <acpi/>
Oct 26 00:12:37 user nova-compute[75165]:     <apic/>
Oct 26 00:12:37 user nova-compute[75165]:     <vmcoreinfo/>
Oct 26 00:12:37 user nova-compute[75165]:   </features>
Oct 26 00:12:37 user nova-compute[75165]:   <clock offset="utc">
Oct 26 00:12:37 user nova-compute[75165]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 00:12:37 user nova-compute[75165]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 00:12:37 user nova-compute[75165]:     <timer name="hpet" present="no"/>
Oct 26 00:12:37 user nova-compute[75165]:   </clock>
Oct 26 00:12:37 user nova-compute[75165]:   <cpu mode="custom" match="exact">
Oct 26 00:12:37 user nova-compute[75165]:     <model>Nehalem</model>
Oct 26 00:12:37 user nova-compute[75165]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 00:12:37 user nova-compute[75165]:   </cpu>
Oct 26 00:12:37 user nova-compute[75165]:   <devices>
Oct 26 00:12:37 user nova-compute[75165]:     <disk type="file" device="disk">
Oct 26 00:12:37 user nova-compute[75165]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 00:12:37 user nova-compute[75165]:       <source file="/opt/stack/data/nova/instances/8f8ec77f-bf35-4b15-bd77-9f8407b09d0b/disk"/>
Oct 26 00:12:37 user nova-compute[75165]:       <target dev="vda" bus="virtio"/>
Oct 26 00:12:37 user nova-compute[75165]:     </disk>
Oct 26 00:12:37 user nova-compute[75165]:     <disk type="file" device="cdrom">
Oct 26 00:12:37 user nova-compute[75165]:       <driver name="qemu" type="raw" cache="none"/>
Oct 26 00:12:37 user nova-compute[75165]:       <source file="/opt/stack/data/nova/instances/8f8ec77f-bf35-4b15-bd77-9f8407b09d0b/disk.config"/>
Oct 26 00:12:37 user nova-compute[75165]:       <target dev="hda" bus="ide"/>
Oct 26 00:12:37 user nova-compute[75165]:     </disk>
Oct 26 00:12:37 user nova-compute[75165]:     <interface type="ethernet">
Oct 26 00:12:37 user nova-compute[75165]:       <mac address="fa:16:3e:c8:5c:77"/>
Oct 26 00:12:37 user nova-compute[75165]:       <model type="virtio"/>
Oct 26 00:12:37 user nova-compute[75165]:       <mtu size="1442"/>
Oct 26 00:12:37 user nova-compute[75165]:       <target dev="tap7f5b9415-33"/>
Oct 26 00:12:37 user nova-compute[75165]:     </interface>
Oct 26 00:12:37 user nova-compute[75165]:     <serial type="pty">
Oct 26 00:12:37 user nova-compute[75165]:       <log file="/opt/stack/data/nova/instances/8f8ec77f-bf35-4b15-bd77-9f8407b09d0b/console.log" append="off"/>
Oct 26 00:12:37 user nova-compute[75165]:     </serial>
Oct 26 00:12:37 user nova-compute[75165]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 00:12:37 user nova-compute[75165]:     <video>
Oct 26 00:12:37 user nova-compute[75165]:       <model type="virtio"/>
Oct 26 00:12:37 user nova-compute[75165]:     </video>
Oct 26 00:12:37 user nova-compute[75165]:     <rng model="virtio">
Oct 26 00:12:37 user nova-compute[75165]:       <backend model="random">/dev/urandom</backend>
Oct 26 00:12:37 user nova-compute[75165]:     </rng>
Oct 26 00:12:37 user nova-compute[75165]:     <controller type="usb" index="0" model="none"/>
Oct 26 00:12:37 user nova-compute[75165]:     <memballoon model="virtio">
Oct 26 00:12:37 user nova-compute[75165]:       <stats period="10"/>
Oct 26 00:12:37 user nova-compute[75165]:     </memballoon>
Oct 26 00:12:37 user nova-compute[75165]:   </devices>
Oct 26 00:12:37 user nova-compute[75165]: </domain>
Oct 26 00:12:37 user nova-compute[75165]:  {{(pid=75165) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 00:12:37 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-c873322a-8495-46bd-bcf5-484090bff5f0 tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T00:12:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1656940732',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1656940732',id=19,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN+wbYUhWvc0Q8Ki4GTS2Tn91hUUyA5mHnOcmOrTkWVgToMqNtiT9k+t+ZtOfljqpTvTwcwIhu3LxiFs8eVVq6KIF4bfjQF4bPry0REDa8gn1PrkrDV91CuU9Osr0XBN6A==',key_name='tempest-keypair-1700446792',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='da5b9c2d1b1e4d9d885fa82f1625b5e0',ramdisk_id='',reservation_id='r-wb7qp03s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-950905423',owner_user_name='tempest-TaggedAttachmentsTest-950905423-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T00:12:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='93efb23845e441bc932910691dfaf023',uuid=8f8ec77f-bf35-4b15-bd77-9f8407b09d0b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7f5b9415-3336-49cc-8909-c21c7003e6fe", "address": "fa:16:3e:c8:5c:77", "network": {"id": "493a3a47-a5c0-4b54-a13e-e5c39f80e90a", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-218779534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da5b9c2d1b1e4d9d885fa82f1625b5e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f5b9415-33", "ovs_interfaceid": "7f5b9415-3336-49cc-8909-c21c7003e6fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 00:12:37 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-c873322a-8495-46bd-bcf5-484090bff5f0 tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] Converting VIF {"id": "7f5b9415-3336-49cc-8909-c21c7003e6fe", "address": "fa:16:3e:c8:5c:77", "network": {"id": "493a3a47-a5c0-4b54-a13e-e5c39f80e90a", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-218779534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da5b9c2d1b1e4d9d885fa82f1625b5e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f5b9415-33", "ovs_interfaceid": "7f5b9415-3336-49cc-8909-c21c7003e6fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:12:37 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-c873322a-8495-46bd-bcf5-484090bff5f0 tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:5c:77,bridge_name='br-int',has_traffic_filtering=True,id=7f5b9415-3336-49cc-8909-c21c7003e6fe,network=Network(493a3a47-a5c0-4b54-a13e-e5c39f80e90a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f5b9415-33') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:12:37 user nova-compute[75165]: DEBUG os_vif [None req-c873322a-8495-46bd-bcf5-484090bff5f0 tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:5c:77,bridge_name='br-int',has_traffic_filtering=True,id=7f5b9415-3336-49cc-8909-c21c7003e6fe,network=Network(493a3a47-a5c0-4b54-a13e-e5c39f80e90a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f5b9415-33') {{(pid=75165) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 00:12:37 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:12:37 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:12:37 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 00:12:37 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:12:37 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b5c69e88-d4c7-520c-99ba-c16924bb4fca', '_type': 'linux-noop'}}, row=False) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:12:37 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:12:37 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:12:37 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:12:37 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7f5b9415-33, may_exist=True, interface_attrs={}) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:12:37 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7f5b9415-33, col_values=(('qos', UUID('ae71bec8-7275-4c79-af22-93b1f1b4bad7')),), if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:12:37 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7f5b9415-33, col_values=(('external_ids', {'iface-id': '7f5b9415-3336-49cc-8909-c21c7003e6fe', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c8:5c:77', 'vm-uuid': '8f8ec77f-bf35-4b15-bd77-9f8407b09d0b'}),), if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:12:37 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:12:37 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:12:37 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:12:37 user nova-compute[75165]: INFO os_vif [None req-c873322a-8495-46bd-bcf5-484090bff5f0 tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:5c:77,bridge_name='br-int',has_traffic_filtering=True,id=7f5b9415-3336-49cc-8909-c21c7003e6fe,network=Network(493a3a47-a5c0-4b54-a13e-e5c39f80e90a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f5b9415-33')
Oct 26 00:12:37 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-c873322a-8495-46bd-bcf5-484090bff5f0 tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] No BDM found with device name vda, not building metadata. {{(pid=75165) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 00:12:37 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-c873322a-8495-46bd-bcf5-484090bff5f0 tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] No BDM found with device name hda, not building metadata. {{(pid=75165) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 00:12:37 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-c873322a-8495-46bd-bcf5-484090bff5f0 tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] No VIF found with MAC fa:16:3e:c8:5c:77, not building metadata {{(pid=75165) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 00:12:37 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-c873322a-8495-46bd-bcf5-484090bff5f0 tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] [instance: 8f8ec77f-bf35-4b15-bd77-9f8407b09d0b] Using config drive
Oct 26 00:12:37 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-c873322a-8495-46bd-bcf5-484090bff5f0 tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] [instance: 8f8ec77f-bf35-4b15-bd77-9f8407b09d0b] Creating config drive at /opt/stack/data/nova/instances/8f8ec77f-bf35-4b15-bd77-9f8407b09d0b/disk.config
Oct 26 00:12:37 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-c873322a-8495-46bd-bcf5-484090bff5f0 tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/8f8ec77f-bf35-4b15-bd77-9f8407b09d0b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpclssx6kg {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:12:37 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-c873322a-8495-46bd-bcf5-484090bff5f0 tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/8f8ec77f-bf35-4b15-bd77-9f8407b09d0b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpclssx6kg" returned: 0 in 0.066s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:12:37 user nova-compute[75165]: DEBUG nova.network.neutron [req-6f4f1d8c-8767-40fa-acdd-743493d175a5 req-88cdfa6a-d960-4336-a154-792eab056419 service nova] [instance: 8f8ec77f-bf35-4b15-bd77-9f8407b09d0b] Updated VIF entry in instance network info cache for port 7f5b9415-3336-49cc-8909-c21c7003e6fe. {{(pid=75165) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 00:12:37 user nova-compute[75165]: DEBUG nova.network.neutron [req-6f4f1d8c-8767-40fa-acdd-743493d175a5 req-88cdfa6a-d960-4336-a154-792eab056419 service nova] [instance: 8f8ec77f-bf35-4b15-bd77-9f8407b09d0b] Updating instance_info_cache with network_info: [{"id": "7f5b9415-3336-49cc-8909-c21c7003e6fe", "address": "fa:16:3e:c8:5c:77", "network": {"id": "493a3a47-a5c0-4b54-a13e-e5c39f80e90a", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-218779534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da5b9c2d1b1e4d9d885fa82f1625b5e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f5b9415-33", "ovs_interfaceid": "7f5b9415-3336-49cc-8909-c21c7003e6fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:12:38 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-6f4f1d8c-8767-40fa-acdd-743493d175a5 req-88cdfa6a-d960-4336-a154-792eab056419 service nova] Releasing lock "refresh_cache-8f8ec77f-bf35-4b15-bd77-9f8407b09d0b" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:12:39 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:12:39 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:12:39 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:12:39 user nova-compute[75165]: DEBUG nova.compute.manager [req-ae728099-7567-4bda-bbfe-39c03fd2ce03 req-878188bb-253a-4475-bcb8-87c81e669529 service nova] [instance: 8f8ec77f-bf35-4b15-bd77-9f8407b09d0b] Received event network-vif-plugged-7f5b9415-3336-49cc-8909-c21c7003e6fe {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:12:39 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-ae728099-7567-4bda-bbfe-39c03fd2ce03 req-878188bb-253a-4475-bcb8-87c81e669529 service nova] Acquiring lock "8f8ec77f-bf35-4b15-bd77-9f8407b09d0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:12:39 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-ae728099-7567-4bda-bbfe-39c03fd2ce03 req-878188bb-253a-4475-bcb8-87c81e669529 service nova] Lock "8f8ec77f-bf35-4b15-bd77-9f8407b09d0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:12:39 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-ae728099-7567-4bda-bbfe-39c03fd2ce03 req-878188bb-253a-4475-bcb8-87c81e669529 service nova] Lock "8f8ec77f-bf35-4b15-bd77-9f8407b09d0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:12:39 user nova-compute[75165]: DEBUG nova.compute.manager [req-ae728099-7567-4bda-bbfe-39c03fd2ce03 req-878188bb-253a-4475-bcb8-87c81e669529 service nova] [instance: 8f8ec77f-bf35-4b15-bd77-9f8407b09d0b] No waiting events found dispatching network-vif-plugged-7f5b9415-3336-49cc-8909-c21c7003e6fe {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:12:39 user nova-compute[75165]: WARNING nova.compute.manager [req-ae728099-7567-4bda-bbfe-39c03fd2ce03 req-878188bb-253a-4475-bcb8-87c81e669529 service nova] [instance: 8f8ec77f-bf35-4b15-bd77-9f8407b09d0b] Received unexpected event network-vif-plugged-7f5b9415-3336-49cc-8909-c21c7003e6fe for instance with vm_state building and task_state spawning.
Oct 26 00:12:40 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:12:40 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:12:40 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:12:40 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:12:40 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:12:41 user nova-compute[75165]: DEBUG nova.compute.manager [req-8a5bc2bf-e819-4669-bcc9-dd18752763b0 req-9351f7e6-5583-42ab-9ee8-155a72f22694 service nova] [instance: 8f8ec77f-bf35-4b15-bd77-9f8407b09d0b] Received event network-vif-plugged-7f5b9415-3336-49cc-8909-c21c7003e6fe {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:12:41 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-8a5bc2bf-e819-4669-bcc9-dd18752763b0 req-9351f7e6-5583-42ab-9ee8-155a72f22694 service nova] Acquiring lock "8f8ec77f-bf35-4b15-bd77-9f8407b09d0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:12:41 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-8a5bc2bf-e819-4669-bcc9-dd18752763b0 req-9351f7e6-5583-42ab-9ee8-155a72f22694 service nova] Lock "8f8ec77f-bf35-4b15-bd77-9f8407b09d0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:12:41 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-8a5bc2bf-e819-4669-bcc9-dd18752763b0 req-9351f7e6-5583-42ab-9ee8-155a72f22694 service nova] Lock "8f8ec77f-bf35-4b15-bd77-9f8407b09d0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:12:41 user nova-compute[75165]: DEBUG nova.compute.manager [req-8a5bc2bf-e819-4669-bcc9-dd18752763b0 req-9351f7e6-5583-42ab-9ee8-155a72f22694 service nova] [instance: 8f8ec77f-bf35-4b15-bd77-9f8407b09d0b] No waiting events found dispatching network-vif-plugged-7f5b9415-3336-49cc-8909-c21c7003e6fe {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:12:41 user nova-compute[75165]: WARNING nova.compute.manager [req-8a5bc2bf-e819-4669-bcc9-dd18752763b0 req-9351f7e6-5583-42ab-9ee8-155a72f22694 service nova] [instance: 8f8ec77f-bf35-4b15-bd77-9f8407b09d0b] Received unexpected event network-vif-plugged-7f5b9415-3336-49cc-8909-c21c7003e6fe for instance with vm_state building and task_state spawning.
Oct 26 00:12:41 user nova-compute[75165]: DEBUG nova.compute.manager [None req-c873322a-8495-46bd-bcf5-484090bff5f0 tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] [instance: 8f8ec77f-bf35-4b15-bd77-9f8407b09d0b] Instance event wait completed in 0 seconds for  {{(pid=75165) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 00:12:41 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-c873322a-8495-46bd-bcf5-484090bff5f0 tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] [instance: 8f8ec77f-bf35-4b15-bd77-9f8407b09d0b] Guest created on hypervisor {{(pid=75165) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 00:12:41 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: 8f8ec77f-bf35-4b15-bd77-9f8407b09d0b] Instance spawned successfully.
Oct 26 00:12:41 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-c873322a-8495-46bd-bcf5-484090bff5f0 tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] [instance: 8f8ec77f-bf35-4b15-bd77-9f8407b09d0b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 00:12:41 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-c873322a-8495-46bd-bcf5-484090bff5f0 tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] [instance: 8f8ec77f-bf35-4b15-bd77-9f8407b09d0b] Found default for hw_cdrom_bus of ide {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:12:41 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-c873322a-8495-46bd-bcf5-484090bff5f0 tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] [instance: 8f8ec77f-bf35-4b15-bd77-9f8407b09d0b] Found default for hw_disk_bus of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:12:41 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-c873322a-8495-46bd-bcf5-484090bff5f0 tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] [instance: 8f8ec77f-bf35-4b15-bd77-9f8407b09d0b] Found default for hw_input_bus of None {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:12:41 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-c873322a-8495-46bd-bcf5-484090bff5f0 tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] [instance: 8f8ec77f-bf35-4b15-bd77-9f8407b09d0b] Found default for hw_pointer_model of None {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:12:41 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-c873322a-8495-46bd-bcf5-484090bff5f0 tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] [instance: 8f8ec77f-bf35-4b15-bd77-9f8407b09d0b] Found default for hw_video_model of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:12:41 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-c873322a-8495-46bd-bcf5-484090bff5f0 tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] [instance: 8f8ec77f-bf35-4b15-bd77-9f8407b09d0b] Found default for hw_vif_model of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:12:41 user nova-compute[75165]: INFO nova.compute.manager [None req-c873322a-8495-46bd-bcf5-484090bff5f0 tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] [instance: 8f8ec77f-bf35-4b15-bd77-9f8407b09d0b] Took 6.16 seconds to spawn the instance on the hypervisor.
Oct 26 00:12:41 user nova-compute[75165]: DEBUG nova.compute.manager [None req-c873322a-8495-46bd-bcf5-484090bff5f0 tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] [instance: 8f8ec77f-bf35-4b15-bd77-9f8407b09d0b] Checking state {{(pid=75165) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 00:12:41 user nova-compute[75165]: INFO nova.compute.manager [None req-c873322a-8495-46bd-bcf5-484090bff5f0 tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] [instance: 8f8ec77f-bf35-4b15-bd77-9f8407b09d0b] Took 7.00 seconds to build instance.
Oct 26 00:12:42 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-c873322a-8495-46bd-bcf5-484090bff5f0 tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] Lock "8f8ec77f-bf35-4b15-bd77-9f8407b09d0b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.108s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:12:42 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:12:45 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:12:47 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:12:50 user nova-compute[75165]: DEBUG nova.compute.manager [req-024e2525-a0d8-4809-9b35-0a6d2a4ef3b4 req-1c8f2233-28d3-4917-b8c3-a7d89873a03e service nova] [instance: 22b9689c-5e83-4807-971f-5b244914b7e5] Received event network-changed-15022d7e-be4a-480d-a612-31e1e689f43b {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:12:50 user nova-compute[75165]: DEBUG nova.compute.manager [req-024e2525-a0d8-4809-9b35-0a6d2a4ef3b4 req-1c8f2233-28d3-4917-b8c3-a7d89873a03e service nova] [instance: 22b9689c-5e83-4807-971f-5b244914b7e5] Refreshing instance network info cache due to event network-changed-15022d7e-be4a-480d-a612-31e1e689f43b. {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 00:12:50 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-024e2525-a0d8-4809-9b35-0a6d2a4ef3b4 req-1c8f2233-28d3-4917-b8c3-a7d89873a03e service nova] Acquiring lock "refresh_cache-22b9689c-5e83-4807-971f-5b244914b7e5" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:12:50 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-024e2525-a0d8-4809-9b35-0a6d2a4ef3b4 req-1c8f2233-28d3-4917-b8c3-a7d89873a03e service nova] Acquired lock "refresh_cache-22b9689c-5e83-4807-971f-5b244914b7e5" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:12:50 user nova-compute[75165]: DEBUG nova.network.neutron [req-024e2525-a0d8-4809-9b35-0a6d2a4ef3b4 req-1c8f2233-28d3-4917-b8c3-a7d89873a03e service nova] [instance: 22b9689c-5e83-4807-971f-5b244914b7e5] Refreshing network info cache for port 15022d7e-be4a-480d-a612-31e1e689f43b {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 00:12:50 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:12:51 user nova-compute[75165]: DEBUG nova.network.neutron [req-024e2525-a0d8-4809-9b35-0a6d2a4ef3b4 req-1c8f2233-28d3-4917-b8c3-a7d89873a03e service nova] [instance: 22b9689c-5e83-4807-971f-5b244914b7e5] Updated VIF entry in instance network info cache for port 15022d7e-be4a-480d-a612-31e1e689f43b. {{(pid=75165) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 00:12:51 user nova-compute[75165]: DEBUG nova.network.neutron [req-024e2525-a0d8-4809-9b35-0a6d2a4ef3b4 req-1c8f2233-28d3-4917-b8c3-a7d89873a03e service nova] [instance: 22b9689c-5e83-4807-971f-5b244914b7e5] Updating instance_info_cache with network_info: [{"id": "15022d7e-be4a-480d-a612-31e1e689f43b", "address": "fa:16:3e:23:d1:cb", "network": {"id": "bd1c84f9-bba9-4a23-8bf2-17e65022136a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1557945804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2911497df44047d9a9ee36a5652298bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15022d7e-be", "ovs_interfaceid": "15022d7e-be4a-480d-a612-31e1e689f43b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:12:51 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-024e2525-a0d8-4809-9b35-0a6d2a4ef3b4 req-1c8f2233-28d3-4917-b8c3-a7d89873a03e service nova] Releasing lock "refresh_cache-22b9689c-5e83-4807-971f-5b244914b7e5" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:12:51 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-8417174f-1f9b-4e71-8d2c-732de05ab25a tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Acquiring lock "22b9689c-5e83-4807-971f-5b244914b7e5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:12:51 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-8417174f-1f9b-4e71-8d2c-732de05ab25a tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Lock "22b9689c-5e83-4807-971f-5b244914b7e5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:12:51 user nova-compute[75165]: DEBUG nova.objects.instance [None req-8417174f-1f9b-4e71-8d2c-732de05ab25a tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Lazy-loading 'flavor' on Instance uuid 22b9689c-5e83-4807-971f-5b244914b7e5 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:12:51 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-8417174f-1f9b-4e71-8d2c-732de05ab25a tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Lock "22b9689c-5e83-4807-971f-5b244914b7e5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:12:51 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-8417174f-1f9b-4e71-8d2c-732de05ab25a tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Acquiring lock "22b9689c-5e83-4807-971f-5b244914b7e5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:12:51 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-8417174f-1f9b-4e71-8d2c-732de05ab25a tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Lock "22b9689c-5e83-4807-971f-5b244914b7e5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:12:51 user nova-compute[75165]: INFO nova.compute.manager [None req-8417174f-1f9b-4e71-8d2c-732de05ab25a tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: 22b9689c-5e83-4807-971f-5b244914b7e5] Attaching volume 33bd85b7-301b-434f-b1af-a682c33cf49b to /dev/vdb
Oct 26 00:12:51 user nova-compute[75165]: DEBUG os_brick.utils [None req-8417174f-1f9b-4e71-8d2c-732de05ab25a tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:12:51 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:12:51 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:12:51 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d22d524-c7a5-4800-a3e6-fe519e9ee5d3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa94814ccb35\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:12:51 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:12:51 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:12:51 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb71e769-b6c7-4455-87e9-a6012d22bcc7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:12:51 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:12:51 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:12:51 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbe69399-e436-4fb6-b41d-2863687e9313]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:12:51 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9ddbec0-5d97-48a4-80ce-9df183237c6c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:12:51 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-8417174f-1f9b-4e71-8d2c-732de05ab25a tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Running cmd (subprocess): nvme version {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:12:51 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-8417174f-1f9b-4e71-8d2c-732de05ab25a tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] 'nvme version' failed. Not Retrying. {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 00:12:51 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8417174f-1f9b-4e71-8d2c-732de05ab25a tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] nvme not present on system {{(pid=75165) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 00:12:51 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:12:51 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 00:12:51 user nova-compute[75165]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 00:12:51 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b3898a5-330b-4866-aa5e-030d7074c101]: (4, '') {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:12:51 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-8417174f-1f9b-4e71-8d2c-732de05ab25a tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75165) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 00:12:51 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-8417174f-1f9b-4e71-8d2c-732de05ab25a tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75165) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 00:12:51 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-8417174f-1f9b-4e71-8d2c-732de05ab25a tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] LIGHTOS: no hostnqn found. {{(pid=75165) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 00:12:51 user nova-compute[75165]: DEBUG os_brick.utils [None req-8417174f-1f9b-4e71-8d2c-732de05ab25a tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa94814ccb35', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:12:51 user nova-compute[75165]: DEBUG nova.virt.block_device [None req-8417174f-1f9b-4e71-8d2c-732de05ab25a tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: 22b9689c-5e83-4807-971f-5b244914b7e5] Updating existing volume attachment record: 7279939e-dfd7-42c8-b31a-bc7243a95628 {{(pid=75165) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 00:12:52 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:12:55 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:12:57 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-1c2b2933-8b2c-4db5-9716-38a5fa9725d8 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Acquiring lock "6f9add59-cabe-4965-8fe3-524618550581" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:12:57 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-1c2b2933-8b2c-4db5-9716-38a5fa9725d8 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Lock "6f9add59-cabe-4965-8fe3-524618550581" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:12:57 user nova-compute[75165]: INFO nova.compute.manager [None req-1c2b2933-8b2c-4db5-9716-38a5fa9725d8 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] [instance: 6f9add59-cabe-4965-8fe3-524618550581] Detaching volume 3664944a-e477-4f40-9b8f-2dce50a14ea8
Oct 26 00:12:57 user nova-compute[75165]: INFO nova.virt.block_device [None req-1c2b2933-8b2c-4db5-9716-38a5fa9725d8 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] [instance: 6f9add59-cabe-4965-8fe3-524618550581] Attempting to driver detach volume 3664944a-e477-4f40-9b8f-2dce50a14ea8 from mountpoint /dev/vdc
Oct 26 00:12:57 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-1c2b2933-8b2c-4db5-9716-38a5fa9725d8 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Attempting to detach device vdc from instance 6f9add59-cabe-4965-8fe3-524618550581 from the persistent domain config. {{(pid=75165) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 00:12:57 user nova-compute[75165]: DEBUG nova.virt.libvirt.guest [None req-1c2b2933-8b2c-4db5-9716-38a5fa9725d8 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 00:12:57 user nova-compute[75165]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 00:12:57 user nova-compute[75165]:   <source dev="/dev/sdc"/>
Oct 26 00:12:57 user nova-compute[75165]:   <target dev="vdc" bus="virtio"/>
Oct 26 00:12:57 user nova-compute[75165]:   <serial>3664944a-e477-4f40-9b8f-2dce50a14ea8</serial>
Oct 26 00:12:57 user nova-compute[75165]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 26 00:12:57 user nova-compute[75165]: </disk>
Oct 26 00:12:57 user nova-compute[75165]:  {{(pid=75165) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 00:12:57 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-1c2b2933-8b2c-4db5-9716-38a5fa9725d8 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Successfully detached device vdc from instance 6f9add59-cabe-4965-8fe3-524618550581 from the persistent domain config.
Oct 26 00:12:57 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-1c2b2933-8b2c-4db5-9716-38a5fa9725d8 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 6f9add59-cabe-4965-8fe3-524618550581 from the live domain config. {{(pid=75165) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 00:12:57 user nova-compute[75165]: DEBUG nova.virt.libvirt.guest [None req-1c2b2933-8b2c-4db5-9716-38a5fa9725d8 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 00:12:57 user nova-compute[75165]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 00:12:57 user nova-compute[75165]:   <source dev="/dev/sdc"/>
Oct 26 00:12:57 user nova-compute[75165]:   <target dev="vdc" bus="virtio"/>
Oct 26 00:12:57 user nova-compute[75165]:   <serial>3664944a-e477-4f40-9b8f-2dce50a14ea8</serial>
Oct 26 00:12:57 user nova-compute[75165]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 26 00:12:57 user nova-compute[75165]: </disk>
Oct 26 00:12:57 user nova-compute[75165]:  {{(pid=75165) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 00:12:57 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:12:57 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:12:58 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-1c2b2933-8b2c-4db5-9716-38a5fa9725d8 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 6f9add59-cabe-4965-8fe3-524618550581 {{(pid=75165) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 00:13:00 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:13:01 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:13:02 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:13:02 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:13:02 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:13:02 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:13:02 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75165) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 00:13:03 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:13:04 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:13:04 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:13:04 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Starting heal instance info cache {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 00:13:04 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "refresh_cache-3b153af2-c93b-47d2-ae8c-76cfd44e384c" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:13:04 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquired lock "refresh_cache-3b153af2-c93b-47d2-ae8c-76cfd44e384c" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:13:04 user nova-compute[75165]: DEBUG nova.network.neutron [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] Forcefully refreshing network info cache for instance {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 00:13:05 user nova-compute[75165]: DEBUG nova.network.neutron [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] Updating instance_info_cache with network_info: [{"id": "874a1698-c52c-444c-bed5-52633dbaeead", "address": "fa:16:3e:75:45:79", "network": {"id": "30951418-d830-4042-9143-c736802150e9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-167387787-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0db2c49ee28f4b7b9fa990faddb9d3a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap874a1698-c5", "ovs_interfaceid": "874a1698-c52c-444c-bed5-52633dbaeead", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:13:05 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Releasing lock "refresh_cache-3b153af2-c93b-47d2-ae8c-76cfd44e384c" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:13:05 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] Updated the network info_cache for instance {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 00:13:05 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:13:05 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:13:05 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:13:05 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:13:05 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:13:05 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75165) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 00:13:05 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9633e6bb-5e95-4994-92a2-9d8f85a946ff/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:13:05 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9633e6bb-5e95-4994-92a2-9d8f85a946ff/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:13:05 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9633e6bb-5e95-4994-92a2-9d8f85a946ff/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:13:05 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:13:06 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9633e6bb-5e95-4994-92a2-9d8f85a946ff/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:13:06 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84c6b624-648b-40e2-a37e-ff08609bad84/disk.rescue --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:13:06 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84c6b624-648b-40e2-a37e-ff08609bad84/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:13:06 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84c6b624-648b-40e2-a37e-ff08609bad84/disk.rescue --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:13:06 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84c6b624-648b-40e2-a37e-ff08609bad84/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:13:06 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84c6b624-648b-40e2-a37e-ff08609bad84/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:13:06 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84c6b624-648b-40e2-a37e-ff08609bad84/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:13:06 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84c6b624-648b-40e2-a37e-ff08609bad84/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:13:06 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84c6b624-648b-40e2-a37e-ff08609bad84/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:13:06 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0edba5b-e4d8-4b0a-ace1-1f32c19f8bd0/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:13:06 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0edba5b-e4d8-4b0a-ace1-1f32c19f8bd0/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:13:06 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0edba5b-e4d8-4b0a-ace1-1f32c19f8bd0/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:13:07 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0edba5b-e4d8-4b0a-ace1-1f32c19f8bd0/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:13:07 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7eeb145-1565-4812-818b-fefda5f2436d/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:13:07 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7eeb145-1565-4812-818b-fefda5f2436d/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:13:07 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7eeb145-1565-4812-818b-fefda5f2436d/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:13:07 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7eeb145-1565-4812-818b-fefda5f2436d/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:13:07 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f9add59-cabe-4965-8fe3-524618550581/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:13:07 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:13:07 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f9add59-cabe-4965-8fe3-524618550581/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:13:07 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f9add59-cabe-4965-8fe3-524618550581/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:13:07 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f9add59-cabe-4965-8fe3-524618550581/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:13:07 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3150d249-37a2-49c6-837a-3828480fa2b4/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:13:08 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3150d249-37a2-49c6-837a-3828480fa2b4/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:13:08 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3150d249-37a2-49c6-837a-3828480fa2b4/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:13:08 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3150d249-37a2-49c6-837a-3828480fa2b4/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:13:08 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26a0b493-bb47-466e-95d5-945fc3849fa5/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:13:08 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:13:08 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26a0b493-bb47-466e-95d5-945fc3849fa5/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:13:08 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26a0b493-bb47-466e-95d5-945fc3849fa5/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:13:08 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26a0b493-bb47-466e-95d5-945fc3849fa5/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:13:08 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75165) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 00:13:08 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26a0b493-bb47-466e-95d5-945fc3849fa5/disk.rescue --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:13:08 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26a0b493-bb47-466e-95d5-945fc3849fa5/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:13:08 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26a0b493-bb47-466e-95d5-945fc3849fa5/disk.rescue --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:13:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26a0b493-bb47-466e-95d5-945fc3849fa5/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:13:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e44bfc-6a68-46ce-8335-aaaba5160d3e/disk.rescue --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:13:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e44bfc-6a68-46ce-8335-aaaba5160d3e/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:13:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e44bfc-6a68-46ce-8335-aaaba5160d3e/disk.rescue --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:13:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e44bfc-6a68-46ce-8335-aaaba5160d3e/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:13:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e44bfc-6a68-46ce-8335-aaaba5160d3e/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:13:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e44bfc-6a68-46ce-8335-aaaba5160d3e/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:13:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e44bfc-6a68-46ce-8335-aaaba5160d3e/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:13:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e44bfc-6a68-46ce-8335-aaaba5160d3e/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:13:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b9689c-5e83-4807-971f-5b244914b7e5/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:13:10 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b9689c-5e83-4807-971f-5b244914b7e5/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:13:10 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b9689c-5e83-4807-971f-5b244914b7e5/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:13:10 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b9689c-5e83-4807-971f-5b244914b7e5/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:13:10 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b153af2-c93b-47d2-ae8c-76cfd44e384c/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:13:10 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:13:10 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b153af2-c93b-47d2-ae8c-76cfd44e384c/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:13:10 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b153af2-c93b-47d2-ae8c-76cfd44e384c/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:13:10 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b153af2-c93b-47d2-ae8c-76cfd44e384c/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:13:10 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75165) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 00:13:10 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f8ec77f-bf35-4b15-bd77-9f8407b09d0b/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:13:10 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:13:10 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f8ec77f-bf35-4b15-bd77-9f8407b09d0b/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:13:10 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f8ec77f-bf35-4b15-bd77-9f8407b09d0b/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:13:10 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8417174f-1f9b-4e71-8d2c-732de05ab25a tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: 22b9689c-5e83-4807-971f-5b244914b7e5] Calling os-brick to attach iSCSI Volume {{(pid=75165) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 00:13:10 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-8417174f-1f9b-4e71-8d2c-732de05ab25a tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8bf8160e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'efsGqiyv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:13:10 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-8417174f-1f9b-4e71-8d2c-732de05ab25a tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:13:10 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-8417174f-1f9b-4e71-8d2c-732de05ab25a tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:13:10 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-8417174f-1f9b-4e71-8d2c-732de05ab25a tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:13:10 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-8417174f-1f9b-4e71-8d2c-732de05ab25a tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:13:10 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-8417174f-1f9b-4e71-8d2c-732de05ab25a tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:13:10 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-8417174f-1f9b-4e71-8d2c-732de05ab25a tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:13:10 user nova-compute[75165]: INFO os_brick.initiator.connectors.iscsi [None req-8417174f-1f9b-4e71-8d2c-732de05ab25a tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 00:13:10 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b -p 172.16.0.220:3260 {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:13:11 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:13:11 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[22827842-4d3c-4582-809d-fbdfd4e1318b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:13:11 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-8417174f-1f9b-4e71-8d2c-732de05ab25a tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 00:13:11 user nova-compute[75165]:  {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:13:11 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b -p 172.16.0.220:3260 --interface default --op new {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:13:11 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:13:11 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2a693b6-9211-40c2-99fb-3a89af9b3caf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b] added\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:13:11 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-8417174f-1f9b-4e71-8d2c-732de05ab25a tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b] added
Oct 26 00:13:11 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:13:11 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:13:11 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:13:11 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2d6ad6c-57a6-4b30-a903-5d502c829a6b]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:13:11 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-8417174f-1f9b-4e71-8d2c-732de05ab25a tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:13:11 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:13:11 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:13:11 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[70cee34a-0879-448a-aec2-840dabe52242]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:13:11 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-8417174f-1f9b-4e71-8d2c-732de05ab25a tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:13:11 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v efsGqiyv {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:13:11 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v efsGqiyv" returned: 0 in 0.023s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:13:11 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[430a9bcc-8138-4237-bb8f-6a4976bcbb3f]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:13:11 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-8417174f-1f9b-4e71-8d2c-732de05ab25a tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'efsGqiyv'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:13:11 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:13:11 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f8ec77f-bf35-4b15-bd77-9f8407b09d0b/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:13:11 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:13:11 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[4928f59e-09f5-49cf-86a5-7e2dadd64e42]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:13:11 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-8417174f-1f9b-4e71-8d2c-732de05ab25a tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:13:11 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:13:11 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:13:11 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f2dba46-8953-470c-a7fd-ef27a180c316]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3664944a-e477-4f40-9b8f-2dce50a14ea8 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:13:11 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-8417174f-1f9b-4e71-8d2c-732de05ab25a tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792 (non-flash)
Oct 26 00:13:11 user nova-compute[75165]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3664944a-e477-4f40-9b8f-2dce50a14ea8 (non-flash)
Oct 26 00:13:11 user nova-compute[75165]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b (non-flash)
Oct 26 00:13:11 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:13:11 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-8417174f-1f9b-4e71-8d2c-732de05ab25a tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792 (non-flash)
Oct 26 00:13:11 user nova-compute[75165]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3664944a-e477-4f40-9b8f-2dce50a14ea8 (non-flash)
Oct 26 00:13:11 user nova-compute[75165]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b (non-flash)
Oct 26 00:13:11 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:13:11 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b -p 172.16.0.220:3260 --login {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:13:11 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:13:11 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:13:11 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Hypervisor/Node resource view: name=user free_ram=7140MB free_disk=24.956378936767578GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75165) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 00:13:11 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:13:11 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:13:11 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b -p 172.16.0.220:3260 --login" returned: 0 in 0.085s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:13:11 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f602f74-61cd-4173-9d13-74f972795f76]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:13:11 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-8417174f-1f9b-4e71-8d2c-732de05ab25a tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b, portal: 172.16.0.220,3260]
Oct 26 00:13:11 user nova-compute[75165]: Login to [iface: default, target: iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b, portal: 172.16.0.220,3260] successful.
Oct 26 00:13:11 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:13:11 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:13:11 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:13:11 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c9d83aa-7459-4c92-82b4-dc9f2392a3f5]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:13:11 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-8417174f-1f9b-4e71-8d2c-732de05ab25a tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:13:11 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:13:11 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Applying migration context for instance 3b153af2-c93b-47d2-ae8c-76cfd44e384c as it has an incoming, in-progress migration cc70c217-87db-48a3-b078-678e5f102287. Migration status is finished {{(pid=75165) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Oct 26 00:13:11 user nova-compute[75165]: INFO nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] Updating resource usage from migration cc70c217-87db-48a3-b078-678e5f102287
Oct 26 00:13:11 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:13:11 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[b39388b9-2e12-4086-b204-713fa2ee997c]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3664944a-e477-4f40-9b8f-2dce50a14ea8 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:13:11 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-8417174f-1f9b-4e71-8d2c-732de05ab25a tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792 (non-flash)
Oct 26 00:13:11 user nova-compute[75165]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3664944a-e477-4f40-9b8f-2dce50a14ea8 (non-flash)
Oct 26 00:13:11 user nova-compute[75165]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b (non-flash)
Oct 26 00:13:11 user nova-compute[75165]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b (non-flash)
Oct 26 00:13:11 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:13:11 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-8417174f-1f9b-4e71-8d2c-732de05ab25a tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792 (non-flash)
Oct 26 00:13:11 user nova-compute[75165]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3664944a-e477-4f40-9b8f-2dce50a14ea8 (non-flash)
Oct 26 00:13:11 user nova-compute[75165]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b (non-flash)
Oct 26 00:13:11 user nova-compute[75165]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b (non-flash)
Oct 26 00:13:11 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:13:11 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-8417174f-1f9b-4e71-8d2c-732de05ab25a tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.813s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:13:11 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-8417174f-1f9b-4e71-8d2c-732de05ab25a tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Connected to 172.16.0.220:3260 {{(pid=75165) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 00:13:11 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-8417174f-1f9b-4e71-8d2c-732de05ab25a tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] HCTL ('36', '-', '-', 0) found on session 15 with lun 0 {{(pid=75165) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 00:13:11 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-8417174f-1f9b-4e71-8d2c-732de05ab25a tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75165) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 00:13:11 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:13:11 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:13:11 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[122eba1c-4e9f-4396-b75d-1b664d9ccc07]: (4, ('- - 0', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:13:11 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-8417174f-1f9b-4e71-8d2c-732de05ab25a tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Searching for a device in session 15 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75165) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 00:13:11 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-8417174f-1f9b-4e71-8d2c-732de05ab25a tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'efsGqiyv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75165) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 00:13:11 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 9633e6bb-5e95-4994-92a2-9d8f85a946ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:13:11 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 84c6b624-648b-40e2-a37e-ff08609bad84 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:13:11 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance c4e44bfc-6a68-46ce-8335-aaaba5160d3e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:13:11 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance a7eeb145-1565-4812-818b-fefda5f2436d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:13:11 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 26a0b493-bb47-466e-95d5-945fc3849fa5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:13:11 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 22b9689c-5e83-4807-971f-5b244914b7e5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:13:11 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 6f9add59-cabe-4965-8fe3-524618550581 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:13:11 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Migration cc70c217-87db-48a3-b078-678e5f102287 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Oct 26 00:13:11 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 3b153af2-c93b-47d2-ae8c-76cfd44e384c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:13:11 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance b0edba5b-e4d8-4b0a-ace1-1f32c19f8bd0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:13:11 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 3150d249-37a2-49c6-837a-3828480fa2b4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:13:11 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 8f8ec77f-bf35-4b15-bd77-9f8407b09d0b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:13:11 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75165) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 00:13:11 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=31GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75165) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 00:13:11 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Refreshing inventories for resource provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 26 00:13:12 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Updating ProviderTree inventory for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 26 00:13:12 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Updating inventory in ProviderTree for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 26 00:13:12 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Refreshing aggregate associations for resource provider 03214fd5-21d1-46ec-b6b0-6449b77ba230, aggregates: None {{(pid=75165) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 26 00:13:12 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Refreshing trait associations for resource provider 03214fd5-21d1-46ec-b6b0-6449b77ba230, traits: COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NODE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_TRUSTED_CERTS,COMPUTE_DEVICE_TAGGING,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO {{(pid=75165) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 26 00:13:12 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:13:12 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:13:12 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Compute_service record updated for user:user {{(pid=75165) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 00:13:12 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.890s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:13:12 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:13:12 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Cleaning up deleted instances {{(pid=75165) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 26 00:13:12 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] There are 0 instances to clean {{(pid=75165) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 26 00:13:12 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:13:12 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75165) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 26 00:13:12 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:13:12 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-8417174f-1f9b-4e71-8d2c-732de05ab25a tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.853s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:13:12 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-8417174f-1f9b-4e71-8d2c-732de05ab25a tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] <== connect_volume: return (1857ms) {'type': 'block', 'scsi_wwn': '23539623964666639', 'path': '/dev/sde'} {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:13:12 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8417174f-1f9b-4e71-8d2c-732de05ab25a tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: 22b9689c-5e83-4807-971f-5b244914b7e5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23539623964666639', 'path': '/dev/sde'} {{(pid=75165) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 00:13:12 user nova-compute[75165]: DEBUG nova.objects.instance [None req-8417174f-1f9b-4e71-8d2c-732de05ab25a tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Lazy-loading 'flavor' on Instance uuid 22b9689c-5e83-4807-971f-5b244914b7e5 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:13:12 user nova-compute[75165]: DEBUG nova.virt.libvirt.guest [None req-8417174f-1f9b-4e71-8d2c-732de05ab25a tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 00:13:12 user nova-compute[75165]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 00:13:12 user nova-compute[75165]:   <source dev="/dev/sde"/>
Oct 26 00:13:12 user nova-compute[75165]:   <target dev="vdb" bus="virtio"/>
Oct 26 00:13:12 user nova-compute[75165]:   <serial>33bd85b7-301b-434f-b1af-a682c33cf49b</serial>
Oct 26 00:13:12 user nova-compute[75165]: </disk>
Oct 26 00:13:12 user nova-compute[75165]:  {{(pid=75165) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 00:13:13 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:13:13 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:13:13 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-8417174f-1f9b-4e71-8d2c-732de05ab25a tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] No BDM found with device name vda, not building metadata. {{(pid=75165) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 00:13:13 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-8417174f-1f9b-4e71-8d2c-732de05ab25a tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75165) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 00:13:13 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-8417174f-1f9b-4e71-8d2c-732de05ab25a tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] No VIF found with MAC fa:16:3e:23:d1:cb, not building metadata {{(pid=75165) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 00:13:13 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-8417174f-1f9b-4e71-8d2c-732de05ab25a tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Lock "22b9689c-5e83-4807-971f-5b244914b7e5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 22.376s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:13:13 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:13:14 user nova-compute[75165]: INFO nova.compute.manager [None req-17724f3d-6c72-48cc-a432-2f9234780a57 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] Unrescuing
Oct 26 00:13:14 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-17724f3d-6c72-48cc-a432-2f9234780a57 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Acquiring lock "refresh_cache-26a0b493-bb47-466e-95d5-945fc3849fa5" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:13:14 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-17724f3d-6c72-48cc-a432-2f9234780a57 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Acquired lock "refresh_cache-26a0b493-bb47-466e-95d5-945fc3849fa5" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:13:14 user nova-compute[75165]: DEBUG nova.network.neutron [None req-17724f3d-6c72-48cc-a432-2f9234780a57 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] Building network info cache for instance {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 00:13:14 user nova-compute[75165]: DEBUG nova.network.neutron [None req-17724f3d-6c72-48cc-a432-2f9234780a57 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] Updating instance_info_cache with network_info: [{"id": "1d6d497c-7382-4dff-b136-d1220b05a838", "address": "fa:16:3e:d3:eb:fb", "network": {"id": "08c51c53-4819-493e-b4eb-df5d6024d43d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1633769998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9cbae16d09ed4474bb6653f08165a4e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d6d497c-73", "ovs_interfaceid": "1d6d497c-7382-4dff-b136-d1220b05a838", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:13:14 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-17724f3d-6c72-48cc-a432-2f9234780a57 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Releasing lock "refresh_cache-26a0b493-bb47-466e-95d5-945fc3849fa5" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:13:14 user nova-compute[75165]: DEBUG nova.objects.instance [None req-17724f3d-6c72-48cc-a432-2f9234780a57 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Lazy-loading 'flavor' on Instance uuid 26a0b493-bb47-466e-95d5-945fc3849fa5 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:13:14 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:13:14 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:13:14 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:13:15 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:13:15 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:13:15 user nova-compute[75165]: DEBUG nova.compute.manager [req-9240f3a9-c99b-4abf-a81e-904e3af61405 req-2efe94a7-fc49-4f68-b97a-3211b5900440 service nova] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] Received event network-vif-unplugged-1d6d497c-7382-4dff-b136-d1220b05a838 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:13:15 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-9240f3a9-c99b-4abf-a81e-904e3af61405 req-2efe94a7-fc49-4f68-b97a-3211b5900440 service nova] Acquiring lock "26a0b493-bb47-466e-95d5-945fc3849fa5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:13:15 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-9240f3a9-c99b-4abf-a81e-904e3af61405 req-2efe94a7-fc49-4f68-b97a-3211b5900440 service nova] Lock "26a0b493-bb47-466e-95d5-945fc3849fa5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:13:15 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-9240f3a9-c99b-4abf-a81e-904e3af61405 req-2efe94a7-fc49-4f68-b97a-3211b5900440 service nova] Lock "26a0b493-bb47-466e-95d5-945fc3849fa5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:13:15 user nova-compute[75165]: DEBUG nova.compute.manager [req-9240f3a9-c99b-4abf-a81e-904e3af61405 req-2efe94a7-fc49-4f68-b97a-3211b5900440 service nova] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] No waiting events found dispatching network-vif-unplugged-1d6d497c-7382-4dff-b136-d1220b05a838 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:13:15 user nova-compute[75165]: WARNING nova.compute.manager [req-9240f3a9-c99b-4abf-a81e-904e3af61405 req-2efe94a7-fc49-4f68-b97a-3211b5900440 service nova] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] Received unexpected event network-vif-unplugged-1d6d497c-7382-4dff-b136-d1220b05a838 for instance with vm_state rescued and task_state unrescuing.
Oct 26 00:13:15 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Triggering sync for uuid 9633e6bb-5e95-4994-92a2-9d8f85a946ff {{(pid=75165) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 00:13:15 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Triggering sync for uuid 84c6b624-648b-40e2-a37e-ff08609bad84 {{(pid=75165) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 00:13:15 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Triggering sync for uuid c4e44bfc-6a68-46ce-8335-aaaba5160d3e {{(pid=75165) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 00:13:15 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Triggering sync for uuid a7eeb145-1565-4812-818b-fefda5f2436d {{(pid=75165) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 00:13:15 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Triggering sync for uuid 26a0b493-bb47-466e-95d5-945fc3849fa5 {{(pid=75165) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 00:13:15 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Triggering sync for uuid 3b153af2-c93b-47d2-ae8c-76cfd44e384c {{(pid=75165) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 00:13:15 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Triggering sync for uuid 22b9689c-5e83-4807-971f-5b244914b7e5 {{(pid=75165) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 00:13:15 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Triggering sync for uuid b0edba5b-e4d8-4b0a-ace1-1f32c19f8bd0 {{(pid=75165) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 00:13:15 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Triggering sync for uuid 3150d249-37a2-49c6-837a-3828480fa2b4 {{(pid=75165) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 00:13:15 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Triggering sync for uuid 8f8ec77f-bf35-4b15-bd77-9f8407b09d0b {{(pid=75165) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 00:13:15 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Triggering sync for uuid 6f9add59-cabe-4965-8fe3-524618550581 {{(pid=75165) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 00:13:15 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "9633e6bb-5e95-4994-92a2-9d8f85a946ff" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:13:15 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "9633e6bb-5e95-4994-92a2-9d8f85a946ff" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:13:15 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "84c6b624-648b-40e2-a37e-ff08609bad84" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:13:15 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "84c6b624-648b-40e2-a37e-ff08609bad84" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:13:15 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "c4e44bfc-6a68-46ce-8335-aaaba5160d3e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:13:15 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "c4e44bfc-6a68-46ce-8335-aaaba5160d3e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:13:15 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "a7eeb145-1565-4812-818b-fefda5f2436d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:13:15 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "a7eeb145-1565-4812-818b-fefda5f2436d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:13:15 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "26a0b493-bb47-466e-95d5-945fc3849fa5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:13:15 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "26a0b493-bb47-466e-95d5-945fc3849fa5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:13:15 user nova-compute[75165]: INFO nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] During sync_power_state the instance has a pending task (unrescuing). Skip.
Oct 26 00:13:15 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "26a0b493-bb47-466e-95d5-945fc3849fa5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:13:15 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "3b153af2-c93b-47d2-ae8c-76cfd44e384c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:13:15 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "3b153af2-c93b-47d2-ae8c-76cfd44e384c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:13:15 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "22b9689c-5e83-4807-971f-5b244914b7e5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:13:15 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "22b9689c-5e83-4807-971f-5b244914b7e5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:13:15 user nova-compute[75165]: INFO nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: 22b9689c-5e83-4807-971f-5b244914b7e5] During sync_power_state the instance has a pending task (rebuilding). Skip.
Oct 26 00:13:15 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "22b9689c-5e83-4807-971f-5b244914b7e5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:13:15 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "b0edba5b-e4d8-4b0a-ace1-1f32c19f8bd0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:13:15 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "b0edba5b-e4d8-4b0a-ace1-1f32c19f8bd0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:13:15 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "3150d249-37a2-49c6-837a-3828480fa2b4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:13:15 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "3150d249-37a2-49c6-837a-3828480fa2b4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:13:15 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "8f8ec77f-bf35-4b15-bd77-9f8407b09d0b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:13:15 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "8f8ec77f-bf35-4b15-bd77-9f8407b09d0b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:13:15 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "6f9add59-cabe-4965-8fe3-524618550581" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:13:15 user nova-compute[75165]: INFO nova.compute.manager [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: 22b9689c-5e83-4807-971f-5b244914b7e5] Rebuilding instance
Oct 26 00:13:15 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "9633e6bb-5e95-4994-92a2-9d8f85a946ff" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.097s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:13:15 user nova-compute[75165]: DEBUG nova.compute.manager [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: 22b9689c-5e83-4807-971f-5b244914b7e5] Checking state {{(pid=75165) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 00:13:15 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "3150d249-37a2-49c6-837a-3828480fa2b4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.110s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:13:15 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "a7eeb145-1565-4812-818b-fefda5f2436d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.118s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:13:15 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "b0edba5b-e4d8-4b0a-ace1-1f32c19f8bd0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.114s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:13:15 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "84c6b624-648b-40e2-a37e-ff08609bad84" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.122s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:13:15 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "3b153af2-c93b-47d2-ae8c-76cfd44e384c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.134s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:13:15 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "c4e44bfc-6a68-46ce-8335-aaaba5160d3e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.147s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:13:15 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "8f8ec77f-bf35-4b15-bd77-9f8407b09d0b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.148s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:13:15 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:13:15 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:13:15 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] Instance destroyed successfully.
Oct 26 00:13:15 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:13:16 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:13:16 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:13:16 user nova-compute[75165]: DEBUG nova.compute.manager [req-dab37732-c7de-48ab-970e-28200d9f5b8d req-3700ab97-55e0-49cb-a46e-cbf8dd540ac5 service nova] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] Received event network-changed-1d6d497c-7382-4dff-b136-d1220b05a838 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:13:16 user nova-compute[75165]: DEBUG nova.compute.manager [req-dab37732-c7de-48ab-970e-28200d9f5b8d req-3700ab97-55e0-49cb-a46e-cbf8dd540ac5 service nova] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] Refreshing instance network info cache due to event network-changed-1d6d497c-7382-4dff-b136-d1220b05a838. {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 00:13:16 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-dab37732-c7de-48ab-970e-28200d9f5b8d req-3700ab97-55e0-49cb-a46e-cbf8dd540ac5 service nova] Acquiring lock "refresh_cache-26a0b493-bb47-466e-95d5-945fc3849fa5" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:13:16 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-dab37732-c7de-48ab-970e-28200d9f5b8d req-3700ab97-55e0-49cb-a46e-cbf8dd540ac5 service nova] Acquired lock "refresh_cache-26a0b493-bb47-466e-95d5-945fc3849fa5" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:13:16 user nova-compute[75165]: DEBUG nova.network.neutron [req-dab37732-c7de-48ab-970e-28200d9f5b8d req-3700ab97-55e0-49cb-a46e-cbf8dd540ac5 service nova] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] Refreshing network info cache for port 1d6d497c-7382-4dff-b136-d1220b05a838 {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 00:13:16 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: 22b9689c-5e83-4807-971f-5b244914b7e5] Instance destroyed successfully.
Oct 26 00:13:17 user nova-compute[75165]: INFO nova.compute.manager [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: 22b9689c-5e83-4807-971f-5b244914b7e5] Detaching volume 33bd85b7-301b-434f-b1af-a682c33cf49b
Oct 26 00:13:17 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:13:17 user nova-compute[75165]: INFO nova.virt.block_device [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: 22b9689c-5e83-4807-971f-5b244914b7e5] Attempting to driver detach volume 33bd85b7-301b-434f-b1af-a682c33cf49b from mountpoint /dev/vdb
Oct 26 00:13:17 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Attempting to detach device vdb from instance 22b9689c-5e83-4807-971f-5b244914b7e5 from the persistent domain config. {{(pid=75165) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 00:13:17 user nova-compute[75165]: DEBUG nova.virt.libvirt.guest [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 00:13:17 user nova-compute[75165]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 00:13:17 user nova-compute[75165]:   <source dev="/dev/sde"/>
Oct 26 00:13:17 user nova-compute[75165]:   <target dev="vdb" bus="virtio"/>
Oct 26 00:13:17 user nova-compute[75165]:   <serial>33bd85b7-301b-434f-b1af-a682c33cf49b</serial>
Oct 26 00:13:17 user nova-compute[75165]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 00:13:17 user nova-compute[75165]: </disk>
Oct 26 00:13:17 user nova-compute[75165]:  {{(pid=75165) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 00:13:17 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Successfully detached device vdb from instance 22b9689c-5e83-4807-971f-5b244914b7e5 from the persistent domain config.
Oct 26 00:13:17 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: 22b9689c-5e83-4807-971f-5b244914b7e5] calling os-brick to detach iSCSI Volume {{(pid=75165) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 00:13:17 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8bf8160e50>, {'target_iqn': 'iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'efsGqiyv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:13:17 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 26 00:13:17 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:13:17 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:13:17 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:13:17 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:13:17 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[696b34f8-3ba5-49a6-9a95-5a55c78353c3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3664944a-e477-4f40-9b8f-2dce50a14ea8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:13:17 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 00:13:17 user nova-compute[75165]: No targets found.
Oct 26 00:13:17 user nova-compute[75165]: iSNS:
Oct 26 00:13:17 user nova-compute[75165]: No targets found.
Oct 26 00:13:17 user nova-compute[75165]: STATIC:
Oct 26 00:13:17 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b
Oct 26 00:13:17 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:13:17 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:13:17 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792
Oct 26 00:13:17 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:13:17 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:13:17 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:3664944a-e477-4f40-9b8f-2dce50a14ea8
Oct 26 00:13:17 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:13:17 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:13:17 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b
Oct 26 00:13:17 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:13:17 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:13:17 user nova-compute[75165]: FIRMWARE:
Oct 26 00:13:17 user nova-compute[75165]: No targets found.
Oct 26 00:13:17 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:13:17 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 00:13:17 user nova-compute[75165]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 00:13:17 user nova-compute[75165]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75165) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 00:13:17 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b', 0)] {{(pid=75165) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 00:13:17 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:13:17 user nova-compute[75165]: DEBUG nova.network.neutron [req-dab37732-c7de-48ab-970e-28200d9f5b8d req-3700ab97-55e0-49cb-a46e-cbf8dd540ac5 service nova] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] Updated VIF entry in instance network info cache for port 1d6d497c-7382-4dff-b136-d1220b05a838. {{(pid=75165) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 00:13:17 user nova-compute[75165]: DEBUG nova.network.neutron [req-dab37732-c7de-48ab-970e-28200d9f5b8d req-3700ab97-55e0-49cb-a46e-cbf8dd540ac5 service nova] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] Updating instance_info_cache with network_info: [{"id": "1d6d497c-7382-4dff-b136-d1220b05a838", "address": "fa:16:3e:d3:eb:fb", "network": {"id": "08c51c53-4819-493e-b4eb-df5d6024d43d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1633769998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9cbae16d09ed4474bb6653f08165a4e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d6d497c-73", "ovs_interfaceid": "1d6d497c-7382-4dff-b136-d1220b05a838", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:13:17 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:13:17 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c050f99-4d9a-4776-aed4-db4454209d6c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3664944a-e477-4f40-9b8f-2dce50a14ea8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:13:17 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:13:17 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-dab37732-c7de-48ab-970e-28200d9f5b8d req-3700ab97-55e0-49cb-a46e-cbf8dd540ac5 service nova] Releasing lock "refresh_cache-26a0b493-bb47-466e-95d5-945fc3849fa5" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:13:17 user nova-compute[75165]: DEBUG nova.compute.manager [req-8b11d473-5d7b-42f5-9455-4c004549a937 req-db12d0df-8f48-4436-b9eb-5c59ca94a93e service nova] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] Received event network-vif-plugged-1d6d497c-7382-4dff-b136-d1220b05a838 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:13:17 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-8b11d473-5d7b-42f5-9455-4c004549a937 req-db12d0df-8f48-4436-b9eb-5c59ca94a93e service nova] Acquiring lock "26a0b493-bb47-466e-95d5-945fc3849fa5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:13:17 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-8b11d473-5d7b-42f5-9455-4c004549a937 req-db12d0df-8f48-4436-b9eb-5c59ca94a93e service nova] Lock "26a0b493-bb47-466e-95d5-945fc3849fa5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:13:17 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-8b11d473-5d7b-42f5-9455-4c004549a937 req-db12d0df-8f48-4436-b9eb-5c59ca94a93e service nova] Lock "26a0b493-bb47-466e-95d5-945fc3849fa5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:13:17 user nova-compute[75165]: DEBUG nova.compute.manager [req-8b11d473-5d7b-42f5-9455-4c004549a937 req-db12d0df-8f48-4436-b9eb-5c59ca94a93e service nova] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] No waiting events found dispatching network-vif-plugged-1d6d497c-7382-4dff-b136-d1220b05a838 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:13:17 user nova-compute[75165]: WARNING nova.compute.manager [req-8b11d473-5d7b-42f5-9455-4c004549a937 req-db12d0df-8f48-4436-b9eb-5c59ca94a93e service nova] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] Received unexpected event network-vif-plugged-1d6d497c-7382-4dff-b136-d1220b05a838 for instance with vm_state rescued and task_state unrescuing.
Oct 26 00:13:17 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:13:17 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[29829623-4f67-4458-9260-492bf2e78496]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3664944a-e477-4f40-9b8f-2dce50a14ea8 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:13:17 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792 (non-flash)
Oct 26 00:13:17 user nova-compute[75165]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3664944a-e477-4f40-9b8f-2dce50a14ea8 (non-flash)
Oct 26 00:13:17 user nova-compute[75165]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b (non-flash)
Oct 26 00:13:17 user nova-compute[75165]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b (non-flash)
Oct 26 00:13:17 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:13:17 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792 (non-flash)
Oct 26 00:13:17 user nova-compute[75165]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3664944a-e477-4f40-9b8f-2dce50a14ea8 (non-flash)
Oct 26 00:13:17 user nova-compute[75165]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b (non-flash)
Oct 26 00:13:17 user nova-compute[75165]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b (non-flash)
Oct 26 00:13:17 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:13:17 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8be04bb5b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b'): ({'sde'}, set())}) {{(pid=75165) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 00:13:17 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Removing single pathed devices sde {{(pid=75165) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 00:13:17 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:13:17 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:13:17 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[dac5b58a-3737-4c2a-b708-79386ef9860f]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:13:17 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:13:17 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.025s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:13:17 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[5101b823-3e1c-48ea-9326-ff9218d7f227]: (4, ('ok\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:13:17 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Flushing IO for device /dev/sde {{(pid=75165) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 00:13:17 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:13:17 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:13:17 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[be851b49-3ab7-4338-9768-cef54bfe09b9]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:13:17 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75165) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 00:13:17 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:13:17 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.042s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:13:17 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[573ec292-cf26-4377-998e-e93924909cd8]: (4, ('1', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:13:17 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75165) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 00:13:17 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] SCSI volumes sde have been removed. {{(pid=75165) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 00:13:17 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b')] {{(pid=75165) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 00:13:17 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:13:17 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:13:17 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[67a55d9a-2ee0-4d26-a36f-ed08630b5811]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:13:17 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:13:17 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b -p 172.16.0.220:3260 --logout {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:13:17 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:13:17 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[b86b9aa1-5892-4c48-9962-1e7dd129e729]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:13:17 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b, portal: 172.16.0.220,3260]
Oct 26 00:13:17 user nova-compute[75165]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b, portal: 172.16.0.220,3260] successful.
Oct 26 00:13:17 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:13:17 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b -p 172.16.0.220:3260 --op delete {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:13:17 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:13:17 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[5063b228-3755-4c5d-ad1e-71bb2a965850]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:13:17 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:13:17 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.334s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:13:17 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] <== disconnect_volume: return (336ms) None {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:13:17 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: 22b9689c-5e83-4807-971f-5b244914b7e5] Disconnected iSCSI Volume {{(pid=75165) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 00:13:17 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:13:17 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:13:17 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:13:17 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:13:17 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:13:17 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:13:18 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-1c2b2933-8b2c-4db5-9716-38a5fa9725d8 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 6f9add59-cabe-4965-8fe3-524618550581 is timed out.
Oct 26 00:13:18 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-1c2b2933-8b2c-4db5-9716-38a5fa9725d8 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Successfully detached device vdc from instance 6f9add59-cabe-4965-8fe3-524618550581 from the live domain config.
Oct 26 00:13:18 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c2b2933-8b2c-4db5-9716-38a5fa9725d8 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] [instance: 6f9add59-cabe-4965-8fe3-524618550581] calling os-brick to detach iSCSI Volume {{(pid=75165) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 00:13:18 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c2b2933-8b2c-4db5-9716-38a5fa9725d8 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8bf8160e50>, {'target_iqn': 'iqn.2010-10.org.openstack:3664944a-e477-4f40-9b8f-2dce50a14ea8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UxTrGBel', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:13:18 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-1c2b2933-8b2c-4db5-9716-38a5fa9725d8 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:13:18 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-1c2b2933-8b2c-4db5-9716-38a5fa9725d8 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:13:18 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-1c2b2933-8b2c-4db5-9716-38a5fa9725d8 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:13:18 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:13:18 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:13:18 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[24227d91-edd7-4614-83a3-93be32c0f54e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3664944a-e477-4f40-9b8f-2dce50a14ea8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:13:18 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c2b2933-8b2c-4db5-9716-38a5fa9725d8 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 00:13:18 user nova-compute[75165]: No targets found.
Oct 26 00:13:18 user nova-compute[75165]: iSNS:
Oct 26 00:13:18 user nova-compute[75165]: No targets found.
Oct 26 00:13:18 user nova-compute[75165]: STATIC:
Oct 26 00:13:18 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792
Oct 26 00:13:18 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:13:18 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:13:18 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:3664944a-e477-4f40-9b8f-2dce50a14ea8
Oct 26 00:13:18 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:13:18 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:13:18 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b
Oct 26 00:13:18 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:13:18 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:13:18 user nova-compute[75165]: FIRMWARE:
Oct 26 00:13:18 user nova-compute[75165]: No targets found.
Oct 26 00:13:18 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:13:18 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c2b2933-8b2c-4db5-9716-38a5fa9725d8 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 00:13:18 user nova-compute[75165]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 00:13:18 user nova-compute[75165]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75165) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 00:13:18 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c2b2933-8b2c-4db5-9716-38a5fa9725d8 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3664944a-e477-4f40-9b8f-2dce50a14ea8', 0)] {{(pid=75165) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 00:13:18 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:13:18 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:13:18 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2a7cd0b-d565-4921-896e-f339ac3519e8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3664944a-e477-4f40-9b8f-2dce50a14ea8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:13:18 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:13:18 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:13:18 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[161fc77b-b72b-4a4b-a541-c9e571a735e1]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3664944a-e477-4f40-9b8f-2dce50a14ea8 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:13:18 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c2b2933-8b2c-4db5-9716-38a5fa9725d8 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792 (non-flash)
Oct 26 00:13:18 user nova-compute[75165]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3664944a-e477-4f40-9b8f-2dce50a14ea8 (non-flash)
Oct 26 00:13:18 user nova-compute[75165]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b (non-flash)
Oct 26 00:13:18 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:13:18 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c2b2933-8b2c-4db5-9716-38a5fa9725d8 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792 (non-flash)
Oct 26 00:13:18 user nova-compute[75165]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3664944a-e477-4f40-9b8f-2dce50a14ea8 (non-flash)
Oct 26 00:13:18 user nova-compute[75165]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b (non-flash)
Oct 26 00:13:18 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:13:18 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c2b2933-8b2c-4db5-9716-38a5fa9725d8 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8c049c27a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3664944a-e477-4f40-9b8f-2dce50a14ea8'): ({'sdc'}, set())}) {{(pid=75165) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 00:13:18 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-1c2b2933-8b2c-4db5-9716-38a5fa9725d8 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Removing single pathed devices sdc {{(pid=75165) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 00:13:18 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:13:18 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:13:18 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[706323fd-5044-4b1f-a056-d812f8c4c9a8]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:13:18 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:13:18 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:13:18 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb7aa6d1-5767-4c2e-a9bf-f7d6fa56c70e]: (4, ('ok\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:13:18 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-1c2b2933-8b2c-4db5-9716-38a5fa9725d8 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Flushing IO for device /dev/sdc {{(pid=75165) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 00:13:18 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:13:18 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:13:18 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc0693dd-af6d-4f0d-a31f-c8e27d906ae1]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:13:18 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-1c2b2933-8b2c-4db5-9716-38a5fa9725d8 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75165) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 00:13:18 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:13:18 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:13:18 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e8d71f5-ff11-46b2-a0f3-fb14e69cf70e]: (4, ('1', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:13:18 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-1c2b2933-8b2c-4db5-9716-38a5fa9725d8 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75165) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 00:13:18 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-1c2b2933-8b2c-4db5-9716-38a5fa9725d8 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] SCSI volumes sdc have been removed. {{(pid=75165) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 00:13:18 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c2b2933-8b2c-4db5-9716-38a5fa9725d8 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3664944a-e477-4f40-9b8f-2dce50a14ea8')] {{(pid=75165) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 00:13:18 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3664944a-e477-4f40-9b8f-2dce50a14ea8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:13:18 user nova-compute[75165]: DEBUG nova.compute.manager [req-9c4e8e35-fb48-4a82-b00d-d62cc57a8165 req-87c0a904-4ca1-4407-a418-13f5dca5a99d service nova] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] Received event network-changed-1d6d497c-7382-4dff-b136-d1220b05a838 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:13:18 user nova-compute[75165]: DEBUG nova.compute.manager [req-9c4e8e35-fb48-4a82-b00d-d62cc57a8165 req-87c0a904-4ca1-4407-a418-13f5dca5a99d service nova] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] Refreshing instance network info cache due to event network-changed-1d6d497c-7382-4dff-b136-d1220b05a838. {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 00:13:18 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-9c4e8e35-fb48-4a82-b00d-d62cc57a8165 req-87c0a904-4ca1-4407-a418-13f5dca5a99d service nova] Acquiring lock "refresh_cache-26a0b493-bb47-466e-95d5-945fc3849fa5" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:13:18 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-9c4e8e35-fb48-4a82-b00d-d62cc57a8165 req-87c0a904-4ca1-4407-a418-13f5dca5a99d service nova] Acquired lock "refresh_cache-26a0b493-bb47-466e-95d5-945fc3849fa5" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:13:18 user nova-compute[75165]: DEBUG nova.network.neutron [req-9c4e8e35-fb48-4a82-b00d-d62cc57a8165 req-87c0a904-4ca1-4407-a418-13f5dca5a99d service nova] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] Refreshing network info cache for port 1d6d497c-7382-4dff-b136-d1220b05a838 {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 00:13:18 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3664944a-e477-4f40-9b8f-2dce50a14ea8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:13:18 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[aee36471-2c37-477a-981b-1debbd68090e]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:13:18 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c2b2933-8b2c-4db5-9716-38a5fa9725d8 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:13:18 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3664944a-e477-4f40-9b8f-2dce50a14ea8 -p 172.16.0.220:3260 --logout {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:13:18 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3664944a-e477-4f40-9b8f-2dce50a14ea8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:13:18 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[9796ece6-9dec-4c44-80c9-8e49923a5516]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:3664944a-e477-4f40-9b8f-2dce50a14ea8, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:3664944a-e477-4f40-9b8f-2dce50a14ea8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:13:18 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c2b2933-8b2c-4db5-9716-38a5fa9725d8 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:3664944a-e477-4f40-9b8f-2dce50a14ea8, portal: 172.16.0.220,3260]
Oct 26 00:13:18 user nova-compute[75165]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:3664944a-e477-4f40-9b8f-2dce50a14ea8, portal: 172.16.0.220,3260] successful.
Oct 26 00:13:18 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:13:18 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3664944a-e477-4f40-9b8f-2dce50a14ea8 -p 172.16.0.220:3260 --op delete {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:13:18 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3664944a-e477-4f40-9b8f-2dce50a14ea8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:13:18 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[a04657a7-c441-49d1-8c06-4251706e744c]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:13:18 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c2b2933-8b2c-4db5-9716-38a5fa9725d8 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:13:18 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-1c2b2933-8b2c-4db5-9716-38a5fa9725d8 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.328s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:13:18 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c2b2933-8b2c-4db5-9716-38a5fa9725d8 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] <== disconnect_volume: return (329ms) None {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:13:18 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c2b2933-8b2c-4db5-9716-38a5fa9725d8 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] [instance: 6f9add59-cabe-4965-8fe3-524618550581] Disconnected iSCSI Volume {{(pid=75165) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 00:13:18 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:13:18 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:13:18 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:13:18 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:13:18 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:13:18 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: 22b9689c-5e83-4807-971f-5b244914b7e5] Instance destroyed successfully.
Oct 26 00:13:18 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:10:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1910763507',display_name='tempest-ServerActionsTestOtherA-server-1799034720',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1910763507',id=15,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCbhvVGCZXABV5ClHwat9SYVr8+lkr4CuPT9Dr+1j4V+RKNDUlpTwy+TnUJZqw7wFY9APF0iWveIh7WwEW0pFasiIl6gv4XcNnJZaIxKvWAEAIXLwvXZamBlkbyJ/XzEvA==',key_name='tempest-keypair-730793300',keypairs=<?>,launch_index=0,launched_at=2023-10-26T00:11:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2911497df44047d9a9ee36a5652298bc',ramdisk_id='',reservation_id='r-h69c2nn0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1690932306',owner_user_name='tempest-ServerActionsTestOtherA-1690932306-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T00:13:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b3ce94f4c01446ebf79a1eba3833e01',uuid=22b9689c-5e83-4807-971f-5b244914b7e5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "15022d7e-be4a-480d-a612-31e1e689f43b", "address": "fa:16:3e:23:d1:cb", "network": {"id": "bd1c84f9-bba9-4a23-8bf2-17e65022136a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1557945804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2911497df44047d9a9ee36a5652298bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15022d7e-be", "ovs_interfaceid": "15022d7e-be4a-480d-a612-31e1e689f43b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 00:13:18 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Converting VIF {"id": "15022d7e-be4a-480d-a612-31e1e689f43b", "address": "fa:16:3e:23:d1:cb", "network": {"id": "bd1c84f9-bba9-4a23-8bf2-17e65022136a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1557945804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2911497df44047d9a9ee36a5652298bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15022d7e-be", "ovs_interfaceid": "15022d7e-be4a-480d-a612-31e1e689f43b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:13:18 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:23:d1:cb,bridge_name='br-int',has_traffic_filtering=True,id=15022d7e-be4a-480d-a612-31e1e689f43b,network=Network(bd1c84f9-bba9-4a23-8bf2-17e65022136a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15022d7e-be') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:13:18 user nova-compute[75165]: DEBUG os_vif [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:d1:cb,bridge_name='br-int',has_traffic_filtering=True,id=15022d7e-be4a-480d-a612-31e1e689f43b,network=Network(bd1c84f9-bba9-4a23-8bf2-17e65022136a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15022d7e-be') {{(pid=75165) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 00:13:18 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:13:18 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap15022d7e-be, bridge=br-int, if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:13:18 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:13:18 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:13:18 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:13:18 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=37674b94-fe36-4fc6-944a-94a29723428c) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:13:18 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:13:18 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:13:18 user nova-compute[75165]: INFO os_vif [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:d1:cb,bridge_name='br-int',has_traffic_filtering=True,id=15022d7e-be4a-480d-a612-31e1e689f43b,network=Network(bd1c84f9-bba9-4a23-8bf2-17e65022136a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15022d7e-be')
Oct 26 00:13:18 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: 22b9689c-5e83-4807-971f-5b244914b7e5] calling os-brick to detach iSCSI Volume {{(pid=75165) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 00:13:18 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8bf8160e50>, {'target_iqn': 'iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'efsGqiyv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:13:18 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 26 00:13:18 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:13:18 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:13:18 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:13:18 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:13:18 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad27df47-fb67-4b4e-853d-75497916f122]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:13:18 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 00:13:18 user nova-compute[75165]: No targets found.
Oct 26 00:13:18 user nova-compute[75165]: iSNS:
Oct 26 00:13:18 user nova-compute[75165]: No targets found.
Oct 26 00:13:18 user nova-compute[75165]: STATIC:
Oct 26 00:13:18 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792
Oct 26 00:13:18 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:13:18 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:13:18 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b
Oct 26 00:13:18 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:13:18 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:13:18 user nova-compute[75165]: FIRMWARE:
Oct 26 00:13:18 user nova-compute[75165]: No targets found.
Oct 26 00:13:18 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:13:18 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 00:13:18 user nova-compute[75165]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 00:13:18 user nova-compute[75165]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75165) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 00:13:18 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b', 0)] {{(pid=75165) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 00:13:18 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:13:18 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:13:18 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[232fdd06-ee68-492f-8823-34363b950489]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:13:18 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:13:18 user nova-compute[75165]: DEBUG nova.network.neutron [req-9c4e8e35-fb48-4a82-b00d-d62cc57a8165 req-87c0a904-4ca1-4407-a418-13f5dca5a99d service nova] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] Updated VIF entry in instance network info cache for port 1d6d497c-7382-4dff-b136-d1220b05a838. {{(pid=75165) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 00:13:18 user nova-compute[75165]: DEBUG nova.network.neutron [req-9c4e8e35-fb48-4a82-b00d-d62cc57a8165 req-87c0a904-4ca1-4407-a418-13f5dca5a99d service nova] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] Updating instance_info_cache with network_info: [{"id": "1d6d497c-7382-4dff-b136-d1220b05a838", "address": "fa:16:3e:d3:eb:fb", "network": {"id": "08c51c53-4819-493e-b4eb-df5d6024d43d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1633769998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9cbae16d09ed4474bb6653f08165a4e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d6d497c-73", "ovs_interfaceid": "1d6d497c-7382-4dff-b136-d1220b05a838", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:13:18 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:13:18 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab6d9a06-79b6-4aac-835a-11062af52f02]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:13:18 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792 (non-flash)
Oct 26 00:13:18 user nova-compute[75165]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b (non-flash)
Oct 26 00:13:18 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:13:18 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792 (non-flash)
Oct 26 00:13:18 user nova-compute[75165]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b (non-flash)
Oct 26 00:13:18 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:13:18 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8c0154d360>, {}) {{(pid=75165) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 00:13:18 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Disconnecting from: [] {{(pid=75165) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 00:13:18 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.078s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:13:18 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] <== disconnect_volume: return (79ms) None {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:13:18 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: 22b9689c-5e83-4807-971f-5b244914b7e5] Disconnected iSCSI Volume {{(pid=75165) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 00:13:18 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: 22b9689c-5e83-4807-971f-5b244914b7e5] Deleting instance files /opt/stack/data/nova/instances/22b9689c-5e83-4807-971f-5b244914b7e5_del
Oct 26 00:13:18 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: 22b9689c-5e83-4807-971f-5b244914b7e5] Deletion of /opt/stack/data/nova/instances/22b9689c-5e83-4807-971f-5b244914b7e5_del complete
Oct 26 00:13:18 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-9c4e8e35-fb48-4a82-b00d-d62cc57a8165 req-87c0a904-4ca1-4407-a418-13f5dca5a99d service nova] Releasing lock "refresh_cache-26a0b493-bb47-466e-95d5-945fc3849fa5" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:13:18 user nova-compute[75165]: DEBUG nova.compute.manager [req-9c4e8e35-fb48-4a82-b00d-d62cc57a8165 req-87c0a904-4ca1-4407-a418-13f5dca5a99d service nova] [instance: 22b9689c-5e83-4807-971f-5b244914b7e5] Received event network-vif-unplugged-15022d7e-be4a-480d-a612-31e1e689f43b {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:13:18 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-9c4e8e35-fb48-4a82-b00d-d62cc57a8165 req-87c0a904-4ca1-4407-a418-13f5dca5a99d service nova] Acquiring lock "22b9689c-5e83-4807-971f-5b244914b7e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:13:18 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-9c4e8e35-fb48-4a82-b00d-d62cc57a8165 req-87c0a904-4ca1-4407-a418-13f5dca5a99d service nova] Lock "22b9689c-5e83-4807-971f-5b244914b7e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:13:18 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-9c4e8e35-fb48-4a82-b00d-d62cc57a8165 req-87c0a904-4ca1-4407-a418-13f5dca5a99d service nova] Lock "22b9689c-5e83-4807-971f-5b244914b7e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:13:18 user nova-compute[75165]: DEBUG nova.compute.manager [req-9c4e8e35-fb48-4a82-b00d-d62cc57a8165 req-87c0a904-4ca1-4407-a418-13f5dca5a99d service nova] [instance: 22b9689c-5e83-4807-971f-5b244914b7e5] No waiting events found dispatching network-vif-unplugged-15022d7e-be4a-480d-a612-31e1e689f43b {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:13:18 user nova-compute[75165]: WARNING nova.compute.manager [req-9c4e8e35-fb48-4a82-b00d-d62cc57a8165 req-87c0a904-4ca1-4407-a418-13f5dca5a99d service nova] [instance: 22b9689c-5e83-4807-971f-5b244914b7e5] Received unexpected event network-vif-unplugged-15022d7e-be4a-480d-a612-31e1e689f43b for instance with vm_state active and task_state rebuilding.
Oct 26 00:13:18 user nova-compute[75165]: DEBUG nova.compute.manager [req-9c4e8e35-fb48-4a82-b00d-d62cc57a8165 req-87c0a904-4ca1-4407-a418-13f5dca5a99d service nova] [instance: 22b9689c-5e83-4807-971f-5b244914b7e5] Received event network-vif-plugged-15022d7e-be4a-480d-a612-31e1e689f43b {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:13:18 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-9c4e8e35-fb48-4a82-b00d-d62cc57a8165 req-87c0a904-4ca1-4407-a418-13f5dca5a99d service nova] Acquiring lock "22b9689c-5e83-4807-971f-5b244914b7e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:13:18 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-9c4e8e35-fb48-4a82-b00d-d62cc57a8165 req-87c0a904-4ca1-4407-a418-13f5dca5a99d service nova] Lock "22b9689c-5e83-4807-971f-5b244914b7e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:13:18 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-9c4e8e35-fb48-4a82-b00d-d62cc57a8165 req-87c0a904-4ca1-4407-a418-13f5dca5a99d service nova] Lock "22b9689c-5e83-4807-971f-5b244914b7e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:13:18 user nova-compute[75165]: DEBUG nova.compute.manager [req-9c4e8e35-fb48-4a82-b00d-d62cc57a8165 req-87c0a904-4ca1-4407-a418-13f5dca5a99d service nova] [instance: 22b9689c-5e83-4807-971f-5b244914b7e5] No waiting events found dispatching network-vif-plugged-15022d7e-be4a-480d-a612-31e1e689f43b {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:13:18 user nova-compute[75165]: WARNING nova.compute.manager [req-9c4e8e35-fb48-4a82-b00d-d62cc57a8165 req-87c0a904-4ca1-4407-a418-13f5dca5a99d service nova] [instance: 22b9689c-5e83-4807-971f-5b244914b7e5] Received unexpected event network-vif-plugged-15022d7e-be4a-480d-a612-31e1e689f43b for instance with vm_state active and task_state rebuilding.
Oct 26 00:13:18 user nova-compute[75165]: INFO nova.virt.block_device [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: 22b9689c-5e83-4807-971f-5b244914b7e5] Booting with volume 33bd85b7-301b-434f-b1af-a682c33cf49b at /dev/vdb
Oct 26 00:13:18 user nova-compute[75165]: DEBUG os_brick.utils [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:13:18 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:13:18 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:13:18 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[f87dfca5-9ad1-4539-bc12-2df1a65f0cfb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa94814ccb35\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:13:18 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:13:19 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:13:19 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fcdc85b-5b89-4dbf-a1ea-64b8d51d114a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:13:19 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:13:19 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:13:19 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7146e26-be51-4e09-9db4-c1c5c1c3c3c1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:13:19 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[98beb917-d0f4-4992-95fa-e426a4bdf140]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:13:19 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Running cmd (subprocess): nvme version {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:13:19 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] 'nvme version' failed. Not Retrying. {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 00:13:19 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] nvme not present on system {{(pid=75165) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 00:13:19 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:13:19 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 00:13:19 user nova-compute[75165]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 00:13:19 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c51cf29-6e93-46b1-993e-68fe9e7e989b]: (4, '') {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:13:19 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75165) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 00:13:19 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75165) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 00:13:19 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] LIGHTOS: no hostnqn found. {{(pid=75165) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 00:13:19 user nova-compute[75165]: DEBUG os_brick.utils [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa94814ccb35', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:13:19 user nova-compute[75165]: DEBUG nova.virt.block_device [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: 22b9689c-5e83-4807-971f-5b244914b7e5] Updating existing volume attachment record: 48bf80dd-17d2-424b-b90f-07d7e1aa23af {{(pid=75165) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 00:13:19 user nova-compute[75165]: DEBUG nova.compute.manager [req-0375a078-e6e0-40be-92e0-a0c8b4434cbd req-8b08947e-c719-48ce-8a7a-ddfdc62aa621 service nova] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] Received event network-vif-plugged-1d6d497c-7382-4dff-b136-d1220b05a838 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:13:19 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-0375a078-e6e0-40be-92e0-a0c8b4434cbd req-8b08947e-c719-48ce-8a7a-ddfdc62aa621 service nova] Acquiring lock "26a0b493-bb47-466e-95d5-945fc3849fa5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:13:19 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-0375a078-e6e0-40be-92e0-a0c8b4434cbd req-8b08947e-c719-48ce-8a7a-ddfdc62aa621 service nova] Lock "26a0b493-bb47-466e-95d5-945fc3849fa5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:13:19 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-0375a078-e6e0-40be-92e0-a0c8b4434cbd req-8b08947e-c719-48ce-8a7a-ddfdc62aa621 service nova] Lock "26a0b493-bb47-466e-95d5-945fc3849fa5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:13:19 user nova-compute[75165]: DEBUG nova.compute.manager [req-0375a078-e6e0-40be-92e0-a0c8b4434cbd req-8b08947e-c719-48ce-8a7a-ddfdc62aa621 service nova] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] No waiting events found dispatching network-vif-plugged-1d6d497c-7382-4dff-b136-d1220b05a838 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:13:19 user nova-compute[75165]: WARNING nova.compute.manager [req-0375a078-e6e0-40be-92e0-a0c8b4434cbd req-8b08947e-c719-48ce-8a7a-ddfdc62aa621 service nova] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] Received unexpected event network-vif-plugged-1d6d497c-7382-4dff-b136-d1220b05a838 for instance with vm_state rescued and task_state unrescuing.
Oct 26 00:13:19 user nova-compute[75165]: DEBUG nova.compute.manager [req-0375a078-e6e0-40be-92e0-a0c8b4434cbd req-8b08947e-c719-48ce-8a7a-ddfdc62aa621 service nova] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] Received event network-vif-plugged-1d6d497c-7382-4dff-b136-d1220b05a838 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:13:19 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-0375a078-e6e0-40be-92e0-a0c8b4434cbd req-8b08947e-c719-48ce-8a7a-ddfdc62aa621 service nova] Acquiring lock "26a0b493-bb47-466e-95d5-945fc3849fa5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:13:19 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-0375a078-e6e0-40be-92e0-a0c8b4434cbd req-8b08947e-c719-48ce-8a7a-ddfdc62aa621 service nova] Lock "26a0b493-bb47-466e-95d5-945fc3849fa5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:13:19 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-0375a078-e6e0-40be-92e0-a0c8b4434cbd req-8b08947e-c719-48ce-8a7a-ddfdc62aa621 service nova] Lock "26a0b493-bb47-466e-95d5-945fc3849fa5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:13:19 user nova-compute[75165]: DEBUG nova.compute.manager [req-0375a078-e6e0-40be-92e0-a0c8b4434cbd req-8b08947e-c719-48ce-8a7a-ddfdc62aa621 service nova] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] No waiting events found dispatching network-vif-plugged-1d6d497c-7382-4dff-b136-d1220b05a838 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:13:19 user nova-compute[75165]: WARNING nova.compute.manager [req-0375a078-e6e0-40be-92e0-a0c8b4434cbd req-8b08947e-c719-48ce-8a7a-ddfdc62aa621 service nova] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] Received unexpected event network-vif-plugged-1d6d497c-7382-4dff-b136-d1220b05a838 for instance with vm_state rescued and task_state unrescuing.
Oct 26 00:13:19 user nova-compute[75165]: DEBUG nova.compute.manager [None req-17724f3d-6c72-48cc-a432-2f9234780a57 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] Checking state {{(pid=75165) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 00:13:20 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:13:23 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:13:23 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:13:25 user nova-compute[75165]: DEBUG nova.network.neutron [None req-8189bf2e-b7ce-4d84-8369-4141f82fa737 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] Port 874a1698-c52c-444c-bed5-52633dbaeead binding to destination host user is already ACTIVE {{(pid=75165) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Oct 26 00:13:25 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-8189bf2e-b7ce-4d84-8369-4141f82fa737 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Acquiring lock "refresh_cache-3b153af2-c93b-47d2-ae8c-76cfd44e384c" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:13:25 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-8189bf2e-b7ce-4d84-8369-4141f82fa737 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Acquired lock "refresh_cache-3b153af2-c93b-47d2-ae8c-76cfd44e384c" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:13:25 user nova-compute[75165]: DEBUG nova.network.neutron [None req-8189bf2e-b7ce-4d84-8369-4141f82fa737 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] Building network info cache for instance {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 00:13:25 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:13:26 user nova-compute[75165]: DEBUG nova.network.neutron [None req-8189bf2e-b7ce-4d84-8369-4141f82fa737 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] Updating instance_info_cache with network_info: [{"id": "874a1698-c52c-444c-bed5-52633dbaeead", "address": "fa:16:3e:75:45:79", "network": {"id": "30951418-d830-4042-9143-c736802150e9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-167387787-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0db2c49ee28f4b7b9fa990faddb9d3a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap874a1698-c5", "ovs_interfaceid": "874a1698-c52c-444c-bed5-52633dbaeead", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:13:26 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-8189bf2e-b7ce-4d84-8369-4141f82fa737 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Releasing lock "refresh_cache-3b153af2-c93b-47d2-ae8c-76cfd44e384c" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:13:26 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-8189bf2e-b7ce-4d84-8369-4141f82fa737 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] Creating tmpfile /opt/stack/data/nova/instances/3b153af2-c93b-47d2-ae8c-76cfd44e384c/tmpgm3jzbql to verify with other compute node that the instance is on the same shared storage. {{(pid=75165) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9628}}
Oct 26 00:13:26 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:13:26 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:13:26 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:13:26 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:13:26 user nova-compute[75165]: DEBUG nova.compute.manager [req-d94cee5e-024d-45a9-8253-d476b362ee9d req-8c01e5af-af69-4865-96f6-0b588855aeea service nova] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] Received event network-vif-unplugged-874a1698-c52c-444c-bed5-52633dbaeead {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:13:26 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-d94cee5e-024d-45a9-8253-d476b362ee9d req-8c01e5af-af69-4865-96f6-0b588855aeea service nova] Acquiring lock "3b153af2-c93b-47d2-ae8c-76cfd44e384c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:13:26 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-d94cee5e-024d-45a9-8253-d476b362ee9d req-8c01e5af-af69-4865-96f6-0b588855aeea service nova] Lock "3b153af2-c93b-47d2-ae8c-76cfd44e384c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:13:26 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-d94cee5e-024d-45a9-8253-d476b362ee9d req-8c01e5af-af69-4865-96f6-0b588855aeea service nova] Lock "3b153af2-c93b-47d2-ae8c-76cfd44e384c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:13:26 user nova-compute[75165]: DEBUG nova.compute.manager [req-d94cee5e-024d-45a9-8253-d476b362ee9d req-8c01e5af-af69-4865-96f6-0b588855aeea service nova] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] No waiting events found dispatching network-vif-unplugged-874a1698-c52c-444c-bed5-52633dbaeead {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:13:26 user nova-compute[75165]: WARNING nova.compute.manager [req-d94cee5e-024d-45a9-8253-d476b362ee9d req-8c01e5af-af69-4865-96f6-0b588855aeea service nova] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] Received unexpected event network-vif-unplugged-874a1698-c52c-444c-bed5-52633dbaeead for instance with vm_state resized and task_state resize_reverting.
Oct 26 00:13:27 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:13:27 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] Instance destroyed successfully.
Oct 26 00:13:27 user nova-compute[75165]: DEBUG nova.objects.instance [None req-8189bf2e-b7ce-4d84-8369-4141f82fa737 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Lazy-loading 'resources' on Instance uuid 3b153af2-c93b-47d2-ae8c-76cfd44e384c {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:13:27 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-8189bf2e-b7ce-4d84-8369-4141f82fa737 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:07:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1649801525',display_name='tempest-ServerActionsTestOtherB-server-1649801525',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1649801525',id=7,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOvLHGJ3GKBbD7yL0+CRyOJiq2ETP4pGNCe7wwUyptp7nQivcPunaHj7Jl8TaU2mAtfcWQAgpHGkK+GRkPrduKn69eOts5d8qkM1kDwYiMG7whEGtVeGR66PH/dfoMGjVA==',key_name='tempest-keypair-513358976',keypairs=<?>,launch_index=0,launched_at=2023-10-26T00:12:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0db2c49ee28f4b7b9fa990faddb9d3a9',ramdisk_id='',reservation_id='r-tna5v2cw',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-238342146',owner_user_name='tempest-ServerActionsTestOtherB-238342146-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T00:12:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43f095bccf684d5a84b874439f2c58e0',uuid=3b153af2-c93b-47d2-ae8c-76cfd44e384c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "874a1698-c52c-444c-bed5-52633dbaeead", "address": "fa:16:3e:75:45:79", "network": {"id": "30951418-d830-4042-9143-c736802150e9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-167387787-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0db2c49ee28f4b7b9fa990faddb9d3a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap874a1698-c5", "ovs_interfaceid": "874a1698-c52c-444c-bed5-52633dbaeead", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 00:13:27 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-8189bf2e-b7ce-4d84-8369-4141f82fa737 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Converting VIF {"id": "874a1698-c52c-444c-bed5-52633dbaeead", "address": "fa:16:3e:75:45:79", "network": {"id": "30951418-d830-4042-9143-c736802150e9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-167387787-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0db2c49ee28f4b7b9fa990faddb9d3a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap874a1698-c5", "ovs_interfaceid": "874a1698-c52c-444c-bed5-52633dbaeead", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:13:27 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-8189bf2e-b7ce-4d84-8369-4141f82fa737 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:75:45:79,bridge_name='br-int',has_traffic_filtering=True,id=874a1698-c52c-444c-bed5-52633dbaeead,network=Network(30951418-d830-4042-9143-c736802150e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap874a1698-c5') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:13:27 user nova-compute[75165]: DEBUG os_vif [None req-8189bf2e-b7ce-4d84-8369-4141f82fa737 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:75:45:79,bridge_name='br-int',has_traffic_filtering=True,id=874a1698-c52c-444c-bed5-52633dbaeead,network=Network(30951418-d830-4042-9143-c736802150e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap874a1698-c5') {{(pid=75165) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 00:13:27 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:13:27 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap874a1698-c5, bridge=br-int, if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:13:27 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:13:27 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:13:27 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:13:27 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=61849163-96e9-4304-a263-fe02cec74289) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:13:27 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:13:27 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:13:27 user nova-compute[75165]: INFO os_vif [None req-8189bf2e-b7ce-4d84-8369-4141f82fa737 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:75:45:79,bridge_name='br-int',has_traffic_filtering=True,id=874a1698-c52c-444c-bed5-52633dbaeead,network=Network(30951418-d830-4042-9143-c736802150e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap874a1698-c5')
Oct 26 00:13:27 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8189bf2e-b7ce-4d84-8369-4141f82fa737 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] calling os-brick to detach iSCSI Volume {{(pid=75165) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 00:13:27 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-8189bf2e-b7ce-4d84-8369-4141f82fa737 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8bf8160e50>, {'target_iqn': 'iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AokCQquF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:13:27 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-8189bf2e-b7ce-4d84-8369-4141f82fa737 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:13:27 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-8189bf2e-b7ce-4d84-8369-4141f82fa737 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:13:27 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-8189bf2e-b7ce-4d84-8369-4141f82fa737 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:13:27 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:13:27 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:13:27 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[a168b16c-1ca8-406b-8647-af629a22add1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:13:27 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-8189bf2e-b7ce-4d84-8369-4141f82fa737 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 00:13:27 user nova-compute[75165]: No targets found.
Oct 26 00:13:27 user nova-compute[75165]: iSNS:
Oct 26 00:13:27 user nova-compute[75165]: No targets found.
Oct 26 00:13:27 user nova-compute[75165]: STATIC:
Oct 26 00:13:27 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792
Oct 26 00:13:27 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:13:27 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:13:27 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b
Oct 26 00:13:27 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:13:27 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:13:27 user nova-compute[75165]: FIRMWARE:
Oct 26 00:13:27 user nova-compute[75165]: No targets found.
Oct 26 00:13:27 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:13:27 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-8189bf2e-b7ce-4d84-8369-4141f82fa737 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 00:13:27 user nova-compute[75165]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 00:13:27 user nova-compute[75165]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75165) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 00:13:27 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-8189bf2e-b7ce-4d84-8369-4141f82fa737 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b', 0)] {{(pid=75165) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 00:13:27 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:13:27 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:13:27 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7ef0558-98b9-4b82-b3ac-c97b5ee85220]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:13:27 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:13:27 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:13:27 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[02b99ddf-5a74-4dd1-8303-ee09b535ea8b]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:13:27 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-8189bf2e-b7ce-4d84-8369-4141f82fa737 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792 (non-flash)
Oct 26 00:13:27 user nova-compute[75165]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b (non-flash)
Oct 26 00:13:27 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:13:27 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-8189bf2e-b7ce-4d84-8369-4141f82fa737 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792 (non-flash)
Oct 26 00:13:27 user nova-compute[75165]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b (non-flash)
Oct 26 00:13:27 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:13:27 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-8189bf2e-b7ce-4d84-8369-4141f82fa737 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8be04bb130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b'): ({'sdd'}, set())}) {{(pid=75165) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 00:13:27 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-8189bf2e-b7ce-4d84-8369-4141f82fa737 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Removing single pathed devices sdd {{(pid=75165) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 00:13:27 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:13:27 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:13:27 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[81a7b70c-394c-4773-8a2a-fb8e56bd3779]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:13:27 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:13:27 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:13:27 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[50bc703d-a13f-4f32-b1a0-28d0c98bc773]: (4, ('ok\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:13:27 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-8189bf2e-b7ce-4d84-8369-4141f82fa737 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Flushing IO for device /dev/sdd {{(pid=75165) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 00:13:27 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:13:27 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:13:27 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d879a43-6389-49ef-afab-b8363976105f]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:13:27 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-8189bf2e-b7ce-4d84-8369-4141f82fa737 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75165) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 00:13:27 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:13:27 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.059s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:13:27 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[d966e08f-90b8-4916-ab29-147a844b29e7]: (4, ('1', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:13:27 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-8189bf2e-b7ce-4d84-8369-4141f82fa737 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75165) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 00:13:27 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-8189bf2e-b7ce-4d84-8369-4141f82fa737 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] SCSI volumes sdd have been removed. {{(pid=75165) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 00:13:27 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-8189bf2e-b7ce-4d84-8369-4141f82fa737 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b')] {{(pid=75165) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 00:13:27 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:13:27 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:13:27 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[03da999b-1582-425f-acb2-400185f97e85]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:13:27 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-8189bf2e-b7ce-4d84-8369-4141f82fa737 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:13:27 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b -p 172.16.0.220:3260 --logout {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:13:27 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:13:27 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8e7a9e5-2b55-4414-b0eb-2af2c7711d85]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:13:27 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-8189bf2e-b7ce-4d84-8369-4141f82fa737 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b, portal: 172.16.0.220,3260]
Oct 26 00:13:27 user nova-compute[75165]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b, portal: 172.16.0.220,3260] successful.
Oct 26 00:13:27 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:13:27 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b -p 172.16.0.220:3260 --op delete {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:13:27 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:13:27 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[f948dde6-19c6-4e47-b596-a9f0cbe1616e]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:13:27 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-8189bf2e-b7ce-4d84-8369-4141f82fa737 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:13:27 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-8189bf2e-b7ce-4d84-8369-4141f82fa737 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:13:27 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-8189bf2e-b7ce-4d84-8369-4141f82fa737 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] <== disconnect_volume: return (336ms) None {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:13:27 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8189bf2e-b7ce-4d84-8369-4141f82fa737 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] Disconnected iSCSI Volume {{(pid=75165) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 00:13:28 user nova-compute[75165]: DEBUG nova.compute.manager [req-44262e8b-da68-4cca-a35f-c928b36d3bac req-6256879c-53b8-48ca-9d6a-aea61c7dfa3b service nova] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] Received event network-vif-plugged-874a1698-c52c-444c-bed5-52633dbaeead {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:13:28 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-44262e8b-da68-4cca-a35f-c928b36d3bac req-6256879c-53b8-48ca-9d6a-aea61c7dfa3b service nova] Acquiring lock "3b153af2-c93b-47d2-ae8c-76cfd44e384c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:13:28 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-44262e8b-da68-4cca-a35f-c928b36d3bac req-6256879c-53b8-48ca-9d6a-aea61c7dfa3b service nova] Lock "3b153af2-c93b-47d2-ae8c-76cfd44e384c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:13:28 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-44262e8b-da68-4cca-a35f-c928b36d3bac req-6256879c-53b8-48ca-9d6a-aea61c7dfa3b service nova] Lock "3b153af2-c93b-47d2-ae8c-76cfd44e384c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:13:28 user nova-compute[75165]: DEBUG nova.compute.manager [req-44262e8b-da68-4cca-a35f-c928b36d3bac req-6256879c-53b8-48ca-9d6a-aea61c7dfa3b service nova] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] No waiting events found dispatching network-vif-plugged-874a1698-c52c-444c-bed5-52633dbaeead {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:13:28 user nova-compute[75165]: WARNING nova.compute.manager [req-44262e8b-da68-4cca-a35f-c928b36d3bac req-6256879c-53b8-48ca-9d6a-aea61c7dfa3b service nova] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] Received unexpected event network-vif-plugged-874a1698-c52c-444c-bed5-52633dbaeead for instance with vm_state resized and task_state resize_reverting.
Oct 26 00:13:28 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-8189bf2e-b7ce-4d84-8369-4141f82fa737 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:13:28 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-8189bf2e-b7ce-4d84-8369-4141f82fa737 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:13:28 user nova-compute[75165]: DEBUG nova.objects.instance [None req-8189bf2e-b7ce-4d84-8369-4141f82fa737 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Lazy-loading 'migration_context' on Instance uuid 3b153af2-c93b-47d2-ae8c-76cfd44e384c {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:13:28 user nova-compute[75165]: DEBUG nova.objects.base [None req-8189bf2e-b7ce-4d84-8369-4141f82fa737 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Object Instance<3b153af2-c93b-47d2-ae8c-76cfd44e384c> lazy-loaded attributes: resources,migration_context {{(pid=75165) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 00:13:29 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-8189bf2e-b7ce-4d84-8369-4141f82fa737 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:13:29 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-8189bf2e-b7ce-4d84-8369-4141f82fa737 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:13:29 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-8189bf2e-b7ce-4d84-8369-4141f82fa737 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.553s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:13:29 user nova-compute[75165]: INFO nova.compute.manager [None req-8189bf2e-b7ce-4d84-8369-4141f82fa737 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] Swapping old allocation on dict_keys(['03214fd5-21d1-46ec-b6b0-6449b77ba230']) held by migration cc70c217-87db-48a3-b078-678e5f102287 for instance
Oct 26 00:13:29 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-8189bf2e-b7ce-4d84-8369-4141f82fa737 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Overwriting current allocation {'allocations': {'03214fd5-21d1-46ec-b6b0-6449b77ba230': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 24}}, 'project_id': '0db2c49ee28f4b7b9fa990faddb9d3a9', 'user_id': '43f095bccf684d5a84b874439f2c58e0', 'consumer_generation': 1} on consumer 3b153af2-c93b-47d2-ae8c-76cfd44e384c {{(pid=75165) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Oct 26 00:13:30 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-8189bf2e-b7ce-4d84-8369-4141f82fa737 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Acquiring lock "refresh_cache-3b153af2-c93b-47d2-ae8c-76cfd44e384c" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:13:30 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-8189bf2e-b7ce-4d84-8369-4141f82fa737 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Acquired lock "refresh_cache-3b153af2-c93b-47d2-ae8c-76cfd44e384c" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:13:30 user nova-compute[75165]: DEBUG nova.network.neutron [None req-8189bf2e-b7ce-4d84-8369-4141f82fa737 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] Building network info cache for instance {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 00:13:30 user nova-compute[75165]: DEBUG nova.network.neutron [None req-8189bf2e-b7ce-4d84-8369-4141f82fa737 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] Updating instance_info_cache with network_info: [{"id": "874a1698-c52c-444c-bed5-52633dbaeead", "address": "fa:16:3e:75:45:79", "network": {"id": "30951418-d830-4042-9143-c736802150e9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-167387787-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0db2c49ee28f4b7b9fa990faddb9d3a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap874a1698-c5", "ovs_interfaceid": "874a1698-c52c-444c-bed5-52633dbaeead", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:13:30 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-8189bf2e-b7ce-4d84-8369-4141f82fa737 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Releasing lock "refresh_cache-3b153af2-c93b-47d2-ae8c-76cfd44e384c" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:13:30 user nova-compute[75165]: DEBUG os_brick.utils [None req-8189bf2e-b7ce-4d84-8369-4141f82fa737 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:13:30 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:13:30 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:13:30 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[af4f0005-6c6b-4ad0-8bf4-3842cbdc1d8f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa94814ccb35\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:13:30 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:13:30 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:13:30 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[e691b91f-4ccf-490b-aa3a-79553def3cbd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:13:30 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:13:30 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:13:30 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[771fd9f2-fec8-40b5-9177-95ec85f83f7b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:13:30 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7266fdb-5575-4319-a2c5-6de9851dacc5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:13:30 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-8189bf2e-b7ce-4d84-8369-4141f82fa737 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Running cmd (subprocess): nvme version {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:13:30 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-8189bf2e-b7ce-4d84-8369-4141f82fa737 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] 'nvme version' failed. Not Retrying. {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 00:13:30 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8189bf2e-b7ce-4d84-8369-4141f82fa737 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] nvme not present on system {{(pid=75165) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 00:13:30 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:13:30 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:13:30 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 00:13:30 user nova-compute[75165]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 00:13:30 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[58eedcf2-c556-4d94-8202-ffa3cea719ca]: (4, '') {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:13:30 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-8189bf2e-b7ce-4d84-8369-4141f82fa737 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75165) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 00:13:30 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-8189bf2e-b7ce-4d84-8369-4141f82fa737 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75165) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 00:13:30 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-8189bf2e-b7ce-4d84-8369-4141f82fa737 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] LIGHTOS: no hostnqn found. {{(pid=75165) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 00:13:30 user nova-compute[75165]: DEBUG os_brick.utils [None req-8189bf2e-b7ce-4d84-8369-4141f82fa737 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa94814ccb35', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:13:31 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-a5e5373e-c1f5-4d02-a4a7-daca9284c692 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Acquiring lock "27fa1771-fb69-49da-81b3-7f112e623170" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:13:31 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-a5e5373e-c1f5-4d02-a4a7-daca9284c692 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Lock "27fa1771-fb69-49da-81b3-7f112e623170" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:13:31 user nova-compute[75165]: DEBUG nova.compute.manager [None req-a5e5373e-c1f5-4d02-a4a7-daca9284c692 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] [instance: 27fa1771-fb69-49da-81b3-7f112e623170] Starting instance... {{(pid=75165) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 00:13:31 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-a5e5373e-c1f5-4d02-a4a7-daca9284c692 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:13:31 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-a5e5373e-c1f5-4d02-a4a7-daca9284c692 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:13:31 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-a5e5373e-c1f5-4d02-a4a7-daca9284c692 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75165) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 00:13:31 user nova-compute[75165]: INFO nova.compute.claims [None req-a5e5373e-c1f5-4d02-a4a7-daca9284c692 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] [instance: 27fa1771-fb69-49da-81b3-7f112e623170] Claim successful on node user
Oct 26 00:13:31 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-a5e5373e-c1f5-4d02-a4a7-daca9284c692 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:13:31 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-a5e5373e-c1f5-4d02-a4a7-daca9284c692 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:13:31 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-a5e5373e-c1f5-4d02-a4a7-daca9284c692 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.600s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:13:31 user nova-compute[75165]: DEBUG nova.compute.manager [None req-a5e5373e-c1f5-4d02-a4a7-daca9284c692 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] [instance: 27fa1771-fb69-49da-81b3-7f112e623170] Start building networks asynchronously for instance. {{(pid=75165) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 00:13:32 user nova-compute[75165]: DEBUG nova.compute.manager [None req-a5e5373e-c1f5-4d02-a4a7-daca9284c692 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] [instance: 27fa1771-fb69-49da-81b3-7f112e623170] Allocating IP information in the background. {{(pid=75165) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 00:13:32 user nova-compute[75165]: DEBUG nova.network.neutron [None req-a5e5373e-c1f5-4d02-a4a7-daca9284c692 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] [instance: 27fa1771-fb69-49da-81b3-7f112e623170] allocate_for_instance() {{(pid=75165) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 00:13:32 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-a5e5373e-c1f5-4d02-a4a7-daca9284c692 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] [instance: 27fa1771-fb69-49da-81b3-7f112e623170] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 00:13:32 user nova-compute[75165]: DEBUG nova.compute.manager [None req-a5e5373e-c1f5-4d02-a4a7-daca9284c692 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] [instance: 27fa1771-fb69-49da-81b3-7f112e623170] Start building block device mappings for instance. {{(pid=75165) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 00:13:32 user nova-compute[75165]: DEBUG nova.policy [None req-a5e5373e-c1f5-4d02-a4a7-daca9284c692 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '841b5be7c0b348de979920fc9ae223ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffbf5c944914cafac7aba65fb7ca402', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75165) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 00:13:32 user nova-compute[75165]: DEBUG nova.compute.manager [None req-a5e5373e-c1f5-4d02-a4a7-daca9284c692 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] [instance: 27fa1771-fb69-49da-81b3-7f112e623170] Start spawning the instance on the hypervisor. {{(pid=75165) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 00:13:32 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-a5e5373e-c1f5-4d02-a4a7-daca9284c692 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] [instance: 27fa1771-fb69-49da-81b3-7f112e623170] Creating instance directory {{(pid=75165) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 00:13:32 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-a5e5373e-c1f5-4d02-a4a7-daca9284c692 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] [instance: 27fa1771-fb69-49da-81b3-7f112e623170] Creating image(s)
Oct 26 00:13:32 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-a5e5373e-c1f5-4d02-a4a7-daca9284c692 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Acquiring lock "/opt/stack/data/nova/instances/27fa1771-fb69-49da-81b3-7f112e623170/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:13:32 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-a5e5373e-c1f5-4d02-a4a7-daca9284c692 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Lock "/opt/stack/data/nova/instances/27fa1771-fb69-49da-81b3-7f112e623170/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:13:32 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-a5e5373e-c1f5-4d02-a4a7-daca9284c692 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Lock "/opt/stack/data/nova/instances/27fa1771-fb69-49da-81b3-7f112e623170/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:13:32 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-a5e5373e-c1f5-4d02-a4a7-daca9284c692 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:13:32 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:13:32 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-a5e5373e-c1f5-4d02-a4a7-daca9284c692 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json" returned: 0 in 0.181s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:13:32 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-a5e5373e-c1f5-4d02-a4a7-daca9284c692 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Acquiring lock "7d3243421cf3fdc288b758f687a93103b7b95466" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:13:32 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-a5e5373e-c1f5-4d02-a4a7-daca9284c692 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Lock "7d3243421cf3fdc288b758f687a93103b7b95466" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:13:32 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-a5e5373e-c1f5-4d02-a4a7-daca9284c692 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:13:32 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-a5e5373e-c1f5-4d02-a4a7-daca9284c692 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json" returned: 0 in 0.243s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:13:32 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-a5e5373e-c1f5-4d02-a4a7-daca9284c692 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466,backing_fmt=raw /opt/stack/data/nova/instances/27fa1771-fb69-49da-81b3-7f112e623170/disk 1073741824 {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:13:32 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-a5e5373e-c1f5-4d02-a4a7-daca9284c692 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466,backing_fmt=raw /opt/stack/data/nova/instances/27fa1771-fb69-49da-81b3-7f112e623170/disk 1073741824" returned: 0 in 0.065s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:13:32 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-a5e5373e-c1f5-4d02-a4a7-daca9284c692 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Lock "7d3243421cf3fdc288b758f687a93103b7b95466" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.318s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:13:32 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-a5e5373e-c1f5-4d02-a4a7-daca9284c692 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:13:32 user nova-compute[75165]: DEBUG nova.network.neutron [None req-a5e5373e-c1f5-4d02-a4a7-daca9284c692 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] [instance: 27fa1771-fb69-49da-81b3-7f112e623170] Successfully created port: 4d97651b-5d7c-4778-85a4-a11588892b31 {{(pid=75165) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 00:13:33 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-a5e5373e-c1f5-4d02-a4a7-daca9284c692 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json" returned: 0 in 0.256s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:13:33 user nova-compute[75165]: DEBUG nova.virt.disk.api [None req-a5e5373e-c1f5-4d02-a4a7-daca9284c692 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Checking if we can resize image /opt/stack/data/nova/instances/27fa1771-fb69-49da-81b3-7f112e623170/disk. size=1073741824 {{(pid=75165) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 00:13:33 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-a5e5373e-c1f5-4d02-a4a7-daca9284c692 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27fa1771-fb69-49da-81b3-7f112e623170/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:13:33 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-a5e5373e-c1f5-4d02-a4a7-daca9284c692 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27fa1771-fb69-49da-81b3-7f112e623170/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:13:33 user nova-compute[75165]: DEBUG nova.virt.disk.api [None req-a5e5373e-c1f5-4d02-a4a7-daca9284c692 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Cannot resize image /opt/stack/data/nova/instances/27fa1771-fb69-49da-81b3-7f112e623170/disk to a smaller size. {{(pid=75165) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 00:13:33 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-a5e5373e-c1f5-4d02-a4a7-daca9284c692 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] [instance: 27fa1771-fb69-49da-81b3-7f112e623170] Created local disks {{(pid=75165) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 00:13:33 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-a5e5373e-c1f5-4d02-a4a7-daca9284c692 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] [instance: 27fa1771-fb69-49da-81b3-7f112e623170] Ensure instance console log exists: /opt/stack/data/nova/instances/27fa1771-fb69-49da-81b3-7f112e623170/console.log {{(pid=75165) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 00:13:33 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-a5e5373e-c1f5-4d02-a4a7-daca9284c692 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:13:33 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-a5e5373e-c1f5-4d02-a4a7-daca9284c692 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:13:33 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-a5e5373e-c1f5-4d02-a4a7-daca9284c692 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:13:34 user nova-compute[75165]: DEBUG nova.network.neutron [None req-a5e5373e-c1f5-4d02-a4a7-daca9284c692 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] [instance: 27fa1771-fb69-49da-81b3-7f112e623170] Successfully updated port: 4d97651b-5d7c-4778-85a4-a11588892b31 {{(pid=75165) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 00:13:34 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-a5e5373e-c1f5-4d02-a4a7-daca9284c692 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Acquiring lock "refresh_cache-27fa1771-fb69-49da-81b3-7f112e623170" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:13:34 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-a5e5373e-c1f5-4d02-a4a7-daca9284c692 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Acquired lock "refresh_cache-27fa1771-fb69-49da-81b3-7f112e623170" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:13:34 user nova-compute[75165]: DEBUG nova.network.neutron [None req-a5e5373e-c1f5-4d02-a4a7-daca9284c692 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] [instance: 27fa1771-fb69-49da-81b3-7f112e623170] Building network info cache for instance {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 00:13:34 user nova-compute[75165]: DEBUG nova.compute.manager [req-d97a17ce-b528-441d-9ab4-cc0d9b678179 req-43b2ad8c-093c-4955-9b02-82046f946333 service nova] [instance: 27fa1771-fb69-49da-81b3-7f112e623170] Received event network-changed-4d97651b-5d7c-4778-85a4-a11588892b31 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:13:34 user nova-compute[75165]: DEBUG nova.compute.manager [req-d97a17ce-b528-441d-9ab4-cc0d9b678179 req-43b2ad8c-093c-4955-9b02-82046f946333 service nova] [instance: 27fa1771-fb69-49da-81b3-7f112e623170] Refreshing instance network info cache due to event network-changed-4d97651b-5d7c-4778-85a4-a11588892b31. {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 00:13:34 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-d97a17ce-b528-441d-9ab4-cc0d9b678179 req-43b2ad8c-093c-4955-9b02-82046f946333 service nova] Acquiring lock "refresh_cache-27fa1771-fb69-49da-81b3-7f112e623170" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:13:34 user nova-compute[75165]: DEBUG nova.network.neutron [None req-a5e5373e-c1f5-4d02-a4a7-daca9284c692 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] [instance: 27fa1771-fb69-49da-81b3-7f112e623170] Instance cache missing network info. {{(pid=75165) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 00:13:34 user nova-compute[75165]: DEBUG nova.network.neutron [None req-a5e5373e-c1f5-4d02-a4a7-daca9284c692 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] [instance: 27fa1771-fb69-49da-81b3-7f112e623170] Updating instance_info_cache with network_info: [{"id": "4d97651b-5d7c-4778-85a4-a11588892b31", "address": "fa:16:3e:c5:bb:76", "network": {"id": "7e330392-6256-405b-ab37-0b8af0c4fd48", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-430326049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ffbf5c944914cafac7aba65fb7ca402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d97651b-5d", "ovs_interfaceid": "4d97651b-5d7c-4778-85a4-a11588892b31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:13:34 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-a5e5373e-c1f5-4d02-a4a7-daca9284c692 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Releasing lock "refresh_cache-27fa1771-fb69-49da-81b3-7f112e623170" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:13:34 user nova-compute[75165]: DEBUG nova.compute.manager [None req-a5e5373e-c1f5-4d02-a4a7-daca9284c692 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] [instance: 27fa1771-fb69-49da-81b3-7f112e623170] Instance network_info: |[{"id": "4d97651b-5d7c-4778-85a4-a11588892b31", "address": "fa:16:3e:c5:bb:76", "network": {"id": "7e330392-6256-405b-ab37-0b8af0c4fd48", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-430326049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ffbf5c944914cafac7aba65fb7ca402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d97651b-5d", "ovs_interfaceid": "4d97651b-5d7c-4778-85a4-a11588892b31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75165) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 00:13:34 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-d97a17ce-b528-441d-9ab4-cc0d9b678179 req-43b2ad8c-093c-4955-9b02-82046f946333 service nova] Acquired lock "refresh_cache-27fa1771-fb69-49da-81b3-7f112e623170" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:13:34 user nova-compute[75165]: DEBUG nova.network.neutron [req-d97a17ce-b528-441d-9ab4-cc0d9b678179 req-43b2ad8c-093c-4955-9b02-82046f946333 service nova] [instance: 27fa1771-fb69-49da-81b3-7f112e623170] Refreshing network info cache for port 4d97651b-5d7c-4778-85a4-a11588892b31 {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 00:13:34 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-a5e5373e-c1f5-4d02-a4a7-daca9284c692 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] [instance: 27fa1771-fb69-49da-81b3-7f112e623170] Start _get_guest_xml network_info=[{"id": "4d97651b-5d7c-4778-85a4-a11588892b31", "address": "fa:16:3e:c5:bb:76", "network": {"id": "7e330392-6256-405b-ab37-0b8af0c4fd48", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-430326049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ffbf5c944914cafac7aba65fb7ca402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d97651b-5d", "ovs_interfaceid": "4d97651b-5d7c-4778-85a4-a11588892b31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T00:03:24Z,direct_url=<?>,disk_format='qcow2',id=bff0d8a1-739e-4c4d-9efa-b73ba7b76d01,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e56bbf444fd34c348475c73673611447',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T00:03:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'size': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': 'bff0d8a1-739e-4c4d-9efa-b73ba7b76d01'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75165) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 00:13:34 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-a5e5373e-c1f5-4d02-a4a7-daca9284c692 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:13:34 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-a5e5373e-c1f5-4d02-a4a7-daca9284c692 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:13:34 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-a5e5373e-c1f5-4d02-a4a7-daca9284c692 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75165) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 00:13:34 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-a5e5373e-c1f5-4d02-a4a7-daca9284c692 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] CPU controller missing on host. {{(pid=75165) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 00:13:34 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-a5e5373e-c1f5-4d02-a4a7-daca9284c692 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75165) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 00:13:34 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-a5e5373e-c1f5-4d02-a4a7-daca9284c692 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] CPU controller found on host. {{(pid=75165) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 00:13:34 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-a5e5373e-c1f5-4d02-a4a7-daca9284c692 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75165) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 00:13:34 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-a5e5373e-c1f5-4d02-a4a7-daca9284c692 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T00:03:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T00:03:24Z,direct_url=<?>,disk_format='qcow2',id=bff0d8a1-739e-4c4d-9efa-b73ba7b76d01,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e56bbf444fd34c348475c73673611447',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T00:03:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 00:13:34 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-a5e5373e-c1f5-4d02-a4a7-daca9284c692 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Flavor limits 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 00:13:34 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-a5e5373e-c1f5-4d02-a4a7-daca9284c692 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Image limits 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 00:13:34 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-a5e5373e-c1f5-4d02-a4a7-daca9284c692 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Flavor pref 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 00:13:34 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-a5e5373e-c1f5-4d02-a4a7-daca9284c692 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Image pref 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 00:13:34 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-a5e5373e-c1f5-4d02-a4a7-daca9284c692 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 00:13:34 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-a5e5373e-c1f5-4d02-a4a7-daca9284c692 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 00:13:34 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-a5e5373e-c1f5-4d02-a4a7-daca9284c692 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75165) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 00:13:34 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-a5e5373e-c1f5-4d02-a4a7-daca9284c692 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Got 1 possible topologies {{(pid=75165) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 00:13:34 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-a5e5373e-c1f5-4d02-a4a7-daca9284c692 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 00:13:34 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-a5e5373e-c1f5-4d02-a4a7-daca9284c692 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 00:13:34 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-a5e5373e-c1f5-4d02-a4a7-daca9284c692 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:13:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1390737120',display_name='tempest-AttachVolumeTestJSON-server-1390737120',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1390737120',id=20,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEolsf1MVpCHotOftiJQ4Zgsnx29J3YYZZ32cA7FaSf4r6DElmgaLg7eBXc3I/pwZzl9KTJMnY6YgVOXkfwz2nESGnC4fUVVLf94BqH2qQSBNdKz1HLQzjXno+XfnON8kw==',key_name='tempest-keypair-763586997',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3ffbf5c944914cafac7aba65fb7ca402',ramdisk_id='',reservation_id='r-ox40rq7n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-2130746724',owner_user_name='tempest-AttachVolumeTestJSON-2130746724-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T00:13:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='841b5be7c0b348de979920fc9ae223ed',uuid=27fa1771-fb69-49da-81b3-7f112e623170,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4d97651b-5d7c-4778-85a4-a11588892b31", "address": "fa:16:3e:c5:bb:76", "network": {"id": "7e330392-6256-405b-ab37-0b8af0c4fd48", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-430326049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ffbf5c944914cafac7aba65fb7ca402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d97651b-5d", "ovs_interfaceid": "4d97651b-5d7c-4778-85a4-a11588892b31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75165) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 00:13:34 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-a5e5373e-c1f5-4d02-a4a7-daca9284c692 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Converting VIF {"id": "4d97651b-5d7c-4778-85a4-a11588892b31", "address": "fa:16:3e:c5:bb:76", "network": {"id": "7e330392-6256-405b-ab37-0b8af0c4fd48", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-430326049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ffbf5c944914cafac7aba65fb7ca402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d97651b-5d", "ovs_interfaceid": "4d97651b-5d7c-4778-85a4-a11588892b31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:13:34 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-a5e5373e-c1f5-4d02-a4a7-daca9284c692 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:bb:76,bridge_name='br-int',has_traffic_filtering=True,id=4d97651b-5d7c-4778-85a4-a11588892b31,network=Network(7e330392-6256-405b-ab37-0b8af0c4fd48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d97651b-5d') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:13:34 user nova-compute[75165]: DEBUG nova.objects.instance [None req-a5e5373e-c1f5-4d02-a4a7-daca9284c692 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Lazy-loading 'pci_devices' on Instance uuid 27fa1771-fb69-49da-81b3-7f112e623170 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:13:34 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-a5e5373e-c1f5-4d02-a4a7-daca9284c692 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] [instance: 27fa1771-fb69-49da-81b3-7f112e623170] End _get_guest_xml xml=<domain type="kvm">
Oct 26 00:13:34 user nova-compute[75165]:   <uuid>27fa1771-fb69-49da-81b3-7f112e623170</uuid>
Oct 26 00:13:34 user nova-compute[75165]:   <name>instance-00000014</name>
Oct 26 00:13:34 user nova-compute[75165]:   <memory>524288</memory>
Oct 26 00:13:34 user nova-compute[75165]:   <vcpu>1</vcpu>
Oct 26 00:13:34 user nova-compute[75165]:   <metadata>
Oct 26 00:13:34 user nova-compute[75165]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 00:13:34 user nova-compute[75165]:       <nova:package version="0.0.0"/>
Oct 26 00:13:34 user nova-compute[75165]:       <nova:name>tempest-AttachVolumeTestJSON-server-1390737120</nova:name>
Oct 26 00:13:34 user nova-compute[75165]:       <nova:creationTime>2023-10-26 00:13:34</nova:creationTime>
Oct 26 00:13:34 user nova-compute[75165]:       <nova:flavor name="m1.tiny">
Oct 26 00:13:34 user nova-compute[75165]:         <nova:memory>512</nova:memory>
Oct 26 00:13:34 user nova-compute[75165]:         <nova:disk>1</nova:disk>
Oct 26 00:13:34 user nova-compute[75165]:         <nova:swap>0</nova:swap>
Oct 26 00:13:34 user nova-compute[75165]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 00:13:34 user nova-compute[75165]:         <nova:vcpus>1</nova:vcpus>
Oct 26 00:13:34 user nova-compute[75165]:       </nova:flavor>
Oct 26 00:13:34 user nova-compute[75165]:       <nova:owner>
Oct 26 00:13:34 user nova-compute[75165]:         <nova:user uuid="841b5be7c0b348de979920fc9ae223ed">tempest-AttachVolumeTestJSON-2130746724-project-member</nova:user>
Oct 26 00:13:34 user nova-compute[75165]:         <nova:project uuid="3ffbf5c944914cafac7aba65fb7ca402">tempest-AttachVolumeTestJSON-2130746724</nova:project>
Oct 26 00:13:34 user nova-compute[75165]:       </nova:owner>
Oct 26 00:13:34 user nova-compute[75165]:       <nova:root type="image" uuid="bff0d8a1-739e-4c4d-9efa-b73ba7b76d01"/>
Oct 26 00:13:34 user nova-compute[75165]:       <nova:ports>
Oct 26 00:13:34 user nova-compute[75165]:         <nova:port uuid="4d97651b-5d7c-4778-85a4-a11588892b31">
Oct 26 00:13:34 user nova-compute[75165]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 26 00:13:34 user nova-compute[75165]:         </nova:port>
Oct 26 00:13:34 user nova-compute[75165]:       </nova:ports>
Oct 26 00:13:34 user nova-compute[75165]:     </nova:instance>
Oct 26 00:13:34 user nova-compute[75165]:   </metadata>
Oct 26 00:13:34 user nova-compute[75165]:   <sysinfo type="smbios">
Oct 26 00:13:34 user nova-compute[75165]:     <system>
Oct 26 00:13:34 user nova-compute[75165]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 00:13:34 user nova-compute[75165]:       <entry name="product">OpenStack Nova</entry>
Oct 26 00:13:34 user nova-compute[75165]:       <entry name="version">0.0.0</entry>
Oct 26 00:13:34 user nova-compute[75165]:       <entry name="serial">27fa1771-fb69-49da-81b3-7f112e623170</entry>
Oct 26 00:13:34 user nova-compute[75165]:       <entry name="uuid">27fa1771-fb69-49da-81b3-7f112e623170</entry>
Oct 26 00:13:34 user nova-compute[75165]:       <entry name="family">Virtual Machine</entry>
Oct 26 00:13:34 user nova-compute[75165]:     </system>
Oct 26 00:13:34 user nova-compute[75165]:   </sysinfo>
Oct 26 00:13:34 user nova-compute[75165]:   <os>
Oct 26 00:13:34 user nova-compute[75165]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 00:13:34 user nova-compute[75165]:     <boot dev="hd"/>
Oct 26 00:13:34 user nova-compute[75165]:     <smbios mode="sysinfo"/>
Oct 26 00:13:34 user nova-compute[75165]:   </os>
Oct 26 00:13:34 user nova-compute[75165]:   <features>
Oct 26 00:13:34 user nova-compute[75165]:     <acpi/>
Oct 26 00:13:34 user nova-compute[75165]:     <apic/>
Oct 26 00:13:34 user nova-compute[75165]:     <vmcoreinfo/>
Oct 26 00:13:34 user nova-compute[75165]:   </features>
Oct 26 00:13:34 user nova-compute[75165]:   <clock offset="utc">
Oct 26 00:13:34 user nova-compute[75165]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 00:13:34 user nova-compute[75165]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 00:13:34 user nova-compute[75165]:     <timer name="hpet" present="no"/>
Oct 26 00:13:34 user nova-compute[75165]:   </clock>
Oct 26 00:13:34 user nova-compute[75165]:   <cpu mode="custom" match="exact">
Oct 26 00:13:34 user nova-compute[75165]:     <model>Nehalem</model>
Oct 26 00:13:34 user nova-compute[75165]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 00:13:34 user nova-compute[75165]:   </cpu>
Oct 26 00:13:34 user nova-compute[75165]:   <devices>
Oct 26 00:13:34 user nova-compute[75165]:     <disk type="file" device="disk">
Oct 26 00:13:34 user nova-compute[75165]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 00:13:34 user nova-compute[75165]:       <source file="/opt/stack/data/nova/instances/27fa1771-fb69-49da-81b3-7f112e623170/disk"/>
Oct 26 00:13:34 user nova-compute[75165]:       <target dev="vda" bus="virtio"/>
Oct 26 00:13:34 user nova-compute[75165]:     </disk>
Oct 26 00:13:34 user nova-compute[75165]:     <interface type="ethernet">
Oct 26 00:13:34 user nova-compute[75165]:       <mac address="fa:16:3e:c5:bb:76"/>
Oct 26 00:13:34 user nova-compute[75165]:       <model type="virtio"/>
Oct 26 00:13:34 user nova-compute[75165]:       <mtu size="1442"/>
Oct 26 00:13:34 user nova-compute[75165]:       <target dev="tap4d97651b-5d"/>
Oct 26 00:13:34 user nova-compute[75165]:     </interface>
Oct 26 00:13:34 user nova-compute[75165]:     <serial type="pty">
Oct 26 00:13:34 user nova-compute[75165]:       <log file="/opt/stack/data/nova/instances/27fa1771-fb69-49da-81b3-7f112e623170/console.log" append="off"/>
Oct 26 00:13:34 user nova-compute[75165]:     </serial>
Oct 26 00:13:34 user nova-compute[75165]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 00:13:34 user nova-compute[75165]:     <video>
Oct 26 00:13:34 user nova-compute[75165]:       <model type="virtio"/>
Oct 26 00:13:34 user nova-compute[75165]:     </video>
Oct 26 00:13:34 user nova-compute[75165]:     <rng model="virtio">
Oct 26 00:13:34 user nova-compute[75165]:       <backend model="random">/dev/urandom</backend>
Oct 26 00:13:34 user nova-compute[75165]:     </rng>
Oct 26 00:13:34 user nova-compute[75165]:     <controller type="usb" index="0" model="none"/>
Oct 26 00:13:34 user nova-compute[75165]:     <memballoon model="virtio">
Oct 26 00:13:34 user nova-compute[75165]:       <stats period="10"/>
Oct 26 00:13:34 user nova-compute[75165]:     </memballoon>
Oct 26 00:13:34 user nova-compute[75165]:   </devices>
Oct 26 00:13:34 user nova-compute[75165]: </domain>
Oct 26 00:13:34 user nova-compute[75165]:  {{(pid=75165) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 00:13:34 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-a5e5373e-c1f5-4d02-a4a7-daca9284c692 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:13:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1390737120',display_name='tempest-AttachVolumeTestJSON-server-1390737120',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1390737120',id=20,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEolsf1MVpCHotOftiJQ4Zgsnx29J3YYZZ32cA7FaSf4r6DElmgaLg7eBXc3I/pwZzl9KTJMnY6YgVOXkfwz2nESGnC4fUVVLf94BqH2qQSBNdKz1HLQzjXno+XfnON8kw==',key_name='tempest-keypair-763586997',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3ffbf5c944914cafac7aba65fb7ca402',ramdisk_id='',reservation_id='r-ox40rq7n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-2130746724',owner_user_name='tempest-AttachVolumeTestJSON-2130746724-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T00:13:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='841b5be7c0b348de979920fc9ae223ed',uuid=27fa1771-fb69-49da-81b3-7f112e623170,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4d97651b-5d7c-4778-85a4-a11588892b31", "address": "fa:16:3e:c5:bb:76", "network": {"id": "7e330392-6256-405b-ab37-0b8af0c4fd48", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-430326049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ffbf5c944914cafac7aba65fb7ca402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d97651b-5d", "ovs_interfaceid": "4d97651b-5d7c-4778-85a4-a11588892b31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 00:13:34 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-a5e5373e-c1f5-4d02-a4a7-daca9284c692 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Converting VIF {"id": "4d97651b-5d7c-4778-85a4-a11588892b31", "address": "fa:16:3e:c5:bb:76", "network": {"id": "7e330392-6256-405b-ab37-0b8af0c4fd48", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-430326049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ffbf5c944914cafac7aba65fb7ca402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d97651b-5d", "ovs_interfaceid": "4d97651b-5d7c-4778-85a4-a11588892b31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:13:34 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-a5e5373e-c1f5-4d02-a4a7-daca9284c692 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:bb:76,bridge_name='br-int',has_traffic_filtering=True,id=4d97651b-5d7c-4778-85a4-a11588892b31,network=Network(7e330392-6256-405b-ab37-0b8af0c4fd48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d97651b-5d') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:13:34 user nova-compute[75165]: DEBUG os_vif [None req-a5e5373e-c1f5-4d02-a4a7-daca9284c692 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:bb:76,bridge_name='br-int',has_traffic_filtering=True,id=4d97651b-5d7c-4778-85a4-a11588892b31,network=Network(7e330392-6256-405b-ab37-0b8af0c4fd48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d97651b-5d') {{(pid=75165) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 00:13:34 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:13:34 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:13:34 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 00:13:34 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:13:34 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4375787e-6f02-5202-9bbe-f9114f448eb1', '_type': 'linux-noop'}}, row=False) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:13:34 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:13:34 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:13:34 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:13:34 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4d97651b-5d, may_exist=True, interface_attrs={}) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:13:34 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4d97651b-5d, col_values=(('qos', UUID('64be83e0-6b57-40db-8be7-854e4c783d79')),), if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:13:34 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4d97651b-5d, col_values=(('external_ids', {'iface-id': '4d97651b-5d7c-4778-85a4-a11588892b31', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c5:bb:76', 'vm-uuid': '27fa1771-fb69-49da-81b3-7f112e623170'}),), if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:13:34 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:13:34 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:13:34 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:13:34 user nova-compute[75165]: INFO os_vif [None req-a5e5373e-c1f5-4d02-a4a7-daca9284c692 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:bb:76,bridge_name='br-int',has_traffic_filtering=True,id=4d97651b-5d7c-4778-85a4-a11588892b31,network=Network(7e330392-6256-405b-ab37-0b8af0c4fd48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d97651b-5d')
Oct 26 00:13:34 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-a5e5373e-c1f5-4d02-a4a7-daca9284c692 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] No BDM found with device name vda, not building metadata. {{(pid=75165) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 00:13:34 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-a5e5373e-c1f5-4d02-a4a7-daca9284c692 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] No VIF found with MAC fa:16:3e:c5:bb:76, not building metadata {{(pid=75165) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 00:13:34 user nova-compute[75165]: DEBUG nova.network.neutron [req-d97a17ce-b528-441d-9ab4-cc0d9b678179 req-43b2ad8c-093c-4955-9b02-82046f946333 service nova] [instance: 27fa1771-fb69-49da-81b3-7f112e623170] Updated VIF entry in instance network info cache for port 4d97651b-5d7c-4778-85a4-a11588892b31. {{(pid=75165) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 00:13:34 user nova-compute[75165]: DEBUG nova.network.neutron [req-d97a17ce-b528-441d-9ab4-cc0d9b678179 req-43b2ad8c-093c-4955-9b02-82046f946333 service nova] [instance: 27fa1771-fb69-49da-81b3-7f112e623170] Updating instance_info_cache with network_info: [{"id": "4d97651b-5d7c-4778-85a4-a11588892b31", "address": "fa:16:3e:c5:bb:76", "network": {"id": "7e330392-6256-405b-ab37-0b8af0c4fd48", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-430326049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ffbf5c944914cafac7aba65fb7ca402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d97651b-5d", "ovs_interfaceid": "4d97651b-5d7c-4778-85a4-a11588892b31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:13:34 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-d97a17ce-b528-441d-9ab4-cc0d9b678179 req-43b2ad8c-093c-4955-9b02-82046f946333 service nova] Releasing lock "refresh_cache-27fa1771-fb69-49da-81b3-7f112e623170" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:13:35 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:13:35 user nova-compute[75165]: DEBUG nova.objects.instance [None req-1c2b2933-8b2c-4db5-9716-38a5fa9725d8 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Lazy-loading 'flavor' on Instance uuid 6f9add59-cabe-4965-8fe3-524618550581 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:13:35 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-1c2b2933-8b2c-4db5-9716-38a5fa9725d8 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Lock "6f9add59-cabe-4965-8fe3-524618550581" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 38.561s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:13:35 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "6f9add59-cabe-4965-8fe3-524618550581" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 20.695s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:13:36 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "6f9add59-cabe-4965-8fe3-524618550581" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.028s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:13:36 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:13:36 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:13:36 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:13:36 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:13:36 user nova-compute[75165]: DEBUG nova.compute.manager [req-9797c694-7fe5-4e0e-8811-445af0337fc7 req-bc4943c2-553a-484b-9fce-dd3ab3f025c2 service nova] [instance: 27fa1771-fb69-49da-81b3-7f112e623170] Received event network-vif-plugged-4d97651b-5d7c-4778-85a4-a11588892b31 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:13:36 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-9797c694-7fe5-4e0e-8811-445af0337fc7 req-bc4943c2-553a-484b-9fce-dd3ab3f025c2 service nova] Acquiring lock "27fa1771-fb69-49da-81b3-7f112e623170-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:13:36 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-9797c694-7fe5-4e0e-8811-445af0337fc7 req-bc4943c2-553a-484b-9fce-dd3ab3f025c2 service nova] Lock "27fa1771-fb69-49da-81b3-7f112e623170-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:13:36 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-9797c694-7fe5-4e0e-8811-445af0337fc7 req-bc4943c2-553a-484b-9fce-dd3ab3f025c2 service nova] Lock "27fa1771-fb69-49da-81b3-7f112e623170-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:13:36 user nova-compute[75165]: DEBUG nova.compute.manager [req-9797c694-7fe5-4e0e-8811-445af0337fc7 req-bc4943c2-553a-484b-9fce-dd3ab3f025c2 service nova] [instance: 27fa1771-fb69-49da-81b3-7f112e623170] No waiting events found dispatching network-vif-plugged-4d97651b-5d7c-4778-85a4-a11588892b31 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:13:36 user nova-compute[75165]: WARNING nova.compute.manager [req-9797c694-7fe5-4e0e-8811-445af0337fc7 req-bc4943c2-553a-484b-9fce-dd3ab3f025c2 service nova] [instance: 27fa1771-fb69-49da-81b3-7f112e623170] Received unexpected event network-vif-plugged-4d97651b-5d7c-4778-85a4-a11588892b31 for instance with vm_state building and task_state spawning.
Oct 26 00:13:37 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:13:37 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:13:37 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:13:38 user nova-compute[75165]: DEBUG nova.compute.manager [None req-a5e5373e-c1f5-4d02-a4a7-daca9284c692 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] [instance: 27fa1771-fb69-49da-81b3-7f112e623170] Instance event wait completed in 0 seconds for  {{(pid=75165) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 00:13:38 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-a5e5373e-c1f5-4d02-a4a7-daca9284c692 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] [instance: 27fa1771-fb69-49da-81b3-7f112e623170] Guest created on hypervisor {{(pid=75165) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 00:13:38 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: 27fa1771-fb69-49da-81b3-7f112e623170] Instance spawned successfully.
Oct 26 00:13:38 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-a5e5373e-c1f5-4d02-a4a7-daca9284c692 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] [instance: 27fa1771-fb69-49da-81b3-7f112e623170] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 00:13:38 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-a5e5373e-c1f5-4d02-a4a7-daca9284c692 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] [instance: 27fa1771-fb69-49da-81b3-7f112e623170] Found default for hw_cdrom_bus of ide {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:13:38 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-a5e5373e-c1f5-4d02-a4a7-daca9284c692 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] [instance: 27fa1771-fb69-49da-81b3-7f112e623170] Found default for hw_disk_bus of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:13:38 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-a5e5373e-c1f5-4d02-a4a7-daca9284c692 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] [instance: 27fa1771-fb69-49da-81b3-7f112e623170] Found default for hw_input_bus of None {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:13:38 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-a5e5373e-c1f5-4d02-a4a7-daca9284c692 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] [instance: 27fa1771-fb69-49da-81b3-7f112e623170] Found default for hw_pointer_model of None {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:13:38 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-a5e5373e-c1f5-4d02-a4a7-daca9284c692 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] [instance: 27fa1771-fb69-49da-81b3-7f112e623170] Found default for hw_video_model of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:13:38 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-a5e5373e-c1f5-4d02-a4a7-daca9284c692 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] [instance: 27fa1771-fb69-49da-81b3-7f112e623170] Found default for hw_vif_model of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:13:38 user nova-compute[75165]: DEBUG nova.compute.manager [req-f723e51d-a1e0-40be-bb12-78376b710421 req-06b44899-1ca1-4d0f-b3bf-955ced6ed89f service nova] [instance: 27fa1771-fb69-49da-81b3-7f112e623170] Received event network-vif-plugged-4d97651b-5d7c-4778-85a4-a11588892b31 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:13:38 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-f723e51d-a1e0-40be-bb12-78376b710421 req-06b44899-1ca1-4d0f-b3bf-955ced6ed89f service nova] Acquiring lock "27fa1771-fb69-49da-81b3-7f112e623170-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:13:38 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-f723e51d-a1e0-40be-bb12-78376b710421 req-06b44899-1ca1-4d0f-b3bf-955ced6ed89f service nova] Lock "27fa1771-fb69-49da-81b3-7f112e623170-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:13:38 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-f723e51d-a1e0-40be-bb12-78376b710421 req-06b44899-1ca1-4d0f-b3bf-955ced6ed89f service nova] Lock "27fa1771-fb69-49da-81b3-7f112e623170-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:13:38 user nova-compute[75165]: DEBUG nova.compute.manager [req-f723e51d-a1e0-40be-bb12-78376b710421 req-06b44899-1ca1-4d0f-b3bf-955ced6ed89f service nova] [instance: 27fa1771-fb69-49da-81b3-7f112e623170] No waiting events found dispatching network-vif-plugged-4d97651b-5d7c-4778-85a4-a11588892b31 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:13:38 user nova-compute[75165]: WARNING nova.compute.manager [req-f723e51d-a1e0-40be-bb12-78376b710421 req-06b44899-1ca1-4d0f-b3bf-955ced6ed89f service nova] [instance: 27fa1771-fb69-49da-81b3-7f112e623170] Received unexpected event network-vif-plugged-4d97651b-5d7c-4778-85a4-a11588892b31 for instance with vm_state building and task_state spawning.
Oct 26 00:13:38 user nova-compute[75165]: INFO nova.compute.manager [None req-a5e5373e-c1f5-4d02-a4a7-daca9284c692 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] [instance: 27fa1771-fb69-49da-81b3-7f112e623170] Took 6.65 seconds to spawn the instance on the hypervisor.
Oct 26 00:13:38 user nova-compute[75165]: DEBUG nova.compute.manager [None req-a5e5373e-c1f5-4d02-a4a7-daca9284c692 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] [instance: 27fa1771-fb69-49da-81b3-7f112e623170] Checking state {{(pid=75165) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 00:13:38 user nova-compute[75165]: INFO nova.compute.manager [None req-a5e5373e-c1f5-4d02-a4a7-daca9284c692 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] [instance: 27fa1771-fb69-49da-81b3-7f112e623170] Took 7.67 seconds to build instance.
Oct 26 00:13:38 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-a5e5373e-c1f5-4d02-a4a7-daca9284c692 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Lock "27fa1771-fb69-49da-81b3-7f112e623170" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.787s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:13:39 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:13:39 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: 22b9689c-5e83-4807-971f-5b244914b7e5] Creating instance directory {{(pid=75165) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 00:13:39 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: 22b9689c-5e83-4807-971f-5b244914b7e5] Creating image(s)
Oct 26 00:13:39 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Acquiring lock "/opt/stack/data/nova/instances/22b9689c-5e83-4807-971f-5b244914b7e5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:13:39 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Lock "/opt/stack/data/nova/instances/22b9689c-5e83-4807-971f-5b244914b7e5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:13:39 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Lock "/opt/stack/data/nova/instances/22b9689c-5e83-4807-971f-5b244914b7e5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:13:39 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:13:39 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json" returned: 0 in 0.199s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:13:39 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Acquiring lock "7d3243421cf3fdc288b758f687a93103b7b95466" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:13:39 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Lock "7d3243421cf3fdc288b758f687a93103b7b95466" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:13:39 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:13:39 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:13:39 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json" returned: 0 in 0.235s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:13:39 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466,backing_fmt=raw /opt/stack/data/nova/instances/22b9689c-5e83-4807-971f-5b244914b7e5/disk 1073741824 {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:13:39 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466,backing_fmt=raw /opt/stack/data/nova/instances/22b9689c-5e83-4807-971f-5b244914b7e5/disk 1073741824" returned: 0 in 0.058s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:13:39 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Lock "7d3243421cf3fdc288b758f687a93103b7b95466" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.300s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:13:39 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:13:40 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json" returned: 0 in 0.251s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:13:40 user nova-compute[75165]: DEBUG nova.virt.disk.api [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Checking if we can resize image /opt/stack/data/nova/instances/22b9689c-5e83-4807-971f-5b244914b7e5/disk. size=1073741824 {{(pid=75165) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 00:13:40 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b9689c-5e83-4807-971f-5b244914b7e5/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:13:40 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b9689c-5e83-4807-971f-5b244914b7e5/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:13:40 user nova-compute[75165]: DEBUG nova.virt.disk.api [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Cannot resize image /opt/stack/data/nova/instances/22b9689c-5e83-4807-971f-5b244914b7e5/disk to a smaller size. {{(pid=75165) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 00:13:40 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: 22b9689c-5e83-4807-971f-5b244914b7e5] Created local disks {{(pid=75165) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 00:13:40 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: 22b9689c-5e83-4807-971f-5b244914b7e5] Ensure instance console log exists: /opt/stack/data/nova/instances/22b9689c-5e83-4807-971f-5b244914b7e5/console.log {{(pid=75165) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 00:13:40 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:13:40 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:13:40 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:13:40 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: 22b9689c-5e83-4807-971f-5b244914b7e5] Start _get_guest_xml network_info=[{"id": "15022d7e-be4a-480d-a612-31e1e689f43b", "address": "fa:16:3e:23:d1:cb", "network": {"id": "bd1c84f9-bba9-4a23-8bf2-17e65022136a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1557945804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2911497df44047d9a9ee36a5652298bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15022d7e-be", "ovs_interfaceid": "15022d7e-be4a-480d-a612-31e1e689f43b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T00:03:24Z,direct_url=<?>,disk_format='qcow2',id=bff0d8a1-739e-4c4d-9efa-b73ba7b76d01,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e56bbf444fd34c348475c73673611447',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T00:03:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'size': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': 'bff0d8a1-739e-4c4d-9efa-b73ba7b76d01'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'efsGqiyv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '22b9689c-5e83-4807-971f-5b244914b7e5', 'attached_at': '', 'detached_at': '', 'volume_id': '33bd85b7-301b-434f-b1af-a682c33cf49b', 'serial': '33bd85b7-301b-434f-b1af-a682c33cf49b'}, 'guest_format': None, 'boot_index': None, 'disk_bus': 'virtio', 'attachment_id': '48bf80dd-17d2-424b-b90f-07d7e1aa23af', 'delete_on_termination': False, 'volume_type': None} {{(pid=75165) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 00:13:40 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Oct 26 00:13:40 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Oct 26 00:13:40 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75165) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 00:13:40 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] CPU controller missing on host. {{(pid=75165) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 00:13:40 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75165) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 00:13:40 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] CPU controller found on host. {{(pid=75165) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 00:13:40 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75165) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 00:13:40 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T00:03:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T00:03:24Z,direct_url=<?>,disk_format='qcow2',id=bff0d8a1-739e-4c4d-9efa-b73ba7b76d01,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e56bbf444fd34c348475c73673611447',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T00:03:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 00:13:40 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Flavor limits 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 00:13:40 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Image limits 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 00:13:40 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Flavor pref 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 00:13:40 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Image pref 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 00:13:40 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 00:13:40 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 00:13:40 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75165) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 00:13:40 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Got 1 possible topologies {{(pid=75165) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 00:13:40 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 00:13:40 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 00:13:40 user nova-compute[75165]: DEBUG nova.objects.instance [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Lazy-loading 'vcpu_model' on Instance uuid 22b9689c-5e83-4807-971f-5b244914b7e5 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:13:40 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: 22b9689c-5e83-4807-971f-5b244914b7e5] Calling os-brick to attach iSCSI Volume {{(pid=75165) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 00:13:40 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8bf8160e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'efsGqiyv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:13:40 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 26 00:13:40 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:13:40 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:13:40 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 26 00:13:40 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:13:40 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:13:40 user nova-compute[75165]: INFO os_brick.initiator.connectors.iscsi [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 00:13:40 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b -p 172.16.0.220:3260 {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:13:40 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:13:40 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[835462f0-2e34-4d90-8042-a3ebbaa33f98]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:13:40 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 00:13:40 user nova-compute[75165]:  {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:13:40 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b -p 172.16.0.220:3260 --interface default --op new {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:13:40 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:13:40 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[b401a5d4-9c4d-453c-ac59-457a088c0abe]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b] added\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:13:40 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b] added
Oct 26 00:13:40 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:13:40 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:13:40 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:13:40 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[e83369f1-ea57-4cc3-aea8-e1daa9556564]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:13:40 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:13:40 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:13:40 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:13:40 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[53352cca-a55d-4b82-a2ae-ef1fb8cd21b8]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:13:40 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:13:40 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v efsGqiyv {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:13:40 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v efsGqiyv" returned: 0 in 0.018s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:13:40 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[db48bbe2-6546-4030-a072-9ab12b901457]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:13:40 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'efsGqiyv'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:13:40 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:13:40 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:13:40 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[80d64acd-60a0-4bbb-b8ec-2066529612c7]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:13:40 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:13:40 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:13:40 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:13:40 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5928b89-beb9-47ef-b513-a45bb1f8796f]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792 (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:13:40 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792 (non-flash)
Oct 26 00:13:40 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:13:40 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792 (non-flash)
Oct 26 00:13:40 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:13:40 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b -p 172.16.0.220:3260 --login {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:13:40 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:13:40 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[8553cf46-8514-4ad8-b370-0870f9d0973a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:13:40 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b, portal: 172.16.0.220,3260]
Oct 26 00:13:40 user nova-compute[75165]: Login to [iface: default, target: iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b, portal: 172.16.0.220,3260] successful.
Oct 26 00:13:40 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:13:40 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:13:40 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:13:40 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d30fa13-d209-4028-a3e9-e0d42c89abc9]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:13:40 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:13:40 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:13:40 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:13:40 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[53b4e2fc-9a89-499a-be53-ab5201f17d48]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:13:40 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792 (non-flash)
Oct 26 00:13:40 user nova-compute[75165]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b (non-flash)
Oct 26 00:13:40 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:13:40 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792 (non-flash)
Oct 26 00:13:40 user nova-compute[75165]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b (non-flash)
Oct 26 00:13:40 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:13:40 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.297s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:13:40 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Connected to 172.16.0.220:3260 {{(pid=75165) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 00:13:40 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] HCTL ('34', '-', '-', 0) found on session 16 with lun 0 {{(pid=75165) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 00:13:40 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75165) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 00:13:40 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:13:40 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:13:40 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[e49d9faf-973f-43fa-a57f-e71280900acc]: (4, ('- - 0', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:13:40 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Searching for a device in session 16 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75165) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 00:13:40 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'efsGqiyv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75165) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 00:13:40 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:13:41 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.335s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:13:41 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] <== connect_volume: return (1337ms) {'type': 'block', 'scsi_wwn': '23539623964666639', 'path': '/dev/sdc'} {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:13:41 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: 22b9689c-5e83-4807-971f-5b244914b7e5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23539623964666639', 'path': '/dev/sdc'} {{(pid=75165) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 00:13:41 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-26T00:10:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1910763507',display_name='tempest-ServerActionsTestOtherA-server-1799034720',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1910763507',id=15,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCbhvVGCZXABV5ClHwat9SYVr8+lkr4CuPT9Dr+1j4V+RKNDUlpTwy+TnUJZqw7wFY9APF0iWveIh7WwEW0pFasiIl6gv4XcNnJZaIxKvWAEAIXLwvXZamBlkbyJ/XzEvA==',key_name='tempest-keypair-730793300',keypairs=<?>,launch_index=0,launched_at=2023-10-26T00:11:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2911497df44047d9a9ee36a5652298bc',ramdisk_id='',reservation_id='r-h69c2nn0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1690932306',owner_user_name='tempest-ServerActionsTestOtherA-1690932306-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T00:13:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b3ce94f4c01446ebf79a1eba3833e01',uuid=22b9689c-5e83-4807-971f-5b244914b7e5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "15022d7e-be4a-480d-a612-31e1e689f43b", "address": "fa:16:3e:23:d1:cb", "network": {"id": "bd1c84f9-bba9-4a23-8bf2-17e65022136a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1557945804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2911497df44047d9a9ee36a5652298bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15022d7e-be", "ovs_interfaceid": "15022d7e-be4a-480d-a612-31e1e689f43b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75165) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 00:13:41 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Converting VIF {"id": "15022d7e-be4a-480d-a612-31e1e689f43b", "address": "fa:16:3e:23:d1:cb", "network": {"id": "bd1c84f9-bba9-4a23-8bf2-17e65022136a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1557945804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2911497df44047d9a9ee36a5652298bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15022d7e-be", "ovs_interfaceid": "15022d7e-be4a-480d-a612-31e1e689f43b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:13:41 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:23:d1:cb,bridge_name='br-int',has_traffic_filtering=True,id=15022d7e-be4a-480d-a612-31e1e689f43b,network=Network(bd1c84f9-bba9-4a23-8bf2-17e65022136a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15022d7e-be') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:13:41 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: 22b9689c-5e83-4807-971f-5b244914b7e5] End _get_guest_xml xml=<domain type="kvm">
Oct 26 00:13:41 user nova-compute[75165]:   <uuid>22b9689c-5e83-4807-971f-5b244914b7e5</uuid>
Oct 26 00:13:41 user nova-compute[75165]:   <name>instance-0000000f</name>
Oct 26 00:13:41 user nova-compute[75165]:   <memory>524288</memory>
Oct 26 00:13:41 user nova-compute[75165]:   <vcpu>1</vcpu>
Oct 26 00:13:41 user nova-compute[75165]:   <metadata>
Oct 26 00:13:41 user nova-compute[75165]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 00:13:41 user nova-compute[75165]:       <nova:package version="0.0.0"/>
Oct 26 00:13:41 user nova-compute[75165]:       <nova:name>tempest-ServerActionsTestOtherA-server-1799034720</nova:name>
Oct 26 00:13:41 user nova-compute[75165]:       <nova:creationTime>2023-10-26 00:13:40</nova:creationTime>
Oct 26 00:13:41 user nova-compute[75165]:       <nova:flavor name="m1.tiny">
Oct 26 00:13:41 user nova-compute[75165]:         <nova:memory>512</nova:memory>
Oct 26 00:13:41 user nova-compute[75165]:         <nova:disk>1</nova:disk>
Oct 26 00:13:41 user nova-compute[75165]:         <nova:swap>0</nova:swap>
Oct 26 00:13:41 user nova-compute[75165]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 00:13:41 user nova-compute[75165]:         <nova:vcpus>1</nova:vcpus>
Oct 26 00:13:41 user nova-compute[75165]:       </nova:flavor>
Oct 26 00:13:41 user nova-compute[75165]:       <nova:owner>
Oct 26 00:13:41 user nova-compute[75165]:         <nova:user uuid="5b3ce94f4c01446ebf79a1eba3833e01">tempest-ServerActionsTestOtherA-1690932306-project-member</nova:user>
Oct 26 00:13:41 user nova-compute[75165]:         <nova:project uuid="2911497df44047d9a9ee36a5652298bc">tempest-ServerActionsTestOtherA-1690932306</nova:project>
Oct 26 00:13:41 user nova-compute[75165]:       </nova:owner>
Oct 26 00:13:41 user nova-compute[75165]:       <nova:root type="image" uuid="bff0d8a1-739e-4c4d-9efa-b73ba7b76d01"/>
Oct 26 00:13:41 user nova-compute[75165]:       <nova:ports>
Oct 26 00:13:41 user nova-compute[75165]:         <nova:port uuid="15022d7e-be4a-480d-a612-31e1e689f43b">
Oct 26 00:13:41 user nova-compute[75165]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 26 00:13:41 user nova-compute[75165]:         </nova:port>
Oct 26 00:13:41 user nova-compute[75165]:       </nova:ports>
Oct 26 00:13:41 user nova-compute[75165]:     </nova:instance>
Oct 26 00:13:41 user nova-compute[75165]:   </metadata>
Oct 26 00:13:41 user nova-compute[75165]:   <sysinfo type="smbios">
Oct 26 00:13:41 user nova-compute[75165]:     <system>
Oct 26 00:13:41 user nova-compute[75165]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 00:13:41 user nova-compute[75165]:       <entry name="product">OpenStack Nova</entry>
Oct 26 00:13:41 user nova-compute[75165]:       <entry name="version">0.0.0</entry>
Oct 26 00:13:41 user nova-compute[75165]:       <entry name="serial">22b9689c-5e83-4807-971f-5b244914b7e5</entry>
Oct 26 00:13:41 user nova-compute[75165]:       <entry name="uuid">22b9689c-5e83-4807-971f-5b244914b7e5</entry>
Oct 26 00:13:41 user nova-compute[75165]:       <entry name="family">Virtual Machine</entry>
Oct 26 00:13:41 user nova-compute[75165]:     </system>
Oct 26 00:13:41 user nova-compute[75165]:   </sysinfo>
Oct 26 00:13:41 user nova-compute[75165]:   <os>
Oct 26 00:13:41 user nova-compute[75165]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 00:13:41 user nova-compute[75165]:     <boot dev="hd"/>
Oct 26 00:13:41 user nova-compute[75165]:     <smbios mode="sysinfo"/>
Oct 26 00:13:41 user nova-compute[75165]:   </os>
Oct 26 00:13:41 user nova-compute[75165]:   <features>
Oct 26 00:13:41 user nova-compute[75165]:     <acpi/>
Oct 26 00:13:41 user nova-compute[75165]:     <apic/>
Oct 26 00:13:41 user nova-compute[75165]:     <vmcoreinfo/>
Oct 26 00:13:41 user nova-compute[75165]:   </features>
Oct 26 00:13:41 user nova-compute[75165]:   <clock offset="utc">
Oct 26 00:13:41 user nova-compute[75165]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 00:13:41 user nova-compute[75165]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 00:13:41 user nova-compute[75165]:     <timer name="hpet" present="no"/>
Oct 26 00:13:41 user nova-compute[75165]:   </clock>
Oct 26 00:13:41 user nova-compute[75165]:   <cpu mode="custom" match="exact">
Oct 26 00:13:41 user nova-compute[75165]:     <model>Nehalem</model>
Oct 26 00:13:41 user nova-compute[75165]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 00:13:41 user nova-compute[75165]:   </cpu>
Oct 26 00:13:41 user nova-compute[75165]:   <devices>
Oct 26 00:13:41 user nova-compute[75165]:     <disk type="file" device="disk">
Oct 26 00:13:41 user nova-compute[75165]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 00:13:41 user nova-compute[75165]:       <source file="/opt/stack/data/nova/instances/22b9689c-5e83-4807-971f-5b244914b7e5/disk"/>
Oct 26 00:13:41 user nova-compute[75165]:       <target dev="vda" bus="virtio"/>
Oct 26 00:13:41 user nova-compute[75165]:     </disk>
Oct 26 00:13:41 user nova-compute[75165]:     <disk type="block" device="disk">
Oct 26 00:13:41 user nova-compute[75165]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 00:13:41 user nova-compute[75165]:       <source dev="/dev/sdc"/>
Oct 26 00:13:41 user nova-compute[75165]:       <target dev="vdb" bus="virtio"/>
Oct 26 00:13:41 user nova-compute[75165]:       <serial>33bd85b7-301b-434f-b1af-a682c33cf49b</serial>
Oct 26 00:13:41 user nova-compute[75165]:     </disk>
Oct 26 00:13:41 user nova-compute[75165]:     <interface type="ethernet">
Oct 26 00:13:41 user nova-compute[75165]:       <mac address="fa:16:3e:23:d1:cb"/>
Oct 26 00:13:41 user nova-compute[75165]:       <model type="virtio"/>
Oct 26 00:13:41 user nova-compute[75165]:       <mtu size="1442"/>
Oct 26 00:13:41 user nova-compute[75165]:       <target dev="tap15022d7e-be"/>
Oct 26 00:13:41 user nova-compute[75165]:     </interface>
Oct 26 00:13:41 user nova-compute[75165]:     <serial type="pty">
Oct 26 00:13:41 user nova-compute[75165]:       <log file="/opt/stack/data/nova/instances/22b9689c-5e83-4807-971f-5b244914b7e5/console.log" append="off"/>
Oct 26 00:13:41 user nova-compute[75165]:     </serial>
Oct 26 00:13:41 user nova-compute[75165]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 00:13:41 user nova-compute[75165]:     <video>
Oct 26 00:13:41 user nova-compute[75165]:       <model type="virtio"/>
Oct 26 00:13:41 user nova-compute[75165]:     </video>
Oct 26 00:13:41 user nova-compute[75165]:     <rng model="virtio">
Oct 26 00:13:41 user nova-compute[75165]:       <backend model="random">/dev/urandom</backend>
Oct 26 00:13:41 user nova-compute[75165]:     </rng>
Oct 26 00:13:41 user nova-compute[75165]:     <controller type="usb" index="0" model="none"/>
Oct 26 00:13:41 user nova-compute[75165]:     <memballoon model="virtio">
Oct 26 00:13:41 user nova-compute[75165]:       <stats period="10"/>
Oct 26 00:13:41 user nova-compute[75165]:     </memballoon>
Oct 26 00:13:41 user nova-compute[75165]:   </devices>
Oct 26 00:13:41 user nova-compute[75165]: </domain>
Oct 26 00:13:41 user nova-compute[75165]:  {{(pid=75165) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 00:13:41 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-26T00:10:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1910763507',display_name='tempest-ServerActionsTestOtherA-server-1799034720',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1910763507',id=15,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCbhvVGCZXABV5ClHwat9SYVr8+lkr4CuPT9Dr+1j4V+RKNDUlpTwy+TnUJZqw7wFY9APF0iWveIh7WwEW0pFasiIl6gv4XcNnJZaIxKvWAEAIXLwvXZamBlkbyJ/XzEvA==',key_name='tempest-keypair-730793300',keypairs=<?>,launch_index=0,launched_at=2023-10-26T00:11:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2911497df44047d9a9ee36a5652298bc',ramdisk_id='',reservation_id='r-h69c2nn0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1690932306',owner_user_name='tempest-ServerActionsTestOtherA-1690932306-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T00:13:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b3ce94f4c01446ebf79a1eba3833e01',uuid=22b9689c-5e83-4807-971f-5b244914b7e5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "15022d7e-be4a-480d-a612-31e1e689f43b", "address": "fa:16:3e:23:d1:cb", "network": {"id": "bd1c84f9-bba9-4a23-8bf2-17e65022136a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1557945804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2911497df44047d9a9ee36a5652298bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15022d7e-be", "ovs_interfaceid": "15022d7e-be4a-480d-a612-31e1e689f43b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 00:13:41 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Converting VIF {"id": "15022d7e-be4a-480d-a612-31e1e689f43b", "address": "fa:16:3e:23:d1:cb", "network": {"id": "bd1c84f9-bba9-4a23-8bf2-17e65022136a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1557945804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2911497df44047d9a9ee36a5652298bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15022d7e-be", "ovs_interfaceid": "15022d7e-be4a-480d-a612-31e1e689f43b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:13:41 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:23:d1:cb,bridge_name='br-int',has_traffic_filtering=True,id=15022d7e-be4a-480d-a612-31e1e689f43b,network=Network(bd1c84f9-bba9-4a23-8bf2-17e65022136a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15022d7e-be') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:13:41 user nova-compute[75165]: DEBUG os_vif [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:d1:cb,bridge_name='br-int',has_traffic_filtering=True,id=15022d7e-be4a-480d-a612-31e1e689f43b,network=Network(bd1c84f9-bba9-4a23-8bf2-17e65022136a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15022d7e-be') {{(pid=75165) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 00:13:41 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:13:41 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:13:41 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 00:13:41 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:13:41 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '10bd5dc4-1fb1-5faf-8aad-5879f75e1e56', '_type': 'linux-noop'}}, row=False) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:13:41 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:13:41 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:13:41 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:13:41 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap15022d7e-be, may_exist=True, interface_attrs={}) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:13:41 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap15022d7e-be, col_values=(('qos', UUID('e9e85ce6-cc4b-456a-81e0-83aad400018b')),), if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:13:41 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap15022d7e-be, col_values=(('external_ids', {'iface-id': '15022d7e-be4a-480d-a612-31e1e689f43b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:23:d1:cb', 'vm-uuid': '22b9689c-5e83-4807-971f-5b244914b7e5'}),), if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:13:41 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:13:41 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:13:41 user nova-compute[75165]: INFO os_vif [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:d1:cb,bridge_name='br-int',has_traffic_filtering=True,id=15022d7e-be4a-480d-a612-31e1e689f43b,network=Network(bd1c84f9-bba9-4a23-8bf2-17e65022136a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15022d7e-be')
Oct 26 00:13:41 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] No BDM found with device name vda, not building metadata. {{(pid=75165) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 00:13:41 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75165) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 00:13:41 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] No VIF found with MAC fa:16:3e:23:d1:cb, not building metadata {{(pid=75165) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 00:13:42 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:13:43 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:13:43 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:13:43 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:13:43 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:13:44 user nova-compute[75165]: DEBUG nova.compute.manager [req-ace68780-faa3-43f5-adb7-54b0d87735b2 req-af611337-a3f4-4a15-996d-5d4631c87e39 service nova] [instance: 22b9689c-5e83-4807-971f-5b244914b7e5] Received event network-vif-plugged-15022d7e-be4a-480d-a612-31e1e689f43b {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:13:44 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-ace68780-faa3-43f5-adb7-54b0d87735b2 req-af611337-a3f4-4a15-996d-5d4631c87e39 service nova] Acquiring lock "22b9689c-5e83-4807-971f-5b244914b7e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:13:44 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-ace68780-faa3-43f5-adb7-54b0d87735b2 req-af611337-a3f4-4a15-996d-5d4631c87e39 service nova] Lock "22b9689c-5e83-4807-971f-5b244914b7e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:13:44 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-ace68780-faa3-43f5-adb7-54b0d87735b2 req-af611337-a3f4-4a15-996d-5d4631c87e39 service nova] Lock "22b9689c-5e83-4807-971f-5b244914b7e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:13:44 user nova-compute[75165]: DEBUG nova.compute.manager [req-ace68780-faa3-43f5-adb7-54b0d87735b2 req-af611337-a3f4-4a15-996d-5d4631c87e39 service nova] [instance: 22b9689c-5e83-4807-971f-5b244914b7e5] No waiting events found dispatching network-vif-plugged-15022d7e-be4a-480d-a612-31e1e689f43b {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:13:44 user nova-compute[75165]: WARNING nova.compute.manager [req-ace68780-faa3-43f5-adb7-54b0d87735b2 req-af611337-a3f4-4a15-996d-5d4631c87e39 service nova] [instance: 22b9689c-5e83-4807-971f-5b244914b7e5] Received unexpected event network-vif-plugged-15022d7e-be4a-480d-a612-31e1e689f43b for instance with vm_state active and task_state rebuild_spawning.
Oct 26 00:13:45 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:13:45 user nova-compute[75165]: DEBUG nova.compute.manager [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: 22b9689c-5e83-4807-971f-5b244914b7e5] Instance event wait completed in 0 seconds for  {{(pid=75165) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 00:13:45 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: 22b9689c-5e83-4807-971f-5b244914b7e5] Guest created on hypervisor {{(pid=75165) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 00:13:46 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: 22b9689c-5e83-4807-971f-5b244914b7e5] Instance spawned successfully.
Oct 26 00:13:46 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: 22b9689c-5e83-4807-971f-5b244914b7e5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 00:13:46 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: 22b9689c-5e83-4807-971f-5b244914b7e5] Found default for hw_cdrom_bus of ide {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:13:46 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: 22b9689c-5e83-4807-971f-5b244914b7e5] Found default for hw_disk_bus of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:13:46 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: 22b9689c-5e83-4807-971f-5b244914b7e5] Found default for hw_input_bus of None {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:13:46 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: 22b9689c-5e83-4807-971f-5b244914b7e5] Found default for hw_pointer_model of None {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:13:46 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: 22b9689c-5e83-4807-971f-5b244914b7e5] Found default for hw_video_model of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:13:46 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: 22b9689c-5e83-4807-971f-5b244914b7e5] Found default for hw_vif_model of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:13:46 user nova-compute[75165]: DEBUG nova.compute.manager [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: 22b9689c-5e83-4807-971f-5b244914b7e5] Checking state {{(pid=75165) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 00:13:46 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:13:46 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:13:46 user nova-compute[75165]: DEBUG nova.objects.instance [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: 22b9689c-5e83-4807-971f-5b244914b7e5] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75165) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1078}}
Oct 26 00:13:46 user nova-compute[75165]: DEBUG nova.compute.manager [req-eda84e1c-83ff-4b2b-90f8-9a26d1c844b7 req-9c7dfc1e-b0b6-42cf-9b1c-4cd80d7eeeda service nova] [instance: 22b9689c-5e83-4807-971f-5b244914b7e5] Received event network-vif-plugged-15022d7e-be4a-480d-a612-31e1e689f43b {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:13:46 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-eda84e1c-83ff-4b2b-90f8-9a26d1c844b7 req-9c7dfc1e-b0b6-42cf-9b1c-4cd80d7eeeda service nova] Acquiring lock "22b9689c-5e83-4807-971f-5b244914b7e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:13:46 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-eda84e1c-83ff-4b2b-90f8-9a26d1c844b7 req-9c7dfc1e-b0b6-42cf-9b1c-4cd80d7eeeda service nova] Lock "22b9689c-5e83-4807-971f-5b244914b7e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:13:46 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-eda84e1c-83ff-4b2b-90f8-9a26d1c844b7 req-9c7dfc1e-b0b6-42cf-9b1c-4cd80d7eeeda service nova] Lock "22b9689c-5e83-4807-971f-5b244914b7e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:13:46 user nova-compute[75165]: DEBUG nova.compute.manager [req-eda84e1c-83ff-4b2b-90f8-9a26d1c844b7 req-9c7dfc1e-b0b6-42cf-9b1c-4cd80d7eeeda service nova] [instance: 22b9689c-5e83-4807-971f-5b244914b7e5] No waiting events found dispatching network-vif-plugged-15022d7e-be4a-480d-a612-31e1e689f43b {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:13:46 user nova-compute[75165]: WARNING nova.compute.manager [req-eda84e1c-83ff-4b2b-90f8-9a26d1c844b7 req-9c7dfc1e-b0b6-42cf-9b1c-4cd80d7eeeda service nova] [instance: 22b9689c-5e83-4807-971f-5b244914b7e5] Received unexpected event network-vif-plugged-15022d7e-be4a-480d-a612-31e1e689f43b for instance with vm_state active and task_state None.
Oct 26 00:13:46 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-1d2160ab-5ea9-4518-8962-ce758f621f5e tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.093s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:13:46 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:13:46 user nova-compute[75165]: INFO nova.compute.manager [None req-fbdcecd5-f8af-415f-8597-c8558b31fa86 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: 84c6b624-648b-40e2-a37e-ff08609bad84] Unrescuing
Oct 26 00:13:46 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-fbdcecd5-f8af-415f-8597-c8558b31fa86 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Acquiring lock "refresh_cache-84c6b624-648b-40e2-a37e-ff08609bad84" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:13:46 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-fbdcecd5-f8af-415f-8597-c8558b31fa86 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Acquired lock "refresh_cache-84c6b624-648b-40e2-a37e-ff08609bad84" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:13:46 user nova-compute[75165]: DEBUG nova.network.neutron [None req-fbdcecd5-f8af-415f-8597-c8558b31fa86 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: 84c6b624-648b-40e2-a37e-ff08609bad84] Building network info cache for instance {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 00:13:47 user nova-compute[75165]: DEBUG nova.network.neutron [None req-fbdcecd5-f8af-415f-8597-c8558b31fa86 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: 84c6b624-648b-40e2-a37e-ff08609bad84] Updating instance_info_cache with network_info: [{"id": "2107529c-ec0e-4d1d-85b4-8605dcabc415", "address": "fa:16:3e:0c:8a:94", "network": {"id": "b31bac4b-1951-4ca3-8682-f1f24de0a5c3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1323234642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71aa69c0ea2d49e184e1e055ff3efa1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2107529c-ec", "ovs_interfaceid": "2107529c-ec0e-4d1d-85b4-8605dcabc415", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:13:47 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-fbdcecd5-f8af-415f-8597-c8558b31fa86 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Releasing lock "refresh_cache-84c6b624-648b-40e2-a37e-ff08609bad84" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:13:47 user nova-compute[75165]: DEBUG nova.objects.instance [None req-fbdcecd5-f8af-415f-8597-c8558b31fa86 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Lazy-loading 'flavor' on Instance uuid 84c6b624-648b-40e2-a37e-ff08609bad84 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:13:47 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:13:47 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:13:47 user nova-compute[75165]: DEBUG nova.compute.manager [req-a855bf1e-8a4c-4513-8d1f-e6ef95e83785 req-31c90d57-73d6-4eff-9d31-cfbe83acb653 service nova] [instance: 84c6b624-648b-40e2-a37e-ff08609bad84] Received event network-vif-unplugged-2107529c-ec0e-4d1d-85b4-8605dcabc415 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:13:47 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-a855bf1e-8a4c-4513-8d1f-e6ef95e83785 req-31c90d57-73d6-4eff-9d31-cfbe83acb653 service nova] Acquiring lock "84c6b624-648b-40e2-a37e-ff08609bad84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:13:47 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-a855bf1e-8a4c-4513-8d1f-e6ef95e83785 req-31c90d57-73d6-4eff-9d31-cfbe83acb653 service nova] Lock "84c6b624-648b-40e2-a37e-ff08609bad84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:13:47 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-a855bf1e-8a4c-4513-8d1f-e6ef95e83785 req-31c90d57-73d6-4eff-9d31-cfbe83acb653 service nova] Lock "84c6b624-648b-40e2-a37e-ff08609bad84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:13:47 user nova-compute[75165]: DEBUG nova.compute.manager [req-a855bf1e-8a4c-4513-8d1f-e6ef95e83785 req-31c90d57-73d6-4eff-9d31-cfbe83acb653 service nova] [instance: 84c6b624-648b-40e2-a37e-ff08609bad84] No waiting events found dispatching network-vif-unplugged-2107529c-ec0e-4d1d-85b4-8605dcabc415 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:13:47 user nova-compute[75165]: WARNING nova.compute.manager [req-a855bf1e-8a4c-4513-8d1f-e6ef95e83785 req-31c90d57-73d6-4eff-9d31-cfbe83acb653 service nova] [instance: 84c6b624-648b-40e2-a37e-ff08609bad84] Received unexpected event network-vif-unplugged-2107529c-ec0e-4d1d-85b4-8605dcabc415 for instance with vm_state rescued and task_state unrescuing.
Oct 26 00:13:47 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:13:47 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:13:48 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-2d9a00f9-4eb8-4404-a6a0-99aaca591f0b tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Acquiring lock "6f9add59-cabe-4965-8fe3-524618550581" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:13:48 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-2d9a00f9-4eb8-4404-a6a0-99aaca591f0b tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Lock "6f9add59-cabe-4965-8fe3-524618550581" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:13:48 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-2d9a00f9-4eb8-4404-a6a0-99aaca591f0b tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Acquiring lock "6f9add59-cabe-4965-8fe3-524618550581-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:13:48 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-2d9a00f9-4eb8-4404-a6a0-99aaca591f0b tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Lock "6f9add59-cabe-4965-8fe3-524618550581-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:13:48 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-2d9a00f9-4eb8-4404-a6a0-99aaca591f0b tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Lock "6f9add59-cabe-4965-8fe3-524618550581-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:13:48 user nova-compute[75165]: INFO nova.compute.manager [None req-2d9a00f9-4eb8-4404-a6a0-99aaca591f0b tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] [instance: 6f9add59-cabe-4965-8fe3-524618550581] Terminating instance
Oct 26 00:13:48 user nova-compute[75165]: DEBUG nova.compute.manager [None req-2d9a00f9-4eb8-4404-a6a0-99aaca591f0b tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] [instance: 6f9add59-cabe-4965-8fe3-524618550581] Start destroying the instance on the hypervisor. {{(pid=75165) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 00:13:48 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:13:48 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:13:48 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-6a83e018-e677-4040-a759-b00c3e92bbb8 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Acquiring lock "26a0b493-bb47-466e-95d5-945fc3849fa5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:13:48 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-6a83e018-e677-4040-a759-b00c3e92bbb8 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Lock "26a0b493-bb47-466e-95d5-945fc3849fa5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:13:48 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:13:48 user nova-compute[75165]: INFO nova.compute.manager [None req-6a83e018-e677-4040-a759-b00c3e92bbb8 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] Detaching volume ce7241dd-04dd-4a96-b8a6-21fb4e678792
Oct 26 00:13:48 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:13:48 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:13:48 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: 84c6b624-648b-40e2-a37e-ff08609bad84] Instance destroyed successfully.
Oct 26 00:13:48 user nova-compute[75165]: INFO nova.virt.block_device [None req-6a83e018-e677-4040-a759-b00c3e92bbb8 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] Attempting to driver detach volume ce7241dd-04dd-4a96-b8a6-21fb4e678792 from mountpoint /dev/vdb
Oct 26 00:13:48 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-6a83e018-e677-4040-a759-b00c3e92bbb8 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Attempting to detach device vdb from instance 26a0b493-bb47-466e-95d5-945fc3849fa5 from the persistent domain config. {{(pid=75165) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 00:13:48 user nova-compute[75165]: DEBUG nova.virt.libvirt.guest [None req-6a83e018-e677-4040-a759-b00c3e92bbb8 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 00:13:48 user nova-compute[75165]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 00:13:48 user nova-compute[75165]:   <source dev="/dev/sdb"/>
Oct 26 00:13:48 user nova-compute[75165]:   <target dev="vdb" bus="virtio"/>
Oct 26 00:13:48 user nova-compute[75165]:   <serial>ce7241dd-04dd-4a96-b8a6-21fb4e678792</serial>
Oct 26 00:13:48 user nova-compute[75165]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 00:13:48 user nova-compute[75165]: </disk>
Oct 26 00:13:48 user nova-compute[75165]:  {{(pid=75165) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 00:13:48 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-6a83e018-e677-4040-a759-b00c3e92bbb8 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Successfully detached device vdb from instance 26a0b493-bb47-466e-95d5-945fc3849fa5 from the persistent domain config.
Oct 26 00:13:48 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-6a83e018-e677-4040-a759-b00c3e92bbb8 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 26a0b493-bb47-466e-95d5-945fc3849fa5 from the live domain config. {{(pid=75165) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 00:13:48 user nova-compute[75165]: DEBUG nova.virt.libvirt.guest [None req-6a83e018-e677-4040-a759-b00c3e92bbb8 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 00:13:48 user nova-compute[75165]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 00:13:48 user nova-compute[75165]:   <source dev="/dev/sdb"/>
Oct 26 00:13:48 user nova-compute[75165]:   <target dev="vdb" bus="virtio"/>
Oct 26 00:13:48 user nova-compute[75165]:   <serial>ce7241dd-04dd-4a96-b8a6-21fb4e678792</serial>
Oct 26 00:13:48 user nova-compute[75165]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 00:13:48 user nova-compute[75165]: </disk>
Oct 26 00:13:48 user nova-compute[75165]:  {{(pid=75165) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 00:13:48 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:13:49 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:13:49 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:13:49 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:13:49 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-6a83e018-e677-4040-a759-b00c3e92bbb8 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 26a0b493-bb47-466e-95d5-945fc3849fa5 {{(pid=75165) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 00:13:49 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: 6f9add59-cabe-4965-8fe3-524618550581] Instance destroyed successfully.
Oct 26 00:13:49 user nova-compute[75165]: DEBUG nova.objects.instance [None req-2d9a00f9-4eb8-4404-a6a0-99aaca591f0b tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Lazy-loading 'resources' on Instance uuid 6f9add59-cabe-4965-8fe3-524618550581 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:13:49 user nova-compute[75165]: DEBUG nova.compute.manager [req-a6c558a7-0f69-4bd7-9935-94e3e721704a req-3fdc5e1f-64d7-4100-9a1b-87f41fc1c3d0 service nova] [instance: 84c6b624-648b-40e2-a37e-ff08609bad84] Received event network-vif-plugged-2107529c-ec0e-4d1d-85b4-8605dcabc415 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:13:49 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-a6c558a7-0f69-4bd7-9935-94e3e721704a req-3fdc5e1f-64d7-4100-9a1b-87f41fc1c3d0 service nova] Acquiring lock "84c6b624-648b-40e2-a37e-ff08609bad84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:13:49 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-a6c558a7-0f69-4bd7-9935-94e3e721704a req-3fdc5e1f-64d7-4100-9a1b-87f41fc1c3d0 service nova] Lock "84c6b624-648b-40e2-a37e-ff08609bad84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:13:49 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-a6c558a7-0f69-4bd7-9935-94e3e721704a req-3fdc5e1f-64d7-4100-9a1b-87f41fc1c3d0 service nova] Lock "84c6b624-648b-40e2-a37e-ff08609bad84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:13:49 user nova-compute[75165]: DEBUG nova.compute.manager [req-a6c558a7-0f69-4bd7-9935-94e3e721704a req-3fdc5e1f-64d7-4100-9a1b-87f41fc1c3d0 service nova] [instance: 84c6b624-648b-40e2-a37e-ff08609bad84] No waiting events found dispatching network-vif-plugged-2107529c-ec0e-4d1d-85b4-8605dcabc415 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:13:49 user nova-compute[75165]: WARNING nova.compute.manager [req-a6c558a7-0f69-4bd7-9935-94e3e721704a req-3fdc5e1f-64d7-4100-9a1b-87f41fc1c3d0 service nova] [instance: 84c6b624-648b-40e2-a37e-ff08609bad84] Received unexpected event network-vif-plugged-2107529c-ec0e-4d1d-85b4-8605dcabc415 for instance with vm_state rescued and task_state unrescuing.
Oct 26 00:13:49 user nova-compute[75165]: DEBUG nova.compute.manager [req-a6c558a7-0f69-4bd7-9935-94e3e721704a req-3fdc5e1f-64d7-4100-9a1b-87f41fc1c3d0 service nova] [instance: 6f9add59-cabe-4965-8fe3-524618550581] Received event network-vif-unplugged-50bf388e-b8ff-4924-9633-7e97d083a361 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:13:49 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-a6c558a7-0f69-4bd7-9935-94e3e721704a req-3fdc5e1f-64d7-4100-9a1b-87f41fc1c3d0 service nova] Acquiring lock "6f9add59-cabe-4965-8fe3-524618550581-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:13:49 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-a6c558a7-0f69-4bd7-9935-94e3e721704a req-3fdc5e1f-64d7-4100-9a1b-87f41fc1c3d0 service nova] Lock "6f9add59-cabe-4965-8fe3-524618550581-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:13:49 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-a6c558a7-0f69-4bd7-9935-94e3e721704a req-3fdc5e1f-64d7-4100-9a1b-87f41fc1c3d0 service nova] Lock "6f9add59-cabe-4965-8fe3-524618550581-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:13:49 user nova-compute[75165]: DEBUG nova.compute.manager [req-a6c558a7-0f69-4bd7-9935-94e3e721704a req-3fdc5e1f-64d7-4100-9a1b-87f41fc1c3d0 service nova] [instance: 6f9add59-cabe-4965-8fe3-524618550581] No waiting events found dispatching network-vif-unplugged-50bf388e-b8ff-4924-9633-7e97d083a361 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:13:49 user nova-compute[75165]: DEBUG nova.compute.manager [req-a6c558a7-0f69-4bd7-9935-94e3e721704a req-3fdc5e1f-64d7-4100-9a1b-87f41fc1c3d0 service nova] [instance: 6f9add59-cabe-4965-8fe3-524618550581] Received event network-vif-unplugged-50bf388e-b8ff-4924-9633-7e97d083a361 for instance with task_state deleting. {{(pid=75165) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 00:13:49 user nova-compute[75165]: DEBUG nova.compute.manager [req-a6c558a7-0f69-4bd7-9935-94e3e721704a req-3fdc5e1f-64d7-4100-9a1b-87f41fc1c3d0 service nova] [instance: 6f9add59-cabe-4965-8fe3-524618550581] Received event network-vif-plugged-50bf388e-b8ff-4924-9633-7e97d083a361 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:13:49 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-a6c558a7-0f69-4bd7-9935-94e3e721704a req-3fdc5e1f-64d7-4100-9a1b-87f41fc1c3d0 service nova] Acquiring lock "6f9add59-cabe-4965-8fe3-524618550581-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:13:49 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-a6c558a7-0f69-4bd7-9935-94e3e721704a req-3fdc5e1f-64d7-4100-9a1b-87f41fc1c3d0 service nova] Lock "6f9add59-cabe-4965-8fe3-524618550581-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:13:49 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-a6c558a7-0f69-4bd7-9935-94e3e721704a req-3fdc5e1f-64d7-4100-9a1b-87f41fc1c3d0 service nova] Lock "6f9add59-cabe-4965-8fe3-524618550581-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:13:49 user nova-compute[75165]: DEBUG nova.compute.manager [req-a6c558a7-0f69-4bd7-9935-94e3e721704a req-3fdc5e1f-64d7-4100-9a1b-87f41fc1c3d0 service nova] [instance: 6f9add59-cabe-4965-8fe3-524618550581] No waiting events found dispatching network-vif-plugged-50bf388e-b8ff-4924-9633-7e97d083a361 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:13:49 user nova-compute[75165]: WARNING nova.compute.manager [req-a6c558a7-0f69-4bd7-9935-94e3e721704a req-3fdc5e1f-64d7-4100-9a1b-87f41fc1c3d0 service nova] [instance: 6f9add59-cabe-4965-8fe3-524618550581] Received unexpected event network-vif-plugged-50bf388e-b8ff-4924-9633-7e97d083a361 for instance with vm_state active and task_state deleting.
Oct 26 00:13:49 user nova-compute[75165]: DEBUG nova.compute.manager [req-a6c558a7-0f69-4bd7-9935-94e3e721704a req-3fdc5e1f-64d7-4100-9a1b-87f41fc1c3d0 service nova] [instance: 6f9add59-cabe-4965-8fe3-524618550581] Received event network-vif-plugged-50bf388e-b8ff-4924-9633-7e97d083a361 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:13:49 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-a6c558a7-0f69-4bd7-9935-94e3e721704a req-3fdc5e1f-64d7-4100-9a1b-87f41fc1c3d0 service nova] Acquiring lock "6f9add59-cabe-4965-8fe3-524618550581-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:13:49 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-a6c558a7-0f69-4bd7-9935-94e3e721704a req-3fdc5e1f-64d7-4100-9a1b-87f41fc1c3d0 service nova] Lock "6f9add59-cabe-4965-8fe3-524618550581-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:13:49 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-a6c558a7-0f69-4bd7-9935-94e3e721704a req-3fdc5e1f-64d7-4100-9a1b-87f41fc1c3d0 service nova] Lock "6f9add59-cabe-4965-8fe3-524618550581-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:13:49 user nova-compute[75165]: DEBUG nova.compute.manager [req-a6c558a7-0f69-4bd7-9935-94e3e721704a req-3fdc5e1f-64d7-4100-9a1b-87f41fc1c3d0 service nova] [instance: 6f9add59-cabe-4965-8fe3-524618550581] No waiting events found dispatching network-vif-plugged-50bf388e-b8ff-4924-9633-7e97d083a361 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:13:49 user nova-compute[75165]: WARNING nova.compute.manager [req-a6c558a7-0f69-4bd7-9935-94e3e721704a req-3fdc5e1f-64d7-4100-9a1b-87f41fc1c3d0 service nova] [instance: 6f9add59-cabe-4965-8fe3-524618550581] Received unexpected event network-vif-plugged-50bf388e-b8ff-4924-9633-7e97d083a361 for instance with vm_state active and task_state deleting.
Oct 26 00:13:49 user nova-compute[75165]: DEBUG nova.compute.manager [req-a6c558a7-0f69-4bd7-9935-94e3e721704a req-3fdc5e1f-64d7-4100-9a1b-87f41fc1c3d0 service nova] [instance: 6f9add59-cabe-4965-8fe3-524618550581] Received event network-vif-plugged-50bf388e-b8ff-4924-9633-7e97d083a361 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:13:49 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-a6c558a7-0f69-4bd7-9935-94e3e721704a req-3fdc5e1f-64d7-4100-9a1b-87f41fc1c3d0 service nova] Acquiring lock "6f9add59-cabe-4965-8fe3-524618550581-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:13:49 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-a6c558a7-0f69-4bd7-9935-94e3e721704a req-3fdc5e1f-64d7-4100-9a1b-87f41fc1c3d0 service nova] Lock "6f9add59-cabe-4965-8fe3-524618550581-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:13:49 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-a6c558a7-0f69-4bd7-9935-94e3e721704a req-3fdc5e1f-64d7-4100-9a1b-87f41fc1c3d0 service nova] Lock "6f9add59-cabe-4965-8fe3-524618550581-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:13:49 user nova-compute[75165]: DEBUG nova.compute.manager [req-a6c558a7-0f69-4bd7-9935-94e3e721704a req-3fdc5e1f-64d7-4100-9a1b-87f41fc1c3d0 service nova] [instance: 6f9add59-cabe-4965-8fe3-524618550581] No waiting events found dispatching network-vif-plugged-50bf388e-b8ff-4924-9633-7e97d083a361 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:13:49 user nova-compute[75165]: WARNING nova.compute.manager [req-a6c558a7-0f69-4bd7-9935-94e3e721704a req-3fdc5e1f-64d7-4100-9a1b-87f41fc1c3d0 service nova] [instance: 6f9add59-cabe-4965-8fe3-524618550581] Received unexpected event network-vif-plugged-50bf388e-b8ff-4924-9633-7e97d083a361 for instance with vm_state active and task_state deleting.
Oct 26 00:13:49 user nova-compute[75165]: DEBUG nova.compute.manager [req-a6c558a7-0f69-4bd7-9935-94e3e721704a req-3fdc5e1f-64d7-4100-9a1b-87f41fc1c3d0 service nova] [instance: 6f9add59-cabe-4965-8fe3-524618550581] Received event network-vif-unplugged-50bf388e-b8ff-4924-9633-7e97d083a361 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:13:49 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-a6c558a7-0f69-4bd7-9935-94e3e721704a req-3fdc5e1f-64d7-4100-9a1b-87f41fc1c3d0 service nova] Acquiring lock "6f9add59-cabe-4965-8fe3-524618550581-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:13:49 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-a6c558a7-0f69-4bd7-9935-94e3e721704a req-3fdc5e1f-64d7-4100-9a1b-87f41fc1c3d0 service nova] Lock "6f9add59-cabe-4965-8fe3-524618550581-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:13:49 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-a6c558a7-0f69-4bd7-9935-94e3e721704a req-3fdc5e1f-64d7-4100-9a1b-87f41fc1c3d0 service nova] Lock "6f9add59-cabe-4965-8fe3-524618550581-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:13:49 user nova-compute[75165]: DEBUG nova.compute.manager [req-a6c558a7-0f69-4bd7-9935-94e3e721704a req-3fdc5e1f-64d7-4100-9a1b-87f41fc1c3d0 service nova] [instance: 6f9add59-cabe-4965-8fe3-524618550581] No waiting events found dispatching network-vif-unplugged-50bf388e-b8ff-4924-9633-7e97d083a361 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:13:49 user nova-compute[75165]: DEBUG nova.compute.manager [req-a6c558a7-0f69-4bd7-9935-94e3e721704a req-3fdc5e1f-64d7-4100-9a1b-87f41fc1c3d0 service nova] [instance: 6f9add59-cabe-4965-8fe3-524618550581] Received event network-vif-unplugged-50bf388e-b8ff-4924-9633-7e97d083a361 for instance with task_state deleting. {{(pid=75165) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 00:13:49 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-2d9a00f9-4eb8-4404-a6a0-99aaca591f0b tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-26T00:07:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-444593788',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-444593788',id=8,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPmLhpEGqHfWEDVp+Bb7MZzf/vrGL3uKzsxYYhytuWZRJqdFBvNBMiuBIa1UGxiNcAnbXigoebvMGsM57flYclfuZrrgJ5NcpyDMNxYszGc32IAq2Sr05Z1/NqZ2VCnXEw==',key_name='tempest-keypair-548689340',keypairs=<?>,launch_index=0,launched_at=2023-10-26T00:11:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='920152101768459baa71010b380ea8f1',ramdisk_id='',reservation_id='r-i1asnolo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-6636270',owner_user_name='tempest-AttachVolumeShelveTestJSON-6636270-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T00:11:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a40cb1b08014444686bd0adad03f6c68',uuid=6f9add59-cabe-4965-8fe3-524618550581,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "50bf388e-b8ff-4924-9633-7e97d083a361", "address": "fa:16:3e:16:28:b9", "network": {"id": "f54e2e9f-5c1e-44ca-bd4b-9cf0747b0f72", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-806146051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "920152101768459baa71010b380ea8f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50bf388e-b8", "ovs_interfaceid": "50bf388e-b8ff-4924-9633-7e97d083a361", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 00:13:49 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-2d9a00f9-4eb8-4404-a6a0-99aaca591f0b tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Converting VIF {"id": "50bf388e-b8ff-4924-9633-7e97d083a361", "address": "fa:16:3e:16:28:b9", "network": {"id": "f54e2e9f-5c1e-44ca-bd4b-9cf0747b0f72", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-806146051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "920152101768459baa71010b380ea8f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50bf388e-b8", "ovs_interfaceid": "50bf388e-b8ff-4924-9633-7e97d083a361", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:13:49 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-2d9a00f9-4eb8-4404-a6a0-99aaca591f0b tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:28:b9,bridge_name='br-int',has_traffic_filtering=True,id=50bf388e-b8ff-4924-9633-7e97d083a361,network=Network(f54e2e9f-5c1e-44ca-bd4b-9cf0747b0f72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50bf388e-b8') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:13:49 user nova-compute[75165]: DEBUG os_vif [None req-2d9a00f9-4eb8-4404-a6a0-99aaca591f0b tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:28:b9,bridge_name='br-int',has_traffic_filtering=True,id=50bf388e-b8ff-4924-9633-7e97d083a361,network=Network(f54e2e9f-5c1e-44ca-bd4b-9cf0747b0f72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50bf388e-b8') {{(pid=75165) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 00:13:49 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:13:49 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap50bf388e-b8, bridge=br-int, if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:13:49 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:13:49 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:13:49 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:13:49 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:13:49 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=321eae0b-4477-4ddd-8c76-15168783de96) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:13:49 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:13:49 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:13:50 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:13:50 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:13:50 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:13:50 user nova-compute[75165]: INFO os_vif [None req-2d9a00f9-4eb8-4404-a6a0-99aaca591f0b tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:28:b9,bridge_name='br-int',has_traffic_filtering=True,id=50bf388e-b8ff-4924-9633-7e97d083a361,network=Network(f54e2e9f-5c1e-44ca-bd4b-9cf0747b0f72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50bf388e-b8')
Oct 26 00:13:50 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-2d9a00f9-4eb8-4404-a6a0-99aaca591f0b tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] [instance: 6f9add59-cabe-4965-8fe3-524618550581] Deleting instance files /opt/stack/data/nova/instances/6f9add59-cabe-4965-8fe3-524618550581_del
Oct 26 00:13:50 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-2d9a00f9-4eb8-4404-a6a0-99aaca591f0b tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] [instance: 6f9add59-cabe-4965-8fe3-524618550581] Deletion of /opt/stack/data/nova/instances/6f9add59-cabe-4965-8fe3-524618550581_del complete
Oct 26 00:13:50 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:13:50 user nova-compute[75165]: INFO nova.compute.manager [None req-2d9a00f9-4eb8-4404-a6a0-99aaca591f0b tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] [instance: 6f9add59-cabe-4965-8fe3-524618550581] Took 2.06 seconds to destroy the instance on the hypervisor.
Oct 26 00:13:50 user nova-compute[75165]: DEBUG oslo.service.loopingcall [None req-2d9a00f9-4eb8-4404-a6a0-99aaca591f0b tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75165) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 00:13:50 user nova-compute[75165]: DEBUG nova.compute.manager [-] [instance: 6f9add59-cabe-4965-8fe3-524618550581] Deallocating network for instance {{(pid=75165) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 00:13:50 user nova-compute[75165]: DEBUG nova.network.neutron [-] [instance: 6f9add59-cabe-4965-8fe3-524618550581] deallocate_for_instance() {{(pid=75165) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 00:13:50 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:13:50 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:13:50 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:13:51 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:13:51 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:13:51 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:13:51 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:13:51 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:13:51 user nova-compute[75165]: DEBUG nova.network.neutron [-] [instance: 6f9add59-cabe-4965-8fe3-524618550581] Updating instance_info_cache with network_info: [] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:13:51 user nova-compute[75165]: INFO nova.compute.manager [-] [instance: 6f9add59-cabe-4965-8fe3-524618550581] Took 1.10 seconds to deallocate network for instance.
Oct 26 00:13:51 user nova-compute[75165]: DEBUG nova.compute.manager [req-7ab19d09-4d6c-44e2-b13b-877a6cd3d7ea req-f9828a89-ee2e-4abe-949e-d88a0ca699fc service nova] [instance: 6f9add59-cabe-4965-8fe3-524618550581] Received event network-vif-deleted-50bf388e-b8ff-4924-9633-7e97d083a361 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:13:51 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:13:51 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-2d9a00f9-4eb8-4404-a6a0-99aaca591f0b tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:13:51 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-2d9a00f9-4eb8-4404-a6a0-99aaca591f0b tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:13:52 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-2d9a00f9-4eb8-4404-a6a0-99aaca591f0b tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:13:52 user nova-compute[75165]: DEBUG nova.compute.manager [req-a2f9ea9e-1da4-435b-96ed-5ecfe8fd4ad9 req-54abc805-92ba-4cc9-9a76-5f753aded602 service nova] [instance: 6f9add59-cabe-4965-8fe3-524618550581] Received event network-vif-plugged-50bf388e-b8ff-4924-9633-7e97d083a361 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:13:52 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-a2f9ea9e-1da4-435b-96ed-5ecfe8fd4ad9 req-54abc805-92ba-4cc9-9a76-5f753aded602 service nova] Acquiring lock "6f9add59-cabe-4965-8fe3-524618550581-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:13:52 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-a2f9ea9e-1da4-435b-96ed-5ecfe8fd4ad9 req-54abc805-92ba-4cc9-9a76-5f753aded602 service nova] Lock "6f9add59-cabe-4965-8fe3-524618550581-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:13:52 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-a2f9ea9e-1da4-435b-96ed-5ecfe8fd4ad9 req-54abc805-92ba-4cc9-9a76-5f753aded602 service nova] Lock "6f9add59-cabe-4965-8fe3-524618550581-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:13:52 user nova-compute[75165]: DEBUG nova.compute.manager [req-a2f9ea9e-1da4-435b-96ed-5ecfe8fd4ad9 req-54abc805-92ba-4cc9-9a76-5f753aded602 service nova] [instance: 6f9add59-cabe-4965-8fe3-524618550581] No waiting events found dispatching network-vif-plugged-50bf388e-b8ff-4924-9633-7e97d083a361 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:13:52 user nova-compute[75165]: WARNING nova.compute.manager [req-a2f9ea9e-1da4-435b-96ed-5ecfe8fd4ad9 req-54abc805-92ba-4cc9-9a76-5f753aded602 service nova] [instance: 6f9add59-cabe-4965-8fe3-524618550581] Received unexpected event network-vif-plugged-50bf388e-b8ff-4924-9633-7e97d083a361 for instance with vm_state deleted and task_state None.
Oct 26 00:13:52 user nova-compute[75165]: DEBUG nova.compute.manager [req-a2f9ea9e-1da4-435b-96ed-5ecfe8fd4ad9 req-54abc805-92ba-4cc9-9a76-5f753aded602 service nova] [instance: 84c6b624-648b-40e2-a37e-ff08609bad84] Received event network-vif-plugged-2107529c-ec0e-4d1d-85b4-8605dcabc415 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:13:52 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-a2f9ea9e-1da4-435b-96ed-5ecfe8fd4ad9 req-54abc805-92ba-4cc9-9a76-5f753aded602 service nova] Acquiring lock "84c6b624-648b-40e2-a37e-ff08609bad84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:13:52 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-a2f9ea9e-1da4-435b-96ed-5ecfe8fd4ad9 req-54abc805-92ba-4cc9-9a76-5f753aded602 service nova] Lock "84c6b624-648b-40e2-a37e-ff08609bad84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:13:52 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-a2f9ea9e-1da4-435b-96ed-5ecfe8fd4ad9 req-54abc805-92ba-4cc9-9a76-5f753aded602 service nova] Lock "84c6b624-648b-40e2-a37e-ff08609bad84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:13:52 user nova-compute[75165]: DEBUG nova.compute.manager [req-a2f9ea9e-1da4-435b-96ed-5ecfe8fd4ad9 req-54abc805-92ba-4cc9-9a76-5f753aded602 service nova] [instance: 84c6b624-648b-40e2-a37e-ff08609bad84] No waiting events found dispatching network-vif-plugged-2107529c-ec0e-4d1d-85b4-8605dcabc415 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:13:52 user nova-compute[75165]: WARNING nova.compute.manager [req-a2f9ea9e-1da4-435b-96ed-5ecfe8fd4ad9 req-54abc805-92ba-4cc9-9a76-5f753aded602 service nova] [instance: 84c6b624-648b-40e2-a37e-ff08609bad84] Received unexpected event network-vif-plugged-2107529c-ec0e-4d1d-85b4-8605dcabc415 for instance with vm_state rescued and task_state unrescuing.
Oct 26 00:13:52 user nova-compute[75165]: DEBUG nova.compute.manager [req-a2f9ea9e-1da4-435b-96ed-5ecfe8fd4ad9 req-54abc805-92ba-4cc9-9a76-5f753aded602 service nova] [instance: 84c6b624-648b-40e2-a37e-ff08609bad84] Received event network-vif-plugged-2107529c-ec0e-4d1d-85b4-8605dcabc415 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:13:52 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-a2f9ea9e-1da4-435b-96ed-5ecfe8fd4ad9 req-54abc805-92ba-4cc9-9a76-5f753aded602 service nova] Acquiring lock "84c6b624-648b-40e2-a37e-ff08609bad84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:13:52 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-a2f9ea9e-1da4-435b-96ed-5ecfe8fd4ad9 req-54abc805-92ba-4cc9-9a76-5f753aded602 service nova] Lock "84c6b624-648b-40e2-a37e-ff08609bad84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:13:52 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-a2f9ea9e-1da4-435b-96ed-5ecfe8fd4ad9 req-54abc805-92ba-4cc9-9a76-5f753aded602 service nova] Lock "84c6b624-648b-40e2-a37e-ff08609bad84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:13:52 user nova-compute[75165]: DEBUG nova.compute.manager [req-a2f9ea9e-1da4-435b-96ed-5ecfe8fd4ad9 req-54abc805-92ba-4cc9-9a76-5f753aded602 service nova] [instance: 84c6b624-648b-40e2-a37e-ff08609bad84] No waiting events found dispatching network-vif-plugged-2107529c-ec0e-4d1d-85b4-8605dcabc415 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:13:52 user nova-compute[75165]: WARNING nova.compute.manager [req-a2f9ea9e-1da4-435b-96ed-5ecfe8fd4ad9 req-54abc805-92ba-4cc9-9a76-5f753aded602 service nova] [instance: 84c6b624-648b-40e2-a37e-ff08609bad84] Received unexpected event network-vif-plugged-2107529c-ec0e-4d1d-85b4-8605dcabc415 for instance with vm_state rescued and task_state unrescuing.
Oct 26 00:13:52 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-2d9a00f9-4eb8-4404-a6a0-99aaca591f0b tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:13:52 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-2d9a00f9-4eb8-4404-a6a0-99aaca591f0b tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.584s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:13:52 user nova-compute[75165]: INFO nova.scheduler.client.report [None req-2d9a00f9-4eb8-4404-a6a0-99aaca591f0b tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Deleted allocations for instance 6f9add59-cabe-4965-8fe3-524618550581
Oct 26 00:13:52 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-8189bf2e-b7ce-4d84-8369-4141f82fa737 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] Starting finish_revert_migration {{(pid=75165) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Oct 26 00:13:52 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-8189bf2e-b7ce-4d84-8369-4141f82fa737 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] Start _get_guest_xml network_info=[{"id": "874a1698-c52c-444c-bed5-52633dbaeead", "address": "fa:16:3e:75:45:79", "network": {"id": "30951418-d830-4042-9143-c736802150e9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-167387787-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0db2c49ee28f4b7b9fa990faddb9d3a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap874a1698-c5", "ovs_interfaceid": "874a1698-c52c-444c-bed5-52633dbaeead", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=bff0d8a1-739e-4c4d-9efa-b73ba7b76d01,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'size': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': 'bff0d8a1-739e-4c4d-9efa-b73ba7b76d01'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AokCQquF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '3b153af2-c93b-47d2-ae8c-76cfd44e384c', 'attached_at': '2023-10-26T00:13:52.000000', 'detached_at': '', 'volume_id': 'bdb81c18-9a59-4d59-861d-f713e876159b', 'serial': 'bdb81c18-9a59-4d59-861d-f713e876159b'}, 'guest_format': None, 'boot_index': None, 'disk_bus': 'virtio', 'attachment_id': '954f552c-c86d-4659-8105-a393a5ffb879', 'delete_on_termination': False, 'volume_type': None} {{(pid=75165) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 00:13:52 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-8189bf2e-b7ce-4d84-8369-4141f82fa737 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:13:52 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-8189bf2e-b7ce-4d84-8369-4141f82fa737 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:13:52 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-8189bf2e-b7ce-4d84-8369-4141f82fa737 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75165) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 00:13:52 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-8189bf2e-b7ce-4d84-8369-4141f82fa737 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] CPU controller missing on host. {{(pid=75165) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 00:13:52 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-8189bf2e-b7ce-4d84-8369-4141f82fa737 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75165) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 00:13:52 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-8189bf2e-b7ce-4d84-8369-4141f82fa737 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] CPU controller found on host. {{(pid=75165) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 00:13:52 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-8189bf2e-b7ce-4d84-8369-4141f82fa737 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75165) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 00:13:52 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-8189bf2e-b7ce-4d84-8369-4141f82fa737 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T00:03:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=bff0d8a1-739e-4c4d-9efa-b73ba7b76d01,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 00:13:52 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-8189bf2e-b7ce-4d84-8369-4141f82fa737 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Flavor limits 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 00:13:52 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-8189bf2e-b7ce-4d84-8369-4141f82fa737 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Image limits 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 00:13:52 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-8189bf2e-b7ce-4d84-8369-4141f82fa737 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Flavor pref 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 00:13:52 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-8189bf2e-b7ce-4d84-8369-4141f82fa737 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Image pref 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 00:13:52 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-8189bf2e-b7ce-4d84-8369-4141f82fa737 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 00:13:52 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-8189bf2e-b7ce-4d84-8369-4141f82fa737 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 00:13:52 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-8189bf2e-b7ce-4d84-8369-4141f82fa737 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75165) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 00:13:52 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-8189bf2e-b7ce-4d84-8369-4141f82fa737 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Got 1 possible topologies {{(pid=75165) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 00:13:52 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-8189bf2e-b7ce-4d84-8369-4141f82fa737 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 00:13:52 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-8189bf2e-b7ce-4d84-8369-4141f82fa737 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 00:13:52 user nova-compute[75165]: DEBUG nova.objects.instance [None req-8189bf2e-b7ce-4d84-8369-4141f82fa737 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Lazy-loading 'vcpu_model' on Instance uuid 3b153af2-c93b-47d2-ae8c-76cfd44e384c {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:13:52 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-2d9a00f9-4eb8-4404-a6a0-99aaca591f0b tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Lock "6f9add59-cabe-4965-8fe3-524618550581" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.182s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:13:52 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8189bf2e-b7ce-4d84-8369-4141f82fa737 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] Calling os-brick to attach iSCSI Volume {{(pid=75165) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 00:13:52 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-8189bf2e-b7ce-4d84-8369-4141f82fa737 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8bf8160e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AokCQquF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:13:52 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-8189bf2e-b7ce-4d84-8369-4141f82fa737 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:13:52 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-8189bf2e-b7ce-4d84-8369-4141f82fa737 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:13:52 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-8189bf2e-b7ce-4d84-8369-4141f82fa737 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:13:52 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-8189bf2e-b7ce-4d84-8369-4141f82fa737 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:13:52 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-8189bf2e-b7ce-4d84-8369-4141f82fa737 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:13:52 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-8189bf2e-b7ce-4d84-8369-4141f82fa737 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:13:52 user nova-compute[75165]: INFO os_brick.initiator.connectors.iscsi [None req-8189bf2e-b7ce-4d84-8369-4141f82fa737 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 00:13:52 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b -p 172.16.0.220:3260 {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:13:52 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:13:52 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3388e20-89b3-498e-b3bd-0d7fa7617ee9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:13:52 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-8189bf2e-b7ce-4d84-8369-4141f82fa737 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 00:13:52 user nova-compute[75165]:  {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:13:52 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b -p 172.16.0.220:3260 --interface default --op new {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:13:52 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:13:52 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[227187ab-2e7a-45e7-bd22-9e01fea38ba9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b] added\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:13:52 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-8189bf2e-b7ce-4d84-8369-4141f82fa737 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b] added
Oct 26 00:13:52 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:13:52 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:13:52 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:13:52 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d7ac78b-cbcb-4394-b349-e27362f02777]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:13:52 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-8189bf2e-b7ce-4d84-8369-4141f82fa737 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:13:52 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:13:52 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:13:52 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ad510fd-54a9-406b-8555-fe55d15063e9]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:13:52 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-8189bf2e-b7ce-4d84-8369-4141f82fa737 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:13:52 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AokCQquF {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:13:52 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AokCQquF" returned: 0 in 0.018s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:13:52 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a13e0c5-644a-4fff-8713-98d0721b9f30]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:13:52 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-8189bf2e-b7ce-4d84-8369-4141f82fa737 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AokCQquF'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:13:52 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:13:52 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:13:52 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[80c46bb5-8b4b-4860-a5a5-a9a8383a453c]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:13:52 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-8189bf2e-b7ce-4d84-8369-4141f82fa737 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:13:52 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:13:52 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:13:52 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[33cec2cf-916f-4550-80b7-ef25c0a40668]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:13:52 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-8189bf2e-b7ce-4d84-8369-4141f82fa737 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792 (non-flash)
Oct 26 00:13:52 user nova-compute[75165]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b (non-flash)
Oct 26 00:13:52 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:13:52 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-8189bf2e-b7ce-4d84-8369-4141f82fa737 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792 (non-flash)
Oct 26 00:13:52 user nova-compute[75165]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b (non-flash)
Oct 26 00:13:52 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:13:52 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b -p 172.16.0.220:3260 --login {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:13:52 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:13:52 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[9164a389-a5fe-4db1-afa5-4d7f1adb6aec]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:13:52 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-8189bf2e-b7ce-4d84-8369-4141f82fa737 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b, portal: 172.16.0.220,3260]
Oct 26 00:13:52 user nova-compute[75165]: Login to [iface: default, target: iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b, portal: 172.16.0.220,3260] successful.
Oct 26 00:13:52 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:13:52 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:13:52 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:13:52 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e129867-6c71-4060-8adf-e6d41fd031b7]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:13:52 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-8189bf2e-b7ce-4d84-8369-4141f82fa737 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:13:52 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:13:52 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:13:52 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[c32c2b13-5ac1-486a-a89f-78c530b1ea60]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:13:52 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-8189bf2e-b7ce-4d84-8369-4141f82fa737 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792 (non-flash)
Oct 26 00:13:52 user nova-compute[75165]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b (non-flash)
Oct 26 00:13:52 user nova-compute[75165]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b (non-flash)
Oct 26 00:13:52 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:13:52 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-8189bf2e-b7ce-4d84-8369-4141f82fa737 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792 (non-flash)
Oct 26 00:13:52 user nova-compute[75165]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b (non-flash)
Oct 26 00:13:52 user nova-compute[75165]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b (non-flash)
Oct 26 00:13:52 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:13:52 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-8189bf2e-b7ce-4d84-8369-4141f82fa737 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.326s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:13:52 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-8189bf2e-b7ce-4d84-8369-4141f82fa737 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Connected to 172.16.0.220:3260 {{(pid=75165) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 00:13:52 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-8189bf2e-b7ce-4d84-8369-4141f82fa737 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] HCTL ('35', '-', '-', 0) found on session 17 with lun 0 {{(pid=75165) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 00:13:52 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-8189bf2e-b7ce-4d84-8369-4141f82fa737 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75165) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 00:13:52 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:13:52 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.023s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:13:52 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[67fea589-9461-4c66-a2a2-2e840bbcc0a8]: (4, ('- - 0', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:13:52 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-8189bf2e-b7ce-4d84-8369-4141f82fa737 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Searching for a device in session 17 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75165) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 00:13:52 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-8189bf2e-b7ce-4d84-8369-4141f82fa737 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AokCQquF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75165) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 00:13:53 user nova-compute[75165]: DEBUG nova.compute.manager [None req-fbdcecd5-f8af-415f-8597-c8558b31fa86 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: 84c6b624-648b-40e2-a37e-ff08609bad84] Checking state {{(pid=75165) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 00:13:53 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-8189bf2e-b7ce-4d84-8369-4141f82fa737 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.389s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:13:53 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-8189bf2e-b7ce-4d84-8369-4141f82fa737 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] <== connect_volume: return (1391ms) {'type': 'block', 'scsi_wwn': '26462656239316661', 'path': '/dev/sdd'} {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:13:53 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8189bf2e-b7ce-4d84-8369-4141f82fa737 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26462656239316661', 'path': '/dev/sdd'} {{(pid=75165) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 00:13:53 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-8189bf2e-b7ce-4d84-8369-4141f82fa737 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:07:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1649801525',display_name='tempest-ServerActionsTestOtherB-server-1649801525',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1649801525',id=7,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOvLHGJ3GKBbD7yL0+CRyOJiq2ETP4pGNCe7wwUyptp7nQivcPunaHj7Jl8TaU2mAtfcWQAgpHGkK+GRkPrduKn69eOts5d8qkM1kDwYiMG7whEGtVeGR66PH/dfoMGjVA==',key_name='tempest-keypair-513358976',keypairs=<?>,launch_index=0,launched_at=2023-10-26T00:12:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0db2c49ee28f4b7b9fa990faddb9d3a9',ramdisk_id='',reservation_id='r-tna5v2cw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-238342146',owner_user_name='tempest-ServerActionsTestOtherB-238342146-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T00:13:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43f095bccf684d5a84b874439f2c58e0',uuid=3b153af2-c93b-47d2-ae8c-76cfd44e384c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "874a1698-c52c-444c-bed5-52633dbaeead", "address": "fa:16:3e:75:45:79", "network": {"id": "30951418-d830-4042-9143-c736802150e9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-167387787-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0db2c49ee28f4b7b9fa990faddb9d3a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap874a1698-c5", "ovs_interfaceid": "874a1698-c52c-444c-bed5-52633dbaeead", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75165) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 00:13:53 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-8189bf2e-b7ce-4d84-8369-4141f82fa737 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Converting VIF {"id": "874a1698-c52c-444c-bed5-52633dbaeead", "address": "fa:16:3e:75:45:79", "network": {"id": "30951418-d830-4042-9143-c736802150e9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-167387787-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0db2c49ee28f4b7b9fa990faddb9d3a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap874a1698-c5", "ovs_interfaceid": "874a1698-c52c-444c-bed5-52633dbaeead", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:13:53 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-8189bf2e-b7ce-4d84-8369-4141f82fa737 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:45:79,bridge_name='br-int',has_traffic_filtering=True,id=874a1698-c52c-444c-bed5-52633dbaeead,network=Network(30951418-d830-4042-9143-c736802150e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap874a1698-c5') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:13:53 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-8189bf2e-b7ce-4d84-8369-4141f82fa737 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] End _get_guest_xml xml=<domain type="kvm">
Oct 26 00:13:53 user nova-compute[75165]:   <uuid>3b153af2-c93b-47d2-ae8c-76cfd44e384c</uuid>
Oct 26 00:13:53 user nova-compute[75165]:   <name>instance-00000007</name>
Oct 26 00:13:53 user nova-compute[75165]:   <memory>524288</memory>
Oct 26 00:13:53 user nova-compute[75165]:   <vcpu>1</vcpu>
Oct 26 00:13:53 user nova-compute[75165]:   <metadata>
Oct 26 00:13:53 user nova-compute[75165]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 00:13:53 user nova-compute[75165]:       <nova:package version="0.0.0"/>
Oct 26 00:13:53 user nova-compute[75165]:       <nova:name>tempest-ServerActionsTestOtherB-server-1649801525</nova:name>
Oct 26 00:13:53 user nova-compute[75165]:       <nova:creationTime>2023-10-26 00:13:52</nova:creationTime>
Oct 26 00:13:53 user nova-compute[75165]:       <nova:flavor name="m1.tiny">
Oct 26 00:13:53 user nova-compute[75165]:         <nova:memory>512</nova:memory>
Oct 26 00:13:53 user nova-compute[75165]:         <nova:disk>1</nova:disk>
Oct 26 00:13:53 user nova-compute[75165]:         <nova:swap>0</nova:swap>
Oct 26 00:13:53 user nova-compute[75165]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 00:13:53 user nova-compute[75165]:         <nova:vcpus>1</nova:vcpus>
Oct 26 00:13:53 user nova-compute[75165]:       </nova:flavor>
Oct 26 00:13:53 user nova-compute[75165]:       <nova:owner>
Oct 26 00:13:53 user nova-compute[75165]:         <nova:user uuid="43f095bccf684d5a84b874439f2c58e0">tempest-ServerActionsTestOtherB-238342146-project-member</nova:user>
Oct 26 00:13:53 user nova-compute[75165]:         <nova:project uuid="0db2c49ee28f4b7b9fa990faddb9d3a9">tempest-ServerActionsTestOtherB-238342146</nova:project>
Oct 26 00:13:53 user nova-compute[75165]:       </nova:owner>
Oct 26 00:13:53 user nova-compute[75165]:       <nova:root type="image" uuid="bff0d8a1-739e-4c4d-9efa-b73ba7b76d01"/>
Oct 26 00:13:53 user nova-compute[75165]:       <nova:ports>
Oct 26 00:13:53 user nova-compute[75165]:         <nova:port uuid="874a1698-c52c-444c-bed5-52633dbaeead">
Oct 26 00:13:53 user nova-compute[75165]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 26 00:13:53 user nova-compute[75165]:         </nova:port>
Oct 26 00:13:53 user nova-compute[75165]:       </nova:ports>
Oct 26 00:13:53 user nova-compute[75165]:     </nova:instance>
Oct 26 00:13:53 user nova-compute[75165]:   </metadata>
Oct 26 00:13:53 user nova-compute[75165]:   <sysinfo type="smbios">
Oct 26 00:13:53 user nova-compute[75165]:     <system>
Oct 26 00:13:53 user nova-compute[75165]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 00:13:53 user nova-compute[75165]:       <entry name="product">OpenStack Nova</entry>
Oct 26 00:13:53 user nova-compute[75165]:       <entry name="version">0.0.0</entry>
Oct 26 00:13:53 user nova-compute[75165]:       <entry name="serial">3b153af2-c93b-47d2-ae8c-76cfd44e384c</entry>
Oct 26 00:13:53 user nova-compute[75165]:       <entry name="uuid">3b153af2-c93b-47d2-ae8c-76cfd44e384c</entry>
Oct 26 00:13:53 user nova-compute[75165]:       <entry name="family">Virtual Machine</entry>
Oct 26 00:13:53 user nova-compute[75165]:     </system>
Oct 26 00:13:53 user nova-compute[75165]:   </sysinfo>
Oct 26 00:13:53 user nova-compute[75165]:   <os>
Oct 26 00:13:53 user nova-compute[75165]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 00:13:53 user nova-compute[75165]:     <boot dev="hd"/>
Oct 26 00:13:53 user nova-compute[75165]:     <smbios mode="sysinfo"/>
Oct 26 00:13:53 user nova-compute[75165]:   </os>
Oct 26 00:13:53 user nova-compute[75165]:   <features>
Oct 26 00:13:53 user nova-compute[75165]:     <acpi/>
Oct 26 00:13:53 user nova-compute[75165]:     <apic/>
Oct 26 00:13:53 user nova-compute[75165]:     <vmcoreinfo/>
Oct 26 00:13:53 user nova-compute[75165]:   </features>
Oct 26 00:13:53 user nova-compute[75165]:   <clock offset="utc">
Oct 26 00:13:53 user nova-compute[75165]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 00:13:53 user nova-compute[75165]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 00:13:53 user nova-compute[75165]:     <timer name="hpet" present="no"/>
Oct 26 00:13:53 user nova-compute[75165]:   </clock>
Oct 26 00:13:53 user nova-compute[75165]:   <cpu mode="custom" match="exact">
Oct 26 00:13:53 user nova-compute[75165]:     <model>Nehalem</model>
Oct 26 00:13:53 user nova-compute[75165]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 00:13:53 user nova-compute[75165]:   </cpu>
Oct 26 00:13:53 user nova-compute[75165]:   <devices>
Oct 26 00:13:53 user nova-compute[75165]:     <disk type="file" device="disk">
Oct 26 00:13:53 user nova-compute[75165]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 00:13:53 user nova-compute[75165]:       <source file="/opt/stack/data/nova/instances/3b153af2-c93b-47d2-ae8c-76cfd44e384c/disk"/>
Oct 26 00:13:53 user nova-compute[75165]:       <target dev="vda" bus="virtio"/>
Oct 26 00:13:53 user nova-compute[75165]:     </disk>
Oct 26 00:13:53 user nova-compute[75165]:     <disk type="block" device="disk">
Oct 26 00:13:53 user nova-compute[75165]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 00:13:53 user nova-compute[75165]:       <source dev="/dev/sdd"/>
Oct 26 00:13:53 user nova-compute[75165]:       <target dev="vdb" bus="virtio"/>
Oct 26 00:13:53 user nova-compute[75165]:       <serial>bdb81c18-9a59-4d59-861d-f713e876159b</serial>
Oct 26 00:13:53 user nova-compute[75165]:     </disk>
Oct 26 00:13:53 user nova-compute[75165]:     <interface type="ethernet">
Oct 26 00:13:53 user nova-compute[75165]:       <mac address="fa:16:3e:75:45:79"/>
Oct 26 00:13:53 user nova-compute[75165]:       <model type="virtio"/>
Oct 26 00:13:53 user nova-compute[75165]:       <mtu size="1442"/>
Oct 26 00:13:53 user nova-compute[75165]:       <target dev="tap874a1698-c5"/>
Oct 26 00:13:53 user nova-compute[75165]:     </interface>
Oct 26 00:13:53 user nova-compute[75165]:     <serial type="pty">
Oct 26 00:13:53 user nova-compute[75165]:       <log file="/opt/stack/data/nova/instances/3b153af2-c93b-47d2-ae8c-76cfd44e384c/console.log" append="off"/>
Oct 26 00:13:53 user nova-compute[75165]:     </serial>
Oct 26 00:13:53 user nova-compute[75165]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 00:13:53 user nova-compute[75165]:     <video>
Oct 26 00:13:53 user nova-compute[75165]:       <model type="virtio"/>
Oct 26 00:13:53 user nova-compute[75165]:     </video>
Oct 26 00:13:53 user nova-compute[75165]:     <rng model="virtio">
Oct 26 00:13:53 user nova-compute[75165]:       <backend model="random">/dev/urandom</backend>
Oct 26 00:13:53 user nova-compute[75165]:     </rng>
Oct 26 00:13:53 user nova-compute[75165]:     <controller type="usb" index="0" model="none"/>
Oct 26 00:13:53 user nova-compute[75165]:     <memballoon model="virtio">
Oct 26 00:13:53 user nova-compute[75165]:       <stats period="10"/>
Oct 26 00:13:53 user nova-compute[75165]:     </memballoon>
Oct 26 00:13:53 user nova-compute[75165]:   </devices>
Oct 26 00:13:53 user nova-compute[75165]: </domain>
Oct 26 00:13:53 user nova-compute[75165]:  {{(pid=75165) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 00:13:53 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-8189bf2e-b7ce-4d84-8369-4141f82fa737 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:07:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1649801525',display_name='tempest-ServerActionsTestOtherB-server-1649801525',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1649801525',id=7,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOvLHGJ3GKBbD7yL0+CRyOJiq2ETP4pGNCe7wwUyptp7nQivcPunaHj7Jl8TaU2mAtfcWQAgpHGkK+GRkPrduKn69eOts5d8qkM1kDwYiMG7whEGtVeGR66PH/dfoMGjVA==',key_name='tempest-keypair-513358976',keypairs=<?>,launch_index=0,launched_at=2023-10-26T00:12:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0db2c49ee28f4b7b9fa990faddb9d3a9',ramdisk_id='',reservation_id='r-tna5v2cw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-238342146',owner_user_name='tempest-ServerActionsTestOtherB-238342146-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T00:13:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43f095bccf684d5a84b874439f2c58e0',uuid=3b153af2-c93b-47d2-ae8c-76cfd44e384c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "874a1698-c52c-444c-bed5-52633dbaeead", "address": "fa:16:3e:75:45:79", "network": {"id": "30951418-d830-4042-9143-c736802150e9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-167387787-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0db2c49ee28f4b7b9fa990faddb9d3a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap874a1698-c5", "ovs_interfaceid": "874a1698-c52c-444c-bed5-52633dbaeead", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 00:13:53 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-8189bf2e-b7ce-4d84-8369-4141f82fa737 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Converting VIF {"id": "874a1698-c52c-444c-bed5-52633dbaeead", "address": "fa:16:3e:75:45:79", "network": {"id": "30951418-d830-4042-9143-c736802150e9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-167387787-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0db2c49ee28f4b7b9fa990faddb9d3a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap874a1698-c5", "ovs_interfaceid": "874a1698-c52c-444c-bed5-52633dbaeead", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:13:53 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-8189bf2e-b7ce-4d84-8369-4141f82fa737 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:45:79,bridge_name='br-int',has_traffic_filtering=True,id=874a1698-c52c-444c-bed5-52633dbaeead,network=Network(30951418-d830-4042-9143-c736802150e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap874a1698-c5') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:13:53 user nova-compute[75165]: DEBUG os_vif [None req-8189bf2e-b7ce-4d84-8369-4141f82fa737 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:45:79,bridge_name='br-int',has_traffic_filtering=True,id=874a1698-c52c-444c-bed5-52633dbaeead,network=Network(30951418-d830-4042-9143-c736802150e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap874a1698-c5') {{(pid=75165) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 00:13:53 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:13:53 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:13:53 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 00:13:53 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:13:53 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4fd37b35-3e3c-57c4-8962-2fc6df59ac1d', '_type': 'linux-noop'}}, row=False) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:13:53 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:13:53 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:13:53 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:13:53 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap874a1698-c5, may_exist=True, interface_attrs={}) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:13:53 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap874a1698-c5, col_values=(('qos', UUID('f90911c3-9be4-4198-ace0-8b533fa371c8')),), if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:13:53 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap874a1698-c5, col_values=(('external_ids', {'iface-id': '874a1698-c52c-444c-bed5-52633dbaeead', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:75:45:79', 'vm-uuid': '3b153af2-c93b-47d2-ae8c-76cfd44e384c'}),), if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:13:53 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:13:53 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:13:53 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:13:53 user nova-compute[75165]: INFO os_vif [None req-8189bf2e-b7ce-4d84-8369-4141f82fa737 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:45:79,bridge_name='br-int',has_traffic_filtering=True,id=874a1698-c52c-444c-bed5-52633dbaeead,network=Network(30951418-d830-4042-9143-c736802150e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap874a1698-c5')
Oct 26 00:13:55 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:13:55 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:13:55 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:13:55 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:13:55 user nova-compute[75165]: DEBUG nova.compute.manager [req-4b874cf5-195c-4ca4-9963-ea3c4c08490c req-61d28f8d-a916-4c1c-87c4-4dda2b748121 service nova] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] Received event network-vif-plugged-874a1698-c52c-444c-bed5-52633dbaeead {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:13:55 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-4b874cf5-195c-4ca4-9963-ea3c4c08490c req-61d28f8d-a916-4c1c-87c4-4dda2b748121 service nova] Acquiring lock "3b153af2-c93b-47d2-ae8c-76cfd44e384c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:13:55 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-4b874cf5-195c-4ca4-9963-ea3c4c08490c req-61d28f8d-a916-4c1c-87c4-4dda2b748121 service nova] Lock "3b153af2-c93b-47d2-ae8c-76cfd44e384c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:13:55 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-4b874cf5-195c-4ca4-9963-ea3c4c08490c req-61d28f8d-a916-4c1c-87c4-4dda2b748121 service nova] Lock "3b153af2-c93b-47d2-ae8c-76cfd44e384c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:13:55 user nova-compute[75165]: DEBUG nova.compute.manager [req-4b874cf5-195c-4ca4-9963-ea3c4c08490c req-61d28f8d-a916-4c1c-87c4-4dda2b748121 service nova] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] No waiting events found dispatching network-vif-plugged-874a1698-c52c-444c-bed5-52633dbaeead {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:13:55 user nova-compute[75165]: WARNING nova.compute.manager [req-4b874cf5-195c-4ca4-9963-ea3c4c08490c req-61d28f8d-a916-4c1c-87c4-4dda2b748121 service nova] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] Received unexpected event network-vif-plugged-874a1698-c52c-444c-bed5-52633dbaeead for instance with vm_state resized and task_state resize_reverting.
Oct 26 00:13:55 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:13:55 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:13:55 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:13:57 user nova-compute[75165]: DEBUG nova.compute.manager [req-6081bc8c-ce02-4552-b57f-b08d8cdfb1b8 req-30dabff7-7681-47d0-8942-ac903c0ef66f service nova] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] Received event network-vif-plugged-874a1698-c52c-444c-bed5-52633dbaeead {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:13:57 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-6081bc8c-ce02-4552-b57f-b08d8cdfb1b8 req-30dabff7-7681-47d0-8942-ac903c0ef66f service nova] Acquiring lock "3b153af2-c93b-47d2-ae8c-76cfd44e384c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:13:57 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-6081bc8c-ce02-4552-b57f-b08d8cdfb1b8 req-30dabff7-7681-47d0-8942-ac903c0ef66f service nova] Lock "3b153af2-c93b-47d2-ae8c-76cfd44e384c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:13:57 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-6081bc8c-ce02-4552-b57f-b08d8cdfb1b8 req-30dabff7-7681-47d0-8942-ac903c0ef66f service nova] Lock "3b153af2-c93b-47d2-ae8c-76cfd44e384c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:13:57 user nova-compute[75165]: DEBUG nova.compute.manager [req-6081bc8c-ce02-4552-b57f-b08d8cdfb1b8 req-30dabff7-7681-47d0-8942-ac903c0ef66f service nova] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] No waiting events found dispatching network-vif-plugged-874a1698-c52c-444c-bed5-52633dbaeead {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:13:57 user nova-compute[75165]: WARNING nova.compute.manager [req-6081bc8c-ce02-4552-b57f-b08d8cdfb1b8 req-30dabff7-7681-47d0-8942-ac903c0ef66f service nova] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] Received unexpected event network-vif-plugged-874a1698-c52c-444c-bed5-52633dbaeead for instance with vm_state resized and task_state resize_reverting.
Oct 26 00:13:57 user nova-compute[75165]: DEBUG nova.compute.manager [None req-8189bf2e-b7ce-4d84-8369-4141f82fa737 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] Instance event wait completed in 0 seconds for  {{(pid=75165) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 00:13:57 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] Instance running successfully.
Oct 26 00:13:57 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-8189bf2e-b7ce-4d84-8369-4141f82fa737 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] finish_revert_migration finished successfully. {{(pid=75165) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Oct 26 00:13:58 user nova-compute[75165]: INFO nova.compute.manager [None req-8189bf2e-b7ce-4d84-8369-4141f82fa737 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] Updating instance to original state: 'active'
Oct 26 00:13:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:13:59 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-778c04c7-4f75-4351-8b09-5b4757b5df9a tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] Acquiring lock "b0edba5b-e4d8-4b0a-ace1-1f32c19f8bd0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:13:59 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-778c04c7-4f75-4351-8b09-5b4757b5df9a tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] Lock "b0edba5b-e4d8-4b0a-ace1-1f32c19f8bd0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:13:59 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-778c04c7-4f75-4351-8b09-5b4757b5df9a tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] Acquiring lock "b0edba5b-e4d8-4b0a-ace1-1f32c19f8bd0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:13:59 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-778c04c7-4f75-4351-8b09-5b4757b5df9a tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] Lock "b0edba5b-e4d8-4b0a-ace1-1f32c19f8bd0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:13:59 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-778c04c7-4f75-4351-8b09-5b4757b5df9a tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] Lock "b0edba5b-e4d8-4b0a-ace1-1f32c19f8bd0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:13:59 user nova-compute[75165]: INFO nova.compute.manager [None req-778c04c7-4f75-4351-8b09-5b4757b5df9a tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] [instance: b0edba5b-e4d8-4b0a-ace1-1f32c19f8bd0] Terminating instance
Oct 26 00:13:59 user nova-compute[75165]: DEBUG nova.compute.manager [None req-778c04c7-4f75-4351-8b09-5b4757b5df9a tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] [instance: b0edba5b-e4d8-4b0a-ace1-1f32c19f8bd0] Start destroying the instance on the hypervisor. {{(pid=75165) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 00:13:59 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:13:59 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:13:59 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:13:59 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:13:59 user nova-compute[75165]: DEBUG nova.compute.manager [req-5d2ad97c-3e72-450e-a3a9-0047b45f6046 req-885e2ed5-06c3-4f8b-8f1e-4a08514a621b service nova] [instance: b0edba5b-e4d8-4b0a-ace1-1f32c19f8bd0] Received event network-vif-unplugged-e931a766-e43c-4224-bb52-9c8561f4aa6d {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:13:59 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-5d2ad97c-3e72-450e-a3a9-0047b45f6046 req-885e2ed5-06c3-4f8b-8f1e-4a08514a621b service nova] Acquiring lock "b0edba5b-e4d8-4b0a-ace1-1f32c19f8bd0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:13:59 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-5d2ad97c-3e72-450e-a3a9-0047b45f6046 req-885e2ed5-06c3-4f8b-8f1e-4a08514a621b service nova] Lock "b0edba5b-e4d8-4b0a-ace1-1f32c19f8bd0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:13:59 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-5d2ad97c-3e72-450e-a3a9-0047b45f6046 req-885e2ed5-06c3-4f8b-8f1e-4a08514a621b service nova] Lock "b0edba5b-e4d8-4b0a-ace1-1f32c19f8bd0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:13:59 user nova-compute[75165]: DEBUG nova.compute.manager [req-5d2ad97c-3e72-450e-a3a9-0047b45f6046 req-885e2ed5-06c3-4f8b-8f1e-4a08514a621b service nova] [instance: b0edba5b-e4d8-4b0a-ace1-1f32c19f8bd0] No waiting events found dispatching network-vif-unplugged-e931a766-e43c-4224-bb52-9c8561f4aa6d {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:13:59 user nova-compute[75165]: DEBUG nova.compute.manager [req-5d2ad97c-3e72-450e-a3a9-0047b45f6046 req-885e2ed5-06c3-4f8b-8f1e-4a08514a621b service nova] [instance: b0edba5b-e4d8-4b0a-ace1-1f32c19f8bd0] Received event network-vif-unplugged-e931a766-e43c-4224-bb52-9c8561f4aa6d for instance with task_state deleting. {{(pid=75165) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 00:14:00 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: b0edba5b-e4d8-4b0a-ace1-1f32c19f8bd0] Instance destroyed successfully.
Oct 26 00:14:00 user nova-compute[75165]: DEBUG nova.objects.instance [None req-778c04c7-4f75-4351-8b09-5b4757b5df9a tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] Lazy-loading 'resources' on Instance uuid b0edba5b-e4d8-4b0a-ace1-1f32c19f8bd0 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:14:00 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-778c04c7-4f75-4351-8b09-5b4757b5df9a tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:11:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-800946363',display_name='tempest-VolumesActionsTest-instance-800946363',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-800946363',id=17,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-26T00:12:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7c9acab3d48a43568a5096c8d786538d',ramdisk_id='',reservation_id='r-tfbej80e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-229861779',owner_user_name='tempest-VolumesActionsTest-229861779-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T00:12:04Z,user_data=None,user_id='f1b35e426f0f488b9fab44fe85bcff98',uuid=b0edba5b-e4d8-4b0a-ace1-1f32c19f8bd0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e931a766-e43c-4224-bb52-9c8561f4aa6d", "address": "fa:16:3e:af:fa:87", "network": {"id": "e571d376-bebd-49ff-b7ee-64a148f25b55", "bridge": "br-int", "label": "tempest-VolumesActionsTest-502796136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c9acab3d48a43568a5096c8d786538d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape931a766-e4", "ovs_interfaceid": "e931a766-e43c-4224-bb52-9c8561f4aa6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 00:14:00 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-778c04c7-4f75-4351-8b09-5b4757b5df9a tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] Converting VIF {"id": "e931a766-e43c-4224-bb52-9c8561f4aa6d", "address": "fa:16:3e:af:fa:87", "network": {"id": "e571d376-bebd-49ff-b7ee-64a148f25b55", "bridge": "br-int", "label": "tempest-VolumesActionsTest-502796136-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c9acab3d48a43568a5096c8d786538d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape931a766-e4", "ovs_interfaceid": "e931a766-e43c-4224-bb52-9c8561f4aa6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:14:00 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-778c04c7-4f75-4351-8b09-5b4757b5df9a tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:fa:87,bridge_name='br-int',has_traffic_filtering=True,id=e931a766-e43c-4224-bb52-9c8561f4aa6d,network=Network(e571d376-bebd-49ff-b7ee-64a148f25b55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape931a766-e4') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:14:00 user nova-compute[75165]: DEBUG os_vif [None req-778c04c7-4f75-4351-8b09-5b4757b5df9a tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:fa:87,bridge_name='br-int',has_traffic_filtering=True,id=e931a766-e43c-4224-bb52-9c8561f4aa6d,network=Network(e571d376-bebd-49ff-b7ee-64a148f25b55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape931a766-e4') {{(pid=75165) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 00:14:00 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:14:00 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape931a766-e4, bridge=br-int, if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:14:00 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:14:00 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:14:00 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ae7c99f8-accf-4077-a008-9f5a77a0fed1) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:14:00 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:14:00 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:14:00 user nova-compute[75165]: INFO os_vif [None req-778c04c7-4f75-4351-8b09-5b4757b5df9a tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:fa:87,bridge_name='br-int',has_traffic_filtering=True,id=e931a766-e43c-4224-bb52-9c8561f4aa6d,network=Network(e571d376-bebd-49ff-b7ee-64a148f25b55),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape931a766-e4')
Oct 26 00:14:00 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-778c04c7-4f75-4351-8b09-5b4757b5df9a tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] [instance: b0edba5b-e4d8-4b0a-ace1-1f32c19f8bd0] Deleting instance files /opt/stack/data/nova/instances/b0edba5b-e4d8-4b0a-ace1-1f32c19f8bd0_del
Oct 26 00:14:00 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-778c04c7-4f75-4351-8b09-5b4757b5df9a tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] [instance: b0edba5b-e4d8-4b0a-ace1-1f32c19f8bd0] Deletion of /opt/stack/data/nova/instances/b0edba5b-e4d8-4b0a-ace1-1f32c19f8bd0_del complete
Oct 26 00:14:00 user nova-compute[75165]: INFO nova.compute.manager [None req-778c04c7-4f75-4351-8b09-5b4757b5df9a tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] [instance: b0edba5b-e4d8-4b0a-ace1-1f32c19f8bd0] Took 1.08 seconds to destroy the instance on the hypervisor.
Oct 26 00:14:00 user nova-compute[75165]: DEBUG oslo.service.loopingcall [None req-778c04c7-4f75-4351-8b09-5b4757b5df9a tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75165) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 00:14:00 user nova-compute[75165]: DEBUG nova.compute.manager [-] [instance: b0edba5b-e4d8-4b0a-ace1-1f32c19f8bd0] Deallocating network for instance {{(pid=75165) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 00:14:00 user nova-compute[75165]: DEBUG nova.network.neutron [-] [instance: b0edba5b-e4d8-4b0a-ace1-1f32c19f8bd0] deallocate_for_instance() {{(pid=75165) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 00:14:00 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:14:01 user nova-compute[75165]: DEBUG nova.network.neutron [-] [instance: b0edba5b-e4d8-4b0a-ace1-1f32c19f8bd0] Updating instance_info_cache with network_info: [] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:14:01 user nova-compute[75165]: DEBUG nova.compute.manager [req-b82bad34-6d10-40ee-a6ef-7655d7e12e84 req-b7512f89-dbb9-4f5c-93e9-9e4424096eff service nova] [instance: b0edba5b-e4d8-4b0a-ace1-1f32c19f8bd0] Received event network-vif-deleted-e931a766-e43c-4224-bb52-9c8561f4aa6d {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:14:01 user nova-compute[75165]: INFO nova.compute.manager [req-b82bad34-6d10-40ee-a6ef-7655d7e12e84 req-b7512f89-dbb9-4f5c-93e9-9e4424096eff service nova] [instance: b0edba5b-e4d8-4b0a-ace1-1f32c19f8bd0] Neutron deleted interface e931a766-e43c-4224-bb52-9c8561f4aa6d; detaching it from the instance and deleting it from the info cache
Oct 26 00:14:01 user nova-compute[75165]: DEBUG nova.network.neutron [req-b82bad34-6d10-40ee-a6ef-7655d7e12e84 req-b7512f89-dbb9-4f5c-93e9-9e4424096eff service nova] [instance: b0edba5b-e4d8-4b0a-ace1-1f32c19f8bd0] Updating instance_info_cache with network_info: [] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:14:01 user nova-compute[75165]: INFO nova.compute.manager [-] [instance: b0edba5b-e4d8-4b0a-ace1-1f32c19f8bd0] Took 0.88 seconds to deallocate network for instance.
Oct 26 00:14:01 user nova-compute[75165]: DEBUG nova.compute.manager [req-b82bad34-6d10-40ee-a6ef-7655d7e12e84 req-b7512f89-dbb9-4f5c-93e9-9e4424096eff service nova] [instance: b0edba5b-e4d8-4b0a-ace1-1f32c19f8bd0] Detach interface failed, port_id=e931a766-e43c-4224-bb52-9c8561f4aa6d, reason: Instance b0edba5b-e4d8-4b0a-ace1-1f32c19f8bd0 could not be found. {{(pid=75165) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 26 00:14:01 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-778c04c7-4f75-4351-8b09-5b4757b5df9a tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:14:01 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-778c04c7-4f75-4351-8b09-5b4757b5df9a tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:14:01 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-778c04c7-4f75-4351-8b09-5b4757b5df9a tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:14:01 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-778c04c7-4f75-4351-8b09-5b4757b5df9a tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:14:01 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:14:02 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-778c04c7-4f75-4351-8b09-5b4757b5df9a tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.644s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:14:02 user nova-compute[75165]: DEBUG nova.compute.manager [req-393cc9ae-4b9c-4695-90a2-f523884831c2 req-00e10ccc-e2da-444b-a608-512256ab4d12 service nova] [instance: b0edba5b-e4d8-4b0a-ace1-1f32c19f8bd0] Received event network-vif-plugged-e931a766-e43c-4224-bb52-9c8561f4aa6d {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:14:02 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-393cc9ae-4b9c-4695-90a2-f523884831c2 req-00e10ccc-e2da-444b-a608-512256ab4d12 service nova] Acquiring lock "b0edba5b-e4d8-4b0a-ace1-1f32c19f8bd0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:14:02 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-393cc9ae-4b9c-4695-90a2-f523884831c2 req-00e10ccc-e2da-444b-a608-512256ab4d12 service nova] Lock "b0edba5b-e4d8-4b0a-ace1-1f32c19f8bd0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:14:02 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-393cc9ae-4b9c-4695-90a2-f523884831c2 req-00e10ccc-e2da-444b-a608-512256ab4d12 service nova] Lock "b0edba5b-e4d8-4b0a-ace1-1f32c19f8bd0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:14:02 user nova-compute[75165]: DEBUG nova.compute.manager [req-393cc9ae-4b9c-4695-90a2-f523884831c2 req-00e10ccc-e2da-444b-a608-512256ab4d12 service nova] [instance: b0edba5b-e4d8-4b0a-ace1-1f32c19f8bd0] No waiting events found dispatching network-vif-plugged-e931a766-e43c-4224-bb52-9c8561f4aa6d {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:14:02 user nova-compute[75165]: WARNING nova.compute.manager [req-393cc9ae-4b9c-4695-90a2-f523884831c2 req-00e10ccc-e2da-444b-a608-512256ab4d12 service nova] [instance: b0edba5b-e4d8-4b0a-ace1-1f32c19f8bd0] Received unexpected event network-vif-plugged-e931a766-e43c-4224-bb52-9c8561f4aa6d for instance with vm_state deleted and task_state None.
Oct 26 00:14:02 user nova-compute[75165]: INFO nova.scheduler.client.report [None req-778c04c7-4f75-4351-8b09-5b4757b5df9a tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] Deleted allocations for instance b0edba5b-e4d8-4b0a-ace1-1f32c19f8bd0
Oct 26 00:14:02 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-778c04c7-4f75-4351-8b09-5b4757b5df9a tempest-VolumesActionsTest-229861779 tempest-VolumesActionsTest-229861779-project-member] Lock "b0edba5b-e4d8-4b0a-ace1-1f32c19f8bd0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.877s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:14:02 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:14:03 user nova-compute[75165]: DEBUG nova.compute.manager [req-a772813f-9ac9-40ca-aaa3-1f87b722db3f req-047f8941-199a-4506-b682-af2eb8c94504 service nova] [instance: 3150d249-37a2-49c6-837a-3828480fa2b4] Received event network-changed-e959f8cc-deda-4ee5-8f46-7d5fbcb13a3b {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:14:03 user nova-compute[75165]: DEBUG nova.compute.manager [req-a772813f-9ac9-40ca-aaa3-1f87b722db3f req-047f8941-199a-4506-b682-af2eb8c94504 service nova] [instance: 3150d249-37a2-49c6-837a-3828480fa2b4] Refreshing instance network info cache due to event network-changed-e959f8cc-deda-4ee5-8f46-7d5fbcb13a3b. {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 00:14:03 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-a772813f-9ac9-40ca-aaa3-1f87b722db3f req-047f8941-199a-4506-b682-af2eb8c94504 service nova] Acquiring lock "refresh_cache-3150d249-37a2-49c6-837a-3828480fa2b4" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:14:03 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-a772813f-9ac9-40ca-aaa3-1f87b722db3f req-047f8941-199a-4506-b682-af2eb8c94504 service nova] Acquired lock "refresh_cache-3150d249-37a2-49c6-837a-3828480fa2b4" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:14:03 user nova-compute[75165]: DEBUG nova.network.neutron [req-a772813f-9ac9-40ca-aaa3-1f87b722db3f req-047f8941-199a-4506-b682-af2eb8c94504 service nova] [instance: 3150d249-37a2-49c6-837a-3828480fa2b4] Refreshing network info cache for port e959f8cc-deda-4ee5-8f46-7d5fbcb13a3b {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 00:14:03 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:14:04 user nova-compute[75165]: DEBUG nova.network.neutron [req-a772813f-9ac9-40ca-aaa3-1f87b722db3f req-047f8941-199a-4506-b682-af2eb8c94504 service nova] [instance: 3150d249-37a2-49c6-837a-3828480fa2b4] Updated VIF entry in instance network info cache for port e959f8cc-deda-4ee5-8f46-7d5fbcb13a3b. {{(pid=75165) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 00:14:04 user nova-compute[75165]: DEBUG nova.network.neutron [req-a772813f-9ac9-40ca-aaa3-1f87b722db3f req-047f8941-199a-4506-b682-af2eb8c94504 service nova] [instance: 3150d249-37a2-49c6-837a-3828480fa2b4] Updating instance_info_cache with network_info: [{"id": "e959f8cc-deda-4ee5-8f46-7d5fbcb13a3b", "address": "fa:16:3e:45:96:61", "network": {"id": "158a2f37-110c-4873-af74-f8c483280159", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1353815059-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7043dc6e5575484b8747c13d3928f717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape959f8cc-de", "ovs_interfaceid": "e959f8cc-deda-4ee5-8f46-7d5fbcb13a3b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:14:04 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-a772813f-9ac9-40ca-aaa3-1f87b722db3f req-047f8941-199a-4506-b682-af2eb8c94504 service nova] Releasing lock "refresh_cache-3150d249-37a2-49c6-837a-3828480fa2b4" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:14:04 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:14:04 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75165) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 00:14:04 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:14:04 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:14:04 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:14:04 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:14:04 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75165) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 00:14:05 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9633e6bb-5e95-4994-92a2-9d8f85a946ff/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:14:05 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9633e6bb-5e95-4994-92a2-9d8f85a946ff/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:14:05 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9633e6bb-5e95-4994-92a2-9d8f85a946ff/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:14:05 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:14:05 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9633e6bb-5e95-4994-92a2-9d8f85a946ff/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:14:05 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84c6b624-648b-40e2-a37e-ff08609bad84/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:14:05 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84c6b624-648b-40e2-a37e-ff08609bad84/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:14:05 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84c6b624-648b-40e2-a37e-ff08609bad84/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:14:05 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84c6b624-648b-40e2-a37e-ff08609bad84/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:14:05 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7eeb145-1565-4812-818b-fefda5f2436d/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:14:05 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:14:06 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7eeb145-1565-4812-818b-fefda5f2436d/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:14:06 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7eeb145-1565-4812-818b-fefda5f2436d/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:14:06 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7eeb145-1565-4812-818b-fefda5f2436d/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:14:06 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3150d249-37a2-49c6-837a-3828480fa2b4/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:14:06 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3150d249-37a2-49c6-837a-3828480fa2b4/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:14:06 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3150d249-37a2-49c6-837a-3828480fa2b4/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:14:06 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3150d249-37a2-49c6-837a-3828480fa2b4/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:14:06 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b9689c-5e83-4807-971f-5b244914b7e5/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:14:06 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b9689c-5e83-4807-971f-5b244914b7e5/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:14:06 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b9689c-5e83-4807-971f-5b244914b7e5/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:14:07 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b9689c-5e83-4807-971f-5b244914b7e5/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:14:07 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75165) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 00:14:07 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26a0b493-bb47-466e-95d5-945fc3849fa5/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:14:07 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26a0b493-bb47-466e-95d5-945fc3849fa5/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:14:07 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26a0b493-bb47-466e-95d5-945fc3849fa5/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:14:07 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26a0b493-bb47-466e-95d5-945fc3849fa5/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:14:07 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e44bfc-6a68-46ce-8335-aaaba5160d3e/disk.rescue --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:14:07 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e44bfc-6a68-46ce-8335-aaaba5160d3e/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:14:07 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e44bfc-6a68-46ce-8335-aaaba5160d3e/disk.rescue --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:14:07 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e44bfc-6a68-46ce-8335-aaaba5160d3e/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:14:07 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e44bfc-6a68-46ce-8335-aaaba5160d3e/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:14:08 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e44bfc-6a68-46ce-8335-aaaba5160d3e/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:14:08 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e44bfc-6a68-46ce-8335-aaaba5160d3e/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:14:08 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e44bfc-6a68-46ce-8335-aaaba5160d3e/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:14:08 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27fa1771-fb69-49da-81b3-7f112e623170/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:14:08 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27fa1771-fb69-49da-81b3-7f112e623170/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:14:08 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27fa1771-fb69-49da-81b3-7f112e623170/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:14:08 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27fa1771-fb69-49da-81b3-7f112e623170/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:14:08 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b153af2-c93b-47d2-ae8c-76cfd44e384c/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:14:08 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b153af2-c93b-47d2-ae8c-76cfd44e384c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:14:08 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b153af2-c93b-47d2-ae8c-76cfd44e384c/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:14:08 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-17c5224f-8e4a-4222-9eec-03e522caecf0 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Acquiring lock "3150d249-37a2-49c6-837a-3828480fa2b4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:14:08 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-17c5224f-8e4a-4222-9eec-03e522caecf0 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Lock "3150d249-37a2-49c6-837a-3828480fa2b4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:14:08 user nova-compute[75165]: DEBUG nova.objects.instance [None req-17c5224f-8e4a-4222-9eec-03e522caecf0 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Lazy-loading 'flavor' on Instance uuid 3150d249-37a2-49c6-837a-3828480fa2b4 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:14:09 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-17c5224f-8e4a-4222-9eec-03e522caecf0 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Lock "3150d249-37a2-49c6-837a-3828480fa2b4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.092s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:14:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b153af2-c93b-47d2-ae8c-76cfd44e384c/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:14:09 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75165) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 00:14:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f8ec77f-bf35-4b15-bd77-9f8407b09d0b/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:14:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f8ec77f-bf35-4b15-bd77-9f8407b09d0b/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:14:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f8ec77f-bf35-4b15-bd77-9f8407b09d0b/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:14:09 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-17c5224f-8e4a-4222-9eec-03e522caecf0 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Acquiring lock "3150d249-37a2-49c6-837a-3828480fa2b4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:14:09 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-17c5224f-8e4a-4222-9eec-03e522caecf0 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Lock "3150d249-37a2-49c6-837a-3828480fa2b4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:14:09 user nova-compute[75165]: INFO nova.compute.manager [None req-17c5224f-8e4a-4222-9eec-03e522caecf0 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] [instance: 3150d249-37a2-49c6-837a-3828480fa2b4] Attaching volume f8ecd4e8-862c-4129-8244-f361457dc5ea to /dev/vdb
Oct 26 00:14:09 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-6a83e018-e677-4040-a759-b00c3e92bbb8 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 26a0b493-bb47-466e-95d5-945fc3849fa5 is timed out.
Oct 26 00:14:09 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-6a83e018-e677-4040-a759-b00c3e92bbb8 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Successfully detached device vdb from instance 26a0b493-bb47-466e-95d5-945fc3849fa5 from the live domain config.
Oct 26 00:14:09 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a83e018-e677-4040-a759-b00c3e92bbb8 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] calling os-brick to detach iSCSI Volume {{(pid=75165) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 00:14:09 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a83e018-e677-4040-a759-b00c3e92bbb8 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8bf8160e50>, {'target_iqn': 'iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IgNFaCRv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:14:09 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-6a83e018-e677-4040-a759-b00c3e92bbb8 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:14:09 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-6a83e018-e677-4040-a759-b00c3e92bbb8 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:14:09 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-6a83e018-e677-4040-a759-b00c3e92bbb8 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:14:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:14:09 user nova-compute[75165]: DEBUG os_brick.utils [None req-17c5224f-8e4a-4222-9eec-03e522caecf0 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:14:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:14:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:14:09 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef69a245-cc0e-41bf-8a52-fc60d9ab7599]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:14:09 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a83e018-e677-4040-a759-b00c3e92bbb8 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 00:14:09 user nova-compute[75165]: No targets found.
Oct 26 00:14:09 user nova-compute[75165]: iSNS:
Oct 26 00:14:09 user nova-compute[75165]: No targets found.
Oct 26 00:14:09 user nova-compute[75165]: STATIC:
Oct 26 00:14:09 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b
Oct 26 00:14:09 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:14:09 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:14:09 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792
Oct 26 00:14:09 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:14:09 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:14:09 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b
Oct 26 00:14:09 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:14:09 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:14:09 user nova-compute[75165]: FIRMWARE:
Oct 26 00:14:09 user nova-compute[75165]: No targets found.
Oct 26 00:14:09 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:14:09 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a83e018-e677-4040-a759-b00c3e92bbb8 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 00:14:09 user nova-compute[75165]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 00:14:09 user nova-compute[75165]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75165) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 00:14:09 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a83e018-e677-4040-a759-b00c3e92bbb8 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792', 0)] {{(pid=75165) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 00:14:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:14:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:14:09 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[36d8ca68-6dd8-496d-87f7-e9d5f7f80ca5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa94814ccb35\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:14:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:14:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:14:09 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[05ca6cc1-61f2-4085-ba3a-c19319a9d685]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:14:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:14:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:14:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f8ec77f-bf35-4b15-bd77-9f8407b09d0b/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:14:09 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[0034f981-b04e-4c8d-935c-59aaf4068e15]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:14:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:14:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:14:09 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb396171-712d-4e48-871e-ce040a246f9b]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:14:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:14:09 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a66a4e2-582f-418a-b1e6-cd478232009a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:14:09 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a83e018-e677-4040-a759-b00c3e92bbb8 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792 (non-flash)
Oct 26 00:14:09 user nova-compute[75165]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b (non-flash)
Oct 26 00:14:09 user nova-compute[75165]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b (non-flash)
Oct 26 00:14:09 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:14:09 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a83e018-e677-4040-a759-b00c3e92bbb8 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792 (non-flash)
Oct 26 00:14:09 user nova-compute[75165]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b (non-flash)
Oct 26 00:14:09 user nova-compute[75165]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b (non-flash)
Oct 26 00:14:09 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:14:09 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a83e018-e677-4040-a759-b00c3e92bbb8 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8c001b1a20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792'): ({'sdb'}, set())}) {{(pid=75165) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 00:14:09 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-6a83e018-e677-4040-a759-b00c3e92bbb8 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Removing single pathed devices sdb {{(pid=75165) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 00:14:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:14:09 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b492d1f-e027-451c-89c5-767a0d477486]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:14:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-17c5224f-8e4a-4222-9eec-03e522caecf0 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Running cmd (subprocess): nvme version {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:14:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-17c5224f-8e4a-4222-9eec-03e522caecf0 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] 'nvme version' failed. Not Retrying. {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 00:14:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:14:09 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4efad0d-fe4a-478e-8b67-e39b2cac5bf7]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:14:09 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.nvmeof [None req-17c5224f-8e4a-4222-9eec-03e522caecf0 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] nvme not present on system {{(pid=75165) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 00:14:10 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:14:10 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:14:10 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 00:14:10 user nova-compute[75165]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 00:14:10 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a27e2bb-a841-4e63-9a97-a467ea8184a8]: (4, '') {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:14:10 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:14:10 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7c86b8e-04f6-4dcd-94db-bd6540512966]: (4, ('ok\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:14:10 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-6a83e018-e677-4040-a759-b00c3e92bbb8 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Flushing IO for device /dev/sdb {{(pid=75165) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 00:14:10 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-17c5224f-8e4a-4222-9eec-03e522caecf0 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75165) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 00:14:10 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-17c5224f-8e4a-4222-9eec-03e522caecf0 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75165) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 00:14:10 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-17c5224f-8e4a-4222-9eec-03e522caecf0 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] LIGHTOS: no hostnqn found. {{(pid=75165) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 00:14:10 user nova-compute[75165]: DEBUG os_brick.utils [None req-17c5224f-8e4a-4222-9eec-03e522caecf0 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] <== get_connector_properties: return (590ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa94814ccb35', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:14:10 user nova-compute[75165]: DEBUG nova.virt.block_device [None req-17c5224f-8e4a-4222-9eec-03e522caecf0 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] [instance: 3150d249-37a2-49c6-837a-3828480fa2b4] Updating existing volume attachment record: 2cdc815b-185b-4f28-aa44-4e17cd71958c {{(pid=75165) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 00:14:10 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:14:10 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:14:10 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2a61791-3817-4ac5-a20a-0acc0697ac2a]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:14:10 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-6a83e018-e677-4040-a759-b00c3e92bbb8 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75165) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 00:14:10 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:14:10 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:14:10 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Hypervisor/Node resource view: name=user free_ram=7472MB free_disk=24.99886703491211GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75165) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 00:14:10 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:14:10 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:14:10 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:14:10 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:14:10 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7a51e78-de7c-4f4a-8a82-0947fec632db]: (4, ('1', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:14:10 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-6a83e018-e677-4040-a759-b00c3e92bbb8 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75165) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 00:14:10 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-6a83e018-e677-4040-a759-b00c3e92bbb8 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] SCSI volumes sdb have been removed. {{(pid=75165) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 00:14:10 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a83e018-e677-4040-a759-b00c3e92bbb8 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792')] {{(pid=75165) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 00:14:10 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:14:10 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:14:10 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca7647fb-7dcb-4ce0-a4f9-1da4f76a2a7a]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:14:10 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a83e018-e677-4040-a759-b00c3e92bbb8 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:14:10 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792 -p 172.16.0.220:3260 --logout {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:14:10 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:14:10 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[c13e8020-89fb-469a-91be-f7d368347ab0]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:14:10 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a83e018-e677-4040-a759-b00c3e92bbb8 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792, portal: 172.16.0.220,3260]
Oct 26 00:14:10 user nova-compute[75165]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792, portal: 172.16.0.220,3260] successful.
Oct 26 00:14:10 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:14:10 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792 -p 172.16.0.220:3260 --op delete {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:14:10 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 9633e6bb-5e95-4994-92a2-9d8f85a946ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:14:10 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 84c6b624-648b-40e2-a37e-ff08609bad84 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:14:10 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance c4e44bfc-6a68-46ce-8335-aaaba5160d3e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:14:10 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance a7eeb145-1565-4812-818b-fefda5f2436d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:14:10 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 26a0b493-bb47-466e-95d5-945fc3849fa5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:14:10 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 22b9689c-5e83-4807-971f-5b244914b7e5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:14:10 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 3b153af2-c93b-47d2-ae8c-76cfd44e384c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:14:10 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 3150d249-37a2-49c6-837a-3828480fa2b4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:14:10 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 8f8ec77f-bf35-4b15-bd77-9f8407b09d0b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:14:10 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 27fa1771-fb69-49da-81b3-7f112e623170 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:14:10 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75165) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 00:14:10 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75165) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 00:14:10 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce7241dd-04dd-4a96-b8a6-21fb4e678792 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:14:10 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3443d74-56df-4ae5-a15f-495a43a8a860]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:14:10 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a83e018-e677-4040-a759-b00c3e92bbb8 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:14:10 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-6a83e018-e677-4040-a759-b00c3e92bbb8 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.801s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:14:10 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a83e018-e677-4040-a759-b00c3e92bbb8 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] <== disconnect_volume: return (803ms) None {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:14:10 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a83e018-e677-4040-a759-b00c3e92bbb8 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] Disconnected iSCSI Volume {{(pid=75165) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 00:14:10 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:14:10 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:14:10 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:14:10 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Compute_service record updated for user:user {{(pid=75165) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 00:14:10 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.561s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:14:10 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:14:11 user nova-compute[75165]: DEBUG nova.objects.instance [None req-6a83e018-e677-4040-a759-b00c3e92bbb8 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Lazy-loading 'flavor' on Instance uuid 26a0b493-bb47-466e-95d5-945fc3849fa5 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:14:11 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-6a83e018-e677-4040-a759-b00c3e92bbb8 tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Lock "26a0b493-bb47-466e-95d5-945fc3849fa5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.952s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:14:11 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:14:11 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Starting heal instance info cache {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 00:14:11 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Didn't find any instances for network info cache update. {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 26 00:14:11 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:14:11 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:14:11 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:14:15 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:14:15 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:14:20 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:14:20 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:14:25 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:14:25 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:14:25 user nova-compute[75165]: DEBUG nova.compute.manager [req-354cb2af-c29e-4a80-8371-2bc755bf5683 req-131ca389-5cf0-443a-b5f7-65546fcbd6c9 service nova] [instance: 8f8ec77f-bf35-4b15-bd77-9f8407b09d0b] Received event network-changed-7f5b9415-3336-49cc-8909-c21c7003e6fe {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:14:25 user nova-compute[75165]: DEBUG nova.compute.manager [req-354cb2af-c29e-4a80-8371-2bc755bf5683 req-131ca389-5cf0-443a-b5f7-65546fcbd6c9 service nova] [instance: 8f8ec77f-bf35-4b15-bd77-9f8407b09d0b] Refreshing instance network info cache due to event network-changed-7f5b9415-3336-49cc-8909-c21c7003e6fe. {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 00:14:25 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-354cb2af-c29e-4a80-8371-2bc755bf5683 req-131ca389-5cf0-443a-b5f7-65546fcbd6c9 service nova] Acquiring lock "refresh_cache-8f8ec77f-bf35-4b15-bd77-9f8407b09d0b" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:14:25 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-354cb2af-c29e-4a80-8371-2bc755bf5683 req-131ca389-5cf0-443a-b5f7-65546fcbd6c9 service nova] Acquired lock "refresh_cache-8f8ec77f-bf35-4b15-bd77-9f8407b09d0b" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:14:25 user nova-compute[75165]: DEBUG nova.network.neutron [req-354cb2af-c29e-4a80-8371-2bc755bf5683 req-131ca389-5cf0-443a-b5f7-65546fcbd6c9 service nova] [instance: 8f8ec77f-bf35-4b15-bd77-9f8407b09d0b] Refreshing network info cache for port 7f5b9415-3336-49cc-8909-c21c7003e6fe {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 00:14:26 user nova-compute[75165]: DEBUG nova.network.neutron [req-354cb2af-c29e-4a80-8371-2bc755bf5683 req-131ca389-5cf0-443a-b5f7-65546fcbd6c9 service nova] [instance: 8f8ec77f-bf35-4b15-bd77-9f8407b09d0b] Updated VIF entry in instance network info cache for port 7f5b9415-3336-49cc-8909-c21c7003e6fe. {{(pid=75165) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 00:14:26 user nova-compute[75165]: DEBUG nova.network.neutron [req-354cb2af-c29e-4a80-8371-2bc755bf5683 req-131ca389-5cf0-443a-b5f7-65546fcbd6c9 service nova] [instance: 8f8ec77f-bf35-4b15-bd77-9f8407b09d0b] Updating instance_info_cache with network_info: [{"id": "7f5b9415-3336-49cc-8909-c21c7003e6fe", "address": "fa:16:3e:c8:5c:77", "network": {"id": "493a3a47-a5c0-4b54-a13e-e5c39f80e90a", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-218779534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da5b9c2d1b1e4d9d885fa82f1625b5e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f5b9415-33", "ovs_interfaceid": "7f5b9415-3336-49cc-8909-c21c7003e6fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:14:26 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-354cb2af-c29e-4a80-8371-2bc755bf5683 req-131ca389-5cf0-443a-b5f7-65546fcbd6c9 service nova] Releasing lock "refresh_cache-8f8ec77f-bf35-4b15-bd77-9f8407b09d0b" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:14:27 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-9d90876e-10b9-4437-8c79-c4e809596e4a tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] Acquiring lock "interface-8f8ec77f-bf35-4b15-bd77-9f8407b09d0b-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:14:27 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-9d90876e-10b9-4437-8c79-c4e809596e4a tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] Lock "interface-8f8ec77f-bf35-4b15-bd77-9f8407b09d0b-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:14:27 user nova-compute[75165]: DEBUG nova.objects.instance [None req-9d90876e-10b9-4437-8c79-c4e809596e4a tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] Lazy-loading 'flavor' on Instance uuid 8f8ec77f-bf35-4b15-bd77-9f8407b09d0b {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:14:27 user nova-compute[75165]: DEBUG nova.objects.instance [None req-9d90876e-10b9-4437-8c79-c4e809596e4a tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] Lazy-loading 'pci_requests' on Instance uuid 8f8ec77f-bf35-4b15-bd77-9f8407b09d0b {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:14:27 user nova-compute[75165]: DEBUG nova.objects.base [None req-9d90876e-10b9-4437-8c79-c4e809596e4a tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] Object Instance<8f8ec77f-bf35-4b15-bd77-9f8407b09d0b> lazy-loaded attributes: flavor,pci_requests {{(pid=75165) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 00:14:27 user nova-compute[75165]: DEBUG nova.network.neutron [None req-9d90876e-10b9-4437-8c79-c4e809596e4a tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] [instance: 8f8ec77f-bf35-4b15-bd77-9f8407b09d0b] allocate_for_instance() {{(pid=75165) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 00:14:27 user nova-compute[75165]: DEBUG nova.policy [None req-9d90876e-10b9-4437-8c79-c4e809596e4a tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '93efb23845e441bc932910691dfaf023', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5b9c2d1b1e4d9d885fa82f1625b5e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75165) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 00:14:28 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17c5224f-8e4a-4222-9eec-03e522caecf0 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] [instance: 3150d249-37a2-49c6-837a-3828480fa2b4] Calling os-brick to attach iSCSI Volume {{(pid=75165) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 00:14:28 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-17c5224f-8e4a-4222-9eec-03e522caecf0 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8bf8160e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f8ecd4e8-862c-4129-8244-f361457dc5ea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eIRZFaSE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:14:28 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-17c5224f-8e4a-4222-9eec-03e522caecf0 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:14:28 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-17c5224f-8e4a-4222-9eec-03e522caecf0 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:14:28 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-17c5224f-8e4a-4222-9eec-03e522caecf0 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:14:28 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-17c5224f-8e4a-4222-9eec-03e522caecf0 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:14:28 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-17c5224f-8e4a-4222-9eec-03e522caecf0 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f8ecd4e8-862c-4129-8244-f361457dc5ea" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:14:28 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-17c5224f-8e4a-4222-9eec-03e522caecf0 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f8ecd4e8-862c-4129-8244-f361457dc5ea" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:14:28 user nova-compute[75165]: INFO os_brick.initiator.connectors.iscsi [None req-17c5224f-8e4a-4222-9eec-03e522caecf0 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 00:14:28 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8ecd4e8-862c-4129-8244-f361457dc5ea -p 172.16.0.220:3260 {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:14:28 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8ecd4e8-862c-4129-8244-f361457dc5ea -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:14:28 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[85777405-7d91-4f8e-8fc5-409ec1daa011]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:14:28 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-17c5224f-8e4a-4222-9eec-03e522caecf0 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 00:14:28 user nova-compute[75165]:  {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:14:28 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8ecd4e8-862c-4129-8244-f361457dc5ea -p 172.16.0.220:3260 --interface default --op new {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:14:28 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8ecd4e8-862c-4129-8244-f361457dc5ea -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:14:28 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4314b38-d50e-44d0-8208-c931b1362a21]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f8ecd4e8-862c-4129-8244-f361457dc5ea] added\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:14:28 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:14:28 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-17c5224f-8e4a-4222-9eec-03e522caecf0 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f8ecd4e8-862c-4129-8244-f361457dc5ea] added
Oct 26 00:14:28 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:14:28 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8ecd4e8-862c-4129-8244-f361457dc5ea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:14:28 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8ecd4e8-862c-4129-8244-f361457dc5ea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.045s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:14:28 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4d94191-7080-4804-b048-6390ab753e0e]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:14:28 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-17c5224f-8e4a-4222-9eec-03e522caecf0 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:14:28 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8ecd4e8-862c-4129-8244-f361457dc5ea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:14:28 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8ecd4e8-862c-4129-8244-f361457dc5ea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:14:28 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c7b40c2-5eb5-4e60-b557-2f34bb2823eb]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:14:28 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-17c5224f-8e4a-4222-9eec-03e522caecf0 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:14:28 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8ecd4e8-862c-4129-8244-f361457dc5ea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eIRZFaSE {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:14:28 user nova-compute[75165]: DEBUG nova.network.neutron [None req-9d90876e-10b9-4437-8c79-c4e809596e4a tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] [instance: 8f8ec77f-bf35-4b15-bd77-9f8407b09d0b] Successfully created port: 2f0902fc-120b-4c3a-aaa8-a441d61ad5e8 {{(pid=75165) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 00:14:28 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8ecd4e8-862c-4129-8244-f361457dc5ea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eIRZFaSE" returned: 0 in 0.019s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:14:28 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8e6c7de-b324-4954-9b1c-909257626f11]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:14:28 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-17c5224f-8e4a-4222-9eec-03e522caecf0 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eIRZFaSE'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:14:28 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8ecd4e8-862c-4129-8244-f361457dc5ea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:14:28 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8ecd4e8-862c-4129-8244-f361457dc5ea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:14:28 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6728040-bd22-484b-b6b6-22b93b7342d0]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:14:28 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-17c5224f-8e4a-4222-9eec-03e522caecf0 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:14:28 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:14:28 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:14:28 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[c52ba724-f3e9-4b54-9f30-482c4e7f32c3]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:14:28 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-17c5224f-8e4a-4222-9eec-03e522caecf0 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b (non-flash)
Oct 26 00:14:28 user nova-compute[75165]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b (non-flash)
Oct 26 00:14:28 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:14:28 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-17c5224f-8e4a-4222-9eec-03e522caecf0 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b (non-flash)
Oct 26 00:14:28 user nova-compute[75165]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b (non-flash)
Oct 26 00:14:28 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:14:28 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8ecd4e8-862c-4129-8244-f361457dc5ea -p 172.16.0.220:3260 --login {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:14:28 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8ecd4e8-862c-4129-8244-f361457dc5ea -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:14:28 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[396b8fca-5d8a-4d36-91d5-8fed0fc1e178]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f8ecd4e8-862c-4129-8244-f361457dc5ea, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f8ecd4e8-862c-4129-8244-f361457dc5ea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:14:28 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-17c5224f-8e4a-4222-9eec-03e522caecf0 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f8ecd4e8-862c-4129-8244-f361457dc5ea, portal: 172.16.0.220,3260]
Oct 26 00:14:28 user nova-compute[75165]: Login to [iface: default, target: iqn.2010-10.org.openstack:f8ecd4e8-862c-4129-8244-f361457dc5ea, portal: 172.16.0.220,3260] successful.
Oct 26 00:14:28 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:14:28 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8ecd4e8-862c-4129-8244-f361457dc5ea -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:14:28 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8ecd4e8-862c-4129-8244-f361457dc5ea -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:14:28 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d1f9c7a-77d6-47b5-8740-89ea085619f0]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:14:28 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-17c5224f-8e4a-4222-9eec-03e522caecf0 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:14:28 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:14:28 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:14:28 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[81561bb7-1d95-46c5-9634-64ba674c15fc]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8ecd4e8-862c-4129-8244-f361457dc5ea (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:14:28 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-17c5224f-8e4a-4222-9eec-03e522caecf0 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b (non-flash)
Oct 26 00:14:28 user nova-compute[75165]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b (non-flash)
Oct 26 00:14:28 user nova-compute[75165]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8ecd4e8-862c-4129-8244-f361457dc5ea (non-flash)
Oct 26 00:14:28 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:14:28 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-17c5224f-8e4a-4222-9eec-03e522caecf0 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b (non-flash)
Oct 26 00:14:28 user nova-compute[75165]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b (non-flash)
Oct 26 00:14:28 user nova-compute[75165]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8ecd4e8-862c-4129-8244-f361457dc5ea (non-flash)
Oct 26 00:14:28 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:14:28 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-17c5224f-8e4a-4222-9eec-03e522caecf0 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f8ecd4e8-862c-4129-8244-f361457dc5ea" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.336s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:14:28 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-17c5224f-8e4a-4222-9eec-03e522caecf0 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Connected to 172.16.0.220:3260 {{(pid=75165) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 00:14:28 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-17c5224f-8e4a-4222-9eec-03e522caecf0 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] HCTL ('33', '-', '-', 0) found on session 18 with lun 0 {{(pid=75165) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 00:14:28 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-17c5224f-8e4a-4222-9eec-03e522caecf0 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75165) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 00:14:28 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:14:28 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:14:28 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[76193bd7-e4dd-4b5e-934a-535cbe8bcc35]: (4, ('- - 0', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:14:28 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-17c5224f-8e4a-4222-9eec-03e522caecf0 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Searching for a device in session 18 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75165) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 00:14:28 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-17c5224f-8e4a-4222-9eec-03e522caecf0 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:f8ecd4e8-862c-4129-8244-f361457dc5ea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eIRZFaSE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75165) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 00:14:28 user nova-compute[75165]: DEBUG nova.network.neutron [None req-9d90876e-10b9-4437-8c79-c4e809596e4a tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] [instance: 8f8ec77f-bf35-4b15-bd77-9f8407b09d0b] Successfully updated port: 2f0902fc-120b-4c3a-aaa8-a441d61ad5e8 {{(pid=75165) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 00:14:28 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-9d90876e-10b9-4437-8c79-c4e809596e4a tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] Acquiring lock "refresh_cache-8f8ec77f-bf35-4b15-bd77-9f8407b09d0b" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:14:28 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-9d90876e-10b9-4437-8c79-c4e809596e4a tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] Acquired lock "refresh_cache-8f8ec77f-bf35-4b15-bd77-9f8407b09d0b" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:14:28 user nova-compute[75165]: DEBUG nova.network.neutron [None req-9d90876e-10b9-4437-8c79-c4e809596e4a tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] [instance: 8f8ec77f-bf35-4b15-bd77-9f8407b09d0b] Building network info cache for instance {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 00:14:29 user nova-compute[75165]: DEBUG nova.compute.manager [req-1a887aba-f03c-4b93-bed1-c1982aadfccf req-d8bf8bfb-16c7-4651-b7ee-b921e2b0af43 service nova] [instance: 8f8ec77f-bf35-4b15-bd77-9f8407b09d0b] Received event network-changed-2f0902fc-120b-4c3a-aaa8-a441d61ad5e8 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:14:29 user nova-compute[75165]: DEBUG nova.compute.manager [req-1a887aba-f03c-4b93-bed1-c1982aadfccf req-d8bf8bfb-16c7-4651-b7ee-b921e2b0af43 service nova] [instance: 8f8ec77f-bf35-4b15-bd77-9f8407b09d0b] Refreshing instance network info cache due to event network-changed-2f0902fc-120b-4c3a-aaa8-a441d61ad5e8. {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 00:14:29 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-1a887aba-f03c-4b93-bed1-c1982aadfccf req-d8bf8bfb-16c7-4651-b7ee-b921e2b0af43 service nova] Acquiring lock "refresh_cache-8f8ec77f-bf35-4b15-bd77-9f8407b09d0b" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:14:29 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-17c5224f-8e4a-4222-9eec-03e522caecf0 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.376s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:14:29 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-17c5224f-8e4a-4222-9eec-03e522caecf0 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] <== connect_volume: return (1382ms) {'type': 'block', 'scsi_wwn': '23939643230303433', 'path': '/dev/sdb'} {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:14:29 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17c5224f-8e4a-4222-9eec-03e522caecf0 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] [instance: 3150d249-37a2-49c6-837a-3828480fa2b4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23939643230303433', 'path': '/dev/sdb'} {{(pid=75165) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 00:14:29 user nova-compute[75165]: DEBUG nova.objects.instance [None req-17c5224f-8e4a-4222-9eec-03e522caecf0 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Lazy-loading 'flavor' on Instance uuid 3150d249-37a2-49c6-837a-3828480fa2b4 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:14:29 user nova-compute[75165]: DEBUG nova.virt.libvirt.guest [None req-17c5224f-8e4a-4222-9eec-03e522caecf0 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 00:14:29 user nova-compute[75165]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 00:14:29 user nova-compute[75165]:   <source dev="/dev/sdb"/>
Oct 26 00:14:29 user nova-compute[75165]:   <target dev="vdb" bus="virtio"/>
Oct 26 00:14:29 user nova-compute[75165]:   <serial>f8ecd4e8-862c-4129-8244-f361457dc5ea</serial>
Oct 26 00:14:29 user nova-compute[75165]: </disk>
Oct 26 00:14:29 user nova-compute[75165]:  {{(pid=75165) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 00:14:29 user nova-compute[75165]: DEBUG nova.network.neutron [None req-9d90876e-10b9-4437-8c79-c4e809596e4a tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] [instance: 8f8ec77f-bf35-4b15-bd77-9f8407b09d0b] Updating instance_info_cache with network_info: [{"id": "7f5b9415-3336-49cc-8909-c21c7003e6fe", "address": "fa:16:3e:c8:5c:77", "network": {"id": "493a3a47-a5c0-4b54-a13e-e5c39f80e90a", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-218779534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da5b9c2d1b1e4d9d885fa82f1625b5e0", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f5b9415-33", "ovs_interfaceid": "7f5b9415-3336-49cc-8909-c21c7003e6fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2f0902fc-120b-4c3a-aaa8-a441d61ad5e8", "address": "fa:16:3e:f6:ac:95", "network": {"id": "aa33c3e8-4f0d-4863-866b-995c0af9ed27", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-650788755", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.81", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "da5b9c2d1b1e4d9d885fa82f1625b5e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f0902fc-12", "ovs_interfaceid": "2f0902fc-120b-4c3a-aaa8-a441d61ad5e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:14:29 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-9d90876e-10b9-4437-8c79-c4e809596e4a tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] Releasing lock "refresh_cache-8f8ec77f-bf35-4b15-bd77-9f8407b09d0b" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:14:29 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-1a887aba-f03c-4b93-bed1-c1982aadfccf req-d8bf8bfb-16c7-4651-b7ee-b921e2b0af43 service nova] Acquired lock "refresh_cache-8f8ec77f-bf35-4b15-bd77-9f8407b09d0b" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:14:29 user nova-compute[75165]: DEBUG nova.network.neutron [req-1a887aba-f03c-4b93-bed1-c1982aadfccf req-d8bf8bfb-16c7-4651-b7ee-b921e2b0af43 service nova] [instance: 8f8ec77f-bf35-4b15-bd77-9f8407b09d0b] Refreshing network info cache for port 2f0902fc-120b-4c3a-aaa8-a441d61ad5e8 {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 00:14:29 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-9d90876e-10b9-4437-8c79-c4e809596e4a tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T00:12:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1656940732',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1656940732',id=19,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN+wbYUhWvc0Q8Ki4GTS2Tn91hUUyA5mHnOcmOrTkWVgToMqNtiT9k+t+ZtOfljqpTvTwcwIhu3LxiFs8eVVq6KIF4bfjQF4bPry0REDa8gn1PrkrDV91CuU9Osr0XBN6A==',key_name='tempest-keypair-1700446792',keypairs=<?>,launch_index=0,launched_at=2023-10-26T00:12:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='da5b9c2d1b1e4d9d885fa82f1625b5e0',ramdisk_id='',reservation_id='r-wb7qp03s',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-950905423',owner_user_name='tempest-TaggedAttachmentsTest-950905423-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T00:12:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='93efb23845e441bc932910691dfaf023',uuid=8f8ec77f-bf35-4b15-bd77-9f8407b09d0b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2f0902fc-120b-4c3a-aaa8-a441d61ad5e8", "address": "fa:16:3e:f6:ac:95", "network": {"id": "aa33c3e8-4f0d-4863-866b-995c0af9ed27", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-650788755", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.81", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "da5b9c2d1b1e4d9d885fa82f1625b5e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f0902fc-12", "ovs_interfaceid": "2f0902fc-120b-4c3a-aaa8-a441d61ad5e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 00:14:29 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-9d90876e-10b9-4437-8c79-c4e809596e4a tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] Converting VIF {"id": "2f0902fc-120b-4c3a-aaa8-a441d61ad5e8", "address": "fa:16:3e:f6:ac:95", "network": {"id": "aa33c3e8-4f0d-4863-866b-995c0af9ed27", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-650788755", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.81", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "da5b9c2d1b1e4d9d885fa82f1625b5e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f0902fc-12", "ovs_interfaceid": "2f0902fc-120b-4c3a-aaa8-a441d61ad5e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:14:29 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-9d90876e-10b9-4437-8c79-c4e809596e4a tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:ac:95,bridge_name='br-int',has_traffic_filtering=True,id=2f0902fc-120b-4c3a-aaa8-a441d61ad5e8,network=Network(aa33c3e8-4f0d-4863-866b-995c0af9ed27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f0902fc-12') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:14:29 user nova-compute[75165]: DEBUG os_vif [None req-9d90876e-10b9-4437-8c79-c4e809596e4a tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:ac:95,bridge_name='br-int',has_traffic_filtering=True,id=2f0902fc-120b-4c3a-aaa8-a441d61ad5e8,network=Network(aa33c3e8-4f0d-4863-866b-995c0af9ed27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f0902fc-12') {{(pid=75165) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 00:14:29 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:14:29 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:14:29 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 00:14:29 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:14:29 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8a59ba58-49e6-5aaa-b73f-ccd0d5272bb7', '_type': 'linux-noop'}}, row=False) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:14:29 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:14:29 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:14:29 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:14:29 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2f0902fc-12, may_exist=True, interface_attrs={}) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:14:29 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2f0902fc-12, col_values=(('qos', UUID('e81df954-9e86-4af1-a12c-4225923e3c9d')),), if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:14:29 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2f0902fc-12, col_values=(('external_ids', {'iface-id': '2f0902fc-120b-4c3a-aaa8-a441d61ad5e8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f6:ac:95', 'vm-uuid': '8f8ec77f-bf35-4b15-bd77-9f8407b09d0b'}),), if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:14:29 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:14:29 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:14:29 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:14:29 user nova-compute[75165]: INFO os_vif [None req-9d90876e-10b9-4437-8c79-c4e809596e4a tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:ac:95,bridge_name='br-int',has_traffic_filtering=True,id=2f0902fc-120b-4c3a-aaa8-a441d61ad5e8,network=Network(aa33c3e8-4f0d-4863-866b-995c0af9ed27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f0902fc-12')
Oct 26 00:14:29 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-9d90876e-10b9-4437-8c79-c4e809596e4a tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T00:12:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1656940732',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1656940732',id=19,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN+wbYUhWvc0Q8Ki4GTS2Tn91hUUyA5mHnOcmOrTkWVgToMqNtiT9k+t+ZtOfljqpTvTwcwIhu3LxiFs8eVVq6KIF4bfjQF4bPry0REDa8gn1PrkrDV91CuU9Osr0XBN6A==',key_name='tempest-keypair-1700446792',keypairs=<?>,launch_index=0,launched_at=2023-10-26T00:12:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='da5b9c2d1b1e4d9d885fa82f1625b5e0',ramdisk_id='',reservation_id='r-wb7qp03s',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-950905423',owner_user_name='tempest-TaggedAttachmentsTest-950905423-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T00:12:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='93efb23845e441bc932910691dfaf023',uuid=8f8ec77f-bf35-4b15-bd77-9f8407b09d0b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2f0902fc-120b-4c3a-aaa8-a441d61ad5e8", "address": "fa:16:3e:f6:ac:95", "network": {"id": "aa33c3e8-4f0d-4863-866b-995c0af9ed27", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-650788755", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.81", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "da5b9c2d1b1e4d9d885fa82f1625b5e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f0902fc-12", "ovs_interfaceid": "2f0902fc-120b-4c3a-aaa8-a441d61ad5e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75165) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 00:14:29 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-9d90876e-10b9-4437-8c79-c4e809596e4a tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] Converting VIF {"id": "2f0902fc-120b-4c3a-aaa8-a441d61ad5e8", "address": "fa:16:3e:f6:ac:95", "network": {"id": "aa33c3e8-4f0d-4863-866b-995c0af9ed27", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-650788755", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.81", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "da5b9c2d1b1e4d9d885fa82f1625b5e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f0902fc-12", "ovs_interfaceid": "2f0902fc-120b-4c3a-aaa8-a441d61ad5e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:14:29 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-9d90876e-10b9-4437-8c79-c4e809596e4a tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:ac:95,bridge_name='br-int',has_traffic_filtering=True,id=2f0902fc-120b-4c3a-aaa8-a441d61ad5e8,network=Network(aa33c3e8-4f0d-4863-866b-995c0af9ed27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f0902fc-12') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:14:29 user nova-compute[75165]: DEBUG nova.virt.libvirt.guest [None req-9d90876e-10b9-4437-8c79-c4e809596e4a tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] attach device xml: <interface type="ethernet">
Oct 26 00:14:29 user nova-compute[75165]:   <mac address="fa:16:3e:f6:ac:95"/>
Oct 26 00:14:29 user nova-compute[75165]:   <model type="virtio"/>
Oct 26 00:14:29 user nova-compute[75165]:   <mtu size="1442"/>
Oct 26 00:14:29 user nova-compute[75165]:   <target dev="tap2f0902fc-12"/>
Oct 26 00:14:29 user nova-compute[75165]: </interface>
Oct 26 00:14:29 user nova-compute[75165]:  {{(pid=75165) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 00:14:29 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:14:29 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:14:29 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:14:30 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-17c5224f-8e4a-4222-9eec-03e522caecf0 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] No BDM found with device name vda, not building metadata. {{(pid=75165) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 00:14:30 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-17c5224f-8e4a-4222-9eec-03e522caecf0 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75165) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 00:14:30 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-17c5224f-8e4a-4222-9eec-03e522caecf0 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] No VIF found with MAC fa:16:3e:45:96:61, not building metadata {{(pid=75165) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 00:14:30 user nova-compute[75165]: DEBUG nova.network.neutron [req-1a887aba-f03c-4b93-bed1-c1982aadfccf req-d8bf8bfb-16c7-4651-b7ee-b921e2b0af43 service nova] [instance: 8f8ec77f-bf35-4b15-bd77-9f8407b09d0b] Updated VIF entry in instance network info cache for port 2f0902fc-120b-4c3a-aaa8-a441d61ad5e8. {{(pid=75165) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 00:14:30 user nova-compute[75165]: DEBUG nova.network.neutron [req-1a887aba-f03c-4b93-bed1-c1982aadfccf req-d8bf8bfb-16c7-4651-b7ee-b921e2b0af43 service nova] [instance: 8f8ec77f-bf35-4b15-bd77-9f8407b09d0b] Updating instance_info_cache with network_info: [{"id": "7f5b9415-3336-49cc-8909-c21c7003e6fe", "address": "fa:16:3e:c8:5c:77", "network": {"id": "493a3a47-a5c0-4b54-a13e-e5c39f80e90a", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-218779534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da5b9c2d1b1e4d9d885fa82f1625b5e0", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f5b9415-33", "ovs_interfaceid": "7f5b9415-3336-49cc-8909-c21c7003e6fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2f0902fc-120b-4c3a-aaa8-a441d61ad5e8", "address": "fa:16:3e:f6:ac:95", "network": {"id": "aa33c3e8-4f0d-4863-866b-995c0af9ed27", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-650788755", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.81", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "da5b9c2d1b1e4d9d885fa82f1625b5e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f0902fc-12", "ovs_interfaceid": "2f0902fc-120b-4c3a-aaa8-a441d61ad5e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:14:30 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-1a887aba-f03c-4b93-bed1-c1982aadfccf req-d8bf8bfb-16c7-4651-b7ee-b921e2b0af43 service nova] Releasing lock "refresh_cache-8f8ec77f-bf35-4b15-bd77-9f8407b09d0b" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:14:30 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-17c5224f-8e4a-4222-9eec-03e522caecf0 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Lock "3150d249-37a2-49c6-837a-3828480fa2b4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.852s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:14:30 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-9d90876e-10b9-4437-8c79-c4e809596e4a tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] No BDM found with device name vda, not building metadata. {{(pid=75165) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 00:14:30 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-9d90876e-10b9-4437-8c79-c4e809596e4a tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] No BDM found with device name hda, not building metadata. {{(pid=75165) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 00:14:30 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-9d90876e-10b9-4437-8c79-c4e809596e4a tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] No VIF found with MAC fa:16:3e:c8:5c:77, not building metadata {{(pid=75165) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 00:14:30 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:14:30 user nova-compute[75165]: DEBUG nova.virt.libvirt.guest [None req-9d90876e-10b9-4437-8c79-c4e809596e4a tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 00:14:30 user nova-compute[75165]:   <nova:package version="0.0.0"/>
Oct 26 00:14:30 user nova-compute[75165]:   <nova:name>tempest-device-tagging-server-1656940732</nova:name>
Oct 26 00:14:30 user nova-compute[75165]:   <nova:creationTime>2023-10-26 00:14:30</nova:creationTime>
Oct 26 00:14:30 user nova-compute[75165]:   <nova:flavor name="m1.tiny">
Oct 26 00:14:30 user nova-compute[75165]:     <nova:memory>512</nova:memory>
Oct 26 00:14:30 user nova-compute[75165]:     <nova:disk>1</nova:disk>
Oct 26 00:14:30 user nova-compute[75165]:     <nova:swap>0</nova:swap>
Oct 26 00:14:30 user nova-compute[75165]:     <nova:ephemeral>0</nova:ephemeral>
Oct 26 00:14:30 user nova-compute[75165]:     <nova:vcpus>1</nova:vcpus>
Oct 26 00:14:30 user nova-compute[75165]:   </nova:flavor>
Oct 26 00:14:30 user nova-compute[75165]:   <nova:owner>
Oct 26 00:14:30 user nova-compute[75165]:     <nova:user uuid="93efb23845e441bc932910691dfaf023">tempest-TaggedAttachmentsTest-950905423-project-member</nova:user>
Oct 26 00:14:30 user nova-compute[75165]:     <nova:project uuid="da5b9c2d1b1e4d9d885fa82f1625b5e0">tempest-TaggedAttachmentsTest-950905423</nova:project>
Oct 26 00:14:30 user nova-compute[75165]:   </nova:owner>
Oct 26 00:14:30 user nova-compute[75165]:   <nova:root type="image" uuid="bff0d8a1-739e-4c4d-9efa-b73ba7b76d01"/>
Oct 26 00:14:30 user nova-compute[75165]:   <nova:ports>
Oct 26 00:14:30 user nova-compute[75165]:     <nova:port uuid="7f5b9415-3336-49cc-8909-c21c7003e6fe">
Oct 26 00:14:30 user nova-compute[75165]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 26 00:14:30 user nova-compute[75165]:     </nova:port>
Oct 26 00:14:30 user nova-compute[75165]:     <nova:port uuid="2f0902fc-120b-4c3a-aaa8-a441d61ad5e8">
Oct 26 00:14:30 user nova-compute[75165]:       <nova:ip type="fixed" address="10.10.10.81" ipVersion="4"/>
Oct 26 00:14:30 user nova-compute[75165]:     </nova:port>
Oct 26 00:14:30 user nova-compute[75165]:   </nova:ports>
Oct 26 00:14:30 user nova-compute[75165]: </nova:instance>
Oct 26 00:14:30 user nova-compute[75165]:  {{(pid=75165) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Oct 26 00:14:30 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:14:30 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-9d90876e-10b9-4437-8c79-c4e809596e4a tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] Lock "interface-8f8ec77f-bf35-4b15-bd77-9f8407b09d0b-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.146s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:14:30 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:14:30 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-fdf8fc13-c390-43a6-9c71-afabde8d58ab tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] Acquiring lock "8f8ec77f-bf35-4b15-bd77-9f8407b09d0b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:14:30 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-fdf8fc13-c390-43a6-9c71-afabde8d58ab tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] Lock "8f8ec77f-bf35-4b15-bd77-9f8407b09d0b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:14:30 user nova-compute[75165]: DEBUG nova.objects.instance [None req-fdf8fc13-c390-43a6-9c71-afabde8d58ab tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] Lazy-loading 'flavor' on Instance uuid 8f8ec77f-bf35-4b15-bd77-9f8407b09d0b {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:14:30 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-fdf8fc13-c390-43a6-9c71-afabde8d58ab tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] Lock "8f8ec77f-bf35-4b15-bd77-9f8407b09d0b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:14:30 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:14:30 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-fdf8fc13-c390-43a6-9c71-afabde8d58ab tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] Acquiring lock "8f8ec77f-bf35-4b15-bd77-9f8407b09d0b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:14:30 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-fdf8fc13-c390-43a6-9c71-afabde8d58ab tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] Lock "8f8ec77f-bf35-4b15-bd77-9f8407b09d0b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:14:30 user nova-compute[75165]: INFO nova.compute.manager [None req-fdf8fc13-c390-43a6-9c71-afabde8d58ab tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] [instance: 8f8ec77f-bf35-4b15-bd77-9f8407b09d0b] Attaching volume b6f63cee-1a4a-4ad6-8eb8-8c929951b7a7 to /dev/vdb
Oct 26 00:14:31 user nova-compute[75165]: DEBUG os_brick.utils [None req-fdf8fc13-c390-43a6-9c71-afabde8d58ab tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:14:31 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:14:31 user nova-compute[75165]: DEBUG nova.compute.manager [req-e73a951e-eb67-4a8e-8c85-3bc7d5d40d18 req-86b5b141-c0fe-49be-a051-1c829ea29362 service nova] [instance: 8f8ec77f-bf35-4b15-bd77-9f8407b09d0b] Received event network-vif-plugged-2f0902fc-120b-4c3a-aaa8-a441d61ad5e8 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:14:31 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-e73a951e-eb67-4a8e-8c85-3bc7d5d40d18 req-86b5b141-c0fe-49be-a051-1c829ea29362 service nova] Acquiring lock "8f8ec77f-bf35-4b15-bd77-9f8407b09d0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:14:31 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-e73a951e-eb67-4a8e-8c85-3bc7d5d40d18 req-86b5b141-c0fe-49be-a051-1c829ea29362 service nova] Lock "8f8ec77f-bf35-4b15-bd77-9f8407b09d0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:14:31 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-e73a951e-eb67-4a8e-8c85-3bc7d5d40d18 req-86b5b141-c0fe-49be-a051-1c829ea29362 service nova] Lock "8f8ec77f-bf35-4b15-bd77-9f8407b09d0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:14:31 user nova-compute[75165]: DEBUG nova.compute.manager [req-e73a951e-eb67-4a8e-8c85-3bc7d5d40d18 req-86b5b141-c0fe-49be-a051-1c829ea29362 service nova] [instance: 8f8ec77f-bf35-4b15-bd77-9f8407b09d0b] No waiting events found dispatching network-vif-plugged-2f0902fc-120b-4c3a-aaa8-a441d61ad5e8 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:14:31 user nova-compute[75165]: WARNING nova.compute.manager [req-e73a951e-eb67-4a8e-8c85-3bc7d5d40d18 req-86b5b141-c0fe-49be-a051-1c829ea29362 service nova] [instance: 8f8ec77f-bf35-4b15-bd77-9f8407b09d0b] Received unexpected event network-vif-plugged-2f0902fc-120b-4c3a-aaa8-a441d61ad5e8 for instance with vm_state active and task_state None.
Oct 26 00:14:31 user nova-compute[75165]: DEBUG nova.compute.manager [req-e73a951e-eb67-4a8e-8c85-3bc7d5d40d18 req-86b5b141-c0fe-49be-a051-1c829ea29362 service nova] [instance: 8f8ec77f-bf35-4b15-bd77-9f8407b09d0b] Received event network-vif-plugged-2f0902fc-120b-4c3a-aaa8-a441d61ad5e8 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:14:31 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-e73a951e-eb67-4a8e-8c85-3bc7d5d40d18 req-86b5b141-c0fe-49be-a051-1c829ea29362 service nova] Acquiring lock "8f8ec77f-bf35-4b15-bd77-9f8407b09d0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:14:31 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-e73a951e-eb67-4a8e-8c85-3bc7d5d40d18 req-86b5b141-c0fe-49be-a051-1c829ea29362 service nova] Lock "8f8ec77f-bf35-4b15-bd77-9f8407b09d0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:14:31 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-e73a951e-eb67-4a8e-8c85-3bc7d5d40d18 req-86b5b141-c0fe-49be-a051-1c829ea29362 service nova] Lock "8f8ec77f-bf35-4b15-bd77-9f8407b09d0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:14:31 user nova-compute[75165]: DEBUG nova.compute.manager [req-e73a951e-eb67-4a8e-8c85-3bc7d5d40d18 req-86b5b141-c0fe-49be-a051-1c829ea29362 service nova] [instance: 8f8ec77f-bf35-4b15-bd77-9f8407b09d0b] No waiting events found dispatching network-vif-plugged-2f0902fc-120b-4c3a-aaa8-a441d61ad5e8 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:14:31 user nova-compute[75165]: WARNING nova.compute.manager [req-e73a951e-eb67-4a8e-8c85-3bc7d5d40d18 req-86b5b141-c0fe-49be-a051-1c829ea29362 service nova] [instance: 8f8ec77f-bf35-4b15-bd77-9f8407b09d0b] Received unexpected event network-vif-plugged-2f0902fc-120b-4c3a-aaa8-a441d61ad5e8 for instance with vm_state active and task_state None.
Oct 26 00:14:31 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:14:31 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[7665678f-44fc-4abf-b358-4c9def2325b8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa94814ccb35\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:14:31 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:14:31 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:14:31 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a99a47b-85ae-4a44-9e90-be9b752f6a97]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:14:31 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:14:31 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:14:31 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[73868663-5998-4675-8bb5-7ba0159f0cfa]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:14:31 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[951bee4b-fde2-4e79-a7e7-a0964ce288bd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:14:31 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-fdf8fc13-c390-43a6-9c71-afabde8d58ab tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] Running cmd (subprocess): nvme version {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:14:31 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-fdf8fc13-c390-43a6-9c71-afabde8d58ab tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] 'nvme version' failed. Not Retrying. {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 00:14:31 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fdf8fc13-c390-43a6-9c71-afabde8d58ab tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] nvme not present on system {{(pid=75165) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 00:14:31 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:14:31 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 00:14:31 user nova-compute[75165]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 00:14:31 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[94648cac-91fb-42e1-8cad-8b73dc3e567e]: (4, '') {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:14:31 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-fdf8fc13-c390-43a6-9c71-afabde8d58ab tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75165) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 00:14:31 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-fdf8fc13-c390-43a6-9c71-afabde8d58ab tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75165) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 00:14:31 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-fdf8fc13-c390-43a6-9c71-afabde8d58ab tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] LIGHTOS: no hostnqn found. {{(pid=75165) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 00:14:31 user nova-compute[75165]: DEBUG os_brick.utils [None req-fdf8fc13-c390-43a6-9c71-afabde8d58ab tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa94814ccb35', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:14:31 user nova-compute[75165]: DEBUG nova.virt.block_device [None req-fdf8fc13-c390-43a6-9c71-afabde8d58ab tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] [instance: 8f8ec77f-bf35-4b15-bd77-9f8407b09d0b] Updating existing volume attachment record: 3f71b801-67b2-45c0-b904-e5785bc2e52a {{(pid=75165) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 00:14:31 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-d9afd07b-3e34-4c9d-a9de-b8c1ac76a4ba tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Acquiring lock "3150d249-37a2-49c6-837a-3828480fa2b4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:14:31 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-d9afd07b-3e34-4c9d-a9de-b8c1ac76a4ba tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Lock "3150d249-37a2-49c6-837a-3828480fa2b4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:14:31 user nova-compute[75165]: INFO nova.compute.manager [None req-d9afd07b-3e34-4c9d-a9de-b8c1ac76a4ba tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] [instance: 3150d249-37a2-49c6-837a-3828480fa2b4] Detaching volume f8ecd4e8-862c-4129-8244-f361457dc5ea
Oct 26 00:14:31 user nova-compute[75165]: INFO nova.virt.block_device [None req-d9afd07b-3e34-4c9d-a9de-b8c1ac76a4ba tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] [instance: 3150d249-37a2-49c6-837a-3828480fa2b4] Attempting to driver detach volume f8ecd4e8-862c-4129-8244-f361457dc5ea from mountpoint /dev/vdb
Oct 26 00:14:31 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-d9afd07b-3e34-4c9d-a9de-b8c1ac76a4ba tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Attempting to detach device vdb from instance 3150d249-37a2-49c6-837a-3828480fa2b4 from the persistent domain config. {{(pid=75165) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 00:14:31 user nova-compute[75165]: DEBUG nova.virt.libvirt.guest [None req-d9afd07b-3e34-4c9d-a9de-b8c1ac76a4ba tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 00:14:31 user nova-compute[75165]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 00:14:31 user nova-compute[75165]:   <source dev="/dev/sdb"/>
Oct 26 00:14:31 user nova-compute[75165]:   <target dev="vdb" bus="virtio"/>
Oct 26 00:14:31 user nova-compute[75165]:   <serial>f8ecd4e8-862c-4129-8244-f361457dc5ea</serial>
Oct 26 00:14:31 user nova-compute[75165]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 00:14:31 user nova-compute[75165]: </disk>
Oct 26 00:14:31 user nova-compute[75165]:  {{(pid=75165) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 00:14:31 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-d9afd07b-3e34-4c9d-a9de-b8c1ac76a4ba tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Successfully detached device vdb from instance 3150d249-37a2-49c6-837a-3828480fa2b4 from the persistent domain config.
Oct 26 00:14:31 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-d9afd07b-3e34-4c9d-a9de-b8c1ac76a4ba tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3150d249-37a2-49c6-837a-3828480fa2b4 from the live domain config. {{(pid=75165) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 00:14:31 user nova-compute[75165]: DEBUG nova.virt.libvirt.guest [None req-d9afd07b-3e34-4c9d-a9de-b8c1ac76a4ba tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 00:14:31 user nova-compute[75165]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 00:14:31 user nova-compute[75165]:   <source dev="/dev/sdb"/>
Oct 26 00:14:31 user nova-compute[75165]:   <target dev="vdb" bus="virtio"/>
Oct 26 00:14:31 user nova-compute[75165]:   <serial>f8ecd4e8-862c-4129-8244-f361457dc5ea</serial>
Oct 26 00:14:31 user nova-compute[75165]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 00:14:31 user nova-compute[75165]: </disk>
Oct 26 00:14:31 user nova-compute[75165]:  {{(pid=75165) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 00:14:32 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-d9afd07b-3e34-4c9d-a9de-b8c1ac76a4ba tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3150d249-37a2-49c6-837a-3828480fa2b4 {{(pid=75165) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 00:14:34 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:14:35 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:14:39 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-b44a8249-3405-4134-8c7c-92e4147b020d tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Acquiring lock "26a0b493-bb47-466e-95d5-945fc3849fa5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:14:39 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-b44a8249-3405-4134-8c7c-92e4147b020d tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Lock "26a0b493-bb47-466e-95d5-945fc3849fa5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:14:39 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-b44a8249-3405-4134-8c7c-92e4147b020d tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Acquiring lock "26a0b493-bb47-466e-95d5-945fc3849fa5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:14:39 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-b44a8249-3405-4134-8c7c-92e4147b020d tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Lock "26a0b493-bb47-466e-95d5-945fc3849fa5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:14:39 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-b44a8249-3405-4134-8c7c-92e4147b020d tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Lock "26a0b493-bb47-466e-95d5-945fc3849fa5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:14:39 user nova-compute[75165]: INFO nova.compute.manager [None req-b44a8249-3405-4134-8c7c-92e4147b020d tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] Terminating instance
Oct 26 00:14:39 user nova-compute[75165]: DEBUG nova.compute.manager [None req-b44a8249-3405-4134-8c7c-92e4147b020d tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] Start destroying the instance on the hypervisor. {{(pid=75165) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 00:14:39 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:14:39 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:14:39 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:14:39 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:14:39 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:14:40 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] Instance destroyed successfully.
Oct 26 00:14:40 user nova-compute[75165]: DEBUG nova.objects.instance [None req-b44a8249-3405-4134-8c7c-92e4147b020d tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Lazy-loading 'resources' on Instance uuid 26a0b493-bb47-466e-95d5-945fc3849fa5 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:14:40 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-b44a8249-3405-4134-8c7c-92e4147b020d tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:07:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-609329296',display_name='tempest-ServerStableDeviceRescueTest-server-609329296',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-609329296',id=6,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC4BNQ+GaWhIdYY5+kuVMESGWyvIRQoK5o0tz+YWgwiyxZJkfUowNPNzbMJ3GImV/y2wwOtRmsApdRZKOXSoI+VOZ3WRPGRkXXPlFnBMVzrbGW9ERsWeijK3p6uBV3K5Jg==',key_name='tempest-keypair-627775438',keypairs=<?>,launch_index=0,launched_at=2023-10-26T00:11:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9cbae16d09ed4474bb6653f08165a4e5',ramdisk_id='',reservation_id='r-y8rfmg08',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1585397509',owner_user_name='tempest-ServerStableDeviceRescueTest-1585397509-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T00:13:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7ac761f144034256baf6a2372a7b685c',uuid=26a0b493-bb47-466e-95d5-945fc3849fa5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1d6d497c-7382-4dff-b136-d1220b05a838", "address": "fa:16:3e:d3:eb:fb", "network": {"id": "08c51c53-4819-493e-b4eb-df5d6024d43d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1633769998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9cbae16d09ed4474bb6653f08165a4e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d6d497c-73", "ovs_interfaceid": "1d6d497c-7382-4dff-b136-d1220b05a838", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 00:14:40 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-b44a8249-3405-4134-8c7c-92e4147b020d tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Converting VIF {"id": "1d6d497c-7382-4dff-b136-d1220b05a838", "address": "fa:16:3e:d3:eb:fb", "network": {"id": "08c51c53-4819-493e-b4eb-df5d6024d43d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1633769998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9cbae16d09ed4474bb6653f08165a4e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d6d497c-73", "ovs_interfaceid": "1d6d497c-7382-4dff-b136-d1220b05a838", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:14:40 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-b44a8249-3405-4134-8c7c-92e4147b020d tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d3:eb:fb,bridge_name='br-int',has_traffic_filtering=True,id=1d6d497c-7382-4dff-b136-d1220b05a838,network=Network(08c51c53-4819-493e-b4eb-df5d6024d43d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d6d497c-73') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:14:40 user nova-compute[75165]: DEBUG os_vif [None req-b44a8249-3405-4134-8c7c-92e4147b020d tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d3:eb:fb,bridge_name='br-int',has_traffic_filtering=True,id=1d6d497c-7382-4dff-b136-d1220b05a838,network=Network(08c51c53-4819-493e-b4eb-df5d6024d43d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d6d497c-73') {{(pid=75165) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 00:14:40 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:14:40 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1d6d497c-73, bridge=br-int, if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:14:40 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:14:40 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:14:40 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:14:40 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a5f06d0c-c86f-44b1-ba8c-f34281ef8ffb) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:14:40 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:14:40 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:14:40 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:14:40 user nova-compute[75165]: INFO os_vif [None req-b44a8249-3405-4134-8c7c-92e4147b020d tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d3:eb:fb,bridge_name='br-int',has_traffic_filtering=True,id=1d6d497c-7382-4dff-b136-d1220b05a838,network=Network(08c51c53-4819-493e-b4eb-df5d6024d43d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d6d497c-73')
Oct 26 00:14:40 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-b44a8249-3405-4134-8c7c-92e4147b020d tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] Deleting instance files /opt/stack/data/nova/instances/26a0b493-bb47-466e-95d5-945fc3849fa5_del
Oct 26 00:14:40 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-b44a8249-3405-4134-8c7c-92e4147b020d tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] Deletion of /opt/stack/data/nova/instances/26a0b493-bb47-466e-95d5-945fc3849fa5_del complete
Oct 26 00:14:40 user nova-compute[75165]: DEBUG nova.compute.manager [req-8a6e1282-581e-49d9-ba60-a409fb0c5918 req-1bddccc0-d877-4247-8820-829ff1bf2815 service nova] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] Received event network-vif-unplugged-1d6d497c-7382-4dff-b136-d1220b05a838 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:14:40 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-8a6e1282-581e-49d9-ba60-a409fb0c5918 req-1bddccc0-d877-4247-8820-829ff1bf2815 service nova] Acquiring lock "26a0b493-bb47-466e-95d5-945fc3849fa5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:14:40 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-8a6e1282-581e-49d9-ba60-a409fb0c5918 req-1bddccc0-d877-4247-8820-829ff1bf2815 service nova] Lock "26a0b493-bb47-466e-95d5-945fc3849fa5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:14:40 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-8a6e1282-581e-49d9-ba60-a409fb0c5918 req-1bddccc0-d877-4247-8820-829ff1bf2815 service nova] Lock "26a0b493-bb47-466e-95d5-945fc3849fa5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:14:40 user nova-compute[75165]: DEBUG nova.compute.manager [req-8a6e1282-581e-49d9-ba60-a409fb0c5918 req-1bddccc0-d877-4247-8820-829ff1bf2815 service nova] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] No waiting events found dispatching network-vif-unplugged-1d6d497c-7382-4dff-b136-d1220b05a838 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:14:40 user nova-compute[75165]: DEBUG nova.compute.manager [req-8a6e1282-581e-49d9-ba60-a409fb0c5918 req-1bddccc0-d877-4247-8820-829ff1bf2815 service nova] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] Received event network-vif-unplugged-1d6d497c-7382-4dff-b136-d1220b05a838 for instance with task_state deleting. {{(pid=75165) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 00:14:40 user nova-compute[75165]: INFO nova.compute.manager [None req-b44a8249-3405-4134-8c7c-92e4147b020d tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] Took 1.15 seconds to destroy the instance on the hypervisor.
Oct 26 00:14:40 user nova-compute[75165]: DEBUG oslo.service.loopingcall [None req-b44a8249-3405-4134-8c7c-92e4147b020d tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75165) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 00:14:40 user nova-compute[75165]: DEBUG nova.compute.manager [-] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] Deallocating network for instance {{(pid=75165) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 00:14:40 user nova-compute[75165]: DEBUG nova.network.neutron [-] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] deallocate_for_instance() {{(pid=75165) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 00:14:41 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:14:41 user nova-compute[75165]: DEBUG nova.network.neutron [-] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] Updating instance_info_cache with network_info: [] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:14:41 user nova-compute[75165]: INFO nova.compute.manager [-] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] Took 1.63 seconds to deallocate network for instance.
Oct 26 00:14:41 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-b44a8249-3405-4134-8c7c-92e4147b020d tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:14:41 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-b44a8249-3405-4134-8c7c-92e4147b020d tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:14:42 user nova-compute[75165]: DEBUG nova.compute.manager [req-179a19fb-35dd-48a1-840b-66064fb030f7 req-68f43bad-ad0c-4991-b68a-146bb2ab3b24 service nova] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] Received event network-vif-plugged-1d6d497c-7382-4dff-b136-d1220b05a838 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:14:42 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-179a19fb-35dd-48a1-840b-66064fb030f7 req-68f43bad-ad0c-4991-b68a-146bb2ab3b24 service nova] Acquiring lock "26a0b493-bb47-466e-95d5-945fc3849fa5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:14:42 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-179a19fb-35dd-48a1-840b-66064fb030f7 req-68f43bad-ad0c-4991-b68a-146bb2ab3b24 service nova] Lock "26a0b493-bb47-466e-95d5-945fc3849fa5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:14:42 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-179a19fb-35dd-48a1-840b-66064fb030f7 req-68f43bad-ad0c-4991-b68a-146bb2ab3b24 service nova] Lock "26a0b493-bb47-466e-95d5-945fc3849fa5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:14:42 user nova-compute[75165]: DEBUG nova.compute.manager [req-179a19fb-35dd-48a1-840b-66064fb030f7 req-68f43bad-ad0c-4991-b68a-146bb2ab3b24 service nova] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] No waiting events found dispatching network-vif-plugged-1d6d497c-7382-4dff-b136-d1220b05a838 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:14:42 user nova-compute[75165]: WARNING nova.compute.manager [req-179a19fb-35dd-48a1-840b-66064fb030f7 req-68f43bad-ad0c-4991-b68a-146bb2ab3b24 service nova] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] Received unexpected event network-vif-plugged-1d6d497c-7382-4dff-b136-d1220b05a838 for instance with vm_state deleted and task_state None.
Oct 26 00:14:42 user nova-compute[75165]: DEBUG nova.compute.manager [req-179a19fb-35dd-48a1-840b-66064fb030f7 req-68f43bad-ad0c-4991-b68a-146bb2ab3b24 service nova] [instance: 26a0b493-bb47-466e-95d5-945fc3849fa5] Received event network-vif-deleted-1d6d497c-7382-4dff-b136-d1220b05a838 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:14:42 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-b44a8249-3405-4134-8c7c-92e4147b020d tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:14:42 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-b44a8249-3405-4134-8c7c-92e4147b020d tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:14:42 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-b44a8249-3405-4134-8c7c-92e4147b020d tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.456s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:14:42 user nova-compute[75165]: INFO nova.scheduler.client.report [None req-b44a8249-3405-4134-8c7c-92e4147b020d tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Deleted allocations for instance 26a0b493-bb47-466e-95d5-945fc3849fa5
Oct 26 00:14:42 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-b44a8249-3405-4134-8c7c-92e4147b020d tempest-ServerStableDeviceRescueTest-1585397509 tempest-ServerStableDeviceRescueTest-1585397509-project-member] Lock "26a0b493-bb47-466e-95d5-945fc3849fa5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.445s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:14:44 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-918e1980-57c0-4909-a3fa-b87c44902c4c tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Acquiring lock "b041e0af-4635-495c-b72d-fbbbd8d43a9b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:14:44 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-918e1980-57c0-4909-a3fa-b87c44902c4c tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Lock "b041e0af-4635-495c-b72d-fbbbd8d43a9b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:14:44 user nova-compute[75165]: DEBUG nova.compute.manager [None req-918e1980-57c0-4909-a3fa-b87c44902c4c tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] [instance: b041e0af-4635-495c-b72d-fbbbd8d43a9b] Starting instance... {{(pid=75165) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 00:14:44 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-918e1980-57c0-4909-a3fa-b87c44902c4c tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:14:44 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-918e1980-57c0-4909-a3fa-b87c44902c4c tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:14:44 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-918e1980-57c0-4909-a3fa-b87c44902c4c tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75165) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 00:14:44 user nova-compute[75165]: INFO nova.compute.claims [None req-918e1980-57c0-4909-a3fa-b87c44902c4c tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] [instance: b041e0af-4635-495c-b72d-fbbbd8d43a9b] Claim successful on node user
Oct 26 00:14:44 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-918e1980-57c0-4909-a3fa-b87c44902c4c tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:14:44 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-918e1980-57c0-4909-a3fa-b87c44902c4c tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:14:44 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-918e1980-57c0-4909-a3fa-b87c44902c4c tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.463s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:14:44 user nova-compute[75165]: DEBUG nova.compute.manager [None req-918e1980-57c0-4909-a3fa-b87c44902c4c tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] [instance: b041e0af-4635-495c-b72d-fbbbd8d43a9b] Start building networks asynchronously for instance. {{(pid=75165) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 00:14:45 user nova-compute[75165]: DEBUG nova.compute.manager [None req-918e1980-57c0-4909-a3fa-b87c44902c4c tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] [instance: b041e0af-4635-495c-b72d-fbbbd8d43a9b] Allocating IP information in the background. {{(pid=75165) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 00:14:45 user nova-compute[75165]: DEBUG nova.network.neutron [None req-918e1980-57c0-4909-a3fa-b87c44902c4c tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] [instance: b041e0af-4635-495c-b72d-fbbbd8d43a9b] allocate_for_instance() {{(pid=75165) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 00:14:45 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-918e1980-57c0-4909-a3fa-b87c44902c4c tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] [instance: b041e0af-4635-495c-b72d-fbbbd8d43a9b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 00:14:45 user nova-compute[75165]: DEBUG nova.compute.manager [None req-918e1980-57c0-4909-a3fa-b87c44902c4c tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] [instance: b041e0af-4635-495c-b72d-fbbbd8d43a9b] Start building block device mappings for instance. {{(pid=75165) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 00:14:45 user nova-compute[75165]: DEBUG nova.policy [None req-918e1980-57c0-4909-a3fa-b87c44902c4c tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a40cb1b08014444686bd0adad03f6c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '920152101768459baa71010b380ea8f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75165) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 00:14:45 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:14:45 user nova-compute[75165]: DEBUG nova.compute.manager [None req-918e1980-57c0-4909-a3fa-b87c44902c4c tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] [instance: b041e0af-4635-495c-b72d-fbbbd8d43a9b] Start spawning the instance on the hypervisor. {{(pid=75165) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 00:14:45 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-918e1980-57c0-4909-a3fa-b87c44902c4c tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] [instance: b041e0af-4635-495c-b72d-fbbbd8d43a9b] Creating instance directory {{(pid=75165) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 00:14:45 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-918e1980-57c0-4909-a3fa-b87c44902c4c tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] [instance: b041e0af-4635-495c-b72d-fbbbd8d43a9b] Creating image(s)
Oct 26 00:14:45 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-918e1980-57c0-4909-a3fa-b87c44902c4c tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Acquiring lock "/opt/stack/data/nova/instances/b041e0af-4635-495c-b72d-fbbbd8d43a9b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:14:45 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-918e1980-57c0-4909-a3fa-b87c44902c4c tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Lock "/opt/stack/data/nova/instances/b041e0af-4635-495c-b72d-fbbbd8d43a9b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:14:45 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-918e1980-57c0-4909-a3fa-b87c44902c4c tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Lock "/opt/stack/data/nova/instances/b041e0af-4635-495c-b72d-fbbbd8d43a9b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:14:45 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-918e1980-57c0-4909-a3fa-b87c44902c4c tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:14:45 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-918e1980-57c0-4909-a3fa-b87c44902c4c tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json" returned: 0 in 0.182s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:14:45 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-918e1980-57c0-4909-a3fa-b87c44902c4c tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Acquiring lock "7d3243421cf3fdc288b758f687a93103b7b95466" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:14:45 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-918e1980-57c0-4909-a3fa-b87c44902c4c tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Lock "7d3243421cf3fdc288b758f687a93103b7b95466" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:14:45 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-918e1980-57c0-4909-a3fa-b87c44902c4c tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:14:45 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-918e1980-57c0-4909-a3fa-b87c44902c4c tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json" returned: 0 in 0.196s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:14:45 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-918e1980-57c0-4909-a3fa-b87c44902c4c tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466,backing_fmt=raw /opt/stack/data/nova/instances/b041e0af-4635-495c-b72d-fbbbd8d43a9b/disk 1073741824 {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:14:45 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-918e1980-57c0-4909-a3fa-b87c44902c4c tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466,backing_fmt=raw /opt/stack/data/nova/instances/b041e0af-4635-495c-b72d-fbbbd8d43a9b/disk 1073741824" returned: 0 in 0.057s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:14:45 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-918e1980-57c0-4909-a3fa-b87c44902c4c tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Lock "7d3243421cf3fdc288b758f687a93103b7b95466" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:14:45 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-918e1980-57c0-4909-a3fa-b87c44902c4c tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:14:45 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-918e1980-57c0-4909-a3fa-b87c44902c4c tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json" returned: 0 in 0.194s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:14:45 user nova-compute[75165]: DEBUG nova.virt.disk.api [None req-918e1980-57c0-4909-a3fa-b87c44902c4c tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b041e0af-4635-495c-b72d-fbbbd8d43a9b/disk. size=1073741824 {{(pid=75165) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 00:14:45 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-918e1980-57c0-4909-a3fa-b87c44902c4c tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b041e0af-4635-495c-b72d-fbbbd8d43a9b/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:14:45 user nova-compute[75165]: DEBUG nova.network.neutron [None req-918e1980-57c0-4909-a3fa-b87c44902c4c tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] [instance: b041e0af-4635-495c-b72d-fbbbd8d43a9b] Successfully created port: 1964255b-cf1e-4e17-a1f7-ae5d6ea25aef {{(pid=75165) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 00:14:45 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:14:46 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-918e1980-57c0-4909-a3fa-b87c44902c4c tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b041e0af-4635-495c-b72d-fbbbd8d43a9b/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:14:46 user nova-compute[75165]: DEBUG nova.virt.disk.api [None req-918e1980-57c0-4909-a3fa-b87c44902c4c tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Cannot resize image /opt/stack/data/nova/instances/b041e0af-4635-495c-b72d-fbbbd8d43a9b/disk to a smaller size. {{(pid=75165) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 00:14:46 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-918e1980-57c0-4909-a3fa-b87c44902c4c tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] [instance: b041e0af-4635-495c-b72d-fbbbd8d43a9b] Created local disks {{(pid=75165) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 00:14:46 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-918e1980-57c0-4909-a3fa-b87c44902c4c tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] [instance: b041e0af-4635-495c-b72d-fbbbd8d43a9b] Ensure instance console log exists: /opt/stack/data/nova/instances/b041e0af-4635-495c-b72d-fbbbd8d43a9b/console.log {{(pid=75165) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 00:14:46 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-918e1980-57c0-4909-a3fa-b87c44902c4c tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:14:46 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-918e1980-57c0-4909-a3fa-b87c44902c4c tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:14:46 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-918e1980-57c0-4909-a3fa-b87c44902c4c tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:14:46 user nova-compute[75165]: DEBUG nova.network.neutron [None req-918e1980-57c0-4909-a3fa-b87c44902c4c tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] [instance: b041e0af-4635-495c-b72d-fbbbd8d43a9b] Successfully updated port: 1964255b-cf1e-4e17-a1f7-ae5d6ea25aef {{(pid=75165) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 00:14:46 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-918e1980-57c0-4909-a3fa-b87c44902c4c tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Acquiring lock "refresh_cache-b041e0af-4635-495c-b72d-fbbbd8d43a9b" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:14:46 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-918e1980-57c0-4909-a3fa-b87c44902c4c tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Acquired lock "refresh_cache-b041e0af-4635-495c-b72d-fbbbd8d43a9b" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:14:46 user nova-compute[75165]: DEBUG nova.network.neutron [None req-918e1980-57c0-4909-a3fa-b87c44902c4c tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] [instance: b041e0af-4635-495c-b72d-fbbbd8d43a9b] Building network info cache for instance {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 00:14:46 user nova-compute[75165]: DEBUG nova.compute.manager [req-b357b149-f826-4661-8d81-ce11ea1dde81 req-a4287c20-94c0-4217-beb7-1efd20ffada8 service nova] [instance: b041e0af-4635-495c-b72d-fbbbd8d43a9b] Received event network-changed-1964255b-cf1e-4e17-a1f7-ae5d6ea25aef {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:14:46 user nova-compute[75165]: DEBUG nova.compute.manager [req-b357b149-f826-4661-8d81-ce11ea1dde81 req-a4287c20-94c0-4217-beb7-1efd20ffada8 service nova] [instance: b041e0af-4635-495c-b72d-fbbbd8d43a9b] Refreshing instance network info cache due to event network-changed-1964255b-cf1e-4e17-a1f7-ae5d6ea25aef. {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 00:14:46 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-b357b149-f826-4661-8d81-ce11ea1dde81 req-a4287c20-94c0-4217-beb7-1efd20ffada8 service nova] Acquiring lock "refresh_cache-b041e0af-4635-495c-b72d-fbbbd8d43a9b" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:14:46 user nova-compute[75165]: DEBUG nova.network.neutron [None req-918e1980-57c0-4909-a3fa-b87c44902c4c tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] [instance: b041e0af-4635-495c-b72d-fbbbd8d43a9b] Instance cache missing network info. {{(pid=75165) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 00:14:47 user nova-compute[75165]: DEBUG nova.network.neutron [None req-918e1980-57c0-4909-a3fa-b87c44902c4c tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] [instance: b041e0af-4635-495c-b72d-fbbbd8d43a9b] Updating instance_info_cache with network_info: [{"id": "1964255b-cf1e-4e17-a1f7-ae5d6ea25aef", "address": "fa:16:3e:76:6f:05", "network": {"id": "f54e2e9f-5c1e-44ca-bd4b-9cf0747b0f72", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-806146051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "920152101768459baa71010b380ea8f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1964255b-cf", "ovs_interfaceid": "1964255b-cf1e-4e17-a1f7-ae5d6ea25aef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:14:47 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-918e1980-57c0-4909-a3fa-b87c44902c4c tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Releasing lock "refresh_cache-b041e0af-4635-495c-b72d-fbbbd8d43a9b" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:14:47 user nova-compute[75165]: DEBUG nova.compute.manager [None req-918e1980-57c0-4909-a3fa-b87c44902c4c tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] [instance: b041e0af-4635-495c-b72d-fbbbd8d43a9b] Instance network_info: |[{"id": "1964255b-cf1e-4e17-a1f7-ae5d6ea25aef", "address": "fa:16:3e:76:6f:05", "network": {"id": "f54e2e9f-5c1e-44ca-bd4b-9cf0747b0f72", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-806146051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "920152101768459baa71010b380ea8f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1964255b-cf", "ovs_interfaceid": "1964255b-cf1e-4e17-a1f7-ae5d6ea25aef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75165) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 00:14:47 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-b357b149-f826-4661-8d81-ce11ea1dde81 req-a4287c20-94c0-4217-beb7-1efd20ffada8 service nova] Acquired lock "refresh_cache-b041e0af-4635-495c-b72d-fbbbd8d43a9b" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:14:47 user nova-compute[75165]: DEBUG nova.network.neutron [req-b357b149-f826-4661-8d81-ce11ea1dde81 req-a4287c20-94c0-4217-beb7-1efd20ffada8 service nova] [instance: b041e0af-4635-495c-b72d-fbbbd8d43a9b] Refreshing network info cache for port 1964255b-cf1e-4e17-a1f7-ae5d6ea25aef {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 00:14:47 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-918e1980-57c0-4909-a3fa-b87c44902c4c tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] [instance: b041e0af-4635-495c-b72d-fbbbd8d43a9b] Start _get_guest_xml network_info=[{"id": "1964255b-cf1e-4e17-a1f7-ae5d6ea25aef", "address": "fa:16:3e:76:6f:05", "network": {"id": "f54e2e9f-5c1e-44ca-bd4b-9cf0747b0f72", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-806146051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "920152101768459baa71010b380ea8f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1964255b-cf", "ovs_interfaceid": "1964255b-cf1e-4e17-a1f7-ae5d6ea25aef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T00:03:24Z,direct_url=<?>,disk_format='qcow2',id=bff0d8a1-739e-4c4d-9efa-b73ba7b76d01,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e56bbf444fd34c348475c73673611447',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T00:03:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'size': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': 'bff0d8a1-739e-4c4d-9efa-b73ba7b76d01'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75165) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 00:14:47 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-918e1980-57c0-4909-a3fa-b87c44902c4c tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:14:47 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-918e1980-57c0-4909-a3fa-b87c44902c4c tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:14:47 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-918e1980-57c0-4909-a3fa-b87c44902c4c tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75165) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 00:14:47 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-918e1980-57c0-4909-a3fa-b87c44902c4c tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] CPU controller missing on host. {{(pid=75165) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 00:14:47 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-918e1980-57c0-4909-a3fa-b87c44902c4c tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75165) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 00:14:47 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-918e1980-57c0-4909-a3fa-b87c44902c4c tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] CPU controller found on host. {{(pid=75165) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 00:14:47 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-918e1980-57c0-4909-a3fa-b87c44902c4c tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75165) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 00:14:47 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-918e1980-57c0-4909-a3fa-b87c44902c4c tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T00:03:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T00:03:24Z,direct_url=<?>,disk_format='qcow2',id=bff0d8a1-739e-4c4d-9efa-b73ba7b76d01,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e56bbf444fd34c348475c73673611447',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T00:03:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 00:14:47 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-918e1980-57c0-4909-a3fa-b87c44902c4c tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Flavor limits 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 00:14:47 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-918e1980-57c0-4909-a3fa-b87c44902c4c tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Image limits 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 00:14:47 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-918e1980-57c0-4909-a3fa-b87c44902c4c tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Flavor pref 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 00:14:47 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-918e1980-57c0-4909-a3fa-b87c44902c4c tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Image pref 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 00:14:47 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-918e1980-57c0-4909-a3fa-b87c44902c4c tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 00:14:47 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-918e1980-57c0-4909-a3fa-b87c44902c4c tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 00:14:47 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-918e1980-57c0-4909-a3fa-b87c44902c4c tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75165) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 00:14:47 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-918e1980-57c0-4909-a3fa-b87c44902c4c tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Got 1 possible topologies {{(pid=75165) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 00:14:47 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-918e1980-57c0-4909-a3fa-b87c44902c4c tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 00:14:47 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-918e1980-57c0-4909-a3fa-b87c44902c4c tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 00:14:47 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-918e1980-57c0-4909-a3fa-b87c44902c4c tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:14:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1018278796',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1018278796',id=21,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFIx031L1+GlVTK7qzqFtuz0mMeB9gXcDnYf15sI5K9uRukBpGnVUMwr1kJMENEY2qClV++eI4EJ2qQekfK0Kpz2P/4UBmBjh5aCvNsjqbekaGDKFB27VB5WEQwCxB5PCA==',key_name='tempest-keypair-1875668396',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='920152101768459baa71010b380ea8f1',ramdisk_id='',reservation_id='r-agpdy52s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-6636270',owner_user_name='tempest-AttachVolumeShelveTestJSON-6636270-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T00:14:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a40cb1b08014444686bd0adad03f6c68',uuid=b041e0af-4635-495c-b72d-fbbbd8d43a9b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1964255b-cf1e-4e17-a1f7-ae5d6ea25aef", "address": "fa:16:3e:76:6f:05", "network": {"id": "f54e2e9f-5c1e-44ca-bd4b-9cf0747b0f72", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-806146051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "920152101768459baa71010b380ea8f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1964255b-cf", "ovs_interfaceid": "1964255b-cf1e-4e17-a1f7-ae5d6ea25aef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75165) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 00:14:47 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-918e1980-57c0-4909-a3fa-b87c44902c4c tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Converting VIF {"id": "1964255b-cf1e-4e17-a1f7-ae5d6ea25aef", "address": "fa:16:3e:76:6f:05", "network": {"id": "f54e2e9f-5c1e-44ca-bd4b-9cf0747b0f72", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-806146051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "920152101768459baa71010b380ea8f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1964255b-cf", "ovs_interfaceid": "1964255b-cf1e-4e17-a1f7-ae5d6ea25aef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:14:47 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-918e1980-57c0-4909-a3fa-b87c44902c4c tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:6f:05,bridge_name='br-int',has_traffic_filtering=True,id=1964255b-cf1e-4e17-a1f7-ae5d6ea25aef,network=Network(f54e2e9f-5c1e-44ca-bd4b-9cf0747b0f72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1964255b-cf') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:14:47 user nova-compute[75165]: DEBUG nova.objects.instance [None req-918e1980-57c0-4909-a3fa-b87c44902c4c tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Lazy-loading 'pci_devices' on Instance uuid b041e0af-4635-495c-b72d-fbbbd8d43a9b {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:14:47 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-918e1980-57c0-4909-a3fa-b87c44902c4c tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] [instance: b041e0af-4635-495c-b72d-fbbbd8d43a9b] End _get_guest_xml xml=<domain type="kvm">
Oct 26 00:14:47 user nova-compute[75165]:   <uuid>b041e0af-4635-495c-b72d-fbbbd8d43a9b</uuid>
Oct 26 00:14:47 user nova-compute[75165]:   <name>instance-00000015</name>
Oct 26 00:14:47 user nova-compute[75165]:   <memory>524288</memory>
Oct 26 00:14:47 user nova-compute[75165]:   <vcpu>1</vcpu>
Oct 26 00:14:47 user nova-compute[75165]:   <metadata>
Oct 26 00:14:47 user nova-compute[75165]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 00:14:47 user nova-compute[75165]:       <nova:package version="0.0.0"/>
Oct 26 00:14:47 user nova-compute[75165]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1018278796</nova:name>
Oct 26 00:14:47 user nova-compute[75165]:       <nova:creationTime>2023-10-26 00:14:47</nova:creationTime>
Oct 26 00:14:47 user nova-compute[75165]:       <nova:flavor name="m1.tiny">
Oct 26 00:14:47 user nova-compute[75165]:         <nova:memory>512</nova:memory>
Oct 26 00:14:47 user nova-compute[75165]:         <nova:disk>1</nova:disk>
Oct 26 00:14:47 user nova-compute[75165]:         <nova:swap>0</nova:swap>
Oct 26 00:14:47 user nova-compute[75165]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 00:14:47 user nova-compute[75165]:         <nova:vcpus>1</nova:vcpus>
Oct 26 00:14:47 user nova-compute[75165]:       </nova:flavor>
Oct 26 00:14:47 user nova-compute[75165]:       <nova:owner>
Oct 26 00:14:47 user nova-compute[75165]:         <nova:user uuid="a40cb1b08014444686bd0adad03f6c68">tempest-AttachVolumeShelveTestJSON-6636270-project-member</nova:user>
Oct 26 00:14:47 user nova-compute[75165]:         <nova:project uuid="920152101768459baa71010b380ea8f1">tempest-AttachVolumeShelveTestJSON-6636270</nova:project>
Oct 26 00:14:47 user nova-compute[75165]:       </nova:owner>
Oct 26 00:14:47 user nova-compute[75165]:       <nova:root type="image" uuid="bff0d8a1-739e-4c4d-9efa-b73ba7b76d01"/>
Oct 26 00:14:47 user nova-compute[75165]:       <nova:ports>
Oct 26 00:14:47 user nova-compute[75165]:         <nova:port uuid="1964255b-cf1e-4e17-a1f7-ae5d6ea25aef">
Oct 26 00:14:47 user nova-compute[75165]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 26 00:14:47 user nova-compute[75165]:         </nova:port>
Oct 26 00:14:47 user nova-compute[75165]:       </nova:ports>
Oct 26 00:14:47 user nova-compute[75165]:     </nova:instance>
Oct 26 00:14:47 user nova-compute[75165]:   </metadata>
Oct 26 00:14:47 user nova-compute[75165]:   <sysinfo type="smbios">
Oct 26 00:14:47 user nova-compute[75165]:     <system>
Oct 26 00:14:47 user nova-compute[75165]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 00:14:47 user nova-compute[75165]:       <entry name="product">OpenStack Nova</entry>
Oct 26 00:14:47 user nova-compute[75165]:       <entry name="version">0.0.0</entry>
Oct 26 00:14:47 user nova-compute[75165]:       <entry name="serial">b041e0af-4635-495c-b72d-fbbbd8d43a9b</entry>
Oct 26 00:14:47 user nova-compute[75165]:       <entry name="uuid">b041e0af-4635-495c-b72d-fbbbd8d43a9b</entry>
Oct 26 00:14:47 user nova-compute[75165]:       <entry name="family">Virtual Machine</entry>
Oct 26 00:14:47 user nova-compute[75165]:     </system>
Oct 26 00:14:47 user nova-compute[75165]:   </sysinfo>
Oct 26 00:14:47 user nova-compute[75165]:   <os>
Oct 26 00:14:47 user nova-compute[75165]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 00:14:47 user nova-compute[75165]:     <boot dev="hd"/>
Oct 26 00:14:47 user nova-compute[75165]:     <smbios mode="sysinfo"/>
Oct 26 00:14:47 user nova-compute[75165]:   </os>
Oct 26 00:14:47 user nova-compute[75165]:   <features>
Oct 26 00:14:47 user nova-compute[75165]:     <acpi/>
Oct 26 00:14:47 user nova-compute[75165]:     <apic/>
Oct 26 00:14:47 user nova-compute[75165]:     <vmcoreinfo/>
Oct 26 00:14:47 user nova-compute[75165]:   </features>
Oct 26 00:14:47 user nova-compute[75165]:   <clock offset="utc">
Oct 26 00:14:47 user nova-compute[75165]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 00:14:47 user nova-compute[75165]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 00:14:47 user nova-compute[75165]:     <timer name="hpet" present="no"/>
Oct 26 00:14:47 user nova-compute[75165]:   </clock>
Oct 26 00:14:47 user nova-compute[75165]:   <cpu mode="custom" match="exact">
Oct 26 00:14:47 user nova-compute[75165]:     <model>Nehalem</model>
Oct 26 00:14:47 user nova-compute[75165]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 00:14:47 user nova-compute[75165]:   </cpu>
Oct 26 00:14:47 user nova-compute[75165]:   <devices>
Oct 26 00:14:47 user nova-compute[75165]:     <disk type="file" device="disk">
Oct 26 00:14:47 user nova-compute[75165]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 00:14:47 user nova-compute[75165]:       <source file="/opt/stack/data/nova/instances/b041e0af-4635-495c-b72d-fbbbd8d43a9b/disk"/>
Oct 26 00:14:47 user nova-compute[75165]:       <target dev="vda" bus="virtio"/>
Oct 26 00:14:47 user nova-compute[75165]:     </disk>
Oct 26 00:14:47 user nova-compute[75165]:     <interface type="ethernet">
Oct 26 00:14:47 user nova-compute[75165]:       <mac address="fa:16:3e:76:6f:05"/>
Oct 26 00:14:47 user nova-compute[75165]:       <model type="virtio"/>
Oct 26 00:14:47 user nova-compute[75165]:       <mtu size="1442"/>
Oct 26 00:14:47 user nova-compute[75165]:       <target dev="tap1964255b-cf"/>
Oct 26 00:14:47 user nova-compute[75165]:     </interface>
Oct 26 00:14:47 user nova-compute[75165]:     <serial type="pty">
Oct 26 00:14:47 user nova-compute[75165]:       <log file="/opt/stack/data/nova/instances/b041e0af-4635-495c-b72d-fbbbd8d43a9b/console.log" append="off"/>
Oct 26 00:14:47 user nova-compute[75165]:     </serial>
Oct 26 00:14:47 user nova-compute[75165]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 00:14:47 user nova-compute[75165]:     <video>
Oct 26 00:14:47 user nova-compute[75165]:       <model type="virtio"/>
Oct 26 00:14:47 user nova-compute[75165]:     </video>
Oct 26 00:14:47 user nova-compute[75165]:     <rng model="virtio">
Oct 26 00:14:47 user nova-compute[75165]:       <backend model="random">/dev/urandom</backend>
Oct 26 00:14:47 user nova-compute[75165]:     </rng>
Oct 26 00:14:47 user nova-compute[75165]:     <controller type="usb" index="0" model="none"/>
Oct 26 00:14:47 user nova-compute[75165]:     <memballoon model="virtio">
Oct 26 00:14:47 user nova-compute[75165]:       <stats period="10"/>
Oct 26 00:14:47 user nova-compute[75165]:     </memballoon>
Oct 26 00:14:47 user nova-compute[75165]:   </devices>
Oct 26 00:14:47 user nova-compute[75165]: </domain>
Oct 26 00:14:47 user nova-compute[75165]:  {{(pid=75165) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 00:14:47 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-918e1980-57c0-4909-a3fa-b87c44902c4c tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:14:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1018278796',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1018278796',id=21,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFIx031L1+GlVTK7qzqFtuz0mMeB9gXcDnYf15sI5K9uRukBpGnVUMwr1kJMENEY2qClV++eI4EJ2qQekfK0Kpz2P/4UBmBjh5aCvNsjqbekaGDKFB27VB5WEQwCxB5PCA==',key_name='tempest-keypair-1875668396',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='920152101768459baa71010b380ea8f1',ramdisk_id='',reservation_id='r-agpdy52s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-6636270',owner_user_name='tempest-AttachVolumeShelveTestJSON-6636270-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T00:14:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a40cb1b08014444686bd0adad03f6c68',uuid=b041e0af-4635-495c-b72d-fbbbd8d43a9b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1964255b-cf1e-4e17-a1f7-ae5d6ea25aef", "address": "fa:16:3e:76:6f:05", "network": {"id": "f54e2e9f-5c1e-44ca-bd4b-9cf0747b0f72", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-806146051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "920152101768459baa71010b380ea8f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1964255b-cf", "ovs_interfaceid": "1964255b-cf1e-4e17-a1f7-ae5d6ea25aef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 00:14:47 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-918e1980-57c0-4909-a3fa-b87c44902c4c tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Converting VIF {"id": "1964255b-cf1e-4e17-a1f7-ae5d6ea25aef", "address": "fa:16:3e:76:6f:05", "network": {"id": "f54e2e9f-5c1e-44ca-bd4b-9cf0747b0f72", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-806146051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "920152101768459baa71010b380ea8f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1964255b-cf", "ovs_interfaceid": "1964255b-cf1e-4e17-a1f7-ae5d6ea25aef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:14:47 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-918e1980-57c0-4909-a3fa-b87c44902c4c tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:6f:05,bridge_name='br-int',has_traffic_filtering=True,id=1964255b-cf1e-4e17-a1f7-ae5d6ea25aef,network=Network(f54e2e9f-5c1e-44ca-bd4b-9cf0747b0f72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1964255b-cf') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:14:47 user nova-compute[75165]: DEBUG os_vif [None req-918e1980-57c0-4909-a3fa-b87c44902c4c tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:6f:05,bridge_name='br-int',has_traffic_filtering=True,id=1964255b-cf1e-4e17-a1f7-ae5d6ea25aef,network=Network(f54e2e9f-5c1e-44ca-bd4b-9cf0747b0f72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1964255b-cf') {{(pid=75165) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 00:14:47 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:14:47 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:14:47 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 00:14:47 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:14:47 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '81c40ebc-a9b8-59f7-896c-ce5f6d734092', '_type': 'linux-noop'}}, row=False) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:14:47 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:14:47 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:14:47 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:14:47 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1964255b-cf, may_exist=True, interface_attrs={}) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:14:47 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1964255b-cf, col_values=(('qos', UUID('0be02375-0fd4-4d15-ad6c-7eb9d51af287')),), if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:14:47 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1964255b-cf, col_values=(('external_ids', {'iface-id': '1964255b-cf1e-4e17-a1f7-ae5d6ea25aef', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:76:6f:05', 'vm-uuid': 'b041e0af-4635-495c-b72d-fbbbd8d43a9b'}),), if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:14:47 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:14:47 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:14:47 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:14:47 user nova-compute[75165]: INFO os_vif [None req-918e1980-57c0-4909-a3fa-b87c44902c4c tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:6f:05,bridge_name='br-int',has_traffic_filtering=True,id=1964255b-cf1e-4e17-a1f7-ae5d6ea25aef,network=Network(f54e2e9f-5c1e-44ca-bd4b-9cf0747b0f72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1964255b-cf')
Oct 26 00:14:47 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-918e1980-57c0-4909-a3fa-b87c44902c4c tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] No BDM found with device name vda, not building metadata. {{(pid=75165) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 00:14:47 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-918e1980-57c0-4909-a3fa-b87c44902c4c tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] No VIF found with MAC fa:16:3e:76:6f:05, not building metadata {{(pid=75165) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 00:14:47 user nova-compute[75165]: DEBUG nova.network.neutron [req-b357b149-f826-4661-8d81-ce11ea1dde81 req-a4287c20-94c0-4217-beb7-1efd20ffada8 service nova] [instance: b041e0af-4635-495c-b72d-fbbbd8d43a9b] Updated VIF entry in instance network info cache for port 1964255b-cf1e-4e17-a1f7-ae5d6ea25aef. {{(pid=75165) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 00:14:47 user nova-compute[75165]: DEBUG nova.network.neutron [req-b357b149-f826-4661-8d81-ce11ea1dde81 req-a4287c20-94c0-4217-beb7-1efd20ffada8 service nova] [instance: b041e0af-4635-495c-b72d-fbbbd8d43a9b] Updating instance_info_cache with network_info: [{"id": "1964255b-cf1e-4e17-a1f7-ae5d6ea25aef", "address": "fa:16:3e:76:6f:05", "network": {"id": "f54e2e9f-5c1e-44ca-bd4b-9cf0747b0f72", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-806146051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "920152101768459baa71010b380ea8f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1964255b-cf", "ovs_interfaceid": "1964255b-cf1e-4e17-a1f7-ae5d6ea25aef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:14:47 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-b357b149-f826-4661-8d81-ce11ea1dde81 req-a4287c20-94c0-4217-beb7-1efd20ffada8 service nova] Releasing lock "refresh_cache-b041e0af-4635-495c-b72d-fbbbd8d43a9b" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:14:48 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:14:49 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:14:49 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:14:49 user nova-compute[75165]: DEBUG nova.compute.manager [req-3f006ca8-5bd8-4f23-a6a4-cbf5ab3327db req-949f3a07-c2b5-4212-95af-fcf86d9a82ab service nova] [instance: b041e0af-4635-495c-b72d-fbbbd8d43a9b] Received event network-vif-plugged-1964255b-cf1e-4e17-a1f7-ae5d6ea25aef {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:14:49 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-3f006ca8-5bd8-4f23-a6a4-cbf5ab3327db req-949f3a07-c2b5-4212-95af-fcf86d9a82ab service nova] Acquiring lock "b041e0af-4635-495c-b72d-fbbbd8d43a9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:14:49 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-3f006ca8-5bd8-4f23-a6a4-cbf5ab3327db req-949f3a07-c2b5-4212-95af-fcf86d9a82ab service nova] Lock "b041e0af-4635-495c-b72d-fbbbd8d43a9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:14:49 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-3f006ca8-5bd8-4f23-a6a4-cbf5ab3327db req-949f3a07-c2b5-4212-95af-fcf86d9a82ab service nova] Lock "b041e0af-4635-495c-b72d-fbbbd8d43a9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:14:49 user nova-compute[75165]: DEBUG nova.compute.manager [req-3f006ca8-5bd8-4f23-a6a4-cbf5ab3327db req-949f3a07-c2b5-4212-95af-fcf86d9a82ab service nova] [instance: b041e0af-4635-495c-b72d-fbbbd8d43a9b] No waiting events found dispatching network-vif-plugged-1964255b-cf1e-4e17-a1f7-ae5d6ea25aef {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:14:49 user nova-compute[75165]: WARNING nova.compute.manager [req-3f006ca8-5bd8-4f23-a6a4-cbf5ab3327db req-949f3a07-c2b5-4212-95af-fcf86d9a82ab service nova] [instance: b041e0af-4635-495c-b72d-fbbbd8d43a9b] Received unexpected event network-vif-plugged-1964255b-cf1e-4e17-a1f7-ae5d6ea25aef for instance with vm_state building and task_state spawning.
Oct 26 00:14:49 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:14:49 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:14:49 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:14:50 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:14:51 user nova-compute[75165]: DEBUG nova.compute.manager [None req-918e1980-57c0-4909-a3fa-b87c44902c4c tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] [instance: b041e0af-4635-495c-b72d-fbbbd8d43a9b] Instance event wait completed in 0 seconds for  {{(pid=75165) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 00:14:51 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-918e1980-57c0-4909-a3fa-b87c44902c4c tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] [instance: b041e0af-4635-495c-b72d-fbbbd8d43a9b] Guest created on hypervisor {{(pid=75165) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 00:14:51 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: b041e0af-4635-495c-b72d-fbbbd8d43a9b] Instance spawned successfully.
Oct 26 00:14:51 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-918e1980-57c0-4909-a3fa-b87c44902c4c tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] [instance: b041e0af-4635-495c-b72d-fbbbd8d43a9b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 00:14:51 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-918e1980-57c0-4909-a3fa-b87c44902c4c tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] [instance: b041e0af-4635-495c-b72d-fbbbd8d43a9b] Found default for hw_cdrom_bus of ide {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:14:51 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-918e1980-57c0-4909-a3fa-b87c44902c4c tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] [instance: b041e0af-4635-495c-b72d-fbbbd8d43a9b] Found default for hw_disk_bus of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:14:51 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-918e1980-57c0-4909-a3fa-b87c44902c4c tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] [instance: b041e0af-4635-495c-b72d-fbbbd8d43a9b] Found default for hw_input_bus of None {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:14:51 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-918e1980-57c0-4909-a3fa-b87c44902c4c tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] [instance: b041e0af-4635-495c-b72d-fbbbd8d43a9b] Found default for hw_pointer_model of None {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:14:51 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-918e1980-57c0-4909-a3fa-b87c44902c4c tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] [instance: b041e0af-4635-495c-b72d-fbbbd8d43a9b] Found default for hw_video_model of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:14:51 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-918e1980-57c0-4909-a3fa-b87c44902c4c tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] [instance: b041e0af-4635-495c-b72d-fbbbd8d43a9b] Found default for hw_vif_model of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:14:51 user nova-compute[75165]: INFO nova.compute.manager [None req-918e1980-57c0-4909-a3fa-b87c44902c4c tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] [instance: b041e0af-4635-495c-b72d-fbbbd8d43a9b] Took 6.38 seconds to spawn the instance on the hypervisor.
Oct 26 00:14:51 user nova-compute[75165]: DEBUG nova.compute.manager [None req-918e1980-57c0-4909-a3fa-b87c44902c4c tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] [instance: b041e0af-4635-495c-b72d-fbbbd8d43a9b] Checking state {{(pid=75165) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 00:14:51 user nova-compute[75165]: DEBUG nova.compute.manager [req-1927717b-03c8-4f12-9949-a6c8e3469a38 req-8ba95d32-1382-42f2-bd31-64a57fe6c396 service nova] [instance: b041e0af-4635-495c-b72d-fbbbd8d43a9b] Received event network-vif-plugged-1964255b-cf1e-4e17-a1f7-ae5d6ea25aef {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:14:51 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-1927717b-03c8-4f12-9949-a6c8e3469a38 req-8ba95d32-1382-42f2-bd31-64a57fe6c396 service nova] Acquiring lock "b041e0af-4635-495c-b72d-fbbbd8d43a9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:14:51 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-1927717b-03c8-4f12-9949-a6c8e3469a38 req-8ba95d32-1382-42f2-bd31-64a57fe6c396 service nova] Lock "b041e0af-4635-495c-b72d-fbbbd8d43a9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:14:51 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-1927717b-03c8-4f12-9949-a6c8e3469a38 req-8ba95d32-1382-42f2-bd31-64a57fe6c396 service nova] Lock "b041e0af-4635-495c-b72d-fbbbd8d43a9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:14:51 user nova-compute[75165]: DEBUG nova.compute.manager [req-1927717b-03c8-4f12-9949-a6c8e3469a38 req-8ba95d32-1382-42f2-bd31-64a57fe6c396 service nova] [instance: b041e0af-4635-495c-b72d-fbbbd8d43a9b] No waiting events found dispatching network-vif-plugged-1964255b-cf1e-4e17-a1f7-ae5d6ea25aef {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:14:51 user nova-compute[75165]: WARNING nova.compute.manager [req-1927717b-03c8-4f12-9949-a6c8e3469a38 req-8ba95d32-1382-42f2-bd31-64a57fe6c396 service nova] [instance: b041e0af-4635-495c-b72d-fbbbd8d43a9b] Received unexpected event network-vif-plugged-1964255b-cf1e-4e17-a1f7-ae5d6ea25aef for instance with vm_state building and task_state spawning.
Oct 26 00:14:51 user nova-compute[75165]: INFO nova.compute.manager [None req-918e1980-57c0-4909-a3fa-b87c44902c4c tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] [instance: b041e0af-4635-495c-b72d-fbbbd8d43a9b] Took 7.34 seconds to build instance.
Oct 26 00:14:51 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-918e1980-57c0-4909-a3fa-b87c44902c4c tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Lock "b041e0af-4635-495c-b72d-fbbbd8d43a9b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.462s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:14:52 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-d9afd07b-3e34-4c9d-a9de-b8c1ac76a4ba tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 3150d249-37a2-49c6-837a-3828480fa2b4 is timed out.
Oct 26 00:14:52 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-d9afd07b-3e34-4c9d-a9de-b8c1ac76a4ba tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Successfully detached device vdb from instance 3150d249-37a2-49c6-837a-3828480fa2b4 from the live domain config.
Oct 26 00:14:52 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9afd07b-3e34-4c9d-a9de-b8c1ac76a4ba tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] [instance: 3150d249-37a2-49c6-837a-3828480fa2b4] calling os-brick to detach iSCSI Volume {{(pid=75165) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 00:14:52 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9afd07b-3e34-4c9d-a9de-b8c1ac76a4ba tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8bf8160e50>, {'target_iqn': 'iqn.2010-10.org.openstack:f8ecd4e8-862c-4129-8244-f361457dc5ea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eIRZFaSE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:14:52 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-d9afd07b-3e34-4c9d-a9de-b8c1ac76a4ba tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:14:52 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-d9afd07b-3e34-4c9d-a9de-b8c1ac76a4ba tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:14:52 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-d9afd07b-3e34-4c9d-a9de-b8c1ac76a4ba tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:14:52 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:14:52 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:14:52 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[37ae89a9-a04a-4825-9145-1024a7a91549]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f8ecd4e8-862c-4129-8244-f361457dc5ea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:14:52 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9afd07b-3e34-4c9d-a9de-b8c1ac76a4ba tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 00:14:52 user nova-compute[75165]: No targets found.
Oct 26 00:14:52 user nova-compute[75165]: iSNS:
Oct 26 00:14:52 user nova-compute[75165]: No targets found.
Oct 26 00:14:52 user nova-compute[75165]: STATIC:
Oct 26 00:14:52 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b
Oct 26 00:14:52 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:14:52 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:14:52 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:f8ecd4e8-862c-4129-8244-f361457dc5ea
Oct 26 00:14:52 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:14:52 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:14:52 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b
Oct 26 00:14:52 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:14:52 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:14:52 user nova-compute[75165]: FIRMWARE:
Oct 26 00:14:52 user nova-compute[75165]: No targets found.
Oct 26 00:14:52 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:14:52 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9afd07b-3e34-4c9d-a9de-b8c1ac76a4ba tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 00:14:52 user nova-compute[75165]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 00:14:52 user nova-compute[75165]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75165) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 00:14:52 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9afd07b-3e34-4c9d-a9de-b8c1ac76a4ba tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f8ecd4e8-862c-4129-8244-f361457dc5ea', 0)] {{(pid=75165) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 00:14:52 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:14:52 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:14:52 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6355dde-ab58-4aff-ac97-20cac8c26cb5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f8ecd4e8-862c-4129-8244-f361457dc5ea\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:14:52 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:14:52 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:14:52 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f108438-296c-4817-b075-50645699e7ef]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8ecd4e8-862c-4129-8244-f361457dc5ea (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:14:52 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9afd07b-3e34-4c9d-a9de-b8c1ac76a4ba tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b (non-flash)
Oct 26 00:14:52 user nova-compute[75165]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b (non-flash)
Oct 26 00:14:52 user nova-compute[75165]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8ecd4e8-862c-4129-8244-f361457dc5ea (non-flash)
Oct 26 00:14:52 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:14:52 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9afd07b-3e34-4c9d-a9de-b8c1ac76a4ba tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b (non-flash)
Oct 26 00:14:52 user nova-compute[75165]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b (non-flash)
Oct 26 00:14:52 user nova-compute[75165]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8ecd4e8-862c-4129-8244-f361457dc5ea (non-flash)
Oct 26 00:14:52 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:14:52 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9afd07b-3e34-4c9d-a9de-b8c1ac76a4ba tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8be04ba830>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f8ecd4e8-862c-4129-8244-f361457dc5ea'): ({'sdb'}, set())}) {{(pid=75165) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 00:14:52 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-d9afd07b-3e34-4c9d-a9de-b8c1ac76a4ba tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Removing single pathed devices sdb {{(pid=75165) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 00:14:52 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:14:52 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:14:52 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[0af462c7-9309-4b2d-b5d2-b8cd22668a0c]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:14:52 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:14:52 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:14:52 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba568fdc-ef81-4a9e-a991-deeb41ee39af]: (4, ('ok\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:14:52 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-d9afd07b-3e34-4c9d-a9de-b8c1ac76a4ba tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Flushing IO for device /dev/sdb {{(pid=75165) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 00:14:52 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:14:52 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:14:52 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c860fc6-6d88-4fe3-85f2-0119d64e33ca]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:14:52 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-d9afd07b-3e34-4c9d-a9de-b8c1ac76a4ba tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75165) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 00:14:52 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:14:52 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:14:52 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f939909-71ec-4bfb-b320-d209d11b4098]: (4, ('1', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:14:52 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-d9afd07b-3e34-4c9d-a9de-b8c1ac76a4ba tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75165) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 00:14:52 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-d9afd07b-3e34-4c9d-a9de-b8c1ac76a4ba tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] SCSI volumes sdb have been removed. {{(pid=75165) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 00:14:52 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9afd07b-3e34-4c9d-a9de-b8c1ac76a4ba tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f8ecd4e8-862c-4129-8244-f361457dc5ea')] {{(pid=75165) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 00:14:52 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8ecd4e8-862c-4129-8244-f361457dc5ea -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:14:52 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8ecd4e8-862c-4129-8244-f361457dc5ea -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:14:52 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[1af19dd1-4060-46cb-9044-eac130a5857a]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:14:52 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9afd07b-3e34-4c9d-a9de-b8c1ac76a4ba tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:14:52 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8ecd4e8-862c-4129-8244-f361457dc5ea -p 172.16.0.220:3260 --logout {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:14:52 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8ecd4e8-862c-4129-8244-f361457dc5ea -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:14:52 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a625b3e-b5fb-4d22-bca2-5fb6bad0838c]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:f8ecd4e8-862c-4129-8244-f361457dc5ea, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:f8ecd4e8-862c-4129-8244-f361457dc5ea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:14:52 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9afd07b-3e34-4c9d-a9de-b8c1ac76a4ba tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:f8ecd4e8-862c-4129-8244-f361457dc5ea, portal: 172.16.0.220,3260]
Oct 26 00:14:52 user nova-compute[75165]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:f8ecd4e8-862c-4129-8244-f361457dc5ea, portal: 172.16.0.220,3260] successful.
Oct 26 00:14:52 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:14:52 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:14:52 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8ecd4e8-862c-4129-8244-f361457dc5ea -p 172.16.0.220:3260 --op delete {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:14:52 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8ecd4e8-862c-4129-8244-f361457dc5ea -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:14:52 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[63443559-ca64-4a19-95d0-96de6b85c0e8]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:14:52 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9afd07b-3e34-4c9d-a9de-b8c1ac76a4ba tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:14:52 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-d9afd07b-3e34-4c9d-a9de-b8c1ac76a4ba tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.352s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:14:52 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9afd07b-3e34-4c9d-a9de-b8c1ac76a4ba tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] <== disconnect_volume: return (355ms) None {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:14:52 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9afd07b-3e34-4c9d-a9de-b8c1ac76a4ba tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] [instance: 3150d249-37a2-49c6-837a-3828480fa2b4] Disconnected iSCSI Volume {{(pid=75165) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 00:14:53 user nova-compute[75165]: DEBUG nova.objects.instance [None req-d9afd07b-3e34-4c9d-a9de-b8c1ac76a4ba tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Lazy-loading 'flavor' on Instance uuid 3150d249-37a2-49c6-837a-3828480fa2b4 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:14:53 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-d9afd07b-3e34-4c9d-a9de-b8c1ac76a4ba tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Lock "3150d249-37a2-49c6-837a-3828480fa2b4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.347s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:14:57 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:15:01 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:15:01 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:15:02 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:15:03 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:15:03 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:15:04 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:15:05 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:15:05 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:15:05 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75165) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 00:15:06 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fdf8fc13-c390-43a6-9c71-afabde8d58ab tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] [instance: 8f8ec77f-bf35-4b15-bd77-9f8407b09d0b] Calling os-brick to attach iSCSI Volume {{(pid=75165) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 00:15:06 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdf8fc13-c390-43a6-9c71-afabde8d58ab tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8bf8160e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b6f63cee-1a4a-4ad6-8eb8-8c929951b7a7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dSOuGyDE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:15:06 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-fdf8fc13-c390-43a6-9c71-afabde8d58ab tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:15:06 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-fdf8fc13-c390-43a6-9c71-afabde8d58ab tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:15:06 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-fdf8fc13-c390-43a6-9c71-afabde8d58ab tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:15:06 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-fdf8fc13-c390-43a6-9c71-afabde8d58ab tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:15:06 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-fdf8fc13-c390-43a6-9c71-afabde8d58ab tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b6f63cee-1a4a-4ad6-8eb8-8c929951b7a7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:15:06 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-fdf8fc13-c390-43a6-9c71-afabde8d58ab tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b6f63cee-1a4a-4ad6-8eb8-8c929951b7a7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:15:06 user nova-compute[75165]: INFO os_brick.initiator.connectors.iscsi [None req-fdf8fc13-c390-43a6-9c71-afabde8d58ab tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 00:15:06 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6f63cee-1a4a-4ad6-8eb8-8c929951b7a7 -p 172.16.0.220:3260 {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:15:06 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6f63cee-1a4a-4ad6-8eb8-8c929951b7a7 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:15:06 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d9e5c8d-7be6-40c6-ac40-7b56bdeba601]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:15:06 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdf8fc13-c390-43a6-9c71-afabde8d58ab tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 00:15:06 user nova-compute[75165]:  {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:15:06 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6f63cee-1a4a-4ad6-8eb8-8c929951b7a7 -p 172.16.0.220:3260 --interface default --op new {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:15:06 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6f63cee-1a4a-4ad6-8eb8-8c929951b7a7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:15:06 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[38ce1155-88b9-4791-aedc-98f273ecd509]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b6f63cee-1a4a-4ad6-8eb8-8c929951b7a7] added\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:15:06 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdf8fc13-c390-43a6-9c71-afabde8d58ab tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b6f63cee-1a4a-4ad6-8eb8-8c929951b7a7] added
Oct 26 00:15:06 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:15:06 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6f63cee-1a4a-4ad6-8eb8-8c929951b7a7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:15:06 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6f63cee-1a4a-4ad6-8eb8-8c929951b7a7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:15:06 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eec9ab9-6d2b-43ae-a75f-89e258b3877b]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:15:06 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdf8fc13-c390-43a6-9c71-afabde8d58ab tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:15:06 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6f63cee-1a4a-4ad6-8eb8-8c929951b7a7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:15:06 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6f63cee-1a4a-4ad6-8eb8-8c929951b7a7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:15:06 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[8008d54c-7c65-4ae1-bb56-99b09fa21561]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:15:06 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdf8fc13-c390-43a6-9c71-afabde8d58ab tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:15:06 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6f63cee-1a4a-4ad6-8eb8-8c929951b7a7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dSOuGyDE {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:15:06 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6f63cee-1a4a-4ad6-8eb8-8c929951b7a7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dSOuGyDE" returned: 0 in 0.021s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:15:06 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[f31146dc-6862-460f-9fdf-b08f81983895]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:15:06 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdf8fc13-c390-43a6-9c71-afabde8d58ab tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dSOuGyDE'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:15:06 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6f63cee-1a4a-4ad6-8eb8-8c929951b7a7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:15:06 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6f63cee-1a4a-4ad6-8eb8-8c929951b7a7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:15:06 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[deec3e3f-21de-41d3-ab22-e4a75348d042]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:15:06 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdf8fc13-c390-43a6-9c71-afabde8d58ab tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:15:06 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:15:06 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:15:06 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[c792219f-d7a6-47a3-ac37-cb9aa7d6106a]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:15:06 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdf8fc13-c390-43a6-9c71-afabde8d58ab tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b (non-flash)
Oct 26 00:15:06 user nova-compute[75165]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b (non-flash)
Oct 26 00:15:06 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:15:06 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdf8fc13-c390-43a6-9c71-afabde8d58ab tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b (non-flash)
Oct 26 00:15:06 user nova-compute[75165]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b (non-flash)
Oct 26 00:15:06 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:15:06 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6f63cee-1a4a-4ad6-8eb8-8c929951b7a7 -p 172.16.0.220:3260 --login {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:15:06 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6f63cee-1a4a-4ad6-8eb8-8c929951b7a7 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:15:06 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[23c3e064-6881-4a5a-930a-6ea89ae99f84]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b6f63cee-1a4a-4ad6-8eb8-8c929951b7a7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b6f63cee-1a4a-4ad6-8eb8-8c929951b7a7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:15:06 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdf8fc13-c390-43a6-9c71-afabde8d58ab tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b6f63cee-1a4a-4ad6-8eb8-8c929951b7a7, portal: 172.16.0.220,3260]
Oct 26 00:15:06 user nova-compute[75165]: Login to [iface: default, target: iqn.2010-10.org.openstack:b6f63cee-1a4a-4ad6-8eb8-8c929951b7a7, portal: 172.16.0.220,3260] successful.
Oct 26 00:15:06 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:15:06 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6f63cee-1a4a-4ad6-8eb8-8c929951b7a7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:15:06 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6f63cee-1a4a-4ad6-8eb8-8c929951b7a7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:15:06 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b604d0f-502e-49c1-9529-c23feddf8e1e]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:15:06 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdf8fc13-c390-43a6-9c71-afabde8d58ab tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:15:06 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:15:06 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:15:06 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[491083bd-3450-4ab7-8be6-c423f851ab7f]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f63cee-1a4a-4ad6-8eb8-8c929951b7a7 (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:15:06 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdf8fc13-c390-43a6-9c71-afabde8d58ab tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b (non-flash)
Oct 26 00:15:06 user nova-compute[75165]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b (non-flash)
Oct 26 00:15:06 user nova-compute[75165]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f63cee-1a4a-4ad6-8eb8-8c929951b7a7 (non-flash)
Oct 26 00:15:06 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:15:06 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdf8fc13-c390-43a6-9c71-afabde8d58ab tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b (non-flash)
Oct 26 00:15:06 user nova-compute[75165]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b (non-flash)
Oct 26 00:15:06 user nova-compute[75165]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f63cee-1a4a-4ad6-8eb8-8c929951b7a7 (non-flash)
Oct 26 00:15:06 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:15:06 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-fdf8fc13-c390-43a6-9c71-afabde8d58ab tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b6f63cee-1a4a-4ad6-8eb8-8c929951b7a7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:15:06 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdf8fc13-c390-43a6-9c71-afabde8d58ab tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] Connected to 172.16.0.220:3260 {{(pid=75165) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 00:15:06 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-fdf8fc13-c390-43a6-9c71-afabde8d58ab tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] HCTL ('33', '-', '-', 0) found on session 19 with lun 0 {{(pid=75165) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 00:15:06 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-fdf8fc13-c390-43a6-9c71-afabde8d58ab tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75165) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 00:15:06 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:15:06 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:15:06 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbbd44b6-5fac-4e05-8526-81fdec1a1c28]: (4, ('- - 0', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:15:06 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-fdf8fc13-c390-43a6-9c71-afabde8d58ab tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] Searching for a device in session 19 and hctl ['33', '*', '*', 0] yield: None {{(pid=75165) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 00:15:06 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:15:06 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Starting heal instance info cache {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 00:15:06 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Rebuilding the list of instances to heal {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 00:15:06 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "refresh_cache-9633e6bb-5e95-4994-92a2-9d8f85a946ff" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:15:06 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquired lock "refresh_cache-9633e6bb-5e95-4994-92a2-9d8f85a946ff" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:15:06 user nova-compute[75165]: DEBUG nova.network.neutron [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: 9633e6bb-5e95-4994-92a2-9d8f85a946ff] Forcefully refreshing network info cache for instance {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 00:15:06 user nova-compute[75165]: DEBUG nova.objects.instance [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lazy-loading 'info_cache' on Instance uuid 9633e6bb-5e95-4994-92a2-9d8f85a946ff {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:15:07 user nova-compute[75165]: DEBUG nova.network.neutron [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: 9633e6bb-5e95-4994-92a2-9d8f85a946ff] Updating instance_info_cache with network_info: [{"id": "6beaf63f-0750-4c6a-b0bd-ebfbca211ad1", "address": "fa:16:3e:c1:5c:f3", "network": {"id": "6344595d-af28-41d8-9091-f7565d587f85", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-916895889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "410dcedc2c3c49c3990259eca1aee491", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6beaf63f-07", "ovs_interfaceid": "6beaf63f-0750-4c6a-b0bd-ebfbca211ad1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:15:07 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:15:07 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:15:07 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75165) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 00:15:07 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75165) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 00:15:07 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75165) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 00:15:07 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:15:07 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Releasing lock "refresh_cache-9633e6bb-5e95-4994-92a2-9d8f85a946ff" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:15:07 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: 9633e6bb-5e95-4994-92a2-9d8f85a946ff] Updated the network info_cache for instance {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 00:15:07 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:15:07 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:15:07 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:15:07 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:15:07 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:15:07 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75165) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 00:15:07 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9633e6bb-5e95-4994-92a2-9d8f85a946ff/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:15:07 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9633e6bb-5e95-4994-92a2-9d8f85a946ff/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:15:07 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9633e6bb-5e95-4994-92a2-9d8f85a946ff/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:15:07 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-fdf8fc13-c390-43a6-9c71-afabde8d58ab tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] Searching for a device in session 19 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75165) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 00:15:07 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdf8fc13-c390-43a6-9c71-afabde8d58ab tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:b6f63cee-1a4a-4ad6-8eb8-8c929951b7a7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dSOuGyDE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75165) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 00:15:07 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-fdf8fc13-c390-43a6-9c71-afabde8d58ab tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.342s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:15:07 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdf8fc13-c390-43a6-9c71-afabde8d58ab tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] <== connect_volume: return (1344ms) {'type': 'block', 'scsi_wwn': '23537376331616463', 'path': '/dev/sdb'} {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:15:07 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fdf8fc13-c390-43a6-9c71-afabde8d58ab tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] [instance: 8f8ec77f-bf35-4b15-bd77-9f8407b09d0b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23537376331616463', 'path': '/dev/sdb'} {{(pid=75165) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 00:15:07 user nova-compute[75165]: DEBUG nova.objects.instance [None req-fdf8fc13-c390-43a6-9c71-afabde8d58ab tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] Lazy-loading 'flavor' on Instance uuid 8f8ec77f-bf35-4b15-bd77-9f8407b09d0b {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:15:07 user nova-compute[75165]: DEBUG nova.virt.libvirt.guest [None req-fdf8fc13-c390-43a6-9c71-afabde8d58ab tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 00:15:07 user nova-compute[75165]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 00:15:07 user nova-compute[75165]:   <source dev="/dev/sdb"/>
Oct 26 00:15:07 user nova-compute[75165]:   <target dev="vdb" bus="virtio"/>
Oct 26 00:15:07 user nova-compute[75165]:   <serial>b6f63cee-1a4a-4ad6-8eb8-8c929951b7a7</serial>
Oct 26 00:15:07 user nova-compute[75165]: </disk>
Oct 26 00:15:07 user nova-compute[75165]:  {{(pid=75165) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 00:15:07 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9633e6bb-5e95-4994-92a2-9d8f85a946ff/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:15:07 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84c6b624-648b-40e2-a37e-ff08609bad84/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:15:08 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84c6b624-648b-40e2-a37e-ff08609bad84/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:15:08 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84c6b624-648b-40e2-a37e-ff08609bad84/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:15:08 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-fdf8fc13-c390-43a6-9c71-afabde8d58ab tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] No BDM found with device name vda, not building metadata. {{(pid=75165) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 00:15:08 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-fdf8fc13-c390-43a6-9c71-afabde8d58ab tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] No BDM found with device name hda, not building metadata. {{(pid=75165) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 00:15:08 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-fdf8fc13-c390-43a6-9c71-afabde8d58ab tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] No VIF found with MAC fa:16:3e:c8:5c:77, not building metadata {{(pid=75165) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 00:15:08 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84c6b624-648b-40e2-a37e-ff08609bad84/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:15:08 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7eeb145-1565-4812-818b-fefda5f2436d/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:15:08 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-fdf8fc13-c390-43a6-9c71-afabde8d58ab tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] Lock "8f8ec77f-bf35-4b15-bd77-9f8407b09d0b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 37.538s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:15:08 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7eeb145-1565-4812-818b-fefda5f2436d/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:15:08 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7eeb145-1565-4812-818b-fefda5f2436d/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:15:08 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7eeb145-1565-4812-818b-fefda5f2436d/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:15:08 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3150d249-37a2-49c6-837a-3828480fa2b4/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:15:08 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3150d249-37a2-49c6-837a-3828480fa2b4/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:15:08 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3150d249-37a2-49c6-837a-3828480fa2b4/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:15:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3150d249-37a2-49c6-837a-3828480fa2b4/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:15:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b9689c-5e83-4807-971f-5b244914b7e5/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:15:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b9689c-5e83-4807-971f-5b244914b7e5/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:15:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b9689c-5e83-4807-971f-5b244914b7e5/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:15:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b9689c-5e83-4807-971f-5b244914b7e5/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:15:09 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75165) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 00:15:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e44bfc-6a68-46ce-8335-aaaba5160d3e/disk.rescue --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:15:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e44bfc-6a68-46ce-8335-aaaba5160d3e/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:15:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e44bfc-6a68-46ce-8335-aaaba5160d3e/disk.rescue --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:15:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e44bfc-6a68-46ce-8335-aaaba5160d3e/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:15:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e44bfc-6a68-46ce-8335-aaaba5160d3e/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:15:09 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-49d3d1a9-50b6-4779-8d92-6544d3213d4e tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] Acquiring lock "8f8ec77f-bf35-4b15-bd77-9f8407b09d0b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:15:09 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-49d3d1a9-50b6-4779-8d92-6544d3213d4e tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] Lock "8f8ec77f-bf35-4b15-bd77-9f8407b09d0b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:15:09 user nova-compute[75165]: INFO nova.compute.manager [None req-49d3d1a9-50b6-4779-8d92-6544d3213d4e tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] [instance: 8f8ec77f-bf35-4b15-bd77-9f8407b09d0b] Detaching volume b6f63cee-1a4a-4ad6-8eb8-8c929951b7a7
Oct 26 00:15:10 user nova-compute[75165]: INFO nova.virt.block_device [None req-49d3d1a9-50b6-4779-8d92-6544d3213d4e tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] [instance: 8f8ec77f-bf35-4b15-bd77-9f8407b09d0b] Attempting to driver detach volume b6f63cee-1a4a-4ad6-8eb8-8c929951b7a7 from mountpoint /dev/vdb
Oct 26 00:15:10 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-49d3d1a9-50b6-4779-8d92-6544d3213d4e tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] Attempting to detach device vdb from instance 8f8ec77f-bf35-4b15-bd77-9f8407b09d0b from the persistent domain config. {{(pid=75165) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 00:15:10 user nova-compute[75165]: DEBUG nova.virt.libvirt.guest [None req-49d3d1a9-50b6-4779-8d92-6544d3213d4e tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 00:15:10 user nova-compute[75165]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 00:15:10 user nova-compute[75165]:   <source dev="/dev/sdb"/>
Oct 26 00:15:10 user nova-compute[75165]:   <target dev="vdb" bus="virtio"/>
Oct 26 00:15:10 user nova-compute[75165]:   <serial>b6f63cee-1a4a-4ad6-8eb8-8c929951b7a7</serial>
Oct 26 00:15:10 user nova-compute[75165]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 26 00:15:10 user nova-compute[75165]: </disk>
Oct 26 00:15:10 user nova-compute[75165]:  {{(pid=75165) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 00:15:10 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-49d3d1a9-50b6-4779-8d92-6544d3213d4e tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] Successfully detached device vdb from instance 8f8ec77f-bf35-4b15-bd77-9f8407b09d0b from the persistent domain config.
Oct 26 00:15:10 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-49d3d1a9-50b6-4779-8d92-6544d3213d4e tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8f8ec77f-bf35-4b15-bd77-9f8407b09d0b from the live domain config. {{(pid=75165) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 00:15:10 user nova-compute[75165]: DEBUG nova.virt.libvirt.guest [None req-49d3d1a9-50b6-4779-8d92-6544d3213d4e tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 00:15:10 user nova-compute[75165]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 00:15:10 user nova-compute[75165]:   <source dev="/dev/sdb"/>
Oct 26 00:15:10 user nova-compute[75165]:   <target dev="vdb" bus="virtio"/>
Oct 26 00:15:10 user nova-compute[75165]:   <serial>b6f63cee-1a4a-4ad6-8eb8-8c929951b7a7</serial>
Oct 26 00:15:10 user nova-compute[75165]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 26 00:15:10 user nova-compute[75165]: </disk>
Oct 26 00:15:10 user nova-compute[75165]:  {{(pid=75165) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 00:15:10 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e44bfc-6a68-46ce-8335-aaaba5160d3e/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:15:10 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e44bfc-6a68-46ce-8335-aaaba5160d3e/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:15:10 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e44bfc-6a68-46ce-8335-aaaba5160d3e/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:15:10 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27fa1771-fb69-49da-81b3-7f112e623170/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:15:10 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27fa1771-fb69-49da-81b3-7f112e623170/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:15:10 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27fa1771-fb69-49da-81b3-7f112e623170/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:15:10 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-49d3d1a9-50b6-4779-8d92-6544d3213d4e tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8f8ec77f-bf35-4b15-bd77-9f8407b09d0b {{(pid=75165) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 00:15:10 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27fa1771-fb69-49da-81b3-7f112e623170/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:15:10 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b153af2-c93b-47d2-ae8c-76cfd44e384c/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:15:10 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b153af2-c93b-47d2-ae8c-76cfd44e384c/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:15:10 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b153af2-c93b-47d2-ae8c-76cfd44e384c/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:15:11 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:15:11 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b153af2-c93b-47d2-ae8c-76cfd44e384c/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:15:11 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75165) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 00:15:11 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f8ec77f-bf35-4b15-bd77-9f8407b09d0b/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:15:11 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f8ec77f-bf35-4b15-bd77-9f8407b09d0b/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:15:11 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f8ec77f-bf35-4b15-bd77-9f8407b09d0b/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:15:11 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f8ec77f-bf35-4b15-bd77-9f8407b09d0b/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:15:11 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b041e0af-4635-495c-b72d-fbbbd8d43a9b/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:15:11 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b041e0af-4635-495c-b72d-fbbbd8d43a9b/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:15:11 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b041e0af-4635-495c-b72d-fbbbd8d43a9b/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:15:11 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b041e0af-4635-495c-b72d-fbbbd8d43a9b/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:15:12 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:15:12 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:15:12 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Hypervisor/Node resource view: name=user free_ram=7379MB free_disk=25.075057983398438GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75165) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 00:15:12 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:15:12 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:15:12 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:15:12 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 9633e6bb-5e95-4994-92a2-9d8f85a946ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:15:12 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 84c6b624-648b-40e2-a37e-ff08609bad84 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:15:12 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance c4e44bfc-6a68-46ce-8335-aaaba5160d3e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:15:12 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance a7eeb145-1565-4812-818b-fefda5f2436d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:15:12 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 22b9689c-5e83-4807-971f-5b244914b7e5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:15:12 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 3b153af2-c93b-47d2-ae8c-76cfd44e384c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:15:12 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 3150d249-37a2-49c6-837a-3828480fa2b4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:15:12 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 8f8ec77f-bf35-4b15-bd77-9f8407b09d0b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:15:12 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 27fa1771-fb69-49da-81b3-7f112e623170 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:15:12 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance b041e0af-4635-495c-b72d-fbbbd8d43a9b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:15:12 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75165) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 00:15:12 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75165) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 00:15:12 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:15:12 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:15:12 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Compute_service record updated for user:user {{(pid=75165) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 00:15:12 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.535s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:15:13 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:15:16 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:15:17 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:15:21 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:15:22 user nova-compute[75165]: DEBUG nova.compute.manager [req-4a9cbd62-edae-4a2d-ac1c-04c4c1bf0bf1 req-54b64bb6-4933-452c-8520-fd3d224aa912 service nova] [instance: 27fa1771-fb69-49da-81b3-7f112e623170] Received event network-changed-4d97651b-5d7c-4778-85a4-a11588892b31 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:15:22 user nova-compute[75165]: DEBUG nova.compute.manager [req-4a9cbd62-edae-4a2d-ac1c-04c4c1bf0bf1 req-54b64bb6-4933-452c-8520-fd3d224aa912 service nova] [instance: 27fa1771-fb69-49da-81b3-7f112e623170] Refreshing instance network info cache due to event network-changed-4d97651b-5d7c-4778-85a4-a11588892b31. {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 00:15:22 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-4a9cbd62-edae-4a2d-ac1c-04c4c1bf0bf1 req-54b64bb6-4933-452c-8520-fd3d224aa912 service nova] Acquiring lock "refresh_cache-27fa1771-fb69-49da-81b3-7f112e623170" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:15:22 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-4a9cbd62-edae-4a2d-ac1c-04c4c1bf0bf1 req-54b64bb6-4933-452c-8520-fd3d224aa912 service nova] Acquired lock "refresh_cache-27fa1771-fb69-49da-81b3-7f112e623170" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:15:22 user nova-compute[75165]: DEBUG nova.network.neutron [req-4a9cbd62-edae-4a2d-ac1c-04c4c1bf0bf1 req-54b64bb6-4933-452c-8520-fd3d224aa912 service nova] [instance: 27fa1771-fb69-49da-81b3-7f112e623170] Refreshing network info cache for port 4d97651b-5d7c-4778-85a4-a11588892b31 {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 00:15:22 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:15:23 user nova-compute[75165]: DEBUG nova.network.neutron [req-4a9cbd62-edae-4a2d-ac1c-04c4c1bf0bf1 req-54b64bb6-4933-452c-8520-fd3d224aa912 service nova] [instance: 27fa1771-fb69-49da-81b3-7f112e623170] Updated VIF entry in instance network info cache for port 4d97651b-5d7c-4778-85a4-a11588892b31. {{(pid=75165) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 00:15:23 user nova-compute[75165]: DEBUG nova.network.neutron [req-4a9cbd62-edae-4a2d-ac1c-04c4c1bf0bf1 req-54b64bb6-4933-452c-8520-fd3d224aa912 service nova] [instance: 27fa1771-fb69-49da-81b3-7f112e623170] Updating instance_info_cache with network_info: [{"id": "4d97651b-5d7c-4778-85a4-a11588892b31", "address": "fa:16:3e:c5:bb:76", "network": {"id": "7e330392-6256-405b-ab37-0b8af0c4fd48", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-430326049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ffbf5c944914cafac7aba65fb7ca402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d97651b-5d", "ovs_interfaceid": "4d97651b-5d7c-4778-85a4-a11588892b31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:15:23 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-a3b5280e-9027-4190-ba6e-d86f6aa45354 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Acquiring lock "3c7002e2-b98f-48e4-b099-9c8b756fd0ae" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:15:23 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-a3b5280e-9027-4190-ba6e-d86f6aa45354 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Lock "3c7002e2-b98f-48e4-b099-9c8b756fd0ae" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:15:23 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-4a9cbd62-edae-4a2d-ac1c-04c4c1bf0bf1 req-54b64bb6-4933-452c-8520-fd3d224aa912 service nova] Releasing lock "refresh_cache-27fa1771-fb69-49da-81b3-7f112e623170" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:15:23 user nova-compute[75165]: DEBUG nova.compute.manager [None req-a3b5280e-9027-4190-ba6e-d86f6aa45354 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] [instance: 3c7002e2-b98f-48e4-b099-9c8b756fd0ae] Starting instance... {{(pid=75165) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 00:15:23 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-a3b5280e-9027-4190-ba6e-d86f6aa45354 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:15:23 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-a3b5280e-9027-4190-ba6e-d86f6aa45354 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:15:23 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-a3b5280e-9027-4190-ba6e-d86f6aa45354 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75165) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 00:15:23 user nova-compute[75165]: INFO nova.compute.claims [None req-a3b5280e-9027-4190-ba6e-d86f6aa45354 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] [instance: 3c7002e2-b98f-48e4-b099-9c8b756fd0ae] Claim successful on node user
Oct 26 00:15:26 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:15:26 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-a3b5280e-9027-4190-ba6e-d86f6aa45354 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:15:26 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-a3b5280e-9027-4190-ba6e-d86f6aa45354 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:15:26 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-a3b5280e-9027-4190-ba6e-d86f6aa45354 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.920s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:15:26 user nova-compute[75165]: DEBUG nova.compute.manager [None req-a3b5280e-9027-4190-ba6e-d86f6aa45354 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] [instance: 3c7002e2-b98f-48e4-b099-9c8b756fd0ae] Start building networks asynchronously for instance. {{(pid=75165) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 00:15:26 user nova-compute[75165]: DEBUG nova.compute.manager [None req-a3b5280e-9027-4190-ba6e-d86f6aa45354 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] [instance: 3c7002e2-b98f-48e4-b099-9c8b756fd0ae] Allocating IP information in the background. {{(pid=75165) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 00:15:26 user nova-compute[75165]: DEBUG nova.network.neutron [None req-a3b5280e-9027-4190-ba6e-d86f6aa45354 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] [instance: 3c7002e2-b98f-48e4-b099-9c8b756fd0ae] allocate_for_instance() {{(pid=75165) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 00:15:26 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-a3b5280e-9027-4190-ba6e-d86f6aa45354 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] [instance: 3c7002e2-b98f-48e4-b099-9c8b756fd0ae] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 00:15:26 user nova-compute[75165]: DEBUG nova.compute.manager [None req-a3b5280e-9027-4190-ba6e-d86f6aa45354 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] [instance: 3c7002e2-b98f-48e4-b099-9c8b756fd0ae] Start building block device mappings for instance. {{(pid=75165) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 00:15:26 user nova-compute[75165]: DEBUG nova.policy [None req-a3b5280e-9027-4190-ba6e-d86f6aa45354 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2c153a25012b42d1869aacee733c754b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7043dc6e5575484b8747c13d3928f717', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75165) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 00:15:26 user nova-compute[75165]: DEBUG nova.compute.manager [None req-a3b5280e-9027-4190-ba6e-d86f6aa45354 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] [instance: 3c7002e2-b98f-48e4-b099-9c8b756fd0ae] Start spawning the instance on the hypervisor. {{(pid=75165) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 00:15:26 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-a3b5280e-9027-4190-ba6e-d86f6aa45354 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] [instance: 3c7002e2-b98f-48e4-b099-9c8b756fd0ae] Creating instance directory {{(pid=75165) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 00:15:26 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-a3b5280e-9027-4190-ba6e-d86f6aa45354 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] [instance: 3c7002e2-b98f-48e4-b099-9c8b756fd0ae] Creating image(s)
Oct 26 00:15:26 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-a3b5280e-9027-4190-ba6e-d86f6aa45354 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Acquiring lock "/opt/stack/data/nova/instances/3c7002e2-b98f-48e4-b099-9c8b756fd0ae/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:15:26 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-a3b5280e-9027-4190-ba6e-d86f6aa45354 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Lock "/opt/stack/data/nova/instances/3c7002e2-b98f-48e4-b099-9c8b756fd0ae/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:15:26 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-a3b5280e-9027-4190-ba6e-d86f6aa45354 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Lock "/opt/stack/data/nova/instances/3c7002e2-b98f-48e4-b099-9c8b756fd0ae/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:15:26 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-a3b5280e-9027-4190-ba6e-d86f6aa45354 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:15:27 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-a3b5280e-9027-4190-ba6e-d86f6aa45354 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json" returned: 0 in 0.244s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:15:27 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-a3b5280e-9027-4190-ba6e-d86f6aa45354 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Acquiring lock "7d3243421cf3fdc288b758f687a93103b7b95466" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:15:27 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-a3b5280e-9027-4190-ba6e-d86f6aa45354 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Lock "7d3243421cf3fdc288b758f687a93103b7b95466" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:15:27 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-a3b5280e-9027-4190-ba6e-d86f6aa45354 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:15:27 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:15:27 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-a3b5280e-9027-4190-ba6e-d86f6aa45354 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json" returned: 0 in 0.190s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:15:27 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-a3b5280e-9027-4190-ba6e-d86f6aa45354 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466,backing_fmt=raw /opt/stack/data/nova/instances/3c7002e2-b98f-48e4-b099-9c8b756fd0ae/disk 1073741824 {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:15:27 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-a3b5280e-9027-4190-ba6e-d86f6aa45354 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466,backing_fmt=raw /opt/stack/data/nova/instances/3c7002e2-b98f-48e4-b099-9c8b756fd0ae/disk 1073741824" returned: 0 in 0.060s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:15:27 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-a3b5280e-9027-4190-ba6e-d86f6aa45354 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Lock "7d3243421cf3fdc288b758f687a93103b7b95466" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.258s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:15:27 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-a3b5280e-9027-4190-ba6e-d86f6aa45354 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:15:27 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-a3b5280e-9027-4190-ba6e-d86f6aa45354 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json" returned: 0 in 0.204s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:15:27 user nova-compute[75165]: DEBUG nova.virt.disk.api [None req-a3b5280e-9027-4190-ba6e-d86f6aa45354 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3c7002e2-b98f-48e4-b099-9c8b756fd0ae/disk. size=1073741824 {{(pid=75165) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 00:15:27 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-a3b5280e-9027-4190-ba6e-d86f6aa45354 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c7002e2-b98f-48e4-b099-9c8b756fd0ae/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:15:27 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-a3b5280e-9027-4190-ba6e-d86f6aa45354 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c7002e2-b98f-48e4-b099-9c8b756fd0ae/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:15:27 user nova-compute[75165]: DEBUG nova.virt.disk.api [None req-a3b5280e-9027-4190-ba6e-d86f6aa45354 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Cannot resize image /opt/stack/data/nova/instances/3c7002e2-b98f-48e4-b099-9c8b756fd0ae/disk to a smaller size. {{(pid=75165) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 00:15:27 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-a3b5280e-9027-4190-ba6e-d86f6aa45354 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] [instance: 3c7002e2-b98f-48e4-b099-9c8b756fd0ae] Created local disks {{(pid=75165) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 00:15:27 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-a3b5280e-9027-4190-ba6e-d86f6aa45354 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] [instance: 3c7002e2-b98f-48e4-b099-9c8b756fd0ae] Ensure instance console log exists: /opt/stack/data/nova/instances/3c7002e2-b98f-48e4-b099-9c8b756fd0ae/console.log {{(pid=75165) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 00:15:27 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-a3b5280e-9027-4190-ba6e-d86f6aa45354 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:15:27 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-a3b5280e-9027-4190-ba6e-d86f6aa45354 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:15:27 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-a3b5280e-9027-4190-ba6e-d86f6aa45354 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:15:28 user nova-compute[75165]: DEBUG nova.network.neutron [None req-a3b5280e-9027-4190-ba6e-d86f6aa45354 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] [instance: 3c7002e2-b98f-48e4-b099-9c8b756fd0ae] Successfully created port: 17a39e49-7cac-4454-9957-6d0d0568fd5d {{(pid=75165) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 00:15:28 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:15:29 user nova-compute[75165]: DEBUG nova.network.neutron [None req-a3b5280e-9027-4190-ba6e-d86f6aa45354 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] [instance: 3c7002e2-b98f-48e4-b099-9c8b756fd0ae] Successfully updated port: 17a39e49-7cac-4454-9957-6d0d0568fd5d {{(pid=75165) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 00:15:29 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-a3b5280e-9027-4190-ba6e-d86f6aa45354 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Acquiring lock "refresh_cache-3c7002e2-b98f-48e4-b099-9c8b756fd0ae" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:15:29 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-a3b5280e-9027-4190-ba6e-d86f6aa45354 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Acquired lock "refresh_cache-3c7002e2-b98f-48e4-b099-9c8b756fd0ae" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:15:29 user nova-compute[75165]: DEBUG nova.network.neutron [None req-a3b5280e-9027-4190-ba6e-d86f6aa45354 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] [instance: 3c7002e2-b98f-48e4-b099-9c8b756fd0ae] Building network info cache for instance {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 00:15:29 user nova-compute[75165]: DEBUG nova.compute.manager [req-0dc59cd0-833e-4a97-a63a-3e147f07fb32 req-ce37743f-45d9-4260-94e7-e93f7b11a3a1 service nova] [instance: 3c7002e2-b98f-48e4-b099-9c8b756fd0ae] Received event network-changed-17a39e49-7cac-4454-9957-6d0d0568fd5d {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:15:29 user nova-compute[75165]: DEBUG nova.compute.manager [req-0dc59cd0-833e-4a97-a63a-3e147f07fb32 req-ce37743f-45d9-4260-94e7-e93f7b11a3a1 service nova] [instance: 3c7002e2-b98f-48e4-b099-9c8b756fd0ae] Refreshing instance network info cache due to event network-changed-17a39e49-7cac-4454-9957-6d0d0568fd5d. {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 00:15:29 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-0dc59cd0-833e-4a97-a63a-3e147f07fb32 req-ce37743f-45d9-4260-94e7-e93f7b11a3a1 service nova] Acquiring lock "refresh_cache-3c7002e2-b98f-48e4-b099-9c8b756fd0ae" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:15:29 user nova-compute[75165]: DEBUG nova.network.neutron [None req-a3b5280e-9027-4190-ba6e-d86f6aa45354 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] [instance: 3c7002e2-b98f-48e4-b099-9c8b756fd0ae] Instance cache missing network info. {{(pid=75165) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 00:15:29 user nova-compute[75165]: DEBUG nova.network.neutron [None req-a3b5280e-9027-4190-ba6e-d86f6aa45354 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] [instance: 3c7002e2-b98f-48e4-b099-9c8b756fd0ae] Updating instance_info_cache with network_info: [{"id": "17a39e49-7cac-4454-9957-6d0d0568fd5d", "address": "fa:16:3e:d6:78:e1", "network": {"id": "158a2f37-110c-4873-af74-f8c483280159", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1353815059-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7043dc6e5575484b8747c13d3928f717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17a39e49-7c", "ovs_interfaceid": "17a39e49-7cac-4454-9957-6d0d0568fd5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:15:29 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-a3b5280e-9027-4190-ba6e-d86f6aa45354 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Releasing lock "refresh_cache-3c7002e2-b98f-48e4-b099-9c8b756fd0ae" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:15:29 user nova-compute[75165]: DEBUG nova.compute.manager [None req-a3b5280e-9027-4190-ba6e-d86f6aa45354 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] [instance: 3c7002e2-b98f-48e4-b099-9c8b756fd0ae] Instance network_info: |[{"id": "17a39e49-7cac-4454-9957-6d0d0568fd5d", "address": "fa:16:3e:d6:78:e1", "network": {"id": "158a2f37-110c-4873-af74-f8c483280159", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1353815059-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7043dc6e5575484b8747c13d3928f717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17a39e49-7c", "ovs_interfaceid": "17a39e49-7cac-4454-9957-6d0d0568fd5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75165) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 00:15:29 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-0dc59cd0-833e-4a97-a63a-3e147f07fb32 req-ce37743f-45d9-4260-94e7-e93f7b11a3a1 service nova] Acquired lock "refresh_cache-3c7002e2-b98f-48e4-b099-9c8b756fd0ae" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:15:29 user nova-compute[75165]: DEBUG nova.network.neutron [req-0dc59cd0-833e-4a97-a63a-3e147f07fb32 req-ce37743f-45d9-4260-94e7-e93f7b11a3a1 service nova] [instance: 3c7002e2-b98f-48e4-b099-9c8b756fd0ae] Refreshing network info cache for port 17a39e49-7cac-4454-9957-6d0d0568fd5d {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 00:15:29 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-a3b5280e-9027-4190-ba6e-d86f6aa45354 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] [instance: 3c7002e2-b98f-48e4-b099-9c8b756fd0ae] Start _get_guest_xml network_info=[{"id": "17a39e49-7cac-4454-9957-6d0d0568fd5d", "address": "fa:16:3e:d6:78:e1", "network": {"id": "158a2f37-110c-4873-af74-f8c483280159", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1353815059-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7043dc6e5575484b8747c13d3928f717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17a39e49-7c", "ovs_interfaceid": "17a39e49-7cac-4454-9957-6d0d0568fd5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T00:03:24Z,direct_url=<?>,disk_format='qcow2',id=bff0d8a1-739e-4c4d-9efa-b73ba7b76d01,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e56bbf444fd34c348475c73673611447',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T00:03:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'size': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': 'bff0d8a1-739e-4c4d-9efa-b73ba7b76d01'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75165) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 00:15:29 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-a3b5280e-9027-4190-ba6e-d86f6aa45354 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:15:29 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-a3b5280e-9027-4190-ba6e-d86f6aa45354 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:15:29 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-a3b5280e-9027-4190-ba6e-d86f6aa45354 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75165) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 00:15:29 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-a3b5280e-9027-4190-ba6e-d86f6aa45354 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] CPU controller missing on host. {{(pid=75165) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 00:15:29 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-a3b5280e-9027-4190-ba6e-d86f6aa45354 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75165) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 00:15:29 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-a3b5280e-9027-4190-ba6e-d86f6aa45354 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] CPU controller found on host. {{(pid=75165) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 00:15:29 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-a3b5280e-9027-4190-ba6e-d86f6aa45354 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75165) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 00:15:29 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-a3b5280e-9027-4190-ba6e-d86f6aa45354 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T00:03:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T00:03:24Z,direct_url=<?>,disk_format='qcow2',id=bff0d8a1-739e-4c4d-9efa-b73ba7b76d01,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e56bbf444fd34c348475c73673611447',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T00:03:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 00:15:29 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-a3b5280e-9027-4190-ba6e-d86f6aa45354 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Flavor limits 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 00:15:29 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-a3b5280e-9027-4190-ba6e-d86f6aa45354 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Image limits 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 00:15:29 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-a3b5280e-9027-4190-ba6e-d86f6aa45354 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Flavor pref 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 00:15:29 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-a3b5280e-9027-4190-ba6e-d86f6aa45354 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Image pref 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 00:15:29 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-a3b5280e-9027-4190-ba6e-d86f6aa45354 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 00:15:29 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-a3b5280e-9027-4190-ba6e-d86f6aa45354 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 00:15:29 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-a3b5280e-9027-4190-ba6e-d86f6aa45354 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75165) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 00:15:29 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-a3b5280e-9027-4190-ba6e-d86f6aa45354 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Got 1 possible topologies {{(pid=75165) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 00:15:29 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-a3b5280e-9027-4190-ba6e-d86f6aa45354 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 00:15:29 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-a3b5280e-9027-4190-ba6e-d86f6aa45354 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 00:15:29 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-a3b5280e-9027-4190-ba6e-d86f6aa45354 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:15:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1009945819',display_name='tempest-VolumesAdminNegativeTest-server-1009945819',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1009945819',id=22,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7043dc6e5575484b8747c13d3928f717',ramdisk_id='',reservation_id='r-uub6gen7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1115603178',owner_user_name='tempest-VolumesAdminNegativeTest-1115603178-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T00:15:27Z,user_data=None,user_id='2c153a25012b42d1869aacee733c754b',uuid=3c7002e2-b98f-48e4-b099-9c8b756fd0ae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "17a39e49-7cac-4454-9957-6d0d0568fd5d", "address": "fa:16:3e:d6:78:e1", "network": {"id": "158a2f37-110c-4873-af74-f8c483280159", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1353815059-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7043dc6e5575484b8747c13d3928f717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17a39e49-7c", "ovs_interfaceid": "17a39e49-7cac-4454-9957-6d0d0568fd5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75165) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 00:15:29 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-a3b5280e-9027-4190-ba6e-d86f6aa45354 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Converting VIF {"id": "17a39e49-7cac-4454-9957-6d0d0568fd5d", "address": "fa:16:3e:d6:78:e1", "network": {"id": "158a2f37-110c-4873-af74-f8c483280159", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1353815059-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7043dc6e5575484b8747c13d3928f717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17a39e49-7c", "ovs_interfaceid": "17a39e49-7cac-4454-9957-6d0d0568fd5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:15:29 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-a3b5280e-9027-4190-ba6e-d86f6aa45354 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:78:e1,bridge_name='br-int',has_traffic_filtering=True,id=17a39e49-7cac-4454-9957-6d0d0568fd5d,network=Network(158a2f37-110c-4873-af74-f8c483280159),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17a39e49-7c') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:15:29 user nova-compute[75165]: DEBUG nova.objects.instance [None req-a3b5280e-9027-4190-ba6e-d86f6aa45354 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Lazy-loading 'pci_devices' on Instance uuid 3c7002e2-b98f-48e4-b099-9c8b756fd0ae {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:15:29 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-a3b5280e-9027-4190-ba6e-d86f6aa45354 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] [instance: 3c7002e2-b98f-48e4-b099-9c8b756fd0ae] End _get_guest_xml xml=<domain type="kvm">
Oct 26 00:15:29 user nova-compute[75165]:   <uuid>3c7002e2-b98f-48e4-b099-9c8b756fd0ae</uuid>
Oct 26 00:15:29 user nova-compute[75165]:   <name>instance-00000016</name>
Oct 26 00:15:29 user nova-compute[75165]:   <memory>524288</memory>
Oct 26 00:15:29 user nova-compute[75165]:   <vcpu>1</vcpu>
Oct 26 00:15:29 user nova-compute[75165]:   <metadata>
Oct 26 00:15:29 user nova-compute[75165]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 00:15:29 user nova-compute[75165]:       <nova:package version="0.0.0"/>
Oct 26 00:15:29 user nova-compute[75165]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1009945819</nova:name>
Oct 26 00:15:29 user nova-compute[75165]:       <nova:creationTime>2023-10-26 00:15:29</nova:creationTime>
Oct 26 00:15:29 user nova-compute[75165]:       <nova:flavor name="m1.tiny">
Oct 26 00:15:29 user nova-compute[75165]:         <nova:memory>512</nova:memory>
Oct 26 00:15:29 user nova-compute[75165]:         <nova:disk>1</nova:disk>
Oct 26 00:15:29 user nova-compute[75165]:         <nova:swap>0</nova:swap>
Oct 26 00:15:29 user nova-compute[75165]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 00:15:29 user nova-compute[75165]:         <nova:vcpus>1</nova:vcpus>
Oct 26 00:15:29 user nova-compute[75165]:       </nova:flavor>
Oct 26 00:15:29 user nova-compute[75165]:       <nova:owner>
Oct 26 00:15:29 user nova-compute[75165]:         <nova:user uuid="2c153a25012b42d1869aacee733c754b">tempest-VolumesAdminNegativeTest-1115603178-project-member</nova:user>
Oct 26 00:15:29 user nova-compute[75165]:         <nova:project uuid="7043dc6e5575484b8747c13d3928f717">tempest-VolumesAdminNegativeTest-1115603178</nova:project>
Oct 26 00:15:29 user nova-compute[75165]:       </nova:owner>
Oct 26 00:15:29 user nova-compute[75165]:       <nova:root type="image" uuid="bff0d8a1-739e-4c4d-9efa-b73ba7b76d01"/>
Oct 26 00:15:29 user nova-compute[75165]:       <nova:ports>
Oct 26 00:15:29 user nova-compute[75165]:         <nova:port uuid="17a39e49-7cac-4454-9957-6d0d0568fd5d">
Oct 26 00:15:29 user nova-compute[75165]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 26 00:15:29 user nova-compute[75165]:         </nova:port>
Oct 26 00:15:29 user nova-compute[75165]:       </nova:ports>
Oct 26 00:15:29 user nova-compute[75165]:     </nova:instance>
Oct 26 00:15:29 user nova-compute[75165]:   </metadata>
Oct 26 00:15:29 user nova-compute[75165]:   <sysinfo type="smbios">
Oct 26 00:15:29 user nova-compute[75165]:     <system>
Oct 26 00:15:29 user nova-compute[75165]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 00:15:29 user nova-compute[75165]:       <entry name="product">OpenStack Nova</entry>
Oct 26 00:15:29 user nova-compute[75165]:       <entry name="version">0.0.0</entry>
Oct 26 00:15:29 user nova-compute[75165]:       <entry name="serial">3c7002e2-b98f-48e4-b099-9c8b756fd0ae</entry>
Oct 26 00:15:29 user nova-compute[75165]:       <entry name="uuid">3c7002e2-b98f-48e4-b099-9c8b756fd0ae</entry>
Oct 26 00:15:29 user nova-compute[75165]:       <entry name="family">Virtual Machine</entry>
Oct 26 00:15:29 user nova-compute[75165]:     </system>
Oct 26 00:15:29 user nova-compute[75165]:   </sysinfo>
Oct 26 00:15:29 user nova-compute[75165]:   <os>
Oct 26 00:15:29 user nova-compute[75165]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 00:15:29 user nova-compute[75165]:     <boot dev="hd"/>
Oct 26 00:15:29 user nova-compute[75165]:     <smbios mode="sysinfo"/>
Oct 26 00:15:29 user nova-compute[75165]:   </os>
Oct 26 00:15:29 user nova-compute[75165]:   <features>
Oct 26 00:15:29 user nova-compute[75165]:     <acpi/>
Oct 26 00:15:29 user nova-compute[75165]:     <apic/>
Oct 26 00:15:29 user nova-compute[75165]:     <vmcoreinfo/>
Oct 26 00:15:29 user nova-compute[75165]:   </features>
Oct 26 00:15:29 user nova-compute[75165]:   <clock offset="utc">
Oct 26 00:15:29 user nova-compute[75165]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 00:15:29 user nova-compute[75165]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 00:15:29 user nova-compute[75165]:     <timer name="hpet" present="no"/>
Oct 26 00:15:29 user nova-compute[75165]:   </clock>
Oct 26 00:15:29 user nova-compute[75165]:   <cpu mode="custom" match="exact">
Oct 26 00:15:29 user nova-compute[75165]:     <model>Nehalem</model>
Oct 26 00:15:29 user nova-compute[75165]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 00:15:29 user nova-compute[75165]:   </cpu>
Oct 26 00:15:29 user nova-compute[75165]:   <devices>
Oct 26 00:15:29 user nova-compute[75165]:     <disk type="file" device="disk">
Oct 26 00:15:29 user nova-compute[75165]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 00:15:29 user nova-compute[75165]:       <source file="/opt/stack/data/nova/instances/3c7002e2-b98f-48e4-b099-9c8b756fd0ae/disk"/>
Oct 26 00:15:29 user nova-compute[75165]:       <target dev="vda" bus="virtio"/>
Oct 26 00:15:29 user nova-compute[75165]:     </disk>
Oct 26 00:15:29 user nova-compute[75165]:     <interface type="ethernet">
Oct 26 00:15:29 user nova-compute[75165]:       <mac address="fa:16:3e:d6:78:e1"/>
Oct 26 00:15:29 user nova-compute[75165]:       <model type="virtio"/>
Oct 26 00:15:29 user nova-compute[75165]:       <mtu size="1442"/>
Oct 26 00:15:29 user nova-compute[75165]:       <target dev="tap17a39e49-7c"/>
Oct 26 00:15:29 user nova-compute[75165]:     </interface>
Oct 26 00:15:29 user nova-compute[75165]:     <serial type="pty">
Oct 26 00:15:29 user nova-compute[75165]:       <log file="/opt/stack/data/nova/instances/3c7002e2-b98f-48e4-b099-9c8b756fd0ae/console.log" append="off"/>
Oct 26 00:15:29 user nova-compute[75165]:     </serial>
Oct 26 00:15:29 user nova-compute[75165]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 00:15:29 user nova-compute[75165]:     <video>
Oct 26 00:15:29 user nova-compute[75165]:       <model type="virtio"/>
Oct 26 00:15:29 user nova-compute[75165]:     </video>
Oct 26 00:15:29 user nova-compute[75165]:     <rng model="virtio">
Oct 26 00:15:29 user nova-compute[75165]:       <backend model="random">/dev/urandom</backend>
Oct 26 00:15:29 user nova-compute[75165]:     </rng>
Oct 26 00:15:29 user nova-compute[75165]:     <controller type="usb" index="0" model="none"/>
Oct 26 00:15:29 user nova-compute[75165]:     <memballoon model="virtio">
Oct 26 00:15:29 user nova-compute[75165]:       <stats period="10"/>
Oct 26 00:15:29 user nova-compute[75165]:     </memballoon>
Oct 26 00:15:29 user nova-compute[75165]:   </devices>
Oct 26 00:15:29 user nova-compute[75165]: </domain>
Oct 26 00:15:29 user nova-compute[75165]:  {{(pid=75165) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 00:15:29 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-a3b5280e-9027-4190-ba6e-d86f6aa45354 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:15:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1009945819',display_name='tempest-VolumesAdminNegativeTest-server-1009945819',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1009945819',id=22,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7043dc6e5575484b8747c13d3928f717',ramdisk_id='',reservation_id='r-uub6gen7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1115603178',owner_user_name='tempest-VolumesAdminNegativeTest-1115603178-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T00:15:27Z,user_data=None,user_id='2c153a25012b42d1869aacee733c754b',uuid=3c7002e2-b98f-48e4-b099-9c8b756fd0ae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "17a39e49-7cac-4454-9957-6d0d0568fd5d", "address": "fa:16:3e:d6:78:e1", "network": {"id": "158a2f37-110c-4873-af74-f8c483280159", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1353815059-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7043dc6e5575484b8747c13d3928f717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17a39e49-7c", "ovs_interfaceid": "17a39e49-7cac-4454-9957-6d0d0568fd5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 00:15:29 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-a3b5280e-9027-4190-ba6e-d86f6aa45354 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Converting VIF {"id": "17a39e49-7cac-4454-9957-6d0d0568fd5d", "address": "fa:16:3e:d6:78:e1", "network": {"id": "158a2f37-110c-4873-af74-f8c483280159", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1353815059-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7043dc6e5575484b8747c13d3928f717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17a39e49-7c", "ovs_interfaceid": "17a39e49-7cac-4454-9957-6d0d0568fd5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:15:29 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-a3b5280e-9027-4190-ba6e-d86f6aa45354 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:78:e1,bridge_name='br-int',has_traffic_filtering=True,id=17a39e49-7cac-4454-9957-6d0d0568fd5d,network=Network(158a2f37-110c-4873-af74-f8c483280159),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17a39e49-7c') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:15:29 user nova-compute[75165]: DEBUG os_vif [None req-a3b5280e-9027-4190-ba6e-d86f6aa45354 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:78:e1,bridge_name='br-int',has_traffic_filtering=True,id=17a39e49-7cac-4454-9957-6d0d0568fd5d,network=Network(158a2f37-110c-4873-af74-f8c483280159),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17a39e49-7c') {{(pid=75165) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 00:15:29 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:15:29 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:15:29 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 00:15:29 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:15:29 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c9d35be6-90e3-5bf6-9b87-36131f5d13b5', '_type': 'linux-noop'}}, row=False) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:15:29 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:15:29 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:15:29 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:15:29 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap17a39e49-7c, may_exist=True, interface_attrs={}) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:15:29 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap17a39e49-7c, col_values=(('qos', UUID('75ebeaa7-2020-4d2c-9485-49d37a33c74a')),), if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:15:29 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap17a39e49-7c, col_values=(('external_ids', {'iface-id': '17a39e49-7cac-4454-9957-6d0d0568fd5d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d6:78:e1', 'vm-uuid': '3c7002e2-b98f-48e4-b099-9c8b756fd0ae'}),), if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:15:29 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:15:29 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:15:29 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:15:29 user nova-compute[75165]: INFO os_vif [None req-a3b5280e-9027-4190-ba6e-d86f6aa45354 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:78:e1,bridge_name='br-int',has_traffic_filtering=True,id=17a39e49-7cac-4454-9957-6d0d0568fd5d,network=Network(158a2f37-110c-4873-af74-f8c483280159),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17a39e49-7c')
Oct 26 00:15:29 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-a3b5280e-9027-4190-ba6e-d86f6aa45354 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] No BDM found with device name vda, not building metadata. {{(pid=75165) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 00:15:29 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-a3b5280e-9027-4190-ba6e-d86f6aa45354 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] No VIF found with MAC fa:16:3e:d6:78:e1, not building metadata {{(pid=75165) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 00:15:30 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-959f0329-0952-4712-bb97-0675986b5c1b tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Acquiring lock "27fa1771-fb69-49da-81b3-7f112e623170" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:15:30 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-959f0329-0952-4712-bb97-0675986b5c1b tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Lock "27fa1771-fb69-49da-81b3-7f112e623170" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:15:30 user nova-compute[75165]: DEBUG nova.objects.instance [None req-959f0329-0952-4712-bb97-0675986b5c1b tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Lazy-loading 'flavor' on Instance uuid 27fa1771-fb69-49da-81b3-7f112e623170 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:15:30 user nova-compute[75165]: DEBUG nova.network.neutron [req-0dc59cd0-833e-4a97-a63a-3e147f07fb32 req-ce37743f-45d9-4260-94e7-e93f7b11a3a1 service nova] [instance: 3c7002e2-b98f-48e4-b099-9c8b756fd0ae] Updated VIF entry in instance network info cache for port 17a39e49-7cac-4454-9957-6d0d0568fd5d. {{(pid=75165) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 00:15:30 user nova-compute[75165]: DEBUG nova.network.neutron [req-0dc59cd0-833e-4a97-a63a-3e147f07fb32 req-ce37743f-45d9-4260-94e7-e93f7b11a3a1 service nova] [instance: 3c7002e2-b98f-48e4-b099-9c8b756fd0ae] Updating instance_info_cache with network_info: [{"id": "17a39e49-7cac-4454-9957-6d0d0568fd5d", "address": "fa:16:3e:d6:78:e1", "network": {"id": "158a2f37-110c-4873-af74-f8c483280159", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1353815059-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7043dc6e5575484b8747c13d3928f717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17a39e49-7c", "ovs_interfaceid": "17a39e49-7cac-4454-9957-6d0d0568fd5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:15:30 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-0dc59cd0-833e-4a97-a63a-3e147f07fb32 req-ce37743f-45d9-4260-94e7-e93f7b11a3a1 service nova] Releasing lock "refresh_cache-3c7002e2-b98f-48e4-b099-9c8b756fd0ae" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:15:30 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-959f0329-0952-4712-bb97-0675986b5c1b tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Lock "27fa1771-fb69-49da-81b3-7f112e623170" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.173s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:15:30 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-959f0329-0952-4712-bb97-0675986b5c1b tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Acquiring lock "27fa1771-fb69-49da-81b3-7f112e623170" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:15:30 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-959f0329-0952-4712-bb97-0675986b5c1b tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Lock "27fa1771-fb69-49da-81b3-7f112e623170" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:15:30 user nova-compute[75165]: INFO nova.compute.manager [None req-959f0329-0952-4712-bb97-0675986b5c1b tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] [instance: 27fa1771-fb69-49da-81b3-7f112e623170] Attaching volume f431d8b9-aa1e-46f5-b7da-39f4a550e050 to /dev/vdb
Oct 26 00:15:30 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-49d3d1a9-50b6-4779-8d92-6544d3213d4e tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 8f8ec77f-bf35-4b15-bd77-9f8407b09d0b is timed out.
Oct 26 00:15:30 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-49d3d1a9-50b6-4779-8d92-6544d3213d4e tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] Successfully detached device vdb from instance 8f8ec77f-bf35-4b15-bd77-9f8407b09d0b from the live domain config.
Oct 26 00:15:30 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49d3d1a9-50b6-4779-8d92-6544d3213d4e tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] [instance: 8f8ec77f-bf35-4b15-bd77-9f8407b09d0b] calling os-brick to detach iSCSI Volume {{(pid=75165) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 00:15:30 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d3d1a9-50b6-4779-8d92-6544d3213d4e tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8bf8160e50>, {'target_iqn': 'iqn.2010-10.org.openstack:b6f63cee-1a4a-4ad6-8eb8-8c929951b7a7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dSOuGyDE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:15:30 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-49d3d1a9-50b6-4779-8d92-6544d3213d4e tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:15:30 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-49d3d1a9-50b6-4779-8d92-6544d3213d4e tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:15:30 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-49d3d1a9-50b6-4779-8d92-6544d3213d4e tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:15:30 user nova-compute[75165]: DEBUG os_brick.utils [None req-959f0329-0952-4712-bb97-0675986b5c1b tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:15:30 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:15:30 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:15:30 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:15:30 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c21522b-f0f0-459e-b4f5-55c551498e9d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ecc2425e-330d-474e-93cb-d136fad65d1c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b6f63cee-1a4a-4ad6-8eb8-8c929951b7a7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:15:30 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d3d1a9-50b6-4779-8d92-6544d3213d4e tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 00:15:30 user nova-compute[75165]: No targets found.
Oct 26 00:15:30 user nova-compute[75165]: iSNS:
Oct 26 00:15:30 user nova-compute[75165]: No targets found.
Oct 26 00:15:30 user nova-compute[75165]: STATIC:
Oct 26 00:15:30 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b
Oct 26 00:15:30 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:15:30 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:15:30 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:ecc2425e-330d-474e-93cb-d136fad65d1c
Oct 26 00:15:30 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:15:30 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:15:30 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:b6f63cee-1a4a-4ad6-8eb8-8c929951b7a7
Oct 26 00:15:30 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:15:30 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:15:30 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b
Oct 26 00:15:30 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:15:30 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:15:30 user nova-compute[75165]: FIRMWARE:
Oct 26 00:15:30 user nova-compute[75165]: No targets found.
Oct 26 00:15:30 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:15:30 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d3d1a9-50b6-4779-8d92-6544d3213d4e tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 00:15:30 user nova-compute[75165]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 00:15:30 user nova-compute[75165]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75165) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 00:15:30 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d3d1a9-50b6-4779-8d92-6544d3213d4e tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b6f63cee-1a4a-4ad6-8eb8-8c929951b7a7', 0)] {{(pid=75165) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 00:15:30 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:15:30 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.023s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:15:30 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[536de0df-fd4a-4d36-b54e-1f69f81b1eed]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa94814ccb35\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:15:30 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:15:30 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.030s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:15:30 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[80684a1e-4a49-4e23-924b-a586cb430a06]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b6f63cee-1a4a-4ad6-8eb8-8c929951b7a7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ecc2425e-330d-474e-93cb-d136fad65d1c\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:15:30 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.028s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:15:30 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eab2ae8-51eb-494a-bfd3-0737b223665c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:15:30 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:15:30 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:15:30 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.025s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:15:30 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4c7b4c7-eb14-4116-82bf-9144599bcb09]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:15:30 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1215dc4-1f6e-4287-aea0-a8bd06c73c95]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:15:30 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-959f0329-0952-4712-bb97-0675986b5c1b tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Running cmd (subprocess): nvme version {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:15:30 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-959f0329-0952-4712-bb97-0675986b5c1b tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] 'nvme version' failed. Not Retrying. {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 00:15:30 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:15:30 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[09c71476-8036-4405-8868-9b4546031beb]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f63cee-1a4a-4ad6-8eb8-8c929951b7a7 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecc2425e-330d-474e-93cb-d136fad65d1c (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:15:30 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.nvmeof [None req-959f0329-0952-4712-bb97-0675986b5c1b tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] nvme not present on system {{(pid=75165) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 00:15:30 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d3d1a9-50b6-4779-8d92-6544d3213d4e tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b (non-flash)
Oct 26 00:15:30 user nova-compute[75165]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b (non-flash)
Oct 26 00:15:30 user nova-compute[75165]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f63cee-1a4a-4ad6-8eb8-8c929951b7a7 (non-flash)
Oct 26 00:15:30 user nova-compute[75165]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecc2425e-330d-474e-93cb-d136fad65d1c (non-flash)
Oct 26 00:15:30 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:15:30 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d3d1a9-50b6-4779-8d92-6544d3213d4e tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b (non-flash)
Oct 26 00:15:30 user nova-compute[75165]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b (non-flash)
Oct 26 00:15:30 user nova-compute[75165]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6f63cee-1a4a-4ad6-8eb8-8c929951b7a7 (non-flash)
Oct 26 00:15:30 user nova-compute[75165]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ecc2425e-330d-474e-93cb-d136fad65d1c (non-flash)
Oct 26 00:15:30 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:15:30 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d3d1a9-50b6-4779-8d92-6544d3213d4e tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8be04f1870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b6f63cee-1a4a-4ad6-8eb8-8c929951b7a7'): ({'sdb'}, set())}) {{(pid=75165) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 00:15:30 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-49d3d1a9-50b6-4779-8d92-6544d3213d4e tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] Removing single pathed devices sdb {{(pid=75165) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 00:15:30 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:15:30 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 00:15:30 user nova-compute[75165]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 00:15:30 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[fedde63f-8033-440c-a001-5f2f22098e86]: (4, '') {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:15:30 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:15:30 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-959f0329-0952-4712-bb97-0675986b5c1b tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75165) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 00:15:30 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-959f0329-0952-4712-bb97-0675986b5c1b tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75165) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 00:15:30 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-959f0329-0952-4712-bb97-0675986b5c1b tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] LIGHTOS: no hostnqn found. {{(pid=75165) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 00:15:30 user nova-compute[75165]: DEBUG os_brick.utils [None req-959f0329-0952-4712-bb97-0675986b5c1b tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] <== get_connector_properties: return (194ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa94814ccb35', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:15:30 user nova-compute[75165]: DEBUG nova.virt.block_device [None req-959f0329-0952-4712-bb97-0675986b5c1b tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] [instance: 27fa1771-fb69-49da-81b3-7f112e623170] Updating existing volume attachment record: 5529af8a-03d2-434d-bc0e-2c527746b289 {{(pid=75165) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 00:15:30 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.040s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:15:30 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bdfa5e6-87ff-4a54-bf78-a05d45530593]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:15:30 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:15:30 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.027s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:15:30 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[83c8a32f-107d-441c-b6e2-4fe3c32a25a9]: (4, ('ok\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:15:30 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-49d3d1a9-50b6-4779-8d92-6544d3213d4e tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] Flushing IO for device /dev/sdb {{(pid=75165) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 00:15:30 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:15:30 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.026s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:15:30 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[670bf16d-0a00-4b17-9a7d-bc7a5d4f95f2]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:15:30 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-49d3d1a9-50b6-4779-8d92-6544d3213d4e tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75165) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 00:15:30 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:15:30 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.056s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:15:30 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bfa5556-856b-4717-b416-1a53a20e3a99]: (4, ('1', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:15:30 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-49d3d1a9-50b6-4779-8d92-6544d3213d4e tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75165) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 00:15:30 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-49d3d1a9-50b6-4779-8d92-6544d3213d4e tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] SCSI volumes sdb have been removed. {{(pid=75165) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 00:15:30 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d3d1a9-50b6-4779-8d92-6544d3213d4e tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b6f63cee-1a4a-4ad6-8eb8-8c929951b7a7')] {{(pid=75165) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 00:15:30 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6f63cee-1a4a-4ad6-8eb8-8c929951b7a7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:15:30 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6f63cee-1a4a-4ad6-8eb8-8c929951b7a7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.031s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:15:30 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[742da900-94e1-4fcc-8b94-cfb7c4ca6b64]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:15:30 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d3d1a9-50b6-4779-8d92-6544d3213d4e tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:15:30 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6f63cee-1a4a-4ad6-8eb8-8c929951b7a7 -p 172.16.0.220:3260 --logout {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:15:30 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6f63cee-1a4a-4ad6-8eb8-8c929951b7a7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:15:30 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dff67bc-e516-4229-98f2-ed65594084ea]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:b6f63cee-1a4a-4ad6-8eb8-8c929951b7a7, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:b6f63cee-1a4a-4ad6-8eb8-8c929951b7a7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:15:30 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d3d1a9-50b6-4779-8d92-6544d3213d4e tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:b6f63cee-1a4a-4ad6-8eb8-8c929951b7a7, portal: 172.16.0.220,3260]
Oct 26 00:15:30 user nova-compute[75165]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:b6f63cee-1a4a-4ad6-8eb8-8c929951b7a7, portal: 172.16.0.220,3260] successful.
Oct 26 00:15:30 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:15:30 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6f63cee-1a4a-4ad6-8eb8-8c929951b7a7 -p 172.16.0.220:3260 --op delete {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:15:31 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:15:31 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6f63cee-1a4a-4ad6-8eb8-8c929951b7a7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:15:31 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eb527bb-9d31-4081-a2c7-67349f20b4c5]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:15:31 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d3d1a9-50b6-4779-8d92-6544d3213d4e tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:15:31 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-49d3d1a9-50b6-4779-8d92-6544d3213d4e tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.497s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:15:31 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d3d1a9-50b6-4779-8d92-6544d3213d4e tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] <== disconnect_volume: return (499ms) None {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:15:31 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49d3d1a9-50b6-4779-8d92-6544d3213d4e tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] [instance: 8f8ec77f-bf35-4b15-bd77-9f8407b09d0b] Disconnected iSCSI Volume {{(pid=75165) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 00:15:31 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:15:31 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:15:31 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:15:31 user nova-compute[75165]: DEBUG nova.compute.manager [req-e8bc130f-440e-4fbb-8af9-95a8280e9daa req-96fa74fc-9df7-4cba-9c2e-30fe4abc8ae7 service nova] [instance: 3c7002e2-b98f-48e4-b099-9c8b756fd0ae] Received event network-vif-plugged-17a39e49-7cac-4454-9957-6d0d0568fd5d {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:15:31 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-e8bc130f-440e-4fbb-8af9-95a8280e9daa req-96fa74fc-9df7-4cba-9c2e-30fe4abc8ae7 service nova] Acquiring lock "3c7002e2-b98f-48e4-b099-9c8b756fd0ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:15:31 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-e8bc130f-440e-4fbb-8af9-95a8280e9daa req-96fa74fc-9df7-4cba-9c2e-30fe4abc8ae7 service nova] Lock "3c7002e2-b98f-48e4-b099-9c8b756fd0ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:15:31 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-e8bc130f-440e-4fbb-8af9-95a8280e9daa req-96fa74fc-9df7-4cba-9c2e-30fe4abc8ae7 service nova] Lock "3c7002e2-b98f-48e4-b099-9c8b756fd0ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:15:31 user nova-compute[75165]: DEBUG nova.compute.manager [req-e8bc130f-440e-4fbb-8af9-95a8280e9daa req-96fa74fc-9df7-4cba-9c2e-30fe4abc8ae7 service nova] [instance: 3c7002e2-b98f-48e4-b099-9c8b756fd0ae] No waiting events found dispatching network-vif-plugged-17a39e49-7cac-4454-9957-6d0d0568fd5d {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:15:31 user nova-compute[75165]: WARNING nova.compute.manager [req-e8bc130f-440e-4fbb-8af9-95a8280e9daa req-96fa74fc-9df7-4cba-9c2e-30fe4abc8ae7 service nova] [instance: 3c7002e2-b98f-48e4-b099-9c8b756fd0ae] Received unexpected event network-vif-plugged-17a39e49-7cac-4454-9957-6d0d0568fd5d for instance with vm_state building and task_state spawning.
Oct 26 00:15:31 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:15:31 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:15:33 user nova-compute[75165]: DEBUG nova.compute.manager [req-b0cc9402-1a1d-4442-ae79-625cf6a69926 req-bd76ef3d-829b-41f1-859d-d8ee6d6840f0 service nova] [instance: 3c7002e2-b98f-48e4-b099-9c8b756fd0ae] Received event network-vif-plugged-17a39e49-7cac-4454-9957-6d0d0568fd5d {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:15:33 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-b0cc9402-1a1d-4442-ae79-625cf6a69926 req-bd76ef3d-829b-41f1-859d-d8ee6d6840f0 service nova] Acquiring lock "3c7002e2-b98f-48e4-b099-9c8b756fd0ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:15:33 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-b0cc9402-1a1d-4442-ae79-625cf6a69926 req-bd76ef3d-829b-41f1-859d-d8ee6d6840f0 service nova] Lock "3c7002e2-b98f-48e4-b099-9c8b756fd0ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:15:33 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-b0cc9402-1a1d-4442-ae79-625cf6a69926 req-bd76ef3d-829b-41f1-859d-d8ee6d6840f0 service nova] Lock "3c7002e2-b98f-48e4-b099-9c8b756fd0ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:15:33 user nova-compute[75165]: DEBUG nova.compute.manager [req-b0cc9402-1a1d-4442-ae79-625cf6a69926 req-bd76ef3d-829b-41f1-859d-d8ee6d6840f0 service nova] [instance: 3c7002e2-b98f-48e4-b099-9c8b756fd0ae] No waiting events found dispatching network-vif-plugged-17a39e49-7cac-4454-9957-6d0d0568fd5d {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:15:33 user nova-compute[75165]: WARNING nova.compute.manager [req-b0cc9402-1a1d-4442-ae79-625cf6a69926 req-bd76ef3d-829b-41f1-859d-d8ee6d6840f0 service nova] [instance: 3c7002e2-b98f-48e4-b099-9c8b756fd0ae] Received unexpected event network-vif-plugged-17a39e49-7cac-4454-9957-6d0d0568fd5d for instance with vm_state building and task_state spawning.
Oct 26 00:15:34 user nova-compute[75165]: DEBUG nova.compute.manager [None req-a3b5280e-9027-4190-ba6e-d86f6aa45354 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] [instance: 3c7002e2-b98f-48e4-b099-9c8b756fd0ae] Instance event wait completed in 0 seconds for  {{(pid=75165) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 00:15:34 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-a3b5280e-9027-4190-ba6e-d86f6aa45354 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] [instance: 3c7002e2-b98f-48e4-b099-9c8b756fd0ae] Guest created on hypervisor {{(pid=75165) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 00:15:34 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: 3c7002e2-b98f-48e4-b099-9c8b756fd0ae] Instance spawned successfully.
Oct 26 00:15:34 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-a3b5280e-9027-4190-ba6e-d86f6aa45354 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] [instance: 3c7002e2-b98f-48e4-b099-9c8b756fd0ae] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 00:15:34 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-a3b5280e-9027-4190-ba6e-d86f6aa45354 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] [instance: 3c7002e2-b98f-48e4-b099-9c8b756fd0ae] Found default for hw_cdrom_bus of ide {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:15:34 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-a3b5280e-9027-4190-ba6e-d86f6aa45354 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] [instance: 3c7002e2-b98f-48e4-b099-9c8b756fd0ae] Found default for hw_disk_bus of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:15:34 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-a3b5280e-9027-4190-ba6e-d86f6aa45354 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] [instance: 3c7002e2-b98f-48e4-b099-9c8b756fd0ae] Found default for hw_input_bus of None {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:15:34 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-a3b5280e-9027-4190-ba6e-d86f6aa45354 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] [instance: 3c7002e2-b98f-48e4-b099-9c8b756fd0ae] Found default for hw_pointer_model of None {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:15:34 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-a3b5280e-9027-4190-ba6e-d86f6aa45354 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] [instance: 3c7002e2-b98f-48e4-b099-9c8b756fd0ae] Found default for hw_video_model of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:15:34 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-a3b5280e-9027-4190-ba6e-d86f6aa45354 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] [instance: 3c7002e2-b98f-48e4-b099-9c8b756fd0ae] Found default for hw_vif_model of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:15:34 user nova-compute[75165]: INFO nova.compute.manager [None req-a3b5280e-9027-4190-ba6e-d86f6aa45354 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] [instance: 3c7002e2-b98f-48e4-b099-9c8b756fd0ae] Took 7.41 seconds to spawn the instance on the hypervisor.
Oct 26 00:15:34 user nova-compute[75165]: DEBUG nova.compute.manager [None req-a3b5280e-9027-4190-ba6e-d86f6aa45354 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] [instance: 3c7002e2-b98f-48e4-b099-9c8b756fd0ae] Checking state {{(pid=75165) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 00:15:34 user nova-compute[75165]: INFO nova.compute.manager [None req-a3b5280e-9027-4190-ba6e-d86f6aa45354 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] [instance: 3c7002e2-b98f-48e4-b099-9c8b756fd0ae] Took 11.00 seconds to build instance.
Oct 26 00:15:34 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-a3b5280e-9027-4190-ba6e-d86f6aa45354 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Lock "3c7002e2-b98f-48e4-b099-9c8b756fd0ae" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.353s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:15:34 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:15:36 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:15:39 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:15:41 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:15:44 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:15:45 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:15:46 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-4329f469-20fd-4f07-ac1f-a1b123f7d0a9 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Acquiring lock "91fe894a-90a8-4545-9b27-91771554c4cb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:15:46 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-4329f469-20fd-4f07-ac1f-a1b123f7d0a9 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Lock "91fe894a-90a8-4545-9b27-91771554c4cb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.005s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:15:46 user nova-compute[75165]: DEBUG nova.compute.manager [None req-4329f469-20fd-4f07-ac1f-a1b123f7d0a9 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: 91fe894a-90a8-4545-9b27-91771554c4cb] Starting instance... {{(pid=75165) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 00:15:46 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-4329f469-20fd-4f07-ac1f-a1b123f7d0a9 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:15:46 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-4329f469-20fd-4f07-ac1f-a1b123f7d0a9 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:15:46 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-4329f469-20fd-4f07-ac1f-a1b123f7d0a9 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75165) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 00:15:46 user nova-compute[75165]: INFO nova.compute.claims [None req-4329f469-20fd-4f07-ac1f-a1b123f7d0a9 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: 91fe894a-90a8-4545-9b27-91771554c4cb] Claim successful on node user
Oct 26 00:15:47 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-4329f469-20fd-4f07-ac1f-a1b123f7d0a9 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:15:47 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-4329f469-20fd-4f07-ac1f-a1b123f7d0a9 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:15:47 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-4329f469-20fd-4f07-ac1f-a1b123f7d0a9 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.616s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:15:47 user nova-compute[75165]: DEBUG nova.compute.manager [None req-4329f469-20fd-4f07-ac1f-a1b123f7d0a9 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: 91fe894a-90a8-4545-9b27-91771554c4cb] Start building networks asynchronously for instance. {{(pid=75165) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 00:15:47 user nova-compute[75165]: DEBUG nova.compute.manager [None req-4329f469-20fd-4f07-ac1f-a1b123f7d0a9 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: 91fe894a-90a8-4545-9b27-91771554c4cb] Allocating IP information in the background. {{(pid=75165) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 00:15:47 user nova-compute[75165]: DEBUG nova.network.neutron [None req-4329f469-20fd-4f07-ac1f-a1b123f7d0a9 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: 91fe894a-90a8-4545-9b27-91771554c4cb] allocate_for_instance() {{(pid=75165) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 00:15:47 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-4329f469-20fd-4f07-ac1f-a1b123f7d0a9 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: 91fe894a-90a8-4545-9b27-91771554c4cb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 00:15:47 user nova-compute[75165]: DEBUG nova.compute.manager [None req-4329f469-20fd-4f07-ac1f-a1b123f7d0a9 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: 91fe894a-90a8-4545-9b27-91771554c4cb] Start building block device mappings for instance. {{(pid=75165) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 00:15:47 user nova-compute[75165]: DEBUG nova.policy [None req-4329f469-20fd-4f07-ac1f-a1b123f7d0a9 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '67876ca3211b47bc99af08436edeb91f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71aa69c0ea2d49e184e1e055ff3efa1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75165) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 00:15:47 user nova-compute[75165]: DEBUG nova.compute.manager [None req-4329f469-20fd-4f07-ac1f-a1b123f7d0a9 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: 91fe894a-90a8-4545-9b27-91771554c4cb] Start spawning the instance on the hypervisor. {{(pid=75165) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 00:15:47 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-4329f469-20fd-4f07-ac1f-a1b123f7d0a9 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: 91fe894a-90a8-4545-9b27-91771554c4cb] Creating instance directory {{(pid=75165) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 00:15:47 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-4329f469-20fd-4f07-ac1f-a1b123f7d0a9 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: 91fe894a-90a8-4545-9b27-91771554c4cb] Creating image(s)
Oct 26 00:15:47 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-4329f469-20fd-4f07-ac1f-a1b123f7d0a9 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Acquiring lock "/opt/stack/data/nova/instances/91fe894a-90a8-4545-9b27-91771554c4cb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:15:47 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-4329f469-20fd-4f07-ac1f-a1b123f7d0a9 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Lock "/opt/stack/data/nova/instances/91fe894a-90a8-4545-9b27-91771554c4cb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:15:47 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-4329f469-20fd-4f07-ac1f-a1b123f7d0a9 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Lock "/opt/stack/data/nova/instances/91fe894a-90a8-4545-9b27-91771554c4cb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:15:47 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-4329f469-20fd-4f07-ac1f-a1b123f7d0a9 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:15:48 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-4329f469-20fd-4f07-ac1f-a1b123f7d0a9 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json" returned: 0 in 0.242s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:15:48 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-4329f469-20fd-4f07-ac1f-a1b123f7d0a9 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Acquiring lock "7d3243421cf3fdc288b758f687a93103b7b95466" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:15:48 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-4329f469-20fd-4f07-ac1f-a1b123f7d0a9 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Lock "7d3243421cf3fdc288b758f687a93103b7b95466" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:15:48 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-4329f469-20fd-4f07-ac1f-a1b123f7d0a9 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:15:48 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-4329f469-20fd-4f07-ac1f-a1b123f7d0a9 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json" returned: 0 in 0.243s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:15:48 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-4329f469-20fd-4f07-ac1f-a1b123f7d0a9 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466,backing_fmt=raw /opt/stack/data/nova/instances/91fe894a-90a8-4545-9b27-91771554c4cb/disk 1073741824 {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:15:48 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-4329f469-20fd-4f07-ac1f-a1b123f7d0a9 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466,backing_fmt=raw /opt/stack/data/nova/instances/91fe894a-90a8-4545-9b27-91771554c4cb/disk 1073741824" returned: 0 in 0.060s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:15:48 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-4329f469-20fd-4f07-ac1f-a1b123f7d0a9 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Lock "7d3243421cf3fdc288b758f687a93103b7b95466" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.312s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:15:48 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-4329f469-20fd-4f07-ac1f-a1b123f7d0a9 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:15:48 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-4329f469-20fd-4f07-ac1f-a1b123f7d0a9 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json" returned: 0 in 0.229s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:15:48 user nova-compute[75165]: DEBUG nova.virt.disk.api [None req-4329f469-20fd-4f07-ac1f-a1b123f7d0a9 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Checking if we can resize image /opt/stack/data/nova/instances/91fe894a-90a8-4545-9b27-91771554c4cb/disk. size=1073741824 {{(pid=75165) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 00:15:48 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-4329f469-20fd-4f07-ac1f-a1b123f7d0a9 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91fe894a-90a8-4545-9b27-91771554c4cb/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:15:48 user nova-compute[75165]: DEBUG nova.network.neutron [None req-4329f469-20fd-4f07-ac1f-a1b123f7d0a9 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: 91fe894a-90a8-4545-9b27-91771554c4cb] Successfully created port: 67590aab-15ed-4684-abd7-64a5c0a9b3f5 {{(pid=75165) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 00:15:49 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-4329f469-20fd-4f07-ac1f-a1b123f7d0a9 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91fe894a-90a8-4545-9b27-91771554c4cb/disk --force-share --output=json" returned: 0 in 0.370s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:15:49 user nova-compute[75165]: DEBUG nova.virt.disk.api [None req-4329f469-20fd-4f07-ac1f-a1b123f7d0a9 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Cannot resize image /opt/stack/data/nova/instances/91fe894a-90a8-4545-9b27-91771554c4cb/disk to a smaller size. {{(pid=75165) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 00:15:49 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-4329f469-20fd-4f07-ac1f-a1b123f7d0a9 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: 91fe894a-90a8-4545-9b27-91771554c4cb] Created local disks {{(pid=75165) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 00:15:49 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-4329f469-20fd-4f07-ac1f-a1b123f7d0a9 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: 91fe894a-90a8-4545-9b27-91771554c4cb] Ensure instance console log exists: /opt/stack/data/nova/instances/91fe894a-90a8-4545-9b27-91771554c4cb/console.log {{(pid=75165) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 00:15:49 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-4329f469-20fd-4f07-ac1f-a1b123f7d0a9 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:15:49 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-4329f469-20fd-4f07-ac1f-a1b123f7d0a9 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:15:49 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-4329f469-20fd-4f07-ac1f-a1b123f7d0a9 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:15:49 user nova-compute[75165]: DEBUG nova.network.neutron [None req-4329f469-20fd-4f07-ac1f-a1b123f7d0a9 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: 91fe894a-90a8-4545-9b27-91771554c4cb] Successfully updated port: 67590aab-15ed-4684-abd7-64a5c0a9b3f5 {{(pid=75165) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 00:15:49 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-4329f469-20fd-4f07-ac1f-a1b123f7d0a9 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Acquiring lock "refresh_cache-91fe894a-90a8-4545-9b27-91771554c4cb" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:15:49 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-4329f469-20fd-4f07-ac1f-a1b123f7d0a9 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Acquired lock "refresh_cache-91fe894a-90a8-4545-9b27-91771554c4cb" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:15:49 user nova-compute[75165]: DEBUG nova.network.neutron [None req-4329f469-20fd-4f07-ac1f-a1b123f7d0a9 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: 91fe894a-90a8-4545-9b27-91771554c4cb] Building network info cache for instance {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 00:15:49 user nova-compute[75165]: DEBUG nova.compute.manager [req-1ac475ef-0e07-43d9-b52b-d4fe72d6a2ab req-f5f829d9-fe53-43d9-922f-1e97ddeb2638 service nova] [instance: 91fe894a-90a8-4545-9b27-91771554c4cb] Received event network-changed-67590aab-15ed-4684-abd7-64a5c0a9b3f5 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:15:49 user nova-compute[75165]: DEBUG nova.compute.manager [req-1ac475ef-0e07-43d9-b52b-d4fe72d6a2ab req-f5f829d9-fe53-43d9-922f-1e97ddeb2638 service nova] [instance: 91fe894a-90a8-4545-9b27-91771554c4cb] Refreshing instance network info cache due to event network-changed-67590aab-15ed-4684-abd7-64a5c0a9b3f5. {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 00:15:49 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-1ac475ef-0e07-43d9-b52b-d4fe72d6a2ab req-f5f829d9-fe53-43d9-922f-1e97ddeb2638 service nova] Acquiring lock "refresh_cache-91fe894a-90a8-4545-9b27-91771554c4cb" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:15:49 user nova-compute[75165]: DEBUG nova.network.neutron [None req-4329f469-20fd-4f07-ac1f-a1b123f7d0a9 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: 91fe894a-90a8-4545-9b27-91771554c4cb] Instance cache missing network info. {{(pid=75165) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 00:15:49 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:15:50 user nova-compute[75165]: DEBUG nova.network.neutron [None req-4329f469-20fd-4f07-ac1f-a1b123f7d0a9 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: 91fe894a-90a8-4545-9b27-91771554c4cb] Updating instance_info_cache with network_info: [{"id": "67590aab-15ed-4684-abd7-64a5c0a9b3f5", "address": "fa:16:3e:7a:ea:a8", "network": {"id": "b31bac4b-1951-4ca3-8682-f1f24de0a5c3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1323234642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71aa69c0ea2d49e184e1e055ff3efa1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67590aab-15", "ovs_interfaceid": "67590aab-15ed-4684-abd7-64a5c0a9b3f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:15:50 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-4329f469-20fd-4f07-ac1f-a1b123f7d0a9 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Releasing lock "refresh_cache-91fe894a-90a8-4545-9b27-91771554c4cb" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:15:50 user nova-compute[75165]: DEBUG nova.compute.manager [None req-4329f469-20fd-4f07-ac1f-a1b123f7d0a9 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: 91fe894a-90a8-4545-9b27-91771554c4cb] Instance network_info: |[{"id": "67590aab-15ed-4684-abd7-64a5c0a9b3f5", "address": "fa:16:3e:7a:ea:a8", "network": {"id": "b31bac4b-1951-4ca3-8682-f1f24de0a5c3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1323234642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71aa69c0ea2d49e184e1e055ff3efa1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67590aab-15", "ovs_interfaceid": "67590aab-15ed-4684-abd7-64a5c0a9b3f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75165) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 00:15:50 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-1ac475ef-0e07-43d9-b52b-d4fe72d6a2ab req-f5f829d9-fe53-43d9-922f-1e97ddeb2638 service nova] Acquired lock "refresh_cache-91fe894a-90a8-4545-9b27-91771554c4cb" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:15:50 user nova-compute[75165]: DEBUG nova.network.neutron [req-1ac475ef-0e07-43d9-b52b-d4fe72d6a2ab req-f5f829d9-fe53-43d9-922f-1e97ddeb2638 service nova] [instance: 91fe894a-90a8-4545-9b27-91771554c4cb] Refreshing network info cache for port 67590aab-15ed-4684-abd7-64a5c0a9b3f5 {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 00:15:50 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-4329f469-20fd-4f07-ac1f-a1b123f7d0a9 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: 91fe894a-90a8-4545-9b27-91771554c4cb] Start _get_guest_xml network_info=[{"id": "67590aab-15ed-4684-abd7-64a5c0a9b3f5", "address": "fa:16:3e:7a:ea:a8", "network": {"id": "b31bac4b-1951-4ca3-8682-f1f24de0a5c3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1323234642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71aa69c0ea2d49e184e1e055ff3efa1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67590aab-15", "ovs_interfaceid": "67590aab-15ed-4684-abd7-64a5c0a9b3f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T00:03:24Z,direct_url=<?>,disk_format='qcow2',id=bff0d8a1-739e-4c4d-9efa-b73ba7b76d01,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e56bbf444fd34c348475c73673611447',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T00:03:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'size': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': 'bff0d8a1-739e-4c4d-9efa-b73ba7b76d01'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75165) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 00:15:50 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-4329f469-20fd-4f07-ac1f-a1b123f7d0a9 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:15:50 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-4329f469-20fd-4f07-ac1f-a1b123f7d0a9 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:15:50 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-4329f469-20fd-4f07-ac1f-a1b123f7d0a9 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75165) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 00:15:50 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-4329f469-20fd-4f07-ac1f-a1b123f7d0a9 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] CPU controller missing on host. {{(pid=75165) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 00:15:50 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-4329f469-20fd-4f07-ac1f-a1b123f7d0a9 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75165) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 00:15:50 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-4329f469-20fd-4f07-ac1f-a1b123f7d0a9 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] CPU controller found on host. {{(pid=75165) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 00:15:50 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-4329f469-20fd-4f07-ac1f-a1b123f7d0a9 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75165) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 00:15:50 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-4329f469-20fd-4f07-ac1f-a1b123f7d0a9 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T00:03:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T00:03:24Z,direct_url=<?>,disk_format='qcow2',id=bff0d8a1-739e-4c4d-9efa-b73ba7b76d01,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e56bbf444fd34c348475c73673611447',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T00:03:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 00:15:50 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-4329f469-20fd-4f07-ac1f-a1b123f7d0a9 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Flavor limits 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 00:15:50 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-4329f469-20fd-4f07-ac1f-a1b123f7d0a9 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Image limits 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 00:15:50 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-4329f469-20fd-4f07-ac1f-a1b123f7d0a9 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Flavor pref 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 00:15:50 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-4329f469-20fd-4f07-ac1f-a1b123f7d0a9 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Image pref 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 00:15:50 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-4329f469-20fd-4f07-ac1f-a1b123f7d0a9 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 00:15:50 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-4329f469-20fd-4f07-ac1f-a1b123f7d0a9 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 00:15:50 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-4329f469-20fd-4f07-ac1f-a1b123f7d0a9 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75165) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 00:15:50 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-4329f469-20fd-4f07-ac1f-a1b123f7d0a9 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Got 1 possible topologies {{(pid=75165) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 00:15:50 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-4329f469-20fd-4f07-ac1f-a1b123f7d0a9 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 00:15:50 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-4329f469-20fd-4f07-ac1f-a1b123f7d0a9 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 00:15:50 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-4329f469-20fd-4f07-ac1f-a1b123f7d0a9 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:15:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1293782971',display_name='tempest-ServerRescueNegativeTestJSON-server-1293782971',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1293782971',id=23,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBicVhnhgJ5DNvonotHh5eL/FfSiR8puDkSZx2aq/ImVCudvj05xCLa3mBVFpugWErX29hnO7slb7sxcE+mwD9p4LdVUoCg84e+AG2ngoSo376olvea13D0Ut/PwRlNsAQ==',key_name='tempest-keypair-12008961',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='71aa69c0ea2d49e184e1e055ff3efa1d',ramdisk_id='',reservation_id='r-ciht86kf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2141505807',owner_user_name='tempest-ServerRescueNegativeTestJSON-2141505807-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T00:15:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='67876ca3211b47bc99af08436edeb91f',uuid=91fe894a-90a8-4545-9b27-91771554c4cb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "67590aab-15ed-4684-abd7-64a5c0a9b3f5", "address": "fa:16:3e:7a:ea:a8", "network": {"id": "b31bac4b-1951-4ca3-8682-f1f24de0a5c3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1323234642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71aa69c0ea2d49e184e1e055ff3efa1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67590aab-15", "ovs_interfaceid": "67590aab-15ed-4684-abd7-64a5c0a9b3f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75165) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 00:15:50 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-4329f469-20fd-4f07-ac1f-a1b123f7d0a9 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Converting VIF {"id": "67590aab-15ed-4684-abd7-64a5c0a9b3f5", "address": "fa:16:3e:7a:ea:a8", "network": {"id": "b31bac4b-1951-4ca3-8682-f1f24de0a5c3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1323234642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71aa69c0ea2d49e184e1e055ff3efa1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67590aab-15", "ovs_interfaceid": "67590aab-15ed-4684-abd7-64a5c0a9b3f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:15:50 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-4329f469-20fd-4f07-ac1f-a1b123f7d0a9 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:ea:a8,bridge_name='br-int',has_traffic_filtering=True,id=67590aab-15ed-4684-abd7-64a5c0a9b3f5,network=Network(b31bac4b-1951-4ca3-8682-f1f24de0a5c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67590aab-15') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:15:50 user nova-compute[75165]: DEBUG nova.objects.instance [None req-4329f469-20fd-4f07-ac1f-a1b123f7d0a9 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Lazy-loading 'pci_devices' on Instance uuid 91fe894a-90a8-4545-9b27-91771554c4cb {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:15:50 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-4329f469-20fd-4f07-ac1f-a1b123f7d0a9 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: 91fe894a-90a8-4545-9b27-91771554c4cb] End _get_guest_xml xml=<domain type="kvm">
Oct 26 00:15:50 user nova-compute[75165]:   <uuid>91fe894a-90a8-4545-9b27-91771554c4cb</uuid>
Oct 26 00:15:50 user nova-compute[75165]:   <name>instance-00000017</name>
Oct 26 00:15:50 user nova-compute[75165]:   <memory>524288</memory>
Oct 26 00:15:50 user nova-compute[75165]:   <vcpu>1</vcpu>
Oct 26 00:15:50 user nova-compute[75165]:   <metadata>
Oct 26 00:15:50 user nova-compute[75165]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 00:15:50 user nova-compute[75165]:       <nova:package version="0.0.0"/>
Oct 26 00:15:50 user nova-compute[75165]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1293782971</nova:name>
Oct 26 00:15:50 user nova-compute[75165]:       <nova:creationTime>2023-10-26 00:15:50</nova:creationTime>
Oct 26 00:15:50 user nova-compute[75165]:       <nova:flavor name="m1.tiny">
Oct 26 00:15:50 user nova-compute[75165]:         <nova:memory>512</nova:memory>
Oct 26 00:15:50 user nova-compute[75165]:         <nova:disk>1</nova:disk>
Oct 26 00:15:50 user nova-compute[75165]:         <nova:swap>0</nova:swap>
Oct 26 00:15:50 user nova-compute[75165]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 00:15:50 user nova-compute[75165]:         <nova:vcpus>1</nova:vcpus>
Oct 26 00:15:50 user nova-compute[75165]:       </nova:flavor>
Oct 26 00:15:50 user nova-compute[75165]:       <nova:owner>
Oct 26 00:15:50 user nova-compute[75165]:         <nova:user uuid="67876ca3211b47bc99af08436edeb91f">tempest-ServerRescueNegativeTestJSON-2141505807-project-member</nova:user>
Oct 26 00:15:50 user nova-compute[75165]:         <nova:project uuid="71aa69c0ea2d49e184e1e055ff3efa1d">tempest-ServerRescueNegativeTestJSON-2141505807</nova:project>
Oct 26 00:15:50 user nova-compute[75165]:       </nova:owner>
Oct 26 00:15:50 user nova-compute[75165]:       <nova:root type="image" uuid="bff0d8a1-739e-4c4d-9efa-b73ba7b76d01"/>
Oct 26 00:15:50 user nova-compute[75165]:       <nova:ports>
Oct 26 00:15:50 user nova-compute[75165]:         <nova:port uuid="67590aab-15ed-4684-abd7-64a5c0a9b3f5">
Oct 26 00:15:50 user nova-compute[75165]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 26 00:15:50 user nova-compute[75165]:         </nova:port>
Oct 26 00:15:50 user nova-compute[75165]:       </nova:ports>
Oct 26 00:15:50 user nova-compute[75165]:     </nova:instance>
Oct 26 00:15:50 user nova-compute[75165]:   </metadata>
Oct 26 00:15:50 user nova-compute[75165]:   <sysinfo type="smbios">
Oct 26 00:15:50 user nova-compute[75165]:     <system>
Oct 26 00:15:50 user nova-compute[75165]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 00:15:50 user nova-compute[75165]:       <entry name="product">OpenStack Nova</entry>
Oct 26 00:15:50 user nova-compute[75165]:       <entry name="version">0.0.0</entry>
Oct 26 00:15:50 user nova-compute[75165]:       <entry name="serial">91fe894a-90a8-4545-9b27-91771554c4cb</entry>
Oct 26 00:15:50 user nova-compute[75165]:       <entry name="uuid">91fe894a-90a8-4545-9b27-91771554c4cb</entry>
Oct 26 00:15:50 user nova-compute[75165]:       <entry name="family">Virtual Machine</entry>
Oct 26 00:15:50 user nova-compute[75165]:     </system>
Oct 26 00:15:50 user nova-compute[75165]:   </sysinfo>
Oct 26 00:15:50 user nova-compute[75165]:   <os>
Oct 26 00:15:50 user nova-compute[75165]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 00:15:50 user nova-compute[75165]:     <boot dev="hd"/>
Oct 26 00:15:50 user nova-compute[75165]:     <smbios mode="sysinfo"/>
Oct 26 00:15:50 user nova-compute[75165]:   </os>
Oct 26 00:15:50 user nova-compute[75165]:   <features>
Oct 26 00:15:50 user nova-compute[75165]:     <acpi/>
Oct 26 00:15:50 user nova-compute[75165]:     <apic/>
Oct 26 00:15:50 user nova-compute[75165]:     <vmcoreinfo/>
Oct 26 00:15:50 user nova-compute[75165]:   </features>
Oct 26 00:15:50 user nova-compute[75165]:   <clock offset="utc">
Oct 26 00:15:50 user nova-compute[75165]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 00:15:50 user nova-compute[75165]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 00:15:50 user nova-compute[75165]:     <timer name="hpet" present="no"/>
Oct 26 00:15:50 user nova-compute[75165]:   </clock>
Oct 26 00:15:50 user nova-compute[75165]:   <cpu mode="custom" match="exact">
Oct 26 00:15:50 user nova-compute[75165]:     <model>Nehalem</model>
Oct 26 00:15:50 user nova-compute[75165]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 00:15:50 user nova-compute[75165]:   </cpu>
Oct 26 00:15:50 user nova-compute[75165]:   <devices>
Oct 26 00:15:50 user nova-compute[75165]:     <disk type="file" device="disk">
Oct 26 00:15:50 user nova-compute[75165]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 00:15:50 user nova-compute[75165]:       <source file="/opt/stack/data/nova/instances/91fe894a-90a8-4545-9b27-91771554c4cb/disk"/>
Oct 26 00:15:50 user nova-compute[75165]:       <target dev="vda" bus="virtio"/>
Oct 26 00:15:50 user nova-compute[75165]:     </disk>
Oct 26 00:15:50 user nova-compute[75165]:     <interface type="ethernet">
Oct 26 00:15:50 user nova-compute[75165]:       <mac address="fa:16:3e:7a:ea:a8"/>
Oct 26 00:15:50 user nova-compute[75165]:       <model type="virtio"/>
Oct 26 00:15:50 user nova-compute[75165]:       <mtu size="1442"/>
Oct 26 00:15:50 user nova-compute[75165]:       <target dev="tap67590aab-15"/>
Oct 26 00:15:50 user nova-compute[75165]:     </interface>
Oct 26 00:15:50 user nova-compute[75165]:     <serial type="pty">
Oct 26 00:15:50 user nova-compute[75165]:       <log file="/opt/stack/data/nova/instances/91fe894a-90a8-4545-9b27-91771554c4cb/console.log" append="off"/>
Oct 26 00:15:50 user nova-compute[75165]:     </serial>
Oct 26 00:15:50 user nova-compute[75165]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 00:15:50 user nova-compute[75165]:     <video>
Oct 26 00:15:50 user nova-compute[75165]:       <model type="virtio"/>
Oct 26 00:15:50 user nova-compute[75165]:     </video>
Oct 26 00:15:50 user nova-compute[75165]:     <rng model="virtio">
Oct 26 00:15:50 user nova-compute[75165]:       <backend model="random">/dev/urandom</backend>
Oct 26 00:15:50 user nova-compute[75165]:     </rng>
Oct 26 00:15:50 user nova-compute[75165]:     <controller type="usb" index="0" model="none"/>
Oct 26 00:15:50 user nova-compute[75165]:     <memballoon model="virtio">
Oct 26 00:15:50 user nova-compute[75165]:       <stats period="10"/>
Oct 26 00:15:50 user nova-compute[75165]:     </memballoon>
Oct 26 00:15:50 user nova-compute[75165]:   </devices>
Oct 26 00:15:50 user nova-compute[75165]: </domain>
Oct 26 00:15:50 user nova-compute[75165]:  {{(pid=75165) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 00:15:50 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-4329f469-20fd-4f07-ac1f-a1b123f7d0a9 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:15:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1293782971',display_name='tempest-ServerRescueNegativeTestJSON-server-1293782971',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1293782971',id=23,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBicVhnhgJ5DNvonotHh5eL/FfSiR8puDkSZx2aq/ImVCudvj05xCLa3mBVFpugWErX29hnO7slb7sxcE+mwD9p4LdVUoCg84e+AG2ngoSo376olvea13D0Ut/PwRlNsAQ==',key_name='tempest-keypair-12008961',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='71aa69c0ea2d49e184e1e055ff3efa1d',ramdisk_id='',reservation_id='r-ciht86kf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2141505807',owner_user_name='tempest-ServerRescueNegativeTestJSON-2141505807-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T00:15:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='67876ca3211b47bc99af08436edeb91f',uuid=91fe894a-90a8-4545-9b27-91771554c4cb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "67590aab-15ed-4684-abd7-64a5c0a9b3f5", "address": "fa:16:3e:7a:ea:a8", "network": {"id": "b31bac4b-1951-4ca3-8682-f1f24de0a5c3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1323234642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71aa69c0ea2d49e184e1e055ff3efa1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67590aab-15", "ovs_interfaceid": "67590aab-15ed-4684-abd7-64a5c0a9b3f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 00:15:50 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-4329f469-20fd-4f07-ac1f-a1b123f7d0a9 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Converting VIF {"id": "67590aab-15ed-4684-abd7-64a5c0a9b3f5", "address": "fa:16:3e:7a:ea:a8", "network": {"id": "b31bac4b-1951-4ca3-8682-f1f24de0a5c3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1323234642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71aa69c0ea2d49e184e1e055ff3efa1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67590aab-15", "ovs_interfaceid": "67590aab-15ed-4684-abd7-64a5c0a9b3f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:15:50 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-4329f469-20fd-4f07-ac1f-a1b123f7d0a9 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:ea:a8,bridge_name='br-int',has_traffic_filtering=True,id=67590aab-15ed-4684-abd7-64a5c0a9b3f5,network=Network(b31bac4b-1951-4ca3-8682-f1f24de0a5c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67590aab-15') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:15:50 user nova-compute[75165]: DEBUG os_vif [None req-4329f469-20fd-4f07-ac1f-a1b123f7d0a9 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:ea:a8,bridge_name='br-int',has_traffic_filtering=True,id=67590aab-15ed-4684-abd7-64a5c0a9b3f5,network=Network(b31bac4b-1951-4ca3-8682-f1f24de0a5c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67590aab-15') {{(pid=75165) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 00:15:50 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:15:50 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:15:50 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 00:15:50 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:15:50 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd3b81a97-21ad-50fd-806d-8f0748c58622', '_type': 'linux-noop'}}, row=False) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:15:50 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:15:50 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:15:50 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:15:50 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap67590aab-15, may_exist=True, interface_attrs={}) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:15:50 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap67590aab-15, col_values=(('qos', UUID('0bbf8d77-07bb-4c99-914b-0ecccb50e721')),), if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:15:50 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap67590aab-15, col_values=(('external_ids', {'iface-id': '67590aab-15ed-4684-abd7-64a5c0a9b3f5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7a:ea:a8', 'vm-uuid': '91fe894a-90a8-4545-9b27-91771554c4cb'}),), if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:15:50 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:15:50 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:15:50 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:15:50 user nova-compute[75165]: INFO os_vif [None req-4329f469-20fd-4f07-ac1f-a1b123f7d0a9 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:ea:a8,bridge_name='br-int',has_traffic_filtering=True,id=67590aab-15ed-4684-abd7-64a5c0a9b3f5,network=Network(b31bac4b-1951-4ca3-8682-f1f24de0a5c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67590aab-15')
Oct 26 00:15:50 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-4329f469-20fd-4f07-ac1f-a1b123f7d0a9 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] No BDM found with device name vda, not building metadata. {{(pid=75165) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 00:15:50 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-4329f469-20fd-4f07-ac1f-a1b123f7d0a9 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] No VIF found with MAC fa:16:3e:7a:ea:a8, not building metadata {{(pid=75165) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 00:15:50 user nova-compute[75165]: DEBUG nova.network.neutron [req-1ac475ef-0e07-43d9-b52b-d4fe72d6a2ab req-f5f829d9-fe53-43d9-922f-1e97ddeb2638 service nova] [instance: 91fe894a-90a8-4545-9b27-91771554c4cb] Updated VIF entry in instance network info cache for port 67590aab-15ed-4684-abd7-64a5c0a9b3f5. {{(pid=75165) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 00:15:50 user nova-compute[75165]: DEBUG nova.network.neutron [req-1ac475ef-0e07-43d9-b52b-d4fe72d6a2ab req-f5f829d9-fe53-43d9-922f-1e97ddeb2638 service nova] [instance: 91fe894a-90a8-4545-9b27-91771554c4cb] Updating instance_info_cache with network_info: [{"id": "67590aab-15ed-4684-abd7-64a5c0a9b3f5", "address": "fa:16:3e:7a:ea:a8", "network": {"id": "b31bac4b-1951-4ca3-8682-f1f24de0a5c3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1323234642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71aa69c0ea2d49e184e1e055ff3efa1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67590aab-15", "ovs_interfaceid": "67590aab-15ed-4684-abd7-64a5c0a9b3f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:15:50 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-1ac475ef-0e07-43d9-b52b-d4fe72d6a2ab req-f5f829d9-fe53-43d9-922f-1e97ddeb2638 service nova] Releasing lock "refresh_cache-91fe894a-90a8-4545-9b27-91771554c4cb" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:15:51 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:15:51 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:15:51 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:15:51 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:15:51 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:15:52 user nova-compute[75165]: DEBUG nova.compute.manager [req-7a040de2-206d-4283-9454-c454fc20a352 req-b9ed1865-a64b-4969-ace2-66fda48b3267 service nova] [instance: 91fe894a-90a8-4545-9b27-91771554c4cb] Received event network-vif-plugged-67590aab-15ed-4684-abd7-64a5c0a9b3f5 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:15:52 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-7a040de2-206d-4283-9454-c454fc20a352 req-b9ed1865-a64b-4969-ace2-66fda48b3267 service nova] Acquiring lock "91fe894a-90a8-4545-9b27-91771554c4cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:15:52 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-7a040de2-206d-4283-9454-c454fc20a352 req-b9ed1865-a64b-4969-ace2-66fda48b3267 service nova] Lock "91fe894a-90a8-4545-9b27-91771554c4cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:15:52 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-7a040de2-206d-4283-9454-c454fc20a352 req-b9ed1865-a64b-4969-ace2-66fda48b3267 service nova] Lock "91fe894a-90a8-4545-9b27-91771554c4cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:15:52 user nova-compute[75165]: DEBUG nova.compute.manager [req-7a040de2-206d-4283-9454-c454fc20a352 req-b9ed1865-a64b-4969-ace2-66fda48b3267 service nova] [instance: 91fe894a-90a8-4545-9b27-91771554c4cb] No waiting events found dispatching network-vif-plugged-67590aab-15ed-4684-abd7-64a5c0a9b3f5 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:15:52 user nova-compute[75165]: WARNING nova.compute.manager [req-7a040de2-206d-4283-9454-c454fc20a352 req-b9ed1865-a64b-4969-ace2-66fda48b3267 service nova] [instance: 91fe894a-90a8-4545-9b27-91771554c4cb] Received unexpected event network-vif-plugged-67590aab-15ed-4684-abd7-64a5c0a9b3f5 for instance with vm_state building and task_state spawning.
Oct 26 00:15:52 user nova-compute[75165]: DEBUG nova.objects.instance [None req-49d3d1a9-50b6-4779-8d92-6544d3213d4e tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] Lazy-loading 'flavor' on Instance uuid 8f8ec77f-bf35-4b15-bd77-9f8407b09d0b {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:15:52 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:15:52 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:15:52 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-49d3d1a9-50b6-4779-8d92-6544d3213d4e tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] Lock "8f8ec77f-bf35-4b15-bd77-9f8407b09d0b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 42.333s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:15:52 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-959f0329-0952-4712-bb97-0675986b5c1b tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] [instance: 27fa1771-fb69-49da-81b3-7f112e623170] Calling os-brick to attach iSCSI Volume {{(pid=75165) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 00:15:52 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-959f0329-0952-4712-bb97-0675986b5c1b tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8bf8160e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f431d8b9-aa1e-46f5-b7da-39f4a550e050', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ijTvApyq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:15:52 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-959f0329-0952-4712-bb97-0675986b5c1b tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:15:52 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-959f0329-0952-4712-bb97-0675986b5c1b tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:15:52 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-959f0329-0952-4712-bb97-0675986b5c1b tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:15:52 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-959f0329-0952-4712-bb97-0675986b5c1b tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:15:52 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-959f0329-0952-4712-bb97-0675986b5c1b tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f431d8b9-aa1e-46f5-b7da-39f4a550e050" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:15:52 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-959f0329-0952-4712-bb97-0675986b5c1b tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f431d8b9-aa1e-46f5-b7da-39f4a550e050" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:15:52 user nova-compute[75165]: INFO os_brick.initiator.connectors.iscsi [None req-959f0329-0952-4712-bb97-0675986b5c1b tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 00:15:52 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f431d8b9-aa1e-46f5-b7da-39f4a550e050 -p 172.16.0.220:3260 {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:15:52 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f431d8b9-aa1e-46f5-b7da-39f4a550e050 -p 172.16.0.220:3260" returned: 21 in 0.036s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:15:52 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[b00b0130-b851-462d-8fdf-0ab7078cfe26]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:15:52 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-959f0329-0952-4712-bb97-0675986b5c1b tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 00:15:52 user nova-compute[75165]:  {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:15:52 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f431d8b9-aa1e-46f5-b7da-39f4a550e050 -p 172.16.0.220:3260 --interface default --op new {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:15:52 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f431d8b9-aa1e-46f5-b7da-39f4a550e050 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:15:52 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[56327e8c-c88b-4f7c-8c33-529110a151d5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f431d8b9-aa1e-46f5-b7da-39f4a550e050] added\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:15:52 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-959f0329-0952-4712-bb97-0675986b5c1b tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f431d8b9-aa1e-46f5-b7da-39f4a550e050] added
Oct 26 00:15:52 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:15:52 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f431d8b9-aa1e-46f5-b7da-39f4a550e050 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:15:52 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f431d8b9-aa1e-46f5-b7da-39f4a550e050 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:15:52 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[72f47058-a882-4f19-9dc3-7960f5c54190]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:15:52 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-959f0329-0952-4712-bb97-0675986b5c1b tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:15:52 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f431d8b9-aa1e-46f5-b7da-39f4a550e050 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:15:52 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f431d8b9-aa1e-46f5-b7da-39f4a550e050 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:15:52 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d792352-8c71-4922-9759-ec4a63a6800b]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:15:52 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-959f0329-0952-4712-bb97-0675986b5c1b tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:15:52 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f431d8b9-aa1e-46f5-b7da-39f4a550e050 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ijTvApyq {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:15:52 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f431d8b9-aa1e-46f5-b7da-39f4a550e050 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ijTvApyq" returned: 0 in 0.019s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:15:52 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9c63dd1-9d5d-4ebf-b78a-8695775a4387]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:15:52 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-959f0329-0952-4712-bb97-0675986b5c1b tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ijTvApyq'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:15:52 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f431d8b9-aa1e-46f5-b7da-39f4a550e050 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:15:52 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f431d8b9-aa1e-46f5-b7da-39f4a550e050 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:15:52 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[726cfde8-a4c3-4d45-a703-41186bdf49cf]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:15:52 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-959f0329-0952-4712-bb97-0675986b5c1b tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:15:52 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:15:52 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:15:52 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[40aa7c79-6ae6-4c95-bba7-a0c095f051f9]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:15:52 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-959f0329-0952-4712-bb97-0675986b5c1b tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b (non-flash)
Oct 26 00:15:52 user nova-compute[75165]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b (non-flash)
Oct 26 00:15:52 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:15:52 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-959f0329-0952-4712-bb97-0675986b5c1b tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b (non-flash)
Oct 26 00:15:52 user nova-compute[75165]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b (non-flash)
Oct 26 00:15:52 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:15:52 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f431d8b9-aa1e-46f5-b7da-39f4a550e050 -p 172.16.0.220:3260 --login {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:15:52 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f431d8b9-aa1e-46f5-b7da-39f4a550e050 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:15:52 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9c5263a-e927-4af5-bb96-2aa4e69ee31a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f431d8b9-aa1e-46f5-b7da-39f4a550e050, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f431d8b9-aa1e-46f5-b7da-39f4a550e050, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:15:52 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-959f0329-0952-4712-bb97-0675986b5c1b tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f431d8b9-aa1e-46f5-b7da-39f4a550e050, portal: 172.16.0.220,3260]
Oct 26 00:15:52 user nova-compute[75165]: Login to [iface: default, target: iqn.2010-10.org.openstack:f431d8b9-aa1e-46f5-b7da-39f4a550e050, portal: 172.16.0.220,3260] successful.
Oct 26 00:15:52 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:15:52 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f431d8b9-aa1e-46f5-b7da-39f4a550e050 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:15:52 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f431d8b9-aa1e-46f5-b7da-39f4a550e050 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.034s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:15:52 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcdaa3a6-b8b4-4263-8e9a-dc02b69b707e]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:15:52 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-959f0329-0952-4712-bb97-0675986b5c1b tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:15:52 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:15:52 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:15:52 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[6091ac58-02df-452d-9704-34056b5247b0]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f431d8b9-aa1e-46f5-b7da-39f4a550e050 (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:15:52 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-959f0329-0952-4712-bb97-0675986b5c1b tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b (non-flash)
Oct 26 00:15:52 user nova-compute[75165]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b (non-flash)
Oct 26 00:15:52 user nova-compute[75165]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f431d8b9-aa1e-46f5-b7da-39f4a550e050 (non-flash)
Oct 26 00:15:52 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:15:52 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-959f0329-0952-4712-bb97-0675986b5c1b tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b (non-flash)
Oct 26 00:15:52 user nova-compute[75165]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b (non-flash)
Oct 26 00:15:52 user nova-compute[75165]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f431d8b9-aa1e-46f5-b7da-39f4a550e050 (non-flash)
Oct 26 00:15:52 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:15:52 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-959f0329-0952-4712-bb97-0675986b5c1b tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f431d8b9-aa1e-46f5-b7da-39f4a550e050" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.356s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:15:52 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-959f0329-0952-4712-bb97-0675986b5c1b tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Connected to 172.16.0.220:3260 {{(pid=75165) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 00:15:52 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-959f0329-0952-4712-bb97-0675986b5c1b tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] HCTL ('33', '-', '-', 0) found on session 21 with lun 0 {{(pid=75165) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 00:15:52 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-959f0329-0952-4712-bb97-0675986b5c1b tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75165) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 00:15:52 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:15:52 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:15:52 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c799f52-9093-4265-8a87-d36e0e796691]: (4, ('- - 0', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:15:52 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-959f0329-0952-4712-bb97-0675986b5c1b tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Searching for a device in session 21 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75165) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 00:15:52 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-959f0329-0952-4712-bb97-0675986b5c1b tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:f431d8b9-aa1e-46f5-b7da-39f4a550e050', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ijTvApyq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75165) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 00:15:53 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-0cb42902-b099-4365-961f-5b19b15944ab tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] Acquiring lock "interface-8f8ec77f-bf35-4b15-bd77-9f8407b09d0b-2f0902fc-120b-4c3a-aaa8-a441d61ad5e8" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:15:53 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-0cb42902-b099-4365-961f-5b19b15944ab tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] Lock "interface-8f8ec77f-bf35-4b15-bd77-9f8407b09d0b-2f0902fc-120b-4c3a-aaa8-a441d61ad5e8" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:15:53 user nova-compute[75165]: DEBUG nova.objects.instance [None req-0cb42902-b099-4365-961f-5b19b15944ab tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] Lazy-loading 'flavor' on Instance uuid 8f8ec77f-bf35-4b15-bd77-9f8407b09d0b {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:15:53 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-0cb42902-b099-4365-961f-5b19b15944ab tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T00:12:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1656940732',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1656940732',id=19,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN+wbYUhWvc0Q8Ki4GTS2Tn91hUUyA5mHnOcmOrTkWVgToMqNtiT9k+t+ZtOfljqpTvTwcwIhu3LxiFs8eVVq6KIF4bfjQF4bPry0REDa8gn1PrkrDV91CuU9Osr0XBN6A==',key_name='tempest-keypair-1700446792',keypairs=<?>,launch_index=0,launched_at=2023-10-26T00:12:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='da5b9c2d1b1e4d9d885fa82f1625b5e0',ramdisk_id='',reservation_id='r-wb7qp03s',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-950905423',owner_user_name='tempest-TaggedAttachmentsTest-950905423-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T00:12:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='93efb23845e441bc932910691dfaf023',uuid=8f8ec77f-bf35-4b15-bd77-9f8407b09d0b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2f0902fc-120b-4c3a-aaa8-a441d61ad5e8", "address": "fa:16:3e:f6:ac:95", "network": {"id": "aa33c3e8-4f0d-4863-866b-995c0af9ed27", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-650788755", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.81", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "da5b9c2d1b1e4d9d885fa82f1625b5e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f0902fc-12", "ovs_interfaceid": "2f0902fc-120b-4c3a-aaa8-a441d61ad5e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75165) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 00:15:53 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-0cb42902-b099-4365-961f-5b19b15944ab tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] Converting VIF {"id": "2f0902fc-120b-4c3a-aaa8-a441d61ad5e8", "address": "fa:16:3e:f6:ac:95", "network": {"id": "aa33c3e8-4f0d-4863-866b-995c0af9ed27", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-650788755", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.81", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "da5b9c2d1b1e4d9d885fa82f1625b5e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f0902fc-12", "ovs_interfaceid": "2f0902fc-120b-4c3a-aaa8-a441d61ad5e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:15:53 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-0cb42902-b099-4365-961f-5b19b15944ab tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:ac:95,bridge_name='br-int',has_traffic_filtering=True,id=2f0902fc-120b-4c3a-aaa8-a441d61ad5e8,network=Network(aa33c3e8-4f0d-4863-866b-995c0af9ed27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f0902fc-12') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:15:53 user nova-compute[75165]: DEBUG nova.virt.libvirt.guest [None req-0cb42902-b099-4365-961f-5b19b15944ab tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:f6:ac:95"/><model type="virtio"/><mtu size="1442"/><target dev="tap2f0902fc-12"/></interface> {{(pid=75165) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 26 00:15:53 user nova-compute[75165]: DEBUG nova.virt.libvirt.guest [None req-0cb42902-b099-4365-961f-5b19b15944ab tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:f6:ac:95"/><model type="virtio"/><mtu size="1442"/><target dev="tap2f0902fc-12"/></interface> {{(pid=75165) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 26 00:15:53 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-0cb42902-b099-4365-961f-5b19b15944ab tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] Attempting to detach device tap2f0902fc-12 from instance 8f8ec77f-bf35-4b15-bd77-9f8407b09d0b from the persistent domain config. {{(pid=75165) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 00:15:53 user nova-compute[75165]: DEBUG nova.virt.libvirt.guest [None req-0cb42902-b099-4365-961f-5b19b15944ab tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] detach device xml: <interface type="ethernet">
Oct 26 00:15:53 user nova-compute[75165]:   <mac address="fa:16:3e:f6:ac:95"/>
Oct 26 00:15:53 user nova-compute[75165]:   <model type="virtio"/>
Oct 26 00:15:53 user nova-compute[75165]:   <mtu size="1442"/>
Oct 26 00:15:53 user nova-compute[75165]:   <target dev="tap2f0902fc-12"/>
Oct 26 00:15:53 user nova-compute[75165]: </interface>
Oct 26 00:15:53 user nova-compute[75165]:  {{(pid=75165) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 00:15:53 user nova-compute[75165]: DEBUG nova.virt.libvirt.guest [None req-0cb42902-b099-4365-961f-5b19b15944ab tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:f6:ac:95"/><model type="virtio"/><mtu size="1442"/><target dev="tap2f0902fc-12"/></interface> {{(pid=75165) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 26 00:15:53 user nova-compute[75165]: DEBUG nova.virt.libvirt.guest [None req-0cb42902-b099-4365-961f-5b19b15944ab tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:f6:ac:95"/><model type="virtio"/><mtu size="1442"/><target dev="tap2f0902fc-12"/></interface>not found in domain: <domain type='kvm' id='23'>
Oct 26 00:15:53 user nova-compute[75165]:   <name>instance-00000013</name>
Oct 26 00:15:53 user nova-compute[75165]:   <uuid>8f8ec77f-bf35-4b15-bd77-9f8407b09d0b</uuid>
Oct 26 00:15:53 user nova-compute[75165]:   <metadata>
Oct 26 00:15:53 user nova-compute[75165]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 00:15:53 user nova-compute[75165]:   <nova:package version="0.0.0"/>
Oct 26 00:15:53 user nova-compute[75165]:   <nova:name>tempest-device-tagging-server-1656940732</nova:name>
Oct 26 00:15:53 user nova-compute[75165]:   <nova:creationTime>2023-10-26 00:14:30</nova:creationTime>
Oct 26 00:15:53 user nova-compute[75165]:   <nova:flavor name="m1.tiny">
Oct 26 00:15:53 user nova-compute[75165]:     <nova:memory>512</nova:memory>
Oct 26 00:15:53 user nova-compute[75165]:     <nova:disk>1</nova:disk>
Oct 26 00:15:53 user nova-compute[75165]:     <nova:swap>0</nova:swap>
Oct 26 00:15:53 user nova-compute[75165]:     <nova:ephemeral>0</nova:ephemeral>
Oct 26 00:15:53 user nova-compute[75165]:     <nova:vcpus>1</nova:vcpus>
Oct 26 00:15:53 user nova-compute[75165]:   </nova:flavor>
Oct 26 00:15:53 user nova-compute[75165]:   <nova:owner>
Oct 26 00:15:53 user nova-compute[75165]:     <nova:user uuid="93efb23845e441bc932910691dfaf023">tempest-TaggedAttachmentsTest-950905423-project-member</nova:user>
Oct 26 00:15:53 user nova-compute[75165]:     <nova:project uuid="da5b9c2d1b1e4d9d885fa82f1625b5e0">tempest-TaggedAttachmentsTest-950905423</nova:project>
Oct 26 00:15:53 user nova-compute[75165]:   </nova:owner>
Oct 26 00:15:53 user nova-compute[75165]:   <nova:root type="image" uuid="bff0d8a1-739e-4c4d-9efa-b73ba7b76d01"/>
Oct 26 00:15:53 user nova-compute[75165]:   <nova:ports>
Oct 26 00:15:53 user nova-compute[75165]:     <nova:port uuid="7f5b9415-3336-49cc-8909-c21c7003e6fe">
Oct 26 00:15:53 user nova-compute[75165]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 26 00:15:53 user nova-compute[75165]:     </nova:port>
Oct 26 00:15:53 user nova-compute[75165]:     <nova:port uuid="2f0902fc-120b-4c3a-aaa8-a441d61ad5e8">
Oct 26 00:15:53 user nova-compute[75165]:       <nova:ip type="fixed" address="10.10.10.81" ipVersion="4"/>
Oct 26 00:15:53 user nova-compute[75165]:     </nova:port>
Oct 26 00:15:53 user nova-compute[75165]:   </nova:ports>
Oct 26 00:15:53 user nova-compute[75165]: </nova:instance>
Oct 26 00:15:53 user nova-compute[75165]:   </metadata>
Oct 26 00:15:53 user nova-compute[75165]:   <memory unit='KiB'>524288</memory>
Oct 26 00:15:53 user nova-compute[75165]:   <currentMemory unit='KiB'>524288</currentMemory>
Oct 26 00:15:53 user nova-compute[75165]:   <vcpu placement='static'>1</vcpu>
Oct 26 00:15:53 user nova-compute[75165]:   <resource>
Oct 26 00:15:53 user nova-compute[75165]:     <partition>/machine</partition>
Oct 26 00:15:53 user nova-compute[75165]:   </resource>
Oct 26 00:15:53 user nova-compute[75165]:   <sysinfo type='smbios'>
Oct 26 00:15:53 user nova-compute[75165]:     <system>
Oct 26 00:15:53 user nova-compute[75165]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Oct 26 00:15:53 user nova-compute[75165]:       <entry name='product'>OpenStack Nova</entry>
Oct 26 00:15:53 user nova-compute[75165]:       <entry name='version'>0.0.0</entry>
Oct 26 00:15:53 user nova-compute[75165]:       <entry name='serial'>8f8ec77f-bf35-4b15-bd77-9f8407b09d0b</entry>
Oct 26 00:15:53 user nova-compute[75165]:       <entry name='uuid'>8f8ec77f-bf35-4b15-bd77-9f8407b09d0b</entry>
Oct 26 00:15:53 user nova-compute[75165]:       <entry name='family'>Virtual Machine</entry>
Oct 26 00:15:53 user nova-compute[75165]:     </system>
Oct 26 00:15:53 user nova-compute[75165]:   </sysinfo>
Oct 26 00:15:53 user nova-compute[75165]:   <os>
Oct 26 00:15:53 user nova-compute[75165]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Oct 26 00:15:53 user nova-compute[75165]:     <boot dev='hd'/>
Oct 26 00:15:53 user nova-compute[75165]:     <smbios mode='sysinfo'/>
Oct 26 00:15:53 user nova-compute[75165]:   </os>
Oct 26 00:15:53 user nova-compute[75165]:   <features>
Oct 26 00:15:53 user nova-compute[75165]:     <acpi/>
Oct 26 00:15:53 user nova-compute[75165]:     <apic/>
Oct 26 00:15:53 user nova-compute[75165]:     <vmcoreinfo state='on'/>
Oct 26 00:15:53 user nova-compute[75165]:   </features>
Oct 26 00:15:53 user nova-compute[75165]:   <cpu mode='custom' match='exact' check='full'>
Oct 26 00:15:53 user nova-compute[75165]:     <model fallback='forbid'>Nehalem</model>
Oct 26 00:15:53 user nova-compute[75165]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Oct 26 00:15:53 user nova-compute[75165]:     <feature policy='require' name='vme'/>
Oct 26 00:15:53 user nova-compute[75165]:     <feature policy='require' name='x2apic'/>
Oct 26 00:15:53 user nova-compute[75165]:     <feature policy='require' name='hypervisor'/>
Oct 26 00:15:53 user nova-compute[75165]:   </cpu>
Oct 26 00:15:53 user nova-compute[75165]:   <clock offset='utc'>
Oct 26 00:15:53 user nova-compute[75165]:     <timer name='pit' tickpolicy='delay'/>
Oct 26 00:15:53 user nova-compute[75165]:     <timer name='rtc' tickpolicy='catchup'/>
Oct 26 00:15:53 user nova-compute[75165]:     <timer name='hpet' present='no'/>
Oct 26 00:15:53 user nova-compute[75165]:   </clock>
Oct 26 00:15:53 user nova-compute[75165]:   <on_poweroff>destroy</on_poweroff>
Oct 26 00:15:53 user nova-compute[75165]:   <on_reboot>restart</on_reboot>
Oct 26 00:15:53 user nova-compute[75165]:   <on_crash>destroy</on_crash>
Oct 26 00:15:53 user nova-compute[75165]:   <devices>
Oct 26 00:15:53 user nova-compute[75165]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 26 00:15:53 user nova-compute[75165]:     <disk type='file' device='disk'>
Oct 26 00:15:53 user nova-compute[75165]:       <driver name='qemu' type='qcow2' cache='none'/>
Oct 26 00:15:53 user nova-compute[75165]:       <source file='/opt/stack/data/nova/instances/8f8ec77f-bf35-4b15-bd77-9f8407b09d0b/disk' index='2'/>
Oct 26 00:15:53 user nova-compute[75165]:       <backingStore type='file' index='3'>
Oct 26 00:15:53 user nova-compute[75165]:         <format type='raw'/>
Oct 26 00:15:53 user nova-compute[75165]:         <source file='/opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466'/>
Oct 26 00:15:53 user nova-compute[75165]:         <backingStore/>
Oct 26 00:15:53 user nova-compute[75165]:       </backingStore>
Oct 26 00:15:53 user nova-compute[75165]:       <target dev='vda' bus='virtio'/>
Oct 26 00:15:53 user nova-compute[75165]:       <alias name='virtio-disk0'/>
Oct 26 00:15:53 user nova-compute[75165]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Oct 26 00:15:53 user nova-compute[75165]:     </disk>
Oct 26 00:15:53 user nova-compute[75165]:     <disk type='file' device='cdrom'>
Oct 26 00:15:53 user nova-compute[75165]:       <driver name='qemu' type='raw' cache='none'/>
Oct 26 00:15:53 user nova-compute[75165]:       <source file='/opt/stack/data/nova/instances/8f8ec77f-bf35-4b15-bd77-9f8407b09d0b/disk.config' index='1'/>
Oct 26 00:15:53 user nova-compute[75165]:       <backingStore/>
Oct 26 00:15:53 user nova-compute[75165]:       <target dev='hda' bus='ide'/>
Oct 26 00:15:53 user nova-compute[75165]:       <readonly/>
Oct 26 00:15:53 user nova-compute[75165]:       <alias name='ide0-0-0'/>
Oct 26 00:15:53 user nova-compute[75165]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Oct 26 00:15:53 user nova-compute[75165]:     </disk>
Oct 26 00:15:53 user nova-compute[75165]:     <controller type='usb' index='0' model='none'>
Oct 26 00:15:53 user nova-compute[75165]:       <alias name='usb'/>
Oct 26 00:15:53 user nova-compute[75165]:     </controller>
Oct 26 00:15:53 user nova-compute[75165]:     <controller type='pci' index='0' model='pci-root'>
Oct 26 00:15:53 user nova-compute[75165]:       <alias name='pci.0'/>
Oct 26 00:15:53 user nova-compute[75165]:     </controller>
Oct 26 00:15:53 user nova-compute[75165]:     <controller type='ide' index='0'>
Oct 26 00:15:53 user nova-compute[75165]:       <alias name='ide'/>
Oct 26 00:15:53 user nova-compute[75165]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Oct 26 00:15:53 user nova-compute[75165]:     </controller>
Oct 26 00:15:53 user nova-compute[75165]:     <interface type='ethernet'>
Oct 26 00:15:53 user nova-compute[75165]:       <mac address='fa:16:3e:c8:5c:77'/>
Oct 26 00:15:53 user nova-compute[75165]:       <target dev='tap7f5b9415-33'/>
Oct 26 00:15:53 user nova-compute[75165]:       <model type='virtio'/>
Oct 26 00:15:53 user nova-compute[75165]:       <mtu size='1442'/>
Oct 26 00:15:53 user nova-compute[75165]:       <alias name='net0'/>
Oct 26 00:15:53 user nova-compute[75165]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Oct 26 00:15:53 user nova-compute[75165]:     </interface>
Oct 26 00:15:53 user nova-compute[75165]:     <interface type='ethernet'>
Oct 26 00:15:53 user nova-compute[75165]:       <mac address='fa:16:3e:f6:ac:95'/>
Oct 26 00:15:53 user nova-compute[75165]:       <target dev='tap2f0902fc-12'/>
Oct 26 00:15:53 user nova-compute[75165]:       <model type='virtio'/>
Oct 26 00:15:53 user nova-compute[75165]:       <mtu size='1442'/>
Oct 26 00:15:53 user nova-compute[75165]:       <alias name='net1'/>
Oct 26 00:15:53 user nova-compute[75165]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Oct 26 00:15:53 user nova-compute[75165]:     </interface>
Oct 26 00:15:53 user nova-compute[75165]:     <serial type='pty'>
Oct 26 00:15:53 user nova-compute[75165]:       <source path='/dev/pts/9'/>
Oct 26 00:15:53 user nova-compute[75165]:       <log file='/opt/stack/data/nova/instances/8f8ec77f-bf35-4b15-bd77-9f8407b09d0b/console.log' append='off'/>
Oct 26 00:15:53 user nova-compute[75165]:       <target type='isa-serial' port='0'>
Oct 26 00:15:53 user nova-compute[75165]:         <model name='isa-serial'/>
Oct 26 00:15:53 user nova-compute[75165]:       </target>
Oct 26 00:15:53 user nova-compute[75165]:       <alias name='serial0'/>
Oct 26 00:15:53 user nova-compute[75165]:     </serial>
Oct 26 00:15:53 user nova-compute[75165]:     <console type='pty' tty='/dev/pts/9'>
Oct 26 00:15:53 user nova-compute[75165]:       <source path='/dev/pts/9'/>
Oct 26 00:15:53 user nova-compute[75165]:       <log file='/opt/stack/data/nova/instances/8f8ec77f-bf35-4b15-bd77-9f8407b09d0b/console.log' append='off'/>
Oct 26 00:15:53 user nova-compute[75165]:       <target type='serial' port='0'/>
Oct 26 00:15:53 user nova-compute[75165]:       <alias name='serial0'/>
Oct 26 00:15:53 user nova-compute[75165]:     </console>
Oct 26 00:15:53 user nova-compute[75165]:     <input type='mouse' bus='ps2'>
Oct 26 00:15:53 user nova-compute[75165]:       <alias name='input0'/>
Oct 26 00:15:53 user nova-compute[75165]:     </input>
Oct 26 00:15:53 user nova-compute[75165]:     <input type='keyboard' bus='ps2'>
Oct 26 00:15:53 user nova-compute[75165]:       <alias name='input1'/>
Oct 26 00:15:53 user nova-compute[75165]:     </input>
Oct 26 00:15:53 user nova-compute[75165]:     <graphics type='vnc' port='5910' autoport='yes' listen='0.0.0.0'>
Oct 26 00:15:53 user nova-compute[75165]:       <listen type='address' address='0.0.0.0'/>
Oct 26 00:15:53 user nova-compute[75165]:     </graphics>
Oct 26 00:15:53 user nova-compute[75165]:     <audio id='1' type='none'/>
Oct 26 00:15:53 user nova-compute[75165]:     <video>
Oct 26 00:15:53 user nova-compute[75165]:       <model type='virtio' heads='1' primary='yes'/>
Oct 26 00:15:53 user nova-compute[75165]:       <alias name='video0'/>
Oct 26 00:15:53 user nova-compute[75165]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Oct 26 00:15:53 user nova-compute[75165]:     </video>
Oct 26 00:15:53 user nova-compute[75165]:     <memballoon model='virtio'>
Oct 26 00:15:53 user nova-compute[75165]:       <stats period='10'/>
Oct 26 00:15:53 user nova-compute[75165]:       <alias name='balloon0'/>
Oct 26 00:15:53 user nova-compute[75165]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Oct 26 00:15:53 user nova-compute[75165]:     </memballoon>
Oct 26 00:15:53 user nova-compute[75165]:     <rng model='virtio'>
Oct 26 00:15:53 user nova-compute[75165]:       <backend model='random'>/dev/urandom</backend>
Oct 26 00:15:53 user nova-compute[75165]:       <alias name='rng0'/>
Oct 26 00:15:53 user nova-compute[75165]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Oct 26 00:15:53 user nova-compute[75165]:     </rng>
Oct 26 00:15:53 user nova-compute[75165]:   </devices>
Oct 26 00:15:53 user nova-compute[75165]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Oct 26 00:15:53 user nova-compute[75165]:     <label>libvirt-8f8ec77f-bf35-4b15-bd77-9f8407b09d0b</label>
Oct 26 00:15:53 user nova-compute[75165]:     <imagelabel>libvirt-8f8ec77f-bf35-4b15-bd77-9f8407b09d0b</imagelabel>
Oct 26 00:15:53 user nova-compute[75165]:   </seclabel>
Oct 26 00:15:53 user nova-compute[75165]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Oct 26 00:15:53 user nova-compute[75165]:     <label>+64055:+108</label>
Oct 26 00:15:53 user nova-compute[75165]:     <imagelabel>+64055:+108</imagelabel>
Oct 26 00:15:53 user nova-compute[75165]:   </seclabel>
Oct 26 00:15:53 user nova-compute[75165]: </domain>
Oct 26 00:15:53 user nova-compute[75165]:  {{(pid=75165) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Oct 26 00:15:53 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-0cb42902-b099-4365-961f-5b19b15944ab tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] Successfully detached device tap2f0902fc-12 from instance 8f8ec77f-bf35-4b15-bd77-9f8407b09d0b from the persistent domain config.
Oct 26 00:15:53 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-0cb42902-b099-4365-961f-5b19b15944ab tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] (1/8): Attempting to detach device tap2f0902fc-12 with device alias net1 from instance 8f8ec77f-bf35-4b15-bd77-9f8407b09d0b from the live domain config. {{(pid=75165) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 00:15:53 user nova-compute[75165]: DEBUG nova.virt.libvirt.guest [None req-0cb42902-b099-4365-961f-5b19b15944ab tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] detach device xml: <interface type="ethernet">
Oct 26 00:15:53 user nova-compute[75165]:   <mac address="fa:16:3e:f6:ac:95"/>
Oct 26 00:15:53 user nova-compute[75165]:   <model type="virtio"/>
Oct 26 00:15:53 user nova-compute[75165]:   <mtu size="1442"/>
Oct 26 00:15:53 user nova-compute[75165]:   <target dev="tap2f0902fc-12"/>
Oct 26 00:15:53 user nova-compute[75165]: </interface>
Oct 26 00:15:53 user nova-compute[75165]:  {{(pid=75165) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 00:15:53 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:15:53 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-0cb42902-b099-4365-961f-5b19b15944ab tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] Start waiting for the detach event from libvirt for device tap2f0902fc-12 with device alias net1 for instance 8f8ec77f-bf35-4b15-bd77-9f8407b09d0b {{(pid=75165) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 00:15:53 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:15:53 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-959f0329-0952-4712-bb97-0675986b5c1b tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.397s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:15:53 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-959f0329-0952-4712-bb97-0675986b5c1b tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] <== connect_volume: return (1400ms) {'type': 'block', 'scsi_wwn': '26133366433646535', 'path': '/dev/sdb'} {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:15:53 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-959f0329-0952-4712-bb97-0675986b5c1b tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] [instance: 27fa1771-fb69-49da-81b3-7f112e623170] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26133366433646535', 'path': '/dev/sdb'} {{(pid=75165) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 00:15:53 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:15:53 user nova-compute[75165]: DEBUG nova.objects.instance [None req-959f0329-0952-4712-bb97-0675986b5c1b tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Lazy-loading 'flavor' on Instance uuid 27fa1771-fb69-49da-81b3-7f112e623170 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:15:53 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:15:54 user nova-compute[75165]: DEBUG nova.virt.libvirt.guest [None req-959f0329-0952-4712-bb97-0675986b5c1b tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 00:15:54 user nova-compute[75165]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 00:15:54 user nova-compute[75165]:   <source dev="/dev/sdb"/>
Oct 26 00:15:54 user nova-compute[75165]:   <target dev="vdb" bus="virtio"/>
Oct 26 00:15:54 user nova-compute[75165]:   <serial>f431d8b9-aa1e-46f5-b7da-39f4a550e050</serial>
Oct 26 00:15:54 user nova-compute[75165]: </disk>
Oct 26 00:15:54 user nova-compute[75165]:  {{(pid=75165) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 00:15:54 user nova-compute[75165]: DEBUG nova.compute.manager [req-8fcfce4c-0be1-438c-9e99-030165546402 req-d9c4a2b2-75e5-4459-955d-5270e3f563c8 service nova] [instance: 91fe894a-90a8-4545-9b27-91771554c4cb] Received event network-vif-plugged-67590aab-15ed-4684-abd7-64a5c0a9b3f5 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:15:54 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-8fcfce4c-0be1-438c-9e99-030165546402 req-d9c4a2b2-75e5-4459-955d-5270e3f563c8 service nova] Acquiring lock "91fe894a-90a8-4545-9b27-91771554c4cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:15:54 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-8fcfce4c-0be1-438c-9e99-030165546402 req-d9c4a2b2-75e5-4459-955d-5270e3f563c8 service nova] Lock "91fe894a-90a8-4545-9b27-91771554c4cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:15:54 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-8fcfce4c-0be1-438c-9e99-030165546402 req-d9c4a2b2-75e5-4459-955d-5270e3f563c8 service nova] Lock "91fe894a-90a8-4545-9b27-91771554c4cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:15:54 user nova-compute[75165]: DEBUG nova.compute.manager [req-8fcfce4c-0be1-438c-9e99-030165546402 req-d9c4a2b2-75e5-4459-955d-5270e3f563c8 service nova] [instance: 91fe894a-90a8-4545-9b27-91771554c4cb] No waiting events found dispatching network-vif-plugged-67590aab-15ed-4684-abd7-64a5c0a9b3f5 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:15:54 user nova-compute[75165]: WARNING nova.compute.manager [req-8fcfce4c-0be1-438c-9e99-030165546402 req-d9c4a2b2-75e5-4459-955d-5270e3f563c8 service nova] [instance: 91fe894a-90a8-4545-9b27-91771554c4cb] Received unexpected event network-vif-plugged-67590aab-15ed-4684-abd7-64a5c0a9b3f5 for instance with vm_state building and task_state spawning.
Oct 26 00:15:54 user nova-compute[75165]: DEBUG nova.compute.manager [None req-4329f469-20fd-4f07-ac1f-a1b123f7d0a9 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: 91fe894a-90a8-4545-9b27-91771554c4cb] Instance event wait completed in 0 seconds for  {{(pid=75165) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 00:15:54 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-4329f469-20fd-4f07-ac1f-a1b123f7d0a9 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: 91fe894a-90a8-4545-9b27-91771554c4cb] Guest created on hypervisor {{(pid=75165) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 00:15:54 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: 91fe894a-90a8-4545-9b27-91771554c4cb] Instance spawned successfully.
Oct 26 00:15:54 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-4329f469-20fd-4f07-ac1f-a1b123f7d0a9 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: 91fe894a-90a8-4545-9b27-91771554c4cb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 00:15:54 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-4329f469-20fd-4f07-ac1f-a1b123f7d0a9 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: 91fe894a-90a8-4545-9b27-91771554c4cb] Found default for hw_cdrom_bus of ide {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:15:54 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-4329f469-20fd-4f07-ac1f-a1b123f7d0a9 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: 91fe894a-90a8-4545-9b27-91771554c4cb] Found default for hw_disk_bus of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:15:54 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-4329f469-20fd-4f07-ac1f-a1b123f7d0a9 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: 91fe894a-90a8-4545-9b27-91771554c4cb] Found default for hw_input_bus of None {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:15:54 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-4329f469-20fd-4f07-ac1f-a1b123f7d0a9 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: 91fe894a-90a8-4545-9b27-91771554c4cb] Found default for hw_pointer_model of None {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:15:54 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-4329f469-20fd-4f07-ac1f-a1b123f7d0a9 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: 91fe894a-90a8-4545-9b27-91771554c4cb] Found default for hw_video_model of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:15:54 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-4329f469-20fd-4f07-ac1f-a1b123f7d0a9 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: 91fe894a-90a8-4545-9b27-91771554c4cb] Found default for hw_vif_model of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:15:54 user nova-compute[75165]: INFO nova.compute.manager [None req-4329f469-20fd-4f07-ac1f-a1b123f7d0a9 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: 91fe894a-90a8-4545-9b27-91771554c4cb] Took 6.83 seconds to spawn the instance on the hypervisor.
Oct 26 00:15:54 user nova-compute[75165]: DEBUG nova.compute.manager [None req-4329f469-20fd-4f07-ac1f-a1b123f7d0a9 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: 91fe894a-90a8-4545-9b27-91771554c4cb] Checking state {{(pid=75165) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 00:15:54 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-959f0329-0952-4712-bb97-0675986b5c1b tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] No BDM found with device name vda, not building metadata. {{(pid=75165) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 00:15:54 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-959f0329-0952-4712-bb97-0675986b5c1b tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75165) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 00:15:54 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-959f0329-0952-4712-bb97-0675986b5c1b tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] No VIF found with MAC fa:16:3e:c5:bb:76, not building metadata {{(pid=75165) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 00:15:54 user nova-compute[75165]: INFO nova.compute.manager [None req-4329f469-20fd-4f07-ac1f-a1b123f7d0a9 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: 91fe894a-90a8-4545-9b27-91771554c4cb] Took 7.97 seconds to build instance.
Oct 26 00:15:54 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-4329f469-20fd-4f07-ac1f-a1b123f7d0a9 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Lock "91fe894a-90a8-4545-9b27-91771554c4cb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.120s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:15:54 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-959f0329-0952-4712-bb97-0675986b5c1b tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Lock "27fa1771-fb69-49da-81b3-7f112e623170" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 24.399s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:15:55 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:15:55 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:15:56 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-a88cdc72-cfd4-42a5-a90f-52034356e3c6 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Acquiring lock "27fa1771-fb69-49da-81b3-7f112e623170" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:15:56 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-a88cdc72-cfd4-42a5-a90f-52034356e3c6 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Lock "27fa1771-fb69-49da-81b3-7f112e623170" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.002s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:15:56 user nova-compute[75165]: DEBUG nova.compute.manager [None req-a88cdc72-cfd4-42a5-a90f-52034356e3c6 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] [instance: 27fa1771-fb69-49da-81b3-7f112e623170] Checking state {{(pid=75165) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 00:15:56 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:15:56 user nova-compute[75165]: DEBUG nova.compute.manager [None req-a88cdc72-cfd4-42a5-a90f-52034356e3c6 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] [instance: 27fa1771-fb69-49da-81b3-7f112e623170] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75165) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Oct 26 00:15:56 user nova-compute[75165]: DEBUG nova.objects.instance [None req-a88cdc72-cfd4-42a5-a90f-52034356e3c6 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Lazy-loading 'flavor' on Instance uuid 27fa1771-fb69-49da-81b3-7f112e623170 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:15:56 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:15:56 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:15:56 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:15:56 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:15:56 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:15:56 user nova-compute[75165]: DEBUG nova.compute.manager [req-57bf096d-5305-46c2-a198-b76841bfe8ae req-8b612961-b544-4a4a-832e-fb5ba6265322 service nova] [instance: 8f8ec77f-bf35-4b15-bd77-9f8407b09d0b] Received event network-vif-unplugged-2f0902fc-120b-4c3a-aaa8-a441d61ad5e8 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:15:56 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-57bf096d-5305-46c2-a198-b76841bfe8ae req-8b612961-b544-4a4a-832e-fb5ba6265322 service nova] Acquiring lock "8f8ec77f-bf35-4b15-bd77-9f8407b09d0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:15:56 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-57bf096d-5305-46c2-a198-b76841bfe8ae req-8b612961-b544-4a4a-832e-fb5ba6265322 service nova] Lock "8f8ec77f-bf35-4b15-bd77-9f8407b09d0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:15:56 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-57bf096d-5305-46c2-a198-b76841bfe8ae req-8b612961-b544-4a4a-832e-fb5ba6265322 service nova] Lock "8f8ec77f-bf35-4b15-bd77-9f8407b09d0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:15:56 user nova-compute[75165]: DEBUG nova.compute.manager [req-57bf096d-5305-46c2-a198-b76841bfe8ae req-8b612961-b544-4a4a-832e-fb5ba6265322 service nova] [instance: 8f8ec77f-bf35-4b15-bd77-9f8407b09d0b] No waiting events found dispatching network-vif-unplugged-2f0902fc-120b-4c3a-aaa8-a441d61ad5e8 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:15:56 user nova-compute[75165]: WARNING nova.compute.manager [req-57bf096d-5305-46c2-a198-b76841bfe8ae req-8b612961-b544-4a4a-832e-fb5ba6265322 service nova] [instance: 8f8ec77f-bf35-4b15-bd77-9f8407b09d0b] Received unexpected event network-vif-unplugged-2f0902fc-120b-4c3a-aaa8-a441d61ad5e8 for instance with vm_state active and task_state None.
Oct 26 00:15:56 user nova-compute[75165]: DEBUG nova.compute.manager [req-57bf096d-5305-46c2-a198-b76841bfe8ae req-8b612961-b544-4a4a-832e-fb5ba6265322 service nova] [instance: 8f8ec77f-bf35-4b15-bd77-9f8407b09d0b] Received event network-vif-plugged-2f0902fc-120b-4c3a-aaa8-a441d61ad5e8 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:15:56 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-57bf096d-5305-46c2-a198-b76841bfe8ae req-8b612961-b544-4a4a-832e-fb5ba6265322 service nova] Acquiring lock "8f8ec77f-bf35-4b15-bd77-9f8407b09d0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:15:56 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-57bf096d-5305-46c2-a198-b76841bfe8ae req-8b612961-b544-4a4a-832e-fb5ba6265322 service nova] Lock "8f8ec77f-bf35-4b15-bd77-9f8407b09d0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:15:56 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-57bf096d-5305-46c2-a198-b76841bfe8ae req-8b612961-b544-4a4a-832e-fb5ba6265322 service nova] Lock "8f8ec77f-bf35-4b15-bd77-9f8407b09d0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:15:56 user nova-compute[75165]: DEBUG nova.compute.manager [req-57bf096d-5305-46c2-a198-b76841bfe8ae req-8b612961-b544-4a4a-832e-fb5ba6265322 service nova] [instance: 8f8ec77f-bf35-4b15-bd77-9f8407b09d0b] No waiting events found dispatching network-vif-plugged-2f0902fc-120b-4c3a-aaa8-a441d61ad5e8 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:15:56 user nova-compute[75165]: WARNING nova.compute.manager [req-57bf096d-5305-46c2-a198-b76841bfe8ae req-8b612961-b544-4a4a-832e-fb5ba6265322 service nova] [instance: 8f8ec77f-bf35-4b15-bd77-9f8407b09d0b] Received unexpected event network-vif-plugged-2f0902fc-120b-4c3a-aaa8-a441d61ad5e8 for instance with vm_state active and task_state None.
Oct 26 00:15:56 user nova-compute[75165]: DEBUG nova.compute.manager [req-4e69c833-e05d-4ff4-bbf3-5f13ae86a526 req-114150a5-0db6-489b-8a03-e12ed45cc463 service nova] [instance: 27fa1771-fb69-49da-81b3-7f112e623170] Received event network-vif-unplugged-4d97651b-5d7c-4778-85a4-a11588892b31 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:15:56 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-4e69c833-e05d-4ff4-bbf3-5f13ae86a526 req-114150a5-0db6-489b-8a03-e12ed45cc463 service nova] Acquiring lock "27fa1771-fb69-49da-81b3-7f112e623170-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:15:56 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-4e69c833-e05d-4ff4-bbf3-5f13ae86a526 req-114150a5-0db6-489b-8a03-e12ed45cc463 service nova] Lock "27fa1771-fb69-49da-81b3-7f112e623170-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:15:56 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-4e69c833-e05d-4ff4-bbf3-5f13ae86a526 req-114150a5-0db6-489b-8a03-e12ed45cc463 service nova] Lock "27fa1771-fb69-49da-81b3-7f112e623170-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:15:56 user nova-compute[75165]: DEBUG nova.compute.manager [req-4e69c833-e05d-4ff4-bbf3-5f13ae86a526 req-114150a5-0db6-489b-8a03-e12ed45cc463 service nova] [instance: 27fa1771-fb69-49da-81b3-7f112e623170] No waiting events found dispatching network-vif-unplugged-4d97651b-5d7c-4778-85a4-a11588892b31 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:15:56 user nova-compute[75165]: WARNING nova.compute.manager [req-4e69c833-e05d-4ff4-bbf3-5f13ae86a526 req-114150a5-0db6-489b-8a03-e12ed45cc463 service nova] [instance: 27fa1771-fb69-49da-81b3-7f112e623170] Received unexpected event network-vif-unplugged-4d97651b-5d7c-4778-85a4-a11588892b31 for instance with vm_state active and task_state powering-off.
Oct 26 00:15:56 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: 27fa1771-fb69-49da-81b3-7f112e623170] Instance destroyed successfully.
Oct 26 00:15:56 user nova-compute[75165]: DEBUG nova.compute.manager [None req-a88cdc72-cfd4-42a5-a90f-52034356e3c6 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] [instance: 27fa1771-fb69-49da-81b3-7f112e623170] Checking state {{(pid=75165) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 00:15:57 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-a88cdc72-cfd4-42a5-a90f-52034356e3c6 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Lock "27fa1771-fb69-49da-81b3-7f112e623170" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 1.038s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:15:58 user nova-compute[75165]: DEBUG nova.compute.manager [req-821e0509-c786-40ab-a602-d24c3af63b13 req-0b17a14e-100f-4290-b670-e24a786f4bd8 service nova] [instance: 27fa1771-fb69-49da-81b3-7f112e623170] Received event network-vif-plugged-4d97651b-5d7c-4778-85a4-a11588892b31 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:15:58 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-821e0509-c786-40ab-a602-d24c3af63b13 req-0b17a14e-100f-4290-b670-e24a786f4bd8 service nova] Acquiring lock "27fa1771-fb69-49da-81b3-7f112e623170-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:15:58 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-821e0509-c786-40ab-a602-d24c3af63b13 req-0b17a14e-100f-4290-b670-e24a786f4bd8 service nova] Lock "27fa1771-fb69-49da-81b3-7f112e623170-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:15:58 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-821e0509-c786-40ab-a602-d24c3af63b13 req-0b17a14e-100f-4290-b670-e24a786f4bd8 service nova] Lock "27fa1771-fb69-49da-81b3-7f112e623170-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:15:58 user nova-compute[75165]: DEBUG nova.compute.manager [req-821e0509-c786-40ab-a602-d24c3af63b13 req-0b17a14e-100f-4290-b670-e24a786f4bd8 service nova] [instance: 27fa1771-fb69-49da-81b3-7f112e623170] No waiting events found dispatching network-vif-plugged-4d97651b-5d7c-4778-85a4-a11588892b31 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:15:58 user nova-compute[75165]: WARNING nova.compute.manager [req-821e0509-c786-40ab-a602-d24c3af63b13 req-0b17a14e-100f-4290-b670-e24a786f4bd8 service nova] [instance: 27fa1771-fb69-49da-81b3-7f112e623170] Received unexpected event network-vif-plugged-4d97651b-5d7c-4778-85a4-a11588892b31 for instance with vm_state stopped and task_state None.
Oct 26 00:16:00 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:16:01 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:16:02 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:16:02 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:16:04 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:16:04 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:16:05 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:16:05 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:16:05 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:16:05 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75165) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 00:16:06 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:16:06 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:16:06 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:16:07 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-d775589a-197e-4f7a-a1a2-b2dcbc09c4f4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Acquiring lock "22b9689c-5e83-4807-971f-5b244914b7e5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:16:07 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-d775589a-197e-4f7a-a1a2-b2dcbc09c4f4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Lock "22b9689c-5e83-4807-971f-5b244914b7e5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:16:07 user nova-compute[75165]: INFO nova.compute.manager [None req-d775589a-197e-4f7a-a1a2-b2dcbc09c4f4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: 22b9689c-5e83-4807-971f-5b244914b7e5] Detaching volume 33bd85b7-301b-434f-b1af-a682c33cf49b
Oct 26 00:16:07 user nova-compute[75165]: INFO nova.virt.block_device [None req-d775589a-197e-4f7a-a1a2-b2dcbc09c4f4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: 22b9689c-5e83-4807-971f-5b244914b7e5] Attempting to driver detach volume 33bd85b7-301b-434f-b1af-a682c33cf49b from mountpoint /dev/vdb
Oct 26 00:16:07 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-d775589a-197e-4f7a-a1a2-b2dcbc09c4f4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Attempting to detach device vdb from instance 22b9689c-5e83-4807-971f-5b244914b7e5 from the persistent domain config. {{(pid=75165) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 00:16:07 user nova-compute[75165]: DEBUG nova.virt.libvirt.guest [None req-d775589a-197e-4f7a-a1a2-b2dcbc09c4f4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 00:16:07 user nova-compute[75165]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 00:16:07 user nova-compute[75165]:   <source dev="/dev/sdc"/>
Oct 26 00:16:07 user nova-compute[75165]:   <target dev="vdb" bus="virtio"/>
Oct 26 00:16:07 user nova-compute[75165]:   <serial>33bd85b7-301b-434f-b1af-a682c33cf49b</serial>
Oct 26 00:16:07 user nova-compute[75165]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 26 00:16:07 user nova-compute[75165]: </disk>
Oct 26 00:16:07 user nova-compute[75165]:  {{(pid=75165) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 00:16:07 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-d775589a-197e-4f7a-a1a2-b2dcbc09c4f4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Successfully detached device vdb from instance 22b9689c-5e83-4807-971f-5b244914b7e5 from the persistent domain config.
Oct 26 00:16:07 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-d775589a-197e-4f7a-a1a2-b2dcbc09c4f4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 22b9689c-5e83-4807-971f-5b244914b7e5 from the live domain config. {{(pid=75165) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 00:16:07 user nova-compute[75165]: DEBUG nova.virt.libvirt.guest [None req-d775589a-197e-4f7a-a1a2-b2dcbc09c4f4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 00:16:07 user nova-compute[75165]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 00:16:07 user nova-compute[75165]:   <source dev="/dev/sdc"/>
Oct 26 00:16:07 user nova-compute[75165]:   <target dev="vdb" bus="virtio"/>
Oct 26 00:16:07 user nova-compute[75165]:   <serial>33bd85b7-301b-434f-b1af-a682c33cf49b</serial>
Oct 26 00:16:07 user nova-compute[75165]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 26 00:16:07 user nova-compute[75165]: </disk>
Oct 26 00:16:07 user nova-compute[75165]:  {{(pid=75165) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 00:16:07 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:16:07 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Starting heal instance info cache {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 00:16:07 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "refresh_cache-84c6b624-648b-40e2-a37e-ff08609bad84" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:16:07 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquired lock "refresh_cache-84c6b624-648b-40e2-a37e-ff08609bad84" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:16:07 user nova-compute[75165]: DEBUG nova.network.neutron [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: 84c6b624-648b-40e2-a37e-ff08609bad84] Forcefully refreshing network info cache for instance {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 00:16:07 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-d775589a-197e-4f7a-a1a2-b2dcbc09c4f4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 22b9689c-5e83-4807-971f-5b244914b7e5 {{(pid=75165) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 00:16:08 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:16:08 user nova-compute[75165]: DEBUG nova.network.neutron [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: 84c6b624-648b-40e2-a37e-ff08609bad84] Updating instance_info_cache with network_info: [{"id": "2107529c-ec0e-4d1d-85b4-8605dcabc415", "address": "fa:16:3e:0c:8a:94", "network": {"id": "b31bac4b-1951-4ca3-8682-f1f24de0a5c3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1323234642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71aa69c0ea2d49e184e1e055ff3efa1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2107529c-ec", "ovs_interfaceid": "2107529c-ec0e-4d1d-85b4-8605dcabc415", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:16:08 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Releasing lock "refresh_cache-84c6b624-648b-40e2-a37e-ff08609bad84" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:16:08 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: 84c6b624-648b-40e2-a37e-ff08609bad84] Updated the network info_cache for instance {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 00:16:08 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:16:08 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:16:08 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:16:08 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:16:08 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:16:08 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75165) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 00:16:08 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9633e6bb-5e95-4994-92a2-9d8f85a946ff/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:16:08 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9633e6bb-5e95-4994-92a2-9d8f85a946ff/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:16:08 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9633e6bb-5e95-4994-92a2-9d8f85a946ff/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:16:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9633e6bb-5e95-4994-92a2-9d8f85a946ff/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:16:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84c6b624-648b-40e2-a37e-ff08609bad84/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:16:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84c6b624-648b-40e2-a37e-ff08609bad84/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:16:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84c6b624-648b-40e2-a37e-ff08609bad84/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:16:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84c6b624-648b-40e2-a37e-ff08609bad84/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:16:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7eeb145-1565-4812-818b-fefda5f2436d/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:16:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7eeb145-1565-4812-818b-fefda5f2436d/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:16:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7eeb145-1565-4812-818b-fefda5f2436d/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:16:10 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7eeb145-1565-4812-818b-fefda5f2436d/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:16:10 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3150d249-37a2-49c6-837a-3828480fa2b4/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:16:10 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:16:10 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3150d249-37a2-49c6-837a-3828480fa2b4/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:16:10 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3150d249-37a2-49c6-837a-3828480fa2b4/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:16:10 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3150d249-37a2-49c6-837a-3828480fa2b4/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:16:10 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b9689c-5e83-4807-971f-5b244914b7e5/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:16:10 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b9689c-5e83-4807-971f-5b244914b7e5/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:16:10 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b9689c-5e83-4807-971f-5b244914b7e5/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:16:10 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:16:11 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22b9689c-5e83-4807-971f-5b244914b7e5/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:16:11 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c7002e2-b98f-48e4-b099-9c8b756fd0ae/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:16:11 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:16:11 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c7002e2-b98f-48e4-b099-9c8b756fd0ae/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:16:11 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c7002e2-b98f-48e4-b099-9c8b756fd0ae/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:16:11 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c7002e2-b98f-48e4-b099-9c8b756fd0ae/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:16:11 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e44bfc-6a68-46ce-8335-aaaba5160d3e/disk.rescue --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:16:11 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e44bfc-6a68-46ce-8335-aaaba5160d3e/disk.rescue --force-share --output=json" returned: 0 in 0.212s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:16:11 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e44bfc-6a68-46ce-8335-aaaba5160d3e/disk.rescue --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:16:11 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e44bfc-6a68-46ce-8335-aaaba5160d3e/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:16:11 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e44bfc-6a68-46ce-8335-aaaba5160d3e/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:16:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e44bfc-6a68-46ce-8335-aaaba5160d3e/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:16:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e44bfc-6a68-46ce-8335-aaaba5160d3e/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:16:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e44bfc-6a68-46ce-8335-aaaba5160d3e/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:16:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27fa1771-fb69-49da-81b3-7f112e623170/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:16:12 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-ec20775f-af46-4665-88c0-bf9e5aa7837e tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Acquiring lock "9633e6bb-5e95-4994-92a2-9d8f85a946ff" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:16:12 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-ec20775f-af46-4665-88c0-bf9e5aa7837e tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Lock "9633e6bb-5e95-4994-92a2-9d8f85a946ff" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:16:12 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-ec20775f-af46-4665-88c0-bf9e5aa7837e tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Acquiring lock "9633e6bb-5e95-4994-92a2-9d8f85a946ff-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:16:12 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-ec20775f-af46-4665-88c0-bf9e5aa7837e tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Lock "9633e6bb-5e95-4994-92a2-9d8f85a946ff-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:16:12 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-ec20775f-af46-4665-88c0-bf9e5aa7837e tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Lock "9633e6bb-5e95-4994-92a2-9d8f85a946ff-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:16:12 user nova-compute[75165]: INFO nova.compute.manager [None req-ec20775f-af46-4665-88c0-bf9e5aa7837e tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] [instance: 9633e6bb-5e95-4994-92a2-9d8f85a946ff] Terminating instance
Oct 26 00:16:12 user nova-compute[75165]: DEBUG nova.compute.manager [None req-ec20775f-af46-4665-88c0-bf9e5aa7837e tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] [instance: 9633e6bb-5e95-4994-92a2-9d8f85a946ff] Start destroying the instance on the hypervisor. {{(pid=75165) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 00:16:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27fa1771-fb69-49da-81b3-7f112e623170/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:16:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27fa1771-fb69-49da-81b3-7f112e623170/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:16:12 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:16:12 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:16:12 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:16:12 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:16:12 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:16:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27fa1771-fb69-49da-81b3-7f112e623170/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:16:12 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75165) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 00:16:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b153af2-c93b-47d2-ae8c-76cfd44e384c/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:16:12 user nova-compute[75165]: DEBUG nova.compute.manager [req-dcec0221-6c96-4d05-91e5-5656e79a5ee7 req-3eb9daf7-c1b3-43a6-b76c-cb177390216f service nova] [instance: 9633e6bb-5e95-4994-92a2-9d8f85a946ff] Received event network-vif-unplugged-6beaf63f-0750-4c6a-b0bd-ebfbca211ad1 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:16:12 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-dcec0221-6c96-4d05-91e5-5656e79a5ee7 req-3eb9daf7-c1b3-43a6-b76c-cb177390216f service nova] Acquiring lock "9633e6bb-5e95-4994-92a2-9d8f85a946ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:16:12 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-dcec0221-6c96-4d05-91e5-5656e79a5ee7 req-3eb9daf7-c1b3-43a6-b76c-cb177390216f service nova] Lock "9633e6bb-5e95-4994-92a2-9d8f85a946ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:16:12 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-dcec0221-6c96-4d05-91e5-5656e79a5ee7 req-3eb9daf7-c1b3-43a6-b76c-cb177390216f service nova] Lock "9633e6bb-5e95-4994-92a2-9d8f85a946ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:16:12 user nova-compute[75165]: DEBUG nova.compute.manager [req-dcec0221-6c96-4d05-91e5-5656e79a5ee7 req-3eb9daf7-c1b3-43a6-b76c-cb177390216f service nova] [instance: 9633e6bb-5e95-4994-92a2-9d8f85a946ff] No waiting events found dispatching network-vif-unplugged-6beaf63f-0750-4c6a-b0bd-ebfbca211ad1 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:16:12 user nova-compute[75165]: DEBUG nova.compute.manager [req-dcec0221-6c96-4d05-91e5-5656e79a5ee7 req-3eb9daf7-c1b3-43a6-b76c-cb177390216f service nova] [instance: 9633e6bb-5e95-4994-92a2-9d8f85a946ff] Received event network-vif-unplugged-6beaf63f-0750-4c6a-b0bd-ebfbca211ad1 for instance with task_state deleting. {{(pid=75165) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 00:16:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b153af2-c93b-47d2-ae8c-76cfd44e384c/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:16:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b153af2-c93b-47d2-ae8c-76cfd44e384c/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:16:13 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b153af2-c93b-47d2-ae8c-76cfd44e384c/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:16:13 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75165) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 00:16:13 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f8ec77f-bf35-4b15-bd77-9f8407b09d0b/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:16:13 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: 9633e6bb-5e95-4994-92a2-9d8f85a946ff] Instance destroyed successfully.
Oct 26 00:16:13 user nova-compute[75165]: DEBUG nova.objects.instance [None req-ec20775f-af46-4665-88c0-bf9e5aa7837e tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Lazy-loading 'resources' on Instance uuid 9633e6bb-5e95-4994-92a2-9d8f85a946ff {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:16:13 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-ec20775f-af46-4665-88c0-bf9e5aa7837e tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:07:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1900438134',display_name='tempest-ServersNegativeTestJSON-server-1900438134',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1900438134',id=1,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-26T00:07:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='410dcedc2c3c49c3990259eca1aee491',ramdisk_id='',reservation_id='r-aaqcpij4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-585947888',owner_user_name='tempest-ServersNegativeTestJSON-585947888-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T00:07:27Z,user_data=None,user_id='d86fd0a8654f412d8c4e8e14d408d7ed',uuid=9633e6bb-5e95-4994-92a2-9d8f85a946ff,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6beaf63f-0750-4c6a-b0bd-ebfbca211ad1", "address": "fa:16:3e:c1:5c:f3", "network": {"id": "6344595d-af28-41d8-9091-f7565d587f85", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-916895889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "410dcedc2c3c49c3990259eca1aee491", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6beaf63f-07", "ovs_interfaceid": "6beaf63f-0750-4c6a-b0bd-ebfbca211ad1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 00:16:13 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-ec20775f-af46-4665-88c0-bf9e5aa7837e tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Converting VIF {"id": "6beaf63f-0750-4c6a-b0bd-ebfbca211ad1", "address": "fa:16:3e:c1:5c:f3", "network": {"id": "6344595d-af28-41d8-9091-f7565d587f85", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-916895889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "410dcedc2c3c49c3990259eca1aee491", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6beaf63f-07", "ovs_interfaceid": "6beaf63f-0750-4c6a-b0bd-ebfbca211ad1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:16:13 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-ec20775f-af46-4665-88c0-bf9e5aa7837e tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c1:5c:f3,bridge_name='br-int',has_traffic_filtering=True,id=6beaf63f-0750-4c6a-b0bd-ebfbca211ad1,network=Network(6344595d-af28-41d8-9091-f7565d587f85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6beaf63f-07') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:16:13 user nova-compute[75165]: DEBUG os_vif [None req-ec20775f-af46-4665-88c0-bf9e5aa7837e tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c1:5c:f3,bridge_name='br-int',has_traffic_filtering=True,id=6beaf63f-0750-4c6a-b0bd-ebfbca211ad1,network=Network(6344595d-af28-41d8-9091-f7565d587f85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6beaf63f-07') {{(pid=75165) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 00:16:13 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:16:13 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6beaf63f-07, bridge=br-int, if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:16:13 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:16:13 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:16:13 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:16:13 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:16:13 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=31e33527-9104-4ff7-a0b0-ab1dfb79644a) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:16:13 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:16:13 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:16:13 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:16:13 user nova-compute[75165]: INFO os_vif [None req-ec20775f-af46-4665-88c0-bf9e5aa7837e tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c1:5c:f3,bridge_name='br-int',has_traffic_filtering=True,id=6beaf63f-0750-4c6a-b0bd-ebfbca211ad1,network=Network(6344595d-af28-41d8-9091-f7565d587f85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6beaf63f-07')
Oct 26 00:16:13 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-ec20775f-af46-4665-88c0-bf9e5aa7837e tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] [instance: 9633e6bb-5e95-4994-92a2-9d8f85a946ff] Deleting instance files /opt/stack/data/nova/instances/9633e6bb-5e95-4994-92a2-9d8f85a946ff_del
Oct 26 00:16:13 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-ec20775f-af46-4665-88c0-bf9e5aa7837e tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] [instance: 9633e6bb-5e95-4994-92a2-9d8f85a946ff] Deletion of /opt/stack/data/nova/instances/9633e6bb-5e95-4994-92a2-9d8f85a946ff_del complete
Oct 26 00:16:13 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f8ec77f-bf35-4b15-bd77-9f8407b09d0b/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:16:13 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f8ec77f-bf35-4b15-bd77-9f8407b09d0b/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:16:13 user nova-compute[75165]: INFO nova.compute.manager [None req-ec20775f-af46-4665-88c0-bf9e5aa7837e tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] [instance: 9633e6bb-5e95-4994-92a2-9d8f85a946ff] Took 1.02 seconds to destroy the instance on the hypervisor.
Oct 26 00:16:13 user nova-compute[75165]: DEBUG oslo.service.loopingcall [None req-ec20775f-af46-4665-88c0-bf9e5aa7837e tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75165) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 00:16:13 user nova-compute[75165]: DEBUG nova.compute.manager [-] [instance: 9633e6bb-5e95-4994-92a2-9d8f85a946ff] Deallocating network for instance {{(pid=75165) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 00:16:13 user nova-compute[75165]: DEBUG nova.network.neutron [-] [instance: 9633e6bb-5e95-4994-92a2-9d8f85a946ff] deallocate_for_instance() {{(pid=75165) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 00:16:13 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f8ec77f-bf35-4b15-bd77-9f8407b09d0b/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:16:13 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91fe894a-90a8-4545-9b27-91771554c4cb/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:16:13 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91fe894a-90a8-4545-9b27-91771554c4cb/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:16:13 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91fe894a-90a8-4545-9b27-91771554c4cb/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:16:13 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-0cb42902-b099-4365-961f-5b19b15944ab tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] Waiting for libvirt event about the detach of device tap2f0902fc-12 with device alias net1 from instance 8f8ec77f-bf35-4b15-bd77-9f8407b09d0b is timed out.
Oct 26 00:16:13 user nova-compute[75165]: DEBUG nova.virt.libvirt.guest [None req-0cb42902-b099-4365-961f-5b19b15944ab tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:f6:ac:95"/><model type="virtio"/><mtu size="1442"/><target dev="tap2f0902fc-12"/></interface> {{(pid=75165) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 26 00:16:13 user nova-compute[75165]: DEBUG nova.virt.libvirt.guest [None req-0cb42902-b099-4365-961f-5b19b15944ab tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:f6:ac:95"/><model type="virtio"/><mtu size="1442"/><target dev="tap2f0902fc-12"/></interface>not found in domain: <domain type='kvm' id='23'>
Oct 26 00:16:13 user nova-compute[75165]:   <name>instance-00000013</name>
Oct 26 00:16:13 user nova-compute[75165]:   <uuid>8f8ec77f-bf35-4b15-bd77-9f8407b09d0b</uuid>
Oct 26 00:16:13 user nova-compute[75165]:   <metadata>
Oct 26 00:16:13 user nova-compute[75165]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 00:16:13 user nova-compute[75165]:   <nova:package version="0.0.0"/>
Oct 26 00:16:13 user nova-compute[75165]:   <nova:name>tempest-device-tagging-server-1656940732</nova:name>
Oct 26 00:16:13 user nova-compute[75165]:   <nova:creationTime>2023-10-26 00:14:30</nova:creationTime>
Oct 26 00:16:13 user nova-compute[75165]:   <nova:flavor name="m1.tiny">
Oct 26 00:16:13 user nova-compute[75165]:     <nova:memory>512</nova:memory>
Oct 26 00:16:13 user nova-compute[75165]:     <nova:disk>1</nova:disk>
Oct 26 00:16:13 user nova-compute[75165]:     <nova:swap>0</nova:swap>
Oct 26 00:16:13 user nova-compute[75165]:     <nova:ephemeral>0</nova:ephemeral>
Oct 26 00:16:13 user nova-compute[75165]:     <nova:vcpus>1</nova:vcpus>
Oct 26 00:16:13 user nova-compute[75165]:   </nova:flavor>
Oct 26 00:16:13 user nova-compute[75165]:   <nova:owner>
Oct 26 00:16:13 user nova-compute[75165]:     <nova:user uuid="93efb23845e441bc932910691dfaf023">tempest-TaggedAttachmentsTest-950905423-project-member</nova:user>
Oct 26 00:16:13 user nova-compute[75165]:     <nova:project uuid="da5b9c2d1b1e4d9d885fa82f1625b5e0">tempest-TaggedAttachmentsTest-950905423</nova:project>
Oct 26 00:16:13 user nova-compute[75165]:   </nova:owner>
Oct 26 00:16:13 user nova-compute[75165]:   <nova:root type="image" uuid="bff0d8a1-739e-4c4d-9efa-b73ba7b76d01"/>
Oct 26 00:16:13 user nova-compute[75165]:   <nova:ports>
Oct 26 00:16:13 user nova-compute[75165]:     <nova:port uuid="7f5b9415-3336-49cc-8909-c21c7003e6fe">
Oct 26 00:16:13 user nova-compute[75165]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 26 00:16:13 user nova-compute[75165]:     </nova:port>
Oct 26 00:16:13 user nova-compute[75165]:     <nova:port uuid="2f0902fc-120b-4c3a-aaa8-a441d61ad5e8">
Oct 26 00:16:13 user nova-compute[75165]:       <nova:ip type="fixed" address="10.10.10.81" ipVersion="4"/>
Oct 26 00:16:13 user nova-compute[75165]:     </nova:port>
Oct 26 00:16:13 user nova-compute[75165]:   </nova:ports>
Oct 26 00:16:13 user nova-compute[75165]: </nova:instance>
Oct 26 00:16:13 user nova-compute[75165]:   </metadata>
Oct 26 00:16:13 user nova-compute[75165]:   <memory unit='KiB'>524288</memory>
Oct 26 00:16:13 user nova-compute[75165]:   <currentMemory unit='KiB'>524288</currentMemory>
Oct 26 00:16:13 user nova-compute[75165]:   <vcpu placement='static'>1</vcpu>
Oct 26 00:16:13 user nova-compute[75165]:   <resource>
Oct 26 00:16:13 user nova-compute[75165]:     <partition>/machine</partition>
Oct 26 00:16:13 user nova-compute[75165]:   </resource>
Oct 26 00:16:13 user nova-compute[75165]:   <sysinfo type='smbios'>
Oct 26 00:16:13 user nova-compute[75165]:     <system>
Oct 26 00:16:13 user nova-compute[75165]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Oct 26 00:16:13 user nova-compute[75165]:       <entry name='product'>OpenStack Nova</entry>
Oct 26 00:16:13 user nova-compute[75165]:       <entry name='version'>0.0.0</entry>
Oct 26 00:16:13 user nova-compute[75165]:       <entry name='serial'>8f8ec77f-bf35-4b15-bd77-9f8407b09d0b</entry>
Oct 26 00:16:13 user nova-compute[75165]:       <entry name='uuid'>8f8ec77f-bf35-4b15-bd77-9f8407b09d0b</entry>
Oct 26 00:16:13 user nova-compute[75165]:       <entry name='family'>Virtual Machine</entry>
Oct 26 00:16:13 user nova-compute[75165]:     </system>
Oct 26 00:16:13 user nova-compute[75165]:   </sysinfo>
Oct 26 00:16:13 user nova-compute[75165]:   <os>
Oct 26 00:16:13 user nova-compute[75165]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Oct 26 00:16:13 user nova-compute[75165]:     <boot dev='hd'/>
Oct 26 00:16:13 user nova-compute[75165]:     <smbios mode='sysinfo'/>
Oct 26 00:16:13 user nova-compute[75165]:   </os>
Oct 26 00:16:13 user nova-compute[75165]:   <features>
Oct 26 00:16:13 user nova-compute[75165]:     <acpi/>
Oct 26 00:16:13 user nova-compute[75165]:     <apic/>
Oct 26 00:16:13 user nova-compute[75165]:     <vmcoreinfo state='on'/>
Oct 26 00:16:13 user nova-compute[75165]:   </features>
Oct 26 00:16:13 user nova-compute[75165]:   <cpu mode='custom' match='exact' check='full'>
Oct 26 00:16:13 user nova-compute[75165]:     <model fallback='forbid'>Nehalem</model>
Oct 26 00:16:13 user nova-compute[75165]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Oct 26 00:16:13 user nova-compute[75165]:     <feature policy='require' name='vme'/>
Oct 26 00:16:13 user nova-compute[75165]:     <feature policy='require' name='x2apic'/>
Oct 26 00:16:13 user nova-compute[75165]:     <feature policy='require' name='hypervisor'/>
Oct 26 00:16:13 user nova-compute[75165]:   </cpu>
Oct 26 00:16:13 user nova-compute[75165]:   <clock offset='utc'>
Oct 26 00:16:13 user nova-compute[75165]:     <timer name='pit' tickpolicy='delay'/>
Oct 26 00:16:13 user nova-compute[75165]:     <timer name='rtc' tickpolicy='catchup'/>
Oct 26 00:16:13 user nova-compute[75165]:     <timer name='hpet' present='no'/>
Oct 26 00:16:13 user nova-compute[75165]:   </clock>
Oct 26 00:16:13 user nova-compute[75165]:   <on_poweroff>destroy</on_poweroff>
Oct 26 00:16:13 user nova-compute[75165]:   <on_reboot>restart</on_reboot>
Oct 26 00:16:13 user nova-compute[75165]:   <on_crash>destroy</on_crash>
Oct 26 00:16:13 user nova-compute[75165]:   <devices>
Oct 26 00:16:13 user nova-compute[75165]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 26 00:16:13 user nova-compute[75165]:     <disk type='file' device='disk'>
Oct 26 00:16:13 user nova-compute[75165]:       <driver name='qemu' type='qcow2' cache='none'/>
Oct 26 00:16:13 user nova-compute[75165]:       <source file='/opt/stack/data/nova/instances/8f8ec77f-bf35-4b15-bd77-9f8407b09d0b/disk' index='2'/>
Oct 26 00:16:13 user nova-compute[75165]:       <backingStore type='file' index='3'>
Oct 26 00:16:13 user nova-compute[75165]:         <format type='raw'/>
Oct 26 00:16:13 user nova-compute[75165]:         <source file='/opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466'/>
Oct 26 00:16:13 user nova-compute[75165]:         <backingStore/>
Oct 26 00:16:13 user nova-compute[75165]:       </backingStore>
Oct 26 00:16:13 user nova-compute[75165]:       <target dev='vda' bus='virtio'/>
Oct 26 00:16:13 user nova-compute[75165]:       <alias name='virtio-disk0'/>
Oct 26 00:16:13 user nova-compute[75165]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Oct 26 00:16:13 user nova-compute[75165]:     </disk>
Oct 26 00:16:13 user nova-compute[75165]:     <disk type='file' device='cdrom'>
Oct 26 00:16:13 user nova-compute[75165]:       <driver name='qemu' type='raw' cache='none'/>
Oct 26 00:16:13 user nova-compute[75165]:       <source file='/opt/stack/data/nova/instances/8f8ec77f-bf35-4b15-bd77-9f8407b09d0b/disk.config' index='1'/>
Oct 26 00:16:13 user nova-compute[75165]:       <backingStore/>
Oct 26 00:16:13 user nova-compute[75165]:       <target dev='hda' bus='ide'/>
Oct 26 00:16:13 user nova-compute[75165]:       <readonly/>
Oct 26 00:16:13 user nova-compute[75165]:       <alias name='ide0-0-0'/>
Oct 26 00:16:13 user nova-compute[75165]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Oct 26 00:16:13 user nova-compute[75165]:     </disk>
Oct 26 00:16:13 user nova-compute[75165]:     <controller type='usb' index='0' model='none'>
Oct 26 00:16:13 user nova-compute[75165]:       <alias name='usb'/>
Oct 26 00:16:13 user nova-compute[75165]:     </controller>
Oct 26 00:16:13 user nova-compute[75165]:     <controller type='pci' index='0' model='pci-root'>
Oct 26 00:16:13 user nova-compute[75165]:       <alias name='pci.0'/>
Oct 26 00:16:13 user nova-compute[75165]:     </controller>
Oct 26 00:16:13 user nova-compute[75165]:     <controller type='ide' index='0'>
Oct 26 00:16:13 user nova-compute[75165]:       <alias name='ide'/>
Oct 26 00:16:13 user nova-compute[75165]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Oct 26 00:16:13 user nova-compute[75165]:     </controller>
Oct 26 00:16:13 user nova-compute[75165]:     <interface type='ethernet'>
Oct 26 00:16:13 user nova-compute[75165]:       <mac address='fa:16:3e:c8:5c:77'/>
Oct 26 00:16:13 user nova-compute[75165]:       <target dev='tap7f5b9415-33'/>
Oct 26 00:16:13 user nova-compute[75165]:       <model type='virtio'/>
Oct 26 00:16:13 user nova-compute[75165]:       <mtu size='1442'/>
Oct 26 00:16:13 user nova-compute[75165]:       <alias name='net0'/>
Oct 26 00:16:13 user nova-compute[75165]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Oct 26 00:16:13 user nova-compute[75165]:     </interface>
Oct 26 00:16:13 user nova-compute[75165]:     <serial type='pty'>
Oct 26 00:16:13 user nova-compute[75165]:       <source path='/dev/pts/9'/>
Oct 26 00:16:13 user nova-compute[75165]:       <log file='/opt/stack/data/nova/instances/8f8ec77f-bf35-4b15-bd77-9f8407b09d0b/console.log' append='off'/>
Oct 26 00:16:13 user nova-compute[75165]:       <target type='isa-serial' port='0'>
Oct 26 00:16:13 user nova-compute[75165]:         <model name='isa-serial'/>
Oct 26 00:16:13 user nova-compute[75165]:       </target>
Oct 26 00:16:13 user nova-compute[75165]:       <alias name='serial0'/>
Oct 26 00:16:13 user nova-compute[75165]:     </serial>
Oct 26 00:16:13 user nova-compute[75165]:     <console type='pty' tty='/dev/pts/9'>
Oct 26 00:16:13 user nova-compute[75165]:       <source path='/dev/pts/9'/>
Oct 26 00:16:13 user nova-compute[75165]:       <log file='/opt/stack/data/nova/instances/8f8ec77f-bf35-4b15-bd77-9f8407b09d0b/console.log' append='off'/>
Oct 26 00:16:13 user nova-compute[75165]:       <target type='serial' port='0'/>
Oct 26 00:16:13 user nova-compute[75165]:       <alias name='serial0'/>
Oct 26 00:16:13 user nova-compute[75165]:     </console>
Oct 26 00:16:13 user nova-compute[75165]:     <input type='mouse' bus='ps2'>
Oct 26 00:16:13 user nova-compute[75165]:       <alias name='input0'/>
Oct 26 00:16:13 user nova-compute[75165]:     </input>
Oct 26 00:16:13 user nova-compute[75165]:     <input type='keyboard' bus='ps2'>
Oct 26 00:16:13 user nova-compute[75165]:       <alias name='input1'/>
Oct 26 00:16:13 user nova-compute[75165]:     </input>
Oct 26 00:16:13 user nova-compute[75165]:     <graphics type='vnc' port='5910' autoport='yes' listen='0.0.0.0'>
Oct 26 00:16:13 user nova-compute[75165]:       <listen type='address' address='0.0.0.0'/>
Oct 26 00:16:13 user nova-compute[75165]:     </graphics>
Oct 26 00:16:13 user nova-compute[75165]:     <audio id='1' type='none'/>
Oct 26 00:16:13 user nova-compute[75165]:     <video>
Oct 26 00:16:13 user nova-compute[75165]:       <model type='virtio' heads='1' primary='yes'/>
Oct 26 00:16:13 user nova-compute[75165]:       <alias name='video0'/>
Oct 26 00:16:13 user nova-compute[75165]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Oct 26 00:16:13 user nova-compute[75165]:     </video>
Oct 26 00:16:13 user nova-compute[75165]:     <memballoon model='virtio'>
Oct 26 00:16:13 user nova-compute[75165]:       <stats period='10'/>
Oct 26 00:16:13 user nova-compute[75165]:       <alias name='balloon0'/>
Oct 26 00:16:13 user nova-compute[75165]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Oct 26 00:16:13 user nova-compute[75165]:     </memballoon>
Oct 26 00:16:13 user nova-compute[75165]:     <rng model='virtio'>
Oct 26 00:16:13 user nova-compute[75165]:       <backend model='random'>/dev/urandom</backend>
Oct 26 00:16:13 user nova-compute[75165]:       <alias name='rng0'/>
Oct 26 00:16:13 user nova-compute[75165]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Oct 26 00:16:13 user nova-compute[75165]:     </rng>
Oct 26 00:16:13 user nova-compute[75165]:   </devices>
Oct 26 00:16:13 user nova-compute[75165]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Oct 26 00:16:13 user nova-compute[75165]:     <label>libvirt-8f8ec77f-bf35-4b15-bd77-9f8407b09d0b</label>
Oct 26 00:16:13 user nova-compute[75165]:     <imagelabel>libvirt-8f8ec77f-bf35-4b15-bd77-9f8407b09d0b</imagelabel>
Oct 26 00:16:13 user nova-compute[75165]:   </seclabel>
Oct 26 00:16:13 user nova-compute[75165]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Oct 26 00:16:13 user nova-compute[75165]:     <label>+64055:+108</label>
Oct 26 00:16:13 user nova-compute[75165]:     <imagelabel>+64055:+108</imagelabel>
Oct 26 00:16:13 user nova-compute[75165]:   </seclabel>
Oct 26 00:16:13 user nova-compute[75165]: </domain>
Oct 26 00:16:13 user nova-compute[75165]:  {{(pid=75165) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Oct 26 00:16:13 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-0cb42902-b099-4365-961f-5b19b15944ab tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] Successfully detached device tap2f0902fc-12 from instance 8f8ec77f-bf35-4b15-bd77-9f8407b09d0b from the live domain config.
Oct 26 00:16:13 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-0cb42902-b099-4365-961f-5b19b15944ab tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T00:12:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1656940732',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1656940732',id=19,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN+wbYUhWvc0Q8Ki4GTS2Tn91hUUyA5mHnOcmOrTkWVgToMqNtiT9k+t+ZtOfljqpTvTwcwIhu3LxiFs8eVVq6KIF4bfjQF4bPry0REDa8gn1PrkrDV91CuU9Osr0XBN6A==',key_name='tempest-keypair-1700446792',keypairs=<?>,launch_index=0,launched_at=2023-10-26T00:12:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='da5b9c2d1b1e4d9d885fa82f1625b5e0',ramdisk_id='',reservation_id='r-wb7qp03s',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-950905423',owner_user_name='tempest-TaggedAttachmentsTest-950905423-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T00:12:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='93efb23845e441bc932910691dfaf023',uuid=8f8ec77f-bf35-4b15-bd77-9f8407b09d0b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2f0902fc-120b-4c3a-aaa8-a441d61ad5e8", "address": "fa:16:3e:f6:ac:95", "network": {"id": "aa33c3e8-4f0d-4863-866b-995c0af9ed27", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-650788755", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.81", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "da5b9c2d1b1e4d9d885fa82f1625b5e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f0902fc-12", "ovs_interfaceid": "2f0902fc-120b-4c3a-aaa8-a441d61ad5e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 00:16:13 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-0cb42902-b099-4365-961f-5b19b15944ab tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] Converting VIF {"id": "2f0902fc-120b-4c3a-aaa8-a441d61ad5e8", "address": "fa:16:3e:f6:ac:95", "network": {"id": "aa33c3e8-4f0d-4863-866b-995c0af9ed27", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-650788755", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.81", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "da5b9c2d1b1e4d9d885fa82f1625b5e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f0902fc-12", "ovs_interfaceid": "2f0902fc-120b-4c3a-aaa8-a441d61ad5e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:16:13 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-0cb42902-b099-4365-961f-5b19b15944ab tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:ac:95,bridge_name='br-int',has_traffic_filtering=True,id=2f0902fc-120b-4c3a-aaa8-a441d61ad5e8,network=Network(aa33c3e8-4f0d-4863-866b-995c0af9ed27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f0902fc-12') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:16:13 user nova-compute[75165]: DEBUG os_vif [None req-0cb42902-b099-4365-961f-5b19b15944ab tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:ac:95,bridge_name='br-int',has_traffic_filtering=True,id=2f0902fc-120b-4c3a-aaa8-a441d61ad5e8,network=Network(aa33c3e8-4f0d-4863-866b-995c0af9ed27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f0902fc-12') {{(pid=75165) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 00:16:13 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:16:13 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2f0902fc-12, bridge=br-int, if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:16:13 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:16:13 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:16:13 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:16:13 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e81df954-9e86-4af1-a12c-4225923e3c9d) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:16:13 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:16:13 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:16:14 user nova-compute[75165]: INFO os_vif [None req-0cb42902-b099-4365-961f-5b19b15944ab tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:ac:95,bridge_name='br-int',has_traffic_filtering=True,id=2f0902fc-120b-4c3a-aaa8-a441d61ad5e8,network=Network(aa33c3e8-4f0d-4863-866b-995c0af9ed27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f0902fc-12')
Oct 26 00:16:14 user nova-compute[75165]: DEBUG nova.virt.libvirt.guest [None req-0cb42902-b099-4365-961f-5b19b15944ab tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 00:16:14 user nova-compute[75165]:   <nova:package version="0.0.0"/>
Oct 26 00:16:14 user nova-compute[75165]:   <nova:name>tempest-device-tagging-server-1656940732</nova:name>
Oct 26 00:16:14 user nova-compute[75165]:   <nova:creationTime>2023-10-26 00:16:14</nova:creationTime>
Oct 26 00:16:14 user nova-compute[75165]:   <nova:flavor name="m1.tiny">
Oct 26 00:16:14 user nova-compute[75165]:     <nova:memory>512</nova:memory>
Oct 26 00:16:14 user nova-compute[75165]:     <nova:disk>1</nova:disk>
Oct 26 00:16:14 user nova-compute[75165]:     <nova:swap>0</nova:swap>
Oct 26 00:16:14 user nova-compute[75165]:     <nova:ephemeral>0</nova:ephemeral>
Oct 26 00:16:14 user nova-compute[75165]:     <nova:vcpus>1</nova:vcpus>
Oct 26 00:16:14 user nova-compute[75165]:   </nova:flavor>
Oct 26 00:16:14 user nova-compute[75165]:   <nova:owner>
Oct 26 00:16:14 user nova-compute[75165]:     <nova:user uuid="93efb23845e441bc932910691dfaf023">tempest-TaggedAttachmentsTest-950905423-project-member</nova:user>
Oct 26 00:16:14 user nova-compute[75165]:     <nova:project uuid="da5b9c2d1b1e4d9d885fa82f1625b5e0">tempest-TaggedAttachmentsTest-950905423</nova:project>
Oct 26 00:16:14 user nova-compute[75165]:   </nova:owner>
Oct 26 00:16:14 user nova-compute[75165]:   <nova:root type="image" uuid="bff0d8a1-739e-4c4d-9efa-b73ba7b76d01"/>
Oct 26 00:16:14 user nova-compute[75165]:   <nova:ports>
Oct 26 00:16:14 user nova-compute[75165]:     <nova:port uuid="7f5b9415-3336-49cc-8909-c21c7003e6fe">
Oct 26 00:16:14 user nova-compute[75165]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 26 00:16:14 user nova-compute[75165]:     </nova:port>
Oct 26 00:16:14 user nova-compute[75165]:   </nova:ports>
Oct 26 00:16:14 user nova-compute[75165]: </nova:instance>
Oct 26 00:16:14 user nova-compute[75165]:  {{(pid=75165) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Oct 26 00:16:14 user nova-compute[75165]: DEBUG nova.network.neutron [-] [instance: 9633e6bb-5e95-4994-92a2-9d8f85a946ff] Updating instance_info_cache with network_info: [] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:16:14 user nova-compute[75165]: INFO nova.compute.manager [-] [instance: 9633e6bb-5e95-4994-92a2-9d8f85a946ff] Took 0.62 seconds to deallocate network for instance.
Oct 26 00:16:14 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91fe894a-90a8-4545-9b27-91771554c4cb/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:16:14 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b041e0af-4635-495c-b72d-fbbbd8d43a9b/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:16:14 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-ec20775f-af46-4665-88c0-bf9e5aa7837e tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:16:14 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-ec20775f-af46-4665-88c0-bf9e5aa7837e tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:16:14 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b041e0af-4635-495c-b72d-fbbbd8d43a9b/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:16:14 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b041e0af-4635-495c-b72d-fbbbd8d43a9b/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:16:14 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-08eb7264-ca23-486f-9cca-e443a6a8161e tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] Acquiring lock "b6558510-6f87-4ef3-b707-f1fa78bf61e8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:16:14 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-08eb7264-ca23-486f-9cca-e443a6a8161e tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] Lock "b6558510-6f87-4ef3-b707-f1fa78bf61e8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:16:14 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b041e0af-4635-495c-b72d-fbbbd8d43a9b/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:16:14 user nova-compute[75165]: DEBUG nova.compute.manager [None req-08eb7264-ca23-486f-9cca-e443a6a8161e tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] [instance: b6558510-6f87-4ef3-b707-f1fa78bf61e8] Starting instance... {{(pid=75165) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 00:16:15 user nova-compute[75165]: DEBUG nova.compute.manager [req-bc06526f-75a6-4c3a-b5d0-5f6208a600da req-ecdef962-9f92-41d1-9af2-49ec2e0d3203 service nova] [instance: 9633e6bb-5e95-4994-92a2-9d8f85a946ff] Received event network-vif-plugged-6beaf63f-0750-4c6a-b0bd-ebfbca211ad1 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:16:15 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-bc06526f-75a6-4c3a-b5d0-5f6208a600da req-ecdef962-9f92-41d1-9af2-49ec2e0d3203 service nova] Acquiring lock "9633e6bb-5e95-4994-92a2-9d8f85a946ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:16:15 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-bc06526f-75a6-4c3a-b5d0-5f6208a600da req-ecdef962-9f92-41d1-9af2-49ec2e0d3203 service nova] Lock "9633e6bb-5e95-4994-92a2-9d8f85a946ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:16:15 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-bc06526f-75a6-4c3a-b5d0-5f6208a600da req-ecdef962-9f92-41d1-9af2-49ec2e0d3203 service nova] Lock "9633e6bb-5e95-4994-92a2-9d8f85a946ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:16:15 user nova-compute[75165]: DEBUG nova.compute.manager [req-bc06526f-75a6-4c3a-b5d0-5f6208a600da req-ecdef962-9f92-41d1-9af2-49ec2e0d3203 service nova] [instance: 9633e6bb-5e95-4994-92a2-9d8f85a946ff] No waiting events found dispatching network-vif-plugged-6beaf63f-0750-4c6a-b0bd-ebfbca211ad1 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:16:15 user nova-compute[75165]: WARNING nova.compute.manager [req-bc06526f-75a6-4c3a-b5d0-5f6208a600da req-ecdef962-9f92-41d1-9af2-49ec2e0d3203 service nova] [instance: 9633e6bb-5e95-4994-92a2-9d8f85a946ff] Received unexpected event network-vif-plugged-6beaf63f-0750-4c6a-b0bd-ebfbca211ad1 for instance with vm_state deleted and task_state None.
Oct 26 00:16:15 user nova-compute[75165]: DEBUG nova.compute.manager [req-bc06526f-75a6-4c3a-b5d0-5f6208a600da req-ecdef962-9f92-41d1-9af2-49ec2e0d3203 service nova] [instance: 9633e6bb-5e95-4994-92a2-9d8f85a946ff] Received event network-vif-deleted-6beaf63f-0750-4c6a-b0bd-ebfbca211ad1 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:16:15 user nova-compute[75165]: DEBUG nova.compute.manager [req-bc06526f-75a6-4c3a-b5d0-5f6208a600da req-ecdef962-9f92-41d1-9af2-49ec2e0d3203 service nova] [instance: 8f8ec77f-bf35-4b15-bd77-9f8407b09d0b] Received event network-vif-deleted-2f0902fc-120b-4c3a-aaa8-a441d61ad5e8 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:16:15 user nova-compute[75165]: INFO nova.compute.manager [req-bc06526f-75a6-4c3a-b5d0-5f6208a600da req-ecdef962-9f92-41d1-9af2-49ec2e0d3203 service nova] [instance: 8f8ec77f-bf35-4b15-bd77-9f8407b09d0b] Neutron deleted interface 2f0902fc-120b-4c3a-aaa8-a441d61ad5e8; detaching it from the instance and deleting it from the info cache
Oct 26 00:16:15 user nova-compute[75165]: DEBUG nova.network.neutron [req-bc06526f-75a6-4c3a-b5d0-5f6208a600da req-ecdef962-9f92-41d1-9af2-49ec2e0d3203 service nova] [instance: 8f8ec77f-bf35-4b15-bd77-9f8407b09d0b] Updating instance_info_cache with network_info: [{"id": "7f5b9415-3336-49cc-8909-c21c7003e6fe", "address": "fa:16:3e:c8:5c:77", "network": {"id": "493a3a47-a5c0-4b54-a13e-e5c39f80e90a", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-218779534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da5b9c2d1b1e4d9d885fa82f1625b5e0", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f5b9415-33", "ovs_interfaceid": "7f5b9415-3336-49cc-8909-c21c7003e6fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:16:15 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:16:15 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:16:15 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Hypervisor/Node resource view: name=user free_ram=7332MB free_disk=25.021591186523438GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75165) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 00:16:15 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:16:15 user nova-compute[75165]: DEBUG nova.objects.instance [req-bc06526f-75a6-4c3a-b5d0-5f6208a600da req-ecdef962-9f92-41d1-9af2-49ec2e0d3203 service nova] Lazy-loading 'system_metadata' on Instance uuid 8f8ec77f-bf35-4b15-bd77-9f8407b09d0b {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:16:15 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-08eb7264-ca23-486f-9cca-e443a6a8161e tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:16:15 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-0cb42902-b099-4365-961f-5b19b15944ab tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] Acquiring lock "refresh_cache-8f8ec77f-bf35-4b15-bd77-9f8407b09d0b" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:16:15 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-0cb42902-b099-4365-961f-5b19b15944ab tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] Acquired lock "refresh_cache-8f8ec77f-bf35-4b15-bd77-9f8407b09d0b" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:16:15 user nova-compute[75165]: DEBUG nova.network.neutron [None req-0cb42902-b099-4365-961f-5b19b15944ab tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] [instance: 8f8ec77f-bf35-4b15-bd77-9f8407b09d0b] Building network info cache for instance {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 00:16:15 user nova-compute[75165]: DEBUG nova.objects.instance [req-bc06526f-75a6-4c3a-b5d0-5f6208a600da req-ecdef962-9f92-41d1-9af2-49ec2e0d3203 service nova] Lazy-loading 'flavor' on Instance uuid 8f8ec77f-bf35-4b15-bd77-9f8407b09d0b {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:16:15 user nova-compute[75165]: DEBUG nova.objects.base [req-bc06526f-75a6-4c3a-b5d0-5f6208a600da req-ecdef962-9f92-41d1-9af2-49ec2e0d3203 service nova] Object Instance<8f8ec77f-bf35-4b15-bd77-9f8407b09d0b> lazy-loaded attributes: system_metadata,flavor {{(pid=75165) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 00:16:15 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [req-bc06526f-75a6-4c3a-b5d0-5f6208a600da req-ecdef962-9f92-41d1-9af2-49ec2e0d3203 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T00:12:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1656940732',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1656940732',id=19,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN+wbYUhWvc0Q8Ki4GTS2Tn91hUUyA5mHnOcmOrTkWVgToMqNtiT9k+t+ZtOfljqpTvTwcwIhu3LxiFs8eVVq6KIF4bfjQF4bPry0REDa8gn1PrkrDV91CuU9Osr0XBN6A==',key_name='tempest-keypair-1700446792',keypairs=<?>,launch_index=0,launched_at=2023-10-26T00:12:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='da5b9c2d1b1e4d9d885fa82f1625b5e0',ramdisk_id='',reservation_id='r-wb7qp03s',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-950905423',owner_user_name='tempest-TaggedAttachmentsTest-950905423-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T00:12:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='93efb23845e441bc932910691dfaf023',uuid=8f8ec77f-bf35-4b15-bd77-9f8407b09d0b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2f0902fc-120b-4c3a-aaa8-a441d61ad5e8", "address": "fa:16:3e:f6:ac:95", "network": {"id": "aa33c3e8-4f0d-4863-866b-995c0af9ed27", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-650788755", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.81", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "da5b9c2d1b1e4d9d885fa82f1625b5e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f0902fc-12", "ovs_interfaceid": "2f0902fc-120b-4c3a-aaa8-a441d61ad5e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75165) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 00:16:15 user nova-compute[75165]: DEBUG nova.network.os_vif_util [req-bc06526f-75a6-4c3a-b5d0-5f6208a600da req-ecdef962-9f92-41d1-9af2-49ec2e0d3203 service nova] Converting VIF {"id": "2f0902fc-120b-4c3a-aaa8-a441d61ad5e8", "address": "fa:16:3e:f6:ac:95", "network": {"id": "aa33c3e8-4f0d-4863-866b-995c0af9ed27", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-650788755", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.81", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "da5b9c2d1b1e4d9d885fa82f1625b5e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f0902fc-12", "ovs_interfaceid": "2f0902fc-120b-4c3a-aaa8-a441d61ad5e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:16:15 user nova-compute[75165]: DEBUG nova.network.os_vif_util [req-bc06526f-75a6-4c3a-b5d0-5f6208a600da req-ecdef962-9f92-41d1-9af2-49ec2e0d3203 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:ac:95,bridge_name='br-int',has_traffic_filtering=True,id=2f0902fc-120b-4c3a-aaa8-a441d61ad5e8,network=Network(aa33c3e8-4f0d-4863-866b-995c0af9ed27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f0902fc-12') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:16:15 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-ec20775f-af46-4665-88c0-bf9e5aa7837e tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:16:15 user nova-compute[75165]: DEBUG nova.virt.libvirt.guest [req-bc06526f-75a6-4c3a-b5d0-5f6208a600da req-ecdef962-9f92-41d1-9af2-49ec2e0d3203 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:f6:ac:95"/><model type="virtio"/><mtu size="1442"/><target dev="tap2f0902fc-12"/></interface> {{(pid=75165) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 26 00:16:15 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-ec20775f-af46-4665-88c0-bf9e5aa7837e tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:16:15 user nova-compute[75165]: DEBUG nova.virt.libvirt.guest [req-bc06526f-75a6-4c3a-b5d0-5f6208a600da req-ecdef962-9f92-41d1-9af2-49ec2e0d3203 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:f6:ac:95"/><model type="virtio"/><mtu size="1442"/><target dev="tap2f0902fc-12"/></interface>not found in domain: <domain type='kvm' id='23'>
Oct 26 00:16:15 user nova-compute[75165]:   <name>instance-00000013</name>
Oct 26 00:16:15 user nova-compute[75165]:   <uuid>8f8ec77f-bf35-4b15-bd77-9f8407b09d0b</uuid>
Oct 26 00:16:15 user nova-compute[75165]:   <metadata>
Oct 26 00:16:15 user nova-compute[75165]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 00:16:15 user nova-compute[75165]:   <nova:package version="0.0.0"/>
Oct 26 00:16:15 user nova-compute[75165]:   <nova:name>tempest-device-tagging-server-1656940732</nova:name>
Oct 26 00:16:15 user nova-compute[75165]:   <nova:creationTime>2023-10-26 00:16:14</nova:creationTime>
Oct 26 00:16:15 user nova-compute[75165]:   <nova:flavor name="m1.tiny">
Oct 26 00:16:15 user nova-compute[75165]:     <nova:memory>512</nova:memory>
Oct 26 00:16:15 user nova-compute[75165]:     <nova:disk>1</nova:disk>
Oct 26 00:16:15 user nova-compute[75165]:     <nova:swap>0</nova:swap>
Oct 26 00:16:15 user nova-compute[75165]:     <nova:ephemeral>0</nova:ephemeral>
Oct 26 00:16:15 user nova-compute[75165]:     <nova:vcpus>1</nova:vcpus>
Oct 26 00:16:15 user nova-compute[75165]:   </nova:flavor>
Oct 26 00:16:15 user nova-compute[75165]:   <nova:owner>
Oct 26 00:16:15 user nova-compute[75165]:     <nova:user uuid="93efb23845e441bc932910691dfaf023">tempest-TaggedAttachmentsTest-950905423-project-member</nova:user>
Oct 26 00:16:15 user nova-compute[75165]:     <nova:project uuid="da5b9c2d1b1e4d9d885fa82f1625b5e0">tempest-TaggedAttachmentsTest-950905423</nova:project>
Oct 26 00:16:15 user nova-compute[75165]:   </nova:owner>
Oct 26 00:16:15 user nova-compute[75165]:   <nova:root type="image" uuid="bff0d8a1-739e-4c4d-9efa-b73ba7b76d01"/>
Oct 26 00:16:15 user nova-compute[75165]:   <nova:ports>
Oct 26 00:16:15 user nova-compute[75165]:     <nova:port uuid="7f5b9415-3336-49cc-8909-c21c7003e6fe">
Oct 26 00:16:15 user nova-compute[75165]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 26 00:16:15 user nova-compute[75165]:     </nova:port>
Oct 26 00:16:15 user nova-compute[75165]:   </nova:ports>
Oct 26 00:16:15 user nova-compute[75165]: </nova:instance>
Oct 26 00:16:15 user nova-compute[75165]:   </metadata>
Oct 26 00:16:15 user nova-compute[75165]:   <memory unit='KiB'>524288</memory>
Oct 26 00:16:15 user nova-compute[75165]:   <currentMemory unit='KiB'>524288</currentMemory>
Oct 26 00:16:15 user nova-compute[75165]:   <vcpu placement='static'>1</vcpu>
Oct 26 00:16:15 user nova-compute[75165]:   <resource>
Oct 26 00:16:15 user nova-compute[75165]:     <partition>/machine</partition>
Oct 26 00:16:15 user nova-compute[75165]:   </resource>
Oct 26 00:16:15 user nova-compute[75165]:   <sysinfo type='smbios'>
Oct 26 00:16:15 user nova-compute[75165]:     <system>
Oct 26 00:16:15 user nova-compute[75165]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Oct 26 00:16:15 user nova-compute[75165]:       <entry name='product'>OpenStack Nova</entry>
Oct 26 00:16:15 user nova-compute[75165]:       <entry name='version'>0.0.0</entry>
Oct 26 00:16:15 user nova-compute[75165]:       <entry name='serial'>8f8ec77f-bf35-4b15-bd77-9f8407b09d0b</entry>
Oct 26 00:16:15 user nova-compute[75165]:       <entry name='uuid'>8f8ec77f-bf35-4b15-bd77-9f8407b09d0b</entry>
Oct 26 00:16:15 user nova-compute[75165]:       <entry name='family'>Virtual Machine</entry>
Oct 26 00:16:15 user nova-compute[75165]:     </system>
Oct 26 00:16:15 user nova-compute[75165]:   </sysinfo>
Oct 26 00:16:15 user nova-compute[75165]:   <os>
Oct 26 00:16:15 user nova-compute[75165]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Oct 26 00:16:15 user nova-compute[75165]:     <boot dev='hd'/>
Oct 26 00:16:15 user nova-compute[75165]:     <smbios mode='sysinfo'/>
Oct 26 00:16:15 user nova-compute[75165]:   </os>
Oct 26 00:16:15 user nova-compute[75165]:   <features>
Oct 26 00:16:15 user nova-compute[75165]:     <acpi/>
Oct 26 00:16:15 user nova-compute[75165]:     <apic/>
Oct 26 00:16:15 user nova-compute[75165]:     <vmcoreinfo state='on'/>
Oct 26 00:16:15 user nova-compute[75165]:   </features>
Oct 26 00:16:15 user nova-compute[75165]:   <cpu mode='custom' match='exact' check='full'>
Oct 26 00:16:15 user nova-compute[75165]:     <model fallback='forbid'>Nehalem</model>
Oct 26 00:16:15 user nova-compute[75165]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Oct 26 00:16:15 user nova-compute[75165]:     <feature policy='require' name='vme'/>
Oct 26 00:16:15 user nova-compute[75165]:     <feature policy='require' name='x2apic'/>
Oct 26 00:16:15 user nova-compute[75165]:     <feature policy='require' name='hypervisor'/>
Oct 26 00:16:15 user nova-compute[75165]:   </cpu>
Oct 26 00:16:15 user nova-compute[75165]:   <clock offset='utc'>
Oct 26 00:16:15 user nova-compute[75165]:     <timer name='pit' tickpolicy='delay'/>
Oct 26 00:16:15 user nova-compute[75165]:     <timer name='rtc' tickpolicy='catchup'/>
Oct 26 00:16:15 user nova-compute[75165]:     <timer name='hpet' present='no'/>
Oct 26 00:16:15 user nova-compute[75165]:   </clock>
Oct 26 00:16:15 user nova-compute[75165]:   <on_poweroff>destroy</on_poweroff>
Oct 26 00:16:15 user nova-compute[75165]:   <on_reboot>restart</on_reboot>
Oct 26 00:16:15 user nova-compute[75165]:   <on_crash>destroy</on_crash>
Oct 26 00:16:15 user nova-compute[75165]:   <devices>
Oct 26 00:16:15 user nova-compute[75165]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 26 00:16:15 user nova-compute[75165]:     <disk type='file' device='disk'>
Oct 26 00:16:15 user nova-compute[75165]:       <driver name='qemu' type='qcow2' cache='none'/>
Oct 26 00:16:15 user nova-compute[75165]:       <source file='/opt/stack/data/nova/instances/8f8ec77f-bf35-4b15-bd77-9f8407b09d0b/disk' index='2'/>
Oct 26 00:16:15 user nova-compute[75165]:       <backingStore type='file' index='3'>
Oct 26 00:16:15 user nova-compute[75165]:         <format type='raw'/>
Oct 26 00:16:15 user nova-compute[75165]:         <source file='/opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466'/>
Oct 26 00:16:15 user nova-compute[75165]:         <backingStore/>
Oct 26 00:16:15 user nova-compute[75165]:       </backingStore>
Oct 26 00:16:15 user nova-compute[75165]:       <target dev='vda' bus='virtio'/>
Oct 26 00:16:15 user nova-compute[75165]:       <alias name='virtio-disk0'/>
Oct 26 00:16:15 user nova-compute[75165]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Oct 26 00:16:15 user nova-compute[75165]:     </disk>
Oct 26 00:16:15 user nova-compute[75165]:     <disk type='file' device='cdrom'>
Oct 26 00:16:15 user nova-compute[75165]:       <driver name='qemu' type='raw' cache='none'/>
Oct 26 00:16:15 user nova-compute[75165]:       <source file='/opt/stack/data/nova/instances/8f8ec77f-bf35-4b15-bd77-9f8407b09d0b/disk.config' index='1'/>
Oct 26 00:16:15 user nova-compute[75165]:       <backingStore/>
Oct 26 00:16:15 user nova-compute[75165]:       <target dev='hda' bus='ide'/>
Oct 26 00:16:15 user nova-compute[75165]:       <readonly/>
Oct 26 00:16:15 user nova-compute[75165]:       <alias name='ide0-0-0'/>
Oct 26 00:16:15 user nova-compute[75165]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Oct 26 00:16:15 user nova-compute[75165]:     </disk>
Oct 26 00:16:15 user nova-compute[75165]:     <controller type='usb' index='0' model='none'>
Oct 26 00:16:15 user nova-compute[75165]:       <alias name='usb'/>
Oct 26 00:16:15 user nova-compute[75165]:     </controller>
Oct 26 00:16:15 user nova-compute[75165]:     <controller type='pci' index='0' model='pci-root'>
Oct 26 00:16:15 user nova-compute[75165]:       <alias name='pci.0'/>
Oct 26 00:16:15 user nova-compute[75165]:     </controller>
Oct 26 00:16:15 user nova-compute[75165]:     <controller type='ide' index='0'>
Oct 26 00:16:15 user nova-compute[75165]:       <alias name='ide'/>
Oct 26 00:16:15 user nova-compute[75165]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Oct 26 00:16:15 user nova-compute[75165]:     </controller>
Oct 26 00:16:15 user nova-compute[75165]:     <interface type='ethernet'>
Oct 26 00:16:15 user nova-compute[75165]:       <mac address='fa:16:3e:c8:5c:77'/>
Oct 26 00:16:15 user nova-compute[75165]:       <target dev='tap7f5b9415-33'/>
Oct 26 00:16:15 user nova-compute[75165]:       <model type='virtio'/>
Oct 26 00:16:15 user nova-compute[75165]:       <mtu size='1442'/>
Oct 26 00:16:15 user nova-compute[75165]:       <alias name='net0'/>
Oct 26 00:16:15 user nova-compute[75165]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Oct 26 00:16:15 user nova-compute[75165]:     </interface>
Oct 26 00:16:15 user nova-compute[75165]:     <serial type='pty'>
Oct 26 00:16:15 user nova-compute[75165]:       <source path='/dev/pts/9'/>
Oct 26 00:16:15 user nova-compute[75165]:       <log file='/opt/stack/data/nova/instances/8f8ec77f-bf35-4b15-bd77-9f8407b09d0b/console.log' append='off'/>
Oct 26 00:16:15 user nova-compute[75165]:       <target type='isa-serial' port='0'>
Oct 26 00:16:15 user nova-compute[75165]:         <model name='isa-serial'/>
Oct 26 00:16:15 user nova-compute[75165]:       </target>
Oct 26 00:16:15 user nova-compute[75165]:       <alias name='serial0'/>
Oct 26 00:16:15 user nova-compute[75165]:     </serial>
Oct 26 00:16:15 user nova-compute[75165]:     <console type='pty' tty='/dev/pts/9'>
Oct 26 00:16:15 user nova-compute[75165]:       <source path='/dev/pts/9'/>
Oct 26 00:16:15 user nova-compute[75165]:       <log file='/opt/stack/data/nova/instances/8f8ec77f-bf35-4b15-bd77-9f8407b09d0b/console.log' append='off'/>
Oct 26 00:16:15 user nova-compute[75165]:       <target type='serial' port='0'/>
Oct 26 00:16:15 user nova-compute[75165]:       <alias name='serial0'/>
Oct 26 00:16:15 user nova-compute[75165]:     </console>
Oct 26 00:16:15 user nova-compute[75165]:     <input type='mouse' bus='ps2'>
Oct 26 00:16:15 user nova-compute[75165]:       <alias name='input0'/>
Oct 26 00:16:15 user nova-compute[75165]:     </input>
Oct 26 00:16:15 user nova-compute[75165]:     <input type='keyboard' bus='ps2'>
Oct 26 00:16:15 user nova-compute[75165]:       <alias name='input1'/>
Oct 26 00:16:15 user nova-compute[75165]:     </input>
Oct 26 00:16:15 user nova-compute[75165]:     <graphics type='vnc' port='5910' autoport='yes' listen='0.0.0.0'>
Oct 26 00:16:15 user nova-compute[75165]:       <listen type='address' address='0.0.0.0'/>
Oct 26 00:16:15 user nova-compute[75165]:     </graphics>
Oct 26 00:16:15 user nova-compute[75165]:     <audio id='1' type='none'/>
Oct 26 00:16:15 user nova-compute[75165]:     <video>
Oct 26 00:16:15 user nova-compute[75165]:       <model type='virtio' heads='1' primary='yes'/>
Oct 26 00:16:15 user nova-compute[75165]:       <alias name='video0'/>
Oct 26 00:16:15 user nova-compute[75165]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Oct 26 00:16:15 user nova-compute[75165]:     </video>
Oct 26 00:16:15 user nova-compute[75165]:     <memballoon model='virtio'>
Oct 26 00:16:15 user nova-compute[75165]:       <stats period='10'/>
Oct 26 00:16:15 user nova-compute[75165]:       <alias name='balloon0'/>
Oct 26 00:16:15 user nova-compute[75165]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Oct 26 00:16:15 user nova-compute[75165]:     </memballoon>
Oct 26 00:16:15 user nova-compute[75165]:     <rng model='virtio'>
Oct 26 00:16:15 user nova-compute[75165]:       <backend model='random'>/dev/urandom</backend>
Oct 26 00:16:15 user nova-compute[75165]:       <alias name='rng0'/>
Oct 26 00:16:15 user nova-compute[75165]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Oct 26 00:16:15 user nova-compute[75165]:     </rng>
Oct 26 00:16:15 user nova-compute[75165]:   </devices>
Oct 26 00:16:15 user nova-compute[75165]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Oct 26 00:16:15 user nova-compute[75165]:     <label>libvirt-8f8ec77f-bf35-4b15-bd77-9f8407b09d0b</label>
Oct 26 00:16:15 user nova-compute[75165]:     <imagelabel>libvirt-8f8ec77f-bf35-4b15-bd77-9f8407b09d0b</imagelabel>
Oct 26 00:16:15 user nova-compute[75165]:   </seclabel>
Oct 26 00:16:15 user nova-compute[75165]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Oct 26 00:16:15 user nova-compute[75165]:     <label>+64055:+108</label>
Oct 26 00:16:15 user nova-compute[75165]:     <imagelabel>+64055:+108</imagelabel>
Oct 26 00:16:15 user nova-compute[75165]:   </seclabel>
Oct 26 00:16:15 user nova-compute[75165]: </domain>
Oct 26 00:16:15 user nova-compute[75165]:  {{(pid=75165) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Oct 26 00:16:15 user nova-compute[75165]: DEBUG nova.virt.libvirt.guest [req-bc06526f-75a6-4c3a-b5d0-5f6208a600da req-ecdef962-9f92-41d1-9af2-49ec2e0d3203 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:f6:ac:95"/><model type="virtio"/><mtu size="1442"/><target dev="tap2f0902fc-12"/></interface> {{(pid=75165) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 26 00:16:15 user nova-compute[75165]: DEBUG nova.virt.libvirt.guest [req-bc06526f-75a6-4c3a-b5d0-5f6208a600da req-ecdef962-9f92-41d1-9af2-49ec2e0d3203 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:f6:ac:95"/><model type="virtio"/><mtu size="1442"/><target dev="tap2f0902fc-12"/></interface>not found in domain: <domain type='kvm' id='23'>
Oct 26 00:16:15 user nova-compute[75165]:   <name>instance-00000013</name>
Oct 26 00:16:15 user nova-compute[75165]:   <uuid>8f8ec77f-bf35-4b15-bd77-9f8407b09d0b</uuid>
Oct 26 00:16:15 user nova-compute[75165]:   <metadata>
Oct 26 00:16:15 user nova-compute[75165]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 00:16:15 user nova-compute[75165]:   <nova:package version="0.0.0"/>
Oct 26 00:16:15 user nova-compute[75165]:   <nova:name>tempest-device-tagging-server-1656940732</nova:name>
Oct 26 00:16:15 user nova-compute[75165]:   <nova:creationTime>2023-10-26 00:16:14</nova:creationTime>
Oct 26 00:16:15 user nova-compute[75165]:   <nova:flavor name="m1.tiny">
Oct 26 00:16:15 user nova-compute[75165]:     <nova:memory>512</nova:memory>
Oct 26 00:16:15 user nova-compute[75165]:     <nova:disk>1</nova:disk>
Oct 26 00:16:15 user nova-compute[75165]:     <nova:swap>0</nova:swap>
Oct 26 00:16:15 user nova-compute[75165]:     <nova:ephemeral>0</nova:ephemeral>
Oct 26 00:16:15 user nova-compute[75165]:     <nova:vcpus>1</nova:vcpus>
Oct 26 00:16:15 user nova-compute[75165]:   </nova:flavor>
Oct 26 00:16:15 user nova-compute[75165]:   <nova:owner>
Oct 26 00:16:15 user nova-compute[75165]:     <nova:user uuid="93efb23845e441bc932910691dfaf023">tempest-TaggedAttachmentsTest-950905423-project-member</nova:user>
Oct 26 00:16:15 user nova-compute[75165]:     <nova:project uuid="da5b9c2d1b1e4d9d885fa82f1625b5e0">tempest-TaggedAttachmentsTest-950905423</nova:project>
Oct 26 00:16:15 user nova-compute[75165]:   </nova:owner>
Oct 26 00:16:15 user nova-compute[75165]:   <nova:root type="image" uuid="bff0d8a1-739e-4c4d-9efa-b73ba7b76d01"/>
Oct 26 00:16:15 user nova-compute[75165]:   <nova:ports>
Oct 26 00:16:15 user nova-compute[75165]:     <nova:port uuid="7f5b9415-3336-49cc-8909-c21c7003e6fe">
Oct 26 00:16:15 user nova-compute[75165]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 26 00:16:15 user nova-compute[75165]:     </nova:port>
Oct 26 00:16:15 user nova-compute[75165]:   </nova:ports>
Oct 26 00:16:15 user nova-compute[75165]: </nova:instance>
Oct 26 00:16:15 user nova-compute[75165]:   </metadata>
Oct 26 00:16:15 user nova-compute[75165]:   <memory unit='KiB'>524288</memory>
Oct 26 00:16:15 user nova-compute[75165]:   <currentMemory unit='KiB'>524288</currentMemory>
Oct 26 00:16:15 user nova-compute[75165]:   <vcpu placement='static'>1</vcpu>
Oct 26 00:16:15 user nova-compute[75165]:   <resource>
Oct 26 00:16:15 user nova-compute[75165]:     <partition>/machine</partition>
Oct 26 00:16:15 user nova-compute[75165]:   </resource>
Oct 26 00:16:15 user nova-compute[75165]:   <sysinfo type='smbios'>
Oct 26 00:16:15 user nova-compute[75165]:     <system>
Oct 26 00:16:15 user nova-compute[75165]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Oct 26 00:16:15 user nova-compute[75165]:       <entry name='product'>OpenStack Nova</entry>
Oct 26 00:16:15 user nova-compute[75165]:       <entry name='version'>0.0.0</entry>
Oct 26 00:16:15 user nova-compute[75165]:       <entry name='serial'>8f8ec77f-bf35-4b15-bd77-9f8407b09d0b</entry>
Oct 26 00:16:15 user nova-compute[75165]:       <entry name='uuid'>8f8ec77f-bf35-4b15-bd77-9f8407b09d0b</entry>
Oct 26 00:16:15 user nova-compute[75165]:       <entry name='family'>Virtual Machine</entry>
Oct 26 00:16:15 user nova-compute[75165]:     </system>
Oct 26 00:16:15 user nova-compute[75165]:   </sysinfo>
Oct 26 00:16:15 user nova-compute[75165]:   <os>
Oct 26 00:16:15 user nova-compute[75165]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Oct 26 00:16:15 user nova-compute[75165]:     <boot dev='hd'/>
Oct 26 00:16:15 user nova-compute[75165]:     <smbios mode='sysinfo'/>
Oct 26 00:16:15 user nova-compute[75165]:   </os>
Oct 26 00:16:15 user nova-compute[75165]:   <features>
Oct 26 00:16:15 user nova-compute[75165]:     <acpi/>
Oct 26 00:16:15 user nova-compute[75165]:     <apic/>
Oct 26 00:16:15 user nova-compute[75165]:     <vmcoreinfo state='on'/>
Oct 26 00:16:15 user nova-compute[75165]:   </features>
Oct 26 00:16:15 user nova-compute[75165]:   <cpu mode='custom' match='exact' check='full'>
Oct 26 00:16:15 user nova-compute[75165]:     <model fallback='forbid'>Nehalem</model>
Oct 26 00:16:15 user nova-compute[75165]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Oct 26 00:16:15 user nova-compute[75165]:     <feature policy='require' name='vme'/>
Oct 26 00:16:15 user nova-compute[75165]:     <feature policy='require' name='x2apic'/>
Oct 26 00:16:15 user nova-compute[75165]:     <feature policy='require' name='hypervisor'/>
Oct 26 00:16:15 user nova-compute[75165]:   </cpu>
Oct 26 00:16:15 user nova-compute[75165]:   <clock offset='utc'>
Oct 26 00:16:15 user nova-compute[75165]:     <timer name='pit' tickpolicy='delay'/>
Oct 26 00:16:15 user nova-compute[75165]:     <timer name='rtc' tickpolicy='catchup'/>
Oct 26 00:16:15 user nova-compute[75165]:     <timer name='hpet' present='no'/>
Oct 26 00:16:15 user nova-compute[75165]:   </clock>
Oct 26 00:16:15 user nova-compute[75165]:   <on_poweroff>destroy</on_poweroff>
Oct 26 00:16:15 user nova-compute[75165]:   <on_reboot>restart</on_reboot>
Oct 26 00:16:15 user nova-compute[75165]:   <on_crash>destroy</on_crash>
Oct 26 00:16:15 user nova-compute[75165]:   <devices>
Oct 26 00:16:15 user nova-compute[75165]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 26 00:16:15 user nova-compute[75165]:     <disk type='file' device='disk'>
Oct 26 00:16:15 user nova-compute[75165]:       <driver name='qemu' type='qcow2' cache='none'/>
Oct 26 00:16:15 user nova-compute[75165]:       <source file='/opt/stack/data/nova/instances/8f8ec77f-bf35-4b15-bd77-9f8407b09d0b/disk' index='2'/>
Oct 26 00:16:15 user nova-compute[75165]:       <backingStore type='file' index='3'>
Oct 26 00:16:15 user nova-compute[75165]:         <format type='raw'/>
Oct 26 00:16:15 user nova-compute[75165]:         <source file='/opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466'/>
Oct 26 00:16:15 user nova-compute[75165]:         <backingStore/>
Oct 26 00:16:15 user nova-compute[75165]:       </backingStore>
Oct 26 00:16:15 user nova-compute[75165]:       <target dev='vda' bus='virtio'/>
Oct 26 00:16:15 user nova-compute[75165]:       <alias name='virtio-disk0'/>
Oct 26 00:16:15 user nova-compute[75165]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Oct 26 00:16:15 user nova-compute[75165]:     </disk>
Oct 26 00:16:15 user nova-compute[75165]:     <disk type='file' device='cdrom'>
Oct 26 00:16:15 user nova-compute[75165]:       <driver name='qemu' type='raw' cache='none'/>
Oct 26 00:16:15 user nova-compute[75165]:       <source file='/opt/stack/data/nova/instances/8f8ec77f-bf35-4b15-bd77-9f8407b09d0b/disk.config' index='1'/>
Oct 26 00:16:15 user nova-compute[75165]:       <backingStore/>
Oct 26 00:16:15 user nova-compute[75165]:       <target dev='hda' bus='ide'/>
Oct 26 00:16:15 user nova-compute[75165]:       <readonly/>
Oct 26 00:16:15 user nova-compute[75165]:       <alias name='ide0-0-0'/>
Oct 26 00:16:15 user nova-compute[75165]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Oct 26 00:16:15 user nova-compute[75165]:     </disk>
Oct 26 00:16:15 user nova-compute[75165]:     <controller type='usb' index='0' model='none'>
Oct 26 00:16:15 user nova-compute[75165]:       <alias name='usb'/>
Oct 26 00:16:15 user nova-compute[75165]:     </controller>
Oct 26 00:16:15 user nova-compute[75165]:     <controller type='pci' index='0' model='pci-root'>
Oct 26 00:16:15 user nova-compute[75165]:       <alias name='pci.0'/>
Oct 26 00:16:15 user nova-compute[75165]:     </controller>
Oct 26 00:16:15 user nova-compute[75165]:     <controller type='ide' index='0'>
Oct 26 00:16:15 user nova-compute[75165]:       <alias name='ide'/>
Oct 26 00:16:15 user nova-compute[75165]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Oct 26 00:16:15 user nova-compute[75165]:     </controller>
Oct 26 00:16:15 user nova-compute[75165]:     <interface type='ethernet'>
Oct 26 00:16:15 user nova-compute[75165]:       <mac address='fa:16:3e:c8:5c:77'/>
Oct 26 00:16:15 user nova-compute[75165]:       <target dev='tap7f5b9415-33'/>
Oct 26 00:16:15 user nova-compute[75165]:       <model type='virtio'/>
Oct 26 00:16:15 user nova-compute[75165]:       <mtu size='1442'/>
Oct 26 00:16:15 user nova-compute[75165]:       <alias name='net0'/>
Oct 26 00:16:15 user nova-compute[75165]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Oct 26 00:16:15 user nova-compute[75165]:     </interface>
Oct 26 00:16:15 user nova-compute[75165]:     <serial type='pty'>
Oct 26 00:16:15 user nova-compute[75165]:       <source path='/dev/pts/9'/>
Oct 26 00:16:15 user nova-compute[75165]:       <log file='/opt/stack/data/nova/instances/8f8ec77f-bf35-4b15-bd77-9f8407b09d0b/console.log' append='off'/>
Oct 26 00:16:15 user nova-compute[75165]:       <target type='isa-serial' port='0'>
Oct 26 00:16:15 user nova-compute[75165]:         <model name='isa-serial'/>
Oct 26 00:16:15 user nova-compute[75165]:       </target>
Oct 26 00:16:15 user nova-compute[75165]:       <alias name='serial0'/>
Oct 26 00:16:15 user nova-compute[75165]:     </serial>
Oct 26 00:16:15 user nova-compute[75165]:     <console type='pty' tty='/dev/pts/9'>
Oct 26 00:16:15 user nova-compute[75165]:       <source path='/dev/pts/9'/>
Oct 26 00:16:15 user nova-compute[75165]:       <log file='/opt/stack/data/nova/instances/8f8ec77f-bf35-4b15-bd77-9f8407b09d0b/console.log' append='off'/>
Oct 26 00:16:15 user nova-compute[75165]:       <target type='serial' port='0'/>
Oct 26 00:16:15 user nova-compute[75165]:       <alias name='serial0'/>
Oct 26 00:16:15 user nova-compute[75165]:     </console>
Oct 26 00:16:15 user nova-compute[75165]:     <input type='mouse' bus='ps2'>
Oct 26 00:16:15 user nova-compute[75165]:       <alias name='input0'/>
Oct 26 00:16:15 user nova-compute[75165]:     </input>
Oct 26 00:16:15 user nova-compute[75165]:     <input type='keyboard' bus='ps2'>
Oct 26 00:16:15 user nova-compute[75165]:       <alias name='input1'/>
Oct 26 00:16:15 user nova-compute[75165]:     </input>
Oct 26 00:16:15 user nova-compute[75165]:     <graphics type='vnc' port='5910' autoport='yes' listen='0.0.0.0'>
Oct 26 00:16:15 user nova-compute[75165]:       <listen type='address' address='0.0.0.0'/>
Oct 26 00:16:15 user nova-compute[75165]:     </graphics>
Oct 26 00:16:15 user nova-compute[75165]:     <audio id='1' type='none'/>
Oct 26 00:16:15 user nova-compute[75165]:     <video>
Oct 26 00:16:15 user nova-compute[75165]:       <model type='virtio' heads='1' primary='yes'/>
Oct 26 00:16:15 user nova-compute[75165]:       <alias name='video0'/>
Oct 26 00:16:15 user nova-compute[75165]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Oct 26 00:16:15 user nova-compute[75165]:     </video>
Oct 26 00:16:15 user nova-compute[75165]:     <memballoon model='virtio'>
Oct 26 00:16:15 user nova-compute[75165]:       <stats period='10'/>
Oct 26 00:16:15 user nova-compute[75165]:       <alias name='balloon0'/>
Oct 26 00:16:15 user nova-compute[75165]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Oct 26 00:16:15 user nova-compute[75165]:     </memballoon>
Oct 26 00:16:15 user nova-compute[75165]:     <rng model='virtio'>
Oct 26 00:16:15 user nova-compute[75165]:       <backend model='random'>/dev/urandom</backend>
Oct 26 00:16:15 user nova-compute[75165]:       <alias name='rng0'/>
Oct 26 00:16:15 user nova-compute[75165]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Oct 26 00:16:15 user nova-compute[75165]:     </rng>
Oct 26 00:16:15 user nova-compute[75165]:   </devices>
Oct 26 00:16:15 user nova-compute[75165]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Oct 26 00:16:15 user nova-compute[75165]:     <label>libvirt-8f8ec77f-bf35-4b15-bd77-9f8407b09d0b</label>
Oct 26 00:16:15 user nova-compute[75165]:     <imagelabel>libvirt-8f8ec77f-bf35-4b15-bd77-9f8407b09d0b</imagelabel>
Oct 26 00:16:15 user nova-compute[75165]:   </seclabel>
Oct 26 00:16:15 user nova-compute[75165]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Oct 26 00:16:15 user nova-compute[75165]:     <label>+64055:+108</label>
Oct 26 00:16:15 user nova-compute[75165]:     <imagelabel>+64055:+108</imagelabel>
Oct 26 00:16:15 user nova-compute[75165]:   </seclabel>
Oct 26 00:16:15 user nova-compute[75165]: </domain>
Oct 26 00:16:15 user nova-compute[75165]:  {{(pid=75165) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Oct 26 00:16:15 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [req-bc06526f-75a6-4c3a-b5d0-5f6208a600da req-ecdef962-9f92-41d1-9af2-49ec2e0d3203 service nova] [instance: 8f8ec77f-bf35-4b15-bd77-9f8407b09d0b] Detaching interface fa:16:3e:f6:ac:95 failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap2f0902fc-12' not found.
Oct 26 00:16:15 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [req-bc06526f-75a6-4c3a-b5d0-5f6208a600da req-ecdef962-9f92-41d1-9af2-49ec2e0d3203 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T00:12:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1656940732',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1656940732',id=19,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN+wbYUhWvc0Q8Ki4GTS2Tn91hUUyA5mHnOcmOrTkWVgToMqNtiT9k+t+ZtOfljqpTvTwcwIhu3LxiFs8eVVq6KIF4bfjQF4bPry0REDa8gn1PrkrDV91CuU9Osr0XBN6A==',key_name='tempest-keypair-1700446792',keypairs=<?>,launch_index=0,launched_at=2023-10-26T00:12:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='da5b9c2d1b1e4d9d885fa82f1625b5e0',ramdisk_id='',reservation_id='r-wb7qp03s',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-950905423',owner_user_name='tempest-TaggedAttachmentsTest-950905423-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T00:12:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='93efb23845e441bc932910691dfaf023',uuid=8f8ec77f-bf35-4b15-bd77-9f8407b09d0b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2f0902fc-120b-4c3a-aaa8-a441d61ad5e8", "address": "fa:16:3e:f6:ac:95", "network": {"id": "aa33c3e8-4f0d-4863-866b-995c0af9ed27", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-650788755", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.81", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "da5b9c2d1b1e4d9d885fa82f1625b5e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f0902fc-12", "ovs_interfaceid": "2f0902fc-120b-4c3a-aaa8-a441d61ad5e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 00:16:15 user nova-compute[75165]: DEBUG nova.network.os_vif_util [req-bc06526f-75a6-4c3a-b5d0-5f6208a600da req-ecdef962-9f92-41d1-9af2-49ec2e0d3203 service nova] Converting VIF {"id": "2f0902fc-120b-4c3a-aaa8-a441d61ad5e8", "address": "fa:16:3e:f6:ac:95", "network": {"id": "aa33c3e8-4f0d-4863-866b-995c0af9ed27", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-650788755", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.81", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "da5b9c2d1b1e4d9d885fa82f1625b5e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f0902fc-12", "ovs_interfaceid": "2f0902fc-120b-4c3a-aaa8-a441d61ad5e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:16:15 user nova-compute[75165]: DEBUG nova.network.os_vif_util [req-bc06526f-75a6-4c3a-b5d0-5f6208a600da req-ecdef962-9f92-41d1-9af2-49ec2e0d3203 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:ac:95,bridge_name='br-int',has_traffic_filtering=True,id=2f0902fc-120b-4c3a-aaa8-a441d61ad5e8,network=Network(aa33c3e8-4f0d-4863-866b-995c0af9ed27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f0902fc-12') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:16:15 user nova-compute[75165]: DEBUG os_vif [req-bc06526f-75a6-4c3a-b5d0-5f6208a600da req-ecdef962-9f92-41d1-9af2-49ec2e0d3203 service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:ac:95,bridge_name='br-int',has_traffic_filtering=True,id=2f0902fc-120b-4c3a-aaa8-a441d61ad5e8,network=Network(aa33c3e8-4f0d-4863-866b-995c0af9ed27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f0902fc-12') {{(pid=75165) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 00:16:15 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:16:15 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2f0902fc-12, bridge=br-int, if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:16:15 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 00:16:15 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-ec20775f-af46-4665-88c0-bf9e5aa7837e tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.045s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:16:15 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.141s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:16:15 user nova-compute[75165]: INFO os_vif [req-bc06526f-75a6-4c3a-b5d0-5f6208a600da req-ecdef962-9f92-41d1-9af2-49ec2e0d3203 service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:ac:95,bridge_name='br-int',has_traffic_filtering=True,id=2f0902fc-120b-4c3a-aaa8-a441d61ad5e8,network=Network(aa33c3e8-4f0d-4863-866b-995c0af9ed27),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f0902fc-12')
Oct 26 00:16:15 user nova-compute[75165]: DEBUG nova.virt.libvirt.guest [req-bc06526f-75a6-4c3a-b5d0-5f6208a600da req-ecdef962-9f92-41d1-9af2-49ec2e0d3203 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 00:16:15 user nova-compute[75165]:   <nova:package version="0.0.0"/>
Oct 26 00:16:15 user nova-compute[75165]:   <nova:name>tempest-device-tagging-server-1656940732</nova:name>
Oct 26 00:16:15 user nova-compute[75165]:   <nova:creationTime>2023-10-26 00:16:15</nova:creationTime>
Oct 26 00:16:15 user nova-compute[75165]:   <nova:flavor name="m1.tiny">
Oct 26 00:16:15 user nova-compute[75165]:     <nova:memory>512</nova:memory>
Oct 26 00:16:15 user nova-compute[75165]:     <nova:disk>1</nova:disk>
Oct 26 00:16:15 user nova-compute[75165]:     <nova:swap>0</nova:swap>
Oct 26 00:16:15 user nova-compute[75165]:     <nova:ephemeral>0</nova:ephemeral>
Oct 26 00:16:15 user nova-compute[75165]:     <nova:vcpus>1</nova:vcpus>
Oct 26 00:16:15 user nova-compute[75165]:   </nova:flavor>
Oct 26 00:16:15 user nova-compute[75165]:   <nova:owner>
Oct 26 00:16:15 user nova-compute[75165]:     <nova:user uuid="93efb23845e441bc932910691dfaf023">tempest-TaggedAttachmentsTest-950905423-project-member</nova:user>
Oct 26 00:16:15 user nova-compute[75165]:     <nova:project uuid="da5b9c2d1b1e4d9d885fa82f1625b5e0">tempest-TaggedAttachmentsTest-950905423</nova:project>
Oct 26 00:16:15 user nova-compute[75165]:   </nova:owner>
Oct 26 00:16:15 user nova-compute[75165]:   <nova:root type="image" uuid="bff0d8a1-739e-4c4d-9efa-b73ba7b76d01"/>
Oct 26 00:16:15 user nova-compute[75165]:   <nova:ports>
Oct 26 00:16:15 user nova-compute[75165]:     <nova:port uuid="7f5b9415-3336-49cc-8909-c21c7003e6fe">
Oct 26 00:16:15 user nova-compute[75165]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 26 00:16:15 user nova-compute[75165]:     </nova:port>
Oct 26 00:16:15 user nova-compute[75165]:   </nova:ports>
Oct 26 00:16:15 user nova-compute[75165]: </nova:instance>
Oct 26 00:16:15 user nova-compute[75165]:  {{(pid=75165) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Oct 26 00:16:15 user nova-compute[75165]: INFO nova.scheduler.client.report [None req-ec20775f-af46-4665-88c0-bf9e5aa7837e tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Deleted allocations for instance 9633e6bb-5e95-4994-92a2-9d8f85a946ff
Oct 26 00:16:15 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-ec20775f-af46-4665-88c0-bf9e5aa7837e tempest-ServersNegativeTestJSON-585947888 tempest-ServersNegativeTestJSON-585947888-project-member] Lock "9633e6bb-5e95-4994-92a2-9d8f85a946ff" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.905s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:16:15 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 84c6b624-648b-40e2-a37e-ff08609bad84 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:16:15 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance c4e44bfc-6a68-46ce-8335-aaaba5160d3e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:16:15 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance a7eeb145-1565-4812-818b-fefda5f2436d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:16:15 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 22b9689c-5e83-4807-971f-5b244914b7e5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:16:15 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 3b153af2-c93b-47d2-ae8c-76cfd44e384c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:16:15 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 3150d249-37a2-49c6-837a-3828480fa2b4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:16:15 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 8f8ec77f-bf35-4b15-bd77-9f8407b09d0b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:16:15 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 27fa1771-fb69-49da-81b3-7f112e623170 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:16:15 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance b041e0af-4635-495c-b72d-fbbbd8d43a9b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:16:15 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 3c7002e2-b98f-48e4-b099-9c8b756fd0ae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:16:15 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 91fe894a-90a8-4545-9b27-91771554c4cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:16:15 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance b6558510-6f87-4ef3-b707-f1fa78bf61e8 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Oct 26 00:16:15 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75165) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 00:16:15 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75165) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 00:16:15 user nova-compute[75165]: DEBUG nova.network.neutron [None req-0cb42902-b099-4365-961f-5b19b15944ab tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] [instance: 8f8ec77f-bf35-4b15-bd77-9f8407b09d0b] Updating instance_info_cache with network_info: [{"id": "7f5b9415-3336-49cc-8909-c21c7003e6fe", "address": "fa:16:3e:c8:5c:77", "network": {"id": "493a3a47-a5c0-4b54-a13e-e5c39f80e90a", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-218779534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da5b9c2d1b1e4d9d885fa82f1625b5e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f5b9415-33", "ovs_interfaceid": "7f5b9415-3336-49cc-8909-c21c7003e6fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:16:15 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-0cb42902-b099-4365-961f-5b19b15944ab tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] Releasing lock "refresh_cache-8f8ec77f-bf35-4b15-bd77-9f8407b09d0b" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:16:15 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-0cb42902-b099-4365-961f-5b19b15944ab tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] Lock "interface-8f8ec77f-bf35-4b15-bd77-9f8407b09d0b-2f0902fc-120b-4c3a-aaa8-a441d61ad5e8" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 22.169s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:16:15 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:16:15 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:16:15 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Compute_service record updated for user:user {{(pid=75165) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 00:16:15 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.598s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:16:15 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-08eb7264-ca23-486f-9cca-e443a6a8161e tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.717s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:16:15 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-08eb7264-ca23-486f-9cca-e443a6a8161e tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75165) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 00:16:15 user nova-compute[75165]: INFO nova.compute.claims [None req-08eb7264-ca23-486f-9cca-e443a6a8161e tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] [instance: b6558510-6f87-4ef3-b707-f1fa78bf61e8] Claim successful on node user
Oct 26 00:16:16 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:16:16 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-08eb7264-ca23-486f-9cca-e443a6a8161e tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:16:16 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-08eb7264-ca23-486f-9cca-e443a6a8161e tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:16:16 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-08eb7264-ca23-486f-9cca-e443a6a8161e tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.453s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:16:16 user nova-compute[75165]: DEBUG nova.compute.manager [None req-08eb7264-ca23-486f-9cca-e443a6a8161e tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] [instance: b6558510-6f87-4ef3-b707-f1fa78bf61e8] Start building networks asynchronously for instance. {{(pid=75165) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 00:16:16 user nova-compute[75165]: DEBUG nova.compute.manager [None req-08eb7264-ca23-486f-9cca-e443a6a8161e tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] [instance: b6558510-6f87-4ef3-b707-f1fa78bf61e8] Allocating IP information in the background. {{(pid=75165) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 00:16:16 user nova-compute[75165]: DEBUG nova.network.neutron [None req-08eb7264-ca23-486f-9cca-e443a6a8161e tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] [instance: b6558510-6f87-4ef3-b707-f1fa78bf61e8] allocate_for_instance() {{(pid=75165) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 00:16:16 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-08eb7264-ca23-486f-9cca-e443a6a8161e tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] [instance: b6558510-6f87-4ef3-b707-f1fa78bf61e8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 00:16:16 user nova-compute[75165]: DEBUG nova.compute.manager [None req-08eb7264-ca23-486f-9cca-e443a6a8161e tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] [instance: b6558510-6f87-4ef3-b707-f1fa78bf61e8] Start building block device mappings for instance. {{(pid=75165) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 00:16:16 user nova-compute[75165]: DEBUG nova.policy [None req-08eb7264-ca23-486f-9cca-e443a6a8161e tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '62ab103dec5d499bb8b83495f201f267', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8274f81c556047709b5b7b45bcb8a0e9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75165) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 00:16:16 user nova-compute[75165]: DEBUG nova.compute.manager [None req-08eb7264-ca23-486f-9cca-e443a6a8161e tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] [instance: b6558510-6f87-4ef3-b707-f1fa78bf61e8] Start spawning the instance on the hypervisor. {{(pid=75165) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 00:16:16 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-08eb7264-ca23-486f-9cca-e443a6a8161e tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] [instance: b6558510-6f87-4ef3-b707-f1fa78bf61e8] Creating instance directory {{(pid=75165) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 00:16:16 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-08eb7264-ca23-486f-9cca-e443a6a8161e tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] [instance: b6558510-6f87-4ef3-b707-f1fa78bf61e8] Creating image(s)
Oct 26 00:16:16 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-08eb7264-ca23-486f-9cca-e443a6a8161e tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] Acquiring lock "/opt/stack/data/nova/instances/b6558510-6f87-4ef3-b707-f1fa78bf61e8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:16:16 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-08eb7264-ca23-486f-9cca-e443a6a8161e tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] Lock "/opt/stack/data/nova/instances/b6558510-6f87-4ef3-b707-f1fa78bf61e8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:16:16 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-08eb7264-ca23-486f-9cca-e443a6a8161e tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] Lock "/opt/stack/data/nova/instances/b6558510-6f87-4ef3-b707-f1fa78bf61e8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:16:16 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-08eb7264-ca23-486f-9cca-e443a6a8161e tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:16:16 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-08eb7264-ca23-486f-9cca-e443a6a8161e tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json" returned: 0 in 0.187s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:16:16 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-08eb7264-ca23-486f-9cca-e443a6a8161e tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] Acquiring lock "7d3243421cf3fdc288b758f687a93103b7b95466" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:16:16 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-08eb7264-ca23-486f-9cca-e443a6a8161e tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] Lock "7d3243421cf3fdc288b758f687a93103b7b95466" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:16:16 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-08eb7264-ca23-486f-9cca-e443a6a8161e tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:16:16 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-36f10850-9edb-474d-9ee6-7030a0876688 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Acquiring lock "3b153af2-c93b-47d2-ae8c-76cfd44e384c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:16:16 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-36f10850-9edb-474d-9ee6-7030a0876688 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Lock "3b153af2-c93b-47d2-ae8c-76cfd44e384c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:16:16 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-36f10850-9edb-474d-9ee6-7030a0876688 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Acquiring lock "3b153af2-c93b-47d2-ae8c-76cfd44e384c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:16:16 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-36f10850-9edb-474d-9ee6-7030a0876688 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Lock "3b153af2-c93b-47d2-ae8c-76cfd44e384c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:16:16 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-36f10850-9edb-474d-9ee6-7030a0876688 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Lock "3b153af2-c93b-47d2-ae8c-76cfd44e384c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:16:16 user nova-compute[75165]: INFO nova.compute.manager [None req-36f10850-9edb-474d-9ee6-7030a0876688 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] Terminating instance
Oct 26 00:16:16 user nova-compute[75165]: DEBUG nova.compute.manager [None req-36f10850-9edb-474d-9ee6-7030a0876688 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] Start destroying the instance on the hypervisor. {{(pid=75165) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 00:16:17 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:16:17 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-08eb7264-ca23-486f-9cca-e443a6a8161e tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json" returned: 0 in 0.209s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:16:17 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-08eb7264-ca23-486f-9cca-e443a6a8161e tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466,backing_fmt=raw /opt/stack/data/nova/instances/b6558510-6f87-4ef3-b707-f1fa78bf61e8/disk 1073741824 {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:16:17 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:16:17 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-08eb7264-ca23-486f-9cca-e443a6a8161e tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466,backing_fmt=raw /opt/stack/data/nova/instances/b6558510-6f87-4ef3-b707-f1fa78bf61e8/disk 1073741824" returned: 0 in 0.054s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:16:17 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-08eb7264-ca23-486f-9cca-e443a6a8161e tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] Lock "7d3243421cf3fdc288b758f687a93103b7b95466" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.269s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:16:17 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-08eb7264-ca23-486f-9cca-e443a6a8161e tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:16:17 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:16:17 user nova-compute[75165]: DEBUG nova.compute.manager [req-190276cd-09d6-45f6-a9f8-8bc3c85dc591 req-4212c1f1-1918-4de5-a0dd-ba2eb7cadb1c service nova] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] Received event network-vif-unplugged-874a1698-c52c-444c-bed5-52633dbaeead {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:16:17 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-190276cd-09d6-45f6-a9f8-8bc3c85dc591 req-4212c1f1-1918-4de5-a0dd-ba2eb7cadb1c service nova] Acquiring lock "3b153af2-c93b-47d2-ae8c-76cfd44e384c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:16:17 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-190276cd-09d6-45f6-a9f8-8bc3c85dc591 req-4212c1f1-1918-4de5-a0dd-ba2eb7cadb1c service nova] Lock "3b153af2-c93b-47d2-ae8c-76cfd44e384c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:16:17 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-190276cd-09d6-45f6-a9f8-8bc3c85dc591 req-4212c1f1-1918-4de5-a0dd-ba2eb7cadb1c service nova] Lock "3b153af2-c93b-47d2-ae8c-76cfd44e384c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:16:17 user nova-compute[75165]: DEBUG nova.compute.manager [req-190276cd-09d6-45f6-a9f8-8bc3c85dc591 req-4212c1f1-1918-4de5-a0dd-ba2eb7cadb1c service nova] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] No waiting events found dispatching network-vif-unplugged-874a1698-c52c-444c-bed5-52633dbaeead {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:16:17 user nova-compute[75165]: DEBUG nova.compute.manager [req-190276cd-09d6-45f6-a9f8-8bc3c85dc591 req-4212c1f1-1918-4de5-a0dd-ba2eb7cadb1c service nova] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] Received event network-vif-unplugged-874a1698-c52c-444c-bed5-52633dbaeead for instance with task_state deleting. {{(pid=75165) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 00:16:17 user nova-compute[75165]: DEBUG nova.network.neutron [None req-08eb7264-ca23-486f-9cca-e443a6a8161e tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] [instance: b6558510-6f87-4ef3-b707-f1fa78bf61e8] Successfully created port: 091593d3-5f35-496b-8e3a-d03963bc0d29 {{(pid=75165) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 00:16:17 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-08eb7264-ca23-486f-9cca-e443a6a8161e tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json" returned: 0 in 0.198s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:16:17 user nova-compute[75165]: DEBUG nova.virt.disk.api [None req-08eb7264-ca23-486f-9cca-e443a6a8161e tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b6558510-6f87-4ef3-b707-f1fa78bf61e8/disk. size=1073741824 {{(pid=75165) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 00:16:17 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-08eb7264-ca23-486f-9cca-e443a6a8161e tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6558510-6f87-4ef3-b707-f1fa78bf61e8/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:16:17 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-08eb7264-ca23-486f-9cca-e443a6a8161e tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6558510-6f87-4ef3-b707-f1fa78bf61e8/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:16:17 user nova-compute[75165]: DEBUG nova.virt.disk.api [None req-08eb7264-ca23-486f-9cca-e443a6a8161e tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] Cannot resize image /opt/stack/data/nova/instances/b6558510-6f87-4ef3-b707-f1fa78bf61e8/disk to a smaller size. {{(pid=75165) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 00:16:17 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-08eb7264-ca23-486f-9cca-e443a6a8161e tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] [instance: b6558510-6f87-4ef3-b707-f1fa78bf61e8] Created local disks {{(pid=75165) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 00:16:17 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-08eb7264-ca23-486f-9cca-e443a6a8161e tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] [instance: b6558510-6f87-4ef3-b707-f1fa78bf61e8] Ensure instance console log exists: /opt/stack/data/nova/instances/b6558510-6f87-4ef3-b707-f1fa78bf61e8/console.log {{(pid=75165) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 00:16:17 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-08eb7264-ca23-486f-9cca-e443a6a8161e tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:16:17 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-08eb7264-ca23-486f-9cca-e443a6a8161e tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:16:17 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-08eb7264-ca23-486f-9cca-e443a6a8161e tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:16:17 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] Instance destroyed successfully.
Oct 26 00:16:17 user nova-compute[75165]: DEBUG nova.objects.instance [None req-36f10850-9edb-474d-9ee6-7030a0876688 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Lazy-loading 'resources' on Instance uuid 3b153af2-c93b-47d2-ae8c-76cfd44e384c {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:16:17 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-36f10850-9edb-474d-9ee6-7030a0876688 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:07:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1649801525',display_name='tempest-ServerActionsTestOtherB-server-1649801525',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1649801525',id=7,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOvLHGJ3GKBbD7yL0+CRyOJiq2ETP4pGNCe7wwUyptp7nQivcPunaHj7Jl8TaU2mAtfcWQAgpHGkK+GRkPrduKn69eOts5d8qkM1kDwYiMG7whEGtVeGR66PH/dfoMGjVA==',key_name='tempest-keypair-513358976',keypairs=<?>,launch_index=0,launched_at=2023-10-26T00:13:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0db2c49ee28f4b7b9fa990faddb9d3a9',ramdisk_id='',reservation_id='r-tna5v2cw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-238342146',owner_user_name='tempest-ServerActionsTestOtherB-238342146-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T00:13:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43f095bccf684d5a84b874439f2c58e0',uuid=3b153af2-c93b-47d2-ae8c-76cfd44e384c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "874a1698-c52c-444c-bed5-52633dbaeead", "address": "fa:16:3e:75:45:79", "network": {"id": "30951418-d830-4042-9143-c736802150e9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-167387787-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0db2c49ee28f4b7b9fa990faddb9d3a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap874a1698-c5", "ovs_interfaceid": "874a1698-c52c-444c-bed5-52633dbaeead", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 00:16:17 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-36f10850-9edb-474d-9ee6-7030a0876688 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Converting VIF {"id": "874a1698-c52c-444c-bed5-52633dbaeead", "address": "fa:16:3e:75:45:79", "network": {"id": "30951418-d830-4042-9143-c736802150e9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-167387787-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0db2c49ee28f4b7b9fa990faddb9d3a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap874a1698-c5", "ovs_interfaceid": "874a1698-c52c-444c-bed5-52633dbaeead", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:16:17 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-36f10850-9edb-474d-9ee6-7030a0876688 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:45:79,bridge_name='br-int',has_traffic_filtering=True,id=874a1698-c52c-444c-bed5-52633dbaeead,network=Network(30951418-d830-4042-9143-c736802150e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap874a1698-c5') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:16:17 user nova-compute[75165]: DEBUG os_vif [None req-36f10850-9edb-474d-9ee6-7030a0876688 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:45:79,bridge_name='br-int',has_traffic_filtering=True,id=874a1698-c52c-444c-bed5-52633dbaeead,network=Network(30951418-d830-4042-9143-c736802150e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap874a1698-c5') {{(pid=75165) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 00:16:17 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:16:17 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap874a1698-c5, bridge=br-int, if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:16:17 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:16:17 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:16:17 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:16:17 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:16:17 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f90911c3-9be4-4198-ace0-8b533fa371c8) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:16:17 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:16:17 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:16:17 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:16:17 user nova-compute[75165]: INFO os_vif [None req-36f10850-9edb-474d-9ee6-7030a0876688 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:45:79,bridge_name='br-int',has_traffic_filtering=True,id=874a1698-c52c-444c-bed5-52633dbaeead,network=Network(30951418-d830-4042-9143-c736802150e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap874a1698-c5')
Oct 26 00:16:17 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36f10850-9edb-474d-9ee6-7030a0876688 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] calling os-brick to detach iSCSI Volume {{(pid=75165) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 00:16:17 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-36f10850-9edb-474d-9ee6-7030a0876688 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8bf8160e50>, {'target_iqn': 'iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AokCQquF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:16:17 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-36f10850-9edb-474d-9ee6-7030a0876688 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:16:17 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-36f10850-9edb-474d-9ee6-7030a0876688 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:16:17 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-36f10850-9edb-474d-9ee6-7030a0876688 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:16:17 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:16:17 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:16:17 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd4b9b66-1e7a-4309-a9c9-91747e396ae0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f431d8b9-aa1e-46f5-b7da-39f4a550e050\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:16:17 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-36f10850-9edb-474d-9ee6-7030a0876688 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 00:16:17 user nova-compute[75165]: No targets found.
Oct 26 00:16:17 user nova-compute[75165]: iSNS:
Oct 26 00:16:17 user nova-compute[75165]: No targets found.
Oct 26 00:16:17 user nova-compute[75165]: STATIC:
Oct 26 00:16:17 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b
Oct 26 00:16:17 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:16:17 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:16:17 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b
Oct 26 00:16:17 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:16:17 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:16:17 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:f431d8b9-aa1e-46f5-b7da-39f4a550e050
Oct 26 00:16:17 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:16:17 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:16:17 user nova-compute[75165]: FIRMWARE:
Oct 26 00:16:17 user nova-compute[75165]: No targets found.
Oct 26 00:16:17 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:16:17 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-36f10850-9edb-474d-9ee6-7030a0876688 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 00:16:17 user nova-compute[75165]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 00:16:17 user nova-compute[75165]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75165) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 00:16:17 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-36f10850-9edb-474d-9ee6-7030a0876688 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b', 0)] {{(pid=75165) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 00:16:17 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:16:17 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:16:17 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[14470fbb-890f-44a1-a84d-210f8cc6e851]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f431d8b9-aa1e-46f5-b7da-39f4a550e050\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:16:17 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:16:17 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:16:17 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9588e25-53c6-4fdd-81c3-a25edd00dc4b]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f431d8b9-aa1e-46f5-b7da-39f4a550e050 (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:16:17 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-36f10850-9edb-474d-9ee6-7030a0876688 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b (non-flash)
Oct 26 00:16:17 user nova-compute[75165]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b (non-flash)
Oct 26 00:16:17 user nova-compute[75165]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f431d8b9-aa1e-46f5-b7da-39f4a550e050 (non-flash)
Oct 26 00:16:17 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:16:17 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-36f10850-9edb-474d-9ee6-7030a0876688 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b (non-flash)
Oct 26 00:16:17 user nova-compute[75165]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b (non-flash)
Oct 26 00:16:17 user nova-compute[75165]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f431d8b9-aa1e-46f5-b7da-39f4a550e050 (non-flash)
Oct 26 00:16:17 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:16:17 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-36f10850-9edb-474d-9ee6-7030a0876688 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8be04a81f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b'): ({'sdd'}, set())}) {{(pid=75165) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 00:16:17 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-36f10850-9edb-474d-9ee6-7030a0876688 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Removing single pathed devices sdd {{(pid=75165) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 00:16:17 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:16:18 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:16:18 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[36c4da4c-3240-4dcc-97d4-c8e5697ba6a3]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:16:18 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:16:18 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.025s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:16:18 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3ca07d9-2140-4a4b-8a90-ac09d0b51264]: (4, ('ok\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:16:18 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-36f10850-9edb-474d-9ee6-7030a0876688 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Flushing IO for device /dev/sdd {{(pid=75165) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 00:16:18 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:16:18 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:16:18 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6371a28-c8ea-453b-a0b4-a67b7a83df8a]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:16:18 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-36f10850-9edb-474d-9ee6-7030a0876688 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75165) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 00:16:18 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:16:18 user nova-compute[75165]: DEBUG nova.network.neutron [None req-08eb7264-ca23-486f-9cca-e443a6a8161e tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] [instance: b6558510-6f87-4ef3-b707-f1fa78bf61e8] Successfully updated port: 091593d3-5f35-496b-8e3a-d03963bc0d29 {{(pid=75165) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 00:16:18 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-08eb7264-ca23-486f-9cca-e443a6a8161e tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] Acquiring lock "refresh_cache-b6558510-6f87-4ef3-b707-f1fa78bf61e8" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:16:18 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-08eb7264-ca23-486f-9cca-e443a6a8161e tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] Acquired lock "refresh_cache-b6558510-6f87-4ef3-b707-f1fa78bf61e8" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:16:18 user nova-compute[75165]: DEBUG nova.network.neutron [None req-08eb7264-ca23-486f-9cca-e443a6a8161e tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] [instance: b6558510-6f87-4ef3-b707-f1fa78bf61e8] Building network info cache for instance {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 00:16:18 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.045s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:16:18 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3095e8d-8836-4a90-8d0c-ca4073fb238a]: (4, ('1', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:16:18 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-36f10850-9edb-474d-9ee6-7030a0876688 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75165) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 00:16:18 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-36f10850-9edb-474d-9ee6-7030a0876688 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] SCSI volumes sdd have been removed. {{(pid=75165) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 00:16:18 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-36f10850-9edb-474d-9ee6-7030a0876688 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b')] {{(pid=75165) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 00:16:18 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:16:18 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:16:18 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[f90e6663-04ed-4576-93be-2befbe7c2dff]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:16:18 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-36f10850-9edb-474d-9ee6-7030a0876688 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:16:18 user nova-compute[75165]: DEBUG nova.compute.manager [req-560f3018-b80f-471b-a019-e0e06b8440a7 req-f982e1a3-c016-4149-b9dc-64471b0fc203 service nova] [instance: b6558510-6f87-4ef3-b707-f1fa78bf61e8] Received event network-changed-091593d3-5f35-496b-8e3a-d03963bc0d29 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:16:18 user nova-compute[75165]: DEBUG nova.compute.manager [req-560f3018-b80f-471b-a019-e0e06b8440a7 req-f982e1a3-c016-4149-b9dc-64471b0fc203 service nova] [instance: b6558510-6f87-4ef3-b707-f1fa78bf61e8] Refreshing instance network info cache due to event network-changed-091593d3-5f35-496b-8e3a-d03963bc0d29. {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 00:16:18 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-560f3018-b80f-471b-a019-e0e06b8440a7 req-f982e1a3-c016-4149-b9dc-64471b0fc203 service nova] Acquiring lock "refresh_cache-b6558510-6f87-4ef3-b707-f1fa78bf61e8" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:16:18 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b -p 172.16.0.220:3260 --logout {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:16:18 user nova-compute[75165]: DEBUG nova.network.neutron [None req-08eb7264-ca23-486f-9cca-e443a6a8161e tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] [instance: b6558510-6f87-4ef3-b707-f1fa78bf61e8] Instance cache missing network info. {{(pid=75165) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 00:16:18 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:16:18 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f8e1d52-ffaf-4420-ba0d-22c85394d79f]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:16:18 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-36f10850-9edb-474d-9ee6-7030a0876688 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b, portal: 172.16.0.220,3260]
Oct 26 00:16:18 user nova-compute[75165]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b, portal: 172.16.0.220,3260] successful.
Oct 26 00:16:18 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:16:18 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b -p 172.16.0.220:3260 --op delete {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:16:18 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdb81c18-9a59-4d59-861d-f713e876159b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:16:18 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb74ca81-af5f-48a2-8c95-2ca3e79c8c63]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:16:18 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-36f10850-9edb-474d-9ee6-7030a0876688 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:16:18 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-36f10850-9edb-474d-9ee6-7030a0876688 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.354s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:16:18 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-36f10850-9edb-474d-9ee6-7030a0876688 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] <== disconnect_volume: return (355ms) None {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:16:18 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36f10850-9edb-474d-9ee6-7030a0876688 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] Disconnected iSCSI Volume {{(pid=75165) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 00:16:18 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-36f10850-9edb-474d-9ee6-7030a0876688 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] Deleting instance files /opt/stack/data/nova/instances/3b153af2-c93b-47d2-ae8c-76cfd44e384c_del
Oct 26 00:16:18 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-36f10850-9edb-474d-9ee6-7030a0876688 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] Deletion of /opt/stack/data/nova/instances/3b153af2-c93b-47d2-ae8c-76cfd44e384c_del complete
Oct 26 00:16:18 user nova-compute[75165]: INFO nova.compute.manager [None req-36f10850-9edb-474d-9ee6-7030a0876688 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] Took 1.36 seconds to destroy the instance on the hypervisor.
Oct 26 00:16:18 user nova-compute[75165]: DEBUG oslo.service.loopingcall [None req-36f10850-9edb-474d-9ee6-7030a0876688 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75165) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 00:16:18 user nova-compute[75165]: DEBUG nova.compute.manager [-] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] Deallocating network for instance {{(pid=75165) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 00:16:18 user nova-compute[75165]: DEBUG nova.network.neutron [-] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] deallocate_for_instance() {{(pid=75165) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 00:16:18 user nova-compute[75165]: DEBUG nova.network.neutron [None req-08eb7264-ca23-486f-9cca-e443a6a8161e tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] [instance: b6558510-6f87-4ef3-b707-f1fa78bf61e8] Updating instance_info_cache with network_info: [{"id": "091593d3-5f35-496b-8e3a-d03963bc0d29", "address": "fa:16:3e:ae:d1:d7", "network": {"id": "68f5c9b3-84b6-42db-9fab-e14624851075", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1858718599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8274f81c556047709b5b7b45bcb8a0e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap091593d3-5f", "ovs_interfaceid": "091593d3-5f35-496b-8e3a-d03963bc0d29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:16:18 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-08eb7264-ca23-486f-9cca-e443a6a8161e tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] Releasing lock "refresh_cache-b6558510-6f87-4ef3-b707-f1fa78bf61e8" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:16:18 user nova-compute[75165]: DEBUG nova.compute.manager [None req-08eb7264-ca23-486f-9cca-e443a6a8161e tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] [instance: b6558510-6f87-4ef3-b707-f1fa78bf61e8] Instance network_info: |[{"id": "091593d3-5f35-496b-8e3a-d03963bc0d29", "address": "fa:16:3e:ae:d1:d7", "network": {"id": "68f5c9b3-84b6-42db-9fab-e14624851075", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1858718599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8274f81c556047709b5b7b45bcb8a0e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap091593d3-5f", "ovs_interfaceid": "091593d3-5f35-496b-8e3a-d03963bc0d29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75165) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 00:16:18 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-560f3018-b80f-471b-a019-e0e06b8440a7 req-f982e1a3-c016-4149-b9dc-64471b0fc203 service nova] Acquired lock "refresh_cache-b6558510-6f87-4ef3-b707-f1fa78bf61e8" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:16:18 user nova-compute[75165]: DEBUG nova.network.neutron [req-560f3018-b80f-471b-a019-e0e06b8440a7 req-f982e1a3-c016-4149-b9dc-64471b0fc203 service nova] [instance: b6558510-6f87-4ef3-b707-f1fa78bf61e8] Refreshing network info cache for port 091593d3-5f35-496b-8e3a-d03963bc0d29 {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 00:16:18 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-08eb7264-ca23-486f-9cca-e443a6a8161e tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] [instance: b6558510-6f87-4ef3-b707-f1fa78bf61e8] Start _get_guest_xml network_info=[{"id": "091593d3-5f35-496b-8e3a-d03963bc0d29", "address": "fa:16:3e:ae:d1:d7", "network": {"id": "68f5c9b3-84b6-42db-9fab-e14624851075", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1858718599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8274f81c556047709b5b7b45bcb8a0e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap091593d3-5f", "ovs_interfaceid": "091593d3-5f35-496b-8e3a-d03963bc0d29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T00:03:24Z,direct_url=<?>,disk_format='qcow2',id=bff0d8a1-739e-4c4d-9efa-b73ba7b76d01,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e56bbf444fd34c348475c73673611447',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T00:03:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'size': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': 'bff0d8a1-739e-4c4d-9efa-b73ba7b76d01'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75165) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 00:16:18 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-08eb7264-ca23-486f-9cca-e443a6a8161e tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:16:18 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-08eb7264-ca23-486f-9cca-e443a6a8161e tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:16:18 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-08eb7264-ca23-486f-9cca-e443a6a8161e tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75165) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 00:16:18 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-08eb7264-ca23-486f-9cca-e443a6a8161e tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] CPU controller missing on host. {{(pid=75165) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 00:16:18 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-08eb7264-ca23-486f-9cca-e443a6a8161e tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75165) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 00:16:18 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-08eb7264-ca23-486f-9cca-e443a6a8161e tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] CPU controller found on host. {{(pid=75165) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 00:16:18 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-08eb7264-ca23-486f-9cca-e443a6a8161e tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75165) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 00:16:18 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-08eb7264-ca23-486f-9cca-e443a6a8161e tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T00:03:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T00:03:24Z,direct_url=<?>,disk_format='qcow2',id=bff0d8a1-739e-4c4d-9efa-b73ba7b76d01,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e56bbf444fd34c348475c73673611447',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T00:03:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 00:16:18 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-08eb7264-ca23-486f-9cca-e443a6a8161e tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] Flavor limits 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 00:16:18 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-08eb7264-ca23-486f-9cca-e443a6a8161e tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] Image limits 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 00:16:18 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-08eb7264-ca23-486f-9cca-e443a6a8161e tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] Flavor pref 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 00:16:18 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-08eb7264-ca23-486f-9cca-e443a6a8161e tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] Image pref 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 00:16:18 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-08eb7264-ca23-486f-9cca-e443a6a8161e tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 00:16:18 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-08eb7264-ca23-486f-9cca-e443a6a8161e tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 00:16:18 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-08eb7264-ca23-486f-9cca-e443a6a8161e tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75165) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 00:16:18 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-08eb7264-ca23-486f-9cca-e443a6a8161e tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] Got 1 possible topologies {{(pid=75165) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 00:16:18 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-08eb7264-ca23-486f-9cca-e443a6a8161e tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 00:16:18 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-08eb7264-ca23-486f-9cca-e443a6a8161e tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 00:16:18 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-08eb7264-ca23-486f-9cca-e443a6a8161e tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:16:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1709787456',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1709787456',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1709787',id=24,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIFgIVZJvI28QJzO8izcFaTf0yzfsmPxFRpcPFoww/GdUbWmzNIRFlipPC/8tFHe1RRliLXYHHiQ178XkIBsO1zlbOTW1uC9kSRsqEyV5/VeLZPhYy3VaVgGm+XUzPv5Rg==',key_name='tempest-keypair-1654320357',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8274f81c556047709b5b7b45bcb8a0e9',ramdisk_id='',reservation_id='r-9tkbutm5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-2068497325',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T00:16:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='62ab103dec5d499bb8b83495f201f267',uuid=b6558510-6f87-4ef3-b707-f1fa78bf61e8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "091593d3-5f35-496b-8e3a-d03963bc0d29", "address": "fa:16:3e:ae:d1:d7", "network": {"id": "68f5c9b3-84b6-42db-9fab-e14624851075", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1858718599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8274f81c556047709b5b7b45bcb8a0e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap091593d3-5f", "ovs_interfaceid": "091593d3-5f35-496b-8e3a-d03963bc0d29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75165) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 00:16:18 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-08eb7264-ca23-486f-9cca-e443a6a8161e tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] Converting VIF {"id": "091593d3-5f35-496b-8e3a-d03963bc0d29", "address": "fa:16:3e:ae:d1:d7", "network": {"id": "68f5c9b3-84b6-42db-9fab-e14624851075", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1858718599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8274f81c556047709b5b7b45bcb8a0e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap091593d3-5f", "ovs_interfaceid": "091593d3-5f35-496b-8e3a-d03963bc0d29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:16:18 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-08eb7264-ca23-486f-9cca-e443a6a8161e tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:d1:d7,bridge_name='br-int',has_traffic_filtering=True,id=091593d3-5f35-496b-8e3a-d03963bc0d29,network=Network(68f5c9b3-84b6-42db-9fab-e14624851075),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap091593d3-5f') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:16:18 user nova-compute[75165]: DEBUG nova.objects.instance [None req-08eb7264-ca23-486f-9cca-e443a6a8161e tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] Lazy-loading 'pci_devices' on Instance uuid b6558510-6f87-4ef3-b707-f1fa78bf61e8 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:16:18 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-08eb7264-ca23-486f-9cca-e443a6a8161e tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] [instance: b6558510-6f87-4ef3-b707-f1fa78bf61e8] End _get_guest_xml xml=<domain type="kvm">
Oct 26 00:16:18 user nova-compute[75165]:   <uuid>b6558510-6f87-4ef3-b707-f1fa78bf61e8</uuid>
Oct 26 00:16:18 user nova-compute[75165]:   <name>instance-00000018</name>
Oct 26 00:16:18 user nova-compute[75165]:   <memory>524288</memory>
Oct 26 00:16:18 user nova-compute[75165]:   <vcpu>1</vcpu>
Oct 26 00:16:18 user nova-compute[75165]:   <metadata>
Oct 26 00:16:18 user nova-compute[75165]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 00:16:18 user nova-compute[75165]:       <nova:package version="0.0.0"/>
Oct 26 00:16:18 user nova-compute[75165]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-1709787456</nova:name>
Oct 26 00:16:18 user nova-compute[75165]:       <nova:creationTime>2023-10-26 00:16:18</nova:creationTime>
Oct 26 00:16:18 user nova-compute[75165]:       <nova:flavor name="m1.tiny">
Oct 26 00:16:18 user nova-compute[75165]:         <nova:memory>512</nova:memory>
Oct 26 00:16:18 user nova-compute[75165]:         <nova:disk>1</nova:disk>
Oct 26 00:16:18 user nova-compute[75165]:         <nova:swap>0</nova:swap>
Oct 26 00:16:18 user nova-compute[75165]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 00:16:18 user nova-compute[75165]:         <nova:vcpus>1</nova:vcpus>
Oct 26 00:16:18 user nova-compute[75165]:       </nova:flavor>
Oct 26 00:16:18 user nova-compute[75165]:       <nova:owner>
Oct 26 00:16:18 user nova-compute[75165]:         <nova:user uuid="62ab103dec5d499bb8b83495f201f267">tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member</nova:user>
Oct 26 00:16:18 user nova-compute[75165]:         <nova:project uuid="8274f81c556047709b5b7b45bcb8a0e9">tempest-TestServerVolumeAttachScenarioOldVersion-2068497325</nova:project>
Oct 26 00:16:18 user nova-compute[75165]:       </nova:owner>
Oct 26 00:16:18 user nova-compute[75165]:       <nova:root type="image" uuid="bff0d8a1-739e-4c4d-9efa-b73ba7b76d01"/>
Oct 26 00:16:18 user nova-compute[75165]:       <nova:ports>
Oct 26 00:16:18 user nova-compute[75165]:         <nova:port uuid="091593d3-5f35-496b-8e3a-d03963bc0d29">
Oct 26 00:16:18 user nova-compute[75165]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 26 00:16:18 user nova-compute[75165]:         </nova:port>
Oct 26 00:16:18 user nova-compute[75165]:       </nova:ports>
Oct 26 00:16:18 user nova-compute[75165]:     </nova:instance>
Oct 26 00:16:18 user nova-compute[75165]:   </metadata>
Oct 26 00:16:18 user nova-compute[75165]:   <sysinfo type="smbios">
Oct 26 00:16:18 user nova-compute[75165]:     <system>
Oct 26 00:16:18 user nova-compute[75165]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 00:16:18 user nova-compute[75165]:       <entry name="product">OpenStack Nova</entry>
Oct 26 00:16:18 user nova-compute[75165]:       <entry name="version">0.0.0</entry>
Oct 26 00:16:18 user nova-compute[75165]:       <entry name="serial">b6558510-6f87-4ef3-b707-f1fa78bf61e8</entry>
Oct 26 00:16:18 user nova-compute[75165]:       <entry name="uuid">b6558510-6f87-4ef3-b707-f1fa78bf61e8</entry>
Oct 26 00:16:18 user nova-compute[75165]:       <entry name="family">Virtual Machine</entry>
Oct 26 00:16:18 user nova-compute[75165]:     </system>
Oct 26 00:16:18 user nova-compute[75165]:   </sysinfo>
Oct 26 00:16:18 user nova-compute[75165]:   <os>
Oct 26 00:16:18 user nova-compute[75165]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 00:16:18 user nova-compute[75165]:     <boot dev="hd"/>
Oct 26 00:16:18 user nova-compute[75165]:     <smbios mode="sysinfo"/>
Oct 26 00:16:18 user nova-compute[75165]:   </os>
Oct 26 00:16:18 user nova-compute[75165]:   <features>
Oct 26 00:16:18 user nova-compute[75165]:     <acpi/>
Oct 26 00:16:18 user nova-compute[75165]:     <apic/>
Oct 26 00:16:18 user nova-compute[75165]:     <vmcoreinfo/>
Oct 26 00:16:18 user nova-compute[75165]:   </features>
Oct 26 00:16:18 user nova-compute[75165]:   <clock offset="utc">
Oct 26 00:16:18 user nova-compute[75165]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 00:16:18 user nova-compute[75165]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 00:16:18 user nova-compute[75165]:     <timer name="hpet" present="no"/>
Oct 26 00:16:18 user nova-compute[75165]:   </clock>
Oct 26 00:16:18 user nova-compute[75165]:   <cpu mode="custom" match="exact">
Oct 26 00:16:18 user nova-compute[75165]:     <model>Nehalem</model>
Oct 26 00:16:18 user nova-compute[75165]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 00:16:18 user nova-compute[75165]:   </cpu>
Oct 26 00:16:18 user nova-compute[75165]:   <devices>
Oct 26 00:16:18 user nova-compute[75165]:     <disk type="file" device="disk">
Oct 26 00:16:18 user nova-compute[75165]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 00:16:18 user nova-compute[75165]:       <source file="/opt/stack/data/nova/instances/b6558510-6f87-4ef3-b707-f1fa78bf61e8/disk"/>
Oct 26 00:16:18 user nova-compute[75165]:       <target dev="vda" bus="virtio"/>
Oct 26 00:16:18 user nova-compute[75165]:     </disk>
Oct 26 00:16:18 user nova-compute[75165]:     <interface type="ethernet">
Oct 26 00:16:18 user nova-compute[75165]:       <mac address="fa:16:3e:ae:d1:d7"/>
Oct 26 00:16:18 user nova-compute[75165]:       <model type="virtio"/>
Oct 26 00:16:18 user nova-compute[75165]:       <mtu size="1442"/>
Oct 26 00:16:18 user nova-compute[75165]:       <target dev="tap091593d3-5f"/>
Oct 26 00:16:18 user nova-compute[75165]:     </interface>
Oct 26 00:16:18 user nova-compute[75165]:     <serial type="pty">
Oct 26 00:16:18 user nova-compute[75165]:       <log file="/opt/stack/data/nova/instances/b6558510-6f87-4ef3-b707-f1fa78bf61e8/console.log" append="off"/>
Oct 26 00:16:18 user nova-compute[75165]:     </serial>
Oct 26 00:16:18 user nova-compute[75165]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 00:16:18 user nova-compute[75165]:     <video>
Oct 26 00:16:18 user nova-compute[75165]:       <model type="virtio"/>
Oct 26 00:16:18 user nova-compute[75165]:     </video>
Oct 26 00:16:18 user nova-compute[75165]:     <rng model="virtio">
Oct 26 00:16:18 user nova-compute[75165]:       <backend model="random">/dev/urandom</backend>
Oct 26 00:16:18 user nova-compute[75165]:     </rng>
Oct 26 00:16:18 user nova-compute[75165]:     <controller type="usb" index="0" model="none"/>
Oct 26 00:16:18 user nova-compute[75165]:     <memballoon model="virtio">
Oct 26 00:16:18 user nova-compute[75165]:       <stats period="10"/>
Oct 26 00:16:18 user nova-compute[75165]:     </memballoon>
Oct 26 00:16:18 user nova-compute[75165]:   </devices>
Oct 26 00:16:18 user nova-compute[75165]: </domain>
Oct 26 00:16:18 user nova-compute[75165]:  {{(pid=75165) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 00:16:18 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-08eb7264-ca23-486f-9cca-e443a6a8161e tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:16:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1709787456',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1709787456',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1709787',id=24,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIFgIVZJvI28QJzO8izcFaTf0yzfsmPxFRpcPFoww/GdUbWmzNIRFlipPC/8tFHe1RRliLXYHHiQ178XkIBsO1zlbOTW1uC9kSRsqEyV5/VeLZPhYy3VaVgGm+XUzPv5Rg==',key_name='tempest-keypair-1654320357',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8274f81c556047709b5b7b45bcb8a0e9',ramdisk_id='',reservation_id='r-9tkbutm5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-2068497325',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T00:16:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='62ab103dec5d499bb8b83495f201f267',uuid=b6558510-6f87-4ef3-b707-f1fa78bf61e8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "091593d3-5f35-496b-8e3a-d03963bc0d29", "address": "fa:16:3e:ae:d1:d7", "network": {"id": "68f5c9b3-84b6-42db-9fab-e14624851075", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1858718599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8274f81c556047709b5b7b45bcb8a0e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap091593d3-5f", "ovs_interfaceid": "091593d3-5f35-496b-8e3a-d03963bc0d29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 00:16:18 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-08eb7264-ca23-486f-9cca-e443a6a8161e tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] Converting VIF {"id": "091593d3-5f35-496b-8e3a-d03963bc0d29", "address": "fa:16:3e:ae:d1:d7", "network": {"id": "68f5c9b3-84b6-42db-9fab-e14624851075", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1858718599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8274f81c556047709b5b7b45bcb8a0e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap091593d3-5f", "ovs_interfaceid": "091593d3-5f35-496b-8e3a-d03963bc0d29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:16:18 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-08eb7264-ca23-486f-9cca-e443a6a8161e tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:d1:d7,bridge_name='br-int',has_traffic_filtering=True,id=091593d3-5f35-496b-8e3a-d03963bc0d29,network=Network(68f5c9b3-84b6-42db-9fab-e14624851075),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap091593d3-5f') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:16:18 user nova-compute[75165]: DEBUG os_vif [None req-08eb7264-ca23-486f-9cca-e443a6a8161e tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:d1:d7,bridge_name='br-int',has_traffic_filtering=True,id=091593d3-5f35-496b-8e3a-d03963bc0d29,network=Network(68f5c9b3-84b6-42db-9fab-e14624851075),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap091593d3-5f') {{(pid=75165) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 00:16:18 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:16:18 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:16:18 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 00:16:18 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:16:18 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '967b04bc-7b5f-58c2-a0bc-a6aa74c6d623', '_type': 'linux-noop'}}, row=False) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:16:18 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:16:18 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:16:18 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:16:18 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:16:18 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap091593d3-5f, may_exist=True, interface_attrs={}) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:16:18 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap091593d3-5f, col_values=(('qos', UUID('fd450142-8f40-49b3-860a-a7ea225379d6')),), if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:16:18 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap091593d3-5f, col_values=(('external_ids', {'iface-id': '091593d3-5f35-496b-8e3a-d03963bc0d29', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ae:d1:d7', 'vm-uuid': 'b6558510-6f87-4ef3-b707-f1fa78bf61e8'}),), if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:16:18 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:16:18 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:16:18 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:16:18 user nova-compute[75165]: INFO os_vif [None req-08eb7264-ca23-486f-9cca-e443a6a8161e tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:d1:d7,bridge_name='br-int',has_traffic_filtering=True,id=091593d3-5f35-496b-8e3a-d03963bc0d29,network=Network(68f5c9b3-84b6-42db-9fab-e14624851075),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap091593d3-5f')
Oct 26 00:16:18 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-08eb7264-ca23-486f-9cca-e443a6a8161e tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] No BDM found with device name vda, not building metadata. {{(pid=75165) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 00:16:18 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-08eb7264-ca23-486f-9cca-e443a6a8161e tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] No VIF found with MAC fa:16:3e:ae:d1:d7, not building metadata {{(pid=75165) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 00:16:19 user nova-compute[75165]: DEBUG nova.compute.manager [req-f132df57-649c-470a-a4b1-69daca6b4aa7 req-29fbe650-b62d-457e-9869-9e69d1b1e15c service nova] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] Received event network-vif-plugged-874a1698-c52c-444c-bed5-52633dbaeead {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:16:19 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-f132df57-649c-470a-a4b1-69daca6b4aa7 req-29fbe650-b62d-457e-9869-9e69d1b1e15c service nova] Acquiring lock "3b153af2-c93b-47d2-ae8c-76cfd44e384c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:16:19 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-f132df57-649c-470a-a4b1-69daca6b4aa7 req-29fbe650-b62d-457e-9869-9e69d1b1e15c service nova] Lock "3b153af2-c93b-47d2-ae8c-76cfd44e384c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:16:19 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-f132df57-649c-470a-a4b1-69daca6b4aa7 req-29fbe650-b62d-457e-9869-9e69d1b1e15c service nova] Lock "3b153af2-c93b-47d2-ae8c-76cfd44e384c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:16:19 user nova-compute[75165]: DEBUG nova.compute.manager [req-f132df57-649c-470a-a4b1-69daca6b4aa7 req-29fbe650-b62d-457e-9869-9e69d1b1e15c service nova] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] No waiting events found dispatching network-vif-plugged-874a1698-c52c-444c-bed5-52633dbaeead {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:16:19 user nova-compute[75165]: WARNING nova.compute.manager [req-f132df57-649c-470a-a4b1-69daca6b4aa7 req-29fbe650-b62d-457e-9869-9e69d1b1e15c service nova] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] Received unexpected event network-vif-plugged-874a1698-c52c-444c-bed5-52633dbaeead for instance with vm_state active and task_state deleting.
Oct 26 00:16:19 user nova-compute[75165]: DEBUG nova.network.neutron [req-560f3018-b80f-471b-a019-e0e06b8440a7 req-f982e1a3-c016-4149-b9dc-64471b0fc203 service nova] [instance: b6558510-6f87-4ef3-b707-f1fa78bf61e8] Updated VIF entry in instance network info cache for port 091593d3-5f35-496b-8e3a-d03963bc0d29. {{(pid=75165) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 00:16:19 user nova-compute[75165]: DEBUG nova.network.neutron [req-560f3018-b80f-471b-a019-e0e06b8440a7 req-f982e1a3-c016-4149-b9dc-64471b0fc203 service nova] [instance: b6558510-6f87-4ef3-b707-f1fa78bf61e8] Updating instance_info_cache with network_info: [{"id": "091593d3-5f35-496b-8e3a-d03963bc0d29", "address": "fa:16:3e:ae:d1:d7", "network": {"id": "68f5c9b3-84b6-42db-9fab-e14624851075", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1858718599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8274f81c556047709b5b7b45bcb8a0e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap091593d3-5f", "ovs_interfaceid": "091593d3-5f35-496b-8e3a-d03963bc0d29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:16:19 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-560f3018-b80f-471b-a019-e0e06b8440a7 req-f982e1a3-c016-4149-b9dc-64471b0fc203 service nova] Releasing lock "refresh_cache-b6558510-6f87-4ef3-b707-f1fa78bf61e8" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:16:20 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:16:20 user nova-compute[75165]: DEBUG nova.network.neutron [-] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] Updating instance_info_cache with network_info: [] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:16:20 user nova-compute[75165]: DEBUG nova.compute.manager [req-77a23bc0-45b5-4d04-9668-9c04d538ddea req-7aae3487-8933-4f4a-ad58-7151c05d0f02 service nova] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] Received event network-vif-deleted-874a1698-c52c-444c-bed5-52633dbaeead {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:16:20 user nova-compute[75165]: INFO nova.compute.manager [req-77a23bc0-45b5-4d04-9668-9c04d538ddea req-7aae3487-8933-4f4a-ad58-7151c05d0f02 service nova] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] Neutron deleted interface 874a1698-c52c-444c-bed5-52633dbaeead; detaching it from the instance and deleting it from the info cache
Oct 26 00:16:20 user nova-compute[75165]: DEBUG nova.network.neutron [req-77a23bc0-45b5-4d04-9668-9c04d538ddea req-7aae3487-8933-4f4a-ad58-7151c05d0f02 service nova] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] Updating instance_info_cache with network_info: [] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:16:20 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:16:20 user nova-compute[75165]: INFO nova.compute.manager [-] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] Took 2.00 seconds to deallocate network for instance.
Oct 26 00:16:20 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:16:20 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:16:20 user nova-compute[75165]: DEBUG nova.compute.manager [req-77a23bc0-45b5-4d04-9668-9c04d538ddea req-7aae3487-8933-4f4a-ad58-7151c05d0f02 service nova] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] Detach interface failed, port_id=874a1698-c52c-444c-bed5-52633dbaeead, reason: Instance 3b153af2-c93b-47d2-ae8c-76cfd44e384c could not be found. {{(pid=75165) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 26 00:16:20 user nova-compute[75165]: DEBUG nova.compute.manager [req-6d9994eb-1d44-4a06-b4e4-d4b34c693b1c req-651c9418-4aaa-4417-a8d6-51493b304506 service nova] [instance: b6558510-6f87-4ef3-b707-f1fa78bf61e8] Received event network-vif-plugged-091593d3-5f35-496b-8e3a-d03963bc0d29 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:16:20 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-6d9994eb-1d44-4a06-b4e4-d4b34c693b1c req-651c9418-4aaa-4417-a8d6-51493b304506 service nova] Acquiring lock "b6558510-6f87-4ef3-b707-f1fa78bf61e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:16:20 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-6d9994eb-1d44-4a06-b4e4-d4b34c693b1c req-651c9418-4aaa-4417-a8d6-51493b304506 service nova] Lock "b6558510-6f87-4ef3-b707-f1fa78bf61e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:16:20 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-6d9994eb-1d44-4a06-b4e4-d4b34c693b1c req-651c9418-4aaa-4417-a8d6-51493b304506 service nova] Lock "b6558510-6f87-4ef3-b707-f1fa78bf61e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:16:20 user nova-compute[75165]: DEBUG nova.compute.manager [req-6d9994eb-1d44-4a06-b4e4-d4b34c693b1c req-651c9418-4aaa-4417-a8d6-51493b304506 service nova] [instance: b6558510-6f87-4ef3-b707-f1fa78bf61e8] No waiting events found dispatching network-vif-plugged-091593d3-5f35-496b-8e3a-d03963bc0d29 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:16:20 user nova-compute[75165]: WARNING nova.compute.manager [req-6d9994eb-1d44-4a06-b4e4-d4b34c693b1c req-651c9418-4aaa-4417-a8d6-51493b304506 service nova] [instance: b6558510-6f87-4ef3-b707-f1fa78bf61e8] Received unexpected event network-vif-plugged-091593d3-5f35-496b-8e3a-d03963bc0d29 for instance with vm_state building and task_state spawning.
Oct 26 00:16:20 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:16:20 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:16:20 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:16:21 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:16:21 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:16:21 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:16:21 user nova-compute[75165]: INFO nova.compute.manager [None req-36f10850-9edb-474d-9ee6-7030a0876688 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] [instance: 3b153af2-c93b-47d2-ae8c-76cfd44e384c] Took 0.88 seconds to detach 1 volumes for instance.
Oct 26 00:16:21 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-36f10850-9edb-474d-9ee6-7030a0876688 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:16:21 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-36f10850-9edb-474d-9ee6-7030a0876688 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:16:21 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-36f10850-9edb-474d-9ee6-7030a0876688 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:16:21 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-36f10850-9edb-474d-9ee6-7030a0876688 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:16:21 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-36f10850-9edb-474d-9ee6-7030a0876688 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.429s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:16:21 user nova-compute[75165]: INFO nova.scheduler.client.report [None req-36f10850-9edb-474d-9ee6-7030a0876688 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Deleted allocations for instance 3b153af2-c93b-47d2-ae8c-76cfd44e384c
Oct 26 00:16:21 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-36f10850-9edb-474d-9ee6-7030a0876688 tempest-ServerActionsTestOtherB-238342146 tempest-ServerActionsTestOtherB-238342146-project-member] Lock "3b153af2-c93b-47d2-ae8c-76cfd44e384c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.913s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:16:22 user nova-compute[75165]: DEBUG nova.compute.manager [None req-08eb7264-ca23-486f-9cca-e443a6a8161e tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] [instance: b6558510-6f87-4ef3-b707-f1fa78bf61e8] Instance event wait completed in 0 seconds for  {{(pid=75165) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 00:16:22 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-08eb7264-ca23-486f-9cca-e443a6a8161e tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] [instance: b6558510-6f87-4ef3-b707-f1fa78bf61e8] Guest created on hypervisor {{(pid=75165) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 00:16:22 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: b6558510-6f87-4ef3-b707-f1fa78bf61e8] Instance spawned successfully.
Oct 26 00:16:22 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-08eb7264-ca23-486f-9cca-e443a6a8161e tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] [instance: b6558510-6f87-4ef3-b707-f1fa78bf61e8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 00:16:22 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-08eb7264-ca23-486f-9cca-e443a6a8161e tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] [instance: b6558510-6f87-4ef3-b707-f1fa78bf61e8] Found default for hw_cdrom_bus of ide {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:16:22 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-08eb7264-ca23-486f-9cca-e443a6a8161e tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] [instance: b6558510-6f87-4ef3-b707-f1fa78bf61e8] Found default for hw_disk_bus of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:16:22 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-08eb7264-ca23-486f-9cca-e443a6a8161e tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] [instance: b6558510-6f87-4ef3-b707-f1fa78bf61e8] Found default for hw_input_bus of None {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:16:22 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-08eb7264-ca23-486f-9cca-e443a6a8161e tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] [instance: b6558510-6f87-4ef3-b707-f1fa78bf61e8] Found default for hw_pointer_model of None {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:16:22 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-08eb7264-ca23-486f-9cca-e443a6a8161e tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] [instance: b6558510-6f87-4ef3-b707-f1fa78bf61e8] Found default for hw_video_model of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:16:22 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-08eb7264-ca23-486f-9cca-e443a6a8161e tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] [instance: b6558510-6f87-4ef3-b707-f1fa78bf61e8] Found default for hw_vif_model of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:16:22 user nova-compute[75165]: DEBUG nova.compute.manager [req-80d068d3-cb21-408c-96aa-7b7db908c858 req-3800a3a5-2dbc-4924-a0bc-5ee57033bdc0 service nova] [instance: b6558510-6f87-4ef3-b707-f1fa78bf61e8] Received event network-vif-plugged-091593d3-5f35-496b-8e3a-d03963bc0d29 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:16:22 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-80d068d3-cb21-408c-96aa-7b7db908c858 req-3800a3a5-2dbc-4924-a0bc-5ee57033bdc0 service nova] Acquiring lock "b6558510-6f87-4ef3-b707-f1fa78bf61e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:16:22 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-80d068d3-cb21-408c-96aa-7b7db908c858 req-3800a3a5-2dbc-4924-a0bc-5ee57033bdc0 service nova] Lock "b6558510-6f87-4ef3-b707-f1fa78bf61e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:16:22 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-80d068d3-cb21-408c-96aa-7b7db908c858 req-3800a3a5-2dbc-4924-a0bc-5ee57033bdc0 service nova] Lock "b6558510-6f87-4ef3-b707-f1fa78bf61e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:16:22 user nova-compute[75165]: DEBUG nova.compute.manager [req-80d068d3-cb21-408c-96aa-7b7db908c858 req-3800a3a5-2dbc-4924-a0bc-5ee57033bdc0 service nova] [instance: b6558510-6f87-4ef3-b707-f1fa78bf61e8] No waiting events found dispatching network-vif-plugged-091593d3-5f35-496b-8e3a-d03963bc0d29 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:16:22 user nova-compute[75165]: WARNING nova.compute.manager [req-80d068d3-cb21-408c-96aa-7b7db908c858 req-3800a3a5-2dbc-4924-a0bc-5ee57033bdc0 service nova] [instance: b6558510-6f87-4ef3-b707-f1fa78bf61e8] Received unexpected event network-vif-plugged-091593d3-5f35-496b-8e3a-d03963bc0d29 for instance with vm_state building and task_state spawning.
Oct 26 00:16:22 user nova-compute[75165]: INFO nova.compute.manager [None req-08eb7264-ca23-486f-9cca-e443a6a8161e tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] [instance: b6558510-6f87-4ef3-b707-f1fa78bf61e8] Took 6.02 seconds to spawn the instance on the hypervisor.
Oct 26 00:16:22 user nova-compute[75165]: DEBUG nova.compute.manager [None req-08eb7264-ca23-486f-9cca-e443a6a8161e tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] [instance: b6558510-6f87-4ef3-b707-f1fa78bf61e8] Checking state {{(pid=75165) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 00:16:22 user nova-compute[75165]: INFO nova.compute.manager [None req-08eb7264-ca23-486f-9cca-e443a6a8161e tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] [instance: b6558510-6f87-4ef3-b707-f1fa78bf61e8] Took 7.85 seconds to build instance.
Oct 26 00:16:22 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-08eb7264-ca23-486f-9cca-e443a6a8161e tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] Lock "b6558510-6f87-4ef3-b707-f1fa78bf61e8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.371s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:16:23 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:16:26 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:16:28 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-d775589a-197e-4f7a-a1a2-b2dcbc09c4f4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 22b9689c-5e83-4807-971f-5b244914b7e5 is timed out.
Oct 26 00:16:28 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-d775589a-197e-4f7a-a1a2-b2dcbc09c4f4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Successfully detached device vdb from instance 22b9689c-5e83-4807-971f-5b244914b7e5 from the live domain config.
Oct 26 00:16:28 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d775589a-197e-4f7a-a1a2-b2dcbc09c4f4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: 22b9689c-5e83-4807-971f-5b244914b7e5] calling os-brick to detach iSCSI Volume {{(pid=75165) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 00:16:28 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-d775589a-197e-4f7a-a1a2-b2dcbc09c4f4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8bf8160e50>, {'target_iqn': 'iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'efsGqiyv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:16:28 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-d775589a-197e-4f7a-a1a2-b2dcbc09c4f4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:16:28 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-d775589a-197e-4f7a-a1a2-b2dcbc09c4f4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:16:28 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-d775589a-197e-4f7a-a1a2-b2dcbc09c4f4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:16:28 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:16:28 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:16:28 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ffcb831-8805-4e55-9ad9-651bd66e84cf]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f431d8b9-aa1e-46f5-b7da-39f4a550e050\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:16:28 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-d775589a-197e-4f7a-a1a2-b2dcbc09c4f4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 00:16:28 user nova-compute[75165]: No targets found.
Oct 26 00:16:28 user nova-compute[75165]: iSNS:
Oct 26 00:16:28 user nova-compute[75165]: No targets found.
Oct 26 00:16:28 user nova-compute[75165]: STATIC:
Oct 26 00:16:28 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b
Oct 26 00:16:28 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:16:28 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:16:28 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:f431d8b9-aa1e-46f5-b7da-39f4a550e050
Oct 26 00:16:28 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:16:28 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:16:28 user nova-compute[75165]: FIRMWARE:
Oct 26 00:16:28 user nova-compute[75165]: No targets found.
Oct 26 00:16:28 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:16:28 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-d775589a-197e-4f7a-a1a2-b2dcbc09c4f4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 00:16:28 user nova-compute[75165]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 00:16:28 user nova-compute[75165]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75165) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 00:16:28 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-d775589a-197e-4f7a-a1a2-b2dcbc09c4f4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b', 0)] {{(pid=75165) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 00:16:28 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:16:28 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:16:28 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[83d37d1a-417a-4304-b40e-d54136879551]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f431d8b9-aa1e-46f5-b7da-39f4a550e050\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:16:28 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:16:28 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:16:28 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[5121cab0-7a0f-4baf-901a-78fdf308a505]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f431d8b9-aa1e-46f5-b7da-39f4a550e050 (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:16:28 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-d775589a-197e-4f7a-a1a2-b2dcbc09c4f4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b (non-flash)
Oct 26 00:16:28 user nova-compute[75165]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f431d8b9-aa1e-46f5-b7da-39f4a550e050 (non-flash)
Oct 26 00:16:28 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:16:28 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-d775589a-197e-4f7a-a1a2-b2dcbc09c4f4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b (non-flash)
Oct 26 00:16:28 user nova-compute[75165]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f431d8b9-aa1e-46f5-b7da-39f4a550e050 (non-flash)
Oct 26 00:16:28 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:16:28 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-d775589a-197e-4f7a-a1a2-b2dcbc09c4f4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8be04c8430>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b'): ({'sdc'}, set())}) {{(pid=75165) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 00:16:28 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-d775589a-197e-4f7a-a1a2-b2dcbc09c4f4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Removing single pathed devices sdc {{(pid=75165) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 00:16:28 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:16:28 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:16:28 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aecdeb3-a5fa-439d-863f-4688a1c35bd6]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:16:28 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:16:28 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:16:28 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ce4e060-ae1a-4404-9303-d3ed785fb66c]: (4, ('ok\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:16:28 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-d775589a-197e-4f7a-a1a2-b2dcbc09c4f4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Flushing IO for device /dev/sdc {{(pid=75165) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 00:16:28 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:16:28 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:16:28 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[0def65fb-51f3-4752-a9e1-b0d151763e4d]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:16:28 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-d775589a-197e-4f7a-a1a2-b2dcbc09c4f4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75165) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 00:16:28 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:16:28 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.052s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:16:28 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[52ba5f63-c786-42ad-bf1c-236096b3cdb1]: (4, ('1', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:16:28 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-d775589a-197e-4f7a-a1a2-b2dcbc09c4f4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75165) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 00:16:28 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-d775589a-197e-4f7a-a1a2-b2dcbc09c4f4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] SCSI volumes sdc have been removed. {{(pid=75165) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 00:16:28 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-d775589a-197e-4f7a-a1a2-b2dcbc09c4f4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b')] {{(pid=75165) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 00:16:28 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:16:28 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:16:28 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa0d58dc-22f4-4258-8af3-571939f9c01d]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:16:28 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-d775589a-197e-4f7a-a1a2-b2dcbc09c4f4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:16:28 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b -p 172.16.0.220:3260 --logout {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:16:28 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:16:28 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[7777fb6c-21cc-4cf9-8a19-e81d2dc558ef]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:16:28 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-d775589a-197e-4f7a-a1a2-b2dcbc09c4f4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b, portal: 172.16.0.220,3260]
Oct 26 00:16:28 user nova-compute[75165]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b, portal: 172.16.0.220,3260] successful.
Oct 26 00:16:28 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:16:28 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b -p 172.16.0.220:3260 --op delete {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:16:28 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33bd85b7-301b-434f-b1af-a682c33cf49b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:16:28 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[80f0a191-6e71-433c-be2f-4d268fdb6f45]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:16:28 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-d775589a-197e-4f7a-a1a2-b2dcbc09c4f4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:16:28 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-d775589a-197e-4f7a-a1a2-b2dcbc09c4f4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.336s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:16:28 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-d775589a-197e-4f7a-a1a2-b2dcbc09c4f4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] <== disconnect_volume: return (338ms) None {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:16:28 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d775589a-197e-4f7a-a1a2-b2dcbc09c4f4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: 22b9689c-5e83-4807-971f-5b244914b7e5] Disconnected iSCSI Volume {{(pid=75165) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 00:16:28 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:16:29 user nova-compute[75165]: DEBUG nova.objects.instance [None req-d775589a-197e-4f7a-a1a2-b2dcbc09c4f4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Lazy-loading 'flavor' on Instance uuid 22b9689c-5e83-4807-971f-5b244914b7e5 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:16:29 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-d775589a-197e-4f7a-a1a2-b2dcbc09c4f4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Lock "22b9689c-5e83-4807-971f-5b244914b7e5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.930s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:16:33 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:16:35 user nova-compute[75165]: DEBUG nova.compute.manager [req-58e95288-3ea5-492b-9698-0cabf03c5292 req-90428048-85b7-4ea2-a521-3f6bdcdc86b1 service nova] [instance: b041e0af-4635-495c-b72d-fbbbd8d43a9b] Received event network-changed-1964255b-cf1e-4e17-a1f7-ae5d6ea25aef {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:16:35 user nova-compute[75165]: DEBUG nova.compute.manager [req-58e95288-3ea5-492b-9698-0cabf03c5292 req-90428048-85b7-4ea2-a521-3f6bdcdc86b1 service nova] [instance: b041e0af-4635-495c-b72d-fbbbd8d43a9b] Refreshing instance network info cache due to event network-changed-1964255b-cf1e-4e17-a1f7-ae5d6ea25aef. {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 00:16:35 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-58e95288-3ea5-492b-9698-0cabf03c5292 req-90428048-85b7-4ea2-a521-3f6bdcdc86b1 service nova] Acquiring lock "refresh_cache-b041e0af-4635-495c-b72d-fbbbd8d43a9b" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:16:35 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-58e95288-3ea5-492b-9698-0cabf03c5292 req-90428048-85b7-4ea2-a521-3f6bdcdc86b1 service nova] Acquired lock "refresh_cache-b041e0af-4635-495c-b72d-fbbbd8d43a9b" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:16:35 user nova-compute[75165]: DEBUG nova.network.neutron [req-58e95288-3ea5-492b-9698-0cabf03c5292 req-90428048-85b7-4ea2-a521-3f6bdcdc86b1 service nova] [instance: b041e0af-4635-495c-b72d-fbbbd8d43a9b] Refreshing network info cache for port 1964255b-cf1e-4e17-a1f7-ae5d6ea25aef {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 00:16:36 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:16:36 user nova-compute[75165]: DEBUG nova.network.neutron [req-58e95288-3ea5-492b-9698-0cabf03c5292 req-90428048-85b7-4ea2-a521-3f6bdcdc86b1 service nova] [instance: b041e0af-4635-495c-b72d-fbbbd8d43a9b] Updated VIF entry in instance network info cache for port 1964255b-cf1e-4e17-a1f7-ae5d6ea25aef. {{(pid=75165) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 00:16:36 user nova-compute[75165]: DEBUG nova.network.neutron [req-58e95288-3ea5-492b-9698-0cabf03c5292 req-90428048-85b7-4ea2-a521-3f6bdcdc86b1 service nova] [instance: b041e0af-4635-495c-b72d-fbbbd8d43a9b] Updating instance_info_cache with network_info: [{"id": "1964255b-cf1e-4e17-a1f7-ae5d6ea25aef", "address": "fa:16:3e:76:6f:05", "network": {"id": "f54e2e9f-5c1e-44ca-bd4b-9cf0747b0f72", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-806146051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "920152101768459baa71010b380ea8f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1964255b-cf", "ovs_interfaceid": "1964255b-cf1e-4e17-a1f7-ae5d6ea25aef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:16:36 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-58e95288-3ea5-492b-9698-0cabf03c5292 req-90428048-85b7-4ea2-a521-3f6bdcdc86b1 service nova] Releasing lock "refresh_cache-b041e0af-4635-495c-b72d-fbbbd8d43a9b" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:16:38 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:16:41 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:16:42 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-a39b4cf1-d8e3-41dd-9a56-b9c5e41385aa tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Acquiring lock "b041e0af-4635-495c-b72d-fbbbd8d43a9b" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:16:42 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-a39b4cf1-d8e3-41dd-9a56-b9c5e41385aa tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Lock "b041e0af-4635-495c-b72d-fbbbd8d43a9b" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.002s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:16:42 user nova-compute[75165]: INFO nova.compute.manager [None req-a39b4cf1-d8e3-41dd-9a56-b9c5e41385aa tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] [instance: b041e0af-4635-495c-b72d-fbbbd8d43a9b] Shelving
Oct 26 00:16:42 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:16:42 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:16:42 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:16:42 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:16:43 user nova-compute[75165]: DEBUG nova.compute.manager [req-b5865523-bd74-4488-b8ec-9172f33d8854 req-d562cff4-2a22-4f80-93a7-fb9556ab966b service nova] [instance: b041e0af-4635-495c-b72d-fbbbd8d43a9b] Received event network-vif-unplugged-1964255b-cf1e-4e17-a1f7-ae5d6ea25aef {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:16:43 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-b5865523-bd74-4488-b8ec-9172f33d8854 req-d562cff4-2a22-4f80-93a7-fb9556ab966b service nova] Acquiring lock "b041e0af-4635-495c-b72d-fbbbd8d43a9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:16:43 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-b5865523-bd74-4488-b8ec-9172f33d8854 req-d562cff4-2a22-4f80-93a7-fb9556ab966b service nova] Lock "b041e0af-4635-495c-b72d-fbbbd8d43a9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:16:43 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-b5865523-bd74-4488-b8ec-9172f33d8854 req-d562cff4-2a22-4f80-93a7-fb9556ab966b service nova] Lock "b041e0af-4635-495c-b72d-fbbbd8d43a9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:16:43 user nova-compute[75165]: DEBUG nova.compute.manager [req-b5865523-bd74-4488-b8ec-9172f33d8854 req-d562cff4-2a22-4f80-93a7-fb9556ab966b service nova] [instance: b041e0af-4635-495c-b72d-fbbbd8d43a9b] No waiting events found dispatching network-vif-unplugged-1964255b-cf1e-4e17-a1f7-ae5d6ea25aef {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:16:43 user nova-compute[75165]: WARNING nova.compute.manager [req-b5865523-bd74-4488-b8ec-9172f33d8854 req-d562cff4-2a22-4f80-93a7-fb9556ab966b service nova] [instance: b041e0af-4635-495c-b72d-fbbbd8d43a9b] Received unexpected event network-vif-unplugged-1964255b-cf1e-4e17-a1f7-ae5d6ea25aef for instance with vm_state active and task_state shelving.
Oct 26 00:16:43 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:16:43 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:16:43 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: b041e0af-4635-495c-b72d-fbbbd8d43a9b] Instance destroyed successfully.
Oct 26 00:16:43 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:16:43 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:16:43 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-a39b4cf1-d8e3-41dd-9a56-b9c5e41385aa tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] [instance: b041e0af-4635-495c-b72d-fbbbd8d43a9b] Beginning cold snapshot process
Oct 26 00:16:43 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:16:43 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:16:43 user nova-compute[75165]: DEBUG nova.privsep.utils [None req-a39b4cf1-d8e3-41dd-9a56-b9c5e41385aa tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75165) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 26 00:16:43 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-a39b4cf1-d8e3-41dd-9a56-b9c5e41385aa tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/b041e0af-4635-495c-b72d-fbbbd8d43a9b/disk /opt/stack/data/nova/instances/snapshots/tmpytqod0cl/4da8c16b9cb242aca283727313f33b19 {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:16:44 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:16:44 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:16:44 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:16:44 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:16:44 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:16:44 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:16:44 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-a39b4cf1-d8e3-41dd-9a56-b9c5e41385aa tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/b041e0af-4635-495c-b72d-fbbbd8d43a9b/disk /opt/stack/data/nova/instances/snapshots/tmpytqod0cl/4da8c16b9cb242aca283727313f33b19" returned: 0 in 0.875s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:16:44 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-a39b4cf1-d8e3-41dd-9a56-b9c5e41385aa tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] [instance: b041e0af-4635-495c-b72d-fbbbd8d43a9b] Snapshot extracted, beginning image upload
Oct 26 00:16:44 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-92c336b1-214d-4960-966a-4382f1816b7a tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] Acquiring lock "8f8ec77f-bf35-4b15-bd77-9f8407b09d0b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:16:44 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-92c336b1-214d-4960-966a-4382f1816b7a tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] Lock "8f8ec77f-bf35-4b15-bd77-9f8407b09d0b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:16:44 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-92c336b1-214d-4960-966a-4382f1816b7a tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] Acquiring lock "8f8ec77f-bf35-4b15-bd77-9f8407b09d0b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:16:44 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-92c336b1-214d-4960-966a-4382f1816b7a tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] Lock "8f8ec77f-bf35-4b15-bd77-9f8407b09d0b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:16:44 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-92c336b1-214d-4960-966a-4382f1816b7a tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] Lock "8f8ec77f-bf35-4b15-bd77-9f8407b09d0b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:16:44 user nova-compute[75165]: INFO nova.compute.manager [None req-92c336b1-214d-4960-966a-4382f1816b7a tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] [instance: 8f8ec77f-bf35-4b15-bd77-9f8407b09d0b] Terminating instance
Oct 26 00:16:44 user nova-compute[75165]: DEBUG nova.compute.manager [None req-92c336b1-214d-4960-966a-4382f1816b7a tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] [instance: 8f8ec77f-bf35-4b15-bd77-9f8407b09d0b] Start destroying the instance on the hypervisor. {{(pid=75165) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 00:16:44 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:16:44 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:16:44 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:16:44 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:16:45 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:16:45 user nova-compute[75165]: DEBUG nova.compute.manager [req-4e691fd5-f91a-48ff-8345-dea8e2513c80 req-645145df-df3d-44a6-b998-50bd48e049ad service nova] [instance: 8f8ec77f-bf35-4b15-bd77-9f8407b09d0b] Received event network-vif-unplugged-7f5b9415-3336-49cc-8909-c21c7003e6fe {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:16:45 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-4e691fd5-f91a-48ff-8345-dea8e2513c80 req-645145df-df3d-44a6-b998-50bd48e049ad service nova] Acquiring lock "8f8ec77f-bf35-4b15-bd77-9f8407b09d0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:16:45 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-4e691fd5-f91a-48ff-8345-dea8e2513c80 req-645145df-df3d-44a6-b998-50bd48e049ad service nova] Lock "8f8ec77f-bf35-4b15-bd77-9f8407b09d0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:16:45 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-4e691fd5-f91a-48ff-8345-dea8e2513c80 req-645145df-df3d-44a6-b998-50bd48e049ad service nova] Lock "8f8ec77f-bf35-4b15-bd77-9f8407b09d0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:16:45 user nova-compute[75165]: DEBUG nova.compute.manager [req-4e691fd5-f91a-48ff-8345-dea8e2513c80 req-645145df-df3d-44a6-b998-50bd48e049ad service nova] [instance: 8f8ec77f-bf35-4b15-bd77-9f8407b09d0b] No waiting events found dispatching network-vif-unplugged-7f5b9415-3336-49cc-8909-c21c7003e6fe {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:16:45 user nova-compute[75165]: DEBUG nova.compute.manager [req-4e691fd5-f91a-48ff-8345-dea8e2513c80 req-645145df-df3d-44a6-b998-50bd48e049ad service nova] [instance: 8f8ec77f-bf35-4b15-bd77-9f8407b09d0b] Received event network-vif-unplugged-7f5b9415-3336-49cc-8909-c21c7003e6fe for instance with task_state deleting. {{(pid=75165) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 00:16:45 user nova-compute[75165]: DEBUG nova.compute.manager [req-ab6f3f94-ee7f-43b6-80e3-51a6d8e8a318 req-aa7b688f-0b26-41cb-8423-faeb70b3d14d service nova] [instance: b041e0af-4635-495c-b72d-fbbbd8d43a9b] Received event network-vif-plugged-1964255b-cf1e-4e17-a1f7-ae5d6ea25aef {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:16:45 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-ab6f3f94-ee7f-43b6-80e3-51a6d8e8a318 req-aa7b688f-0b26-41cb-8423-faeb70b3d14d service nova] Acquiring lock "b041e0af-4635-495c-b72d-fbbbd8d43a9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:16:45 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-ab6f3f94-ee7f-43b6-80e3-51a6d8e8a318 req-aa7b688f-0b26-41cb-8423-faeb70b3d14d service nova] Lock "b041e0af-4635-495c-b72d-fbbbd8d43a9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:16:45 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-ab6f3f94-ee7f-43b6-80e3-51a6d8e8a318 req-aa7b688f-0b26-41cb-8423-faeb70b3d14d service nova] Lock "b041e0af-4635-495c-b72d-fbbbd8d43a9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:16:45 user nova-compute[75165]: DEBUG nova.compute.manager [req-ab6f3f94-ee7f-43b6-80e3-51a6d8e8a318 req-aa7b688f-0b26-41cb-8423-faeb70b3d14d service nova] [instance: b041e0af-4635-495c-b72d-fbbbd8d43a9b] No waiting events found dispatching network-vif-plugged-1964255b-cf1e-4e17-a1f7-ae5d6ea25aef {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:16:45 user nova-compute[75165]: WARNING nova.compute.manager [req-ab6f3f94-ee7f-43b6-80e3-51a6d8e8a318 req-aa7b688f-0b26-41cb-8423-faeb70b3d14d service nova] [instance: b041e0af-4635-495c-b72d-fbbbd8d43a9b] Received unexpected event network-vif-plugged-1964255b-cf1e-4e17-a1f7-ae5d6ea25aef for instance with vm_state active and task_state shelving_image_uploading.
Oct 26 00:16:45 user nova-compute[75165]: DEBUG nova.compute.manager [req-ab6f3f94-ee7f-43b6-80e3-51a6d8e8a318 req-aa7b688f-0b26-41cb-8423-faeb70b3d14d service nova] [instance: b041e0af-4635-495c-b72d-fbbbd8d43a9b] Received event network-vif-plugged-1964255b-cf1e-4e17-a1f7-ae5d6ea25aef {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:16:45 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-ab6f3f94-ee7f-43b6-80e3-51a6d8e8a318 req-aa7b688f-0b26-41cb-8423-faeb70b3d14d service nova] Acquiring lock "b041e0af-4635-495c-b72d-fbbbd8d43a9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:16:45 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-ab6f3f94-ee7f-43b6-80e3-51a6d8e8a318 req-aa7b688f-0b26-41cb-8423-faeb70b3d14d service nova] Lock "b041e0af-4635-495c-b72d-fbbbd8d43a9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:16:45 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-ab6f3f94-ee7f-43b6-80e3-51a6d8e8a318 req-aa7b688f-0b26-41cb-8423-faeb70b3d14d service nova] Lock "b041e0af-4635-495c-b72d-fbbbd8d43a9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:16:45 user nova-compute[75165]: DEBUG nova.compute.manager [req-ab6f3f94-ee7f-43b6-80e3-51a6d8e8a318 req-aa7b688f-0b26-41cb-8423-faeb70b3d14d service nova] [instance: b041e0af-4635-495c-b72d-fbbbd8d43a9b] No waiting events found dispatching network-vif-plugged-1964255b-cf1e-4e17-a1f7-ae5d6ea25aef {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:16:45 user nova-compute[75165]: WARNING nova.compute.manager [req-ab6f3f94-ee7f-43b6-80e3-51a6d8e8a318 req-aa7b688f-0b26-41cb-8423-faeb70b3d14d service nova] [instance: b041e0af-4635-495c-b72d-fbbbd8d43a9b] Received unexpected event network-vif-plugged-1964255b-cf1e-4e17-a1f7-ae5d6ea25aef for instance with vm_state active and task_state shelving_image_uploading.
Oct 26 00:16:45 user nova-compute[75165]: DEBUG nova.compute.manager [req-ab6f3f94-ee7f-43b6-80e3-51a6d8e8a318 req-aa7b688f-0b26-41cb-8423-faeb70b3d14d service nova] [instance: b041e0af-4635-495c-b72d-fbbbd8d43a9b] Received event network-vif-plugged-1964255b-cf1e-4e17-a1f7-ae5d6ea25aef {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:16:45 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-ab6f3f94-ee7f-43b6-80e3-51a6d8e8a318 req-aa7b688f-0b26-41cb-8423-faeb70b3d14d service nova] Acquiring lock "b041e0af-4635-495c-b72d-fbbbd8d43a9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:16:45 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-ab6f3f94-ee7f-43b6-80e3-51a6d8e8a318 req-aa7b688f-0b26-41cb-8423-faeb70b3d14d service nova] Lock "b041e0af-4635-495c-b72d-fbbbd8d43a9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:16:45 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-ab6f3f94-ee7f-43b6-80e3-51a6d8e8a318 req-aa7b688f-0b26-41cb-8423-faeb70b3d14d service nova] Lock "b041e0af-4635-495c-b72d-fbbbd8d43a9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:16:45 user nova-compute[75165]: DEBUG nova.compute.manager [req-ab6f3f94-ee7f-43b6-80e3-51a6d8e8a318 req-aa7b688f-0b26-41cb-8423-faeb70b3d14d service nova] [instance: b041e0af-4635-495c-b72d-fbbbd8d43a9b] No waiting events found dispatching network-vif-plugged-1964255b-cf1e-4e17-a1f7-ae5d6ea25aef {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:16:45 user nova-compute[75165]: WARNING nova.compute.manager [req-ab6f3f94-ee7f-43b6-80e3-51a6d8e8a318 req-aa7b688f-0b26-41cb-8423-faeb70b3d14d service nova] [instance: b041e0af-4635-495c-b72d-fbbbd8d43a9b] Received unexpected event network-vif-plugged-1964255b-cf1e-4e17-a1f7-ae5d6ea25aef for instance with vm_state active and task_state shelving_image_uploading.
Oct 26 00:16:45 user nova-compute[75165]: DEBUG nova.compute.manager [req-ab6f3f94-ee7f-43b6-80e3-51a6d8e8a318 req-aa7b688f-0b26-41cb-8423-faeb70b3d14d service nova] [instance: b041e0af-4635-495c-b72d-fbbbd8d43a9b] Received event network-vif-unplugged-1964255b-cf1e-4e17-a1f7-ae5d6ea25aef {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:16:45 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-ab6f3f94-ee7f-43b6-80e3-51a6d8e8a318 req-aa7b688f-0b26-41cb-8423-faeb70b3d14d service nova] Acquiring lock "b041e0af-4635-495c-b72d-fbbbd8d43a9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:16:45 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-ab6f3f94-ee7f-43b6-80e3-51a6d8e8a318 req-aa7b688f-0b26-41cb-8423-faeb70b3d14d service nova] Lock "b041e0af-4635-495c-b72d-fbbbd8d43a9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:16:45 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-ab6f3f94-ee7f-43b6-80e3-51a6d8e8a318 req-aa7b688f-0b26-41cb-8423-faeb70b3d14d service nova] Lock "b041e0af-4635-495c-b72d-fbbbd8d43a9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:16:45 user nova-compute[75165]: DEBUG nova.compute.manager [req-ab6f3f94-ee7f-43b6-80e3-51a6d8e8a318 req-aa7b688f-0b26-41cb-8423-faeb70b3d14d service nova] [instance: b041e0af-4635-495c-b72d-fbbbd8d43a9b] No waiting events found dispatching network-vif-unplugged-1964255b-cf1e-4e17-a1f7-ae5d6ea25aef {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:16:45 user nova-compute[75165]: WARNING nova.compute.manager [req-ab6f3f94-ee7f-43b6-80e3-51a6d8e8a318 req-aa7b688f-0b26-41cb-8423-faeb70b3d14d service nova] [instance: b041e0af-4635-495c-b72d-fbbbd8d43a9b] Received unexpected event network-vif-unplugged-1964255b-cf1e-4e17-a1f7-ae5d6ea25aef for instance with vm_state active and task_state shelving_image_uploading.
Oct 26 00:16:45 user nova-compute[75165]: DEBUG nova.compute.manager [req-ab6f3f94-ee7f-43b6-80e3-51a6d8e8a318 req-aa7b688f-0b26-41cb-8423-faeb70b3d14d service nova] [instance: b041e0af-4635-495c-b72d-fbbbd8d43a9b] Received event network-vif-plugged-1964255b-cf1e-4e17-a1f7-ae5d6ea25aef {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:16:45 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-ab6f3f94-ee7f-43b6-80e3-51a6d8e8a318 req-aa7b688f-0b26-41cb-8423-faeb70b3d14d service nova] Acquiring lock "b041e0af-4635-495c-b72d-fbbbd8d43a9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:16:45 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-ab6f3f94-ee7f-43b6-80e3-51a6d8e8a318 req-aa7b688f-0b26-41cb-8423-faeb70b3d14d service nova] Lock "b041e0af-4635-495c-b72d-fbbbd8d43a9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:16:45 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-ab6f3f94-ee7f-43b6-80e3-51a6d8e8a318 req-aa7b688f-0b26-41cb-8423-faeb70b3d14d service nova] Lock "b041e0af-4635-495c-b72d-fbbbd8d43a9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:16:45 user nova-compute[75165]: DEBUG nova.compute.manager [req-ab6f3f94-ee7f-43b6-80e3-51a6d8e8a318 req-aa7b688f-0b26-41cb-8423-faeb70b3d14d service nova] [instance: b041e0af-4635-495c-b72d-fbbbd8d43a9b] No waiting events found dispatching network-vif-plugged-1964255b-cf1e-4e17-a1f7-ae5d6ea25aef {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:16:45 user nova-compute[75165]: WARNING nova.compute.manager [req-ab6f3f94-ee7f-43b6-80e3-51a6d8e8a318 req-aa7b688f-0b26-41cb-8423-faeb70b3d14d service nova] [instance: b041e0af-4635-495c-b72d-fbbbd8d43a9b] Received unexpected event network-vif-plugged-1964255b-cf1e-4e17-a1f7-ae5d6ea25aef for instance with vm_state active and task_state shelving_image_uploading.
Oct 26 00:16:45 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: 8f8ec77f-bf35-4b15-bd77-9f8407b09d0b] Instance destroyed successfully.
Oct 26 00:16:45 user nova-compute[75165]: DEBUG nova.objects.instance [None req-92c336b1-214d-4960-966a-4382f1816b7a tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] Lazy-loading 'resources' on Instance uuid 8f8ec77f-bf35-4b15-bd77-9f8407b09d0b {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:16:45 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-92c336b1-214d-4960-966a-4382f1816b7a tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T00:12:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1656940732',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1656940732',id=19,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN+wbYUhWvc0Q8Ki4GTS2Tn91hUUyA5mHnOcmOrTkWVgToMqNtiT9k+t+ZtOfljqpTvTwcwIhu3LxiFs8eVVq6KIF4bfjQF4bPry0REDa8gn1PrkrDV91CuU9Osr0XBN6A==',key_name='tempest-keypair-1700446792',keypairs=<?>,launch_index=0,launched_at=2023-10-26T00:12:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='da5b9c2d1b1e4d9d885fa82f1625b5e0',ramdisk_id='',reservation_id='r-wb7qp03s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-950905423',owner_user_name='tempest-TaggedAttachmentsTest-950905423-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T00:12:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='93efb23845e441bc932910691dfaf023',uuid=8f8ec77f-bf35-4b15-bd77-9f8407b09d0b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7f5b9415-3336-49cc-8909-c21c7003e6fe", "address": "fa:16:3e:c8:5c:77", "network": {"id": "493a3a47-a5c0-4b54-a13e-e5c39f80e90a", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-218779534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da5b9c2d1b1e4d9d885fa82f1625b5e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f5b9415-33", "ovs_interfaceid": "7f5b9415-3336-49cc-8909-c21c7003e6fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 00:16:45 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-92c336b1-214d-4960-966a-4382f1816b7a tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] Converting VIF {"id": "7f5b9415-3336-49cc-8909-c21c7003e6fe", "address": "fa:16:3e:c8:5c:77", "network": {"id": "493a3a47-a5c0-4b54-a13e-e5c39f80e90a", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-218779534-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da5b9c2d1b1e4d9d885fa82f1625b5e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f5b9415-33", "ovs_interfaceid": "7f5b9415-3336-49cc-8909-c21c7003e6fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:16:45 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-92c336b1-214d-4960-966a-4382f1816b7a tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c8:5c:77,bridge_name='br-int',has_traffic_filtering=True,id=7f5b9415-3336-49cc-8909-c21c7003e6fe,network=Network(493a3a47-a5c0-4b54-a13e-e5c39f80e90a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f5b9415-33') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:16:45 user nova-compute[75165]: DEBUG os_vif [None req-92c336b1-214d-4960-966a-4382f1816b7a tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c8:5c:77,bridge_name='br-int',has_traffic_filtering=True,id=7f5b9415-3336-49cc-8909-c21c7003e6fe,network=Network(493a3a47-a5c0-4b54-a13e-e5c39f80e90a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f5b9415-33') {{(pid=75165) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 00:16:45 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:16:45 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7f5b9415-33, bridge=br-int, if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:16:45 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:16:45 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:16:45 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:16:45 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:16:45 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ae71bec8-7275-4c79-af22-93b1f1b4bad7) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:16:45 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:16:45 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:16:45 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:16:45 user nova-compute[75165]: INFO os_vif [None req-92c336b1-214d-4960-966a-4382f1816b7a tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c8:5c:77,bridge_name='br-int',has_traffic_filtering=True,id=7f5b9415-3336-49cc-8909-c21c7003e6fe,network=Network(493a3a47-a5c0-4b54-a13e-e5c39f80e90a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f5b9415-33')
Oct 26 00:16:45 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-92c336b1-214d-4960-966a-4382f1816b7a tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] [instance: 8f8ec77f-bf35-4b15-bd77-9f8407b09d0b] Deleting instance files /opt/stack/data/nova/instances/8f8ec77f-bf35-4b15-bd77-9f8407b09d0b_del
Oct 26 00:16:45 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-92c336b1-214d-4960-966a-4382f1816b7a tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] [instance: 8f8ec77f-bf35-4b15-bd77-9f8407b09d0b] Deletion of /opt/stack/data/nova/instances/8f8ec77f-bf35-4b15-bd77-9f8407b09d0b_del complete
Oct 26 00:16:45 user nova-compute[75165]: INFO nova.compute.manager [None req-92c336b1-214d-4960-966a-4382f1816b7a tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] [instance: 8f8ec77f-bf35-4b15-bd77-9f8407b09d0b] Took 0.99 seconds to destroy the instance on the hypervisor.
Oct 26 00:16:45 user nova-compute[75165]: DEBUG oslo.service.loopingcall [None req-92c336b1-214d-4960-966a-4382f1816b7a tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75165) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 00:16:45 user nova-compute[75165]: DEBUG nova.compute.manager [-] [instance: 8f8ec77f-bf35-4b15-bd77-9f8407b09d0b] Deallocating network for instance {{(pid=75165) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 00:16:45 user nova-compute[75165]: DEBUG nova.network.neutron [-] [instance: 8f8ec77f-bf35-4b15-bd77-9f8407b09d0b] deallocate_for_instance() {{(pid=75165) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 00:16:46 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:16:47 user nova-compute[75165]: DEBUG nova.network.neutron [-] [instance: 8f8ec77f-bf35-4b15-bd77-9f8407b09d0b] Updating instance_info_cache with network_info: [] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:16:47 user nova-compute[75165]: INFO nova.compute.manager [-] [instance: 8f8ec77f-bf35-4b15-bd77-9f8407b09d0b] Took 1.23 seconds to deallocate network for instance.
Oct 26 00:16:47 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-92c336b1-214d-4960-966a-4382f1816b7a tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:16:47 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-92c336b1-214d-4960-966a-4382f1816b7a tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:16:47 user nova-compute[75165]: DEBUG nova.compute.manager [req-25b55abb-7deb-4921-a02d-2a55d705d299 req-f496bcf2-0a51-4407-863d-a89c9b1cf33c service nova] [instance: 8f8ec77f-bf35-4b15-bd77-9f8407b09d0b] Received event network-vif-plugged-7f5b9415-3336-49cc-8909-c21c7003e6fe {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:16:47 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-25b55abb-7deb-4921-a02d-2a55d705d299 req-f496bcf2-0a51-4407-863d-a89c9b1cf33c service nova] Acquiring lock "8f8ec77f-bf35-4b15-bd77-9f8407b09d0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:16:47 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-25b55abb-7deb-4921-a02d-2a55d705d299 req-f496bcf2-0a51-4407-863d-a89c9b1cf33c service nova] Lock "8f8ec77f-bf35-4b15-bd77-9f8407b09d0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:16:47 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-25b55abb-7deb-4921-a02d-2a55d705d299 req-f496bcf2-0a51-4407-863d-a89c9b1cf33c service nova] Lock "8f8ec77f-bf35-4b15-bd77-9f8407b09d0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:16:47 user nova-compute[75165]: DEBUG nova.compute.manager [req-25b55abb-7deb-4921-a02d-2a55d705d299 req-f496bcf2-0a51-4407-863d-a89c9b1cf33c service nova] [instance: 8f8ec77f-bf35-4b15-bd77-9f8407b09d0b] No waiting events found dispatching network-vif-plugged-7f5b9415-3336-49cc-8909-c21c7003e6fe {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:16:47 user nova-compute[75165]: WARNING nova.compute.manager [req-25b55abb-7deb-4921-a02d-2a55d705d299 req-f496bcf2-0a51-4407-863d-a89c9b1cf33c service nova] [instance: 8f8ec77f-bf35-4b15-bd77-9f8407b09d0b] Received unexpected event network-vif-plugged-7f5b9415-3336-49cc-8909-c21c7003e6fe for instance with vm_state deleted and task_state None.
Oct 26 00:16:47 user nova-compute[75165]: DEBUG nova.compute.manager [req-48a84ab3-d436-4276-a152-d68e30d27722 req-2f76dbaf-7ea7-4c40-9f8a-27fc7468a8ae service nova] [instance: 8f8ec77f-bf35-4b15-bd77-9f8407b09d0b] Received event network-vif-deleted-7f5b9415-3336-49cc-8909-c21c7003e6fe {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:16:47 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-92c336b1-214d-4960-966a-4382f1816b7a tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:16:47 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-92c336b1-214d-4960-966a-4382f1816b7a tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:16:47 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-92c336b1-214d-4960-966a-4382f1816b7a tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.533s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:16:47 user nova-compute[75165]: INFO nova.scheduler.client.report [None req-92c336b1-214d-4960-966a-4382f1816b7a tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] Deleted allocations for instance 8f8ec77f-bf35-4b15-bd77-9f8407b09d0b
Oct 26 00:16:47 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-92c336b1-214d-4960-966a-4382f1816b7a tempest-TaggedAttachmentsTest-950905423 tempest-TaggedAttachmentsTest-950905423-project-member] Lock "8f8ec77f-bf35-4b15-bd77-9f8407b09d0b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.024s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:16:47 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-a39b4cf1-d8e3-41dd-9a56-b9c5e41385aa tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] [instance: b041e0af-4635-495c-b72d-fbbbd8d43a9b] Snapshot image upload complete
Oct 26 00:16:47 user nova-compute[75165]: DEBUG nova.compute.manager [None req-a39b4cf1-d8e3-41dd-9a56-b9c5e41385aa tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] [instance: b041e0af-4635-495c-b72d-fbbbd8d43a9b] Checking state {{(pid=75165) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 00:16:48 user nova-compute[75165]: INFO nova.compute.manager [None req-a39b4cf1-d8e3-41dd-9a56-b9c5e41385aa tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] [instance: b041e0af-4635-495c-b72d-fbbbd8d43a9b] Shelve offloading
Oct 26 00:16:48 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: b041e0af-4635-495c-b72d-fbbbd8d43a9b] Instance destroyed successfully.
Oct 26 00:16:48 user nova-compute[75165]: DEBUG nova.compute.manager [None req-a39b4cf1-d8e3-41dd-9a56-b9c5e41385aa tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] [instance: b041e0af-4635-495c-b72d-fbbbd8d43a9b] Checking state {{(pid=75165) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 00:16:48 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-a39b4cf1-d8e3-41dd-9a56-b9c5e41385aa tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Acquiring lock "refresh_cache-b041e0af-4635-495c-b72d-fbbbd8d43a9b" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:16:48 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-a39b4cf1-d8e3-41dd-9a56-b9c5e41385aa tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Acquired lock "refresh_cache-b041e0af-4635-495c-b72d-fbbbd8d43a9b" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:16:48 user nova-compute[75165]: DEBUG nova.network.neutron [None req-a39b4cf1-d8e3-41dd-9a56-b9c5e41385aa tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] [instance: b041e0af-4635-495c-b72d-fbbbd8d43a9b] Building network info cache for instance {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 00:16:48 user nova-compute[75165]: DEBUG nova.network.neutron [None req-a39b4cf1-d8e3-41dd-9a56-b9c5e41385aa tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] [instance: b041e0af-4635-495c-b72d-fbbbd8d43a9b] Updating instance_info_cache with network_info: [{"id": "1964255b-cf1e-4e17-a1f7-ae5d6ea25aef", "address": "fa:16:3e:76:6f:05", "network": {"id": "f54e2e9f-5c1e-44ca-bd4b-9cf0747b0f72", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-806146051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "920152101768459baa71010b380ea8f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1964255b-cf", "ovs_interfaceid": "1964255b-cf1e-4e17-a1f7-ae5d6ea25aef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:16:48 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-a39b4cf1-d8e3-41dd-9a56-b9c5e41385aa tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Releasing lock "refresh_cache-b041e0af-4635-495c-b72d-fbbbd8d43a9b" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:16:49 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: b041e0af-4635-495c-b72d-fbbbd8d43a9b] Instance destroyed successfully.
Oct 26 00:16:49 user nova-compute[75165]: DEBUG nova.objects.instance [None req-a39b4cf1-d8e3-41dd-9a56-b9c5e41385aa tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Lazy-loading 'resources' on Instance uuid b041e0af-4635-495c-b72d-fbbbd8d43a9b {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:16:49 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-a39b4cf1-d8e3-41dd-9a56-b9c5e41385aa tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:14:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1018278796',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1018278796',id=21,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFIx031L1+GlVTK7qzqFtuz0mMeB9gXcDnYf15sI5K9uRukBpGnVUMwr1kJMENEY2qClV++eI4EJ2qQekfK0Kpz2P/4UBmBjh5aCvNsjqbekaGDKFB27VB5WEQwCxB5PCA==',key_name='tempest-keypair-1875668396',keypairs=<?>,launch_index=0,launched_at=2023-10-26T00:14:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='920152101768459baa71010b380ea8f1',ramdisk_id='',reservation_id='r-agpdy52s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-6636270',owner_user_name='tempest-AttachVolumeShelveTestJSON-6636270-project-member',shelved_at='2023-10-26T00:16:47.954892',shelved_host='user',shelved_image_id='9a1997e4-5869-4d2a-97ae-53b83fbdca54'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T00:16:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a40cb1b08014444686bd0adad03f6c68',uuid=b041e0af-4635-495c-b72d-fbbbd8d43a9b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "1964255b-cf1e-4e17-a1f7-ae5d6ea25aef", "address": "fa:16:3e:76:6f:05", "network": {"id": "f54e2e9f-5c1e-44ca-bd4b-9cf0747b0f72", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-806146051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "920152101768459baa71010b380ea8f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1964255b-cf", "ovs_interfaceid": "1964255b-cf1e-4e17-a1f7-ae5d6ea25aef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 00:16:49 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-a39b4cf1-d8e3-41dd-9a56-b9c5e41385aa tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Converting VIF {"id": "1964255b-cf1e-4e17-a1f7-ae5d6ea25aef", "address": "fa:16:3e:76:6f:05", "network": {"id": "f54e2e9f-5c1e-44ca-bd4b-9cf0747b0f72", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-806146051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "920152101768459baa71010b380ea8f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1964255b-cf", "ovs_interfaceid": "1964255b-cf1e-4e17-a1f7-ae5d6ea25aef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:16:49 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-a39b4cf1-d8e3-41dd-9a56-b9c5e41385aa tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:6f:05,bridge_name='br-int',has_traffic_filtering=True,id=1964255b-cf1e-4e17-a1f7-ae5d6ea25aef,network=Network(f54e2e9f-5c1e-44ca-bd4b-9cf0747b0f72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1964255b-cf') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:16:49 user nova-compute[75165]: DEBUG os_vif [None req-a39b4cf1-d8e3-41dd-9a56-b9c5e41385aa tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:6f:05,bridge_name='br-int',has_traffic_filtering=True,id=1964255b-cf1e-4e17-a1f7-ae5d6ea25aef,network=Network(f54e2e9f-5c1e-44ca-bd4b-9cf0747b0f72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1964255b-cf') {{(pid=75165) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 00:16:49 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:16:49 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1964255b-cf, bridge=br-int, if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:16:49 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:16:49 user nova-compute[75165]: DEBUG nova.compute.manager [req-cb316c19-4902-4a37-9caa-1f80127b2f23 req-d52e2594-a41d-4917-a0de-8eff2379e7bd service nova] [instance: b041e0af-4635-495c-b72d-fbbbd8d43a9b] Received event network-changed-1964255b-cf1e-4e17-a1f7-ae5d6ea25aef {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:16:49 user nova-compute[75165]: DEBUG nova.compute.manager [req-cb316c19-4902-4a37-9caa-1f80127b2f23 req-d52e2594-a41d-4917-a0de-8eff2379e7bd service nova] [instance: b041e0af-4635-495c-b72d-fbbbd8d43a9b] Refreshing instance network info cache due to event network-changed-1964255b-cf1e-4e17-a1f7-ae5d6ea25aef. {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 00:16:49 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-cb316c19-4902-4a37-9caa-1f80127b2f23 req-d52e2594-a41d-4917-a0de-8eff2379e7bd service nova] Acquiring lock "refresh_cache-b041e0af-4635-495c-b72d-fbbbd8d43a9b" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:16:49 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-cb316c19-4902-4a37-9caa-1f80127b2f23 req-d52e2594-a41d-4917-a0de-8eff2379e7bd service nova] Acquired lock "refresh_cache-b041e0af-4635-495c-b72d-fbbbd8d43a9b" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:16:49 user nova-compute[75165]: DEBUG nova.network.neutron [req-cb316c19-4902-4a37-9caa-1f80127b2f23 req-d52e2594-a41d-4917-a0de-8eff2379e7bd service nova] [instance: b041e0af-4635-495c-b72d-fbbbd8d43a9b] Refreshing network info cache for port 1964255b-cf1e-4e17-a1f7-ae5d6ea25aef {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 00:16:49 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:16:49 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:16:49 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0be02375-0fd4-4d15-ad6c-7eb9d51af287) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:16:49 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:16:49 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:16:49 user nova-compute[75165]: INFO os_vif [None req-a39b4cf1-d8e3-41dd-9a56-b9c5e41385aa tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:6f:05,bridge_name='br-int',has_traffic_filtering=True,id=1964255b-cf1e-4e17-a1f7-ae5d6ea25aef,network=Network(f54e2e9f-5c1e-44ca-bd4b-9cf0747b0f72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1964255b-cf')
Oct 26 00:16:49 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-a39b4cf1-d8e3-41dd-9a56-b9c5e41385aa tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] [instance: b041e0af-4635-495c-b72d-fbbbd8d43a9b] Deleting instance files /opt/stack/data/nova/instances/b041e0af-4635-495c-b72d-fbbbd8d43a9b_del
Oct 26 00:16:49 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-a39b4cf1-d8e3-41dd-9a56-b9c5e41385aa tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] [instance: b041e0af-4635-495c-b72d-fbbbd8d43a9b] Deletion of /opt/stack/data/nova/instances/b041e0af-4635-495c-b72d-fbbbd8d43a9b_del complete
Oct 26 00:16:49 user nova-compute[75165]: INFO nova.scheduler.client.report [None req-a39b4cf1-d8e3-41dd-9a56-b9c5e41385aa tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Deleted allocations for instance b041e0af-4635-495c-b72d-fbbbd8d43a9b
Oct 26 00:16:49 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-a39b4cf1-d8e3-41dd-9a56-b9c5e41385aa tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:16:49 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-a39b4cf1-d8e3-41dd-9a56-b9c5e41385aa tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:16:49 user nova-compute[75165]: DEBUG nova.objects.instance [None req-a39b4cf1-d8e3-41dd-9a56-b9c5e41385aa tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Lazy-loading 'numa_topology' on Instance uuid b041e0af-4635-495c-b72d-fbbbd8d43a9b {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:16:49 user nova-compute[75165]: DEBUG nova.objects.base [None req-a39b4cf1-d8e3-41dd-9a56-b9c5e41385aa tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Object Instance<b041e0af-4635-495c-b72d-fbbbd8d43a9b> lazy-loaded attributes: resources,numa_topology {{(pid=75165) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 00:16:50 user nova-compute[75165]: DEBUG nova.network.neutron [req-cb316c19-4902-4a37-9caa-1f80127b2f23 req-d52e2594-a41d-4917-a0de-8eff2379e7bd service nova] [instance: b041e0af-4635-495c-b72d-fbbbd8d43a9b] Updated VIF entry in instance network info cache for port 1964255b-cf1e-4e17-a1f7-ae5d6ea25aef. {{(pid=75165) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 00:16:50 user nova-compute[75165]: DEBUG nova.network.neutron [req-cb316c19-4902-4a37-9caa-1f80127b2f23 req-d52e2594-a41d-4917-a0de-8eff2379e7bd service nova] [instance: b041e0af-4635-495c-b72d-fbbbd8d43a9b] Updating instance_info_cache with network_info: [{"id": "1964255b-cf1e-4e17-a1f7-ae5d6ea25aef", "address": "fa:16:3e:76:6f:05", "network": {"id": "f54e2e9f-5c1e-44ca-bd4b-9cf0747b0f72", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-806146051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "920152101768459baa71010b380ea8f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap1964255b-cf", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:16:50 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-cb316c19-4902-4a37-9caa-1f80127b2f23 req-d52e2594-a41d-4917-a0de-8eff2379e7bd service nova] Releasing lock "refresh_cache-b041e0af-4635-495c-b72d-fbbbd8d43a9b" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:16:50 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-a39b4cf1-d8e3-41dd-9a56-b9c5e41385aa tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:16:50 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-a39b4cf1-d8e3-41dd-9a56-b9c5e41385aa tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:16:50 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-a39b4cf1-d8e3-41dd-9a56-b9c5e41385aa tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.403s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:16:50 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-a39b4cf1-d8e3-41dd-9a56-b9c5e41385aa tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Lock "b041e0af-4635-495c-b72d-fbbbd8d43a9b" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 7.525s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:16:51 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:16:54 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:16:57 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-7f0a7b07-7e55-4725-b34d-32324861198f tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Acquiring lock "22b9689c-5e83-4807-971f-5b244914b7e5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:16:57 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-7f0a7b07-7e55-4725-b34d-32324861198f tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Lock "22b9689c-5e83-4807-971f-5b244914b7e5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:16:57 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-7f0a7b07-7e55-4725-b34d-32324861198f tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Acquiring lock "22b9689c-5e83-4807-971f-5b244914b7e5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:16:57 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-7f0a7b07-7e55-4725-b34d-32324861198f tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Lock "22b9689c-5e83-4807-971f-5b244914b7e5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:16:57 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-7f0a7b07-7e55-4725-b34d-32324861198f tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Lock "22b9689c-5e83-4807-971f-5b244914b7e5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:16:57 user nova-compute[75165]: INFO nova.compute.manager [None req-7f0a7b07-7e55-4725-b34d-32324861198f tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: 22b9689c-5e83-4807-971f-5b244914b7e5] Terminating instance
Oct 26 00:16:57 user nova-compute[75165]: DEBUG nova.compute.manager [None req-7f0a7b07-7e55-4725-b34d-32324861198f tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: 22b9689c-5e83-4807-971f-5b244914b7e5] Start destroying the instance on the hypervisor. {{(pid=75165) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 00:16:57 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:16:57 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:16:58 user nova-compute[75165]: DEBUG nova.compute.manager [req-c6c1350b-dad7-4c81-b476-c2b51a21623b req-2391305c-d40f-4d7b-b55e-c3aa9eacb5b7 service nova] [instance: 22b9689c-5e83-4807-971f-5b244914b7e5] Received event network-vif-unplugged-15022d7e-be4a-480d-a612-31e1e689f43b {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:16:58 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-c6c1350b-dad7-4c81-b476-c2b51a21623b req-2391305c-d40f-4d7b-b55e-c3aa9eacb5b7 service nova] Acquiring lock "22b9689c-5e83-4807-971f-5b244914b7e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:16:58 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-c6c1350b-dad7-4c81-b476-c2b51a21623b req-2391305c-d40f-4d7b-b55e-c3aa9eacb5b7 service nova] Lock "22b9689c-5e83-4807-971f-5b244914b7e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:16:58 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-c6c1350b-dad7-4c81-b476-c2b51a21623b req-2391305c-d40f-4d7b-b55e-c3aa9eacb5b7 service nova] Lock "22b9689c-5e83-4807-971f-5b244914b7e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:16:58 user nova-compute[75165]: DEBUG nova.compute.manager [req-c6c1350b-dad7-4c81-b476-c2b51a21623b req-2391305c-d40f-4d7b-b55e-c3aa9eacb5b7 service nova] [instance: 22b9689c-5e83-4807-971f-5b244914b7e5] No waiting events found dispatching network-vif-unplugged-15022d7e-be4a-480d-a612-31e1e689f43b {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:16:58 user nova-compute[75165]: DEBUG nova.compute.manager [req-c6c1350b-dad7-4c81-b476-c2b51a21623b req-2391305c-d40f-4d7b-b55e-c3aa9eacb5b7 service nova] [instance: 22b9689c-5e83-4807-971f-5b244914b7e5] Received event network-vif-unplugged-15022d7e-be4a-480d-a612-31e1e689f43b for instance with task_state deleting. {{(pid=75165) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 00:16:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:16:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:16:58 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: 22b9689c-5e83-4807-971f-5b244914b7e5] Instance destroyed successfully.
Oct 26 00:16:58 user nova-compute[75165]: DEBUG nova.objects.instance [None req-7f0a7b07-7e55-4725-b34d-32324861198f tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Lazy-loading 'resources' on Instance uuid 22b9689c-5e83-4807-971f-5b244914b7e5 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:16:58 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-7f0a7b07-7e55-4725-b34d-32324861198f tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-26T00:10:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1910763507',display_name='tempest-ServerActionsTestOtherA-server-1799034720',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1910763507',id=15,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCbhvVGCZXABV5ClHwat9SYVr8+lkr4CuPT9Dr+1j4V+RKNDUlpTwy+TnUJZqw7wFY9APF0iWveIh7WwEW0pFasiIl6gv4XcNnJZaIxKvWAEAIXLwvXZamBlkbyJ/XzEvA==',key_name='tempest-keypair-730793300',keypairs=<?>,launch_index=0,launched_at=2023-10-26T00:13:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2911497df44047d9a9ee36a5652298bc',ramdisk_id='',reservation_id='r-h69c2nn0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1690932306',owner_user_name='tempest-ServerActionsTestOtherA-1690932306-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T00:13:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b3ce94f4c01446ebf79a1eba3833e01',uuid=22b9689c-5e83-4807-971f-5b244914b7e5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "15022d7e-be4a-480d-a612-31e1e689f43b", "address": "fa:16:3e:23:d1:cb", "network": {"id": "bd1c84f9-bba9-4a23-8bf2-17e65022136a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1557945804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2911497df44047d9a9ee36a5652298bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15022d7e-be", "ovs_interfaceid": "15022d7e-be4a-480d-a612-31e1e689f43b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 00:16:58 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-7f0a7b07-7e55-4725-b34d-32324861198f tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Converting VIF {"id": "15022d7e-be4a-480d-a612-31e1e689f43b", "address": "fa:16:3e:23:d1:cb", "network": {"id": "bd1c84f9-bba9-4a23-8bf2-17e65022136a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1557945804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2911497df44047d9a9ee36a5652298bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15022d7e-be", "ovs_interfaceid": "15022d7e-be4a-480d-a612-31e1e689f43b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:16:58 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-7f0a7b07-7e55-4725-b34d-32324861198f tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:23:d1:cb,bridge_name='br-int',has_traffic_filtering=True,id=15022d7e-be4a-480d-a612-31e1e689f43b,network=Network(bd1c84f9-bba9-4a23-8bf2-17e65022136a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15022d7e-be') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:16:58 user nova-compute[75165]: DEBUG os_vif [None req-7f0a7b07-7e55-4725-b34d-32324861198f tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:d1:cb,bridge_name='br-int',has_traffic_filtering=True,id=15022d7e-be4a-480d-a612-31e1e689f43b,network=Network(bd1c84f9-bba9-4a23-8bf2-17e65022136a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15022d7e-be') {{(pid=75165) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 00:16:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:16:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap15022d7e-be, bridge=br-int, if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:16:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:16:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:16:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:16:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:16:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e9e85ce6-cc4b-456a-81e0-83aad400018b) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:16:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:16:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:16:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:16:58 user nova-compute[75165]: INFO os_vif [None req-7f0a7b07-7e55-4725-b34d-32324861198f tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:d1:cb,bridge_name='br-int',has_traffic_filtering=True,id=15022d7e-be4a-480d-a612-31e1e689f43b,network=Network(bd1c84f9-bba9-4a23-8bf2-17e65022136a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15022d7e-be')
Oct 26 00:16:58 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-7f0a7b07-7e55-4725-b34d-32324861198f tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: 22b9689c-5e83-4807-971f-5b244914b7e5] Deleting instance files /opt/stack/data/nova/instances/22b9689c-5e83-4807-971f-5b244914b7e5_del
Oct 26 00:16:58 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-7f0a7b07-7e55-4725-b34d-32324861198f tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: 22b9689c-5e83-4807-971f-5b244914b7e5] Deletion of /opt/stack/data/nova/instances/22b9689c-5e83-4807-971f-5b244914b7e5_del complete
Oct 26 00:16:58 user nova-compute[75165]: INFO nova.compute.manager [None req-7f0a7b07-7e55-4725-b34d-32324861198f tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: 22b9689c-5e83-4807-971f-5b244914b7e5] Took 0.88 seconds to destroy the instance on the hypervisor.
Oct 26 00:16:58 user nova-compute[75165]: DEBUG oslo.service.loopingcall [None req-7f0a7b07-7e55-4725-b34d-32324861198f tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75165) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 00:16:58 user nova-compute[75165]: DEBUG nova.compute.manager [-] [instance: 22b9689c-5e83-4807-971f-5b244914b7e5] Deallocating network for instance {{(pid=75165) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 00:16:58 user nova-compute[75165]: DEBUG nova.network.neutron [-] [instance: 22b9689c-5e83-4807-971f-5b244914b7e5] deallocate_for_instance() {{(pid=75165) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 00:16:59 user nova-compute[75165]: DEBUG nova.network.neutron [-] [instance: 22b9689c-5e83-4807-971f-5b244914b7e5] Updating instance_info_cache with network_info: [] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:16:59 user nova-compute[75165]: INFO nova.compute.manager [-] [instance: 22b9689c-5e83-4807-971f-5b244914b7e5] Took 0.75 seconds to deallocate network for instance.
Oct 26 00:16:59 user nova-compute[75165]: DEBUG nova.compute.manager [req-7c743a11-fb24-441c-bd12-4c653b2723ad req-e214072c-152d-4305-915f-d966fd75c12e service nova] [instance: 22b9689c-5e83-4807-971f-5b244914b7e5] Received event network-vif-deleted-15022d7e-be4a-480d-a612-31e1e689f43b {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:16:59 user nova-compute[75165]: INFO nova.compute.manager [req-7c743a11-fb24-441c-bd12-4c653b2723ad req-e214072c-152d-4305-915f-d966fd75c12e service nova] [instance: 22b9689c-5e83-4807-971f-5b244914b7e5] Neutron deleted interface 15022d7e-be4a-480d-a612-31e1e689f43b; detaching it from the instance and deleting it from the info cache
Oct 26 00:16:59 user nova-compute[75165]: DEBUG nova.network.neutron [req-7c743a11-fb24-441c-bd12-4c653b2723ad req-e214072c-152d-4305-915f-d966fd75c12e service nova] [instance: 22b9689c-5e83-4807-971f-5b244914b7e5] Updating instance_info_cache with network_info: [] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:16:59 user nova-compute[75165]: DEBUG nova.compute.manager [req-7c743a11-fb24-441c-bd12-4c653b2723ad req-e214072c-152d-4305-915f-d966fd75c12e service nova] [instance: 22b9689c-5e83-4807-971f-5b244914b7e5] Detach interface failed, port_id=15022d7e-be4a-480d-a612-31e1e689f43b, reason: Instance 22b9689c-5e83-4807-971f-5b244914b7e5 could not be found. {{(pid=75165) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 26 00:16:59 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-7f0a7b07-7e55-4725-b34d-32324861198f tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:16:59 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-7f0a7b07-7e55-4725-b34d-32324861198f tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:16:59 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-7f0a7b07-7e55-4725-b34d-32324861198f tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:16:59 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-7f0a7b07-7e55-4725-b34d-32324861198f tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:16:59 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-7f0a7b07-7e55-4725-b34d-32324861198f tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.290s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:16:59 user nova-compute[75165]: INFO nova.scheduler.client.report [None req-7f0a7b07-7e55-4725-b34d-32324861198f tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Deleted allocations for instance 22b9689c-5e83-4807-971f-5b244914b7e5
Oct 26 00:16:59 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-7f0a7b07-7e55-4725-b34d-32324861198f tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Lock "22b9689c-5e83-4807-971f-5b244914b7e5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.115s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:17:00 user nova-compute[75165]: DEBUG nova.compute.manager [req-fbc2bbbc-189a-448c-8828-adf27aded0e1 req-7e8c4c6e-9ada-4b4d-a805-2497d7e0d8cf service nova] [instance: 22b9689c-5e83-4807-971f-5b244914b7e5] Received event network-vif-plugged-15022d7e-be4a-480d-a612-31e1e689f43b {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:17:00 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-fbc2bbbc-189a-448c-8828-adf27aded0e1 req-7e8c4c6e-9ada-4b4d-a805-2497d7e0d8cf service nova] Acquiring lock "22b9689c-5e83-4807-971f-5b244914b7e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:17:00 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-fbc2bbbc-189a-448c-8828-adf27aded0e1 req-7e8c4c6e-9ada-4b4d-a805-2497d7e0d8cf service nova] Lock "22b9689c-5e83-4807-971f-5b244914b7e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:17:00 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-fbc2bbbc-189a-448c-8828-adf27aded0e1 req-7e8c4c6e-9ada-4b4d-a805-2497d7e0d8cf service nova] Lock "22b9689c-5e83-4807-971f-5b244914b7e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:17:00 user nova-compute[75165]: DEBUG nova.compute.manager [req-fbc2bbbc-189a-448c-8828-adf27aded0e1 req-7e8c4c6e-9ada-4b4d-a805-2497d7e0d8cf service nova] [instance: 22b9689c-5e83-4807-971f-5b244914b7e5] No waiting events found dispatching network-vif-plugged-15022d7e-be4a-480d-a612-31e1e689f43b {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:17:00 user nova-compute[75165]: WARNING nova.compute.manager [req-fbc2bbbc-189a-448c-8828-adf27aded0e1 req-7e8c4c6e-9ada-4b4d-a805-2497d7e0d8cf service nova] [instance: 22b9689c-5e83-4807-971f-5b244914b7e5] Received unexpected event network-vif-plugged-15022d7e-be4a-480d-a612-31e1e689f43b for instance with vm_state deleted and task_state None.
Oct 26 00:17:03 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:17:05 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:17:08 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:17:10 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:17:10 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:17:10 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:17:10 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Starting heal instance info cache {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 00:17:10 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "refresh_cache-c4e44bfc-6a68-46ce-8335-aaaba5160d3e" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:17:10 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquired lock "refresh_cache-c4e44bfc-6a68-46ce-8335-aaaba5160d3e" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:17:10 user nova-compute[75165]: DEBUG nova.network.neutron [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: c4e44bfc-6a68-46ce-8335-aaaba5160d3e] Forcefully refreshing network info cache for instance {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 00:17:10 user nova-compute[75165]: DEBUG nova.network.neutron [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: c4e44bfc-6a68-46ce-8335-aaaba5160d3e] Updating instance_info_cache with network_info: [{"id": "842f3b7a-8da7-48d2-90f7-7241fbaab648", "address": "fa:16:3e:1f:64:04", "network": {"id": "b31bac4b-1951-4ca3-8682-f1f24de0a5c3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1323234642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71aa69c0ea2d49e184e1e055ff3efa1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap842f3b7a-8d", "ovs_interfaceid": "842f3b7a-8da7-48d2-90f7-7241fbaab648", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:17:10 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Releasing lock "refresh_cache-c4e44bfc-6a68-46ce-8335-aaaba5160d3e" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:17:10 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: c4e44bfc-6a68-46ce-8335-aaaba5160d3e] Updated the network info_cache for instance {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 00:17:10 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:17:10 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:17:10 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:17:10 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:17:10 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:17:10 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:17:10 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75165) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 00:17:10 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:17:10 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:17:10 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:17:10 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:17:10 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75165) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 00:17:11 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:17:11 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84c6b624-648b-40e2-a37e-ff08609bad84/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:17:11 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84c6b624-648b-40e2-a37e-ff08609bad84/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:17:11 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84c6b624-648b-40e2-a37e-ff08609bad84/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:17:11 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84c6b624-648b-40e2-a37e-ff08609bad84/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:17:11 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7eeb145-1565-4812-818b-fefda5f2436d/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:17:11 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7eeb145-1565-4812-818b-fefda5f2436d/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:17:11 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7eeb145-1565-4812-818b-fefda5f2436d/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:17:11 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7eeb145-1565-4812-818b-fefda5f2436d/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:17:11 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6558510-6f87-4ef3-b707-f1fa78bf61e8/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:17:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6558510-6f87-4ef3-b707-f1fa78bf61e8/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:17:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6558510-6f87-4ef3-b707-f1fa78bf61e8/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:17:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6558510-6f87-4ef3-b707-f1fa78bf61e8/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:17:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3150d249-37a2-49c6-837a-3828480fa2b4/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:17:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3150d249-37a2-49c6-837a-3828480fa2b4/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:17:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3150d249-37a2-49c6-837a-3828480fa2b4/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:17:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3150d249-37a2-49c6-837a-3828480fa2b4/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:17:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c7002e2-b98f-48e4-b099-9c8b756fd0ae/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:17:13 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c7002e2-b98f-48e4-b099-9c8b756fd0ae/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:17:13 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c7002e2-b98f-48e4-b099-9c8b756fd0ae/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:17:13 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c7002e2-b98f-48e4-b099-9c8b756fd0ae/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:17:13 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e44bfc-6a68-46ce-8335-aaaba5160d3e/disk.rescue --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:17:13 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e44bfc-6a68-46ce-8335-aaaba5160d3e/disk.rescue --force-share --output=json" returned: 0 in 0.267s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:17:13 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e44bfc-6a68-46ce-8335-aaaba5160d3e/disk.rescue --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:17:13 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:17:13 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e44bfc-6a68-46ce-8335-aaaba5160d3e/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:17:13 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e44bfc-6a68-46ce-8335-aaaba5160d3e/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:17:13 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e44bfc-6a68-46ce-8335-aaaba5160d3e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:17:13 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e44bfc-6a68-46ce-8335-aaaba5160d3e/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:17:14 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e44bfc-6a68-46ce-8335-aaaba5160d3e/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:17:14 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27fa1771-fb69-49da-81b3-7f112e623170/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:17:14 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27fa1771-fb69-49da-81b3-7f112e623170/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:17:14 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27fa1771-fb69-49da-81b3-7f112e623170/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:17:14 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27fa1771-fb69-49da-81b3-7f112e623170/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:17:14 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75165) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 00:17:14 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91fe894a-90a8-4545-9b27-91771554c4cb/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:17:14 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91fe894a-90a8-4545-9b27-91771554c4cb/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:17:14 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91fe894a-90a8-4545-9b27-91771554c4cb/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:17:14 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91fe894a-90a8-4545-9b27-91771554c4cb/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:17:15 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:17:15 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:17:15 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Hypervisor/Node resource view: name=user free_ram=7919MB free_disk=25.04355239868164GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75165) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 00:17:15 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:17:15 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:17:15 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 84c6b624-648b-40e2-a37e-ff08609bad84 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:17:15 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance c4e44bfc-6a68-46ce-8335-aaaba5160d3e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:17:15 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance a7eeb145-1565-4812-818b-fefda5f2436d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:17:15 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 3150d249-37a2-49c6-837a-3828480fa2b4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:17:15 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 27fa1771-fb69-49da-81b3-7f112e623170 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:17:15 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 3c7002e2-b98f-48e4-b099-9c8b756fd0ae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:17:15 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 91fe894a-90a8-4545-9b27-91771554c4cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:17:15 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance b6558510-6f87-4ef3-b707-f1fa78bf61e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:17:15 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75165) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 00:17:15 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75165) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 00:17:15 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:17:15 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:17:15 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Compute_service record updated for user:user {{(pid=75165) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 00:17:15 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.434s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:17:18 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:17:22 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:17:23 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:17:28 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:17:30 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-54e86ac3-a661-42a5-aa93-cfde5e43947f tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Acquiring lock "3c7002e2-b98f-48e4-b099-9c8b756fd0ae" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:17:30 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-54e86ac3-a661-42a5-aa93-cfde5e43947f tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Lock "3c7002e2-b98f-48e4-b099-9c8b756fd0ae" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:17:30 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-54e86ac3-a661-42a5-aa93-cfde5e43947f tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Acquiring lock "3c7002e2-b98f-48e4-b099-9c8b756fd0ae-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:17:30 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-54e86ac3-a661-42a5-aa93-cfde5e43947f tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Lock "3c7002e2-b98f-48e4-b099-9c8b756fd0ae-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:17:30 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-54e86ac3-a661-42a5-aa93-cfde5e43947f tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Lock "3c7002e2-b98f-48e4-b099-9c8b756fd0ae-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:17:30 user nova-compute[75165]: INFO nova.compute.manager [None req-54e86ac3-a661-42a5-aa93-cfde5e43947f tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] [instance: 3c7002e2-b98f-48e4-b099-9c8b756fd0ae] Terminating instance
Oct 26 00:17:30 user nova-compute[75165]: DEBUG nova.compute.manager [None req-54e86ac3-a661-42a5-aa93-cfde5e43947f tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] [instance: 3c7002e2-b98f-48e4-b099-9c8b756fd0ae] Start destroying the instance on the hypervisor. {{(pid=75165) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 00:17:30 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:17:30 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:17:30 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:17:30 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:17:30 user nova-compute[75165]: DEBUG nova.compute.manager [req-8dd00aba-eb29-4ef9-a9e7-183ebb2f482c req-cea7007c-8fb0-498e-bbf6-6a2a4f15b434 service nova] [instance: 3c7002e2-b98f-48e4-b099-9c8b756fd0ae] Received event network-vif-unplugged-17a39e49-7cac-4454-9957-6d0d0568fd5d {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:17:30 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-8dd00aba-eb29-4ef9-a9e7-183ebb2f482c req-cea7007c-8fb0-498e-bbf6-6a2a4f15b434 service nova] Acquiring lock "3c7002e2-b98f-48e4-b099-9c8b756fd0ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:17:30 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-8dd00aba-eb29-4ef9-a9e7-183ebb2f482c req-cea7007c-8fb0-498e-bbf6-6a2a4f15b434 service nova] Lock "3c7002e2-b98f-48e4-b099-9c8b756fd0ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:17:30 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-8dd00aba-eb29-4ef9-a9e7-183ebb2f482c req-cea7007c-8fb0-498e-bbf6-6a2a4f15b434 service nova] Lock "3c7002e2-b98f-48e4-b099-9c8b756fd0ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:17:30 user nova-compute[75165]: DEBUG nova.compute.manager [req-8dd00aba-eb29-4ef9-a9e7-183ebb2f482c req-cea7007c-8fb0-498e-bbf6-6a2a4f15b434 service nova] [instance: 3c7002e2-b98f-48e4-b099-9c8b756fd0ae] No waiting events found dispatching network-vif-unplugged-17a39e49-7cac-4454-9957-6d0d0568fd5d {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:17:30 user nova-compute[75165]: DEBUG nova.compute.manager [req-8dd00aba-eb29-4ef9-a9e7-183ebb2f482c req-cea7007c-8fb0-498e-bbf6-6a2a4f15b434 service nova] [instance: 3c7002e2-b98f-48e4-b099-9c8b756fd0ae] Received event network-vif-unplugged-17a39e49-7cac-4454-9957-6d0d0568fd5d for instance with task_state deleting. {{(pid=75165) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 00:17:31 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: 3c7002e2-b98f-48e4-b099-9c8b756fd0ae] Instance destroyed successfully.
Oct 26 00:17:31 user nova-compute[75165]: DEBUG nova.objects.instance [None req-54e86ac3-a661-42a5-aa93-cfde5e43947f tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Lazy-loading 'resources' on Instance uuid 3c7002e2-b98f-48e4-b099-9c8b756fd0ae {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:17:31 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-54e86ac3-a661-42a5-aa93-cfde5e43947f tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:15:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1009945819',display_name='tempest-VolumesAdminNegativeTest-server-1009945819',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1009945819',id=22,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-26T00:15:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7043dc6e5575484b8747c13d3928f717',ramdisk_id='',reservation_id='r-uub6gen7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1115603178',owner_user_name='tempest-VolumesAdminNegativeTest-1115603178-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T00:15:34Z,user_data=None,user_id='2c153a25012b42d1869aacee733c754b',uuid=3c7002e2-b98f-48e4-b099-9c8b756fd0ae,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "17a39e49-7cac-4454-9957-6d0d0568fd5d", "address": "fa:16:3e:d6:78:e1", "network": {"id": "158a2f37-110c-4873-af74-f8c483280159", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1353815059-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7043dc6e5575484b8747c13d3928f717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17a39e49-7c", "ovs_interfaceid": "17a39e49-7cac-4454-9957-6d0d0568fd5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 00:17:31 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-54e86ac3-a661-42a5-aa93-cfde5e43947f tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Converting VIF {"id": "17a39e49-7cac-4454-9957-6d0d0568fd5d", "address": "fa:16:3e:d6:78:e1", "network": {"id": "158a2f37-110c-4873-af74-f8c483280159", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1353815059-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7043dc6e5575484b8747c13d3928f717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17a39e49-7c", "ovs_interfaceid": "17a39e49-7cac-4454-9957-6d0d0568fd5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:17:31 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-54e86ac3-a661-42a5-aa93-cfde5e43947f tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:78:e1,bridge_name='br-int',has_traffic_filtering=True,id=17a39e49-7cac-4454-9957-6d0d0568fd5d,network=Network(158a2f37-110c-4873-af74-f8c483280159),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17a39e49-7c') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:17:31 user nova-compute[75165]: DEBUG os_vif [None req-54e86ac3-a661-42a5-aa93-cfde5e43947f tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:78:e1,bridge_name='br-int',has_traffic_filtering=True,id=17a39e49-7cac-4454-9957-6d0d0568fd5d,network=Network(158a2f37-110c-4873-af74-f8c483280159),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17a39e49-7c') {{(pid=75165) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 00:17:31 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:17:31 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap17a39e49-7c, bridge=br-int, if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:17:31 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:17:31 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:17:31 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:17:31 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=75ebeaa7-2020-4d2c-9485-49d37a33c74a) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:17:31 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:17:31 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:17:31 user nova-compute[75165]: INFO os_vif [None req-54e86ac3-a661-42a5-aa93-cfde5e43947f tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:78:e1,bridge_name='br-int',has_traffic_filtering=True,id=17a39e49-7cac-4454-9957-6d0d0568fd5d,network=Network(158a2f37-110c-4873-af74-f8c483280159),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17a39e49-7c')
Oct 26 00:17:31 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-54e86ac3-a661-42a5-aa93-cfde5e43947f tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] [instance: 3c7002e2-b98f-48e4-b099-9c8b756fd0ae] Deleting instance files /opt/stack/data/nova/instances/3c7002e2-b98f-48e4-b099-9c8b756fd0ae_del
Oct 26 00:17:31 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-54e86ac3-a661-42a5-aa93-cfde5e43947f tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] [instance: 3c7002e2-b98f-48e4-b099-9c8b756fd0ae] Deletion of /opt/stack/data/nova/instances/3c7002e2-b98f-48e4-b099-9c8b756fd0ae_del complete
Oct 26 00:17:31 user nova-compute[75165]: INFO nova.compute.manager [None req-54e86ac3-a661-42a5-aa93-cfde5e43947f tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] [instance: 3c7002e2-b98f-48e4-b099-9c8b756fd0ae] Took 0.99 seconds to destroy the instance on the hypervisor.
Oct 26 00:17:31 user nova-compute[75165]: DEBUG oslo.service.loopingcall [None req-54e86ac3-a661-42a5-aa93-cfde5e43947f tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75165) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 00:17:31 user nova-compute[75165]: DEBUG nova.compute.manager [-] [instance: 3c7002e2-b98f-48e4-b099-9c8b756fd0ae] Deallocating network for instance {{(pid=75165) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 00:17:31 user nova-compute[75165]: DEBUG nova.network.neutron [-] [instance: 3c7002e2-b98f-48e4-b099-9c8b756fd0ae] deallocate_for_instance() {{(pid=75165) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 00:17:32 user nova-compute[75165]: DEBUG nova.network.neutron [-] [instance: 3c7002e2-b98f-48e4-b099-9c8b756fd0ae] Updating instance_info_cache with network_info: [] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:17:32 user nova-compute[75165]: INFO nova.compute.manager [-] [instance: 3c7002e2-b98f-48e4-b099-9c8b756fd0ae] Took 1.00 seconds to deallocate network for instance.
Oct 26 00:17:32 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-54e86ac3-a661-42a5-aa93-cfde5e43947f tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:17:32 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-54e86ac3-a661-42a5-aa93-cfde5e43947f tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:17:32 user nova-compute[75165]: DEBUG nova.compute.manager [req-3373413d-990f-41cf-9259-3bb58b7d1ff1 req-25bdaa76-a699-489e-ad6e-8b87eed16524 service nova] [instance: 3c7002e2-b98f-48e4-b099-9c8b756fd0ae] Received event network-vif-deleted-17a39e49-7cac-4454-9957-6d0d0568fd5d {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:17:32 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-54e86ac3-a661-42a5-aa93-cfde5e43947f tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:17:32 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-54e86ac3-a661-42a5-aa93-cfde5e43947f tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:17:32 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-54e86ac3-a661-42a5-aa93-cfde5e43947f tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.317s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:17:32 user nova-compute[75165]: INFO nova.scheduler.client.report [None req-54e86ac3-a661-42a5-aa93-cfde5e43947f tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Deleted allocations for instance 3c7002e2-b98f-48e4-b099-9c8b756fd0ae
Oct 26 00:17:32 user nova-compute[75165]: DEBUG nova.compute.manager [req-9146a127-5728-419c-83c3-f4d1d3eb6221 req-5788e3cc-f610-4313-91f7-7e536bf0e317 service nova] [instance: 3c7002e2-b98f-48e4-b099-9c8b756fd0ae] Received event network-vif-plugged-17a39e49-7cac-4454-9957-6d0d0568fd5d {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:17:32 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-9146a127-5728-419c-83c3-f4d1d3eb6221 req-5788e3cc-f610-4313-91f7-7e536bf0e317 service nova] Acquiring lock "3c7002e2-b98f-48e4-b099-9c8b756fd0ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:17:32 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-9146a127-5728-419c-83c3-f4d1d3eb6221 req-5788e3cc-f610-4313-91f7-7e536bf0e317 service nova] Lock "3c7002e2-b98f-48e4-b099-9c8b756fd0ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:17:32 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-9146a127-5728-419c-83c3-f4d1d3eb6221 req-5788e3cc-f610-4313-91f7-7e536bf0e317 service nova] Lock "3c7002e2-b98f-48e4-b099-9c8b756fd0ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:17:32 user nova-compute[75165]: DEBUG nova.compute.manager [req-9146a127-5728-419c-83c3-f4d1d3eb6221 req-5788e3cc-f610-4313-91f7-7e536bf0e317 service nova] [instance: 3c7002e2-b98f-48e4-b099-9c8b756fd0ae] No waiting events found dispatching network-vif-plugged-17a39e49-7cac-4454-9957-6d0d0568fd5d {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:17:32 user nova-compute[75165]: WARNING nova.compute.manager [req-9146a127-5728-419c-83c3-f4d1d3eb6221 req-5788e3cc-f610-4313-91f7-7e536bf0e317 service nova] [instance: 3c7002e2-b98f-48e4-b099-9c8b756fd0ae] Received unexpected event network-vif-plugged-17a39e49-7cac-4454-9957-6d0d0568fd5d for instance with vm_state deleted and task_state None.
Oct 26 00:17:32 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-54e86ac3-a661-42a5-aa93-cfde5e43947f tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Lock "3c7002e2-b98f-48e4-b099-9c8b756fd0ae" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.613s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:17:36 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:17:38 user nova-compute[75165]: DEBUG nova.compute.manager [req-48c91f7e-0c24-4ba3-a9b0-d99e50941b80 req-a1048d8d-8e26-4239-8b55-598043da775a service nova] [instance: 91fe894a-90a8-4545-9b27-91771554c4cb] Received event network-changed-67590aab-15ed-4684-abd7-64a5c0a9b3f5 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:17:38 user nova-compute[75165]: DEBUG nova.compute.manager [req-48c91f7e-0c24-4ba3-a9b0-d99e50941b80 req-a1048d8d-8e26-4239-8b55-598043da775a service nova] [instance: 91fe894a-90a8-4545-9b27-91771554c4cb] Refreshing instance network info cache due to event network-changed-67590aab-15ed-4684-abd7-64a5c0a9b3f5. {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 00:17:38 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-48c91f7e-0c24-4ba3-a9b0-d99e50941b80 req-a1048d8d-8e26-4239-8b55-598043da775a service nova] Acquiring lock "refresh_cache-91fe894a-90a8-4545-9b27-91771554c4cb" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:17:38 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-48c91f7e-0c24-4ba3-a9b0-d99e50941b80 req-a1048d8d-8e26-4239-8b55-598043da775a service nova] Acquired lock "refresh_cache-91fe894a-90a8-4545-9b27-91771554c4cb" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:17:38 user nova-compute[75165]: DEBUG nova.network.neutron [req-48c91f7e-0c24-4ba3-a9b0-d99e50941b80 req-a1048d8d-8e26-4239-8b55-598043da775a service nova] [instance: 91fe894a-90a8-4545-9b27-91771554c4cb] Refreshing network info cache for port 67590aab-15ed-4684-abd7-64a5c0a9b3f5 {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 00:17:38 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-5b0da81f-609d-4e72-b3c3-a51f2e175ab0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Acquiring lock "91fe894a-90a8-4545-9b27-91771554c4cb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:17:38 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-5b0da81f-609d-4e72-b3c3-a51f2e175ab0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Lock "91fe894a-90a8-4545-9b27-91771554c4cb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:17:38 user nova-compute[75165]: DEBUG nova.objects.instance [None req-5b0da81f-609d-4e72-b3c3-a51f2e175ab0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Lazy-loading 'flavor' on Instance uuid 91fe894a-90a8-4545-9b27-91771554c4cb {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:17:38 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-5b0da81f-609d-4e72-b3c3-a51f2e175ab0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Lock "91fe894a-90a8-4545-9b27-91771554c4cb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.082s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:17:38 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-5b0da81f-609d-4e72-b3c3-a51f2e175ab0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Acquiring lock "91fe894a-90a8-4545-9b27-91771554c4cb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:17:38 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-5b0da81f-609d-4e72-b3c3-a51f2e175ab0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Lock "91fe894a-90a8-4545-9b27-91771554c4cb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:17:38 user nova-compute[75165]: INFO nova.compute.manager [None req-5b0da81f-609d-4e72-b3c3-a51f2e175ab0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: 91fe894a-90a8-4545-9b27-91771554c4cb] Attaching volume f06e40e7-3ca1-4a25-bd11-ff01280c6df2 to /dev/vdb
Oct 26 00:17:38 user nova-compute[75165]: DEBUG os_brick.utils [None req-5b0da81f-609d-4e72-b3c3-a51f2e175ab0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:17:38 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:17:38 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:17:38 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[24d2f336-acb2-4ce9-afa2-34df2cf717e8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa94814ccb35\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:17:38 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:17:38 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:17:38 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[45354d90-7247-486b-b41b-43090400c79e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:17:38 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:17:38 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.086s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:17:38 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[2066e4b7-b3ca-45ea-a860-ab965754596d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:17:38 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[9307ded7-967e-4e40-b3c6-56e000862da6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:17:38 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-5b0da81f-609d-4e72-b3c3-a51f2e175ab0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Running cmd (subprocess): nvme version {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:17:38 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-5b0da81f-609d-4e72-b3c3-a51f2e175ab0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] 'nvme version' failed. Not Retrying. {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 00:17:38 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5b0da81f-609d-4e72-b3c3-a51f2e175ab0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] nvme not present on system {{(pid=75165) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 00:17:38 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:17:38 user nova-compute[75165]: DEBUG nova.network.neutron [req-48c91f7e-0c24-4ba3-a9b0-d99e50941b80 req-a1048d8d-8e26-4239-8b55-598043da775a service nova] [instance: 91fe894a-90a8-4545-9b27-91771554c4cb] Updated VIF entry in instance network info cache for port 67590aab-15ed-4684-abd7-64a5c0a9b3f5. {{(pid=75165) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 00:17:38 user nova-compute[75165]: DEBUG nova.network.neutron [req-48c91f7e-0c24-4ba3-a9b0-d99e50941b80 req-a1048d8d-8e26-4239-8b55-598043da775a service nova] [instance: 91fe894a-90a8-4545-9b27-91771554c4cb] Updating instance_info_cache with network_info: [{"id": "67590aab-15ed-4684-abd7-64a5c0a9b3f5", "address": "fa:16:3e:7a:ea:a8", "network": {"id": "b31bac4b-1951-4ca3-8682-f1f24de0a5c3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1323234642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71aa69c0ea2d49e184e1e055ff3efa1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67590aab-15", "ovs_interfaceid": "67590aab-15ed-4684-abd7-64a5c0a9b3f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:17:38 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 00:17:38 user nova-compute[75165]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 00:17:38 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[091b8695-33b5-4978-918c-da7c765e3212]: (4, '') {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:17:38 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-5b0da81f-609d-4e72-b3c3-a51f2e175ab0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75165) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 00:17:38 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-5b0da81f-609d-4e72-b3c3-a51f2e175ab0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75165) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 00:17:38 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-5b0da81f-609d-4e72-b3c3-a51f2e175ab0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] LIGHTOS: no hostnqn found. {{(pid=75165) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 00:17:38 user nova-compute[75165]: DEBUG os_brick.utils [None req-5b0da81f-609d-4e72-b3c3-a51f2e175ab0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] <== get_connector_properties: return (236ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa94814ccb35', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:17:38 user nova-compute[75165]: DEBUG nova.virt.block_device [None req-5b0da81f-609d-4e72-b3c3-a51f2e175ab0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: 91fe894a-90a8-4545-9b27-91771554c4cb] Updating existing volume attachment record: 605c78cb-4faa-49f2-920e-43b1cab32da5 {{(pid=75165) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 00:17:38 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-48c91f7e-0c24-4ba3-a9b0-d99e50941b80 req-a1048d8d-8e26-4239-8b55-598043da775a service nova] Releasing lock "refresh_cache-91fe894a-90a8-4545-9b27-91771554c4cb" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:17:41 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:17:41 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:17:45 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:17:46 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:17:46 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:17:46 user nova-compute[75165]: DEBUG nova.objects.instance [None req-e443eaee-f72a-478b-803b-871a8cc033c4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Lazy-loading 'flavor' on Instance uuid 27fa1771-fb69-49da-81b3-7f112e623170 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:17:47 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-e443eaee-f72a-478b-803b-871a8cc033c4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Acquiring lock "refresh_cache-27fa1771-fb69-49da-81b3-7f112e623170" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:17:47 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-e443eaee-f72a-478b-803b-871a8cc033c4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Acquired lock "refresh_cache-27fa1771-fb69-49da-81b3-7f112e623170" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:17:47 user nova-compute[75165]: DEBUG nova.network.neutron [None req-e443eaee-f72a-478b-803b-871a8cc033c4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] [instance: 27fa1771-fb69-49da-81b3-7f112e623170] Building network info cache for instance {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 00:17:47 user nova-compute[75165]: DEBUG nova.objects.instance [None req-e443eaee-f72a-478b-803b-871a8cc033c4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Lazy-loading 'info_cache' on Instance uuid 27fa1771-fb69-49da-81b3-7f112e623170 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:17:47 user nova-compute[75165]: DEBUG nova.objects.base [None req-e443eaee-f72a-478b-803b-871a8cc033c4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Object Instance<27fa1771-fb69-49da-81b3-7f112e623170> lazy-loaded attributes: flavor,info_cache {{(pid=75165) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 00:17:47 user nova-compute[75165]: DEBUG nova.network.neutron [None req-e443eaee-f72a-478b-803b-871a8cc033c4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] [instance: 27fa1771-fb69-49da-81b3-7f112e623170] Updating instance_info_cache with network_info: [{"id": "4d97651b-5d7c-4778-85a4-a11588892b31", "address": "fa:16:3e:c5:bb:76", "network": {"id": "7e330392-6256-405b-ab37-0b8af0c4fd48", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-430326049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ffbf5c944914cafac7aba65fb7ca402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d97651b-5d", "ovs_interfaceid": "4d97651b-5d7c-4778-85a4-a11588892b31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:17:47 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-e443eaee-f72a-478b-803b-871a8cc033c4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Releasing lock "refresh_cache-27fa1771-fb69-49da-81b3-7f112e623170" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:17:47 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: 27fa1771-fb69-49da-81b3-7f112e623170] Instance destroyed successfully.
Oct 26 00:17:47 user nova-compute[75165]: DEBUG nova.objects.instance [None req-e443eaee-f72a-478b-803b-871a8cc033c4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Lazy-loading 'resources' on Instance uuid 27fa1771-fb69-49da-81b3-7f112e623170 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:17:47 user nova-compute[75165]: DEBUG nova.objects.base [None req-e443eaee-f72a-478b-803b-871a8cc033c4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Object Instance<27fa1771-fb69-49da-81b3-7f112e623170> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75165) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 00:17:47 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-e443eaee-f72a-478b-803b-871a8cc033c4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:13:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1390737120',display_name='tempest-AttachVolumeTestJSON-server-1390737120',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1390737120',id=20,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEolsf1MVpCHotOftiJQ4Zgsnx29J3YYZZ32cA7FaSf4r6DElmgaLg7eBXc3I/pwZzl9KTJMnY6YgVOXkfwz2nESGnC4fUVVLf94BqH2qQSBNdKz1HLQzjXno+XfnON8kw==',key_name='tempest-keypair-763586997',keypairs=<?>,launch_index=0,launched_at=2023-10-26T00:13:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='3ffbf5c944914cafac7aba65fb7ca402',ramdisk_id='',reservation_id='r-ox40rq7n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2130746724',owner_user_name='tempest-AttachVolumeTestJSON-2130746724-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T00:15:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='841b5be7c0b348de979920fc9ae223ed',uuid=27fa1771-fb69-49da-81b3-7f112e623170,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "4d97651b-5d7c-4778-85a4-a11588892b31", "address": "fa:16:3e:c5:bb:76", "network": {"id": "7e330392-6256-405b-ab37-0b8af0c4fd48", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-430326049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ffbf5c944914cafac7aba65fb7ca402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d97651b-5d", "ovs_interfaceid": "4d97651b-5d7c-4778-85a4-a11588892b31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 00:17:47 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-e443eaee-f72a-478b-803b-871a8cc033c4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Converting VIF {"id": "4d97651b-5d7c-4778-85a4-a11588892b31", "address": "fa:16:3e:c5:bb:76", "network": {"id": "7e330392-6256-405b-ab37-0b8af0c4fd48", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-430326049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ffbf5c944914cafac7aba65fb7ca402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d97651b-5d", "ovs_interfaceid": "4d97651b-5d7c-4778-85a4-a11588892b31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:17:47 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-e443eaee-f72a-478b-803b-871a8cc033c4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:bb:76,bridge_name='br-int',has_traffic_filtering=True,id=4d97651b-5d7c-4778-85a4-a11588892b31,network=Network(7e330392-6256-405b-ab37-0b8af0c4fd48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d97651b-5d') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:17:47 user nova-compute[75165]: DEBUG os_vif [None req-e443eaee-f72a-478b-803b-871a8cc033c4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:bb:76,bridge_name='br-int',has_traffic_filtering=True,id=4d97651b-5d7c-4778-85a4-a11588892b31,network=Network(7e330392-6256-405b-ab37-0b8af0c4fd48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d97651b-5d') {{(pid=75165) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 00:17:47 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:17:47 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4d97651b-5d, bridge=br-int, if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:17:47 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:17:47 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:17:47 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:17:47 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=64be83e0-6b57-40db-8be7-854e4c783d79) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:17:47 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:17:47 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:17:47 user nova-compute[75165]: INFO os_vif [None req-e443eaee-f72a-478b-803b-871a8cc033c4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:bb:76,bridge_name='br-int',has_traffic_filtering=True,id=4d97651b-5d7c-4778-85a4-a11588892b31,network=Network(7e330392-6256-405b-ab37-0b8af0c4fd48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d97651b-5d')
Oct 26 00:17:47 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e443eaee-f72a-478b-803b-871a8cc033c4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] [instance: 27fa1771-fb69-49da-81b3-7f112e623170] calling os-brick to detach iSCSI Volume {{(pid=75165) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 00:17:47 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e443eaee-f72a-478b-803b-871a8cc033c4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8bf8160e50>, {'target_iqn': 'iqn.2010-10.org.openstack:f431d8b9-aa1e-46f5-b7da-39f4a550e050', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ijTvApyq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:17:47 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-e443eaee-f72a-478b-803b-871a8cc033c4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:17:47 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-e443eaee-f72a-478b-803b-871a8cc033c4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:17:47 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-e443eaee-f72a-478b-803b-871a8cc033c4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:17:47 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:17:47 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:17:47 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[2af086d6-e602-4af4-bde4-0f69962b56af]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f431d8b9-aa1e-46f5-b7da-39f4a550e050\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:17:47 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e443eaee-f72a-478b-803b-871a8cc033c4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 00:17:47 user nova-compute[75165]: No targets found.
Oct 26 00:17:47 user nova-compute[75165]: iSNS:
Oct 26 00:17:47 user nova-compute[75165]: No targets found.
Oct 26 00:17:47 user nova-compute[75165]: STATIC:
Oct 26 00:17:47 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:f431d8b9-aa1e-46f5-b7da-39f4a550e050
Oct 26 00:17:47 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:17:47 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:17:47 user nova-compute[75165]: FIRMWARE:
Oct 26 00:17:47 user nova-compute[75165]: No targets found.
Oct 26 00:17:47 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:17:47 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e443eaee-f72a-478b-803b-871a8cc033c4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 00:17:47 user nova-compute[75165]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 00:17:47 user nova-compute[75165]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75165) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 00:17:47 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e443eaee-f72a-478b-803b-871a8cc033c4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f431d8b9-aa1e-46f5-b7da-39f4a550e050', 0)] {{(pid=75165) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 00:17:47 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:17:47 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:17:47 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa54146e-e611-41eb-a5d5-0c4c7ee4c32e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f431d8b9-aa1e-46f5-b7da-39f4a550e050\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:17:47 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:17:47 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:17:47 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8de3b6c-a9dd-4237-9773-5808e5dff52f]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f431d8b9-aa1e-46f5-b7da-39f4a550e050 (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:17:47 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e443eaee-f72a-478b-803b-871a8cc033c4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f431d8b9-aa1e-46f5-b7da-39f4a550e050 (non-flash)
Oct 26 00:17:47 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:17:47 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e443eaee-f72a-478b-803b-871a8cc033c4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f431d8b9-aa1e-46f5-b7da-39f4a550e050 (non-flash)
Oct 26 00:17:47 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:17:47 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e443eaee-f72a-478b-803b-871a8cc033c4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8be03c4af0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f431d8b9-aa1e-46f5-b7da-39f4a550e050'): ({'sdb'}, set())}) {{(pid=75165) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 00:17:47 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-e443eaee-f72a-478b-803b-871a8cc033c4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Removing single pathed devices sdb {{(pid=75165) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 00:17:47 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:17:47 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:17:47 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fbf6b6a-ed41-4f8b-894b-68527b29f8d6]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:17:47 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:17:47 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.026s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:17:47 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[723349ad-f4a6-443a-adf9-e46afea9b7bc]: (4, ('ok\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:17:47 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-e443eaee-f72a-478b-803b-871a8cc033c4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Flushing IO for device /dev/sdb {{(pid=75165) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 00:17:47 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:17:47 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:17:47 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[60ca0019-9488-44df-82f5-2d0b9de15bc2]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:17:47 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-e443eaee-f72a-478b-803b-871a8cc033c4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75165) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 00:17:47 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:17:47 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:17:47 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d70c5f0-250a-4dc7-bb9f-cfad6dc1f5ad]: (4, ('1', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:17:47 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-e443eaee-f72a-478b-803b-871a8cc033c4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75165) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 00:17:47 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-e443eaee-f72a-478b-803b-871a8cc033c4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] SCSI volumes sdb have been removed. {{(pid=75165) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 00:17:47 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e443eaee-f72a-478b-803b-871a8cc033c4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f431d8b9-aa1e-46f5-b7da-39f4a550e050')] {{(pid=75165) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 00:17:47 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f431d8b9-aa1e-46f5-b7da-39f4a550e050 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:17:48 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f431d8b9-aa1e-46f5-b7da-39f4a550e050 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.031s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:17:48 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf4a8c82-87bc-44a5-9e2e-050260c2a7ed]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:17:48 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e443eaee-f72a-478b-803b-871a8cc033c4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:17:48 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f431d8b9-aa1e-46f5-b7da-39f4a550e050 -p 172.16.0.220:3260 --logout {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:17:48 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f431d8b9-aa1e-46f5-b7da-39f4a550e050 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:17:48 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5d10399-0aef-48b9-8ca0-45a0a921f698]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:f431d8b9-aa1e-46f5-b7da-39f4a550e050, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:f431d8b9-aa1e-46f5-b7da-39f4a550e050, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:17:48 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e443eaee-f72a-478b-803b-871a8cc033c4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:f431d8b9-aa1e-46f5-b7da-39f4a550e050, portal: 172.16.0.220,3260]
Oct 26 00:17:48 user nova-compute[75165]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:f431d8b9-aa1e-46f5-b7da-39f4a550e050, portal: 172.16.0.220,3260] successful.
Oct 26 00:17:48 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:17:48 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f431d8b9-aa1e-46f5-b7da-39f4a550e050 -p 172.16.0.220:3260 --op delete {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:17:48 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f431d8b9-aa1e-46f5-b7da-39f4a550e050 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:17:48 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd372eb1-e3be-469f-ba79-c2882791e70d]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:17:48 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e443eaee-f72a-478b-803b-871a8cc033c4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:17:48 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-e443eaee-f72a-478b-803b-871a8cc033c4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.369s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:17:48 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e443eaee-f72a-478b-803b-871a8cc033c4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] <== disconnect_volume: return (372ms) None {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:17:48 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e443eaee-f72a-478b-803b-871a8cc033c4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] [instance: 27fa1771-fb69-49da-81b3-7f112e623170] Disconnected iSCSI Volume {{(pid=75165) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 00:17:48 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-e443eaee-f72a-478b-803b-871a8cc033c4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] [instance: 27fa1771-fb69-49da-81b3-7f112e623170] Start _get_guest_xml network_info=[{"id": "4d97651b-5d7c-4778-85a4-a11588892b31", "address": "fa:16:3e:c5:bb:76", "network": {"id": "7e330392-6256-405b-ab37-0b8af0c4fd48", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-430326049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ffbf5c944914cafac7aba65fb7ca402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d97651b-5d", "ovs_interfaceid": "4d97651b-5d7c-4778-85a4-a11588892b31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=bff0d8a1-739e-4c4d-9efa-b73ba7b76d01,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'size': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': 'bff0d8a1-739e-4c4d-9efa-b73ba7b76d01'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f431d8b9-aa1e-46f5-b7da-39f4a550e050', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ijTvApyq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '27fa1771-fb69-49da-81b3-7f112e623170', 'attached_at': '', 'detached_at': '', 'volume_id': 'f431d8b9-aa1e-46f5-b7da-39f4a550e050', 'serial': 'f431d8b9-aa1e-46f5-b7da-39f4a550e050'}, 'guest_format': None, 'boot_index': None, 'disk_bus': 'virtio', 'attachment_id': '5529af8a-03d2-434d-bc0e-2c527746b289', 'delete_on_termination': False, 'volume_type': None} {{(pid=75165) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 00:17:48 user nova-compute[75165]: DEBUG nova.objects.instance [None req-e443eaee-f72a-478b-803b-871a8cc033c4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Lazy-loading 'numa_topology' on Instance uuid 27fa1771-fb69-49da-81b3-7f112e623170 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:17:48 user nova-compute[75165]: DEBUG nova.objects.base [None req-e443eaee-f72a-478b-803b-871a8cc033c4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Object Instance<27fa1771-fb69-49da-81b3-7f112e623170> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75165) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 00:17:48 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-e443eaee-f72a-478b-803b-871a8cc033c4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:17:48 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-e443eaee-f72a-478b-803b-871a8cc033c4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:17:48 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-e443eaee-f72a-478b-803b-871a8cc033c4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75165) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 00:17:48 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-e443eaee-f72a-478b-803b-871a8cc033c4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] CPU controller missing on host. {{(pid=75165) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 00:17:48 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-e443eaee-f72a-478b-803b-871a8cc033c4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75165) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 00:17:48 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-e443eaee-f72a-478b-803b-871a8cc033c4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] CPU controller found on host. {{(pid=75165) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 00:17:48 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-e443eaee-f72a-478b-803b-871a8cc033c4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75165) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 00:17:48 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-e443eaee-f72a-478b-803b-871a8cc033c4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T00:03:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=bff0d8a1-739e-4c4d-9efa-b73ba7b76d01,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 00:17:48 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-e443eaee-f72a-478b-803b-871a8cc033c4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Flavor limits 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 00:17:48 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-e443eaee-f72a-478b-803b-871a8cc033c4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Image limits 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 00:17:48 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-e443eaee-f72a-478b-803b-871a8cc033c4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Flavor pref 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 00:17:48 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-e443eaee-f72a-478b-803b-871a8cc033c4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Image pref 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 00:17:48 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-e443eaee-f72a-478b-803b-871a8cc033c4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 00:17:48 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-e443eaee-f72a-478b-803b-871a8cc033c4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 00:17:48 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-e443eaee-f72a-478b-803b-871a8cc033c4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75165) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 00:17:48 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-e443eaee-f72a-478b-803b-871a8cc033c4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Got 1 possible topologies {{(pid=75165) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 00:17:48 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-e443eaee-f72a-478b-803b-871a8cc033c4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 00:17:48 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-e443eaee-f72a-478b-803b-871a8cc033c4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 00:17:48 user nova-compute[75165]: DEBUG nova.objects.instance [None req-e443eaee-f72a-478b-803b-871a8cc033c4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Lazy-loading 'vcpu_model' on Instance uuid 27fa1771-fb69-49da-81b3-7f112e623170 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:17:48 user nova-compute[75165]: DEBUG nova.objects.base [None req-e443eaee-f72a-478b-803b-871a8cc033c4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Object Instance<27fa1771-fb69-49da-81b3-7f112e623170> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75165) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 00:17:48 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e443eaee-f72a-478b-803b-871a8cc033c4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] [instance: 27fa1771-fb69-49da-81b3-7f112e623170] Calling os-brick to attach iSCSI Volume {{(pid=75165) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 00:17:48 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e443eaee-f72a-478b-803b-871a8cc033c4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8bf8160e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f431d8b9-aa1e-46f5-b7da-39f4a550e050', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ijTvApyq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:17:48 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-e443eaee-f72a-478b-803b-871a8cc033c4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:17:48 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-e443eaee-f72a-478b-803b-871a8cc033c4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:17:48 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-e443eaee-f72a-478b-803b-871a8cc033c4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:17:48 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-e443eaee-f72a-478b-803b-871a8cc033c4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:17:48 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-e443eaee-f72a-478b-803b-871a8cc033c4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f431d8b9-aa1e-46f5-b7da-39f4a550e050" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:17:48 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-e443eaee-f72a-478b-803b-871a8cc033c4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f431d8b9-aa1e-46f5-b7da-39f4a550e050" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:17:48 user nova-compute[75165]: INFO os_brick.initiator.connectors.iscsi [None req-e443eaee-f72a-478b-803b-871a8cc033c4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 00:17:48 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f431d8b9-aa1e-46f5-b7da-39f4a550e050 -p 172.16.0.220:3260 {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:17:48 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f431d8b9-aa1e-46f5-b7da-39f4a550e050 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:17:48 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9add24e-92c0-49d7-a48c-56ac6b90b9fc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:17:48 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e443eaee-f72a-478b-803b-871a8cc033c4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 00:17:48 user nova-compute[75165]:  {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:17:48 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f431d8b9-aa1e-46f5-b7da-39f4a550e050 -p 172.16.0.220:3260 --interface default --op new {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:17:48 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f431d8b9-aa1e-46f5-b7da-39f4a550e050 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:17:48 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce36cf45-cade-4231-94b7-042e9bd84a3d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f431d8b9-aa1e-46f5-b7da-39f4a550e050] added\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:17:48 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e443eaee-f72a-478b-803b-871a8cc033c4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f431d8b9-aa1e-46f5-b7da-39f4a550e050] added
Oct 26 00:17:48 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:17:48 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f431d8b9-aa1e-46f5-b7da-39f4a550e050 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:17:48 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f431d8b9-aa1e-46f5-b7da-39f4a550e050 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:17:48 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[10020960-5448-4b19-a46e-82ba2a870479]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:17:48 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e443eaee-f72a-478b-803b-871a8cc033c4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:17:48 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f431d8b9-aa1e-46f5-b7da-39f4a550e050 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:17:48 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f431d8b9-aa1e-46f5-b7da-39f4a550e050 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:17:48 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[784f560d-95c4-44f4-ae8a-7f33c73a4f23]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:17:48 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e443eaee-f72a-478b-803b-871a8cc033c4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:17:48 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f431d8b9-aa1e-46f5-b7da-39f4a550e050 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ijTvApyq {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:17:48 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f431d8b9-aa1e-46f5-b7da-39f4a550e050 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ijTvApyq" returned: 0 in 0.028s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:17:48 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc72054a-5455-426a-99fe-5f98690f8319]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:17:48 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e443eaee-f72a-478b-803b-871a8cc033c4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ijTvApyq'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:17:48 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f431d8b9-aa1e-46f5-b7da-39f4a550e050 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:17:48 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f431d8b9-aa1e-46f5-b7da-39f4a550e050 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:17:48 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[060a8c79-0a11-40c4-b4f8-f3d096eda55c]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:17:48 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e443eaee-f72a-478b-803b-871a8cc033c4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:17:48 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:17:48 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.023s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:17:48 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[576a4893-7561-4bd4-a40e-e06d62647fec]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:17:48 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e443eaee-f72a-478b-803b-871a8cc033c4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 26 00:17:48 user nova-compute[75165]:  {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:17:48 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e443eaee-f72a-478b-803b-871a8cc033c4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 26 00:17:48 user nova-compute[75165]:  {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:17:48 user nova-compute[75165]: WARNING os_brick.initiator.connectors.iscsi [None req-e443eaee-f72a-478b-803b-871a8cc033c4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 26 00:17:48 user nova-compute[75165]: 
Oct 26 00:17:48 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f431d8b9-aa1e-46f5-b7da-39f4a550e050 -p 172.16.0.220:3260 --login {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:17:48 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f431d8b9-aa1e-46f5-b7da-39f4a550e050 -p 172.16.0.220:3260 --login" returned: 0 in 0.093s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:17:48 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdaed597-7ddc-4350-8dc9-ac5bf386ff1b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f431d8b9-aa1e-46f5-b7da-39f4a550e050, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f431d8b9-aa1e-46f5-b7da-39f4a550e050, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:17:48 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e443eaee-f72a-478b-803b-871a8cc033c4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f431d8b9-aa1e-46f5-b7da-39f4a550e050, portal: 172.16.0.220,3260]
Oct 26 00:17:48 user nova-compute[75165]: Login to [iface: default, target: iqn.2010-10.org.openstack:f431d8b9-aa1e-46f5-b7da-39f4a550e050, portal: 172.16.0.220,3260] successful.
Oct 26 00:17:48 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:17:48 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f431d8b9-aa1e-46f5-b7da-39f4a550e050 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:17:48 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f431d8b9-aa1e-46f5-b7da-39f4a550e050 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:17:48 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[5611e0ca-7fb3-44d4-ac80-387db5073a7a]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:17:48 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e443eaee-f72a-478b-803b-871a8cc033c4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:17:48 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:17:48 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:17:48 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d5292b9-340d-4a09-8009-dfcc431a0edb]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f431d8b9-aa1e-46f5-b7da-39f4a550e050 (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:17:48 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e443eaee-f72a-478b-803b-871a8cc033c4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f431d8b9-aa1e-46f5-b7da-39f4a550e050 (non-flash)
Oct 26 00:17:48 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:17:48 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e443eaee-f72a-478b-803b-871a8cc033c4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f431d8b9-aa1e-46f5-b7da-39f4a550e050 (non-flash)
Oct 26 00:17:48 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:17:48 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-e443eaee-f72a-478b-803b-871a8cc033c4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f431d8b9-aa1e-46f5-b7da-39f4a550e050" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.378s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:17:48 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e443eaee-f72a-478b-803b-871a8cc033c4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Connected to 172.16.0.220:3260 {{(pid=75165) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 00:17:48 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-e443eaee-f72a-478b-803b-871a8cc033c4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] HCTL ('33', '-', '-', 0) found on session 22 with lun 0 {{(pid=75165) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 00:17:48 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-e443eaee-f72a-478b-803b-871a8cc033c4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75165) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 00:17:48 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:17:48 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:17:48 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[4044c5e6-ff28-4a54-a835-52033b74e693]: (4, ('- - 0', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:17:48 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-e443eaee-f72a-478b-803b-871a8cc033c4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Searching for a device in session 22 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75165) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 00:17:48 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e443eaee-f72a-478b-803b-871a8cc033c4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:f431d8b9-aa1e-46f5-b7da-39f4a550e050', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ijTvApyq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75165) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 00:17:49 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-e443eaee-f72a-478b-803b-871a8cc033c4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.425s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:17:49 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e443eaee-f72a-478b-803b-871a8cc033c4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] <== connect_volume: return (1427ms) {'type': 'block', 'scsi_wwn': '26133366433646535', 'path': '/dev/sdb'} {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:17:49 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e443eaee-f72a-478b-803b-871a8cc033c4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] [instance: 27fa1771-fb69-49da-81b3-7f112e623170] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26133366433646535', 'path': '/dev/sdb'} {{(pid=75165) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 00:17:49 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-e443eaee-f72a-478b-803b-871a8cc033c4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:13:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1390737120',display_name='tempest-AttachVolumeTestJSON-server-1390737120',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1390737120',id=20,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEolsf1MVpCHotOftiJQ4Zgsnx29J3YYZZ32cA7FaSf4r6DElmgaLg7eBXc3I/pwZzl9KTJMnY6YgVOXkfwz2nESGnC4fUVVLf94BqH2qQSBNdKz1HLQzjXno+XfnON8kw==',key_name='tempest-keypair-763586997',keypairs=<?>,launch_index=0,launched_at=2023-10-26T00:13:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='3ffbf5c944914cafac7aba65fb7ca402',ramdisk_id='',reservation_id='r-ox40rq7n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2130746724',owner_user_name='tempest-AttachVolumeTestJSON-2130746724-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T00:15:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='841b5be7c0b348de979920fc9ae223ed',uuid=27fa1771-fb69-49da-81b3-7f112e623170,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "4d97651b-5d7c-4778-85a4-a11588892b31", "address": "fa:16:3e:c5:bb:76", "network": {"id": "7e330392-6256-405b-ab37-0b8af0c4fd48", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-430326049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ffbf5c944914cafac7aba65fb7ca402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d97651b-5d", "ovs_interfaceid": "4d97651b-5d7c-4778-85a4-a11588892b31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75165) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 00:17:49 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-e443eaee-f72a-478b-803b-871a8cc033c4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Converting VIF {"id": "4d97651b-5d7c-4778-85a4-a11588892b31", "address": "fa:16:3e:c5:bb:76", "network": {"id": "7e330392-6256-405b-ab37-0b8af0c4fd48", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-430326049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ffbf5c944914cafac7aba65fb7ca402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d97651b-5d", "ovs_interfaceid": "4d97651b-5d7c-4778-85a4-a11588892b31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:17:49 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-e443eaee-f72a-478b-803b-871a8cc033c4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:bb:76,bridge_name='br-int',has_traffic_filtering=True,id=4d97651b-5d7c-4778-85a4-a11588892b31,network=Network(7e330392-6256-405b-ab37-0b8af0c4fd48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d97651b-5d') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:17:49 user nova-compute[75165]: DEBUG nova.objects.instance [None req-e443eaee-f72a-478b-803b-871a8cc033c4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Lazy-loading 'pci_devices' on Instance uuid 27fa1771-fb69-49da-81b3-7f112e623170 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:17:49 user nova-compute[75165]: DEBUG nova.objects.base [None req-e443eaee-f72a-478b-803b-871a8cc033c4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Object Instance<27fa1771-fb69-49da-81b3-7f112e623170> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75165) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 00:17:49 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-e443eaee-f72a-478b-803b-871a8cc033c4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] [instance: 27fa1771-fb69-49da-81b3-7f112e623170] End _get_guest_xml xml=<domain type="kvm">
Oct 26 00:17:49 user nova-compute[75165]:   <uuid>27fa1771-fb69-49da-81b3-7f112e623170</uuid>
Oct 26 00:17:49 user nova-compute[75165]:   <name>instance-00000014</name>
Oct 26 00:17:49 user nova-compute[75165]:   <memory>524288</memory>
Oct 26 00:17:49 user nova-compute[75165]:   <vcpu>1</vcpu>
Oct 26 00:17:49 user nova-compute[75165]:   <metadata>
Oct 26 00:17:49 user nova-compute[75165]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 00:17:49 user nova-compute[75165]:       <nova:package version="0.0.0"/>
Oct 26 00:17:49 user nova-compute[75165]:       <nova:name>tempest-AttachVolumeTestJSON-server-1390737120</nova:name>
Oct 26 00:17:49 user nova-compute[75165]:       <nova:creationTime>2023-10-26 00:17:48</nova:creationTime>
Oct 26 00:17:49 user nova-compute[75165]:       <nova:flavor name="m1.tiny">
Oct 26 00:17:49 user nova-compute[75165]:         <nova:memory>512</nova:memory>
Oct 26 00:17:49 user nova-compute[75165]:         <nova:disk>1</nova:disk>
Oct 26 00:17:49 user nova-compute[75165]:         <nova:swap>0</nova:swap>
Oct 26 00:17:49 user nova-compute[75165]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 00:17:49 user nova-compute[75165]:         <nova:vcpus>1</nova:vcpus>
Oct 26 00:17:49 user nova-compute[75165]:       </nova:flavor>
Oct 26 00:17:49 user nova-compute[75165]:       <nova:owner>
Oct 26 00:17:49 user nova-compute[75165]:         <nova:user uuid="841b5be7c0b348de979920fc9ae223ed">tempest-AttachVolumeTestJSON-2130746724-project-member</nova:user>
Oct 26 00:17:49 user nova-compute[75165]:         <nova:project uuid="3ffbf5c944914cafac7aba65fb7ca402">tempest-AttachVolumeTestJSON-2130746724</nova:project>
Oct 26 00:17:49 user nova-compute[75165]:       </nova:owner>
Oct 26 00:17:49 user nova-compute[75165]:       <nova:root type="image" uuid="bff0d8a1-739e-4c4d-9efa-b73ba7b76d01"/>
Oct 26 00:17:49 user nova-compute[75165]:       <nova:ports>
Oct 26 00:17:49 user nova-compute[75165]:         <nova:port uuid="4d97651b-5d7c-4778-85a4-a11588892b31">
Oct 26 00:17:49 user nova-compute[75165]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 26 00:17:49 user nova-compute[75165]:         </nova:port>
Oct 26 00:17:49 user nova-compute[75165]:       </nova:ports>
Oct 26 00:17:49 user nova-compute[75165]:     </nova:instance>
Oct 26 00:17:49 user nova-compute[75165]:   </metadata>
Oct 26 00:17:49 user nova-compute[75165]:   <sysinfo type="smbios">
Oct 26 00:17:49 user nova-compute[75165]:     <system>
Oct 26 00:17:49 user nova-compute[75165]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 00:17:49 user nova-compute[75165]:       <entry name="product">OpenStack Nova</entry>
Oct 26 00:17:49 user nova-compute[75165]:       <entry name="version">0.0.0</entry>
Oct 26 00:17:49 user nova-compute[75165]:       <entry name="serial">27fa1771-fb69-49da-81b3-7f112e623170</entry>
Oct 26 00:17:49 user nova-compute[75165]:       <entry name="uuid">27fa1771-fb69-49da-81b3-7f112e623170</entry>
Oct 26 00:17:49 user nova-compute[75165]:       <entry name="family">Virtual Machine</entry>
Oct 26 00:17:49 user nova-compute[75165]:     </system>
Oct 26 00:17:49 user nova-compute[75165]:   </sysinfo>
Oct 26 00:17:49 user nova-compute[75165]:   <os>
Oct 26 00:17:49 user nova-compute[75165]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 00:17:49 user nova-compute[75165]:     <boot dev="hd"/>
Oct 26 00:17:49 user nova-compute[75165]:     <smbios mode="sysinfo"/>
Oct 26 00:17:49 user nova-compute[75165]:   </os>
Oct 26 00:17:49 user nova-compute[75165]:   <features>
Oct 26 00:17:49 user nova-compute[75165]:     <acpi/>
Oct 26 00:17:49 user nova-compute[75165]:     <apic/>
Oct 26 00:17:49 user nova-compute[75165]:     <vmcoreinfo/>
Oct 26 00:17:49 user nova-compute[75165]:   </features>
Oct 26 00:17:49 user nova-compute[75165]:   <clock offset="utc">
Oct 26 00:17:49 user nova-compute[75165]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 00:17:49 user nova-compute[75165]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 00:17:49 user nova-compute[75165]:     <timer name="hpet" present="no"/>
Oct 26 00:17:49 user nova-compute[75165]:   </clock>
Oct 26 00:17:49 user nova-compute[75165]:   <cpu mode="custom" match="exact">
Oct 26 00:17:49 user nova-compute[75165]:     <model>Nehalem</model>
Oct 26 00:17:49 user nova-compute[75165]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 00:17:49 user nova-compute[75165]:   </cpu>
Oct 26 00:17:49 user nova-compute[75165]:   <devices>
Oct 26 00:17:49 user nova-compute[75165]:     <disk type="file" device="disk">
Oct 26 00:17:49 user nova-compute[75165]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 00:17:49 user nova-compute[75165]:       <source file="/opt/stack/data/nova/instances/27fa1771-fb69-49da-81b3-7f112e623170/disk"/>
Oct 26 00:17:49 user nova-compute[75165]:       <target dev="vda" bus="virtio"/>
Oct 26 00:17:49 user nova-compute[75165]:     </disk>
Oct 26 00:17:49 user nova-compute[75165]:     <disk type="block" device="disk">
Oct 26 00:17:49 user nova-compute[75165]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 00:17:49 user nova-compute[75165]:       <source dev="/dev/sdb"/>
Oct 26 00:17:49 user nova-compute[75165]:       <target dev="vdb" bus="virtio"/>
Oct 26 00:17:49 user nova-compute[75165]:       <serial>f431d8b9-aa1e-46f5-b7da-39f4a550e050</serial>
Oct 26 00:17:49 user nova-compute[75165]:     </disk>
Oct 26 00:17:49 user nova-compute[75165]:     <interface type="ethernet">
Oct 26 00:17:49 user nova-compute[75165]:       <mac address="fa:16:3e:c5:bb:76"/>
Oct 26 00:17:49 user nova-compute[75165]:       <model type="virtio"/>
Oct 26 00:17:49 user nova-compute[75165]:       <mtu size="1442"/>
Oct 26 00:17:49 user nova-compute[75165]:       <target dev="tap4d97651b-5d"/>
Oct 26 00:17:49 user nova-compute[75165]:     </interface>
Oct 26 00:17:49 user nova-compute[75165]:     <serial type="pty">
Oct 26 00:17:49 user nova-compute[75165]:       <log file="/opt/stack/data/nova/instances/27fa1771-fb69-49da-81b3-7f112e623170/console.log" append="off"/>
Oct 26 00:17:49 user nova-compute[75165]:     </serial>
Oct 26 00:17:49 user nova-compute[75165]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 00:17:49 user nova-compute[75165]:     <video>
Oct 26 00:17:49 user nova-compute[75165]:       <model type="virtio"/>
Oct 26 00:17:49 user nova-compute[75165]:     </video>
Oct 26 00:17:49 user nova-compute[75165]:     <rng model="virtio">
Oct 26 00:17:49 user nova-compute[75165]:       <backend model="random">/dev/urandom</backend>
Oct 26 00:17:49 user nova-compute[75165]:     </rng>
Oct 26 00:17:49 user nova-compute[75165]:     <controller type="usb" index="0" model="none"/>
Oct 26 00:17:49 user nova-compute[75165]:     <memballoon model="virtio">
Oct 26 00:17:49 user nova-compute[75165]:       <stats period="10"/>
Oct 26 00:17:49 user nova-compute[75165]:     </memballoon>
Oct 26 00:17:49 user nova-compute[75165]:   </devices>
Oct 26 00:17:49 user nova-compute[75165]: </domain>
Oct 26 00:17:49 user nova-compute[75165]:  {{(pid=75165) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 00:17:49 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-e443eaee-f72a-478b-803b-871a8cc033c4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27fa1771-fb69-49da-81b3-7f112e623170/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:17:50 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-e443eaee-f72a-478b-803b-871a8cc033c4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27fa1771-fb69-49da-81b3-7f112e623170/disk --force-share --output=json" returned: 0 in 0.282s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:17:50 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-e443eaee-f72a-478b-803b-871a8cc033c4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27fa1771-fb69-49da-81b3-7f112e623170/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:17:50 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-e443eaee-f72a-478b-803b-871a8cc033c4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27fa1771-fb69-49da-81b3-7f112e623170/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:17:50 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-e443eaee-f72a-478b-803b-871a8cc033c4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75165) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 00:17:50 user nova-compute[75165]: DEBUG nova.objects.instance [None req-e443eaee-f72a-478b-803b-871a8cc033c4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Lazy-loading 'trusted_certs' on Instance uuid 27fa1771-fb69-49da-81b3-7f112e623170 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:17:50 user nova-compute[75165]: DEBUG nova.objects.base [None req-e443eaee-f72a-478b-803b-871a8cc033c4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Object Instance<27fa1771-fb69-49da-81b3-7f112e623170> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75165) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 00:17:50 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-e443eaee-f72a-478b-803b-871a8cc033c4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:17:50 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-e443eaee-f72a-478b-803b-871a8cc033c4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json" returned: 0 in 0.203s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:17:50 user nova-compute[75165]: DEBUG nova.virt.disk.api [None req-e443eaee-f72a-478b-803b-871a8cc033c4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Checking if we can resize image /opt/stack/data/nova/instances/27fa1771-fb69-49da-81b3-7f112e623170/disk. size=1073741824 {{(pid=75165) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 00:17:50 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-e443eaee-f72a-478b-803b-871a8cc033c4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27fa1771-fb69-49da-81b3-7f112e623170/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:17:50 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-e443eaee-f72a-478b-803b-871a8cc033c4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27fa1771-fb69-49da-81b3-7f112e623170/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:17:50 user nova-compute[75165]: DEBUG nova.virt.disk.api [None req-e443eaee-f72a-478b-803b-871a8cc033c4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Cannot resize image /opt/stack/data/nova/instances/27fa1771-fb69-49da-81b3-7f112e623170/disk to a smaller size. {{(pid=75165) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 00:17:50 user nova-compute[75165]: DEBUG nova.objects.instance [None req-e443eaee-f72a-478b-803b-871a8cc033c4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Lazy-loading 'migration_context' on Instance uuid 27fa1771-fb69-49da-81b3-7f112e623170 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:17:50 user nova-compute[75165]: DEBUG nova.objects.base [None req-e443eaee-f72a-478b-803b-871a8cc033c4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Object Instance<27fa1771-fb69-49da-81b3-7f112e623170> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75165) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 00:17:50 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-e443eaee-f72a-478b-803b-871a8cc033c4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:13:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1390737120',display_name='tempest-AttachVolumeTestJSON-server-1390737120',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1390737120',id=20,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEolsf1MVpCHotOftiJQ4Zgsnx29J3YYZZ32cA7FaSf4r6DElmgaLg7eBXc3I/pwZzl9KTJMnY6YgVOXkfwz2nESGnC4fUVVLf94BqH2qQSBNdKz1HLQzjXno+XfnON8kw==',key_name='tempest-keypair-763586997',keypairs=<?>,launch_index=0,launched_at=2023-10-26T00:13:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='3ffbf5c944914cafac7aba65fb7ca402',ramdisk_id='',reservation_id='r-ox40rq7n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2130746724',owner_user_name='tempest-AttachVolumeTestJSON-2130746724-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T00:15:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='841b5be7c0b348de979920fc9ae223ed',uuid=27fa1771-fb69-49da-81b3-7f112e623170,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "4d97651b-5d7c-4778-85a4-a11588892b31", "address": "fa:16:3e:c5:bb:76", "network": {"id": "7e330392-6256-405b-ab37-0b8af0c4fd48", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-430326049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ffbf5c944914cafac7aba65fb7ca402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d97651b-5d", "ovs_interfaceid": "4d97651b-5d7c-4778-85a4-a11588892b31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 00:17:50 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-e443eaee-f72a-478b-803b-871a8cc033c4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Converting VIF {"id": "4d97651b-5d7c-4778-85a4-a11588892b31", "address": "fa:16:3e:c5:bb:76", "network": {"id": "7e330392-6256-405b-ab37-0b8af0c4fd48", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-430326049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ffbf5c944914cafac7aba65fb7ca402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d97651b-5d", "ovs_interfaceid": "4d97651b-5d7c-4778-85a4-a11588892b31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:17:50 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-e443eaee-f72a-478b-803b-871a8cc033c4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:bb:76,bridge_name='br-int',has_traffic_filtering=True,id=4d97651b-5d7c-4778-85a4-a11588892b31,network=Network(7e330392-6256-405b-ab37-0b8af0c4fd48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d97651b-5d') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:17:50 user nova-compute[75165]: DEBUG os_vif [None req-e443eaee-f72a-478b-803b-871a8cc033c4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:bb:76,bridge_name='br-int',has_traffic_filtering=True,id=4d97651b-5d7c-4778-85a4-a11588892b31,network=Network(7e330392-6256-405b-ab37-0b8af0c4fd48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d97651b-5d') {{(pid=75165) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 00:17:50 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:17:50 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:17:50 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 00:17:50 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:17:50 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4375787e-6f02-5202-9bbe-f9114f448eb1', '_type': 'linux-noop'}}, row=False) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:17:50 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:17:50 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:17:50 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:17:50 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4d97651b-5d, may_exist=True, interface_attrs={}) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:17:50 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4d97651b-5d, col_values=(('qos', UUID('2aeb1c18-0809-46cc-92a1-5e41491f628f')),), if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:17:50 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4d97651b-5d, col_values=(('external_ids', {'iface-id': '4d97651b-5d7c-4778-85a4-a11588892b31', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c5:bb:76', 'vm-uuid': '27fa1771-fb69-49da-81b3-7f112e623170'}),), if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:17:50 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:17:50 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:17:50 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:17:50 user nova-compute[75165]: INFO os_vif [None req-e443eaee-f72a-478b-803b-871a8cc033c4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:bb:76,bridge_name='br-int',has_traffic_filtering=True,id=4d97651b-5d7c-4778-85a4-a11588892b31,network=Network(7e330392-6256-405b-ab37-0b8af0c4fd48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d97651b-5d')
Oct 26 00:17:52 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:17:52 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:17:52 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:17:52 user nova-compute[75165]: DEBUG nova.compute.manager [req-20acab07-0f29-4606-af8a-eb1548460bf3 req-e6bb5c64-3e88-42dd-8cc1-65a6c5b1c0a8 service nova] [instance: 27fa1771-fb69-49da-81b3-7f112e623170] Received event network-vif-plugged-4d97651b-5d7c-4778-85a4-a11588892b31 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:17:52 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-20acab07-0f29-4606-af8a-eb1548460bf3 req-e6bb5c64-3e88-42dd-8cc1-65a6c5b1c0a8 service nova] Acquiring lock "27fa1771-fb69-49da-81b3-7f112e623170-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:17:52 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-20acab07-0f29-4606-af8a-eb1548460bf3 req-e6bb5c64-3e88-42dd-8cc1-65a6c5b1c0a8 service nova] Lock "27fa1771-fb69-49da-81b3-7f112e623170-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:17:52 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-20acab07-0f29-4606-af8a-eb1548460bf3 req-e6bb5c64-3e88-42dd-8cc1-65a6c5b1c0a8 service nova] Lock "27fa1771-fb69-49da-81b3-7f112e623170-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:17:52 user nova-compute[75165]: DEBUG nova.compute.manager [req-20acab07-0f29-4606-af8a-eb1548460bf3 req-e6bb5c64-3e88-42dd-8cc1-65a6c5b1c0a8 service nova] [instance: 27fa1771-fb69-49da-81b3-7f112e623170] No waiting events found dispatching network-vif-plugged-4d97651b-5d7c-4778-85a4-a11588892b31 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:17:52 user nova-compute[75165]: WARNING nova.compute.manager [req-20acab07-0f29-4606-af8a-eb1548460bf3 req-e6bb5c64-3e88-42dd-8cc1-65a6c5b1c0a8 service nova] [instance: 27fa1771-fb69-49da-81b3-7f112e623170] Received unexpected event network-vif-plugged-4d97651b-5d7c-4778-85a4-a11588892b31 for instance with vm_state stopped and task_state powering-on.
Oct 26 00:17:52 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:17:53 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:17:53 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:17:54 user nova-compute[75165]: DEBUG nova.compute.manager [req-6fb16a8a-b835-4da8-8a62-b0c416cb9583 req-31151528-9b86-4435-b0c2-c9664bc38992 service nova] [instance: 27fa1771-fb69-49da-81b3-7f112e623170] Received event network-vif-plugged-4d97651b-5d7c-4778-85a4-a11588892b31 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:17:54 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-6fb16a8a-b835-4da8-8a62-b0c416cb9583 req-31151528-9b86-4435-b0c2-c9664bc38992 service nova] Acquiring lock "27fa1771-fb69-49da-81b3-7f112e623170-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:17:54 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-6fb16a8a-b835-4da8-8a62-b0c416cb9583 req-31151528-9b86-4435-b0c2-c9664bc38992 service nova] Lock "27fa1771-fb69-49da-81b3-7f112e623170-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:17:54 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-6fb16a8a-b835-4da8-8a62-b0c416cb9583 req-31151528-9b86-4435-b0c2-c9664bc38992 service nova] Lock "27fa1771-fb69-49da-81b3-7f112e623170-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:17:54 user nova-compute[75165]: DEBUG nova.compute.manager [req-6fb16a8a-b835-4da8-8a62-b0c416cb9583 req-31151528-9b86-4435-b0c2-c9664bc38992 service nova] [instance: 27fa1771-fb69-49da-81b3-7f112e623170] No waiting events found dispatching network-vif-plugged-4d97651b-5d7c-4778-85a4-a11588892b31 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:17:54 user nova-compute[75165]: WARNING nova.compute.manager [req-6fb16a8a-b835-4da8-8a62-b0c416cb9583 req-31151528-9b86-4435-b0c2-c9664bc38992 service nova] [instance: 27fa1771-fb69-49da-81b3-7f112e623170] Received unexpected event network-vif-plugged-4d97651b-5d7c-4778-85a4-a11588892b31 for instance with vm_state stopped and task_state powering-on.
Oct 26 00:17:55 user nova-compute[75165]: DEBUG nova.compute.manager [None req-e443eaee-f72a-478b-803b-871a8cc033c4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] [instance: 27fa1771-fb69-49da-81b3-7f112e623170] Instance event wait completed in 0 seconds for  {{(pid=75165) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 00:17:55 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: 27fa1771-fb69-49da-81b3-7f112e623170] Instance rebooted successfully.
Oct 26 00:17:55 user nova-compute[75165]: DEBUG nova.compute.manager [None req-e443eaee-f72a-478b-803b-871a8cc033c4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] [instance: 27fa1771-fb69-49da-81b3-7f112e623170] Checking state {{(pid=75165) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 00:17:55 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:17:56 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:17:57 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:18:00 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b0da81f-609d-4e72-b3c3-a51f2e175ab0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: 91fe894a-90a8-4545-9b27-91771554c4cb] Calling os-brick to attach iSCSI Volume {{(pid=75165) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 00:18:00 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b0da81f-609d-4e72-b3c3-a51f2e175ab0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8bf8160e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f06e40e7-3ca1-4a25-bd11-ff01280c6df2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mcRWVrAX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:18:00 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-5b0da81f-609d-4e72-b3c3-a51f2e175ab0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:18:00 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-5b0da81f-609d-4e72-b3c3-a51f2e175ab0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:18:00 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-5b0da81f-609d-4e72-b3c3-a51f2e175ab0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:18:00 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-5b0da81f-609d-4e72-b3c3-a51f2e175ab0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:18:00 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-5b0da81f-609d-4e72-b3c3-a51f2e175ab0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f06e40e7-3ca1-4a25-bd11-ff01280c6df2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:18:00 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-5b0da81f-609d-4e72-b3c3-a51f2e175ab0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f06e40e7-3ca1-4a25-bd11-ff01280c6df2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:18:00 user nova-compute[75165]: INFO os_brick.initiator.connectors.iscsi [None req-5b0da81f-609d-4e72-b3c3-a51f2e175ab0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 00:18:00 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f06e40e7-3ca1-4a25-bd11-ff01280c6df2 -p 172.16.0.220:3260 {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:18:00 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f06e40e7-3ca1-4a25-bd11-ff01280c6df2 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:18:00 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[d73e8eb5-ae0f-4044-ac0b-8ea45be9e896]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:18:00 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b0da81f-609d-4e72-b3c3-a51f2e175ab0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 00:18:00 user nova-compute[75165]:  {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:18:00 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f06e40e7-3ca1-4a25-bd11-ff01280c6df2 -p 172.16.0.220:3260 --interface default --op new {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:18:00 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f06e40e7-3ca1-4a25-bd11-ff01280c6df2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:18:00 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcb4e414-ca12-4b26-87f5-92e113896684]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f06e40e7-3ca1-4a25-bd11-ff01280c6df2] added\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:18:00 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b0da81f-609d-4e72-b3c3-a51f2e175ab0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f06e40e7-3ca1-4a25-bd11-ff01280c6df2] added
Oct 26 00:18:00 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:18:00 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f06e40e7-3ca1-4a25-bd11-ff01280c6df2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:18:00 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f06e40e7-3ca1-4a25-bd11-ff01280c6df2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:18:00 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[f083d499-38e1-4769-b205-ee6898ce780b]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:18:00 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b0da81f-609d-4e72-b3c3-a51f2e175ab0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:18:00 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f06e40e7-3ca1-4a25-bd11-ff01280c6df2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:18:00 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f06e40e7-3ca1-4a25-bd11-ff01280c6df2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:18:00 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9ffb118-3c3f-4327-921c-1238c68dcd6a]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:18:00 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b0da81f-609d-4e72-b3c3-a51f2e175ab0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:18:00 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f06e40e7-3ca1-4a25-bd11-ff01280c6df2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mcRWVrAX {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:18:00 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f06e40e7-3ca1-4a25-bd11-ff01280c6df2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mcRWVrAX" returned: 0 in 0.032s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:18:00 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b04ef61-8c89-4c5c-a0dd-c9a2ded35a08]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:18:00 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b0da81f-609d-4e72-b3c3-a51f2e175ab0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mcRWVrAX'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:18:00 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f06e40e7-3ca1-4a25-bd11-ff01280c6df2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:18:00 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f06e40e7-3ca1-4a25-bd11-ff01280c6df2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:18:00 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[765b2c8d-9f20-4fa3-a757-eb1a1df7e74e]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:18:00 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b0da81f-609d-4e72-b3c3-a51f2e175ab0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:18:00 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:18:00 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:18:00 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[37b529e8-5355-4c20-852f-43d366f7d89f]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f431d8b9-aa1e-46f5-b7da-39f4a550e050 (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:18:00 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b0da81f-609d-4e72-b3c3-a51f2e175ab0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f431d8b9-aa1e-46f5-b7da-39f4a550e050 (non-flash)
Oct 26 00:18:00 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:18:00 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b0da81f-609d-4e72-b3c3-a51f2e175ab0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f431d8b9-aa1e-46f5-b7da-39f4a550e050 (non-flash)
Oct 26 00:18:00 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:18:00 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f06e40e7-3ca1-4a25-bd11-ff01280c6df2 -p 172.16.0.220:3260 --login {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:18:00 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f06e40e7-3ca1-4a25-bd11-ff01280c6df2 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:18:00 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c4d2c24-fc46-4e47-b132-708fdf002e29]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f06e40e7-3ca1-4a25-bd11-ff01280c6df2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f06e40e7-3ca1-4a25-bd11-ff01280c6df2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:18:00 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b0da81f-609d-4e72-b3c3-a51f2e175ab0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f06e40e7-3ca1-4a25-bd11-ff01280c6df2, portal: 172.16.0.220,3260]
Oct 26 00:18:00 user nova-compute[75165]: Login to [iface: default, target: iqn.2010-10.org.openstack:f06e40e7-3ca1-4a25-bd11-ff01280c6df2, portal: 172.16.0.220,3260] successful.
Oct 26 00:18:00 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:18:00 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f06e40e7-3ca1-4a25-bd11-ff01280c6df2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:18:00 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f06e40e7-3ca1-4a25-bd11-ff01280c6df2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:18:00 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[46971616-eeec-4cc5-abda-cfed754b4ade]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:18:00 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b0da81f-609d-4e72-b3c3-a51f2e175ab0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:18:00 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:18:00 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:18:00 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bb7f8b5-6d9b-44a3-ba67-0def629849d1]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f431d8b9-aa1e-46f5-b7da-39f4a550e050 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f06e40e7-3ca1-4a25-bd11-ff01280c6df2 (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:18:00 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b0da81f-609d-4e72-b3c3-a51f2e175ab0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f431d8b9-aa1e-46f5-b7da-39f4a550e050 (non-flash)
Oct 26 00:18:00 user nova-compute[75165]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f06e40e7-3ca1-4a25-bd11-ff01280c6df2 (non-flash)
Oct 26 00:18:00 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:18:00 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b0da81f-609d-4e72-b3c3-a51f2e175ab0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f431d8b9-aa1e-46f5-b7da-39f4a550e050 (non-flash)
Oct 26 00:18:00 user nova-compute[75165]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f06e40e7-3ca1-4a25-bd11-ff01280c6df2 (non-flash)
Oct 26 00:18:00 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:18:00 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-5b0da81f-609d-4e72-b3c3-a51f2e175ab0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f06e40e7-3ca1-4a25-bd11-ff01280c6df2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.331s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:18:00 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b0da81f-609d-4e72-b3c3-a51f2e175ab0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Connected to 172.16.0.220:3260 {{(pid=75165) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 00:18:00 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-5b0da81f-609d-4e72-b3c3-a51f2e175ab0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] HCTL ('34', '-', '-', 0) found on session 23 with lun 0 {{(pid=75165) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 00:18:00 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-5b0da81f-609d-4e72-b3c3-a51f2e175ab0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75165) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 00:18:00 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:18:00 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.022s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:18:00 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e3f7fdc-23f9-4d29-8d33-6cbf366e23e2]: (4, ('- - 0', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:18:00 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-5b0da81f-609d-4e72-b3c3-a51f2e175ab0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Searching for a device in session 23 and hctl ['34', '*', '*', 0] yield: None {{(pid=75165) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 00:18:00 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:18:01 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-5b0da81f-609d-4e72-b3c3-a51f2e175ab0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Searching for a device in session 23 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75165) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 00:18:01 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b0da81f-609d-4e72-b3c3-a51f2e175ab0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:f06e40e7-3ca1-4a25-bd11-ff01280c6df2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mcRWVrAX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75165) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 00:18:01 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-5b0da81f-609d-4e72-b3c3-a51f2e175ab0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.369s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:18:01 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b0da81f-609d-4e72-b3c3-a51f2e175ab0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] <== connect_volume: return (1371ms) {'type': 'block', 'scsi_wwn': '26266313237356166', 'path': '/dev/sdc'} {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:18:01 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b0da81f-609d-4e72-b3c3-a51f2e175ab0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: 91fe894a-90a8-4545-9b27-91771554c4cb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26266313237356166', 'path': '/dev/sdc'} {{(pid=75165) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 00:18:01 user nova-compute[75165]: DEBUG nova.objects.instance [None req-5b0da81f-609d-4e72-b3c3-a51f2e175ab0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Lazy-loading 'flavor' on Instance uuid 91fe894a-90a8-4545-9b27-91771554c4cb {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:18:01 user nova-compute[75165]: DEBUG nova.virt.libvirt.guest [None req-5b0da81f-609d-4e72-b3c3-a51f2e175ab0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 00:18:01 user nova-compute[75165]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 00:18:01 user nova-compute[75165]:   <source dev="/dev/sdc"/>
Oct 26 00:18:01 user nova-compute[75165]:   <target dev="vdb" bus="virtio"/>
Oct 26 00:18:01 user nova-compute[75165]:   <serial>f06e40e7-3ca1-4a25-bd11-ff01280c6df2</serial>
Oct 26 00:18:01 user nova-compute[75165]: </disk>
Oct 26 00:18:01 user nova-compute[75165]:  {{(pid=75165) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 00:18:01 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:18:02 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-5b0da81f-609d-4e72-b3c3-a51f2e175ab0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] No BDM found with device name vda, not building metadata. {{(pid=75165) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 00:18:02 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-5b0da81f-609d-4e72-b3c3-a51f2e175ab0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75165) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 00:18:02 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-5b0da81f-609d-4e72-b3c3-a51f2e175ab0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] No VIF found with MAC fa:16:3e:7a:ea:a8, not building metadata {{(pid=75165) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 00:18:02 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-5b0da81f-609d-4e72-b3c3-a51f2e175ab0 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Lock "91fe894a-90a8-4545-9b27-91771554c4cb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 23.724s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:18:03 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:18:03 user nova-compute[75165]: INFO nova.compute.manager [None req-b285a1b9-374b-487b-b9ea-d2d6d1b9b2c3 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: 91fe894a-90a8-4545-9b27-91771554c4cb] Rescuing
Oct 26 00:18:03 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-b285a1b9-374b-487b-b9ea-d2d6d1b9b2c3 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Acquiring lock "refresh_cache-91fe894a-90a8-4545-9b27-91771554c4cb" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:18:03 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-b285a1b9-374b-487b-b9ea-d2d6d1b9b2c3 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Acquired lock "refresh_cache-91fe894a-90a8-4545-9b27-91771554c4cb" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:18:03 user nova-compute[75165]: DEBUG nova.network.neutron [None req-b285a1b9-374b-487b-b9ea-d2d6d1b9b2c3 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: 91fe894a-90a8-4545-9b27-91771554c4cb] Building network info cache for instance {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 00:18:03 user nova-compute[75165]: DEBUG nova.network.neutron [None req-b285a1b9-374b-487b-b9ea-d2d6d1b9b2c3 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: 91fe894a-90a8-4545-9b27-91771554c4cb] Updating instance_info_cache with network_info: [{"id": "67590aab-15ed-4684-abd7-64a5c0a9b3f5", "address": "fa:16:3e:7a:ea:a8", "network": {"id": "b31bac4b-1951-4ca3-8682-f1f24de0a5c3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1323234642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71aa69c0ea2d49e184e1e055ff3efa1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67590aab-15", "ovs_interfaceid": "67590aab-15ed-4684-abd7-64a5c0a9b3f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:18:03 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-b285a1b9-374b-487b-b9ea-d2d6d1b9b2c3 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Releasing lock "refresh_cache-91fe894a-90a8-4545-9b27-91771554c4cb" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:18:03 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:18:03 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:18:04 user nova-compute[75165]: DEBUG nova.compute.manager [req-a75e73cf-d703-4bca-b15d-69155c6b7f33 req-e812e362-a4cc-4ea6-a4e4-fbc507d6e989 service nova] [instance: 91fe894a-90a8-4545-9b27-91771554c4cb] Received event network-vif-unplugged-67590aab-15ed-4684-abd7-64a5c0a9b3f5 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:18:04 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-a75e73cf-d703-4bca-b15d-69155c6b7f33 req-e812e362-a4cc-4ea6-a4e4-fbc507d6e989 service nova] Acquiring lock "91fe894a-90a8-4545-9b27-91771554c4cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:18:04 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-a75e73cf-d703-4bca-b15d-69155c6b7f33 req-e812e362-a4cc-4ea6-a4e4-fbc507d6e989 service nova] Lock "91fe894a-90a8-4545-9b27-91771554c4cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:18:04 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-a75e73cf-d703-4bca-b15d-69155c6b7f33 req-e812e362-a4cc-4ea6-a4e4-fbc507d6e989 service nova] Lock "91fe894a-90a8-4545-9b27-91771554c4cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:18:04 user nova-compute[75165]: DEBUG nova.compute.manager [req-a75e73cf-d703-4bca-b15d-69155c6b7f33 req-e812e362-a4cc-4ea6-a4e4-fbc507d6e989 service nova] [instance: 91fe894a-90a8-4545-9b27-91771554c4cb] No waiting events found dispatching network-vif-unplugged-67590aab-15ed-4684-abd7-64a5c0a9b3f5 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:18:04 user nova-compute[75165]: WARNING nova.compute.manager [req-a75e73cf-d703-4bca-b15d-69155c6b7f33 req-e812e362-a4cc-4ea6-a4e4-fbc507d6e989 service nova] [instance: 91fe894a-90a8-4545-9b27-91771554c4cb] Received unexpected event network-vif-unplugged-67590aab-15ed-4684-abd7-64a5c0a9b3f5 for instance with vm_state active and task_state rescuing.
Oct 26 00:18:04 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:18:04 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:18:04 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:18:04 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: 91fe894a-90a8-4545-9b27-91771554c4cb] Instance destroyed successfully.
Oct 26 00:18:04 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-b285a1b9-374b-487b-b9ea-d2d6d1b9b2c3 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: 91fe894a-90a8-4545-9b27-91771554c4cb] Attempting rescue
Oct 26 00:18:04 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-b285a1b9-374b-487b-b9ea-d2d6d1b9b2c3 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75165) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 26 00:18:04 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-b285a1b9-374b-487b-b9ea-d2d6d1b9b2c3 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: 91fe894a-90a8-4545-9b27-91771554c4cb] Instance directory exists: not creating {{(pid=75165) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 26 00:18:04 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-b285a1b9-374b-487b-b9ea-d2d6d1b9b2c3 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: 91fe894a-90a8-4545-9b27-91771554c4cb] Creating image(s)
Oct 26 00:18:04 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-b285a1b9-374b-487b-b9ea-d2d6d1b9b2c3 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Acquiring lock "/opt/stack/data/nova/instances/91fe894a-90a8-4545-9b27-91771554c4cb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:18:04 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-b285a1b9-374b-487b-b9ea-d2d6d1b9b2c3 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Lock "/opt/stack/data/nova/instances/91fe894a-90a8-4545-9b27-91771554c4cb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:18:04 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-b285a1b9-374b-487b-b9ea-d2d6d1b9b2c3 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Lock "/opt/stack/data/nova/instances/91fe894a-90a8-4545-9b27-91771554c4cb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:18:04 user nova-compute[75165]: DEBUG nova.objects.instance [None req-b285a1b9-374b-487b-b9ea-d2d6d1b9b2c3 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Lazy-loading 'trusted_certs' on Instance uuid 91fe894a-90a8-4545-9b27-91771554c4cb {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:18:04 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-b285a1b9-374b-487b-b9ea-d2d6d1b9b2c3 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Acquiring lock "7d3243421cf3fdc288b758f687a93103b7b95466" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:18:04 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-b285a1b9-374b-487b-b9ea-d2d6d1b9b2c3 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Lock "7d3243421cf3fdc288b758f687a93103b7b95466" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:18:04 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-b285a1b9-374b-487b-b9ea-d2d6d1b9b2c3 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:18:04 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-b285a1b9-374b-487b-b9ea-d2d6d1b9b2c3 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json" returned: 0 in 0.193s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:18:04 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-b285a1b9-374b-487b-b9ea-d2d6d1b9b2c3 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466,backing_fmt=raw /opt/stack/data/nova/instances/91fe894a-90a8-4545-9b27-91771554c4cb/disk.rescue {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:18:04 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-b285a1b9-374b-487b-b9ea-d2d6d1b9b2c3 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466,backing_fmt=raw /opt/stack/data/nova/instances/91fe894a-90a8-4545-9b27-91771554c4cb/disk.rescue" returned: 0 in 0.069s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:18:04 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-b285a1b9-374b-487b-b9ea-d2d6d1b9b2c3 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Lock "7d3243421cf3fdc288b758f687a93103b7b95466" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.271s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:18:04 user nova-compute[75165]: DEBUG nova.objects.instance [None req-b285a1b9-374b-487b-b9ea-d2d6d1b9b2c3 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Lazy-loading 'migration_context' on Instance uuid 91fe894a-90a8-4545-9b27-91771554c4cb {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:18:05 user nova-compute[75165]: DEBUG nova.objects.base [None req-b285a1b9-374b-487b-b9ea-d2d6d1b9b2c3 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Object Instance<91fe894a-90a8-4545-9b27-91771554c4cb> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75165) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 00:18:05 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-b285a1b9-374b-487b-b9ea-d2d6d1b9b2c3 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: 91fe894a-90a8-4545-9b27-91771554c4cb] Created local disks {{(pid=75165) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 00:18:05 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-b285a1b9-374b-487b-b9ea-d2d6d1b9b2c3 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: 91fe894a-90a8-4545-9b27-91771554c4cb] Start _get_guest_xml network_info=[{"id": "67590aab-15ed-4684-abd7-64a5c0a9b3f5", "address": "fa:16:3e:7a:ea:a8", "network": {"id": "b31bac4b-1951-4ca3-8682-f1f24de0a5c3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1323234642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1323234642-network", "vif_mac": "fa:16:3e:7a:ea:a8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71aa69c0ea2d49e184e1e055ff3efa1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67590aab-15", "ovs_interfaceid": "67590aab-15ed-4684-abd7-64a5c0a9b3f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T00:03:24Z,direct_url=<?>,disk_format='qcow2',id=bff0d8a1-739e-4c4d-9efa-b73ba7b76d01,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e56bbf444fd34c348475c73673611447',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T00:03:26Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'bff0d8a1-739e-4c4d-9efa-b73ba7b76d01', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75165) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 00:18:05 user nova-compute[75165]: DEBUG nova.objects.instance [None req-b285a1b9-374b-487b-b9ea-d2d6d1b9b2c3 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Lazy-loading 'resources' on Instance uuid 91fe894a-90a8-4545-9b27-91771554c4cb {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:18:05 user nova-compute[75165]: DEBUG nova.objects.base [None req-b285a1b9-374b-487b-b9ea-d2d6d1b9b2c3 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Object Instance<91fe894a-90a8-4545-9b27-91771554c4cb> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75165) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 00:18:05 user nova-compute[75165]: DEBUG nova.objects.instance [None req-b285a1b9-374b-487b-b9ea-d2d6d1b9b2c3 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Lazy-loading 'numa_topology' on Instance uuid 91fe894a-90a8-4545-9b27-91771554c4cb {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:18:05 user nova-compute[75165]: DEBUG nova.objects.base [None req-b285a1b9-374b-487b-b9ea-d2d6d1b9b2c3 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Object Instance<91fe894a-90a8-4545-9b27-91771554c4cb> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75165) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 00:18:05 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-b285a1b9-374b-487b-b9ea-d2d6d1b9b2c3 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:18:05 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-b285a1b9-374b-487b-b9ea-d2d6d1b9b2c3 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:18:05 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-b285a1b9-374b-487b-b9ea-d2d6d1b9b2c3 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75165) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 00:18:05 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-b285a1b9-374b-487b-b9ea-d2d6d1b9b2c3 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] CPU controller missing on host. {{(pid=75165) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 00:18:05 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-b285a1b9-374b-487b-b9ea-d2d6d1b9b2c3 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75165) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 00:18:05 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-b285a1b9-374b-487b-b9ea-d2d6d1b9b2c3 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] CPU controller found on host. {{(pid=75165) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 00:18:05 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-b285a1b9-374b-487b-b9ea-d2d6d1b9b2c3 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75165) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 00:18:05 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-b285a1b9-374b-487b-b9ea-d2d6d1b9b2c3 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T00:03:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T00:03:24Z,direct_url=<?>,disk_format='qcow2',id=bff0d8a1-739e-4c4d-9efa-b73ba7b76d01,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e56bbf444fd34c348475c73673611447',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T00:03:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 00:18:05 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-b285a1b9-374b-487b-b9ea-d2d6d1b9b2c3 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Flavor limits 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 00:18:05 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-b285a1b9-374b-487b-b9ea-d2d6d1b9b2c3 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Image limits 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 00:18:05 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-b285a1b9-374b-487b-b9ea-d2d6d1b9b2c3 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Flavor pref 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 00:18:05 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-b285a1b9-374b-487b-b9ea-d2d6d1b9b2c3 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Image pref 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 00:18:05 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-b285a1b9-374b-487b-b9ea-d2d6d1b9b2c3 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 00:18:05 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-b285a1b9-374b-487b-b9ea-d2d6d1b9b2c3 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 00:18:05 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-b285a1b9-374b-487b-b9ea-d2d6d1b9b2c3 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75165) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 00:18:05 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-b285a1b9-374b-487b-b9ea-d2d6d1b9b2c3 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Got 1 possible topologies {{(pid=75165) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 00:18:05 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-b285a1b9-374b-487b-b9ea-d2d6d1b9b2c3 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 00:18:05 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-b285a1b9-374b-487b-b9ea-d2d6d1b9b2c3 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 00:18:05 user nova-compute[75165]: DEBUG nova.objects.instance [None req-b285a1b9-374b-487b-b9ea-d2d6d1b9b2c3 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Lazy-loading 'vcpu_model' on Instance uuid 91fe894a-90a8-4545-9b27-91771554c4cb {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:18:05 user nova-compute[75165]: DEBUG nova.objects.base [None req-b285a1b9-374b-487b-b9ea-d2d6d1b9b2c3 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Object Instance<91fe894a-90a8-4545-9b27-91771554c4cb> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75165) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 00:18:05 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-b285a1b9-374b-487b-b9ea-d2d6d1b9b2c3 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:15:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1293782971',display_name='tempest-ServerRescueNegativeTestJSON-server-1293782971',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1293782971',id=23,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBicVhnhgJ5DNvonotHh5eL/FfSiR8puDkSZx2aq/ImVCudvj05xCLa3mBVFpugWErX29hnO7slb7sxcE+mwD9p4LdVUoCg84e+AG2ngoSo376olvea13D0Ut/PwRlNsAQ==',key_name='tempest-keypair-12008961',keypairs=<?>,launch_index=0,launched_at=2023-10-26T00:15:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='71aa69c0ea2d49e184e1e055ff3efa1d',ramdisk_id='',reservation_id='r-ciht86kf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-2141505807',owner_user_name='tempest-ServerRescueNegativeTestJSON-2141505807-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T00:15:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='67876ca3211b47bc99af08436edeb91f',uuid=91fe894a-90a8-4545-9b27-91771554c4cb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "67590aab-15ed-4684-abd7-64a5c0a9b3f5", "address": "fa:16:3e:7a:ea:a8", "network": {"id": "b31bac4b-1951-4ca3-8682-f1f24de0a5c3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1323234642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1323234642-network", "vif_mac": "fa:16:3e:7a:ea:a8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71aa69c0ea2d49e184e1e055ff3efa1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67590aab-15", "ovs_interfaceid": "67590aab-15ed-4684-abd7-64a5c0a9b3f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75165) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 00:18:05 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-b285a1b9-374b-487b-b9ea-d2d6d1b9b2c3 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Converting VIF {"id": "67590aab-15ed-4684-abd7-64a5c0a9b3f5", "address": "fa:16:3e:7a:ea:a8", "network": {"id": "b31bac4b-1951-4ca3-8682-f1f24de0a5c3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1323234642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1323234642-network", "vif_mac": "fa:16:3e:7a:ea:a8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71aa69c0ea2d49e184e1e055ff3efa1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67590aab-15", "ovs_interfaceid": "67590aab-15ed-4684-abd7-64a5c0a9b3f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:18:05 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-b285a1b9-374b-487b-b9ea-d2d6d1b9b2c3 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7a:ea:a8,bridge_name='br-int',has_traffic_filtering=True,id=67590aab-15ed-4684-abd7-64a5c0a9b3f5,network=Network(b31bac4b-1951-4ca3-8682-f1f24de0a5c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67590aab-15') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:18:05 user nova-compute[75165]: DEBUG nova.objects.instance [None req-b285a1b9-374b-487b-b9ea-d2d6d1b9b2c3 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Lazy-loading 'pci_devices' on Instance uuid 91fe894a-90a8-4545-9b27-91771554c4cb {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:18:05 user nova-compute[75165]: DEBUG nova.objects.base [None req-b285a1b9-374b-487b-b9ea-d2d6d1b9b2c3 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Object Instance<91fe894a-90a8-4545-9b27-91771554c4cb> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75165) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 00:18:05 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-b285a1b9-374b-487b-b9ea-d2d6d1b9b2c3 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: 91fe894a-90a8-4545-9b27-91771554c4cb] End _get_guest_xml xml=<domain type="kvm">
Oct 26 00:18:05 user nova-compute[75165]:   <uuid>91fe894a-90a8-4545-9b27-91771554c4cb</uuid>
Oct 26 00:18:05 user nova-compute[75165]:   <name>instance-00000017</name>
Oct 26 00:18:05 user nova-compute[75165]:   <memory>524288</memory>
Oct 26 00:18:05 user nova-compute[75165]:   <vcpu>1</vcpu>
Oct 26 00:18:05 user nova-compute[75165]:   <metadata>
Oct 26 00:18:05 user nova-compute[75165]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 00:18:05 user nova-compute[75165]:       <nova:package version="0.0.0"/>
Oct 26 00:18:05 user nova-compute[75165]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1293782971</nova:name>
Oct 26 00:18:05 user nova-compute[75165]:       <nova:creationTime>2023-10-26 00:18:05</nova:creationTime>
Oct 26 00:18:05 user nova-compute[75165]:       <nova:flavor name="m1.tiny">
Oct 26 00:18:05 user nova-compute[75165]:         <nova:memory>512</nova:memory>
Oct 26 00:18:05 user nova-compute[75165]:         <nova:disk>1</nova:disk>
Oct 26 00:18:05 user nova-compute[75165]:         <nova:swap>0</nova:swap>
Oct 26 00:18:05 user nova-compute[75165]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 00:18:05 user nova-compute[75165]:         <nova:vcpus>1</nova:vcpus>
Oct 26 00:18:05 user nova-compute[75165]:       </nova:flavor>
Oct 26 00:18:05 user nova-compute[75165]:       <nova:owner>
Oct 26 00:18:05 user nova-compute[75165]:         <nova:user uuid="67876ca3211b47bc99af08436edeb91f">tempest-ServerRescueNegativeTestJSON-2141505807-project-member</nova:user>
Oct 26 00:18:05 user nova-compute[75165]:         <nova:project uuid="71aa69c0ea2d49e184e1e055ff3efa1d">tempest-ServerRescueNegativeTestJSON-2141505807</nova:project>
Oct 26 00:18:05 user nova-compute[75165]:       </nova:owner>
Oct 26 00:18:05 user nova-compute[75165]:       <nova:root type="image" uuid="bff0d8a1-739e-4c4d-9efa-b73ba7b76d01"/>
Oct 26 00:18:05 user nova-compute[75165]:       <nova:ports>
Oct 26 00:18:05 user nova-compute[75165]:         <nova:port uuid="67590aab-15ed-4684-abd7-64a5c0a9b3f5">
Oct 26 00:18:05 user nova-compute[75165]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 26 00:18:05 user nova-compute[75165]:         </nova:port>
Oct 26 00:18:05 user nova-compute[75165]:       </nova:ports>
Oct 26 00:18:05 user nova-compute[75165]:     </nova:instance>
Oct 26 00:18:05 user nova-compute[75165]:   </metadata>
Oct 26 00:18:05 user nova-compute[75165]:   <sysinfo type="smbios">
Oct 26 00:18:05 user nova-compute[75165]:     <system>
Oct 26 00:18:05 user nova-compute[75165]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 00:18:05 user nova-compute[75165]:       <entry name="product">OpenStack Nova</entry>
Oct 26 00:18:05 user nova-compute[75165]:       <entry name="version">0.0.0</entry>
Oct 26 00:18:05 user nova-compute[75165]:       <entry name="serial">91fe894a-90a8-4545-9b27-91771554c4cb</entry>
Oct 26 00:18:05 user nova-compute[75165]:       <entry name="uuid">91fe894a-90a8-4545-9b27-91771554c4cb</entry>
Oct 26 00:18:05 user nova-compute[75165]:       <entry name="family">Virtual Machine</entry>
Oct 26 00:18:05 user nova-compute[75165]:     </system>
Oct 26 00:18:05 user nova-compute[75165]:   </sysinfo>
Oct 26 00:18:05 user nova-compute[75165]:   <os>
Oct 26 00:18:05 user nova-compute[75165]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 00:18:05 user nova-compute[75165]:     <smbios mode="sysinfo"/>
Oct 26 00:18:05 user nova-compute[75165]:   </os>
Oct 26 00:18:05 user nova-compute[75165]:   <features>
Oct 26 00:18:05 user nova-compute[75165]:     <acpi/>
Oct 26 00:18:05 user nova-compute[75165]:     <apic/>
Oct 26 00:18:05 user nova-compute[75165]:     <vmcoreinfo/>
Oct 26 00:18:05 user nova-compute[75165]:   </features>
Oct 26 00:18:05 user nova-compute[75165]:   <clock offset="utc">
Oct 26 00:18:05 user nova-compute[75165]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 00:18:05 user nova-compute[75165]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 00:18:05 user nova-compute[75165]:     <timer name="hpet" present="no"/>
Oct 26 00:18:05 user nova-compute[75165]:   </clock>
Oct 26 00:18:05 user nova-compute[75165]:   <cpu mode="custom" match="exact">
Oct 26 00:18:05 user nova-compute[75165]:     <model>Nehalem</model>
Oct 26 00:18:05 user nova-compute[75165]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 00:18:05 user nova-compute[75165]:   </cpu>
Oct 26 00:18:05 user nova-compute[75165]:   <devices>
Oct 26 00:18:05 user nova-compute[75165]:     <disk type="file" device="disk">
Oct 26 00:18:05 user nova-compute[75165]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 00:18:05 user nova-compute[75165]:       <source file="/opt/stack/data/nova/instances/91fe894a-90a8-4545-9b27-91771554c4cb/disk.rescue"/>
Oct 26 00:18:05 user nova-compute[75165]:       <target dev="vda" bus="virtio"/>
Oct 26 00:18:05 user nova-compute[75165]:     </disk>
Oct 26 00:18:05 user nova-compute[75165]:     <disk type="file" device="disk">
Oct 26 00:18:05 user nova-compute[75165]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 00:18:05 user nova-compute[75165]:       <source file="/opt/stack/data/nova/instances/91fe894a-90a8-4545-9b27-91771554c4cb/disk"/>
Oct 26 00:18:05 user nova-compute[75165]:       <target dev="vdb" bus="virtio"/>
Oct 26 00:18:05 user nova-compute[75165]:     </disk>
Oct 26 00:18:05 user nova-compute[75165]:     <interface type="ethernet">
Oct 26 00:18:05 user nova-compute[75165]:       <mac address="fa:16:3e:7a:ea:a8"/>
Oct 26 00:18:05 user nova-compute[75165]:       <model type="virtio"/>
Oct 26 00:18:05 user nova-compute[75165]:       <mtu size="1442"/>
Oct 26 00:18:05 user nova-compute[75165]:       <target dev="tap67590aab-15"/>
Oct 26 00:18:05 user nova-compute[75165]:     </interface>
Oct 26 00:18:05 user nova-compute[75165]:     <serial type="pty">
Oct 26 00:18:05 user nova-compute[75165]:       <log file="/opt/stack/data/nova/instances/91fe894a-90a8-4545-9b27-91771554c4cb/console.log" append="off"/>
Oct 26 00:18:05 user nova-compute[75165]:     </serial>
Oct 26 00:18:05 user nova-compute[75165]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 00:18:05 user nova-compute[75165]:     <video>
Oct 26 00:18:05 user nova-compute[75165]:       <model type="virtio"/>
Oct 26 00:18:05 user nova-compute[75165]:     </video>
Oct 26 00:18:05 user nova-compute[75165]:     <rng model="virtio">
Oct 26 00:18:05 user nova-compute[75165]:       <backend model="random">/dev/urandom</backend>
Oct 26 00:18:05 user nova-compute[75165]:     </rng>
Oct 26 00:18:05 user nova-compute[75165]:     <controller type="usb" index="0" model="none"/>
Oct 26 00:18:05 user nova-compute[75165]:     <memballoon model="virtio">
Oct 26 00:18:05 user nova-compute[75165]:       <stats period="10"/>
Oct 26 00:18:05 user nova-compute[75165]:     </memballoon>
Oct 26 00:18:05 user nova-compute[75165]:   </devices>
Oct 26 00:18:05 user nova-compute[75165]: </domain>
Oct 26 00:18:05 user nova-compute[75165]:  {{(pid=75165) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 00:18:05 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: 91fe894a-90a8-4545-9b27-91771554c4cb] Instance destroyed successfully.
Oct 26 00:18:05 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-b285a1b9-374b-487b-b9ea-d2d6d1b9b2c3 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] No BDM found with device name vda, not building metadata. {{(pid=75165) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 00:18:05 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-b285a1b9-374b-487b-b9ea-d2d6d1b9b2c3 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75165) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 00:18:05 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-b285a1b9-374b-487b-b9ea-d2d6d1b9b2c3 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] No VIF found with MAC fa:16:3e:7a:ea:a8, not building metadata {{(pid=75165) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 00:18:05 user nova-compute[75165]: DEBUG nova.compute.manager [req-81edccea-d4f0-412e-8382-665dd1cc70ad req-7d9afbe4-1b1d-420e-9877-eaf59f47f368 service nova] [instance: b6558510-6f87-4ef3-b707-f1fa78bf61e8] Received event network-changed-091593d3-5f35-496b-8e3a-d03963bc0d29 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:18:05 user nova-compute[75165]: DEBUG nova.compute.manager [req-81edccea-d4f0-412e-8382-665dd1cc70ad req-7d9afbe4-1b1d-420e-9877-eaf59f47f368 service nova] [instance: b6558510-6f87-4ef3-b707-f1fa78bf61e8] Refreshing instance network info cache due to event network-changed-091593d3-5f35-496b-8e3a-d03963bc0d29. {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 00:18:05 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-81edccea-d4f0-412e-8382-665dd1cc70ad req-7d9afbe4-1b1d-420e-9877-eaf59f47f368 service nova] Acquiring lock "refresh_cache-b6558510-6f87-4ef3-b707-f1fa78bf61e8" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:18:05 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-81edccea-d4f0-412e-8382-665dd1cc70ad req-7d9afbe4-1b1d-420e-9877-eaf59f47f368 service nova] Acquired lock "refresh_cache-b6558510-6f87-4ef3-b707-f1fa78bf61e8" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:18:05 user nova-compute[75165]: DEBUG nova.network.neutron [req-81edccea-d4f0-412e-8382-665dd1cc70ad req-7d9afbe4-1b1d-420e-9877-eaf59f47f368 service nova] [instance: b6558510-6f87-4ef3-b707-f1fa78bf61e8] Refreshing network info cache for port 091593d3-5f35-496b-8e3a-d03963bc0d29 {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 00:18:05 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:18:05 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75165) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 00:18:05 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:18:06 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:18:06 user nova-compute[75165]: DEBUG nova.compute.manager [req-8a290ccf-dba6-45a6-9d19-07b9e760a0da req-b201ac9b-62ca-4bde-a4e1-83e0ea9de6d1 service nova] [instance: 91fe894a-90a8-4545-9b27-91771554c4cb] Received event network-vif-plugged-67590aab-15ed-4684-abd7-64a5c0a9b3f5 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:18:06 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-8a290ccf-dba6-45a6-9d19-07b9e760a0da req-b201ac9b-62ca-4bde-a4e1-83e0ea9de6d1 service nova] Acquiring lock "91fe894a-90a8-4545-9b27-91771554c4cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:18:06 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-8a290ccf-dba6-45a6-9d19-07b9e760a0da req-b201ac9b-62ca-4bde-a4e1-83e0ea9de6d1 service nova] Lock "91fe894a-90a8-4545-9b27-91771554c4cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:18:06 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-8a290ccf-dba6-45a6-9d19-07b9e760a0da req-b201ac9b-62ca-4bde-a4e1-83e0ea9de6d1 service nova] Lock "91fe894a-90a8-4545-9b27-91771554c4cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:18:06 user nova-compute[75165]: DEBUG nova.compute.manager [req-8a290ccf-dba6-45a6-9d19-07b9e760a0da req-b201ac9b-62ca-4bde-a4e1-83e0ea9de6d1 service nova] [instance: 91fe894a-90a8-4545-9b27-91771554c4cb] No waiting events found dispatching network-vif-plugged-67590aab-15ed-4684-abd7-64a5c0a9b3f5 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:18:06 user nova-compute[75165]: WARNING nova.compute.manager [req-8a290ccf-dba6-45a6-9d19-07b9e760a0da req-b201ac9b-62ca-4bde-a4e1-83e0ea9de6d1 service nova] [instance: 91fe894a-90a8-4545-9b27-91771554c4cb] Received unexpected event network-vif-plugged-67590aab-15ed-4684-abd7-64a5c0a9b3f5 for instance with vm_state active and task_state rescuing.
Oct 26 00:18:06 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:18:06 user nova-compute[75165]: DEBUG nova.network.neutron [req-81edccea-d4f0-412e-8382-665dd1cc70ad req-7d9afbe4-1b1d-420e-9877-eaf59f47f368 service nova] [instance: b6558510-6f87-4ef3-b707-f1fa78bf61e8] Updated VIF entry in instance network info cache for port 091593d3-5f35-496b-8e3a-d03963bc0d29. {{(pid=75165) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 00:18:06 user nova-compute[75165]: DEBUG nova.network.neutron [req-81edccea-d4f0-412e-8382-665dd1cc70ad req-7d9afbe4-1b1d-420e-9877-eaf59f47f368 service nova] [instance: b6558510-6f87-4ef3-b707-f1fa78bf61e8] Updating instance_info_cache with network_info: [{"id": "091593d3-5f35-496b-8e3a-d03963bc0d29", "address": "fa:16:3e:ae:d1:d7", "network": {"id": "68f5c9b3-84b6-42db-9fab-e14624851075", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1858718599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8274f81c556047709b5b7b45bcb8a0e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap091593d3-5f", "ovs_interfaceid": "091593d3-5f35-496b-8e3a-d03963bc0d29", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:18:06 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:18:06 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-81edccea-d4f0-412e-8382-665dd1cc70ad req-7d9afbe4-1b1d-420e-9877-eaf59f47f368 service nova] Releasing lock "refresh_cache-b6558510-6f87-4ef3-b707-f1fa78bf61e8" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:18:06 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:18:06 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:18:07 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:18:07 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:18:08 user nova-compute[75165]: DEBUG nova.compute.manager [req-88eb2c31-a4d1-4bc2-9aad-908f3ff30338 req-f6d47e24-e1c9-4ee1-ac75-c89059b13eb1 service nova] [instance: 91fe894a-90a8-4545-9b27-91771554c4cb] Received event network-vif-plugged-67590aab-15ed-4684-abd7-64a5c0a9b3f5 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:18:08 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-88eb2c31-a4d1-4bc2-9aad-908f3ff30338 req-f6d47e24-e1c9-4ee1-ac75-c89059b13eb1 service nova] Acquiring lock "91fe894a-90a8-4545-9b27-91771554c4cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:18:08 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-88eb2c31-a4d1-4bc2-9aad-908f3ff30338 req-f6d47e24-e1c9-4ee1-ac75-c89059b13eb1 service nova] Lock "91fe894a-90a8-4545-9b27-91771554c4cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:18:08 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-88eb2c31-a4d1-4bc2-9aad-908f3ff30338 req-f6d47e24-e1c9-4ee1-ac75-c89059b13eb1 service nova] Lock "91fe894a-90a8-4545-9b27-91771554c4cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:18:08 user nova-compute[75165]: DEBUG nova.compute.manager [req-88eb2c31-a4d1-4bc2-9aad-908f3ff30338 req-f6d47e24-e1c9-4ee1-ac75-c89059b13eb1 service nova] [instance: 91fe894a-90a8-4545-9b27-91771554c4cb] No waiting events found dispatching network-vif-plugged-67590aab-15ed-4684-abd7-64a5c0a9b3f5 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:18:08 user nova-compute[75165]: WARNING nova.compute.manager [req-88eb2c31-a4d1-4bc2-9aad-908f3ff30338 req-f6d47e24-e1c9-4ee1-ac75-c89059b13eb1 service nova] [instance: 91fe894a-90a8-4545-9b27-91771554c4cb] Received unexpected event network-vif-plugged-67590aab-15ed-4684-abd7-64a5c0a9b3f5 for instance with vm_state active and task_state rescuing.
Oct 26 00:18:08 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:18:08 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:18:08 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:18:08 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:18:08 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:18:08 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:18:08 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75165) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 00:18:09 user nova-compute[75165]: DEBUG nova.compute.manager [None req-b285a1b9-374b-487b-b9ea-d2d6d1b9b2c3 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: 91fe894a-90a8-4545-9b27-91771554c4cb] Checking state {{(pid=75165) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 00:18:09 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:18:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84c6b624-648b-40e2-a37e-ff08609bad84/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:18:10 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84c6b624-648b-40e2-a37e-ff08609bad84/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:18:10 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84c6b624-648b-40e2-a37e-ff08609bad84/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:18:10 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84c6b624-648b-40e2-a37e-ff08609bad84/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:18:10 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7eeb145-1565-4812-818b-fefda5f2436d/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:18:10 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7eeb145-1565-4812-818b-fefda5f2436d/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:18:10 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7eeb145-1565-4812-818b-fefda5f2436d/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:18:10 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7eeb145-1565-4812-818b-fefda5f2436d/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:18:10 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6558510-6f87-4ef3-b707-f1fa78bf61e8/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:18:10 user nova-compute[75165]: DEBUG nova.compute.manager [req-5378840b-1b1f-49df-806c-648de9ec9d15 req-b935264f-3610-4e3f-a5eb-58193148732a service nova] [instance: 91fe894a-90a8-4545-9b27-91771554c4cb] Received event network-vif-plugged-67590aab-15ed-4684-abd7-64a5c0a9b3f5 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:18:10 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-5378840b-1b1f-49df-806c-648de9ec9d15 req-b935264f-3610-4e3f-a5eb-58193148732a service nova] Acquiring lock "91fe894a-90a8-4545-9b27-91771554c4cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:18:10 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-5378840b-1b1f-49df-806c-648de9ec9d15 req-b935264f-3610-4e3f-a5eb-58193148732a service nova] Lock "91fe894a-90a8-4545-9b27-91771554c4cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:18:10 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-5378840b-1b1f-49df-806c-648de9ec9d15 req-b935264f-3610-4e3f-a5eb-58193148732a service nova] Lock "91fe894a-90a8-4545-9b27-91771554c4cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:18:10 user nova-compute[75165]: DEBUG nova.compute.manager [req-5378840b-1b1f-49df-806c-648de9ec9d15 req-b935264f-3610-4e3f-a5eb-58193148732a service nova] [instance: 91fe894a-90a8-4545-9b27-91771554c4cb] No waiting events found dispatching network-vif-plugged-67590aab-15ed-4684-abd7-64a5c0a9b3f5 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:18:10 user nova-compute[75165]: WARNING nova.compute.manager [req-5378840b-1b1f-49df-806c-648de9ec9d15 req-b935264f-3610-4e3f-a5eb-58193148732a service nova] [instance: 91fe894a-90a8-4545-9b27-91771554c4cb] Received unexpected event network-vif-plugged-67590aab-15ed-4684-abd7-64a5c0a9b3f5 for instance with vm_state rescued and task_state None.
Oct 26 00:18:10 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6558510-6f87-4ef3-b707-f1fa78bf61e8/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:18:10 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6558510-6f87-4ef3-b707-f1fa78bf61e8/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:18:10 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:18:11 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:18:11 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6558510-6f87-4ef3-b707-f1fa78bf61e8/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:18:11 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3150d249-37a2-49c6-837a-3828480fa2b4/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:18:11 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3150d249-37a2-49c6-837a-3828480fa2b4/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:18:11 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3150d249-37a2-49c6-837a-3828480fa2b4/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:18:11 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-22674851-2f66-486a-b277-980e0ec233a6 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Acquiring lock "97fb67a7-637d-456f-b4dd-0a271ed6cfc4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:18:11 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-22674851-2f66-486a-b277-980e0ec233a6 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Lock "97fb67a7-637d-456f-b4dd-0a271ed6cfc4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:18:11 user nova-compute[75165]: DEBUG nova.compute.manager [None req-22674851-2f66-486a-b277-980e0ec233a6 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: 97fb67a7-637d-456f-b4dd-0a271ed6cfc4] Starting instance... {{(pid=75165) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 00:18:11 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3150d249-37a2-49c6-837a-3828480fa2b4/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:18:11 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e44bfc-6a68-46ce-8335-aaaba5160d3e/disk.rescue --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:18:11 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-22674851-2f66-486a-b277-980e0ec233a6 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:18:11 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-22674851-2f66-486a-b277-980e0ec233a6 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:18:11 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-22674851-2f66-486a-b277-980e0ec233a6 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75165) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 00:18:11 user nova-compute[75165]: INFO nova.compute.claims [None req-22674851-2f66-486a-b277-980e0ec233a6 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: 97fb67a7-637d-456f-b4dd-0a271ed6cfc4] Claim successful on node user
Oct 26 00:18:11 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e44bfc-6a68-46ce-8335-aaaba5160d3e/disk.rescue --force-share --output=json" returned: 0 in 0.245s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:18:11 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e44bfc-6a68-46ce-8335-aaaba5160d3e/disk.rescue --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:18:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e44bfc-6a68-46ce-8335-aaaba5160d3e/disk.rescue --force-share --output=json" returned: 0 in 0.224s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:18:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e44bfc-6a68-46ce-8335-aaaba5160d3e/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:18:12 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-dc856ec5-3b8e-445d-bd39-14981c065951 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] Acquiring lock "b6558510-6f87-4ef3-b707-f1fa78bf61e8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:18:12 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-dc856ec5-3b8e-445d-bd39-14981c065951 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] Lock "b6558510-6f87-4ef3-b707-f1fa78bf61e8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:18:12 user nova-compute[75165]: DEBUG nova.objects.instance [None req-dc856ec5-3b8e-445d-bd39-14981c065951 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] Lazy-loading 'flavor' on Instance uuid b6558510-6f87-4ef3-b707-f1fa78bf61e8 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:18:12 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-dc856ec5-3b8e-445d-bd39-14981c065951 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] Lock "b6558510-6f87-4ef3-b707-f1fa78bf61e8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:18:12 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-22674851-2f66-486a-b277-980e0ec233a6 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:18:12 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-22674851-2f66-486a-b277-980e0ec233a6 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:18:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e44bfc-6a68-46ce-8335-aaaba5160d3e/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:18:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e44bfc-6a68-46ce-8335-aaaba5160d3e/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:18:12 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-22674851-2f66-486a-b277-980e0ec233a6 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.568s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:18:12 user nova-compute[75165]: DEBUG nova.compute.manager [None req-22674851-2f66-486a-b277-980e0ec233a6 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: 97fb67a7-637d-456f-b4dd-0a271ed6cfc4] Start building networks asynchronously for instance. {{(pid=75165) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 00:18:12 user nova-compute[75165]: DEBUG nova.compute.manager [None req-22674851-2f66-486a-b277-980e0ec233a6 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: 97fb67a7-637d-456f-b4dd-0a271ed6cfc4] Allocating IP information in the background. {{(pid=75165) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 00:18:12 user nova-compute[75165]: DEBUG nova.network.neutron [None req-22674851-2f66-486a-b277-980e0ec233a6 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: 97fb67a7-637d-456f-b4dd-0a271ed6cfc4] allocate_for_instance() {{(pid=75165) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 00:18:12 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-dc856ec5-3b8e-445d-bd39-14981c065951 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] Acquiring lock "b6558510-6f87-4ef3-b707-f1fa78bf61e8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:18:12 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-dc856ec5-3b8e-445d-bd39-14981c065951 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] Lock "b6558510-6f87-4ef3-b707-f1fa78bf61e8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:18:12 user nova-compute[75165]: INFO nova.compute.manager [None req-dc856ec5-3b8e-445d-bd39-14981c065951 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] [instance: b6558510-6f87-4ef3-b707-f1fa78bf61e8] Attaching volume 6c0013a0-b960-49c6-8287-75b4c373e0a3 to /dev/vdb
Oct 26 00:18:12 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-22674851-2f66-486a-b277-980e0ec233a6 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: 97fb67a7-637d-456f-b4dd-0a271ed6cfc4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 00:18:12 user nova-compute[75165]: DEBUG nova.compute.manager [None req-22674851-2f66-486a-b277-980e0ec233a6 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: 97fb67a7-637d-456f-b4dd-0a271ed6cfc4] Start building block device mappings for instance. {{(pid=75165) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 00:18:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e44bfc-6a68-46ce-8335-aaaba5160d3e/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:18:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27fa1771-fb69-49da-81b3-7f112e623170/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:18:12 user nova-compute[75165]: DEBUG nova.policy [None req-22674851-2f66-486a-b277-980e0ec233a6 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'dbe0d52293264f33ae86de41dabeefcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd616862c7c184de5b0ba3121552c5666', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75165) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 00:18:12 user nova-compute[75165]: DEBUG os_brick.utils [None req-dc856ec5-3b8e-445d-bd39-14981c065951 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:18:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:18:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:18:12 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[b297c875-2680-4205-957a-7ed663f040fe]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa94814ccb35\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:18:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:18:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:18:12 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[659639fa-5dae-4c11-9c7c-d0976b1bc8fd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:18:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:18:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:18:12 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d8e4704-983c-495d-8ed0-6cd025c8aa19]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:18:12 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ddd13a3-de51-463a-9ff7-0b3e9a442874]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:18:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-dc856ec5-3b8e-445d-bd39-14981c065951 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] Running cmd (subprocess): nvme version {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:18:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-dc856ec5-3b8e-445d-bd39-14981c065951 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] 'nvme version' failed. Not Retrying. {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 00:18:12 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dc856ec5-3b8e-445d-bd39-14981c065951 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] nvme not present on system {{(pid=75165) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 00:18:12 user nova-compute[75165]: DEBUG nova.compute.manager [None req-22674851-2f66-486a-b277-980e0ec233a6 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: 97fb67a7-637d-456f-b4dd-0a271ed6cfc4] Start spawning the instance on the hypervisor. {{(pid=75165) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 00:18:12 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-22674851-2f66-486a-b277-980e0ec233a6 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: 97fb67a7-637d-456f-b4dd-0a271ed6cfc4] Creating instance directory {{(pid=75165) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 00:18:12 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-22674851-2f66-486a-b277-980e0ec233a6 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: 97fb67a7-637d-456f-b4dd-0a271ed6cfc4] Creating image(s)
Oct 26 00:18:12 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-22674851-2f66-486a-b277-980e0ec233a6 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Acquiring lock "/opt/stack/data/nova/instances/97fb67a7-637d-456f-b4dd-0a271ed6cfc4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:18:12 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-22674851-2f66-486a-b277-980e0ec233a6 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Lock "/opt/stack/data/nova/instances/97fb67a7-637d-456f-b4dd-0a271ed6cfc4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:18:12 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-22674851-2f66-486a-b277-980e0ec233a6 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Lock "/opt/stack/data/nova/instances/97fb67a7-637d-456f-b4dd-0a271ed6cfc4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:18:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:18:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 00:18:12 user nova-compute[75165]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 00:18:12 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[7695d510-b3d9-46cf-aa6b-d80781ad5606]: (4, '') {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:18:12 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-dc856ec5-3b8e-445d-bd39-14981c065951 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75165) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 00:18:12 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-dc856ec5-3b8e-445d-bd39-14981c065951 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75165) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 00:18:12 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-dc856ec5-3b8e-445d-bd39-14981c065951 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] LIGHTOS: no hostnqn found. {{(pid=75165) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 00:18:12 user nova-compute[75165]: DEBUG os_brick.utils [None req-dc856ec5-3b8e-445d-bd39-14981c065951 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa94814ccb35', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:18:12 user nova-compute[75165]: DEBUG nova.virt.block_device [None req-dc856ec5-3b8e-445d-bd39-14981c065951 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] [instance: b6558510-6f87-4ef3-b707-f1fa78bf61e8] Updating existing volume attachment record: 0875a144-4787-45f5-964a-4c03158f84a5 {{(pid=75165) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 00:18:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27fa1771-fb69-49da-81b3-7f112e623170/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:18:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-22674851-2f66-486a-b277-980e0ec233a6 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:18:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27fa1771-fb69-49da-81b3-7f112e623170/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:18:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-22674851-2f66-486a-b277-980e0ec233a6 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json" returned: 0 in 0.192s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:18:12 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-22674851-2f66-486a-b277-980e0ec233a6 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Acquiring lock "7d3243421cf3fdc288b758f687a93103b7b95466" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:18:12 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-22674851-2f66-486a-b277-980e0ec233a6 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Lock "7d3243421cf3fdc288b758f687a93103b7b95466" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:18:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-22674851-2f66-486a-b277-980e0ec233a6 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:18:13 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27fa1771-fb69-49da-81b3-7f112e623170/disk --force-share --output=json" returned: 0 in 0.265s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:18:13 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75165) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 00:18:13 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91fe894a-90a8-4545-9b27-91771554c4cb/disk.rescue --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:18:13 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-22674851-2f66-486a-b277-980e0ec233a6 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json" returned: 0 in 0.235s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:18:13 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-22674851-2f66-486a-b277-980e0ec233a6 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466,backing_fmt=raw /opt/stack/data/nova/instances/97fb67a7-637d-456f-b4dd-0a271ed6cfc4/disk 1073741824 {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:18:13 user nova-compute[75165]: DEBUG nova.network.neutron [None req-22674851-2f66-486a-b277-980e0ec233a6 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: 97fb67a7-637d-456f-b4dd-0a271ed6cfc4] Successfully created port: 254ea53c-6da9-46d5-a139-7926008cdf8b {{(pid=75165) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 00:18:13 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-22674851-2f66-486a-b277-980e0ec233a6 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466,backing_fmt=raw /opt/stack/data/nova/instances/97fb67a7-637d-456f-b4dd-0a271ed6cfc4/disk 1073741824" returned: 0 in 0.061s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:18:13 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-22674851-2f66-486a-b277-980e0ec233a6 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Lock "7d3243421cf3fdc288b758f687a93103b7b95466" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.303s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:18:13 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-22674851-2f66-486a-b277-980e0ec233a6 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:18:13 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91fe894a-90a8-4545-9b27-91771554c4cb/disk.rescue --force-share --output=json" returned: 0 in 0.222s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:18:13 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91fe894a-90a8-4545-9b27-91771554c4cb/disk.rescue --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:18:13 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-22674851-2f66-486a-b277-980e0ec233a6 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json" returned: 0 in 0.224s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:18:13 user nova-compute[75165]: DEBUG nova.virt.disk.api [None req-22674851-2f66-486a-b277-980e0ec233a6 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Checking if we can resize image /opt/stack/data/nova/instances/97fb67a7-637d-456f-b4dd-0a271ed6cfc4/disk. size=1073741824 {{(pid=75165) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 00:18:13 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-22674851-2f66-486a-b277-980e0ec233a6 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97fb67a7-637d-456f-b4dd-0a271ed6cfc4/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:18:13 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91fe894a-90a8-4545-9b27-91771554c4cb/disk.rescue --force-share --output=json" returned: 0 in 0.222s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:18:13 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] skipping disk /opt/stack/data/nova/instances/91fe894a-90a8-4545-9b27-91771554c4cb/disk (vdb) as it is a volume {{(pid=75165) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 00:18:14 user nova-compute[75165]: DEBUG nova.network.neutron [None req-22674851-2f66-486a-b277-980e0ec233a6 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: 97fb67a7-637d-456f-b4dd-0a271ed6cfc4] Successfully updated port: 254ea53c-6da9-46d5-a139-7926008cdf8b {{(pid=75165) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 00:18:14 user nova-compute[75165]: DEBUG nova.compute.manager [req-cc7dd48c-fb71-46b6-a404-4c11721dd68e req-f84baf27-6952-442e-8848-289cb6d878e3 service nova] [instance: 97fb67a7-637d-456f-b4dd-0a271ed6cfc4] Received event network-changed-254ea53c-6da9-46d5-a139-7926008cdf8b {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:18:14 user nova-compute[75165]: DEBUG nova.compute.manager [req-cc7dd48c-fb71-46b6-a404-4c11721dd68e req-f84baf27-6952-442e-8848-289cb6d878e3 service nova] [instance: 97fb67a7-637d-456f-b4dd-0a271ed6cfc4] Refreshing instance network info cache due to event network-changed-254ea53c-6da9-46d5-a139-7926008cdf8b. {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 00:18:14 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-cc7dd48c-fb71-46b6-a404-4c11721dd68e req-f84baf27-6952-442e-8848-289cb6d878e3 service nova] Acquiring lock "refresh_cache-97fb67a7-637d-456f-b4dd-0a271ed6cfc4" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:18:14 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-cc7dd48c-fb71-46b6-a404-4c11721dd68e req-f84baf27-6952-442e-8848-289cb6d878e3 service nova] Acquired lock "refresh_cache-97fb67a7-637d-456f-b4dd-0a271ed6cfc4" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:18:14 user nova-compute[75165]: DEBUG nova.network.neutron [req-cc7dd48c-fb71-46b6-a404-4c11721dd68e req-f84baf27-6952-442e-8848-289cb6d878e3 service nova] [instance: 97fb67a7-637d-456f-b4dd-0a271ed6cfc4] Refreshing network info cache for port 254ea53c-6da9-46d5-a139-7926008cdf8b {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 00:18:14 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-22674851-2f66-486a-b277-980e0ec233a6 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97fb67a7-637d-456f-b4dd-0a271ed6cfc4/disk --force-share --output=json" returned: 0 in 0.653s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:18:14 user nova-compute[75165]: DEBUG nova.virt.disk.api [None req-22674851-2f66-486a-b277-980e0ec233a6 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Cannot resize image /opt/stack/data/nova/instances/97fb67a7-637d-456f-b4dd-0a271ed6cfc4/disk to a smaller size. {{(pid=75165) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 00:18:14 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-22674851-2f66-486a-b277-980e0ec233a6 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: 97fb67a7-637d-456f-b4dd-0a271ed6cfc4] Created local disks {{(pid=75165) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 00:18:14 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-22674851-2f66-486a-b277-980e0ec233a6 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: 97fb67a7-637d-456f-b4dd-0a271ed6cfc4] Ensure instance console log exists: /opt/stack/data/nova/instances/97fb67a7-637d-456f-b4dd-0a271ed6cfc4/console.log {{(pid=75165) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 00:18:14 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-22674851-2f66-486a-b277-980e0ec233a6 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:18:14 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-22674851-2f66-486a-b277-980e0ec233a6 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:18:14 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-22674851-2f66-486a-b277-980e0ec233a6 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:18:14 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:18:14 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:18:14 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Hypervisor/Node resource view: name=user free_ram=8171MB free_disk=25.055824279785156GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75165) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 00:18:14 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:18:14 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:18:14 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-22674851-2f66-486a-b277-980e0ec233a6 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Acquiring lock "refresh_cache-97fb67a7-637d-456f-b4dd-0a271ed6cfc4" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:18:14 user nova-compute[75165]: DEBUG nova.network.neutron [req-cc7dd48c-fb71-46b6-a404-4c11721dd68e req-f84baf27-6952-442e-8848-289cb6d878e3 service nova] [instance: 97fb67a7-637d-456f-b4dd-0a271ed6cfc4] Instance cache missing network info. {{(pid=75165) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 00:18:14 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 84c6b624-648b-40e2-a37e-ff08609bad84 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:18:14 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance c4e44bfc-6a68-46ce-8335-aaaba5160d3e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:18:14 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance a7eeb145-1565-4812-818b-fefda5f2436d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:18:14 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 3150d249-37a2-49c6-837a-3828480fa2b4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:18:14 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 27fa1771-fb69-49da-81b3-7f112e623170 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:18:14 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 91fe894a-90a8-4545-9b27-91771554c4cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:18:14 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance b6558510-6f87-4ef3-b707-f1fa78bf61e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:18:14 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 97fb67a7-637d-456f-b4dd-0a271ed6cfc4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:18:14 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75165) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 00:18:14 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75165) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 00:18:14 user nova-compute[75165]: DEBUG nova.network.neutron [req-cc7dd48c-fb71-46b6-a404-4c11721dd68e req-f84baf27-6952-442e-8848-289cb6d878e3 service nova] [instance: 97fb67a7-637d-456f-b4dd-0a271ed6cfc4] Updating instance_info_cache with network_info: [] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:18:14 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-cc7dd48c-fb71-46b6-a404-4c11721dd68e req-f84baf27-6952-442e-8848-289cb6d878e3 service nova] Releasing lock "refresh_cache-97fb67a7-637d-456f-b4dd-0a271ed6cfc4" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:18:14 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-22674851-2f66-486a-b277-980e0ec233a6 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Acquired lock "refresh_cache-97fb67a7-637d-456f-b4dd-0a271ed6cfc4" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:18:14 user nova-compute[75165]: DEBUG nova.network.neutron [None req-22674851-2f66-486a-b277-980e0ec233a6 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: 97fb67a7-637d-456f-b4dd-0a271ed6cfc4] Building network info cache for instance {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 00:18:14 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Refreshing inventories for resource provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 26 00:18:14 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Updating ProviderTree inventory for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 26 00:18:14 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Updating inventory in ProviderTree for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 26 00:18:14 user nova-compute[75165]: DEBUG nova.network.neutron [None req-22674851-2f66-486a-b277-980e0ec233a6 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: 97fb67a7-637d-456f-b4dd-0a271ed6cfc4] Instance cache missing network info. {{(pid=75165) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 00:18:14 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Refreshing aggregate associations for resource provider 03214fd5-21d1-46ec-b6b0-6449b77ba230, aggregates: None {{(pid=75165) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 26 00:18:14 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Refreshing trait associations for resource provider 03214fd5-21d1-46ec-b6b0-6449b77ba230, traits: COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NODE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_TRUSTED_CERTS,COMPUTE_DEVICE_TAGGING,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO {{(pid=75165) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 26 00:18:14 user nova-compute[75165]: DEBUG nova.network.neutron [None req-22674851-2f66-486a-b277-980e0ec233a6 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: 97fb67a7-637d-456f-b4dd-0a271ed6cfc4] Updating instance_info_cache with network_info: [{"id": "254ea53c-6da9-46d5-a139-7926008cdf8b", "address": "fa:16:3e:08:21:2a", "network": {"id": "eb55c0bc-cae5-4ba3-851a-e31a50b52c88", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1081223830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d616862c7c184de5b0ba3121552c5666", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap254ea53c-6d", "ovs_interfaceid": "254ea53c-6da9-46d5-a139-7926008cdf8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:18:14 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-22674851-2f66-486a-b277-980e0ec233a6 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Releasing lock "refresh_cache-97fb67a7-637d-456f-b4dd-0a271ed6cfc4" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:18:14 user nova-compute[75165]: DEBUG nova.compute.manager [None req-22674851-2f66-486a-b277-980e0ec233a6 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: 97fb67a7-637d-456f-b4dd-0a271ed6cfc4] Instance network_info: |[{"id": "254ea53c-6da9-46d5-a139-7926008cdf8b", "address": "fa:16:3e:08:21:2a", "network": {"id": "eb55c0bc-cae5-4ba3-851a-e31a50b52c88", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1081223830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d616862c7c184de5b0ba3121552c5666", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap254ea53c-6d", "ovs_interfaceid": "254ea53c-6da9-46d5-a139-7926008cdf8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75165) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 00:18:14 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-22674851-2f66-486a-b277-980e0ec233a6 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: 97fb67a7-637d-456f-b4dd-0a271ed6cfc4] Start _get_guest_xml network_info=[{"id": "254ea53c-6da9-46d5-a139-7926008cdf8b", "address": "fa:16:3e:08:21:2a", "network": {"id": "eb55c0bc-cae5-4ba3-851a-e31a50b52c88", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1081223830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d616862c7c184de5b0ba3121552c5666", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap254ea53c-6d", "ovs_interfaceid": "254ea53c-6da9-46d5-a139-7926008cdf8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T00:03:24Z,direct_url=<?>,disk_format='qcow2',id=bff0d8a1-739e-4c4d-9efa-b73ba7b76d01,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e56bbf444fd34c348475c73673611447',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T00:03:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'size': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': 'bff0d8a1-739e-4c4d-9efa-b73ba7b76d01'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75165) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 00:18:14 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-22674851-2f66-486a-b277-980e0ec233a6 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:18:14 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-22674851-2f66-486a-b277-980e0ec233a6 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:18:14 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-22674851-2f66-486a-b277-980e0ec233a6 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75165) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 00:18:14 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-22674851-2f66-486a-b277-980e0ec233a6 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] CPU controller missing on host. {{(pid=75165) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 00:18:14 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-22674851-2f66-486a-b277-980e0ec233a6 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75165) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 00:18:14 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-22674851-2f66-486a-b277-980e0ec233a6 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] CPU controller found on host. {{(pid=75165) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 00:18:14 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-22674851-2f66-486a-b277-980e0ec233a6 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75165) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 00:18:14 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-22674851-2f66-486a-b277-980e0ec233a6 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T00:03:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T00:03:24Z,direct_url=<?>,disk_format='qcow2',id=bff0d8a1-739e-4c4d-9efa-b73ba7b76d01,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e56bbf444fd34c348475c73673611447',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T00:03:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 00:18:14 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-22674851-2f66-486a-b277-980e0ec233a6 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Flavor limits 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 00:18:14 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-22674851-2f66-486a-b277-980e0ec233a6 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Image limits 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 00:18:14 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-22674851-2f66-486a-b277-980e0ec233a6 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Flavor pref 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 00:18:14 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-22674851-2f66-486a-b277-980e0ec233a6 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Image pref 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 00:18:14 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-22674851-2f66-486a-b277-980e0ec233a6 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 00:18:14 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-22674851-2f66-486a-b277-980e0ec233a6 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 00:18:14 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-22674851-2f66-486a-b277-980e0ec233a6 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75165) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 00:18:14 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-22674851-2f66-486a-b277-980e0ec233a6 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Got 1 possible topologies {{(pid=75165) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 00:18:14 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-22674851-2f66-486a-b277-980e0ec233a6 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 00:18:14 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-22674851-2f66-486a-b277-980e0ec233a6 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 00:18:14 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-22674851-2f66-486a-b277-980e0ec233a6 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:18:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-326837151',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-326837151',id=25,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d616862c7c184de5b0ba3121552c5666',ramdisk_id='',reservation_id='r-0cxh099s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-638746030',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T00:18:13Z,user_data=None,user_id='dbe0d52293264f33ae86de41dabeefcf',uuid=97fb67a7-637d-456f-b4dd-0a271ed6cfc4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "254ea53c-6da9-46d5-a139-7926008cdf8b", "address": "fa:16:3e:08:21:2a", "network": {"id": "eb55c0bc-cae5-4ba3-851a-e31a50b52c88", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1081223830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d616862c7c184de5b0ba3121552c5666", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap254ea53c-6d", "ovs_interfaceid": "254ea53c-6da9-46d5-a139-7926008cdf8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75165) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 00:18:14 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-22674851-2f66-486a-b277-980e0ec233a6 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Converting VIF {"id": "254ea53c-6da9-46d5-a139-7926008cdf8b", "address": "fa:16:3e:08:21:2a", "network": {"id": "eb55c0bc-cae5-4ba3-851a-e31a50b52c88", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1081223830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d616862c7c184de5b0ba3121552c5666", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap254ea53c-6d", "ovs_interfaceid": "254ea53c-6da9-46d5-a139-7926008cdf8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:18:14 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-22674851-2f66-486a-b277-980e0ec233a6 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:21:2a,bridge_name='br-int',has_traffic_filtering=True,id=254ea53c-6da9-46d5-a139-7926008cdf8b,network=Network(eb55c0bc-cae5-4ba3-851a-e31a50b52c88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap254ea53c-6d') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:18:14 user nova-compute[75165]: DEBUG nova.objects.instance [None req-22674851-2f66-486a-b277-980e0ec233a6 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Lazy-loading 'pci_devices' on Instance uuid 97fb67a7-637d-456f-b4dd-0a271ed6cfc4 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:18:14 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:18:14 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-22674851-2f66-486a-b277-980e0ec233a6 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: 97fb67a7-637d-456f-b4dd-0a271ed6cfc4] End _get_guest_xml xml=<domain type="kvm">
Oct 26 00:18:14 user nova-compute[75165]:   <uuid>97fb67a7-637d-456f-b4dd-0a271ed6cfc4</uuid>
Oct 26 00:18:14 user nova-compute[75165]:   <name>instance-00000019</name>
Oct 26 00:18:14 user nova-compute[75165]:   <memory>524288</memory>
Oct 26 00:18:14 user nova-compute[75165]:   <vcpu>1</vcpu>
Oct 26 00:18:14 user nova-compute[75165]:   <metadata>
Oct 26 00:18:14 user nova-compute[75165]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 00:18:14 user nova-compute[75165]:       <nova:package version="0.0.0"/>
Oct 26 00:18:14 user nova-compute[75165]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-326837151</nova:name>
Oct 26 00:18:14 user nova-compute[75165]:       <nova:creationTime>2023-10-26 00:18:14</nova:creationTime>
Oct 26 00:18:14 user nova-compute[75165]:       <nova:flavor name="m1.tiny">
Oct 26 00:18:14 user nova-compute[75165]:         <nova:memory>512</nova:memory>
Oct 26 00:18:14 user nova-compute[75165]:         <nova:disk>1</nova:disk>
Oct 26 00:18:14 user nova-compute[75165]:         <nova:swap>0</nova:swap>
Oct 26 00:18:14 user nova-compute[75165]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 00:18:14 user nova-compute[75165]:         <nova:vcpus>1</nova:vcpus>
Oct 26 00:18:14 user nova-compute[75165]:       </nova:flavor>
Oct 26 00:18:14 user nova-compute[75165]:       <nova:owner>
Oct 26 00:18:14 user nova-compute[75165]:         <nova:user uuid="dbe0d52293264f33ae86de41dabeefcf">tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member</nova:user>
Oct 26 00:18:14 user nova-compute[75165]:         <nova:project uuid="d616862c7c184de5b0ba3121552c5666">tempest-ServerBootFromVolumeStableRescueTest-638746030</nova:project>
Oct 26 00:18:14 user nova-compute[75165]:       </nova:owner>
Oct 26 00:18:14 user nova-compute[75165]:       <nova:root type="image" uuid="bff0d8a1-739e-4c4d-9efa-b73ba7b76d01"/>
Oct 26 00:18:14 user nova-compute[75165]:       <nova:ports>
Oct 26 00:18:14 user nova-compute[75165]:         <nova:port uuid="254ea53c-6da9-46d5-a139-7926008cdf8b">
Oct 26 00:18:14 user nova-compute[75165]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 26 00:18:14 user nova-compute[75165]:         </nova:port>
Oct 26 00:18:14 user nova-compute[75165]:       </nova:ports>
Oct 26 00:18:14 user nova-compute[75165]:     </nova:instance>
Oct 26 00:18:14 user nova-compute[75165]:   </metadata>
Oct 26 00:18:14 user nova-compute[75165]:   <sysinfo type="smbios">
Oct 26 00:18:14 user nova-compute[75165]:     <system>
Oct 26 00:18:14 user nova-compute[75165]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 00:18:14 user nova-compute[75165]:       <entry name="product">OpenStack Nova</entry>
Oct 26 00:18:14 user nova-compute[75165]:       <entry name="version">0.0.0</entry>
Oct 26 00:18:14 user nova-compute[75165]:       <entry name="serial">97fb67a7-637d-456f-b4dd-0a271ed6cfc4</entry>
Oct 26 00:18:14 user nova-compute[75165]:       <entry name="uuid">97fb67a7-637d-456f-b4dd-0a271ed6cfc4</entry>
Oct 26 00:18:14 user nova-compute[75165]:       <entry name="family">Virtual Machine</entry>
Oct 26 00:18:14 user nova-compute[75165]:     </system>
Oct 26 00:18:14 user nova-compute[75165]:   </sysinfo>
Oct 26 00:18:14 user nova-compute[75165]:   <os>
Oct 26 00:18:14 user nova-compute[75165]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 00:18:14 user nova-compute[75165]:     <boot dev="hd"/>
Oct 26 00:18:14 user nova-compute[75165]:     <smbios mode="sysinfo"/>
Oct 26 00:18:14 user nova-compute[75165]:   </os>
Oct 26 00:18:14 user nova-compute[75165]:   <features>
Oct 26 00:18:14 user nova-compute[75165]:     <acpi/>
Oct 26 00:18:14 user nova-compute[75165]:     <apic/>
Oct 26 00:18:14 user nova-compute[75165]:     <vmcoreinfo/>
Oct 26 00:18:14 user nova-compute[75165]:   </features>
Oct 26 00:18:14 user nova-compute[75165]:   <clock offset="utc">
Oct 26 00:18:14 user nova-compute[75165]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 00:18:14 user nova-compute[75165]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 00:18:14 user nova-compute[75165]:     <timer name="hpet" present="no"/>
Oct 26 00:18:14 user nova-compute[75165]:   </clock>
Oct 26 00:18:14 user nova-compute[75165]:   <cpu mode="custom" match="exact">
Oct 26 00:18:14 user nova-compute[75165]:     <model>Nehalem</model>
Oct 26 00:18:14 user nova-compute[75165]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 00:18:14 user nova-compute[75165]:   </cpu>
Oct 26 00:18:14 user nova-compute[75165]:   <devices>
Oct 26 00:18:14 user nova-compute[75165]:     <disk type="file" device="disk">
Oct 26 00:18:14 user nova-compute[75165]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 00:18:14 user nova-compute[75165]:       <source file="/opt/stack/data/nova/instances/97fb67a7-637d-456f-b4dd-0a271ed6cfc4/disk"/>
Oct 26 00:18:14 user nova-compute[75165]:       <target dev="vda" bus="virtio"/>
Oct 26 00:18:14 user nova-compute[75165]:     </disk>
Oct 26 00:18:14 user nova-compute[75165]:     <interface type="ethernet">
Oct 26 00:18:14 user nova-compute[75165]:       <mac address="fa:16:3e:08:21:2a"/>
Oct 26 00:18:14 user nova-compute[75165]:       <model type="virtio"/>
Oct 26 00:18:14 user nova-compute[75165]:       <mtu size="1442"/>
Oct 26 00:18:14 user nova-compute[75165]:       <target dev="tap254ea53c-6d"/>
Oct 26 00:18:14 user nova-compute[75165]:     </interface>
Oct 26 00:18:14 user nova-compute[75165]:     <serial type="pty">
Oct 26 00:18:14 user nova-compute[75165]:       <log file="/opt/stack/data/nova/instances/97fb67a7-637d-456f-b4dd-0a271ed6cfc4/console.log" append="off"/>
Oct 26 00:18:14 user nova-compute[75165]:     </serial>
Oct 26 00:18:14 user nova-compute[75165]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 00:18:14 user nova-compute[75165]:     <video>
Oct 26 00:18:14 user nova-compute[75165]:       <model type="virtio"/>
Oct 26 00:18:14 user nova-compute[75165]:     </video>
Oct 26 00:18:14 user nova-compute[75165]:     <rng model="virtio">
Oct 26 00:18:14 user nova-compute[75165]:       <backend model="random">/dev/urandom</backend>
Oct 26 00:18:14 user nova-compute[75165]:     </rng>
Oct 26 00:18:14 user nova-compute[75165]:     <controller type="usb" index="0" model="none"/>
Oct 26 00:18:14 user nova-compute[75165]:     <memballoon model="virtio">
Oct 26 00:18:14 user nova-compute[75165]:       <stats period="10"/>
Oct 26 00:18:14 user nova-compute[75165]:     </memballoon>
Oct 26 00:18:14 user nova-compute[75165]:   </devices>
Oct 26 00:18:14 user nova-compute[75165]: </domain>
Oct 26 00:18:14 user nova-compute[75165]:  {{(pid=75165) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 00:18:14 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-22674851-2f66-486a-b277-980e0ec233a6 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:18:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-326837151',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-326837151',id=25,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d616862c7c184de5b0ba3121552c5666',ramdisk_id='',reservation_id='r-0cxh099s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-638746030',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T00:18:13Z,user_data=None,user_id='dbe0d52293264f33ae86de41dabeefcf',uuid=97fb67a7-637d-456f-b4dd-0a271ed6cfc4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "254ea53c-6da9-46d5-a139-7926008cdf8b", "address": "fa:16:3e:08:21:2a", "network": {"id": "eb55c0bc-cae5-4ba3-851a-e31a50b52c88", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1081223830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d616862c7c184de5b0ba3121552c5666", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap254ea53c-6d", "ovs_interfaceid": "254ea53c-6da9-46d5-a139-7926008cdf8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 00:18:14 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-22674851-2f66-486a-b277-980e0ec233a6 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Converting VIF {"id": "254ea53c-6da9-46d5-a139-7926008cdf8b", "address": "fa:16:3e:08:21:2a", "network": {"id": "eb55c0bc-cae5-4ba3-851a-e31a50b52c88", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1081223830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d616862c7c184de5b0ba3121552c5666", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap254ea53c-6d", "ovs_interfaceid": "254ea53c-6da9-46d5-a139-7926008cdf8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:18:14 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-22674851-2f66-486a-b277-980e0ec233a6 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:21:2a,bridge_name='br-int',has_traffic_filtering=True,id=254ea53c-6da9-46d5-a139-7926008cdf8b,network=Network(eb55c0bc-cae5-4ba3-851a-e31a50b52c88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap254ea53c-6d') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:18:14 user nova-compute[75165]: DEBUG os_vif [None req-22674851-2f66-486a-b277-980e0ec233a6 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:21:2a,bridge_name='br-int',has_traffic_filtering=True,id=254ea53c-6da9-46d5-a139-7926008cdf8b,network=Network(eb55c0bc-cae5-4ba3-851a-e31a50b52c88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap254ea53c-6d') {{(pid=75165) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 00:18:14 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:18:14 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:18:14 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 00:18:14 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:18:14 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b2103e37-5005-55d8-9fd5-966b463f6789', '_type': 'linux-noop'}}, row=False) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:18:14 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:18:14 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:18:14 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:18:14 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:18:14 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap254ea53c-6d, may_exist=True, interface_attrs={}) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:18:14 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap254ea53c-6d, col_values=(('qos', UUID('4f77dd52-16d3-4471-984e-d41de7edd093')),), if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:18:14 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap254ea53c-6d, col_values=(('external_ids', {'iface-id': '254ea53c-6da9-46d5-a139-7926008cdf8b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:08:21:2a', 'vm-uuid': '97fb67a7-637d-456f-b4dd-0a271ed6cfc4'}),), if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:18:14 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:18:14 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:18:14 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Compute_service record updated for user:user {{(pid=75165) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 00:18:14 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.800s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:18:14 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:18:14 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:18:14 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Cleaning up deleted instances {{(pid=75165) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 26 00:18:14 user nova-compute[75165]: INFO os_vif [None req-22674851-2f66-486a-b277-980e0ec233a6 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:21:2a,bridge_name='br-int',has_traffic_filtering=True,id=254ea53c-6da9-46d5-a139-7926008cdf8b,network=Network(eb55c0bc-cae5-4ba3-851a-e31a50b52c88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap254ea53c-6d')
Oct 26 00:18:14 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] There are 0 instances to clean {{(pid=75165) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 26 00:18:14 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:18:14 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75165) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 26 00:18:15 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-22674851-2f66-486a-b277-980e0ec233a6 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] No BDM found with device name vda, not building metadata. {{(pid=75165) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 00:18:15 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-22674851-2f66-486a-b277-980e0ec233a6 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] No VIF found with MAC fa:16:3e:08:21:2a, not building metadata {{(pid=75165) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 00:18:16 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:18:16 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:18:16 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:18:16 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:18:16 user nova-compute[75165]: DEBUG nova.compute.manager [req-142014ee-749b-4c86-b7fe-88d9dac2e0de req-3387fb3f-85f1-4674-bb78-06bd027fca53 service nova] [instance: 97fb67a7-637d-456f-b4dd-0a271ed6cfc4] Received event network-vif-plugged-254ea53c-6da9-46d5-a139-7926008cdf8b {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:18:16 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-142014ee-749b-4c86-b7fe-88d9dac2e0de req-3387fb3f-85f1-4674-bb78-06bd027fca53 service nova] Acquiring lock "97fb67a7-637d-456f-b4dd-0a271ed6cfc4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:18:16 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-142014ee-749b-4c86-b7fe-88d9dac2e0de req-3387fb3f-85f1-4674-bb78-06bd027fca53 service nova] Lock "97fb67a7-637d-456f-b4dd-0a271ed6cfc4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:18:16 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-142014ee-749b-4c86-b7fe-88d9dac2e0de req-3387fb3f-85f1-4674-bb78-06bd027fca53 service nova] Lock "97fb67a7-637d-456f-b4dd-0a271ed6cfc4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:18:16 user nova-compute[75165]: DEBUG nova.compute.manager [req-142014ee-749b-4c86-b7fe-88d9dac2e0de req-3387fb3f-85f1-4674-bb78-06bd027fca53 service nova] [instance: 97fb67a7-637d-456f-b4dd-0a271ed6cfc4] No waiting events found dispatching network-vif-plugged-254ea53c-6da9-46d5-a139-7926008cdf8b {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:18:16 user nova-compute[75165]: WARNING nova.compute.manager [req-142014ee-749b-4c86-b7fe-88d9dac2e0de req-3387fb3f-85f1-4674-bb78-06bd027fca53 service nova] [instance: 97fb67a7-637d-456f-b4dd-0a271ed6cfc4] Received unexpected event network-vif-plugged-254ea53c-6da9-46d5-a139-7926008cdf8b for instance with vm_state building and task_state spawning.
Oct 26 00:18:16 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:18:16 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Starting heal instance info cache {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 00:18:17 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "refresh_cache-a7eeb145-1565-4812-818b-fefda5f2436d" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:18:17 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquired lock "refresh_cache-a7eeb145-1565-4812-818b-fefda5f2436d" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:18:17 user nova-compute[75165]: DEBUG nova.network.neutron [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: a7eeb145-1565-4812-818b-fefda5f2436d] Forcefully refreshing network info cache for instance {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 00:18:17 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:18:17 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:18:17 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:18:17 user nova-compute[75165]: DEBUG nova.network.neutron [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: a7eeb145-1565-4812-818b-fefda5f2436d] Updating instance_info_cache with network_info: [{"id": "7a43d085-a683-4c49-a7c8-13b8f35c943d", "address": "fa:16:3e:e8:63:41", "network": {"id": "bd1c84f9-bba9-4a23-8bf2-17e65022136a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1557945804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2911497df44047d9a9ee36a5652298bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a43d085-a6", "ovs_interfaceid": "7a43d085-a683-4c49-a7c8-13b8f35c943d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:18:17 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Releasing lock "refresh_cache-a7eeb145-1565-4812-818b-fefda5f2436d" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:18:17 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: a7eeb145-1565-4812-818b-fefda5f2436d] Updated the network info_cache for instance {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 00:18:17 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:18:18 user nova-compute[75165]: DEBUG nova.compute.manager [req-2cd24ea1-bbfd-445c-9971-2141d6e4565a req-5ebca1e1-1f77-4ef2-96c0-0f6ecd548ac4 service nova] [instance: 97fb67a7-637d-456f-b4dd-0a271ed6cfc4] Received event network-vif-plugged-254ea53c-6da9-46d5-a139-7926008cdf8b {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:18:18 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-2cd24ea1-bbfd-445c-9971-2141d6e4565a req-5ebca1e1-1f77-4ef2-96c0-0f6ecd548ac4 service nova] Acquiring lock "97fb67a7-637d-456f-b4dd-0a271ed6cfc4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:18:18 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-2cd24ea1-bbfd-445c-9971-2141d6e4565a req-5ebca1e1-1f77-4ef2-96c0-0f6ecd548ac4 service nova] Lock "97fb67a7-637d-456f-b4dd-0a271ed6cfc4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:18:18 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-2cd24ea1-bbfd-445c-9971-2141d6e4565a req-5ebca1e1-1f77-4ef2-96c0-0f6ecd548ac4 service nova] Lock "97fb67a7-637d-456f-b4dd-0a271ed6cfc4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:18:18 user nova-compute[75165]: DEBUG nova.compute.manager [req-2cd24ea1-bbfd-445c-9971-2141d6e4565a req-5ebca1e1-1f77-4ef2-96c0-0f6ecd548ac4 service nova] [instance: 97fb67a7-637d-456f-b4dd-0a271ed6cfc4] No waiting events found dispatching network-vif-plugged-254ea53c-6da9-46d5-a139-7926008cdf8b {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:18:18 user nova-compute[75165]: WARNING nova.compute.manager [req-2cd24ea1-bbfd-445c-9971-2141d6e4565a req-5ebca1e1-1f77-4ef2-96c0-0f6ecd548ac4 service nova] [instance: 97fb67a7-637d-456f-b4dd-0a271ed6cfc4] Received unexpected event network-vif-plugged-254ea53c-6da9-46d5-a139-7926008cdf8b for instance with vm_state building and task_state spawning.
Oct 26 00:18:18 user nova-compute[75165]: DEBUG nova.compute.manager [None req-22674851-2f66-486a-b277-980e0ec233a6 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: 97fb67a7-637d-456f-b4dd-0a271ed6cfc4] Instance event wait completed in 0 seconds for  {{(pid=75165) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 00:18:18 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-22674851-2f66-486a-b277-980e0ec233a6 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: 97fb67a7-637d-456f-b4dd-0a271ed6cfc4] Guest created on hypervisor {{(pid=75165) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 00:18:18 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: 97fb67a7-637d-456f-b4dd-0a271ed6cfc4] Instance spawned successfully.
Oct 26 00:18:18 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-22674851-2f66-486a-b277-980e0ec233a6 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: 97fb67a7-637d-456f-b4dd-0a271ed6cfc4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 00:18:18 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-22674851-2f66-486a-b277-980e0ec233a6 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: 97fb67a7-637d-456f-b4dd-0a271ed6cfc4] Found default for hw_cdrom_bus of ide {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:18:18 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-22674851-2f66-486a-b277-980e0ec233a6 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: 97fb67a7-637d-456f-b4dd-0a271ed6cfc4] Found default for hw_disk_bus of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:18:18 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-22674851-2f66-486a-b277-980e0ec233a6 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: 97fb67a7-637d-456f-b4dd-0a271ed6cfc4] Found default for hw_input_bus of None {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:18:18 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-22674851-2f66-486a-b277-980e0ec233a6 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: 97fb67a7-637d-456f-b4dd-0a271ed6cfc4] Found default for hw_pointer_model of None {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:18:18 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-22674851-2f66-486a-b277-980e0ec233a6 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: 97fb67a7-637d-456f-b4dd-0a271ed6cfc4] Found default for hw_video_model of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:18:18 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-22674851-2f66-486a-b277-980e0ec233a6 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: 97fb67a7-637d-456f-b4dd-0a271ed6cfc4] Found default for hw_vif_model of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:18:19 user nova-compute[75165]: INFO nova.compute.manager [None req-22674851-2f66-486a-b277-980e0ec233a6 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: 97fb67a7-637d-456f-b4dd-0a271ed6cfc4] Took 6.34 seconds to spawn the instance on the hypervisor.
Oct 26 00:18:19 user nova-compute[75165]: DEBUG nova.compute.manager [None req-22674851-2f66-486a-b277-980e0ec233a6 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: 97fb67a7-637d-456f-b4dd-0a271ed6cfc4] Checking state {{(pid=75165) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 00:18:19 user nova-compute[75165]: INFO nova.compute.manager [None req-22674851-2f66-486a-b277-980e0ec233a6 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: 97fb67a7-637d-456f-b4dd-0a271ed6cfc4] Took 7.52 seconds to build instance.
Oct 26 00:18:19 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-22674851-2f66-486a-b277-980e0ec233a6 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Lock "97fb67a7-637d-456f-b4dd-0a271ed6cfc4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.656s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:18:19 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:18:21 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:18:24 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:18:26 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:18:29 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:18:31 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:18:31 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-052cd5c6-aea6-47bb-ac77-b615b75731e4 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Acquiring lock "3150d249-37a2-49c6-837a-3828480fa2b4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:18:31 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-052cd5c6-aea6-47bb-ac77-b615b75731e4 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Lock "3150d249-37a2-49c6-837a-3828480fa2b4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:18:31 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-052cd5c6-aea6-47bb-ac77-b615b75731e4 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Acquiring lock "3150d249-37a2-49c6-837a-3828480fa2b4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:18:31 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-052cd5c6-aea6-47bb-ac77-b615b75731e4 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Lock "3150d249-37a2-49c6-837a-3828480fa2b4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:18:31 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-052cd5c6-aea6-47bb-ac77-b615b75731e4 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Lock "3150d249-37a2-49c6-837a-3828480fa2b4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:18:31 user nova-compute[75165]: INFO nova.compute.manager [None req-052cd5c6-aea6-47bb-ac77-b615b75731e4 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] [instance: 3150d249-37a2-49c6-837a-3828480fa2b4] Terminating instance
Oct 26 00:18:31 user nova-compute[75165]: DEBUG nova.compute.manager [None req-052cd5c6-aea6-47bb-ac77-b615b75731e4 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] [instance: 3150d249-37a2-49c6-837a-3828480fa2b4] Start destroying the instance on the hypervisor. {{(pid=75165) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 00:18:31 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:18:32 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:18:32 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:18:32 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:18:32 user nova-compute[75165]: DEBUG nova.compute.manager [req-ae9af399-e2eb-439b-9985-4e236f493965 req-d633eb38-82ee-4e9d-b3a9-12ece0e78d57 service nova] [instance: 3150d249-37a2-49c6-837a-3828480fa2b4] Received event network-vif-unplugged-e959f8cc-deda-4ee5-8f46-7d5fbcb13a3b {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:18:32 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-ae9af399-e2eb-439b-9985-4e236f493965 req-d633eb38-82ee-4e9d-b3a9-12ece0e78d57 service nova] Acquiring lock "3150d249-37a2-49c6-837a-3828480fa2b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:18:32 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-ae9af399-e2eb-439b-9985-4e236f493965 req-d633eb38-82ee-4e9d-b3a9-12ece0e78d57 service nova] Lock "3150d249-37a2-49c6-837a-3828480fa2b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:18:32 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-ae9af399-e2eb-439b-9985-4e236f493965 req-d633eb38-82ee-4e9d-b3a9-12ece0e78d57 service nova] Lock "3150d249-37a2-49c6-837a-3828480fa2b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:18:32 user nova-compute[75165]: DEBUG nova.compute.manager [req-ae9af399-e2eb-439b-9985-4e236f493965 req-d633eb38-82ee-4e9d-b3a9-12ece0e78d57 service nova] [instance: 3150d249-37a2-49c6-837a-3828480fa2b4] No waiting events found dispatching network-vif-unplugged-e959f8cc-deda-4ee5-8f46-7d5fbcb13a3b {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:18:32 user nova-compute[75165]: DEBUG nova.compute.manager [req-ae9af399-e2eb-439b-9985-4e236f493965 req-d633eb38-82ee-4e9d-b3a9-12ece0e78d57 service nova] [instance: 3150d249-37a2-49c6-837a-3828480fa2b4] Received event network-vif-unplugged-e959f8cc-deda-4ee5-8f46-7d5fbcb13a3b for instance with task_state deleting. {{(pid=75165) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 00:18:32 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: 3150d249-37a2-49c6-837a-3828480fa2b4] Instance destroyed successfully.
Oct 26 00:18:32 user nova-compute[75165]: DEBUG nova.objects.instance [None req-052cd5c6-aea6-47bb-ac77-b615b75731e4 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Lazy-loading 'resources' on Instance uuid 3150d249-37a2-49c6-837a-3828480fa2b4 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:18:32 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-052cd5c6-aea6-47bb-ac77-b615b75731e4 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:12:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1958214188',display_name='tempest-VolumesAdminNegativeTest-server-1958214188',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1958214188',id=18,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJDMruTlHBDhYEEOzgW9OeGjwnXh2Go3Ic7gLbOiYZ5vAh8cL2+w7FnxMQJgYsq4iVtA4O+jc7OYn22swhiDZldM7uaDfqBsj/HSjlU3fDrHq4CGcm7dCkbPmKlup8Jx+Q==',key_name='tempest-keypair-324227546',keypairs=<?>,launch_index=0,launched_at=2023-10-26T00:12:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7043dc6e5575484b8747c13d3928f717',ramdisk_id='',reservation_id='r-vyds5cc6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1115603178',owner_user_name='tempest-VolumesAdminNegativeTest-1115603178-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T00:12:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2c153a25012b42d1869aacee733c754b',uuid=3150d249-37a2-49c6-837a-3828480fa2b4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e959f8cc-deda-4ee5-8f46-7d5fbcb13a3b", "address": "fa:16:3e:45:96:61", "network": {"id": "158a2f37-110c-4873-af74-f8c483280159", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1353815059-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7043dc6e5575484b8747c13d3928f717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape959f8cc-de", "ovs_interfaceid": "e959f8cc-deda-4ee5-8f46-7d5fbcb13a3b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 00:18:32 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-052cd5c6-aea6-47bb-ac77-b615b75731e4 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Converting VIF {"id": "e959f8cc-deda-4ee5-8f46-7d5fbcb13a3b", "address": "fa:16:3e:45:96:61", "network": {"id": "158a2f37-110c-4873-af74-f8c483280159", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1353815059-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7043dc6e5575484b8747c13d3928f717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape959f8cc-de", "ovs_interfaceid": "e959f8cc-deda-4ee5-8f46-7d5fbcb13a3b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:18:32 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-052cd5c6-aea6-47bb-ac77-b615b75731e4 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:45:96:61,bridge_name='br-int',has_traffic_filtering=True,id=e959f8cc-deda-4ee5-8f46-7d5fbcb13a3b,network=Network(158a2f37-110c-4873-af74-f8c483280159),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape959f8cc-de') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:18:32 user nova-compute[75165]: DEBUG os_vif [None req-052cd5c6-aea6-47bb-ac77-b615b75731e4 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:45:96:61,bridge_name='br-int',has_traffic_filtering=True,id=e959f8cc-deda-4ee5-8f46-7d5fbcb13a3b,network=Network(158a2f37-110c-4873-af74-f8c483280159),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape959f8cc-de') {{(pid=75165) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 00:18:32 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:18:32 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape959f8cc-de, bridge=br-int, if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:18:32 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:18:32 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:18:32 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:18:32 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=14b36445-6237-4e63-8a07-96f540404e50) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:18:32 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:18:32 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:18:32 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:18:32 user nova-compute[75165]: INFO os_vif [None req-052cd5c6-aea6-47bb-ac77-b615b75731e4 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:45:96:61,bridge_name='br-int',has_traffic_filtering=True,id=e959f8cc-deda-4ee5-8f46-7d5fbcb13a3b,network=Network(158a2f37-110c-4873-af74-f8c483280159),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape959f8cc-de')
Oct 26 00:18:32 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-052cd5c6-aea6-47bb-ac77-b615b75731e4 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] [instance: 3150d249-37a2-49c6-837a-3828480fa2b4] Deleting instance files /opt/stack/data/nova/instances/3150d249-37a2-49c6-837a-3828480fa2b4_del
Oct 26 00:18:32 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-052cd5c6-aea6-47bb-ac77-b615b75731e4 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] [instance: 3150d249-37a2-49c6-837a-3828480fa2b4] Deletion of /opt/stack/data/nova/instances/3150d249-37a2-49c6-837a-3828480fa2b4_del complete
Oct 26 00:18:32 user nova-compute[75165]: INFO nova.compute.manager [None req-052cd5c6-aea6-47bb-ac77-b615b75731e4 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] [instance: 3150d249-37a2-49c6-837a-3828480fa2b4] Took 1.02 seconds to destroy the instance on the hypervisor.
Oct 26 00:18:32 user nova-compute[75165]: DEBUG oslo.service.loopingcall [None req-052cd5c6-aea6-47bb-ac77-b615b75731e4 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75165) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 00:18:32 user nova-compute[75165]: DEBUG nova.compute.manager [-] [instance: 3150d249-37a2-49c6-837a-3828480fa2b4] Deallocating network for instance {{(pid=75165) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 00:18:32 user nova-compute[75165]: DEBUG nova.network.neutron [-] [instance: 3150d249-37a2-49c6-837a-3828480fa2b4] deallocate_for_instance() {{(pid=75165) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 00:18:33 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc856ec5-3b8e-445d-bd39-14981c065951 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] [instance: b6558510-6f87-4ef3-b707-f1fa78bf61e8] Calling os-brick to attach iSCSI Volume {{(pid=75165) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 00:18:33 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc856ec5-3b8e-445d-bd39-14981c065951 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8bf8160e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6c0013a0-b960-49c6-8287-75b4c373e0a3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eCNqrOoF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:18:33 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-dc856ec5-3b8e-445d-bd39-14981c065951 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:18:33 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-dc856ec5-3b8e-445d-bd39-14981c065951 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:18:33 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-dc856ec5-3b8e-445d-bd39-14981c065951 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:18:33 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-dc856ec5-3b8e-445d-bd39-14981c065951 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:18:33 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-dc856ec5-3b8e-445d-bd39-14981c065951 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c0013a0-b960-49c6-8287-75b4c373e0a3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:18:33 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-dc856ec5-3b8e-445d-bd39-14981c065951 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c0013a0-b960-49c6-8287-75b4c373e0a3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:18:33 user nova-compute[75165]: INFO os_brick.initiator.connectors.iscsi [None req-dc856ec5-3b8e-445d-bd39-14981c065951 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 00:18:33 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c0013a0-b960-49c6-8287-75b4c373e0a3 -p 172.16.0.220:3260 {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:18:33 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c0013a0-b960-49c6-8287-75b4c373e0a3 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:18:33 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b09d308-74a0-4885-9353-42e1a1ce755a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:18:33 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc856ec5-3b8e-445d-bd39-14981c065951 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 00:18:33 user nova-compute[75165]:  {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:18:33 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c0013a0-b960-49c6-8287-75b4c373e0a3 -p 172.16.0.220:3260 --interface default --op new {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:18:33 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c0013a0-b960-49c6-8287-75b4c373e0a3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:18:33 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[0889367f-21d2-44e8-919a-2ba8bd1febeb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6c0013a0-b960-49c6-8287-75b4c373e0a3] added\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:18:33 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc856ec5-3b8e-445d-bd39-14981c065951 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6c0013a0-b960-49c6-8287-75b4c373e0a3] added
Oct 26 00:18:33 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:18:33 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c0013a0-b960-49c6-8287-75b4c373e0a3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:18:33 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c0013a0-b960-49c6-8287-75b4c373e0a3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:18:33 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[316f7cb0-17b1-4350-b787-cac9fd4bf743]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:18:33 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc856ec5-3b8e-445d-bd39-14981c065951 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:18:33 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c0013a0-b960-49c6-8287-75b4c373e0a3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:18:33 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c0013a0-b960-49c6-8287-75b4c373e0a3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:18:33 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[08d8a8d1-1806-49e8-a2e2-a326d5d8be52]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:18:33 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc856ec5-3b8e-445d-bd39-14981c065951 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:18:33 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c0013a0-b960-49c6-8287-75b4c373e0a3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eCNqrOoF {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:18:33 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c0013a0-b960-49c6-8287-75b4c373e0a3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eCNqrOoF" returned: 0 in 0.020s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:18:33 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[52fe23fd-ab63-46bc-8657-b751d5366638]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:18:33 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc856ec5-3b8e-445d-bd39-14981c065951 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eCNqrOoF'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:18:33 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c0013a0-b960-49c6-8287-75b4c373e0a3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:18:33 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c0013a0-b960-49c6-8287-75b4c373e0a3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.133s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:18:33 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c40134a-1c68-4e44-b4fa-d992e4ae95e3]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:18:33 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc856ec5-3b8e-445d-bd39-14981c065951 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:18:33 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:18:33 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:18:33 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[655da28f-bf1c-4b81-a93f-45e51a64eaeb]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f431d8b9-aa1e-46f5-b7da-39f4a550e050 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f06e40e7-3ca1-4a25-bd11-ff01280c6df2 (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:18:33 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc856ec5-3b8e-445d-bd39-14981c065951 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f431d8b9-aa1e-46f5-b7da-39f4a550e050 (non-flash)
Oct 26 00:18:33 user nova-compute[75165]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f06e40e7-3ca1-4a25-bd11-ff01280c6df2 (non-flash)
Oct 26 00:18:33 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:18:33 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc856ec5-3b8e-445d-bd39-14981c065951 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f431d8b9-aa1e-46f5-b7da-39f4a550e050 (non-flash)
Oct 26 00:18:33 user nova-compute[75165]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f06e40e7-3ca1-4a25-bd11-ff01280c6df2 (non-flash)
Oct 26 00:18:33 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:18:33 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c0013a0-b960-49c6-8287-75b4c373e0a3 -p 172.16.0.220:3260 --login {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:18:33 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c0013a0-b960-49c6-8287-75b4c373e0a3 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:18:33 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[2379a5c5-b777-428b-a5d0-b6a86c62fb11]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6c0013a0-b960-49c6-8287-75b4c373e0a3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6c0013a0-b960-49c6-8287-75b4c373e0a3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:18:33 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc856ec5-3b8e-445d-bd39-14981c065951 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6c0013a0-b960-49c6-8287-75b4c373e0a3, portal: 172.16.0.220,3260]
Oct 26 00:18:33 user nova-compute[75165]: Login to [iface: default, target: iqn.2010-10.org.openstack:6c0013a0-b960-49c6-8287-75b4c373e0a3, portal: 172.16.0.220,3260] successful.
Oct 26 00:18:33 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:18:33 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c0013a0-b960-49c6-8287-75b4c373e0a3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:18:33 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c0013a0-b960-49c6-8287-75b4c373e0a3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:18:33 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[927fed13-d3c5-472f-985e-a8a5c0240bb5]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:18:33 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc856ec5-3b8e-445d-bd39-14981c065951 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:18:33 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:18:33 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:18:33 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[afae5d3b-c997-4ce2-8903-702a36bca577]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f431d8b9-aa1e-46f5-b7da-39f4a550e050 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f06e40e7-3ca1-4a25-bd11-ff01280c6df2 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c0013a0-b960-49c6-8287-75b4c373e0a3 (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:18:33 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc856ec5-3b8e-445d-bd39-14981c065951 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f431d8b9-aa1e-46f5-b7da-39f4a550e050 (non-flash)
Oct 26 00:18:33 user nova-compute[75165]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f06e40e7-3ca1-4a25-bd11-ff01280c6df2 (non-flash)
Oct 26 00:18:33 user nova-compute[75165]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c0013a0-b960-49c6-8287-75b4c373e0a3 (non-flash)
Oct 26 00:18:33 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:18:33 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc856ec5-3b8e-445d-bd39-14981c065951 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f431d8b9-aa1e-46f5-b7da-39f4a550e050 (non-flash)
Oct 26 00:18:33 user nova-compute[75165]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f06e40e7-3ca1-4a25-bd11-ff01280c6df2 (non-flash)
Oct 26 00:18:33 user nova-compute[75165]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c0013a0-b960-49c6-8287-75b4c373e0a3 (non-flash)
Oct 26 00:18:33 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:18:33 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-dc856ec5-3b8e-445d-bd39-14981c065951 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c0013a0-b960-49c6-8287-75b4c373e0a3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.427s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:18:33 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc856ec5-3b8e-445d-bd39-14981c065951 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] Connected to 172.16.0.220:3260 {{(pid=75165) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 00:18:33 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-dc856ec5-3b8e-445d-bd39-14981c065951 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] HCTL ('35', '-', '-', 0) found on session 24 with lun 0 {{(pid=75165) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 00:18:33 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-dc856ec5-3b8e-445d-bd39-14981c065951 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75165) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 00:18:33 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:18:33 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.025s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:18:33 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[91d156f6-8871-472c-855f-9c836c96a411]: (4, ('- - 0', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:18:33 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-dc856ec5-3b8e-445d-bd39-14981c065951 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] Searching for a device in session 24 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75165) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 00:18:33 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc856ec5-3b8e-445d-bd39-14981c065951 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:6c0013a0-b960-49c6-8287-75b4c373e0a3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eCNqrOoF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75165) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 00:18:34 user nova-compute[75165]: DEBUG nova.network.neutron [-] [instance: 3150d249-37a2-49c6-837a-3828480fa2b4] Updating instance_info_cache with network_info: [] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:18:34 user nova-compute[75165]: INFO nova.compute.manager [-] [instance: 3150d249-37a2-49c6-837a-3828480fa2b4] Took 1.17 seconds to deallocate network for instance.
Oct 26 00:18:34 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-052cd5c6-aea6-47bb-ac77-b615b75731e4 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:18:34 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-052cd5c6-aea6-47bb-ac77-b615b75731e4 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:18:34 user nova-compute[75165]: DEBUG nova.compute.manager [req-a4a5afac-9068-4890-aa26-a2ffacf1a427 req-a658bc29-640e-4d6b-abee-d139ff345ec6 service nova] [instance: 3150d249-37a2-49c6-837a-3828480fa2b4] Received event network-vif-plugged-e959f8cc-deda-4ee5-8f46-7d5fbcb13a3b {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:18:34 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-a4a5afac-9068-4890-aa26-a2ffacf1a427 req-a658bc29-640e-4d6b-abee-d139ff345ec6 service nova] Acquiring lock "3150d249-37a2-49c6-837a-3828480fa2b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:18:34 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-a4a5afac-9068-4890-aa26-a2ffacf1a427 req-a658bc29-640e-4d6b-abee-d139ff345ec6 service nova] Lock "3150d249-37a2-49c6-837a-3828480fa2b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:18:34 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-a4a5afac-9068-4890-aa26-a2ffacf1a427 req-a658bc29-640e-4d6b-abee-d139ff345ec6 service nova] Lock "3150d249-37a2-49c6-837a-3828480fa2b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:18:34 user nova-compute[75165]: DEBUG nova.compute.manager [req-a4a5afac-9068-4890-aa26-a2ffacf1a427 req-a658bc29-640e-4d6b-abee-d139ff345ec6 service nova] [instance: 3150d249-37a2-49c6-837a-3828480fa2b4] No waiting events found dispatching network-vif-plugged-e959f8cc-deda-4ee5-8f46-7d5fbcb13a3b {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:18:34 user nova-compute[75165]: WARNING nova.compute.manager [req-a4a5afac-9068-4890-aa26-a2ffacf1a427 req-a658bc29-640e-4d6b-abee-d139ff345ec6 service nova] [instance: 3150d249-37a2-49c6-837a-3828480fa2b4] Received unexpected event network-vif-plugged-e959f8cc-deda-4ee5-8f46-7d5fbcb13a3b for instance with vm_state deleted and task_state None.
Oct 26 00:18:34 user nova-compute[75165]: DEBUG nova.compute.manager [req-a4a5afac-9068-4890-aa26-a2ffacf1a427 req-a658bc29-640e-4d6b-abee-d139ff345ec6 service nova] [instance: 3150d249-37a2-49c6-837a-3828480fa2b4] Received event network-vif-deleted-e959f8cc-deda-4ee5-8f46-7d5fbcb13a3b {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:18:34 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-052cd5c6-aea6-47bb-ac77-b615b75731e4 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:18:34 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-052cd5c6-aea6-47bb-ac77-b615b75731e4 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:18:34 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-052cd5c6-aea6-47bb-ac77-b615b75731e4 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.354s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:18:34 user nova-compute[75165]: INFO nova.scheduler.client.report [None req-052cd5c6-aea6-47bb-ac77-b615b75731e4 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Deleted allocations for instance 3150d249-37a2-49c6-837a-3828480fa2b4
Oct 26 00:18:34 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-052cd5c6-aea6-47bb-ac77-b615b75731e4 tempest-VolumesAdminNegativeTest-1115603178 tempest-VolumesAdminNegativeTest-1115603178-project-member] Lock "3150d249-37a2-49c6-837a-3828480fa2b4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.784s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:18:34 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-dc856ec5-3b8e-445d-bd39-14981c065951 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.470s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:18:34 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc856ec5-3b8e-445d-bd39-14981c065951 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] <== connect_volume: return (1472ms) {'type': 'block', 'scsi_wwn': '26264646439326665', 'path': '/dev/sdd'} {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:18:34 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc856ec5-3b8e-445d-bd39-14981c065951 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] [instance: b6558510-6f87-4ef3-b707-f1fa78bf61e8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26264646439326665', 'path': '/dev/sdd'} {{(pid=75165) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 00:18:34 user nova-compute[75165]: DEBUG nova.objects.instance [None req-dc856ec5-3b8e-445d-bd39-14981c065951 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] Lazy-loading 'flavor' on Instance uuid b6558510-6f87-4ef3-b707-f1fa78bf61e8 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:18:34 user nova-compute[75165]: DEBUG nova.virt.libvirt.guest [None req-dc856ec5-3b8e-445d-bd39-14981c065951 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 00:18:34 user nova-compute[75165]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 00:18:34 user nova-compute[75165]:   <source dev="/dev/sdd"/>
Oct 26 00:18:34 user nova-compute[75165]:   <target dev="vdb" bus="virtio"/>
Oct 26 00:18:34 user nova-compute[75165]:   <serial>6c0013a0-b960-49c6-8287-75b4c373e0a3</serial>
Oct 26 00:18:34 user nova-compute[75165]: </disk>
Oct 26 00:18:34 user nova-compute[75165]:  {{(pid=75165) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 00:18:35 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-dc856ec5-3b8e-445d-bd39-14981c065951 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] No BDM found with device name vda, not building metadata. {{(pid=75165) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 00:18:35 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-dc856ec5-3b8e-445d-bd39-14981c065951 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75165) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 00:18:35 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-dc856ec5-3b8e-445d-bd39-14981c065951 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] No VIF found with MAC fa:16:3e:ae:d1:d7, not building metadata {{(pid=75165) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 00:18:35 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-dc856ec5-3b8e-445d-bd39-14981c065951 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] Lock "b6558510-6f87-4ef3-b707-f1fa78bf61e8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 23.072s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:18:35 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-c3611511-cd6f-42d4-8f89-e481da049524 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Acquiring lock "b041e0af-4635-495c-b72d-fbbbd8d43a9b" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:18:35 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-c3611511-cd6f-42d4-8f89-e481da049524 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Lock "b041e0af-4635-495c-b72d-fbbbd8d43a9b" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:18:35 user nova-compute[75165]: INFO nova.compute.manager [None req-c3611511-cd6f-42d4-8f89-e481da049524 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] [instance: b041e0af-4635-495c-b72d-fbbbd8d43a9b] Unshelving
Oct 26 00:18:35 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-c3611511-cd6f-42d4-8f89-e481da049524 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:18:35 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-c3611511-cd6f-42d4-8f89-e481da049524 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:18:35 user nova-compute[75165]: DEBUG nova.objects.instance [None req-c3611511-cd6f-42d4-8f89-e481da049524 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Lazy-loading 'pci_requests' on Instance uuid b041e0af-4635-495c-b72d-fbbbd8d43a9b {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:18:35 user nova-compute[75165]: DEBUG nova.objects.instance [None req-c3611511-cd6f-42d4-8f89-e481da049524 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Lazy-loading 'numa_topology' on Instance uuid b041e0af-4635-495c-b72d-fbbbd8d43a9b {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:18:35 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-c3611511-cd6f-42d4-8f89-e481da049524 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75165) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 00:18:35 user nova-compute[75165]: INFO nova.compute.claims [None req-c3611511-cd6f-42d4-8f89-e481da049524 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] [instance: b041e0af-4635-495c-b72d-fbbbd8d43a9b] Claim successful on node user
Oct 26 00:18:36 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:18:36 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-c3611511-cd6f-42d4-8f89-e481da049524 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:18:36 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-c3611511-cd6f-42d4-8f89-e481da049524 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:18:36 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-c3611511-cd6f-42d4-8f89-e481da049524 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.400s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:18:36 user nova-compute[75165]: INFO nova.network.neutron [None req-c3611511-cd6f-42d4-8f89-e481da049524 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] [instance: b041e0af-4635-495c-b72d-fbbbd8d43a9b] Updating port 1964255b-cf1e-4e17-a1f7-ae5d6ea25aef with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Oct 26 00:18:37 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-c3611511-cd6f-42d4-8f89-e481da049524 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Acquiring lock "refresh_cache-b041e0af-4635-495c-b72d-fbbbd8d43a9b" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:18:37 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-c3611511-cd6f-42d4-8f89-e481da049524 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Acquired lock "refresh_cache-b041e0af-4635-495c-b72d-fbbbd8d43a9b" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:18:37 user nova-compute[75165]: DEBUG nova.network.neutron [None req-c3611511-cd6f-42d4-8f89-e481da049524 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] [instance: b041e0af-4635-495c-b72d-fbbbd8d43a9b] Building network info cache for instance {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 00:18:37 user nova-compute[75165]: DEBUG nova.compute.manager [req-fc7ea34a-3f2c-4fe1-b344-8da45495eddb req-a6ad655d-88be-4c50-a4d5-9059de4523ea service nova] [instance: b041e0af-4635-495c-b72d-fbbbd8d43a9b] Received event network-changed-1964255b-cf1e-4e17-a1f7-ae5d6ea25aef {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:18:37 user nova-compute[75165]: DEBUG nova.compute.manager [req-fc7ea34a-3f2c-4fe1-b344-8da45495eddb req-a6ad655d-88be-4c50-a4d5-9059de4523ea service nova] [instance: b041e0af-4635-495c-b72d-fbbbd8d43a9b] Refreshing instance network info cache due to event network-changed-1964255b-cf1e-4e17-a1f7-ae5d6ea25aef. {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 00:18:37 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-fc7ea34a-3f2c-4fe1-b344-8da45495eddb req-a6ad655d-88be-4c50-a4d5-9059de4523ea service nova] Acquiring lock "refresh_cache-b041e0af-4635-495c-b72d-fbbbd8d43a9b" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:18:37 user nova-compute[75165]: DEBUG nova.network.neutron [None req-c3611511-cd6f-42d4-8f89-e481da049524 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] [instance: b041e0af-4635-495c-b72d-fbbbd8d43a9b] Updating instance_info_cache with network_info: [{"id": "1964255b-cf1e-4e17-a1f7-ae5d6ea25aef", "address": "fa:16:3e:76:6f:05", "network": {"id": "f54e2e9f-5c1e-44ca-bd4b-9cf0747b0f72", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-806146051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "920152101768459baa71010b380ea8f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1964255b-cf", "ovs_interfaceid": "1964255b-cf1e-4e17-a1f7-ae5d6ea25aef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:18:37 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-c3611511-cd6f-42d4-8f89-e481da049524 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Releasing lock "refresh_cache-b041e0af-4635-495c-b72d-fbbbd8d43a9b" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:18:37 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-c3611511-cd6f-42d4-8f89-e481da049524 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] [instance: b041e0af-4635-495c-b72d-fbbbd8d43a9b] Creating instance directory {{(pid=75165) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 00:18:37 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-c3611511-cd6f-42d4-8f89-e481da049524 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] [instance: b041e0af-4635-495c-b72d-fbbbd8d43a9b] Creating image(s)
Oct 26 00:18:37 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-c3611511-cd6f-42d4-8f89-e481da049524 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Acquiring lock "/opt/stack/data/nova/instances/b041e0af-4635-495c-b72d-fbbbd8d43a9b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:18:37 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-c3611511-cd6f-42d4-8f89-e481da049524 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Lock "/opt/stack/data/nova/instances/b041e0af-4635-495c-b72d-fbbbd8d43a9b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:18:37 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-c3611511-cd6f-42d4-8f89-e481da049524 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Lock "/opt/stack/data/nova/instances/b041e0af-4635-495c-b72d-fbbbd8d43a9b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:18:37 user nova-compute[75165]: DEBUG nova.objects.instance [None req-c3611511-cd6f-42d4-8f89-e481da049524 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Lazy-loading 'trusted_certs' on Instance uuid b041e0af-4635-495c-b72d-fbbbd8d43a9b {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:18:37 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-fc7ea34a-3f2c-4fe1-b344-8da45495eddb req-a6ad655d-88be-4c50-a4d5-9059de4523ea service nova] Acquired lock "refresh_cache-b041e0af-4635-495c-b72d-fbbbd8d43a9b" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:18:37 user nova-compute[75165]: DEBUG nova.network.neutron [req-fc7ea34a-3f2c-4fe1-b344-8da45495eddb req-a6ad655d-88be-4c50-a4d5-9059de4523ea service nova] [instance: b041e0af-4635-495c-b72d-fbbbd8d43a9b] Refreshing network info cache for port 1964255b-cf1e-4e17-a1f7-ae5d6ea25aef {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 00:18:37 user nova-compute[75165]: DEBUG nova.objects.base [None req-c3611511-cd6f-42d4-8f89-e481da049524 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Object Instance<b041e0af-4635-495c-b72d-fbbbd8d43a9b> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75165) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 00:18:37 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-c3611511-cd6f-42d4-8f89-e481da049524 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Acquiring lock "eb607d80b14fae12f267e90d6f5b92333c26409a" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:18:37 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-c3611511-cd6f-42d4-8f89-e481da049524 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Lock "eb607d80b14fae12f267e90d6f5b92333c26409a" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:18:38 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-c3611511-cd6f-42d4-8f89-e481da049524 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb607d80b14fae12f267e90d6f5b92333c26409a.part --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:18:38 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:18:38 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-93abecdb-ba6e-4818-a8c9-fb661b438978 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] Acquiring lock "b6558510-6f87-4ef3-b707-f1fa78bf61e8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:18:38 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-93abecdb-ba6e-4818-a8c9-fb661b438978 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] Lock "b6558510-6f87-4ef3-b707-f1fa78bf61e8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:18:38 user nova-compute[75165]: INFO nova.compute.manager [None req-93abecdb-ba6e-4818-a8c9-fb661b438978 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] [instance: b6558510-6f87-4ef3-b707-f1fa78bf61e8] Detaching volume 6c0013a0-b960-49c6-8287-75b4c373e0a3
Oct 26 00:18:38 user nova-compute[75165]: INFO nova.virt.block_device [None req-93abecdb-ba6e-4818-a8c9-fb661b438978 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] [instance: b6558510-6f87-4ef3-b707-f1fa78bf61e8] Attempting to driver detach volume 6c0013a0-b960-49c6-8287-75b4c373e0a3 from mountpoint /dev/vdb
Oct 26 00:18:38 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-c3611511-cd6f-42d4-8f89-e481da049524 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb607d80b14fae12f267e90d6f5b92333c26409a.part --force-share --output=json" returned: 0 in 0.187s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:18:38 user nova-compute[75165]: DEBUG nova.virt.images [None req-c3611511-cd6f-42d4-8f89-e481da049524 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] 9a1997e4-5869-4d2a-97ae-53b83fbdca54 was qcow2, converting to raw {{(pid=75165) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 26 00:18:38 user nova-compute[75165]: DEBUG nova.privsep.utils [None req-c3611511-cd6f-42d4-8f89-e481da049524 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75165) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 26 00:18:38 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-c3611511-cd6f-42d4-8f89-e481da049524 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/eb607d80b14fae12f267e90d6f5b92333c26409a.part /opt/stack/data/nova/instances/_base/eb607d80b14fae12f267e90d6f5b92333c26409a.converted {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:18:39 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-93abecdb-ba6e-4818-a8c9-fb661b438978 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] Attempting to detach device vdb from instance b6558510-6f87-4ef3-b707-f1fa78bf61e8 from the persistent domain config. {{(pid=75165) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 00:18:39 user nova-compute[75165]: DEBUG nova.virt.libvirt.guest [None req-93abecdb-ba6e-4818-a8c9-fb661b438978 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 00:18:39 user nova-compute[75165]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 00:18:39 user nova-compute[75165]:   <source dev="/dev/sdd"/>
Oct 26 00:18:39 user nova-compute[75165]:   <target dev="vdb" bus="virtio"/>
Oct 26 00:18:39 user nova-compute[75165]:   <serial>6c0013a0-b960-49c6-8287-75b4c373e0a3</serial>
Oct 26 00:18:39 user nova-compute[75165]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 00:18:39 user nova-compute[75165]: </disk>
Oct 26 00:18:39 user nova-compute[75165]:  {{(pid=75165) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 00:18:39 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-93abecdb-ba6e-4818-a8c9-fb661b438978 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] Successfully detached device vdb from instance b6558510-6f87-4ef3-b707-f1fa78bf61e8 from the persistent domain config.
Oct 26 00:18:39 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-93abecdb-ba6e-4818-a8c9-fb661b438978 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b6558510-6f87-4ef3-b707-f1fa78bf61e8 from the live domain config. {{(pid=75165) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 00:18:39 user nova-compute[75165]: DEBUG nova.virt.libvirt.guest [None req-93abecdb-ba6e-4818-a8c9-fb661b438978 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 00:18:39 user nova-compute[75165]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 00:18:39 user nova-compute[75165]:   <source dev="/dev/sdd"/>
Oct 26 00:18:39 user nova-compute[75165]:   <target dev="vdb" bus="virtio"/>
Oct 26 00:18:39 user nova-compute[75165]:   <serial>6c0013a0-b960-49c6-8287-75b4c373e0a3</serial>
Oct 26 00:18:39 user nova-compute[75165]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 00:18:39 user nova-compute[75165]: </disk>
Oct 26 00:18:39 user nova-compute[75165]:  {{(pid=75165) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 00:18:39 user nova-compute[75165]: DEBUG nova.network.neutron [req-fc7ea34a-3f2c-4fe1-b344-8da45495eddb req-a6ad655d-88be-4c50-a4d5-9059de4523ea service nova] [instance: b041e0af-4635-495c-b72d-fbbbd8d43a9b] Updated VIF entry in instance network info cache for port 1964255b-cf1e-4e17-a1f7-ae5d6ea25aef. {{(pid=75165) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 00:18:39 user nova-compute[75165]: DEBUG nova.network.neutron [req-fc7ea34a-3f2c-4fe1-b344-8da45495eddb req-a6ad655d-88be-4c50-a4d5-9059de4523ea service nova] [instance: b041e0af-4635-495c-b72d-fbbbd8d43a9b] Updating instance_info_cache with network_info: [{"id": "1964255b-cf1e-4e17-a1f7-ae5d6ea25aef", "address": "fa:16:3e:76:6f:05", "network": {"id": "f54e2e9f-5c1e-44ca-bd4b-9cf0747b0f72", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-806146051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "920152101768459baa71010b380ea8f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1964255b-cf", "ovs_interfaceid": "1964255b-cf1e-4e17-a1f7-ae5d6ea25aef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:18:39 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-fc7ea34a-3f2c-4fe1-b344-8da45495eddb req-a6ad655d-88be-4c50-a4d5-9059de4523ea service nova] Releasing lock "refresh_cache-b041e0af-4635-495c-b72d-fbbbd8d43a9b" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:18:39 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-c3611511-cd6f-42d4-8f89-e481da049524 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/eb607d80b14fae12f267e90d6f5b92333c26409a.part /opt/stack/data/nova/instances/_base/eb607d80b14fae12f267e90d6f5b92333c26409a.converted" returned: 0 in 0.732s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:18:39 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-c3611511-cd6f-42d4-8f89-e481da049524 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb607d80b14fae12f267e90d6f5b92333c26409a.converted --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:18:39 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-93abecdb-ba6e-4818-a8c9-fb661b438978 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b6558510-6f87-4ef3-b707-f1fa78bf61e8 {{(pid=75165) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 00:18:39 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-c3611511-cd6f-42d4-8f89-e481da049524 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb607d80b14fae12f267e90d6f5b92333c26409a.converted --force-share --output=json" returned: 0 in 0.206s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:18:39 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-c3611511-cd6f-42d4-8f89-e481da049524 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Lock "eb607d80b14fae12f267e90d6f5b92333c26409a" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.373s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:18:39 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-c3611511-cd6f-42d4-8f89-e481da049524 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb607d80b14fae12f267e90d6f5b92333c26409a --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:18:40 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-c3611511-cd6f-42d4-8f89-e481da049524 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb607d80b14fae12f267e90d6f5b92333c26409a --force-share --output=json" returned: 0 in 0.206s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:18:40 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-c3611511-cd6f-42d4-8f89-e481da049524 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Acquiring lock "eb607d80b14fae12f267e90d6f5b92333c26409a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:18:40 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-c3611511-cd6f-42d4-8f89-e481da049524 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Lock "eb607d80b14fae12f267e90d6f5b92333c26409a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:18:40 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-c3611511-cd6f-42d4-8f89-e481da049524 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb607d80b14fae12f267e90d6f5b92333c26409a --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:18:40 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-c3611511-cd6f-42d4-8f89-e481da049524 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb607d80b14fae12f267e90d6f5b92333c26409a --force-share --output=json" returned: 0 in 0.176s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:18:40 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-c3611511-cd6f-42d4-8f89-e481da049524 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb607d80b14fae12f267e90d6f5b92333c26409a,backing_fmt=raw /opt/stack/data/nova/instances/b041e0af-4635-495c-b72d-fbbbd8d43a9b/disk 1073741824 {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:18:40 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-c3611511-cd6f-42d4-8f89-e481da049524 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb607d80b14fae12f267e90d6f5b92333c26409a,backing_fmt=raw /opt/stack/data/nova/instances/b041e0af-4635-495c-b72d-fbbbd8d43a9b/disk 1073741824" returned: 0 in 0.053s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:18:40 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-c3611511-cd6f-42d4-8f89-e481da049524 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Lock "eb607d80b14fae12f267e90d6f5b92333c26409a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:18:40 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-c3611511-cd6f-42d4-8f89-e481da049524 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb607d80b14fae12f267e90d6f5b92333c26409a --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:18:40 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-c3611511-cd6f-42d4-8f89-e481da049524 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb607d80b14fae12f267e90d6f5b92333c26409a --force-share --output=json" returned: 0 in 0.198s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:18:40 user nova-compute[75165]: DEBUG nova.objects.instance [None req-c3611511-cd6f-42d4-8f89-e481da049524 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Lazy-loading 'migration_context' on Instance uuid b041e0af-4635-495c-b72d-fbbbd8d43a9b {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:18:40 user nova-compute[75165]: DEBUG nova.objects.base [None req-c3611511-cd6f-42d4-8f89-e481da049524 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Object Instance<b041e0af-4635-495c-b72d-fbbbd8d43a9b> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75165) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 00:18:40 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-c3611511-cd6f-42d4-8f89-e481da049524 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] [instance: b041e0af-4635-495c-b72d-fbbbd8d43a9b] Rebasing disk image.
Oct 26 00:18:40 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-c3611511-cd6f-42d4-8f89-e481da049524 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:18:40 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-c3611511-cd6f-42d4-8f89-e481da049524 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json" returned: 0 in 0.209s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:18:40 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-c3611511-cd6f-42d4-8f89-e481da049524 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 -F raw /opt/stack/data/nova/instances/b041e0af-4635-495c-b72d-fbbbd8d43a9b/disk {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:18:41 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:18:43 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-c3611511-cd6f-42d4-8f89-e481da049524 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 -F raw /opt/stack/data/nova/instances/b041e0af-4635-495c-b72d-fbbbd8d43a9b/disk" returned: 0 in 2.560s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:18:43 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-c3611511-cd6f-42d4-8f89-e481da049524 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] [instance: b041e0af-4635-495c-b72d-fbbbd8d43a9b] Created local disks {{(pid=75165) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 00:18:43 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-c3611511-cd6f-42d4-8f89-e481da049524 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] [instance: b041e0af-4635-495c-b72d-fbbbd8d43a9b] Ensure instance console log exists: /opt/stack/data/nova/instances/b041e0af-4635-495c-b72d-fbbbd8d43a9b/console.log {{(pid=75165) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 00:18:43 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-c3611511-cd6f-42d4-8f89-e481da049524 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:18:43 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-c3611511-cd6f-42d4-8f89-e481da049524 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:18:43 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-c3611511-cd6f-42d4-8f89-e481da049524 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:18:43 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-c3611511-cd6f-42d4-8f89-e481da049524 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] [instance: b041e0af-4635-495c-b72d-fbbbd8d43a9b] Start _get_guest_xml network_info=[{"id": "1964255b-cf1e-4e17-a1f7-ae5d6ea25aef", "address": "fa:16:3e:76:6f:05", "network": {"id": "f54e2e9f-5c1e-44ca-bd4b-9cf0747b0f72", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-806146051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "920152101768459baa71010b380ea8f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1964255b-cf", "ovs_interfaceid": "1964255b-cf1e-4e17-a1f7-ae5d6ea25aef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='f6f3d931598b36895bc5cf4d5f046b9c',container_format='bare',created_at=2023-10-26T00:16:43Z,direct_url=<?>,disk_format='qcow2',id=9a1997e4-5869-4d2a-97ae-53b83fbdca54,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1018278796-shelved',owner='920152101768459baa71010b380ea8f1',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-26T00:16:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'size': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': 'bff0d8a1-739e-4c4d-9efa-b73ba7b76d01'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75165) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 00:18:43 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-c3611511-cd6f-42d4-8f89-e481da049524 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:18:43 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-c3611511-cd6f-42d4-8f89-e481da049524 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:18:43 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-c3611511-cd6f-42d4-8f89-e481da049524 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75165) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 00:18:43 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-c3611511-cd6f-42d4-8f89-e481da049524 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] CPU controller missing on host. {{(pid=75165) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 00:18:43 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-c3611511-cd6f-42d4-8f89-e481da049524 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75165) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 00:18:43 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-c3611511-cd6f-42d4-8f89-e481da049524 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] CPU controller found on host. {{(pid=75165) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 00:18:43 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-c3611511-cd6f-42d4-8f89-e481da049524 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75165) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 00:18:43 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-c3611511-cd6f-42d4-8f89-e481da049524 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T00:03:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='f6f3d931598b36895bc5cf4d5f046b9c',container_format='bare',created_at=2023-10-26T00:16:43Z,direct_url=<?>,disk_format='qcow2',id=9a1997e4-5869-4d2a-97ae-53b83fbdca54,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1018278796-shelved',owner='920152101768459baa71010b380ea8f1',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-26T00:16:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 00:18:43 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-c3611511-cd6f-42d4-8f89-e481da049524 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Flavor limits 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 00:18:43 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-c3611511-cd6f-42d4-8f89-e481da049524 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Image limits 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 00:18:43 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-c3611511-cd6f-42d4-8f89-e481da049524 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Flavor pref 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 00:18:43 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-c3611511-cd6f-42d4-8f89-e481da049524 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Image pref 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 00:18:43 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-c3611511-cd6f-42d4-8f89-e481da049524 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 00:18:43 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-c3611511-cd6f-42d4-8f89-e481da049524 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 00:18:43 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-c3611511-cd6f-42d4-8f89-e481da049524 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75165) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 00:18:43 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-c3611511-cd6f-42d4-8f89-e481da049524 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Got 1 possible topologies {{(pid=75165) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 00:18:43 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-c3611511-cd6f-42d4-8f89-e481da049524 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 00:18:43 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-c3611511-cd6f-42d4-8f89-e481da049524 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 00:18:43 user nova-compute[75165]: DEBUG nova.objects.instance [None req-c3611511-cd6f-42d4-8f89-e481da049524 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Lazy-loading 'vcpu_model' on Instance uuid b041e0af-4635-495c-b72d-fbbbd8d43a9b {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:18:43 user nova-compute[75165]: DEBUG nova.objects.base [None req-c3611511-cd6f-42d4-8f89-e481da049524 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Object Instance<b041e0af-4635-495c-b72d-fbbbd8d43a9b> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75165) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 00:18:43 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-c3611511-cd6f-42d4-8f89-e481da049524 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-26T00:14:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1018278796',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1018278796',id=21,image_ref='9a1997e4-5869-4d2a-97ae-53b83fbdca54',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1875668396',keypairs=<?>,launch_index=0,launched_at=2023-10-26T00:14:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='920152101768459baa71010b380ea8f1',ramdisk_id='',reservation_id='r-agpdy52s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-6636270',owner_user_name='tempest-AttachVolumeShelveTestJSON-6636270-project-member',shelved_at='2023-10-26T00:16:47.954892',shelved_host='user',shelved_image_id='9a1997e4-5869-4d2a-97ae-53b83fbdca54'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T00:18:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a40cb1b08014444686bd0adad03f6c68',uuid=b041e0af-4635-495c-b72d-fbbbd8d43a9b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "1964255b-cf1e-4e17-a1f7-ae5d6ea25aef", "address": "fa:16:3e:76:6f:05", "network": {"id": "f54e2e9f-5c1e-44ca-bd4b-9cf0747b0f72", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-806146051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "920152101768459baa71010b380ea8f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1964255b-cf", "ovs_interfaceid": "1964255b-cf1e-4e17-a1f7-ae5d6ea25aef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75165) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 00:18:43 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-c3611511-cd6f-42d4-8f89-e481da049524 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Converting VIF {"id": "1964255b-cf1e-4e17-a1f7-ae5d6ea25aef", "address": "fa:16:3e:76:6f:05", "network": {"id": "f54e2e9f-5c1e-44ca-bd4b-9cf0747b0f72", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-806146051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "920152101768459baa71010b380ea8f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1964255b-cf", "ovs_interfaceid": "1964255b-cf1e-4e17-a1f7-ae5d6ea25aef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:18:43 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-c3611511-cd6f-42d4-8f89-e481da049524 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:6f:05,bridge_name='br-int',has_traffic_filtering=True,id=1964255b-cf1e-4e17-a1f7-ae5d6ea25aef,network=Network(f54e2e9f-5c1e-44ca-bd4b-9cf0747b0f72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1964255b-cf') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:18:43 user nova-compute[75165]: DEBUG nova.objects.instance [None req-c3611511-cd6f-42d4-8f89-e481da049524 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Lazy-loading 'pci_devices' on Instance uuid b041e0af-4635-495c-b72d-fbbbd8d43a9b {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:18:43 user nova-compute[75165]: DEBUG nova.objects.base [None req-c3611511-cd6f-42d4-8f89-e481da049524 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Object Instance<b041e0af-4635-495c-b72d-fbbbd8d43a9b> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75165) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 00:18:43 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-c3611511-cd6f-42d4-8f89-e481da049524 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] [instance: b041e0af-4635-495c-b72d-fbbbd8d43a9b] End _get_guest_xml xml=<domain type="kvm">
Oct 26 00:18:43 user nova-compute[75165]:   <uuid>b041e0af-4635-495c-b72d-fbbbd8d43a9b</uuid>
Oct 26 00:18:43 user nova-compute[75165]:   <name>instance-00000015</name>
Oct 26 00:18:43 user nova-compute[75165]:   <memory>524288</memory>
Oct 26 00:18:43 user nova-compute[75165]:   <vcpu>1</vcpu>
Oct 26 00:18:43 user nova-compute[75165]:   <metadata>
Oct 26 00:18:43 user nova-compute[75165]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 00:18:43 user nova-compute[75165]:       <nova:package version="0.0.0"/>
Oct 26 00:18:43 user nova-compute[75165]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1018278796</nova:name>
Oct 26 00:18:43 user nova-compute[75165]:       <nova:creationTime>2023-10-26 00:18:43</nova:creationTime>
Oct 26 00:18:43 user nova-compute[75165]:       <nova:flavor name="m1.tiny">
Oct 26 00:18:43 user nova-compute[75165]:         <nova:memory>512</nova:memory>
Oct 26 00:18:43 user nova-compute[75165]:         <nova:disk>1</nova:disk>
Oct 26 00:18:43 user nova-compute[75165]:         <nova:swap>0</nova:swap>
Oct 26 00:18:43 user nova-compute[75165]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 00:18:43 user nova-compute[75165]:         <nova:vcpus>1</nova:vcpus>
Oct 26 00:18:43 user nova-compute[75165]:       </nova:flavor>
Oct 26 00:18:43 user nova-compute[75165]:       <nova:owner>
Oct 26 00:18:43 user nova-compute[75165]:         <nova:user uuid="a40cb1b08014444686bd0adad03f6c68">tempest-AttachVolumeShelveTestJSON-6636270-project-member</nova:user>
Oct 26 00:18:43 user nova-compute[75165]:         <nova:project uuid="920152101768459baa71010b380ea8f1">tempest-AttachVolumeShelveTestJSON-6636270</nova:project>
Oct 26 00:18:43 user nova-compute[75165]:       </nova:owner>
Oct 26 00:18:43 user nova-compute[75165]:       <nova:root type="image" uuid="9a1997e4-5869-4d2a-97ae-53b83fbdca54"/>
Oct 26 00:18:43 user nova-compute[75165]:       <nova:ports>
Oct 26 00:18:43 user nova-compute[75165]:         <nova:port uuid="1964255b-cf1e-4e17-a1f7-ae5d6ea25aef">
Oct 26 00:18:43 user nova-compute[75165]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 26 00:18:43 user nova-compute[75165]:         </nova:port>
Oct 26 00:18:43 user nova-compute[75165]:       </nova:ports>
Oct 26 00:18:43 user nova-compute[75165]:     </nova:instance>
Oct 26 00:18:43 user nova-compute[75165]:   </metadata>
Oct 26 00:18:43 user nova-compute[75165]:   <sysinfo type="smbios">
Oct 26 00:18:43 user nova-compute[75165]:     <system>
Oct 26 00:18:43 user nova-compute[75165]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 00:18:43 user nova-compute[75165]:       <entry name="product">OpenStack Nova</entry>
Oct 26 00:18:43 user nova-compute[75165]:       <entry name="version">0.0.0</entry>
Oct 26 00:18:43 user nova-compute[75165]:       <entry name="serial">b041e0af-4635-495c-b72d-fbbbd8d43a9b</entry>
Oct 26 00:18:43 user nova-compute[75165]:       <entry name="uuid">b041e0af-4635-495c-b72d-fbbbd8d43a9b</entry>
Oct 26 00:18:43 user nova-compute[75165]:       <entry name="family">Virtual Machine</entry>
Oct 26 00:18:43 user nova-compute[75165]:     </system>
Oct 26 00:18:43 user nova-compute[75165]:   </sysinfo>
Oct 26 00:18:43 user nova-compute[75165]:   <os>
Oct 26 00:18:43 user nova-compute[75165]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 00:18:43 user nova-compute[75165]:     <boot dev="hd"/>
Oct 26 00:18:43 user nova-compute[75165]:     <smbios mode="sysinfo"/>
Oct 26 00:18:43 user nova-compute[75165]:   </os>
Oct 26 00:18:43 user nova-compute[75165]:   <features>
Oct 26 00:18:43 user nova-compute[75165]:     <acpi/>
Oct 26 00:18:43 user nova-compute[75165]:     <apic/>
Oct 26 00:18:43 user nova-compute[75165]:     <vmcoreinfo/>
Oct 26 00:18:43 user nova-compute[75165]:   </features>
Oct 26 00:18:43 user nova-compute[75165]:   <clock offset="utc">
Oct 26 00:18:43 user nova-compute[75165]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 00:18:43 user nova-compute[75165]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 00:18:43 user nova-compute[75165]:     <timer name="hpet" present="no"/>
Oct 26 00:18:43 user nova-compute[75165]:   </clock>
Oct 26 00:18:43 user nova-compute[75165]:   <cpu mode="custom" match="exact">
Oct 26 00:18:43 user nova-compute[75165]:     <model>Nehalem</model>
Oct 26 00:18:43 user nova-compute[75165]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 00:18:43 user nova-compute[75165]:   </cpu>
Oct 26 00:18:43 user nova-compute[75165]:   <devices>
Oct 26 00:18:43 user nova-compute[75165]:     <disk type="file" device="disk">
Oct 26 00:18:43 user nova-compute[75165]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 00:18:43 user nova-compute[75165]:       <source file="/opt/stack/data/nova/instances/b041e0af-4635-495c-b72d-fbbbd8d43a9b/disk"/>
Oct 26 00:18:43 user nova-compute[75165]:       <target dev="vda" bus="virtio"/>
Oct 26 00:18:43 user nova-compute[75165]:     </disk>
Oct 26 00:18:43 user nova-compute[75165]:     <interface type="ethernet">
Oct 26 00:18:43 user nova-compute[75165]:       <mac address="fa:16:3e:76:6f:05"/>
Oct 26 00:18:43 user nova-compute[75165]:       <model type="virtio"/>
Oct 26 00:18:43 user nova-compute[75165]:       <mtu size="1442"/>
Oct 26 00:18:43 user nova-compute[75165]:       <target dev="tap1964255b-cf"/>
Oct 26 00:18:43 user nova-compute[75165]:     </interface>
Oct 26 00:18:43 user nova-compute[75165]:     <serial type="pty">
Oct 26 00:18:43 user nova-compute[75165]:       <log file="/opt/stack/data/nova/instances/b041e0af-4635-495c-b72d-fbbbd8d43a9b/console.log" append="off"/>
Oct 26 00:18:43 user nova-compute[75165]:     </serial>
Oct 26 00:18:43 user nova-compute[75165]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 00:18:43 user nova-compute[75165]:     <video>
Oct 26 00:18:43 user nova-compute[75165]:       <model type="virtio"/>
Oct 26 00:18:43 user nova-compute[75165]:     </video>
Oct 26 00:18:43 user nova-compute[75165]:     <rng model="virtio">
Oct 26 00:18:43 user nova-compute[75165]:       <backend model="random">/dev/urandom</backend>
Oct 26 00:18:43 user nova-compute[75165]:     </rng>
Oct 26 00:18:43 user nova-compute[75165]:     <controller type="usb" index="0" model="none"/>
Oct 26 00:18:43 user nova-compute[75165]:     <memballoon model="virtio">
Oct 26 00:18:43 user nova-compute[75165]:       <stats period="10"/>
Oct 26 00:18:43 user nova-compute[75165]:     </memballoon>
Oct 26 00:18:43 user nova-compute[75165]:   </devices>
Oct 26 00:18:43 user nova-compute[75165]: </domain>
Oct 26 00:18:43 user nova-compute[75165]:  {{(pid=75165) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 00:18:43 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-c3611511-cd6f-42d4-8f89-e481da049524 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-26T00:14:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1018278796',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1018278796',id=21,image_ref='9a1997e4-5869-4d2a-97ae-53b83fbdca54',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1875668396',keypairs=<?>,launch_index=0,launched_at=2023-10-26T00:14:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='920152101768459baa71010b380ea8f1',ramdisk_id='',reservation_id='r-agpdy52s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-6636270',owner_user_name='tempest-AttachVolumeShelveTestJSON-6636270-project-member',shelved_at='2023-10-26T00:16:47.954892',shelved_host='user',shelved_image_id='9a1997e4-5869-4d2a-97ae-53b83fbdca54'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T00:18:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a40cb1b08014444686bd0adad03f6c68',uuid=b041e0af-4635-495c-b72d-fbbbd8d43a9b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "1964255b-cf1e-4e17-a1f7-ae5d6ea25aef", "address": "fa:16:3e:76:6f:05", "network": {"id": "f54e2e9f-5c1e-44ca-bd4b-9cf0747b0f72", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-806146051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "920152101768459baa71010b380ea8f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1964255b-cf", "ovs_interfaceid": "1964255b-cf1e-4e17-a1f7-ae5d6ea25aef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 00:18:43 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-c3611511-cd6f-42d4-8f89-e481da049524 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Converting VIF {"id": "1964255b-cf1e-4e17-a1f7-ae5d6ea25aef", "address": "fa:16:3e:76:6f:05", "network": {"id": "f54e2e9f-5c1e-44ca-bd4b-9cf0747b0f72", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-806146051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "920152101768459baa71010b380ea8f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1964255b-cf", "ovs_interfaceid": "1964255b-cf1e-4e17-a1f7-ae5d6ea25aef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:18:43 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-c3611511-cd6f-42d4-8f89-e481da049524 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:6f:05,bridge_name='br-int',has_traffic_filtering=True,id=1964255b-cf1e-4e17-a1f7-ae5d6ea25aef,network=Network(f54e2e9f-5c1e-44ca-bd4b-9cf0747b0f72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1964255b-cf') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:18:43 user nova-compute[75165]: DEBUG os_vif [None req-c3611511-cd6f-42d4-8f89-e481da049524 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:6f:05,bridge_name='br-int',has_traffic_filtering=True,id=1964255b-cf1e-4e17-a1f7-ae5d6ea25aef,network=Network(f54e2e9f-5c1e-44ca-bd4b-9cf0747b0f72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1964255b-cf') {{(pid=75165) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 00:18:43 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:18:43 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:18:43 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 00:18:43 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:18:43 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '81c40ebc-a9b8-59f7-896c-ce5f6d734092', '_type': 'linux-noop'}}, row=False) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:18:43 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:18:43 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:18:43 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:18:43 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1964255b-cf, may_exist=True, interface_attrs={}) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:18:43 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1964255b-cf, col_values=(('qos', UUID('c40381ad-1696-4cd6-8261-48e192625969')),), if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:18:43 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1964255b-cf, col_values=(('external_ids', {'iface-id': '1964255b-cf1e-4e17-a1f7-ae5d6ea25aef', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:76:6f:05', 'vm-uuid': 'b041e0af-4635-495c-b72d-fbbbd8d43a9b'}),), if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:18:43 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:18:43 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:18:43 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:18:43 user nova-compute[75165]: INFO os_vif [None req-c3611511-cd6f-42d4-8f89-e481da049524 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:6f:05,bridge_name='br-int',has_traffic_filtering=True,id=1964255b-cf1e-4e17-a1f7-ae5d6ea25aef,network=Network(f54e2e9f-5c1e-44ca-bd4b-9cf0747b0f72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1964255b-cf')
Oct 26 00:18:43 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-c3611511-cd6f-42d4-8f89-e481da049524 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] No BDM found with device name vda, not building metadata. {{(pid=75165) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 00:18:43 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-c3611511-cd6f-42d4-8f89-e481da049524 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] No VIF found with MAC fa:16:3e:76:6f:05, not building metadata {{(pid=75165) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 00:18:44 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:18:45 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:18:45 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:18:45 user nova-compute[75165]: DEBUG nova.compute.manager [req-ba0199ac-0731-4dc7-a9e2-ced587e4fd9a req-f6942f8f-f02d-49d9-a96b-039d76c71d01 service nova] [instance: b041e0af-4635-495c-b72d-fbbbd8d43a9b] Received event network-vif-plugged-1964255b-cf1e-4e17-a1f7-ae5d6ea25aef {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:18:45 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-ba0199ac-0731-4dc7-a9e2-ced587e4fd9a req-f6942f8f-f02d-49d9-a96b-039d76c71d01 service nova] Acquiring lock "b041e0af-4635-495c-b72d-fbbbd8d43a9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:18:45 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-ba0199ac-0731-4dc7-a9e2-ced587e4fd9a req-f6942f8f-f02d-49d9-a96b-039d76c71d01 service nova] Lock "b041e0af-4635-495c-b72d-fbbbd8d43a9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:18:45 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-ba0199ac-0731-4dc7-a9e2-ced587e4fd9a req-f6942f8f-f02d-49d9-a96b-039d76c71d01 service nova] Lock "b041e0af-4635-495c-b72d-fbbbd8d43a9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:18:45 user nova-compute[75165]: DEBUG nova.compute.manager [req-ba0199ac-0731-4dc7-a9e2-ced587e4fd9a req-f6942f8f-f02d-49d9-a96b-039d76c71d01 service nova] [instance: b041e0af-4635-495c-b72d-fbbbd8d43a9b] No waiting events found dispatching network-vif-plugged-1964255b-cf1e-4e17-a1f7-ae5d6ea25aef {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:18:45 user nova-compute[75165]: WARNING nova.compute.manager [req-ba0199ac-0731-4dc7-a9e2-ced587e4fd9a req-f6942f8f-f02d-49d9-a96b-039d76c71d01 service nova] [instance: b041e0af-4635-495c-b72d-fbbbd8d43a9b] Received unexpected event network-vif-plugged-1964255b-cf1e-4e17-a1f7-ae5d6ea25aef for instance with vm_state shelved_offloaded and task_state spawning.
Oct 26 00:18:45 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:18:45 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:18:45 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:18:45 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:18:46 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:18:47 user nova-compute[75165]: DEBUG nova.compute.manager [req-769dcced-78c4-48dd-bf1c-adb1c0a355f2 req-fc215580-5dd9-46f4-944c-1bb18bff35cb service nova] [instance: b041e0af-4635-495c-b72d-fbbbd8d43a9b] Received event network-vif-plugged-1964255b-cf1e-4e17-a1f7-ae5d6ea25aef {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:18:47 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-769dcced-78c4-48dd-bf1c-adb1c0a355f2 req-fc215580-5dd9-46f4-944c-1bb18bff35cb service nova] Acquiring lock "b041e0af-4635-495c-b72d-fbbbd8d43a9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:18:47 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-769dcced-78c4-48dd-bf1c-adb1c0a355f2 req-fc215580-5dd9-46f4-944c-1bb18bff35cb service nova] Lock "b041e0af-4635-495c-b72d-fbbbd8d43a9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:18:47 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-769dcced-78c4-48dd-bf1c-adb1c0a355f2 req-fc215580-5dd9-46f4-944c-1bb18bff35cb service nova] Lock "b041e0af-4635-495c-b72d-fbbbd8d43a9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:18:47 user nova-compute[75165]: DEBUG nova.compute.manager [req-769dcced-78c4-48dd-bf1c-adb1c0a355f2 req-fc215580-5dd9-46f4-944c-1bb18bff35cb service nova] [instance: b041e0af-4635-495c-b72d-fbbbd8d43a9b] No waiting events found dispatching network-vif-plugged-1964255b-cf1e-4e17-a1f7-ae5d6ea25aef {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:18:47 user nova-compute[75165]: WARNING nova.compute.manager [req-769dcced-78c4-48dd-bf1c-adb1c0a355f2 req-fc215580-5dd9-46f4-944c-1bb18bff35cb service nova] [instance: b041e0af-4635-495c-b72d-fbbbd8d43a9b] Received unexpected event network-vif-plugged-1964255b-cf1e-4e17-a1f7-ae5d6ea25aef for instance with vm_state shelved_offloaded and task_state spawning.
Oct 26 00:18:47 user nova-compute[75165]: DEBUG nova.compute.manager [None req-c3611511-cd6f-42d4-8f89-e481da049524 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] [instance: b041e0af-4635-495c-b72d-fbbbd8d43a9b] Instance event wait completed in 0 seconds for  {{(pid=75165) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 00:18:47 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-c3611511-cd6f-42d4-8f89-e481da049524 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] [instance: b041e0af-4635-495c-b72d-fbbbd8d43a9b] Guest created on hypervisor {{(pid=75165) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 00:18:47 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: b041e0af-4635-495c-b72d-fbbbd8d43a9b] Instance spawned successfully.
Oct 26 00:18:47 user nova-compute[75165]: DEBUG nova.compute.manager [None req-c3611511-cd6f-42d4-8f89-e481da049524 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] [instance: b041e0af-4635-495c-b72d-fbbbd8d43a9b] Checking state {{(pid=75165) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 00:18:48 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-c3611511-cd6f-42d4-8f89-e481da049524 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Lock "b041e0af-4635-495c-b72d-fbbbd8d43a9b" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 12.295s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:18:48 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:18:48 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:18:51 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:18:53 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:18:54 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:18:56 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:18:56 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:18:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:18:59 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-93abecdb-ba6e-4818-a8c9-fb661b438978 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b6558510-6f87-4ef3-b707-f1fa78bf61e8 is timed out.
Oct 26 00:18:59 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-93abecdb-ba6e-4818-a8c9-fb661b438978 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] Successfully detached device vdb from instance b6558510-6f87-4ef3-b707-f1fa78bf61e8 from the live domain config.
Oct 26 00:18:59 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-93abecdb-ba6e-4818-a8c9-fb661b438978 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] [instance: b6558510-6f87-4ef3-b707-f1fa78bf61e8] calling os-brick to detach iSCSI Volume {{(pid=75165) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 00:18:59 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-93abecdb-ba6e-4818-a8c9-fb661b438978 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8bf8160e50>, {'target_iqn': 'iqn.2010-10.org.openstack:6c0013a0-b960-49c6-8287-75b4c373e0a3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eCNqrOoF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:18:59 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-93abecdb-ba6e-4818-a8c9-fb661b438978 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:18:59 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-93abecdb-ba6e-4818-a8c9-fb661b438978 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:18:59 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-93abecdb-ba6e-4818-a8c9-fb661b438978 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:18:59 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:18:59 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:18:59 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[f395fd3d-6345-4662-9a7b-4336445f067b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f06e40e7-3ca1-4a25-bd11-ff01280c6df2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6c0013a0-b960-49c6-8287-75b4c373e0a3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f431d8b9-aa1e-46f5-b7da-39f4a550e050\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:18:59 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-93abecdb-ba6e-4818-a8c9-fb661b438978 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 00:18:59 user nova-compute[75165]: No targets found.
Oct 26 00:18:59 user nova-compute[75165]: iSNS:
Oct 26 00:18:59 user nova-compute[75165]: No targets found.
Oct 26 00:18:59 user nova-compute[75165]: STATIC:
Oct 26 00:18:59 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:f06e40e7-3ca1-4a25-bd11-ff01280c6df2
Oct 26 00:18:59 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:18:59 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:18:59 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:6c0013a0-b960-49c6-8287-75b4c373e0a3
Oct 26 00:18:59 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:18:59 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:18:59 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:f431d8b9-aa1e-46f5-b7da-39f4a550e050
Oct 26 00:18:59 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:18:59 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:18:59 user nova-compute[75165]: FIRMWARE:
Oct 26 00:18:59 user nova-compute[75165]: No targets found.
Oct 26 00:18:59 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:18:59 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-93abecdb-ba6e-4818-a8c9-fb661b438978 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 00:18:59 user nova-compute[75165]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 00:18:59 user nova-compute[75165]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75165) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 00:18:59 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-93abecdb-ba6e-4818-a8c9-fb661b438978 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c0013a0-b960-49c6-8287-75b4c373e0a3', 0)] {{(pid=75165) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 00:18:59 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:18:59 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:18:59 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[470f9ca1-7b22-4dd9-a5e0-62d27047a917]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c0013a0-b960-49c6-8287-75b4c373e0a3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f06e40e7-3ca1-4a25-bd11-ff01280c6df2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f431d8b9-aa1e-46f5-b7da-39f4a550e050\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:18:59 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:18:59 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:18:59 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad6533f3-cdda-4f49-bce9-0d8618c9c319]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f431d8b9-aa1e-46f5-b7da-39f4a550e050 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f06e40e7-3ca1-4a25-bd11-ff01280c6df2 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c0013a0-b960-49c6-8287-75b4c373e0a3 (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:18:59 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-93abecdb-ba6e-4818-a8c9-fb661b438978 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f431d8b9-aa1e-46f5-b7da-39f4a550e050 (non-flash)
Oct 26 00:18:59 user nova-compute[75165]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f06e40e7-3ca1-4a25-bd11-ff01280c6df2 (non-flash)
Oct 26 00:18:59 user nova-compute[75165]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c0013a0-b960-49c6-8287-75b4c373e0a3 (non-flash)
Oct 26 00:18:59 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:18:59 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-93abecdb-ba6e-4818-a8c9-fb661b438978 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f431d8b9-aa1e-46f5-b7da-39f4a550e050 (non-flash)
Oct 26 00:18:59 user nova-compute[75165]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f06e40e7-3ca1-4a25-bd11-ff01280c6df2 (non-flash)
Oct 26 00:18:59 user nova-compute[75165]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c0013a0-b960-49c6-8287-75b4c373e0a3 (non-flash)
Oct 26 00:18:59 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:18:59 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-93abecdb-ba6e-4818-a8c9-fb661b438978 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8c014f76d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c0013a0-b960-49c6-8287-75b4c373e0a3'): ({'sdd'}, set())}) {{(pid=75165) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 00:18:59 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-93abecdb-ba6e-4818-a8c9-fb661b438978 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] Removing single pathed devices sdd {{(pid=75165) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 00:18:59 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:18:59 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:18:59 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cf0a2cd-901f-4aed-bc76-398100c455a0]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:18:59 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:18:59 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:18:59 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed02986f-9ed3-475e-a93c-cd6ca50828a3]: (4, ('ok\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:18:59 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-93abecdb-ba6e-4818-a8c9-fb661b438978 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] Flushing IO for device /dev/sdd {{(pid=75165) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 00:18:59 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:18:59 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:18:59 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3dcafc4-e02c-4dc7-b5df-4c48ae844bdc]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:18:59 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-93abecdb-ba6e-4818-a8c9-fb661b438978 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75165) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 00:18:59 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:19:00 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.041s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:19:00 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[60e4a609-97dc-40be-a7c3-5e82cd839f41]: (4, ('1', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:19:00 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-93abecdb-ba6e-4818-a8c9-fb661b438978 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75165) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 00:19:00 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-93abecdb-ba6e-4818-a8c9-fb661b438978 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] SCSI volumes sdd have been removed. {{(pid=75165) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 00:19:00 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-93abecdb-ba6e-4818-a8c9-fb661b438978 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c0013a0-b960-49c6-8287-75b4c373e0a3')] {{(pid=75165) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 00:19:00 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c0013a0-b960-49c6-8287-75b4c373e0a3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:19:00 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c0013a0-b960-49c6-8287-75b4c373e0a3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:19:00 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[41be5162-9831-4429-b20b-df60f1ee1a22]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:19:00 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-93abecdb-ba6e-4818-a8c9-fb661b438978 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:19:00 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c0013a0-b960-49c6-8287-75b4c373e0a3 -p 172.16.0.220:3260 --logout {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:19:00 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c0013a0-b960-49c6-8287-75b4c373e0a3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:19:00 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[baddd06d-867f-4348-9716-7fd6455bc8e0]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:6c0013a0-b960-49c6-8287-75b4c373e0a3, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:6c0013a0-b960-49c6-8287-75b4c373e0a3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:19:00 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-93abecdb-ba6e-4818-a8c9-fb661b438978 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:6c0013a0-b960-49c6-8287-75b4c373e0a3, portal: 172.16.0.220,3260]
Oct 26 00:19:00 user nova-compute[75165]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:6c0013a0-b960-49c6-8287-75b4c373e0a3, portal: 172.16.0.220,3260] successful.
Oct 26 00:19:00 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:19:00 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c0013a0-b960-49c6-8287-75b4c373e0a3 -p 172.16.0.220:3260 --op delete {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:19:00 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c0013a0-b960-49c6-8287-75b4c373e0a3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:19:00 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6579070-d3c5-47c3-ba07-939a41c78cab]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:19:00 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-93abecdb-ba6e-4818-a8c9-fb661b438978 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:19:00 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-93abecdb-ba6e-4818-a8c9-fb661b438978 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.326s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:19:00 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-93abecdb-ba6e-4818-a8c9-fb661b438978 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] <== disconnect_volume: return (328ms) None {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:19:00 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-93abecdb-ba6e-4818-a8c9-fb661b438978 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] [instance: b6558510-6f87-4ef3-b707-f1fa78bf61e8] Disconnected iSCSI Volume {{(pid=75165) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 00:19:00 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:19:01 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:19:02 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:19:03 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:19:03 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:19:04 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-e2088fe4-02e5-4d06-a933-697ccfff5f16 tempest-VolumesActionsTest-964746875 tempest-VolumesActionsTest-964746875-project-member] Acquiring lock "8e847329-ad09-450d-854b-468a3b8bdf60" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:19:04 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-e2088fe4-02e5-4d06-a933-697ccfff5f16 tempest-VolumesActionsTest-964746875 tempest-VolumesActionsTest-964746875-project-member] Lock "8e847329-ad09-450d-854b-468a3b8bdf60" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:19:04 user nova-compute[75165]: DEBUG nova.compute.manager [None req-e2088fe4-02e5-4d06-a933-697ccfff5f16 tempest-VolumesActionsTest-964746875 tempest-VolumesActionsTest-964746875-project-member] [instance: 8e847329-ad09-450d-854b-468a3b8bdf60] Starting instance... {{(pid=75165) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 00:19:04 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-e2088fe4-02e5-4d06-a933-697ccfff5f16 tempest-VolumesActionsTest-964746875 tempest-VolumesActionsTest-964746875-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:19:04 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-e2088fe4-02e5-4d06-a933-697ccfff5f16 tempest-VolumesActionsTest-964746875 tempest-VolumesActionsTest-964746875-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:19:04 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-e2088fe4-02e5-4d06-a933-697ccfff5f16 tempest-VolumesActionsTest-964746875 tempest-VolumesActionsTest-964746875-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75165) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 00:19:04 user nova-compute[75165]: INFO nova.compute.claims [None req-e2088fe4-02e5-4d06-a933-697ccfff5f16 tempest-VolumesActionsTest-964746875 tempest-VolumesActionsTest-964746875-project-member] [instance: 8e847329-ad09-450d-854b-468a3b8bdf60] Claim successful on node user
Oct 26 00:19:04 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-e2088fe4-02e5-4d06-a933-697ccfff5f16 tempest-VolumesActionsTest-964746875 tempest-VolumesActionsTest-964746875-project-member] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:19:04 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-e2088fe4-02e5-4d06-a933-697ccfff5f16 tempest-VolumesActionsTest-964746875 tempest-VolumesActionsTest-964746875-project-member] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:19:04 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-e2088fe4-02e5-4d06-a933-697ccfff5f16 tempest-VolumesActionsTest-964746875 tempest-VolumesActionsTest-964746875-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.397s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:19:04 user nova-compute[75165]: DEBUG nova.compute.manager [None req-e2088fe4-02e5-4d06-a933-697ccfff5f16 tempest-VolumesActionsTest-964746875 tempest-VolumesActionsTest-964746875-project-member] [instance: 8e847329-ad09-450d-854b-468a3b8bdf60] Start building networks asynchronously for instance. {{(pid=75165) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 00:19:04 user nova-compute[75165]: DEBUG nova.compute.manager [None req-e2088fe4-02e5-4d06-a933-697ccfff5f16 tempest-VolumesActionsTest-964746875 tempest-VolumesActionsTest-964746875-project-member] [instance: 8e847329-ad09-450d-854b-468a3b8bdf60] Allocating IP information in the background. {{(pid=75165) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 00:19:04 user nova-compute[75165]: DEBUG nova.network.neutron [None req-e2088fe4-02e5-4d06-a933-697ccfff5f16 tempest-VolumesActionsTest-964746875 tempest-VolumesActionsTest-964746875-project-member] [instance: 8e847329-ad09-450d-854b-468a3b8bdf60] allocate_for_instance() {{(pid=75165) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 00:19:04 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-e2088fe4-02e5-4d06-a933-697ccfff5f16 tempest-VolumesActionsTest-964746875 tempest-VolumesActionsTest-964746875-project-member] [instance: 8e847329-ad09-450d-854b-468a3b8bdf60] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 00:19:04 user nova-compute[75165]: DEBUG nova.compute.manager [None req-e2088fe4-02e5-4d06-a933-697ccfff5f16 tempest-VolumesActionsTest-964746875 tempest-VolumesActionsTest-964746875-project-member] [instance: 8e847329-ad09-450d-854b-468a3b8bdf60] Start building block device mappings for instance. {{(pid=75165) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 00:19:04 user nova-compute[75165]: DEBUG nova.policy [None req-e2088fe4-02e5-4d06-a933-697ccfff5f16 tempest-VolumesActionsTest-964746875 tempest-VolumesActionsTest-964746875-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1bdac2b15e794e0da5ed2fd4740712ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac36ea060d7f4e43b4ff69ff32afd8a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75165) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 00:19:04 user nova-compute[75165]: DEBUG nova.compute.manager [None req-e2088fe4-02e5-4d06-a933-697ccfff5f16 tempest-VolumesActionsTest-964746875 tempest-VolumesActionsTest-964746875-project-member] [instance: 8e847329-ad09-450d-854b-468a3b8bdf60] Start spawning the instance on the hypervisor. {{(pid=75165) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 00:19:04 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-e2088fe4-02e5-4d06-a933-697ccfff5f16 tempest-VolumesActionsTest-964746875 tempest-VolumesActionsTest-964746875-project-member] [instance: 8e847329-ad09-450d-854b-468a3b8bdf60] Creating instance directory {{(pid=75165) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 00:19:04 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-e2088fe4-02e5-4d06-a933-697ccfff5f16 tempest-VolumesActionsTest-964746875 tempest-VolumesActionsTest-964746875-project-member] [instance: 8e847329-ad09-450d-854b-468a3b8bdf60] Creating image(s)
Oct 26 00:19:04 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-e2088fe4-02e5-4d06-a933-697ccfff5f16 tempest-VolumesActionsTest-964746875 tempest-VolumesActionsTest-964746875-project-member] Acquiring lock "/opt/stack/data/nova/instances/8e847329-ad09-450d-854b-468a3b8bdf60/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:19:04 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-e2088fe4-02e5-4d06-a933-697ccfff5f16 tempest-VolumesActionsTest-964746875 tempest-VolumesActionsTest-964746875-project-member] Lock "/opt/stack/data/nova/instances/8e847329-ad09-450d-854b-468a3b8bdf60/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:19:04 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-e2088fe4-02e5-4d06-a933-697ccfff5f16 tempest-VolumesActionsTest-964746875 tempest-VolumesActionsTest-964746875-project-member] Lock "/opt/stack/data/nova/instances/8e847329-ad09-450d-854b-468a3b8bdf60/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:19:04 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-e2088fe4-02e5-4d06-a933-697ccfff5f16 tempest-VolumesActionsTest-964746875 tempest-VolumesActionsTest-964746875-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:19:05 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-e2088fe4-02e5-4d06-a933-697ccfff5f16 tempest-VolumesActionsTest-964746875 tempest-VolumesActionsTest-964746875-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json" returned: 0 in 0.205s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:19:05 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-e2088fe4-02e5-4d06-a933-697ccfff5f16 tempest-VolumesActionsTest-964746875 tempest-VolumesActionsTest-964746875-project-member] Acquiring lock "7d3243421cf3fdc288b758f687a93103b7b95466" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:19:05 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-e2088fe4-02e5-4d06-a933-697ccfff5f16 tempest-VolumesActionsTest-964746875 tempest-VolumesActionsTest-964746875-project-member] Lock "7d3243421cf3fdc288b758f687a93103b7b95466" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:19:05 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-e2088fe4-02e5-4d06-a933-697ccfff5f16 tempest-VolumesActionsTest-964746875 tempest-VolumesActionsTest-964746875-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:19:05 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-e2088fe4-02e5-4d06-a933-697ccfff5f16 tempest-VolumesActionsTest-964746875 tempest-VolumesActionsTest-964746875-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json" returned: 0 in 0.170s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:19:05 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-e2088fe4-02e5-4d06-a933-697ccfff5f16 tempest-VolumesActionsTest-964746875 tempest-VolumesActionsTest-964746875-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466,backing_fmt=raw /opt/stack/data/nova/instances/8e847329-ad09-450d-854b-468a3b8bdf60/disk 1073741824 {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:19:05 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-e2088fe4-02e5-4d06-a933-697ccfff5f16 tempest-VolumesActionsTest-964746875 tempest-VolumesActionsTest-964746875-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466,backing_fmt=raw /opt/stack/data/nova/instances/8e847329-ad09-450d-854b-468a3b8bdf60/disk 1073741824" returned: 0 in 0.062s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:19:05 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-e2088fe4-02e5-4d06-a933-697ccfff5f16 tempest-VolumesActionsTest-964746875 tempest-VolumesActionsTest-964746875-project-member] Lock "7d3243421cf3fdc288b758f687a93103b7b95466" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:19:05 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-e2088fe4-02e5-4d06-a933-697ccfff5f16 tempest-VolumesActionsTest-964746875 tempest-VolumesActionsTest-964746875-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:19:05 user nova-compute[75165]: DEBUG nova.network.neutron [None req-e2088fe4-02e5-4d06-a933-697ccfff5f16 tempest-VolumesActionsTest-964746875 tempest-VolumesActionsTest-964746875-project-member] [instance: 8e847329-ad09-450d-854b-468a3b8bdf60] Successfully created port: 7bc04115-a6b3-4514-b72d-4b73aa5fe793 {{(pid=75165) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 00:19:05 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-e2088fe4-02e5-4d06-a933-697ccfff5f16 tempest-VolumesActionsTest-964746875 tempest-VolumesActionsTest-964746875-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json" returned: 0 in 0.178s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:19:05 user nova-compute[75165]: DEBUG nova.virt.disk.api [None req-e2088fe4-02e5-4d06-a933-697ccfff5f16 tempest-VolumesActionsTest-964746875 tempest-VolumesActionsTest-964746875-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8e847329-ad09-450d-854b-468a3b8bdf60/disk. size=1073741824 {{(pid=75165) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 00:19:05 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-e2088fe4-02e5-4d06-a933-697ccfff5f16 tempest-VolumesActionsTest-964746875 tempest-VolumesActionsTest-964746875-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e847329-ad09-450d-854b-468a3b8bdf60/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:19:05 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-e2088fe4-02e5-4d06-a933-697ccfff5f16 tempest-VolumesActionsTest-964746875 tempest-VolumesActionsTest-964746875-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e847329-ad09-450d-854b-468a3b8bdf60/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:19:05 user nova-compute[75165]: DEBUG nova.virt.disk.api [None req-e2088fe4-02e5-4d06-a933-697ccfff5f16 tempest-VolumesActionsTest-964746875 tempest-VolumesActionsTest-964746875-project-member] Cannot resize image /opt/stack/data/nova/instances/8e847329-ad09-450d-854b-468a3b8bdf60/disk to a smaller size. {{(pid=75165) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 00:19:05 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-e2088fe4-02e5-4d06-a933-697ccfff5f16 tempest-VolumesActionsTest-964746875 tempest-VolumesActionsTest-964746875-project-member] [instance: 8e847329-ad09-450d-854b-468a3b8bdf60] Created local disks {{(pid=75165) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 00:19:05 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-e2088fe4-02e5-4d06-a933-697ccfff5f16 tempest-VolumesActionsTest-964746875 tempest-VolumesActionsTest-964746875-project-member] [instance: 8e847329-ad09-450d-854b-468a3b8bdf60] Ensure instance console log exists: /opt/stack/data/nova/instances/8e847329-ad09-450d-854b-468a3b8bdf60/console.log {{(pid=75165) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 00:19:05 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-e2088fe4-02e5-4d06-a933-697ccfff5f16 tempest-VolumesActionsTest-964746875 tempest-VolumesActionsTest-964746875-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:19:05 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-e2088fe4-02e5-4d06-a933-697ccfff5f16 tempest-VolumesActionsTest-964746875 tempest-VolumesActionsTest-964746875-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:19:05 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-e2088fe4-02e5-4d06-a933-697ccfff5f16 tempest-VolumesActionsTest-964746875 tempest-VolumesActionsTest-964746875-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:19:05 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:19:05 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75165) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 00:19:06 user nova-compute[75165]: DEBUG nova.objects.instance [None req-93abecdb-ba6e-4818-a8c9-fb661b438978 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] Lazy-loading 'flavor' on Instance uuid b6558510-6f87-4ef3-b707-f1fa78bf61e8 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:19:06 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-93abecdb-ba6e-4818-a8c9-fb661b438978 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] Lock "b6558510-6f87-4ef3-b707-f1fa78bf61e8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 27.214s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:19:06 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:19:06 user nova-compute[75165]: DEBUG nova.network.neutron [None req-e2088fe4-02e5-4d06-a933-697ccfff5f16 tempest-VolumesActionsTest-964746875 tempest-VolumesActionsTest-964746875-project-member] [instance: 8e847329-ad09-450d-854b-468a3b8bdf60] Successfully updated port: 7bc04115-a6b3-4514-b72d-4b73aa5fe793 {{(pid=75165) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 00:19:06 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-e2088fe4-02e5-4d06-a933-697ccfff5f16 tempest-VolumesActionsTest-964746875 tempest-VolumesActionsTest-964746875-project-member] Acquiring lock "refresh_cache-8e847329-ad09-450d-854b-468a3b8bdf60" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:19:06 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-e2088fe4-02e5-4d06-a933-697ccfff5f16 tempest-VolumesActionsTest-964746875 tempest-VolumesActionsTest-964746875-project-member] Acquired lock "refresh_cache-8e847329-ad09-450d-854b-468a3b8bdf60" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:19:06 user nova-compute[75165]: DEBUG nova.network.neutron [None req-e2088fe4-02e5-4d06-a933-697ccfff5f16 tempest-VolumesActionsTest-964746875 tempest-VolumesActionsTest-964746875-project-member] [instance: 8e847329-ad09-450d-854b-468a3b8bdf60] Building network info cache for instance {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 00:19:06 user nova-compute[75165]: DEBUG nova.compute.manager [req-a27ccd3c-c8b6-4194-9782-c497108db7a9 req-29d31446-10ef-4c91-84ce-4c6aedcac4aa service nova] [instance: 8e847329-ad09-450d-854b-468a3b8bdf60] Received event network-changed-7bc04115-a6b3-4514-b72d-4b73aa5fe793 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:19:06 user nova-compute[75165]: DEBUG nova.compute.manager [req-a27ccd3c-c8b6-4194-9782-c497108db7a9 req-29d31446-10ef-4c91-84ce-4c6aedcac4aa service nova] [instance: 8e847329-ad09-450d-854b-468a3b8bdf60] Refreshing instance network info cache due to event network-changed-7bc04115-a6b3-4514-b72d-4b73aa5fe793. {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 00:19:06 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-a27ccd3c-c8b6-4194-9782-c497108db7a9 req-29d31446-10ef-4c91-84ce-4c6aedcac4aa service nova] Acquiring lock "refresh_cache-8e847329-ad09-450d-854b-468a3b8bdf60" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:19:06 user nova-compute[75165]: DEBUG nova.network.neutron [None req-e2088fe4-02e5-4d06-a933-697ccfff5f16 tempest-VolumesActionsTest-964746875 tempest-VolumesActionsTest-964746875-project-member] [instance: 8e847329-ad09-450d-854b-468a3b8bdf60] Instance cache missing network info. {{(pid=75165) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 00:19:06 user nova-compute[75165]: DEBUG nova.network.neutron [None req-e2088fe4-02e5-4d06-a933-697ccfff5f16 tempest-VolumesActionsTest-964746875 tempest-VolumesActionsTest-964746875-project-member] [instance: 8e847329-ad09-450d-854b-468a3b8bdf60] Updating instance_info_cache with network_info: [{"id": "7bc04115-a6b3-4514-b72d-4b73aa5fe793", "address": "fa:16:3e:fb:a0:6b", "network": {"id": "302fba99-ca6c-41be-895d-a534355a2ffa", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1221818499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac36ea060d7f4e43b4ff69ff32afd8a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bc04115-a6", "ovs_interfaceid": "7bc04115-a6b3-4514-b72d-4b73aa5fe793", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:19:06 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-e2088fe4-02e5-4d06-a933-697ccfff5f16 tempest-VolumesActionsTest-964746875 tempest-VolumesActionsTest-964746875-project-member] Releasing lock "refresh_cache-8e847329-ad09-450d-854b-468a3b8bdf60" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:19:06 user nova-compute[75165]: DEBUG nova.compute.manager [None req-e2088fe4-02e5-4d06-a933-697ccfff5f16 tempest-VolumesActionsTest-964746875 tempest-VolumesActionsTest-964746875-project-member] [instance: 8e847329-ad09-450d-854b-468a3b8bdf60] Instance network_info: |[{"id": "7bc04115-a6b3-4514-b72d-4b73aa5fe793", "address": "fa:16:3e:fb:a0:6b", "network": {"id": "302fba99-ca6c-41be-895d-a534355a2ffa", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1221818499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac36ea060d7f4e43b4ff69ff32afd8a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bc04115-a6", "ovs_interfaceid": "7bc04115-a6b3-4514-b72d-4b73aa5fe793", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75165) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 00:19:06 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-a27ccd3c-c8b6-4194-9782-c497108db7a9 req-29d31446-10ef-4c91-84ce-4c6aedcac4aa service nova] Acquired lock "refresh_cache-8e847329-ad09-450d-854b-468a3b8bdf60" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:19:06 user nova-compute[75165]: DEBUG nova.network.neutron [req-a27ccd3c-c8b6-4194-9782-c497108db7a9 req-29d31446-10ef-4c91-84ce-4c6aedcac4aa service nova] [instance: 8e847329-ad09-450d-854b-468a3b8bdf60] Refreshing network info cache for port 7bc04115-a6b3-4514-b72d-4b73aa5fe793 {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 00:19:06 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-e2088fe4-02e5-4d06-a933-697ccfff5f16 tempest-VolumesActionsTest-964746875 tempest-VolumesActionsTest-964746875-project-member] [instance: 8e847329-ad09-450d-854b-468a3b8bdf60] Start _get_guest_xml network_info=[{"id": "7bc04115-a6b3-4514-b72d-4b73aa5fe793", "address": "fa:16:3e:fb:a0:6b", "network": {"id": "302fba99-ca6c-41be-895d-a534355a2ffa", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1221818499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac36ea060d7f4e43b4ff69ff32afd8a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bc04115-a6", "ovs_interfaceid": "7bc04115-a6b3-4514-b72d-4b73aa5fe793", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T00:03:24Z,direct_url=<?>,disk_format='qcow2',id=bff0d8a1-739e-4c4d-9efa-b73ba7b76d01,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e56bbf444fd34c348475c73673611447',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T00:03:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'size': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': 'bff0d8a1-739e-4c4d-9efa-b73ba7b76d01'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75165) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 00:19:06 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-e2088fe4-02e5-4d06-a933-697ccfff5f16 tempest-VolumesActionsTest-964746875 tempest-VolumesActionsTest-964746875-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:19:06 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-e2088fe4-02e5-4d06-a933-697ccfff5f16 tempest-VolumesActionsTest-964746875 tempest-VolumesActionsTest-964746875-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:19:06 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-e2088fe4-02e5-4d06-a933-697ccfff5f16 tempest-VolumesActionsTest-964746875 tempest-VolumesActionsTest-964746875-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75165) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 00:19:06 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-e2088fe4-02e5-4d06-a933-697ccfff5f16 tempest-VolumesActionsTest-964746875 tempest-VolumesActionsTest-964746875-project-member] CPU controller missing on host. {{(pid=75165) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 00:19:06 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-e2088fe4-02e5-4d06-a933-697ccfff5f16 tempest-VolumesActionsTest-964746875 tempest-VolumesActionsTest-964746875-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75165) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 00:19:06 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-e2088fe4-02e5-4d06-a933-697ccfff5f16 tempest-VolumesActionsTest-964746875 tempest-VolumesActionsTest-964746875-project-member] CPU controller found on host. {{(pid=75165) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 00:19:06 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-e2088fe4-02e5-4d06-a933-697ccfff5f16 tempest-VolumesActionsTest-964746875 tempest-VolumesActionsTest-964746875-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75165) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 00:19:06 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-e2088fe4-02e5-4d06-a933-697ccfff5f16 tempest-VolumesActionsTest-964746875 tempest-VolumesActionsTest-964746875-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T00:03:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T00:03:24Z,direct_url=<?>,disk_format='qcow2',id=bff0d8a1-739e-4c4d-9efa-b73ba7b76d01,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e56bbf444fd34c348475c73673611447',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T00:03:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 00:19:06 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-e2088fe4-02e5-4d06-a933-697ccfff5f16 tempest-VolumesActionsTest-964746875 tempest-VolumesActionsTest-964746875-project-member] Flavor limits 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 00:19:06 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-e2088fe4-02e5-4d06-a933-697ccfff5f16 tempest-VolumesActionsTest-964746875 tempest-VolumesActionsTest-964746875-project-member] Image limits 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 00:19:06 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-e2088fe4-02e5-4d06-a933-697ccfff5f16 tempest-VolumesActionsTest-964746875 tempest-VolumesActionsTest-964746875-project-member] Flavor pref 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 00:19:06 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-e2088fe4-02e5-4d06-a933-697ccfff5f16 tempest-VolumesActionsTest-964746875 tempest-VolumesActionsTest-964746875-project-member] Image pref 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 00:19:06 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-e2088fe4-02e5-4d06-a933-697ccfff5f16 tempest-VolumesActionsTest-964746875 tempest-VolumesActionsTest-964746875-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 00:19:06 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-e2088fe4-02e5-4d06-a933-697ccfff5f16 tempest-VolumesActionsTest-964746875 tempest-VolumesActionsTest-964746875-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 00:19:06 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-e2088fe4-02e5-4d06-a933-697ccfff5f16 tempest-VolumesActionsTest-964746875 tempest-VolumesActionsTest-964746875-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75165) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 00:19:06 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-e2088fe4-02e5-4d06-a933-697ccfff5f16 tempest-VolumesActionsTest-964746875 tempest-VolumesActionsTest-964746875-project-member] Got 1 possible topologies {{(pid=75165) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 00:19:06 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-e2088fe4-02e5-4d06-a933-697ccfff5f16 tempest-VolumesActionsTest-964746875 tempest-VolumesActionsTest-964746875-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 00:19:06 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-e2088fe4-02e5-4d06-a933-697ccfff5f16 tempest-VolumesActionsTest-964746875 tempest-VolumesActionsTest-964746875-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 00:19:06 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-e2088fe4-02e5-4d06-a933-697ccfff5f16 tempest-VolumesActionsTest-964746875 tempest-VolumesActionsTest-964746875-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:19:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-459487771',display_name='tempest-VolumesActionsTest-instance-459487771',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-459487771',id=26,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ac36ea060d7f4e43b4ff69ff32afd8a3',ramdisk_id='',reservation_id='r-pk0kfbhp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-964746875',owner_user_name='tempest-VolumesActionsTest-964746875-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T00:19:05Z,user_data=None,user_id='1bdac2b15e794e0da5ed2fd4740712ce',uuid=8e847329-ad09-450d-854b-468a3b8bdf60,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7bc04115-a6b3-4514-b72d-4b73aa5fe793", "address": "fa:16:3e:fb:a0:6b", "network": {"id": "302fba99-ca6c-41be-895d-a534355a2ffa", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1221818499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac36ea060d7f4e43b4ff69ff32afd8a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bc04115-a6", "ovs_interfaceid": "7bc04115-a6b3-4514-b72d-4b73aa5fe793", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75165) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 00:19:06 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-e2088fe4-02e5-4d06-a933-697ccfff5f16 tempest-VolumesActionsTest-964746875 tempest-VolumesActionsTest-964746875-project-member] Converting VIF {"id": "7bc04115-a6b3-4514-b72d-4b73aa5fe793", "address": "fa:16:3e:fb:a0:6b", "network": {"id": "302fba99-ca6c-41be-895d-a534355a2ffa", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1221818499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac36ea060d7f4e43b4ff69ff32afd8a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bc04115-a6", "ovs_interfaceid": "7bc04115-a6b3-4514-b72d-4b73aa5fe793", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:19:06 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-e2088fe4-02e5-4d06-a933-697ccfff5f16 tempest-VolumesActionsTest-964746875 tempest-VolumesActionsTest-964746875-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:a0:6b,bridge_name='br-int',has_traffic_filtering=True,id=7bc04115-a6b3-4514-b72d-4b73aa5fe793,network=Network(302fba99-ca6c-41be-895d-a534355a2ffa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bc04115-a6') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:19:06 user nova-compute[75165]: DEBUG nova.objects.instance [None req-e2088fe4-02e5-4d06-a933-697ccfff5f16 tempest-VolumesActionsTest-964746875 tempest-VolumesActionsTest-964746875-project-member] Lazy-loading 'pci_devices' on Instance uuid 8e847329-ad09-450d-854b-468a3b8bdf60 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:19:06 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-e2088fe4-02e5-4d06-a933-697ccfff5f16 tempest-VolumesActionsTest-964746875 tempest-VolumesActionsTest-964746875-project-member] [instance: 8e847329-ad09-450d-854b-468a3b8bdf60] End _get_guest_xml xml=<domain type="kvm">
Oct 26 00:19:06 user nova-compute[75165]:   <uuid>8e847329-ad09-450d-854b-468a3b8bdf60</uuid>
Oct 26 00:19:06 user nova-compute[75165]:   <name>instance-0000001a</name>
Oct 26 00:19:06 user nova-compute[75165]:   <memory>524288</memory>
Oct 26 00:19:06 user nova-compute[75165]:   <vcpu>1</vcpu>
Oct 26 00:19:06 user nova-compute[75165]:   <metadata>
Oct 26 00:19:06 user nova-compute[75165]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 00:19:06 user nova-compute[75165]:       <nova:package version="0.0.0"/>
Oct 26 00:19:06 user nova-compute[75165]:       <nova:name>tempest-VolumesActionsTest-instance-459487771</nova:name>
Oct 26 00:19:06 user nova-compute[75165]:       <nova:creationTime>2023-10-26 00:19:06</nova:creationTime>
Oct 26 00:19:06 user nova-compute[75165]:       <nova:flavor name="m1.tiny">
Oct 26 00:19:06 user nova-compute[75165]:         <nova:memory>512</nova:memory>
Oct 26 00:19:06 user nova-compute[75165]:         <nova:disk>1</nova:disk>
Oct 26 00:19:06 user nova-compute[75165]:         <nova:swap>0</nova:swap>
Oct 26 00:19:06 user nova-compute[75165]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 00:19:06 user nova-compute[75165]:         <nova:vcpus>1</nova:vcpus>
Oct 26 00:19:06 user nova-compute[75165]:       </nova:flavor>
Oct 26 00:19:06 user nova-compute[75165]:       <nova:owner>
Oct 26 00:19:06 user nova-compute[75165]:         <nova:user uuid="1bdac2b15e794e0da5ed2fd4740712ce">tempest-VolumesActionsTest-964746875-project-member</nova:user>
Oct 26 00:19:06 user nova-compute[75165]:         <nova:project uuid="ac36ea060d7f4e43b4ff69ff32afd8a3">tempest-VolumesActionsTest-964746875</nova:project>
Oct 26 00:19:06 user nova-compute[75165]:       </nova:owner>
Oct 26 00:19:06 user nova-compute[75165]:       <nova:root type="image" uuid="bff0d8a1-739e-4c4d-9efa-b73ba7b76d01"/>
Oct 26 00:19:06 user nova-compute[75165]:       <nova:ports>
Oct 26 00:19:06 user nova-compute[75165]:         <nova:port uuid="7bc04115-a6b3-4514-b72d-4b73aa5fe793">
Oct 26 00:19:06 user nova-compute[75165]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 26 00:19:06 user nova-compute[75165]:         </nova:port>
Oct 26 00:19:06 user nova-compute[75165]:       </nova:ports>
Oct 26 00:19:06 user nova-compute[75165]:     </nova:instance>
Oct 26 00:19:06 user nova-compute[75165]:   </metadata>
Oct 26 00:19:06 user nova-compute[75165]:   <sysinfo type="smbios">
Oct 26 00:19:06 user nova-compute[75165]:     <system>
Oct 26 00:19:06 user nova-compute[75165]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 00:19:06 user nova-compute[75165]:       <entry name="product">OpenStack Nova</entry>
Oct 26 00:19:06 user nova-compute[75165]:       <entry name="version">0.0.0</entry>
Oct 26 00:19:06 user nova-compute[75165]:       <entry name="serial">8e847329-ad09-450d-854b-468a3b8bdf60</entry>
Oct 26 00:19:06 user nova-compute[75165]:       <entry name="uuid">8e847329-ad09-450d-854b-468a3b8bdf60</entry>
Oct 26 00:19:06 user nova-compute[75165]:       <entry name="family">Virtual Machine</entry>
Oct 26 00:19:06 user nova-compute[75165]:     </system>
Oct 26 00:19:06 user nova-compute[75165]:   </sysinfo>
Oct 26 00:19:06 user nova-compute[75165]:   <os>
Oct 26 00:19:06 user nova-compute[75165]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 00:19:06 user nova-compute[75165]:     <boot dev="hd"/>
Oct 26 00:19:06 user nova-compute[75165]:     <smbios mode="sysinfo"/>
Oct 26 00:19:06 user nova-compute[75165]:   </os>
Oct 26 00:19:06 user nova-compute[75165]:   <features>
Oct 26 00:19:06 user nova-compute[75165]:     <acpi/>
Oct 26 00:19:06 user nova-compute[75165]:     <apic/>
Oct 26 00:19:06 user nova-compute[75165]:     <vmcoreinfo/>
Oct 26 00:19:06 user nova-compute[75165]:   </features>
Oct 26 00:19:06 user nova-compute[75165]:   <clock offset="utc">
Oct 26 00:19:06 user nova-compute[75165]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 00:19:06 user nova-compute[75165]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 00:19:06 user nova-compute[75165]:     <timer name="hpet" present="no"/>
Oct 26 00:19:06 user nova-compute[75165]:   </clock>
Oct 26 00:19:06 user nova-compute[75165]:   <cpu mode="custom" match="exact">
Oct 26 00:19:06 user nova-compute[75165]:     <model>Nehalem</model>
Oct 26 00:19:06 user nova-compute[75165]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 00:19:06 user nova-compute[75165]:   </cpu>
Oct 26 00:19:06 user nova-compute[75165]:   <devices>
Oct 26 00:19:06 user nova-compute[75165]:     <disk type="file" device="disk">
Oct 26 00:19:06 user nova-compute[75165]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 00:19:06 user nova-compute[75165]:       <source file="/opt/stack/data/nova/instances/8e847329-ad09-450d-854b-468a3b8bdf60/disk"/>
Oct 26 00:19:06 user nova-compute[75165]:       <target dev="vda" bus="virtio"/>
Oct 26 00:19:06 user nova-compute[75165]:     </disk>
Oct 26 00:19:06 user nova-compute[75165]:     <interface type="ethernet">
Oct 26 00:19:06 user nova-compute[75165]:       <mac address="fa:16:3e:fb:a0:6b"/>
Oct 26 00:19:06 user nova-compute[75165]:       <model type="virtio"/>
Oct 26 00:19:06 user nova-compute[75165]:       <mtu size="1442"/>
Oct 26 00:19:06 user nova-compute[75165]:       <target dev="tap7bc04115-a6"/>
Oct 26 00:19:06 user nova-compute[75165]:     </interface>
Oct 26 00:19:06 user nova-compute[75165]:     <serial type="pty">
Oct 26 00:19:06 user nova-compute[75165]:       <log file="/opt/stack/data/nova/instances/8e847329-ad09-450d-854b-468a3b8bdf60/console.log" append="off"/>
Oct 26 00:19:06 user nova-compute[75165]:     </serial>
Oct 26 00:19:06 user nova-compute[75165]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 00:19:06 user nova-compute[75165]:     <video>
Oct 26 00:19:06 user nova-compute[75165]:       <model type="virtio"/>
Oct 26 00:19:06 user nova-compute[75165]:     </video>
Oct 26 00:19:06 user nova-compute[75165]:     <rng model="virtio">
Oct 26 00:19:06 user nova-compute[75165]:       <backend model="random">/dev/urandom</backend>
Oct 26 00:19:06 user nova-compute[75165]:     </rng>
Oct 26 00:19:06 user nova-compute[75165]:     <controller type="usb" index="0" model="none"/>
Oct 26 00:19:06 user nova-compute[75165]:     <memballoon model="virtio">
Oct 26 00:19:06 user nova-compute[75165]:       <stats period="10"/>
Oct 26 00:19:06 user nova-compute[75165]:     </memballoon>
Oct 26 00:19:06 user nova-compute[75165]:   </devices>
Oct 26 00:19:06 user nova-compute[75165]: </domain>
Oct 26 00:19:06 user nova-compute[75165]:  {{(pid=75165) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 00:19:06 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-e2088fe4-02e5-4d06-a933-697ccfff5f16 tempest-VolumesActionsTest-964746875 tempest-VolumesActionsTest-964746875-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:19:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-459487771',display_name='tempest-VolumesActionsTest-instance-459487771',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-459487771',id=26,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ac36ea060d7f4e43b4ff69ff32afd8a3',ramdisk_id='',reservation_id='r-pk0kfbhp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-964746875',owner_user_name='tempest-VolumesActionsTest-964746875-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T00:19:05Z,user_data=None,user_id='1bdac2b15e794e0da5ed2fd4740712ce',uuid=8e847329-ad09-450d-854b-468a3b8bdf60,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7bc04115-a6b3-4514-b72d-4b73aa5fe793", "address": "fa:16:3e:fb:a0:6b", "network": {"id": "302fba99-ca6c-41be-895d-a534355a2ffa", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1221818499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac36ea060d7f4e43b4ff69ff32afd8a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bc04115-a6", "ovs_interfaceid": "7bc04115-a6b3-4514-b72d-4b73aa5fe793", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 00:19:06 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-e2088fe4-02e5-4d06-a933-697ccfff5f16 tempest-VolumesActionsTest-964746875 tempest-VolumesActionsTest-964746875-project-member] Converting VIF {"id": "7bc04115-a6b3-4514-b72d-4b73aa5fe793", "address": "fa:16:3e:fb:a0:6b", "network": {"id": "302fba99-ca6c-41be-895d-a534355a2ffa", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1221818499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac36ea060d7f4e43b4ff69ff32afd8a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bc04115-a6", "ovs_interfaceid": "7bc04115-a6b3-4514-b72d-4b73aa5fe793", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:19:06 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-e2088fe4-02e5-4d06-a933-697ccfff5f16 tempest-VolumesActionsTest-964746875 tempest-VolumesActionsTest-964746875-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:a0:6b,bridge_name='br-int',has_traffic_filtering=True,id=7bc04115-a6b3-4514-b72d-4b73aa5fe793,network=Network(302fba99-ca6c-41be-895d-a534355a2ffa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bc04115-a6') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:19:06 user nova-compute[75165]: DEBUG os_vif [None req-e2088fe4-02e5-4d06-a933-697ccfff5f16 tempest-VolumesActionsTest-964746875 tempest-VolumesActionsTest-964746875-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:a0:6b,bridge_name='br-int',has_traffic_filtering=True,id=7bc04115-a6b3-4514-b72d-4b73aa5fe793,network=Network(302fba99-ca6c-41be-895d-a534355a2ffa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bc04115-a6') {{(pid=75165) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 00:19:06 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:19:06 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:19:06 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 00:19:06 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:19:06 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1c301f75-b49f-5c88-a535-bb13fbd75c71', '_type': 'linux-noop'}}, row=False) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:19:06 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:19:06 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:19:06 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:19:06 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7bc04115-a6, may_exist=True, interface_attrs={}) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:19:06 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7bc04115-a6, col_values=(('qos', UUID('c50a23ee-eaf1-457c-8b7f-a523f8320527')),), if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:19:06 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7bc04115-a6, col_values=(('external_ids', {'iface-id': '7bc04115-a6b3-4514-b72d-4b73aa5fe793', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fb:a0:6b', 'vm-uuid': '8e847329-ad09-450d-854b-468a3b8bdf60'}),), if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:19:06 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:19:06 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:19:06 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:19:06 user nova-compute[75165]: INFO os_vif [None req-e2088fe4-02e5-4d06-a933-697ccfff5f16 tempest-VolumesActionsTest-964746875 tempest-VolumesActionsTest-964746875-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:a0:6b,bridge_name='br-int',has_traffic_filtering=True,id=7bc04115-a6b3-4514-b72d-4b73aa5fe793,network=Network(302fba99-ca6c-41be-895d-a534355a2ffa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bc04115-a6')
Oct 26 00:19:06 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-e2088fe4-02e5-4d06-a933-697ccfff5f16 tempest-VolumesActionsTest-964746875 tempest-VolumesActionsTest-964746875-project-member] No BDM found with device name vda, not building metadata. {{(pid=75165) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 00:19:06 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-e2088fe4-02e5-4d06-a933-697ccfff5f16 tempest-VolumesActionsTest-964746875 tempest-VolumesActionsTest-964746875-project-member] No VIF found with MAC fa:16:3e:fb:a0:6b, not building metadata {{(pid=75165) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 00:19:07 user nova-compute[75165]: DEBUG nova.network.neutron [req-a27ccd3c-c8b6-4194-9782-c497108db7a9 req-29d31446-10ef-4c91-84ce-4c6aedcac4aa service nova] [instance: 8e847329-ad09-450d-854b-468a3b8bdf60] Updated VIF entry in instance network info cache for port 7bc04115-a6b3-4514-b72d-4b73aa5fe793. {{(pid=75165) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 00:19:07 user nova-compute[75165]: DEBUG nova.network.neutron [req-a27ccd3c-c8b6-4194-9782-c497108db7a9 req-29d31446-10ef-4c91-84ce-4c6aedcac4aa service nova] [instance: 8e847329-ad09-450d-854b-468a3b8bdf60] Updating instance_info_cache with network_info: [{"id": "7bc04115-a6b3-4514-b72d-4b73aa5fe793", "address": "fa:16:3e:fb:a0:6b", "network": {"id": "302fba99-ca6c-41be-895d-a534355a2ffa", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1221818499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac36ea060d7f4e43b4ff69ff32afd8a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bc04115-a6", "ovs_interfaceid": "7bc04115-a6b3-4514-b72d-4b73aa5fe793", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:19:07 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-a27ccd3c-c8b6-4194-9782-c497108db7a9 req-29d31446-10ef-4c91-84ce-4c6aedcac4aa service nova] Releasing lock "refresh_cache-8e847329-ad09-450d-854b-468a3b8bdf60" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:19:07 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-be9a63a2-6f30-4973-b220-872af6d9af23 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Acquiring lock "bad6c21f-885f-4348-86f7-b237ce2d241b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:19:07 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-be9a63a2-6f30-4973-b220-872af6d9af23 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Lock "bad6c21f-885f-4348-86f7-b237ce2d241b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:19:07 user nova-compute[75165]: DEBUG nova.compute.manager [None req-be9a63a2-6f30-4973-b220-872af6d9af23 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: bad6c21f-885f-4348-86f7-b237ce2d241b] Starting instance... {{(pid=75165) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 00:19:07 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-be9a63a2-6f30-4973-b220-872af6d9af23 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:19:07 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-be9a63a2-6f30-4973-b220-872af6d9af23 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:19:07 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-be9a63a2-6f30-4973-b220-872af6d9af23 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75165) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 00:19:07 user nova-compute[75165]: INFO nova.compute.claims [None req-be9a63a2-6f30-4973-b220-872af6d9af23 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: bad6c21f-885f-4348-86f7-b237ce2d241b] Claim successful on node user
Oct 26 00:19:07 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:19:07 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:19:08 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:19:08 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:19:08 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:19:08 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-be9a63a2-6f30-4973-b220-872af6d9af23 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:19:08 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-be9a63a2-6f30-4973-b220-872af6d9af23 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:19:08 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-be9a63a2-6f30-4973-b220-872af6d9af23 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.547s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:19:08 user nova-compute[75165]: DEBUG nova.compute.manager [None req-be9a63a2-6f30-4973-b220-872af6d9af23 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: bad6c21f-885f-4348-86f7-b237ce2d241b] Start building networks asynchronously for instance. {{(pid=75165) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 00:19:08 user nova-compute[75165]: DEBUG nova.compute.manager [None req-be9a63a2-6f30-4973-b220-872af6d9af23 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: bad6c21f-885f-4348-86f7-b237ce2d241b] Allocating IP information in the background. {{(pid=75165) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 00:19:08 user nova-compute[75165]: DEBUG nova.network.neutron [None req-be9a63a2-6f30-4973-b220-872af6d9af23 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: bad6c21f-885f-4348-86f7-b237ce2d241b] allocate_for_instance() {{(pid=75165) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 00:19:08 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-be9a63a2-6f30-4973-b220-872af6d9af23 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: bad6c21f-885f-4348-86f7-b237ce2d241b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 00:19:08 user nova-compute[75165]: DEBUG nova.compute.manager [req-c6c8363a-54af-4a24-b3b6-12b842f96e37 req-9f139c1d-f372-4463-82f5-d9613cbc1a85 service nova] [instance: 8e847329-ad09-450d-854b-468a3b8bdf60] Received event network-vif-plugged-7bc04115-a6b3-4514-b72d-4b73aa5fe793 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:19:08 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-c6c8363a-54af-4a24-b3b6-12b842f96e37 req-9f139c1d-f372-4463-82f5-d9613cbc1a85 service nova] Acquiring lock "8e847329-ad09-450d-854b-468a3b8bdf60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:19:08 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-c6c8363a-54af-4a24-b3b6-12b842f96e37 req-9f139c1d-f372-4463-82f5-d9613cbc1a85 service nova] Lock "8e847329-ad09-450d-854b-468a3b8bdf60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:19:08 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-c6c8363a-54af-4a24-b3b6-12b842f96e37 req-9f139c1d-f372-4463-82f5-d9613cbc1a85 service nova] Lock "8e847329-ad09-450d-854b-468a3b8bdf60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:19:08 user nova-compute[75165]: DEBUG nova.compute.manager [req-c6c8363a-54af-4a24-b3b6-12b842f96e37 req-9f139c1d-f372-4463-82f5-d9613cbc1a85 service nova] [instance: 8e847329-ad09-450d-854b-468a3b8bdf60] No waiting events found dispatching network-vif-plugged-7bc04115-a6b3-4514-b72d-4b73aa5fe793 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:19:08 user nova-compute[75165]: WARNING nova.compute.manager [req-c6c8363a-54af-4a24-b3b6-12b842f96e37 req-9f139c1d-f372-4463-82f5-d9613cbc1a85 service nova] [instance: 8e847329-ad09-450d-854b-468a3b8bdf60] Received unexpected event network-vif-plugged-7bc04115-a6b3-4514-b72d-4b73aa5fe793 for instance with vm_state building and task_state spawning.
Oct 26 00:19:08 user nova-compute[75165]: DEBUG nova.compute.manager [None req-be9a63a2-6f30-4973-b220-872af6d9af23 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: bad6c21f-885f-4348-86f7-b237ce2d241b] Start building block device mappings for instance. {{(pid=75165) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 00:19:08 user nova-compute[75165]: DEBUG nova.policy [None req-be9a63a2-6f30-4973-b220-872af6d9af23 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5b3ce94f4c01446ebf79a1eba3833e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2911497df44047d9a9ee36a5652298bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75165) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 00:19:08 user nova-compute[75165]: INFO nova.virt.block_device [None req-be9a63a2-6f30-4973-b220-872af6d9af23 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: bad6c21f-885f-4348-86f7-b237ce2d241b] Booting with volume 99a43689-b7cd-47e6-ae88-fd8ba07c60c1 at /dev/vda
Oct 26 00:19:08 user nova-compute[75165]: DEBUG os_brick.utils [None req-be9a63a2-6f30-4973-b220-872af6d9af23 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:19:08 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:19:08 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:19:08 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[46721798-0270-46d9-810b-7821f6786695]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa94814ccb35\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:19:08 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:19:08 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:19:08 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c219e8d-621b-4656-9409-7e074f3f7ab0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:19:08 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:19:08 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:19:08 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[8791808b-ae09-473d-9889-abf54d73187e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:19:08 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2507be5-66f3-4df4-903d-b3cfd27376e1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:19:08 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-be9a63a2-6f30-4973-b220-872af6d9af23 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Running cmd (subprocess): nvme version {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:19:08 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-be9a63a2-6f30-4973-b220-872af6d9af23 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] 'nvme version' failed. Not Retrying. {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 00:19:08 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.nvmeof [None req-be9a63a2-6f30-4973-b220-872af6d9af23 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] nvme not present on system {{(pid=75165) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 00:19:08 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:19:08 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:19:08 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 00:19:08 user nova-compute[75165]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 00:19:08 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0ec72a9-0759-44ca-9a56-879bc9c11b70]: (4, '') {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:19:08 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-be9a63a2-6f30-4973-b220-872af6d9af23 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75165) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 00:19:08 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-be9a63a2-6f30-4973-b220-872af6d9af23 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75165) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 00:19:08 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-be9a63a2-6f30-4973-b220-872af6d9af23 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] LIGHTOS: no hostnqn found. {{(pid=75165) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 00:19:08 user nova-compute[75165]: DEBUG os_brick.utils [None req-be9a63a2-6f30-4973-b220-872af6d9af23 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa94814ccb35', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:19:08 user nova-compute[75165]: DEBUG nova.virt.block_device [None req-be9a63a2-6f30-4973-b220-872af6d9af23 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: bad6c21f-885f-4348-86f7-b237ce2d241b] Updating existing volume attachment record: 2b9ef915-36a0-43a9-b6b1-1d4a8fff62b8 {{(pid=75165) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 00:19:08 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:19:08 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:19:09 user nova-compute[75165]: DEBUG nova.network.neutron [None req-be9a63a2-6f30-4973-b220-872af6d9af23 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: bad6c21f-885f-4348-86f7-b237ce2d241b] Successfully created port: b64d421a-ca91-4f21-80f7-17b0c17ceb8a {{(pid=75165) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 00:19:09 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:19:09 user nova-compute[75165]: DEBUG nova.network.neutron [None req-be9a63a2-6f30-4973-b220-872af6d9af23 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: bad6c21f-885f-4348-86f7-b237ce2d241b] Successfully updated port: b64d421a-ca91-4f21-80f7-17b0c17ceb8a {{(pid=75165) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 00:19:09 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:19:09 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:19:09 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:19:09 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75165) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 00:19:09 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-be9a63a2-6f30-4973-b220-872af6d9af23 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Acquiring lock "refresh_cache-bad6c21f-885f-4348-86f7-b237ce2d241b" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:19:09 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-be9a63a2-6f30-4973-b220-872af6d9af23 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Acquired lock "refresh_cache-bad6c21f-885f-4348-86f7-b237ce2d241b" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:19:09 user nova-compute[75165]: DEBUG nova.network.neutron [None req-be9a63a2-6f30-4973-b220-872af6d9af23 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: bad6c21f-885f-4348-86f7-b237ce2d241b] Building network info cache for instance {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 00:19:09 user nova-compute[75165]: DEBUG nova.network.neutron [None req-be9a63a2-6f30-4973-b220-872af6d9af23 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: bad6c21f-885f-4348-86f7-b237ce2d241b] Instance cache missing network info. {{(pid=75165) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 00:19:10 user nova-compute[75165]: DEBUG nova.network.neutron [None req-be9a63a2-6f30-4973-b220-872af6d9af23 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: bad6c21f-885f-4348-86f7-b237ce2d241b] Updating instance_info_cache with network_info: [{"id": "b64d421a-ca91-4f21-80f7-17b0c17ceb8a", "address": "fa:16:3e:54:54:b8", "network": {"id": "bd1c84f9-bba9-4a23-8bf2-17e65022136a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1557945804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2911497df44047d9a9ee36a5652298bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb64d421a-ca", "ovs_interfaceid": "b64d421a-ca91-4f21-80f7-17b0c17ceb8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:19:10 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-be9a63a2-6f30-4973-b220-872af6d9af23 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Releasing lock "refresh_cache-bad6c21f-885f-4348-86f7-b237ce2d241b" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:19:10 user nova-compute[75165]: DEBUG nova.compute.manager [None req-be9a63a2-6f30-4973-b220-872af6d9af23 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: bad6c21f-885f-4348-86f7-b237ce2d241b] Instance network_info: |[{"id": "b64d421a-ca91-4f21-80f7-17b0c17ceb8a", "address": "fa:16:3e:54:54:b8", "network": {"id": "bd1c84f9-bba9-4a23-8bf2-17e65022136a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1557945804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2911497df44047d9a9ee36a5652298bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb64d421a-ca", "ovs_interfaceid": "b64d421a-ca91-4f21-80f7-17b0c17ceb8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75165) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 00:19:10 user nova-compute[75165]: DEBUG nova.compute.manager [None req-e2088fe4-02e5-4d06-a933-697ccfff5f16 tempest-VolumesActionsTest-964746875 tempest-VolumesActionsTest-964746875-project-member] [instance: 8e847329-ad09-450d-854b-468a3b8bdf60] Instance event wait completed in 0 seconds for  {{(pid=75165) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 00:19:10 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-e2088fe4-02e5-4d06-a933-697ccfff5f16 tempest-VolumesActionsTest-964746875 tempest-VolumesActionsTest-964746875-project-member] [instance: 8e847329-ad09-450d-854b-468a3b8bdf60] Guest created on hypervisor {{(pid=75165) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 00:19:10 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: 8e847329-ad09-450d-854b-468a3b8bdf60] Instance spawned successfully.
Oct 26 00:19:10 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-e2088fe4-02e5-4d06-a933-697ccfff5f16 tempest-VolumesActionsTest-964746875 tempest-VolumesActionsTest-964746875-project-member] [instance: 8e847329-ad09-450d-854b-468a3b8bdf60] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 00:19:10 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-e2088fe4-02e5-4d06-a933-697ccfff5f16 tempest-VolumesActionsTest-964746875 tempest-VolumesActionsTest-964746875-project-member] [instance: 8e847329-ad09-450d-854b-468a3b8bdf60] Found default for hw_cdrom_bus of ide {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:19:10 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-e2088fe4-02e5-4d06-a933-697ccfff5f16 tempest-VolumesActionsTest-964746875 tempest-VolumesActionsTest-964746875-project-member] [instance: 8e847329-ad09-450d-854b-468a3b8bdf60] Found default for hw_disk_bus of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:19:10 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-e2088fe4-02e5-4d06-a933-697ccfff5f16 tempest-VolumesActionsTest-964746875 tempest-VolumesActionsTest-964746875-project-member] [instance: 8e847329-ad09-450d-854b-468a3b8bdf60] Found default for hw_input_bus of None {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:19:10 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-e2088fe4-02e5-4d06-a933-697ccfff5f16 tempest-VolumesActionsTest-964746875 tempest-VolumesActionsTest-964746875-project-member] [instance: 8e847329-ad09-450d-854b-468a3b8bdf60] Found default for hw_pointer_model of None {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:19:10 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-e2088fe4-02e5-4d06-a933-697ccfff5f16 tempest-VolumesActionsTest-964746875 tempest-VolumesActionsTest-964746875-project-member] [instance: 8e847329-ad09-450d-854b-468a3b8bdf60] Found default for hw_video_model of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:19:10 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-e2088fe4-02e5-4d06-a933-697ccfff5f16 tempest-VolumesActionsTest-964746875 tempest-VolumesActionsTest-964746875-project-member] [instance: 8e847329-ad09-450d-854b-468a3b8bdf60] Found default for hw_vif_model of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:19:10 user nova-compute[75165]: INFO nova.compute.manager [None req-e2088fe4-02e5-4d06-a933-697ccfff5f16 tempest-VolumesActionsTest-964746875 tempest-VolumesActionsTest-964746875-project-member] [instance: 8e847329-ad09-450d-854b-468a3b8bdf60] Took 5.60 seconds to spawn the instance on the hypervisor.
Oct 26 00:19:10 user nova-compute[75165]: DEBUG nova.compute.manager [None req-e2088fe4-02e5-4d06-a933-697ccfff5f16 tempest-VolumesActionsTest-964746875 tempest-VolumesActionsTest-964746875-project-member] [instance: 8e847329-ad09-450d-854b-468a3b8bdf60] Checking state {{(pid=75165) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 00:19:10 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b041e0af-4635-495c-b72d-fbbbd8d43a9b/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:19:10 user nova-compute[75165]: DEBUG nova.compute.manager [req-d9417caf-d199-4ca9-b9a2-0bc8bf032db5 req-9cf5d00c-622c-4de1-b664-932cef1d1a39 service nova] [instance: 8e847329-ad09-450d-854b-468a3b8bdf60] Received event network-vif-plugged-7bc04115-a6b3-4514-b72d-4b73aa5fe793 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:19:10 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-d9417caf-d199-4ca9-b9a2-0bc8bf032db5 req-9cf5d00c-622c-4de1-b664-932cef1d1a39 service nova] Acquiring lock "8e847329-ad09-450d-854b-468a3b8bdf60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:19:10 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-d9417caf-d199-4ca9-b9a2-0bc8bf032db5 req-9cf5d00c-622c-4de1-b664-932cef1d1a39 service nova] Lock "8e847329-ad09-450d-854b-468a3b8bdf60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:19:10 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-d9417caf-d199-4ca9-b9a2-0bc8bf032db5 req-9cf5d00c-622c-4de1-b664-932cef1d1a39 service nova] Lock "8e847329-ad09-450d-854b-468a3b8bdf60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:19:10 user nova-compute[75165]: DEBUG nova.compute.manager [req-d9417caf-d199-4ca9-b9a2-0bc8bf032db5 req-9cf5d00c-622c-4de1-b664-932cef1d1a39 service nova] [instance: 8e847329-ad09-450d-854b-468a3b8bdf60] No waiting events found dispatching network-vif-plugged-7bc04115-a6b3-4514-b72d-4b73aa5fe793 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:19:10 user nova-compute[75165]: WARNING nova.compute.manager [req-d9417caf-d199-4ca9-b9a2-0bc8bf032db5 req-9cf5d00c-622c-4de1-b664-932cef1d1a39 service nova] [instance: 8e847329-ad09-450d-854b-468a3b8bdf60] Received unexpected event network-vif-plugged-7bc04115-a6b3-4514-b72d-4b73aa5fe793 for instance with vm_state building and task_state spawning.
Oct 26 00:19:10 user nova-compute[75165]: DEBUG nova.compute.manager [req-d9417caf-d199-4ca9-b9a2-0bc8bf032db5 req-9cf5d00c-622c-4de1-b664-932cef1d1a39 service nova] [instance: bad6c21f-885f-4348-86f7-b237ce2d241b] Received event network-changed-b64d421a-ca91-4f21-80f7-17b0c17ceb8a {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:19:10 user nova-compute[75165]: DEBUG nova.compute.manager [req-d9417caf-d199-4ca9-b9a2-0bc8bf032db5 req-9cf5d00c-622c-4de1-b664-932cef1d1a39 service nova] [instance: bad6c21f-885f-4348-86f7-b237ce2d241b] Refreshing instance network info cache due to event network-changed-b64d421a-ca91-4f21-80f7-17b0c17ceb8a. {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 00:19:10 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-d9417caf-d199-4ca9-b9a2-0bc8bf032db5 req-9cf5d00c-622c-4de1-b664-932cef1d1a39 service nova] Acquiring lock "refresh_cache-bad6c21f-885f-4348-86f7-b237ce2d241b" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:19:10 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-d9417caf-d199-4ca9-b9a2-0bc8bf032db5 req-9cf5d00c-622c-4de1-b664-932cef1d1a39 service nova] Acquired lock "refresh_cache-bad6c21f-885f-4348-86f7-b237ce2d241b" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:19:10 user nova-compute[75165]: DEBUG nova.network.neutron [req-d9417caf-d199-4ca9-b9a2-0bc8bf032db5 req-9cf5d00c-622c-4de1-b664-932cef1d1a39 service nova] [instance: bad6c21f-885f-4348-86f7-b237ce2d241b] Refreshing network info cache for port b64d421a-ca91-4f21-80f7-17b0c17ceb8a {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 00:19:10 user nova-compute[75165]: INFO nova.compute.manager [None req-e2088fe4-02e5-4d06-a933-697ccfff5f16 tempest-VolumesActionsTest-964746875 tempest-VolumesActionsTest-964746875-project-member] [instance: 8e847329-ad09-450d-854b-468a3b8bdf60] Took 6.40 seconds to build instance.
Oct 26 00:19:10 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-e2088fe4-02e5-4d06-a933-697ccfff5f16 tempest-VolumesActionsTest-964746875 tempest-VolumesActionsTest-964746875-project-member] Lock "8e847329-ad09-450d-854b-468a3b8bdf60" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.494s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:19:10 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b041e0af-4635-495c-b72d-fbbbd8d43a9b/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:19:10 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b041e0af-4635-495c-b72d-fbbbd8d43a9b/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:19:10 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b041e0af-4635-495c-b72d-fbbbd8d43a9b/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:19:10 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84c6b624-648b-40e2-a37e-ff08609bad84/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:19:10 user nova-compute[75165]: DEBUG nova.network.neutron [req-d9417caf-d199-4ca9-b9a2-0bc8bf032db5 req-9cf5d00c-622c-4de1-b664-932cef1d1a39 service nova] [instance: bad6c21f-885f-4348-86f7-b237ce2d241b] Updated VIF entry in instance network info cache for port b64d421a-ca91-4f21-80f7-17b0c17ceb8a. {{(pid=75165) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 00:19:10 user nova-compute[75165]: DEBUG nova.network.neutron [req-d9417caf-d199-4ca9-b9a2-0bc8bf032db5 req-9cf5d00c-622c-4de1-b664-932cef1d1a39 service nova] [instance: bad6c21f-885f-4348-86f7-b237ce2d241b] Updating instance_info_cache with network_info: [{"id": "b64d421a-ca91-4f21-80f7-17b0c17ceb8a", "address": "fa:16:3e:54:54:b8", "network": {"id": "bd1c84f9-bba9-4a23-8bf2-17e65022136a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1557945804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2911497df44047d9a9ee36a5652298bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb64d421a-ca", "ovs_interfaceid": "b64d421a-ca91-4f21-80f7-17b0c17ceb8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:19:11 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-d9417caf-d199-4ca9-b9a2-0bc8bf032db5 req-9cf5d00c-622c-4de1-b664-932cef1d1a39 service nova] Releasing lock "refresh_cache-bad6c21f-885f-4348-86f7-b237ce2d241b" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:19:11 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84c6b624-648b-40e2-a37e-ff08609bad84/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:19:11 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84c6b624-648b-40e2-a37e-ff08609bad84/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:19:11 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:19:11 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84c6b624-648b-40e2-a37e-ff08609bad84/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:19:11 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97fb67a7-637d-456f-b4dd-0a271ed6cfc4/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:19:11 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97fb67a7-637d-456f-b4dd-0a271ed6cfc4/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:19:11 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97fb67a7-637d-456f-b4dd-0a271ed6cfc4/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:19:11 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97fb67a7-637d-456f-b4dd-0a271ed6cfc4/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:19:11 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7eeb145-1565-4812-818b-fefda5f2436d/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:19:11 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:19:11 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7eeb145-1565-4812-818b-fefda5f2436d/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:19:11 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7eeb145-1565-4812-818b-fefda5f2436d/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:19:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7eeb145-1565-4812-818b-fefda5f2436d/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:19:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6558510-6f87-4ef3-b707-f1fa78bf61e8/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:19:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6558510-6f87-4ef3-b707-f1fa78bf61e8/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:19:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6558510-6f87-4ef3-b707-f1fa78bf61e8/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:19:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6558510-6f87-4ef3-b707-f1fa78bf61e8/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:19:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e44bfc-6a68-46ce-8335-aaaba5160d3e/disk.rescue --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:19:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e44bfc-6a68-46ce-8335-aaaba5160d3e/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:19:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e44bfc-6a68-46ce-8335-aaaba5160d3e/disk.rescue --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:19:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e44bfc-6a68-46ce-8335-aaaba5160d3e/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:19:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e44bfc-6a68-46ce-8335-aaaba5160d3e/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:19:13 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e44bfc-6a68-46ce-8335-aaaba5160d3e/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:19:13 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e44bfc-6a68-46ce-8335-aaaba5160d3e/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:19:13 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e44bfc-6a68-46ce-8335-aaaba5160d3e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:19:13 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27fa1771-fb69-49da-81b3-7f112e623170/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:19:13 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27fa1771-fb69-49da-81b3-7f112e623170/disk --force-share --output=json" returned: 0 in 0.274s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:19:13 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27fa1771-fb69-49da-81b3-7f112e623170/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:19:13 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27fa1771-fb69-49da-81b3-7f112e623170/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:19:13 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75165) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 00:19:13 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e847329-ad09-450d-854b-468a3b8bdf60/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:19:13 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e847329-ad09-450d-854b-468a3b8bdf60/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:19:13 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e847329-ad09-450d-854b-468a3b8bdf60/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:19:14 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e847329-ad09-450d-854b-468a3b8bdf60/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:19:14 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91fe894a-90a8-4545-9b27-91771554c4cb/disk.rescue --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:19:14 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91fe894a-90a8-4545-9b27-91771554c4cb/disk.rescue --force-share --output=json" returned: 0 in 0.207s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:19:14 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91fe894a-90a8-4545-9b27-91771554c4cb/disk.rescue --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:19:14 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91fe894a-90a8-4545-9b27-91771554c4cb/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:19:14 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] skipping disk /opt/stack/data/nova/instances/91fe894a-90a8-4545-9b27-91771554c4cb/disk (vdb) as it is a volume {{(pid=75165) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 00:19:14 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:19:14 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:19:14 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Hypervisor/Node resource view: name=user free_ram=7814MB free_disk=25.015918731689453GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75165) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 00:19:14 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:19:14 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:19:15 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 84c6b624-648b-40e2-a37e-ff08609bad84 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:19:15 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance c4e44bfc-6a68-46ce-8335-aaaba5160d3e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:19:15 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance a7eeb145-1565-4812-818b-fefda5f2436d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:19:15 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 27fa1771-fb69-49da-81b3-7f112e623170 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:19:15 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 91fe894a-90a8-4545-9b27-91771554c4cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:19:15 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance b6558510-6f87-4ef3-b707-f1fa78bf61e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:19:15 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 97fb67a7-637d-456f-b4dd-0a271ed6cfc4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:19:15 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance b041e0af-4635-495c-b72d-fbbbd8d43a9b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:19:15 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 8e847329-ad09-450d-854b-468a3b8bdf60 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:19:15 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance bad6c21f-885f-4348-86f7-b237ce2d241b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:19:15 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75165) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 00:19:15 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75165) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 00:19:15 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:19:15 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:19:15 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Compute_service record updated for user:user {{(pid=75165) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 00:19:15 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.583s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:19:16 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:19:16 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:19:16 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Starting heal instance info cache {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 00:19:16 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "refresh_cache-27fa1771-fb69-49da-81b3-7f112e623170" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:19:16 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquired lock "refresh_cache-27fa1771-fb69-49da-81b3-7f112e623170" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:19:16 user nova-compute[75165]: DEBUG nova.network.neutron [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: 27fa1771-fb69-49da-81b3-7f112e623170] Forcefully refreshing network info cache for instance {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 00:19:16 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:19:17 user nova-compute[75165]: DEBUG nova.network.neutron [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: 27fa1771-fb69-49da-81b3-7f112e623170] Updating instance_info_cache with network_info: [{"id": "4d97651b-5d7c-4778-85a4-a11588892b31", "address": "fa:16:3e:c5:bb:76", "network": {"id": "7e330392-6256-405b-ab37-0b8af0c4fd48", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-430326049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ffbf5c944914cafac7aba65fb7ca402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d97651b-5d", "ovs_interfaceid": "4d97651b-5d7c-4778-85a4-a11588892b31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:19:17 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Releasing lock "refresh_cache-27fa1771-fb69-49da-81b3-7f112e623170" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:19:17 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: 27fa1771-fb69-49da-81b3-7f112e623170] Updated the network info_cache for instance {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 00:19:17 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:19:17 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:19:17 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:19:21 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:19:25 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:19:26 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:19:26 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:19:27 user nova-compute[75165]: DEBUG nova.compute.manager [None req-be9a63a2-6f30-4973-b220-872af6d9af23 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: bad6c21f-885f-4348-86f7-b237ce2d241b] Start spawning the instance on the hypervisor. {{(pid=75165) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 00:19:27 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-be9a63a2-6f30-4973-b220-872af6d9af23 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: bad6c21f-885f-4348-86f7-b237ce2d241b] Creating instance directory {{(pid=75165) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 00:19:27 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-be9a63a2-6f30-4973-b220-872af6d9af23 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: bad6c21f-885f-4348-86f7-b237ce2d241b] Creating image(s)
Oct 26 00:19:27 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-be9a63a2-6f30-4973-b220-872af6d9af23 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: bad6c21f-885f-4348-86f7-b237ce2d241b] Did not create local disks {{(pid=75165) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 26 00:19:27 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-be9a63a2-6f30-4973-b220-872af6d9af23 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: bad6c21f-885f-4348-86f7-b237ce2d241b] Ensure instance console log exists: /opt/stack/data/nova/instances/bad6c21f-885f-4348-86f7-b237ce2d241b/console.log {{(pid=75165) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 00:19:27 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-be9a63a2-6f30-4973-b220-872af6d9af23 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:19:27 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-be9a63a2-6f30-4973-b220-872af6d9af23 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:19:27 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-be9a63a2-6f30-4973-b220-872af6d9af23 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:19:27 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-be9a63a2-6f30-4973-b220-872af6d9af23 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: bad6c21f-885f-4348-86f7-b237ce2d241b] Start _get_guest_xml network_info=[{"id": "b64d421a-ca91-4f21-80f7-17b0c17ceb8a", "address": "fa:16:3e:54:54:b8", "network": {"id": "bd1c84f9-bba9-4a23-8bf2-17e65022136a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1557945804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2911497df44047d9a9ee36a5652298bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb64d421a-ca", "ovs_interfaceid": "b64d421a-ca91-4f21-80f7-17b0c17ceb8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:99a43689-b7cd-47e6-ae88-fd8ba07c60c1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RhTfzArp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'bad6c21f-885f-4348-86f7-b237ce2d241b', 'attached_at': '', 'detached_at': '', 'volume_id': '99a43689-b7cd-47e6-ae88-fd8ba07c60c1', 'serial': '99a43689-b7cd-47e6-ae88-fd8ba07c60c1'}, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'attachment_id': '2b9ef915-36a0-43a9-b6b1-1d4a8fff62b8', 'delete_on_termination': True, 'volume_type': None} {{(pid=75165) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 00:19:27 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-be9a63a2-6f30-4973-b220-872af6d9af23 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:19:27 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-be9a63a2-6f30-4973-b220-872af6d9af23 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:19:27 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-be9a63a2-6f30-4973-b220-872af6d9af23 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75165) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 00:19:27 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-be9a63a2-6f30-4973-b220-872af6d9af23 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] CPU controller missing on host. {{(pid=75165) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 00:19:27 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-be9a63a2-6f30-4973-b220-872af6d9af23 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75165) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 00:19:27 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-be9a63a2-6f30-4973-b220-872af6d9af23 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] CPU controller found on host. {{(pid=75165) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 00:19:27 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-be9a63a2-6f30-4973-b220-872af6d9af23 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75165) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 00:19:27 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-be9a63a2-6f30-4973-b220-872af6d9af23 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T00:03:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 00:19:27 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-be9a63a2-6f30-4973-b220-872af6d9af23 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Flavor limits 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 00:19:27 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-be9a63a2-6f30-4973-b220-872af6d9af23 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Image limits 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 00:19:27 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-be9a63a2-6f30-4973-b220-872af6d9af23 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Flavor pref 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 00:19:27 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-be9a63a2-6f30-4973-b220-872af6d9af23 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Image pref 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 00:19:27 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-be9a63a2-6f30-4973-b220-872af6d9af23 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 00:19:27 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-be9a63a2-6f30-4973-b220-872af6d9af23 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 00:19:27 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-be9a63a2-6f30-4973-b220-872af6d9af23 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75165) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 00:19:27 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-be9a63a2-6f30-4973-b220-872af6d9af23 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Got 1 possible topologies {{(pid=75165) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 00:19:27 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-be9a63a2-6f30-4973-b220-872af6d9af23 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 00:19:27 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-be9a63a2-6f30-4973-b220-872af6d9af23 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 00:19:27 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be9a63a2-6f30-4973-b220-872af6d9af23 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: bad6c21f-885f-4348-86f7-b237ce2d241b] Calling os-brick to attach iSCSI Volume {{(pid=75165) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 00:19:27 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-be9a63a2-6f30-4973-b220-872af6d9af23 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8bf8160e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:99a43689-b7cd-47e6-ae88-fd8ba07c60c1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RhTfzArp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:19:27 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-be9a63a2-6f30-4973-b220-872af6d9af23 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:19:27 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-be9a63a2-6f30-4973-b220-872af6d9af23 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:19:27 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-be9a63a2-6f30-4973-b220-872af6d9af23 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:19:27 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-be9a63a2-6f30-4973-b220-872af6d9af23 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:19:27 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-be9a63a2-6f30-4973-b220-872af6d9af23 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:99a43689-b7cd-47e6-ae88-fd8ba07c60c1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:19:27 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-be9a63a2-6f30-4973-b220-872af6d9af23 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:99a43689-b7cd-47e6-ae88-fd8ba07c60c1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:19:27 user nova-compute[75165]: INFO os_brick.initiator.connectors.iscsi [None req-be9a63a2-6f30-4973-b220-872af6d9af23 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 00:19:27 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99a43689-b7cd-47e6-ae88-fd8ba07c60c1 -p 172.16.0.220:3260 {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:19:27 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99a43689-b7cd-47e6-ae88-fd8ba07c60c1 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:19:27 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[339910dc-1d0c-46d6-b257-b7f57b6da50d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:19:27 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-be9a63a2-6f30-4973-b220-872af6d9af23 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 00:19:27 user nova-compute[75165]:  {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:19:27 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99a43689-b7cd-47e6-ae88-fd8ba07c60c1 -p 172.16.0.220:3260 --interface default --op new {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:19:27 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99a43689-b7cd-47e6-ae88-fd8ba07c60c1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:19:27 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9576fbb-e14a-484e-81a9-912032ce218d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:99a43689-b7cd-47e6-ae88-fd8ba07c60c1] added\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:19:27 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-be9a63a2-6f30-4973-b220-872af6d9af23 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:99a43689-b7cd-47e6-ae88-fd8ba07c60c1] added
Oct 26 00:19:27 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:19:27 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99a43689-b7cd-47e6-ae88-fd8ba07c60c1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:19:27 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99a43689-b7cd-47e6-ae88-fd8ba07c60c1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:19:27 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab9a470f-e30e-4524-a684-c6adf33d19f4]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:19:27 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-be9a63a2-6f30-4973-b220-872af6d9af23 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:19:27 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99a43689-b7cd-47e6-ae88-fd8ba07c60c1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:19:27 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99a43689-b7cd-47e6-ae88-fd8ba07c60c1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:19:27 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[97973d9c-736f-4111-ab7f-4b4b9ce707ff]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:19:27 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-be9a63a2-6f30-4973-b220-872af6d9af23 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:19:27 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99a43689-b7cd-47e6-ae88-fd8ba07c60c1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RhTfzArp {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:19:27 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99a43689-b7cd-47e6-ae88-fd8ba07c60c1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RhTfzArp" returned: 0 in 0.025s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:19:27 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[9259d8a4-c755-44ea-a94b-7d32a4b243f8]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:19:27 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-be9a63a2-6f30-4973-b220-872af6d9af23 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RhTfzArp'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:19:27 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99a43689-b7cd-47e6-ae88-fd8ba07c60c1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:19:27 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99a43689-b7cd-47e6-ae88-fd8ba07c60c1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:19:27 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[d21ee5c2-7488-4e03-b92a-38ec09139f82]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:19:27 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-be9a63a2-6f30-4973-b220-872af6d9af23 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:19:27 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:19:27 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:19:27 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab12891d-f70c-4314-9823-53985da94263]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f431d8b9-aa1e-46f5-b7da-39f4a550e050 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f06e40e7-3ca1-4a25-bd11-ff01280c6df2 (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:19:27 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-be9a63a2-6f30-4973-b220-872af6d9af23 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f431d8b9-aa1e-46f5-b7da-39f4a550e050 (non-flash)
Oct 26 00:19:27 user nova-compute[75165]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f06e40e7-3ca1-4a25-bd11-ff01280c6df2 (non-flash)
Oct 26 00:19:27 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:19:27 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-be9a63a2-6f30-4973-b220-872af6d9af23 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f431d8b9-aa1e-46f5-b7da-39f4a550e050 (non-flash)
Oct 26 00:19:27 user nova-compute[75165]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f06e40e7-3ca1-4a25-bd11-ff01280c6df2 (non-flash)
Oct 26 00:19:27 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:19:27 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99a43689-b7cd-47e6-ae88-fd8ba07c60c1 -p 172.16.0.220:3260 --login {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:19:27 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99a43689-b7cd-47e6-ae88-fd8ba07c60c1 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:19:27 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1c626b5-1a79-4c68-a07c-9e6488eba59f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:99a43689-b7cd-47e6-ae88-fd8ba07c60c1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:99a43689-b7cd-47e6-ae88-fd8ba07c60c1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:19:27 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-be9a63a2-6f30-4973-b220-872af6d9af23 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:99a43689-b7cd-47e6-ae88-fd8ba07c60c1, portal: 172.16.0.220,3260]
Oct 26 00:19:27 user nova-compute[75165]: Login to [iface: default, target: iqn.2010-10.org.openstack:99a43689-b7cd-47e6-ae88-fd8ba07c60c1, portal: 172.16.0.220,3260] successful.
Oct 26 00:19:27 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:19:27 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99a43689-b7cd-47e6-ae88-fd8ba07c60c1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:19:27 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99a43689-b7cd-47e6-ae88-fd8ba07c60c1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:19:27 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8d793de-dc47-40fa-bf00-3651940ca4ca]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:19:27 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-be9a63a2-6f30-4973-b220-872af6d9af23 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:19:27 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:19:27 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:19:27 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[4df52f20-6bec-42ae-a8cf-b3880213256d]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f431d8b9-aa1e-46f5-b7da-39f4a550e050 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f06e40e7-3ca1-4a25-bd11-ff01280c6df2 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a43689-b7cd-47e6-ae88-fd8ba07c60c1 (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:19:27 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-be9a63a2-6f30-4973-b220-872af6d9af23 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f431d8b9-aa1e-46f5-b7da-39f4a550e050 (non-flash)
Oct 26 00:19:27 user nova-compute[75165]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f06e40e7-3ca1-4a25-bd11-ff01280c6df2 (non-flash)
Oct 26 00:19:27 user nova-compute[75165]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a43689-b7cd-47e6-ae88-fd8ba07c60c1 (non-flash)
Oct 26 00:19:27 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:19:27 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-be9a63a2-6f30-4973-b220-872af6d9af23 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f431d8b9-aa1e-46f5-b7da-39f4a550e050 (non-flash)
Oct 26 00:19:27 user nova-compute[75165]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f06e40e7-3ca1-4a25-bd11-ff01280c6df2 (non-flash)
Oct 26 00:19:27 user nova-compute[75165]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a43689-b7cd-47e6-ae88-fd8ba07c60c1 (non-flash)
Oct 26 00:19:27 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:19:27 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-be9a63a2-6f30-4973-b220-872af6d9af23 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:99a43689-b7cd-47e6-ae88-fd8ba07c60c1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.294s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:19:27 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-be9a63a2-6f30-4973-b220-872af6d9af23 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Connected to 172.16.0.220:3260 {{(pid=75165) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 00:19:27 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-be9a63a2-6f30-4973-b220-872af6d9af23 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] HCTL ('35', '-', '-', 0) found on session 25 with lun 0 {{(pid=75165) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 00:19:27 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-be9a63a2-6f30-4973-b220-872af6d9af23 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75165) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 00:19:27 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:19:27 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:19:27 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[f207cb68-1d06-425c-a7d1-d6f35148ca72]: (4, ('- - 0', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:19:27 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-be9a63a2-6f30-4973-b220-872af6d9af23 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Searching for a device in session 25 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75165) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 00:19:27 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-be9a63a2-6f30-4973-b220-872af6d9af23 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:99a43689-b7cd-47e6-ae88-fd8ba07c60c1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RhTfzArp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75165) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 00:19:28 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-be9a63a2-6f30-4973-b220-872af6d9af23 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.326s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:19:28 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-be9a63a2-6f30-4973-b220-872af6d9af23 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] <== connect_volume: return (1329ms) {'type': 'block', 'scsi_wwn': '23630393831646262', 'path': '/dev/sdd'} {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:19:28 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be9a63a2-6f30-4973-b220-872af6d9af23 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: bad6c21f-885f-4348-86f7-b237ce2d241b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23630393831646262', 'path': '/dev/sdd'} {{(pid=75165) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 00:19:28 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-be9a63a2-6f30-4973-b220-872af6d9af23 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:19:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-71108019',display_name='tempest-ServerActionsTestOtherA-server-71108019',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-71108019',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOtsEaxSd5nKie4b+oTvKYqMVt06ToquYp528kCMFq0uGoZPhLpZteN38KkhJxhsHSzqyfMtJ24GLZPdcByyVczoa0tAnbSbuiNOiWj1Q2SiBRytz34zgMiDTwdnF2ayTw==',key_name='tempest-keypair-1300111',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2911497df44047d9a9ee36a5652298bc',ramdisk_id='',reservation_id='r-5k0e6xul',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1690932306',owner_user_name='tempest-ServerActionsTestOtherA-1690932306-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T00:19:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b3ce94f4c01446ebf79a1eba3833e01',uuid=bad6c21f-885f-4348-86f7-b237ce2d241b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b64d421a-ca91-4f21-80f7-17b0c17ceb8a", "address": "fa:16:3e:54:54:b8", "network": {"id": "bd1c84f9-bba9-4a23-8bf2-17e65022136a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1557945804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2911497df44047d9a9ee36a5652298bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb64d421a-ca", "ovs_interfaceid": "b64d421a-ca91-4f21-80f7-17b0c17ceb8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75165) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 00:19:28 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-be9a63a2-6f30-4973-b220-872af6d9af23 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Converting VIF {"id": "b64d421a-ca91-4f21-80f7-17b0c17ceb8a", "address": "fa:16:3e:54:54:b8", "network": {"id": "bd1c84f9-bba9-4a23-8bf2-17e65022136a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1557945804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2911497df44047d9a9ee36a5652298bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb64d421a-ca", "ovs_interfaceid": "b64d421a-ca91-4f21-80f7-17b0c17ceb8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:19:28 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-be9a63a2-6f30-4973-b220-872af6d9af23 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:54:b8,bridge_name='br-int',has_traffic_filtering=True,id=b64d421a-ca91-4f21-80f7-17b0c17ceb8a,network=Network(bd1c84f9-bba9-4a23-8bf2-17e65022136a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb64d421a-ca') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:19:28 user nova-compute[75165]: DEBUG nova.objects.instance [None req-be9a63a2-6f30-4973-b220-872af6d9af23 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Lazy-loading 'pci_devices' on Instance uuid bad6c21f-885f-4348-86f7-b237ce2d241b {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:19:28 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-be9a63a2-6f30-4973-b220-872af6d9af23 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: bad6c21f-885f-4348-86f7-b237ce2d241b] End _get_guest_xml xml=<domain type="kvm">
Oct 26 00:19:28 user nova-compute[75165]:   <uuid>bad6c21f-885f-4348-86f7-b237ce2d241b</uuid>
Oct 26 00:19:28 user nova-compute[75165]:   <name>instance-0000001b</name>
Oct 26 00:19:28 user nova-compute[75165]:   <memory>524288</memory>
Oct 26 00:19:28 user nova-compute[75165]:   <vcpu>1</vcpu>
Oct 26 00:19:28 user nova-compute[75165]:   <metadata>
Oct 26 00:19:28 user nova-compute[75165]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 00:19:28 user nova-compute[75165]:       <nova:package version="0.0.0"/>
Oct 26 00:19:28 user nova-compute[75165]:       <nova:name>tempest-ServerActionsTestOtherA-server-71108019</nova:name>
Oct 26 00:19:28 user nova-compute[75165]:       <nova:creationTime>2023-10-26 00:19:27</nova:creationTime>
Oct 26 00:19:28 user nova-compute[75165]:       <nova:flavor name="m1.tiny">
Oct 26 00:19:28 user nova-compute[75165]:         <nova:memory>512</nova:memory>
Oct 26 00:19:28 user nova-compute[75165]:         <nova:disk>1</nova:disk>
Oct 26 00:19:28 user nova-compute[75165]:         <nova:swap>0</nova:swap>
Oct 26 00:19:28 user nova-compute[75165]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 00:19:28 user nova-compute[75165]:         <nova:vcpus>1</nova:vcpus>
Oct 26 00:19:28 user nova-compute[75165]:       </nova:flavor>
Oct 26 00:19:28 user nova-compute[75165]:       <nova:owner>
Oct 26 00:19:28 user nova-compute[75165]:         <nova:user uuid="5b3ce94f4c01446ebf79a1eba3833e01">tempest-ServerActionsTestOtherA-1690932306-project-member</nova:user>
Oct 26 00:19:28 user nova-compute[75165]:         <nova:project uuid="2911497df44047d9a9ee36a5652298bc">tempest-ServerActionsTestOtherA-1690932306</nova:project>
Oct 26 00:19:28 user nova-compute[75165]:       </nova:owner>
Oct 26 00:19:28 user nova-compute[75165]:       <nova:ports>
Oct 26 00:19:28 user nova-compute[75165]:         <nova:port uuid="b64d421a-ca91-4f21-80f7-17b0c17ceb8a">
Oct 26 00:19:28 user nova-compute[75165]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 26 00:19:28 user nova-compute[75165]:         </nova:port>
Oct 26 00:19:28 user nova-compute[75165]:       </nova:ports>
Oct 26 00:19:28 user nova-compute[75165]:     </nova:instance>
Oct 26 00:19:28 user nova-compute[75165]:   </metadata>
Oct 26 00:19:28 user nova-compute[75165]:   <sysinfo type="smbios">
Oct 26 00:19:28 user nova-compute[75165]:     <system>
Oct 26 00:19:28 user nova-compute[75165]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 00:19:28 user nova-compute[75165]:       <entry name="product">OpenStack Nova</entry>
Oct 26 00:19:28 user nova-compute[75165]:       <entry name="version">0.0.0</entry>
Oct 26 00:19:28 user nova-compute[75165]:       <entry name="serial">bad6c21f-885f-4348-86f7-b237ce2d241b</entry>
Oct 26 00:19:28 user nova-compute[75165]:       <entry name="uuid">bad6c21f-885f-4348-86f7-b237ce2d241b</entry>
Oct 26 00:19:28 user nova-compute[75165]:       <entry name="family">Virtual Machine</entry>
Oct 26 00:19:28 user nova-compute[75165]:     </system>
Oct 26 00:19:28 user nova-compute[75165]:   </sysinfo>
Oct 26 00:19:28 user nova-compute[75165]:   <os>
Oct 26 00:19:28 user nova-compute[75165]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 00:19:28 user nova-compute[75165]:     <boot dev="hd"/>
Oct 26 00:19:28 user nova-compute[75165]:     <smbios mode="sysinfo"/>
Oct 26 00:19:28 user nova-compute[75165]:   </os>
Oct 26 00:19:28 user nova-compute[75165]:   <features>
Oct 26 00:19:28 user nova-compute[75165]:     <acpi/>
Oct 26 00:19:28 user nova-compute[75165]:     <apic/>
Oct 26 00:19:28 user nova-compute[75165]:     <vmcoreinfo/>
Oct 26 00:19:28 user nova-compute[75165]:   </features>
Oct 26 00:19:28 user nova-compute[75165]:   <clock offset="utc">
Oct 26 00:19:28 user nova-compute[75165]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 00:19:28 user nova-compute[75165]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 00:19:28 user nova-compute[75165]:     <timer name="hpet" present="no"/>
Oct 26 00:19:28 user nova-compute[75165]:   </clock>
Oct 26 00:19:28 user nova-compute[75165]:   <cpu mode="custom" match="exact">
Oct 26 00:19:28 user nova-compute[75165]:     <model>Nehalem</model>
Oct 26 00:19:28 user nova-compute[75165]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 00:19:28 user nova-compute[75165]:   </cpu>
Oct 26 00:19:28 user nova-compute[75165]:   <devices>
Oct 26 00:19:28 user nova-compute[75165]:     <disk type="block" device="disk">
Oct 26 00:19:28 user nova-compute[75165]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 00:19:28 user nova-compute[75165]:       <source dev="/dev/sdd"/>
Oct 26 00:19:28 user nova-compute[75165]:       <target dev="vda" bus="virtio"/>
Oct 26 00:19:28 user nova-compute[75165]:       <serial>99a43689-b7cd-47e6-ae88-fd8ba07c60c1</serial>
Oct 26 00:19:28 user nova-compute[75165]:     </disk>
Oct 26 00:19:28 user nova-compute[75165]:     <interface type="ethernet">
Oct 26 00:19:28 user nova-compute[75165]:       <mac address="fa:16:3e:54:54:b8"/>
Oct 26 00:19:28 user nova-compute[75165]:       <model type="virtio"/>
Oct 26 00:19:28 user nova-compute[75165]:       <mtu size="1442"/>
Oct 26 00:19:28 user nova-compute[75165]:       <target dev="tapb64d421a-ca"/>
Oct 26 00:19:28 user nova-compute[75165]:     </interface>
Oct 26 00:19:28 user nova-compute[75165]:     <serial type="pty">
Oct 26 00:19:28 user nova-compute[75165]:       <log file="/opt/stack/data/nova/instances/bad6c21f-885f-4348-86f7-b237ce2d241b/console.log" append="off"/>
Oct 26 00:19:28 user nova-compute[75165]:     </serial>
Oct 26 00:19:28 user nova-compute[75165]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 00:19:28 user nova-compute[75165]:     <video>
Oct 26 00:19:28 user nova-compute[75165]:       <model type="virtio"/>
Oct 26 00:19:28 user nova-compute[75165]:     </video>
Oct 26 00:19:28 user nova-compute[75165]:     <rng model="virtio">
Oct 26 00:19:28 user nova-compute[75165]:       <backend model="random">/dev/urandom</backend>
Oct 26 00:19:28 user nova-compute[75165]:     </rng>
Oct 26 00:19:28 user nova-compute[75165]:     <controller type="usb" index="0" model="none"/>
Oct 26 00:19:28 user nova-compute[75165]:     <memballoon model="virtio">
Oct 26 00:19:28 user nova-compute[75165]:       <stats period="10"/>
Oct 26 00:19:28 user nova-compute[75165]:     </memballoon>
Oct 26 00:19:28 user nova-compute[75165]:   </devices>
Oct 26 00:19:28 user nova-compute[75165]: </domain>
Oct 26 00:19:28 user nova-compute[75165]:  {{(pid=75165) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 00:19:28 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-be9a63a2-6f30-4973-b220-872af6d9af23 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:19:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-71108019',display_name='tempest-ServerActionsTestOtherA-server-71108019',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-71108019',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOtsEaxSd5nKie4b+oTvKYqMVt06ToquYp528kCMFq0uGoZPhLpZteN38KkhJxhsHSzqyfMtJ24GLZPdcByyVczoa0tAnbSbuiNOiWj1Q2SiBRytz34zgMiDTwdnF2ayTw==',key_name='tempest-keypair-1300111',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2911497df44047d9a9ee36a5652298bc',ramdisk_id='',reservation_id='r-5k0e6xul',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1690932306',owner_user_name='tempest-ServerActionsTestOtherA-1690932306-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T00:19:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b3ce94f4c01446ebf79a1eba3833e01',uuid=bad6c21f-885f-4348-86f7-b237ce2d241b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b64d421a-ca91-4f21-80f7-17b0c17ceb8a", "address": "fa:16:3e:54:54:b8", "network": {"id": "bd1c84f9-bba9-4a23-8bf2-17e65022136a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1557945804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2911497df44047d9a9ee36a5652298bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb64d421a-ca", "ovs_interfaceid": "b64d421a-ca91-4f21-80f7-17b0c17ceb8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 00:19:28 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-be9a63a2-6f30-4973-b220-872af6d9af23 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Converting VIF {"id": "b64d421a-ca91-4f21-80f7-17b0c17ceb8a", "address": "fa:16:3e:54:54:b8", "network": {"id": "bd1c84f9-bba9-4a23-8bf2-17e65022136a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1557945804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2911497df44047d9a9ee36a5652298bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb64d421a-ca", "ovs_interfaceid": "b64d421a-ca91-4f21-80f7-17b0c17ceb8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:19:28 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-be9a63a2-6f30-4973-b220-872af6d9af23 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:54:b8,bridge_name='br-int',has_traffic_filtering=True,id=b64d421a-ca91-4f21-80f7-17b0c17ceb8a,network=Network(bd1c84f9-bba9-4a23-8bf2-17e65022136a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb64d421a-ca') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:19:28 user nova-compute[75165]: DEBUG os_vif [None req-be9a63a2-6f30-4973-b220-872af6d9af23 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:54:b8,bridge_name='br-int',has_traffic_filtering=True,id=b64d421a-ca91-4f21-80f7-17b0c17ceb8a,network=Network(bd1c84f9-bba9-4a23-8bf2-17e65022136a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb64d421a-ca') {{(pid=75165) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 00:19:28 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:19:28 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:19:28 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 00:19:28 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:19:28 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6f80f756-3d52-515d-9638-1ffa93684992', '_type': 'linux-noop'}}, row=False) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:19:28 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:19:28 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:19:28 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:19:28 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb64d421a-ca, may_exist=True, interface_attrs={}) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:19:28 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb64d421a-ca, col_values=(('qos', UUID('2b8fb9de-2050-4f9d-93e4-9de6de4fcb32')),), if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:19:28 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb64d421a-ca, col_values=(('external_ids', {'iface-id': 'b64d421a-ca91-4f21-80f7-17b0c17ceb8a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:54:54:b8', 'vm-uuid': 'bad6c21f-885f-4348-86f7-b237ce2d241b'}),), if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:19:28 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:19:28 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:19:28 user nova-compute[75165]: INFO os_vif [None req-be9a63a2-6f30-4973-b220-872af6d9af23 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:54:b8,bridge_name='br-int',has_traffic_filtering=True,id=b64d421a-ca91-4f21-80f7-17b0c17ceb8a,network=Network(bd1c84f9-bba9-4a23-8bf2-17e65022136a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb64d421a-ca')
Oct 26 00:19:28 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-be9a63a2-6f30-4973-b220-872af6d9af23 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] No BDM found with device name vda, not building metadata. {{(pid=75165) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 00:19:28 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-be9a63a2-6f30-4973-b220-872af6d9af23 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] No VIF found with MAC fa:16:3e:54:54:b8, not building metadata {{(pid=75165) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 00:19:29 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:19:29 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:19:29 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:19:30 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:19:30 user nova-compute[75165]: DEBUG nova.compute.manager [req-50dc52e4-7c2f-4ad6-9ae3-a9d909259cc6 req-052461b8-4e73-492d-839c-fd915eeb2fc5 service nova] [instance: bad6c21f-885f-4348-86f7-b237ce2d241b] Received event network-vif-plugged-b64d421a-ca91-4f21-80f7-17b0c17ceb8a {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:19:30 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-50dc52e4-7c2f-4ad6-9ae3-a9d909259cc6 req-052461b8-4e73-492d-839c-fd915eeb2fc5 service nova] Acquiring lock "bad6c21f-885f-4348-86f7-b237ce2d241b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:19:30 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-50dc52e4-7c2f-4ad6-9ae3-a9d909259cc6 req-052461b8-4e73-492d-839c-fd915eeb2fc5 service nova] Lock "bad6c21f-885f-4348-86f7-b237ce2d241b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:19:30 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-50dc52e4-7c2f-4ad6-9ae3-a9d909259cc6 req-052461b8-4e73-492d-839c-fd915eeb2fc5 service nova] Lock "bad6c21f-885f-4348-86f7-b237ce2d241b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:19:30 user nova-compute[75165]: DEBUG nova.compute.manager [req-50dc52e4-7c2f-4ad6-9ae3-a9d909259cc6 req-052461b8-4e73-492d-839c-fd915eeb2fc5 service nova] [instance: bad6c21f-885f-4348-86f7-b237ce2d241b] No waiting events found dispatching network-vif-plugged-b64d421a-ca91-4f21-80f7-17b0c17ceb8a {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:19:30 user nova-compute[75165]: WARNING nova.compute.manager [req-50dc52e4-7c2f-4ad6-9ae3-a9d909259cc6 req-052461b8-4e73-492d-839c-fd915eeb2fc5 service nova] [instance: bad6c21f-885f-4348-86f7-b237ce2d241b] Received unexpected event network-vif-plugged-b64d421a-ca91-4f21-80f7-17b0c17ceb8a for instance with vm_state building and task_state spawning.
Oct 26 00:19:31 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:19:32 user nova-compute[75165]: DEBUG nova.compute.manager [None req-be9a63a2-6f30-4973-b220-872af6d9af23 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: bad6c21f-885f-4348-86f7-b237ce2d241b] Instance event wait completed in 0 seconds for  {{(pid=75165) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 00:19:32 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-be9a63a2-6f30-4973-b220-872af6d9af23 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: bad6c21f-885f-4348-86f7-b237ce2d241b] Guest created on hypervisor {{(pid=75165) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 00:19:32 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: bad6c21f-885f-4348-86f7-b237ce2d241b] Instance spawned successfully.
Oct 26 00:19:32 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-be9a63a2-6f30-4973-b220-872af6d9af23 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: bad6c21f-885f-4348-86f7-b237ce2d241b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 00:19:32 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-be9a63a2-6f30-4973-b220-872af6d9af23 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: bad6c21f-885f-4348-86f7-b237ce2d241b] Found default for hw_cdrom_bus of ide {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:19:32 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-be9a63a2-6f30-4973-b220-872af6d9af23 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: bad6c21f-885f-4348-86f7-b237ce2d241b] Found default for hw_disk_bus of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:19:32 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-be9a63a2-6f30-4973-b220-872af6d9af23 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: bad6c21f-885f-4348-86f7-b237ce2d241b] Found default for hw_input_bus of None {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:19:32 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-be9a63a2-6f30-4973-b220-872af6d9af23 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: bad6c21f-885f-4348-86f7-b237ce2d241b] Found default for hw_pointer_model of None {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:19:32 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-be9a63a2-6f30-4973-b220-872af6d9af23 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: bad6c21f-885f-4348-86f7-b237ce2d241b] Found default for hw_video_model of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:19:32 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-be9a63a2-6f30-4973-b220-872af6d9af23 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: bad6c21f-885f-4348-86f7-b237ce2d241b] Found default for hw_vif_model of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:19:32 user nova-compute[75165]: DEBUG nova.compute.manager [req-424c7443-e1d0-4269-aefc-ff438ad13b3b req-832a021b-54b9-4327-bc18-8b294a831e6d service nova] [instance: bad6c21f-885f-4348-86f7-b237ce2d241b] Received event network-vif-plugged-b64d421a-ca91-4f21-80f7-17b0c17ceb8a {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:19:32 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-424c7443-e1d0-4269-aefc-ff438ad13b3b req-832a021b-54b9-4327-bc18-8b294a831e6d service nova] Acquiring lock "bad6c21f-885f-4348-86f7-b237ce2d241b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:19:32 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-424c7443-e1d0-4269-aefc-ff438ad13b3b req-832a021b-54b9-4327-bc18-8b294a831e6d service nova] Lock "bad6c21f-885f-4348-86f7-b237ce2d241b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:19:32 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-424c7443-e1d0-4269-aefc-ff438ad13b3b req-832a021b-54b9-4327-bc18-8b294a831e6d service nova] Lock "bad6c21f-885f-4348-86f7-b237ce2d241b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:19:32 user nova-compute[75165]: DEBUG nova.compute.manager [req-424c7443-e1d0-4269-aefc-ff438ad13b3b req-832a021b-54b9-4327-bc18-8b294a831e6d service nova] [instance: bad6c21f-885f-4348-86f7-b237ce2d241b] No waiting events found dispatching network-vif-plugged-b64d421a-ca91-4f21-80f7-17b0c17ceb8a {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:19:32 user nova-compute[75165]: WARNING nova.compute.manager [req-424c7443-e1d0-4269-aefc-ff438ad13b3b req-832a021b-54b9-4327-bc18-8b294a831e6d service nova] [instance: bad6c21f-885f-4348-86f7-b237ce2d241b] Received unexpected event network-vif-plugged-b64d421a-ca91-4f21-80f7-17b0c17ceb8a for instance with vm_state building and task_state spawning.
Oct 26 00:19:32 user nova-compute[75165]: INFO nova.compute.manager [None req-be9a63a2-6f30-4973-b220-872af6d9af23 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: bad6c21f-885f-4348-86f7-b237ce2d241b] Took 5.27 seconds to spawn the instance on the hypervisor.
Oct 26 00:19:32 user nova-compute[75165]: DEBUG nova.compute.manager [None req-be9a63a2-6f30-4973-b220-872af6d9af23 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: bad6c21f-885f-4348-86f7-b237ce2d241b] Checking state {{(pid=75165) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 00:19:32 user nova-compute[75165]: INFO nova.compute.manager [None req-be9a63a2-6f30-4973-b220-872af6d9af23 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: bad6c21f-885f-4348-86f7-b237ce2d241b] Took 24.69 seconds to build instance.
Oct 26 00:19:32 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-be9a63a2-6f30-4973-b220-872af6d9af23 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Lock "bad6c21f-885f-4348-86f7-b237ce2d241b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 24.803s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:19:33 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:19:36 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:19:38 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-f158c805-8e16-4fa8-ae05-bfd19b508917 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Acquiring lock "27fa1771-fb69-49da-81b3-7f112e623170" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:19:38 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-f158c805-8e16-4fa8-ae05-bfd19b508917 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Lock "27fa1771-fb69-49da-81b3-7f112e623170" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:19:38 user nova-compute[75165]: INFO nova.compute.manager [None req-f158c805-8e16-4fa8-ae05-bfd19b508917 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] [instance: 27fa1771-fb69-49da-81b3-7f112e623170] Detaching volume f431d8b9-aa1e-46f5-b7da-39f4a550e050
Oct 26 00:19:38 user nova-compute[75165]: INFO nova.virt.block_device [None req-f158c805-8e16-4fa8-ae05-bfd19b508917 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] [instance: 27fa1771-fb69-49da-81b3-7f112e623170] Attempting to driver detach volume f431d8b9-aa1e-46f5-b7da-39f4a550e050 from mountpoint /dev/vdb
Oct 26 00:19:38 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-f158c805-8e16-4fa8-ae05-bfd19b508917 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Attempting to detach device vdb from instance 27fa1771-fb69-49da-81b3-7f112e623170 from the persistent domain config. {{(pid=75165) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 00:19:38 user nova-compute[75165]: DEBUG nova.virt.libvirt.guest [None req-f158c805-8e16-4fa8-ae05-bfd19b508917 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 00:19:38 user nova-compute[75165]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 00:19:38 user nova-compute[75165]:   <source dev="/dev/sdb"/>
Oct 26 00:19:38 user nova-compute[75165]:   <target dev="vdb" bus="virtio"/>
Oct 26 00:19:38 user nova-compute[75165]:   <serial>f431d8b9-aa1e-46f5-b7da-39f4a550e050</serial>
Oct 26 00:19:38 user nova-compute[75165]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 26 00:19:38 user nova-compute[75165]: </disk>
Oct 26 00:19:38 user nova-compute[75165]:  {{(pid=75165) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 00:19:38 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-f158c805-8e16-4fa8-ae05-bfd19b508917 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Successfully detached device vdb from instance 27fa1771-fb69-49da-81b3-7f112e623170 from the persistent domain config.
Oct 26 00:19:38 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-f158c805-8e16-4fa8-ae05-bfd19b508917 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 27fa1771-fb69-49da-81b3-7f112e623170 from the live domain config. {{(pid=75165) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 00:19:38 user nova-compute[75165]: DEBUG nova.virt.libvirt.guest [None req-f158c805-8e16-4fa8-ae05-bfd19b508917 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 00:19:38 user nova-compute[75165]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 00:19:38 user nova-compute[75165]:   <source dev="/dev/sdb"/>
Oct 26 00:19:38 user nova-compute[75165]:   <target dev="vdb" bus="virtio"/>
Oct 26 00:19:38 user nova-compute[75165]:   <serial>f431d8b9-aa1e-46f5-b7da-39f4a550e050</serial>
Oct 26 00:19:38 user nova-compute[75165]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 26 00:19:38 user nova-compute[75165]: </disk>
Oct 26 00:19:38 user nova-compute[75165]:  {{(pid=75165) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 00:19:38 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:19:38 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-f158c805-8e16-4fa8-ae05-bfd19b508917 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 27fa1771-fb69-49da-81b3-7f112e623170 {{(pid=75165) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 00:19:39 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-d2907479-2528-4274-8c90-f0e45f634a7d tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] Acquiring lock "b6558510-6f87-4ef3-b707-f1fa78bf61e8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:19:39 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-d2907479-2528-4274-8c90-f0e45f634a7d tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] Lock "b6558510-6f87-4ef3-b707-f1fa78bf61e8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:19:39 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-d2907479-2528-4274-8c90-f0e45f634a7d tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] Acquiring lock "b6558510-6f87-4ef3-b707-f1fa78bf61e8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:19:39 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-d2907479-2528-4274-8c90-f0e45f634a7d tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] Lock "b6558510-6f87-4ef3-b707-f1fa78bf61e8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:19:39 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-d2907479-2528-4274-8c90-f0e45f634a7d tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] Lock "b6558510-6f87-4ef3-b707-f1fa78bf61e8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:19:40 user nova-compute[75165]: INFO nova.compute.manager [None req-d2907479-2528-4274-8c90-f0e45f634a7d tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] [instance: b6558510-6f87-4ef3-b707-f1fa78bf61e8] Terminating instance
Oct 26 00:19:40 user nova-compute[75165]: DEBUG nova.compute.manager [None req-d2907479-2528-4274-8c90-f0e45f634a7d tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] [instance: b6558510-6f87-4ef3-b707-f1fa78bf61e8] Start destroying the instance on the hypervisor. {{(pid=75165) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 00:19:40 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:19:40 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:19:40 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:19:40 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:19:40 user nova-compute[75165]: DEBUG nova.compute.manager [req-dbff0e00-6132-4341-a94f-2dd0dddc64d8 req-0a3155eb-196e-4846-a466-169970a9f03b service nova] [instance: b6558510-6f87-4ef3-b707-f1fa78bf61e8] Received event network-vif-unplugged-091593d3-5f35-496b-8e3a-d03963bc0d29 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:19:40 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-dbff0e00-6132-4341-a94f-2dd0dddc64d8 req-0a3155eb-196e-4846-a466-169970a9f03b service nova] Acquiring lock "b6558510-6f87-4ef3-b707-f1fa78bf61e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:19:40 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-dbff0e00-6132-4341-a94f-2dd0dddc64d8 req-0a3155eb-196e-4846-a466-169970a9f03b service nova] Lock "b6558510-6f87-4ef3-b707-f1fa78bf61e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:19:40 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-dbff0e00-6132-4341-a94f-2dd0dddc64d8 req-0a3155eb-196e-4846-a466-169970a9f03b service nova] Lock "b6558510-6f87-4ef3-b707-f1fa78bf61e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:19:40 user nova-compute[75165]: DEBUG nova.compute.manager [req-dbff0e00-6132-4341-a94f-2dd0dddc64d8 req-0a3155eb-196e-4846-a466-169970a9f03b service nova] [instance: b6558510-6f87-4ef3-b707-f1fa78bf61e8] No waiting events found dispatching network-vif-unplugged-091593d3-5f35-496b-8e3a-d03963bc0d29 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:19:40 user nova-compute[75165]: DEBUG nova.compute.manager [req-dbff0e00-6132-4341-a94f-2dd0dddc64d8 req-0a3155eb-196e-4846-a466-169970a9f03b service nova] [instance: b6558510-6f87-4ef3-b707-f1fa78bf61e8] Received event network-vif-unplugged-091593d3-5f35-496b-8e3a-d03963bc0d29 for instance with task_state deleting. {{(pid=75165) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 00:19:40 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:19:40 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:19:40 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:19:40 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: b6558510-6f87-4ef3-b707-f1fa78bf61e8] Instance destroyed successfully.
Oct 26 00:19:40 user nova-compute[75165]: DEBUG nova.objects.instance [None req-d2907479-2528-4274-8c90-f0e45f634a7d tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] Lazy-loading 'resources' on Instance uuid b6558510-6f87-4ef3-b707-f1fa78bf61e8 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:19:40 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-d2907479-2528-4274-8c90-f0e45f634a7d tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:16:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1709787456',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1709787456',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1709787',id=24,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIFgIVZJvI28QJzO8izcFaTf0yzfsmPxFRpcPFoww/GdUbWmzNIRFlipPC/8tFHe1RRliLXYHHiQ178XkIBsO1zlbOTW1uC9kSRsqEyV5/VeLZPhYy3VaVgGm+XUzPv5Rg==',key_name='tempest-keypair-1654320357',keypairs=<?>,launch_index=0,launched_at=2023-10-26T00:16:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8274f81c556047709b5b7b45bcb8a0e9',ramdisk_id='',reservation_id='r-9tkbutm5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-2068497325',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T00:16:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='62ab103dec5d499bb8b83495f201f267',uuid=b6558510-6f87-4ef3-b707-f1fa78bf61e8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "091593d3-5f35-496b-8e3a-d03963bc0d29", "address": "fa:16:3e:ae:d1:d7", "network": {"id": "68f5c9b3-84b6-42db-9fab-e14624851075", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1858718599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8274f81c556047709b5b7b45bcb8a0e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap091593d3-5f", "ovs_interfaceid": "091593d3-5f35-496b-8e3a-d03963bc0d29", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 00:19:40 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-d2907479-2528-4274-8c90-f0e45f634a7d tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] Converting VIF {"id": "091593d3-5f35-496b-8e3a-d03963bc0d29", "address": "fa:16:3e:ae:d1:d7", "network": {"id": "68f5c9b3-84b6-42db-9fab-e14624851075", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1858718599-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8274f81c556047709b5b7b45bcb8a0e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap091593d3-5f", "ovs_interfaceid": "091593d3-5f35-496b-8e3a-d03963bc0d29", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:19:40 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-d2907479-2528-4274-8c90-f0e45f634a7d tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ae:d1:d7,bridge_name='br-int',has_traffic_filtering=True,id=091593d3-5f35-496b-8e3a-d03963bc0d29,network=Network(68f5c9b3-84b6-42db-9fab-e14624851075),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap091593d3-5f') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:19:40 user nova-compute[75165]: DEBUG os_vif [None req-d2907479-2528-4274-8c90-f0e45f634a7d tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:d1:d7,bridge_name='br-int',has_traffic_filtering=True,id=091593d3-5f35-496b-8e3a-d03963bc0d29,network=Network(68f5c9b3-84b6-42db-9fab-e14624851075),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap091593d3-5f') {{(pid=75165) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 00:19:40 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:19:40 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap091593d3-5f, bridge=br-int, if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:19:40 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:19:40 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:19:40 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:19:40 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:19:40 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fd450142-8f40-49b3-860a-a7ea225379d6) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:19:40 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:19:40 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:19:40 user nova-compute[75165]: INFO os_vif [None req-d2907479-2528-4274-8c90-f0e45f634a7d tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:d1:d7,bridge_name='br-int',has_traffic_filtering=True,id=091593d3-5f35-496b-8e3a-d03963bc0d29,network=Network(68f5c9b3-84b6-42db-9fab-e14624851075),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap091593d3-5f')
Oct 26 00:19:40 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-d2907479-2528-4274-8c90-f0e45f634a7d tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] [instance: b6558510-6f87-4ef3-b707-f1fa78bf61e8] Deleting instance files /opt/stack/data/nova/instances/b6558510-6f87-4ef3-b707-f1fa78bf61e8_del
Oct 26 00:19:40 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-d2907479-2528-4274-8c90-f0e45f634a7d tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] [instance: b6558510-6f87-4ef3-b707-f1fa78bf61e8] Deletion of /opt/stack/data/nova/instances/b6558510-6f87-4ef3-b707-f1fa78bf61e8_del complete
Oct 26 00:19:40 user nova-compute[75165]: INFO nova.compute.manager [None req-d2907479-2528-4274-8c90-f0e45f634a7d tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] [instance: b6558510-6f87-4ef3-b707-f1fa78bf61e8] Took 0.96 seconds to destroy the instance on the hypervisor.
Oct 26 00:19:40 user nova-compute[75165]: DEBUG oslo.service.loopingcall [None req-d2907479-2528-4274-8c90-f0e45f634a7d tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75165) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 00:19:40 user nova-compute[75165]: DEBUG nova.compute.manager [-] [instance: b6558510-6f87-4ef3-b707-f1fa78bf61e8] Deallocating network for instance {{(pid=75165) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 00:19:40 user nova-compute[75165]: DEBUG nova.network.neutron [-] [instance: b6558510-6f87-4ef3-b707-f1fa78bf61e8] deallocate_for_instance() {{(pid=75165) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 00:19:41 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:19:41 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:19:41 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:19:41 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:19:41 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:19:41 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:19:41 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:19:41 user nova-compute[75165]: DEBUG nova.network.neutron [-] [instance: b6558510-6f87-4ef3-b707-f1fa78bf61e8] Updating instance_info_cache with network_info: [] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:19:41 user nova-compute[75165]: INFO nova.compute.manager [-] [instance: b6558510-6f87-4ef3-b707-f1fa78bf61e8] Took 0.88 seconds to deallocate network for instance.
Oct 26 00:19:41 user nova-compute[75165]: DEBUG nova.compute.manager [req-04352281-d72e-4198-8314-989b40bc2e92 req-57890252-1254-4c1d-bc67-f61e9c95de16 service nova] [instance: b6558510-6f87-4ef3-b707-f1fa78bf61e8] Received event network-vif-deleted-091593d3-5f35-496b-8e3a-d03963bc0d29 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:19:41 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-d2907479-2528-4274-8c90-f0e45f634a7d tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:19:41 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-d2907479-2528-4274-8c90-f0e45f634a7d tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:19:42 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-d2907479-2528-4274-8c90-f0e45f634a7d tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:19:42 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-d2907479-2528-4274-8c90-f0e45f634a7d tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:19:42 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-d2907479-2528-4274-8c90-f0e45f634a7d tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.346s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:19:42 user nova-compute[75165]: INFO nova.scheduler.client.report [None req-d2907479-2528-4274-8c90-f0e45f634a7d tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] Deleted allocations for instance b6558510-6f87-4ef3-b707-f1fa78bf61e8
Oct 26 00:19:42 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-d2907479-2528-4274-8c90-f0e45f634a7d tempest-TestServerVolumeAttachScenarioOldVersion-2068497325 tempest-TestServerVolumeAttachScenarioOldVersion-2068497325-project-member] Lock "b6558510-6f87-4ef3-b707-f1fa78bf61e8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.431s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:19:42 user nova-compute[75165]: DEBUG nova.compute.manager [req-7fbb573f-985f-4614-bcf3-70b57e598d9c req-5ecbb905-ff54-4bca-8c77-49630fe9cce7 service nova] [instance: b6558510-6f87-4ef3-b707-f1fa78bf61e8] Received event network-vif-plugged-091593d3-5f35-496b-8e3a-d03963bc0d29 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:19:42 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-7fbb573f-985f-4614-bcf3-70b57e598d9c req-5ecbb905-ff54-4bca-8c77-49630fe9cce7 service nova] Acquiring lock "b6558510-6f87-4ef3-b707-f1fa78bf61e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:19:42 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-7fbb573f-985f-4614-bcf3-70b57e598d9c req-5ecbb905-ff54-4bca-8c77-49630fe9cce7 service nova] Lock "b6558510-6f87-4ef3-b707-f1fa78bf61e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:19:42 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-7fbb573f-985f-4614-bcf3-70b57e598d9c req-5ecbb905-ff54-4bca-8c77-49630fe9cce7 service nova] Lock "b6558510-6f87-4ef3-b707-f1fa78bf61e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:19:42 user nova-compute[75165]: DEBUG nova.compute.manager [req-7fbb573f-985f-4614-bcf3-70b57e598d9c req-5ecbb905-ff54-4bca-8c77-49630fe9cce7 service nova] [instance: b6558510-6f87-4ef3-b707-f1fa78bf61e8] No waiting events found dispatching network-vif-plugged-091593d3-5f35-496b-8e3a-d03963bc0d29 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:19:42 user nova-compute[75165]: WARNING nova.compute.manager [req-7fbb573f-985f-4614-bcf3-70b57e598d9c req-5ecbb905-ff54-4bca-8c77-49630fe9cce7 service nova] [instance: b6558510-6f87-4ef3-b707-f1fa78bf61e8] Received unexpected event network-vif-plugged-091593d3-5f35-496b-8e3a-d03963bc0d29 for instance with vm_state deleted and task_state None.
Oct 26 00:19:42 user nova-compute[75165]: DEBUG nova.compute.manager [req-7fbb573f-985f-4614-bcf3-70b57e598d9c req-5ecbb905-ff54-4bca-8c77-49630fe9cce7 service nova] [instance: b6558510-6f87-4ef3-b707-f1fa78bf61e8] Received event network-vif-plugged-091593d3-5f35-496b-8e3a-d03963bc0d29 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:19:42 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-7fbb573f-985f-4614-bcf3-70b57e598d9c req-5ecbb905-ff54-4bca-8c77-49630fe9cce7 service nova] Acquiring lock "b6558510-6f87-4ef3-b707-f1fa78bf61e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:19:42 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-7fbb573f-985f-4614-bcf3-70b57e598d9c req-5ecbb905-ff54-4bca-8c77-49630fe9cce7 service nova] Lock "b6558510-6f87-4ef3-b707-f1fa78bf61e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:19:42 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-7fbb573f-985f-4614-bcf3-70b57e598d9c req-5ecbb905-ff54-4bca-8c77-49630fe9cce7 service nova] Lock "b6558510-6f87-4ef3-b707-f1fa78bf61e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:19:42 user nova-compute[75165]: DEBUG nova.compute.manager [req-7fbb573f-985f-4614-bcf3-70b57e598d9c req-5ecbb905-ff54-4bca-8c77-49630fe9cce7 service nova] [instance: b6558510-6f87-4ef3-b707-f1fa78bf61e8] No waiting events found dispatching network-vif-plugged-091593d3-5f35-496b-8e3a-d03963bc0d29 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:19:42 user nova-compute[75165]: WARNING nova.compute.manager [req-7fbb573f-985f-4614-bcf3-70b57e598d9c req-5ecbb905-ff54-4bca-8c77-49630fe9cce7 service nova] [instance: b6558510-6f87-4ef3-b707-f1fa78bf61e8] Received unexpected event network-vif-plugged-091593d3-5f35-496b-8e3a-d03963bc0d29 for instance with vm_state deleted and task_state None.
Oct 26 00:19:42 user nova-compute[75165]: DEBUG nova.compute.manager [req-7fbb573f-985f-4614-bcf3-70b57e598d9c req-5ecbb905-ff54-4bca-8c77-49630fe9cce7 service nova] [instance: b6558510-6f87-4ef3-b707-f1fa78bf61e8] Received event network-vif-plugged-091593d3-5f35-496b-8e3a-d03963bc0d29 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:19:42 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-7fbb573f-985f-4614-bcf3-70b57e598d9c req-5ecbb905-ff54-4bca-8c77-49630fe9cce7 service nova] Acquiring lock "b6558510-6f87-4ef3-b707-f1fa78bf61e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:19:42 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-7fbb573f-985f-4614-bcf3-70b57e598d9c req-5ecbb905-ff54-4bca-8c77-49630fe9cce7 service nova] Lock "b6558510-6f87-4ef3-b707-f1fa78bf61e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:19:42 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-7fbb573f-985f-4614-bcf3-70b57e598d9c req-5ecbb905-ff54-4bca-8c77-49630fe9cce7 service nova] Lock "b6558510-6f87-4ef3-b707-f1fa78bf61e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:19:42 user nova-compute[75165]: DEBUG nova.compute.manager [req-7fbb573f-985f-4614-bcf3-70b57e598d9c req-5ecbb905-ff54-4bca-8c77-49630fe9cce7 service nova] [instance: b6558510-6f87-4ef3-b707-f1fa78bf61e8] No waiting events found dispatching network-vif-plugged-091593d3-5f35-496b-8e3a-d03963bc0d29 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:19:42 user nova-compute[75165]: WARNING nova.compute.manager [req-7fbb573f-985f-4614-bcf3-70b57e598d9c req-5ecbb905-ff54-4bca-8c77-49630fe9cce7 service nova] [instance: b6558510-6f87-4ef3-b707-f1fa78bf61e8] Received unexpected event network-vif-plugged-091593d3-5f35-496b-8e3a-d03963bc0d29 for instance with vm_state deleted and task_state None.
Oct 26 00:19:42 user nova-compute[75165]: DEBUG nova.compute.manager [req-7fbb573f-985f-4614-bcf3-70b57e598d9c req-5ecbb905-ff54-4bca-8c77-49630fe9cce7 service nova] [instance: b6558510-6f87-4ef3-b707-f1fa78bf61e8] Received event network-vif-unplugged-091593d3-5f35-496b-8e3a-d03963bc0d29 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:19:42 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-7fbb573f-985f-4614-bcf3-70b57e598d9c req-5ecbb905-ff54-4bca-8c77-49630fe9cce7 service nova] Acquiring lock "b6558510-6f87-4ef3-b707-f1fa78bf61e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:19:42 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-7fbb573f-985f-4614-bcf3-70b57e598d9c req-5ecbb905-ff54-4bca-8c77-49630fe9cce7 service nova] Lock "b6558510-6f87-4ef3-b707-f1fa78bf61e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:19:42 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-7fbb573f-985f-4614-bcf3-70b57e598d9c req-5ecbb905-ff54-4bca-8c77-49630fe9cce7 service nova] Lock "b6558510-6f87-4ef3-b707-f1fa78bf61e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:19:42 user nova-compute[75165]: DEBUG nova.compute.manager [req-7fbb573f-985f-4614-bcf3-70b57e598d9c req-5ecbb905-ff54-4bca-8c77-49630fe9cce7 service nova] [instance: b6558510-6f87-4ef3-b707-f1fa78bf61e8] No waiting events found dispatching network-vif-unplugged-091593d3-5f35-496b-8e3a-d03963bc0d29 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:19:42 user nova-compute[75165]: WARNING nova.compute.manager [req-7fbb573f-985f-4614-bcf3-70b57e598d9c req-5ecbb905-ff54-4bca-8c77-49630fe9cce7 service nova] [instance: b6558510-6f87-4ef3-b707-f1fa78bf61e8] Received unexpected event network-vif-unplugged-091593d3-5f35-496b-8e3a-d03963bc0d29 for instance with vm_state deleted and task_state None.
Oct 26 00:19:42 user nova-compute[75165]: DEBUG nova.compute.manager [req-7fbb573f-985f-4614-bcf3-70b57e598d9c req-5ecbb905-ff54-4bca-8c77-49630fe9cce7 service nova] [instance: b6558510-6f87-4ef3-b707-f1fa78bf61e8] Received event network-vif-plugged-091593d3-5f35-496b-8e3a-d03963bc0d29 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:19:42 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-7fbb573f-985f-4614-bcf3-70b57e598d9c req-5ecbb905-ff54-4bca-8c77-49630fe9cce7 service nova] Acquiring lock "b6558510-6f87-4ef3-b707-f1fa78bf61e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:19:42 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-7fbb573f-985f-4614-bcf3-70b57e598d9c req-5ecbb905-ff54-4bca-8c77-49630fe9cce7 service nova] Lock "b6558510-6f87-4ef3-b707-f1fa78bf61e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:19:42 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-7fbb573f-985f-4614-bcf3-70b57e598d9c req-5ecbb905-ff54-4bca-8c77-49630fe9cce7 service nova] Lock "b6558510-6f87-4ef3-b707-f1fa78bf61e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:19:42 user nova-compute[75165]: DEBUG nova.compute.manager [req-7fbb573f-985f-4614-bcf3-70b57e598d9c req-5ecbb905-ff54-4bca-8c77-49630fe9cce7 service nova] [instance: b6558510-6f87-4ef3-b707-f1fa78bf61e8] No waiting events found dispatching network-vif-plugged-091593d3-5f35-496b-8e3a-d03963bc0d29 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:19:42 user nova-compute[75165]: WARNING nova.compute.manager [req-7fbb573f-985f-4614-bcf3-70b57e598d9c req-5ecbb905-ff54-4bca-8c77-49630fe9cce7 service nova] [instance: b6558510-6f87-4ef3-b707-f1fa78bf61e8] Received unexpected event network-vif-plugged-091593d3-5f35-496b-8e3a-d03963bc0d29 for instance with vm_state deleted and task_state None.
Oct 26 00:19:45 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:19:46 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:19:50 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:19:51 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:19:54 user nova-compute[75165]: INFO nova.compute.manager [None req-eec01a13-1ed0-449c-9732-3a232a3995de tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: 91fe894a-90a8-4545-9b27-91771554c4cb] Unrescuing
Oct 26 00:19:54 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-eec01a13-1ed0-449c-9732-3a232a3995de tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Acquiring lock "refresh_cache-91fe894a-90a8-4545-9b27-91771554c4cb" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:19:54 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-eec01a13-1ed0-449c-9732-3a232a3995de tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Acquired lock "refresh_cache-91fe894a-90a8-4545-9b27-91771554c4cb" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:19:54 user nova-compute[75165]: DEBUG nova.network.neutron [None req-eec01a13-1ed0-449c-9732-3a232a3995de tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: 91fe894a-90a8-4545-9b27-91771554c4cb] Building network info cache for instance {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 00:19:54 user nova-compute[75165]: DEBUG nova.network.neutron [None req-eec01a13-1ed0-449c-9732-3a232a3995de tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: 91fe894a-90a8-4545-9b27-91771554c4cb] Updating instance_info_cache with network_info: [{"id": "67590aab-15ed-4684-abd7-64a5c0a9b3f5", "address": "fa:16:3e:7a:ea:a8", "network": {"id": "b31bac4b-1951-4ca3-8682-f1f24de0a5c3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1323234642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71aa69c0ea2d49e184e1e055ff3efa1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67590aab-15", "ovs_interfaceid": "67590aab-15ed-4684-abd7-64a5c0a9b3f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:19:54 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-eec01a13-1ed0-449c-9732-3a232a3995de tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Releasing lock "refresh_cache-91fe894a-90a8-4545-9b27-91771554c4cb" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:19:54 user nova-compute[75165]: DEBUG nova.objects.instance [None req-eec01a13-1ed0-449c-9732-3a232a3995de tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Lazy-loading 'flavor' on Instance uuid 91fe894a-90a8-4545-9b27-91771554c4cb {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:19:54 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:19:54 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:19:55 user nova-compute[75165]: DEBUG nova.compute.manager [req-a25e45dd-8404-4344-b5d1-92f096aff651 req-8a4f4a37-003a-45a6-be5a-50450f06792e service nova] [instance: 91fe894a-90a8-4545-9b27-91771554c4cb] Received event network-vif-unplugged-67590aab-15ed-4684-abd7-64a5c0a9b3f5 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:19:55 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-a25e45dd-8404-4344-b5d1-92f096aff651 req-8a4f4a37-003a-45a6-be5a-50450f06792e service nova] Acquiring lock "91fe894a-90a8-4545-9b27-91771554c4cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:19:55 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-a25e45dd-8404-4344-b5d1-92f096aff651 req-8a4f4a37-003a-45a6-be5a-50450f06792e service nova] Lock "91fe894a-90a8-4545-9b27-91771554c4cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:19:55 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-a25e45dd-8404-4344-b5d1-92f096aff651 req-8a4f4a37-003a-45a6-be5a-50450f06792e service nova] Lock "91fe894a-90a8-4545-9b27-91771554c4cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:19:55 user nova-compute[75165]: DEBUG nova.compute.manager [req-a25e45dd-8404-4344-b5d1-92f096aff651 req-8a4f4a37-003a-45a6-be5a-50450f06792e service nova] [instance: 91fe894a-90a8-4545-9b27-91771554c4cb] No waiting events found dispatching network-vif-unplugged-67590aab-15ed-4684-abd7-64a5c0a9b3f5 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:19:55 user nova-compute[75165]: WARNING nova.compute.manager [req-a25e45dd-8404-4344-b5d1-92f096aff651 req-8a4f4a37-003a-45a6-be5a-50450f06792e service nova] [instance: 91fe894a-90a8-4545-9b27-91771554c4cb] Received unexpected event network-vif-unplugged-67590aab-15ed-4684-abd7-64a5c0a9b3f5 for instance with vm_state rescued and task_state unrescuing.
Oct 26 00:19:55 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:19:55 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:19:55 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:19:55 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: 91fe894a-90a8-4545-9b27-91771554c4cb] Instance destroyed successfully.
Oct 26 00:19:55 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:19:56 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:19:56 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:19:56 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:19:56 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:19:56 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:19:56 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:19:56 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:19:57 user nova-compute[75165]: DEBUG nova.compute.manager [req-e1c3bb95-dce7-40be-a3cc-4d76214f78da req-fc8aae37-f95e-44ad-b9aa-c08589864568 service nova] [instance: 91fe894a-90a8-4545-9b27-91771554c4cb] Received event network-vif-plugged-67590aab-15ed-4684-abd7-64a5c0a9b3f5 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:19:57 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-e1c3bb95-dce7-40be-a3cc-4d76214f78da req-fc8aae37-f95e-44ad-b9aa-c08589864568 service nova] Acquiring lock "91fe894a-90a8-4545-9b27-91771554c4cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:19:57 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-e1c3bb95-dce7-40be-a3cc-4d76214f78da req-fc8aae37-f95e-44ad-b9aa-c08589864568 service nova] Lock "91fe894a-90a8-4545-9b27-91771554c4cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:19:57 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-e1c3bb95-dce7-40be-a3cc-4d76214f78da req-fc8aae37-f95e-44ad-b9aa-c08589864568 service nova] Lock "91fe894a-90a8-4545-9b27-91771554c4cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:19:57 user nova-compute[75165]: DEBUG nova.compute.manager [req-e1c3bb95-dce7-40be-a3cc-4d76214f78da req-fc8aae37-f95e-44ad-b9aa-c08589864568 service nova] [instance: 91fe894a-90a8-4545-9b27-91771554c4cb] No waiting events found dispatching network-vif-plugged-67590aab-15ed-4684-abd7-64a5c0a9b3f5 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:19:57 user nova-compute[75165]: WARNING nova.compute.manager [req-e1c3bb95-dce7-40be-a3cc-4d76214f78da req-fc8aae37-f95e-44ad-b9aa-c08589864568 service nova] [instance: 91fe894a-90a8-4545-9b27-91771554c4cb] Received unexpected event network-vif-plugged-67590aab-15ed-4684-abd7-64a5c0a9b3f5 for instance with vm_state rescued and task_state unrescuing.
Oct 26 00:19:57 user nova-compute[75165]: DEBUG nova.compute.manager [req-e1c3bb95-dce7-40be-a3cc-4d76214f78da req-fc8aae37-f95e-44ad-b9aa-c08589864568 service nova] [instance: 91fe894a-90a8-4545-9b27-91771554c4cb] Received event network-vif-plugged-67590aab-15ed-4684-abd7-64a5c0a9b3f5 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:19:57 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-e1c3bb95-dce7-40be-a3cc-4d76214f78da req-fc8aae37-f95e-44ad-b9aa-c08589864568 service nova] Acquiring lock "91fe894a-90a8-4545-9b27-91771554c4cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:19:57 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-e1c3bb95-dce7-40be-a3cc-4d76214f78da req-fc8aae37-f95e-44ad-b9aa-c08589864568 service nova] Lock "91fe894a-90a8-4545-9b27-91771554c4cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:19:57 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-e1c3bb95-dce7-40be-a3cc-4d76214f78da req-fc8aae37-f95e-44ad-b9aa-c08589864568 service nova] Lock "91fe894a-90a8-4545-9b27-91771554c4cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:19:57 user nova-compute[75165]: DEBUG nova.compute.manager [req-e1c3bb95-dce7-40be-a3cc-4d76214f78da req-fc8aae37-f95e-44ad-b9aa-c08589864568 service nova] [instance: 91fe894a-90a8-4545-9b27-91771554c4cb] No waiting events found dispatching network-vif-plugged-67590aab-15ed-4684-abd7-64a5c0a9b3f5 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:19:57 user nova-compute[75165]: WARNING nova.compute.manager [req-e1c3bb95-dce7-40be-a3cc-4d76214f78da req-fc8aae37-f95e-44ad-b9aa-c08589864568 service nova] [instance: 91fe894a-90a8-4545-9b27-91771554c4cb] Received unexpected event network-vif-plugged-67590aab-15ed-4684-abd7-64a5c0a9b3f5 for instance with vm_state rescued and task_state unrescuing.
Oct 26 00:19:57 user nova-compute[75165]: DEBUG nova.compute.manager [req-e1c3bb95-dce7-40be-a3cc-4d76214f78da req-fc8aae37-f95e-44ad-b9aa-c08589864568 service nova] [instance: 91fe894a-90a8-4545-9b27-91771554c4cb] Received event network-vif-plugged-67590aab-15ed-4684-abd7-64a5c0a9b3f5 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:19:57 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-e1c3bb95-dce7-40be-a3cc-4d76214f78da req-fc8aae37-f95e-44ad-b9aa-c08589864568 service nova] Acquiring lock "91fe894a-90a8-4545-9b27-91771554c4cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:19:57 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-e1c3bb95-dce7-40be-a3cc-4d76214f78da req-fc8aae37-f95e-44ad-b9aa-c08589864568 service nova] Lock "91fe894a-90a8-4545-9b27-91771554c4cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:19:57 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-e1c3bb95-dce7-40be-a3cc-4d76214f78da req-fc8aae37-f95e-44ad-b9aa-c08589864568 service nova] Lock "91fe894a-90a8-4545-9b27-91771554c4cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:19:57 user nova-compute[75165]: DEBUG nova.compute.manager [req-e1c3bb95-dce7-40be-a3cc-4d76214f78da req-fc8aae37-f95e-44ad-b9aa-c08589864568 service nova] [instance: 91fe894a-90a8-4545-9b27-91771554c4cb] No waiting events found dispatching network-vif-plugged-67590aab-15ed-4684-abd7-64a5c0a9b3f5 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:19:57 user nova-compute[75165]: WARNING nova.compute.manager [req-e1c3bb95-dce7-40be-a3cc-4d76214f78da req-fc8aae37-f95e-44ad-b9aa-c08589864568 service nova] [instance: 91fe894a-90a8-4545-9b27-91771554c4cb] Received unexpected event network-vif-plugged-67590aab-15ed-4684-abd7-64a5c0a9b3f5 for instance with vm_state rescued and task_state unrescuing.
Oct 26 00:19:58 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-f158c805-8e16-4fa8-ae05-bfd19b508917 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 27fa1771-fb69-49da-81b3-7f112e623170 is timed out.
Oct 26 00:19:58 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-f158c805-8e16-4fa8-ae05-bfd19b508917 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Successfully detached device vdb from instance 27fa1771-fb69-49da-81b3-7f112e623170 from the live domain config.
Oct 26 00:19:58 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f158c805-8e16-4fa8-ae05-bfd19b508917 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] [instance: 27fa1771-fb69-49da-81b3-7f112e623170] calling os-brick to detach iSCSI Volume {{(pid=75165) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 00:19:58 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-f158c805-8e16-4fa8-ae05-bfd19b508917 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8bf8160e50>, {'target_iqn': 'iqn.2010-10.org.openstack:f431d8b9-aa1e-46f5-b7da-39f4a550e050', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ijTvApyq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:19:58 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-f158c805-8e16-4fa8-ae05-bfd19b508917 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:19:58 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-f158c805-8e16-4fa8-ae05-bfd19b508917 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:19:58 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-f158c805-8e16-4fa8-ae05-bfd19b508917 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:19:58 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:19:58 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:19:58 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[887be7c2-3434-403d-9668-7f322d3576ba]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f06e40e7-3ca1-4a25-bd11-ff01280c6df2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:99a43689-b7cd-47e6-ae88-fd8ba07c60c1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f431d8b9-aa1e-46f5-b7da-39f4a550e050\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:19:58 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-f158c805-8e16-4fa8-ae05-bfd19b508917 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 00:19:58 user nova-compute[75165]: No targets found.
Oct 26 00:19:58 user nova-compute[75165]: iSNS:
Oct 26 00:19:58 user nova-compute[75165]: No targets found.
Oct 26 00:19:58 user nova-compute[75165]: STATIC:
Oct 26 00:19:58 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:f06e40e7-3ca1-4a25-bd11-ff01280c6df2
Oct 26 00:19:58 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:19:58 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:19:58 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:99a43689-b7cd-47e6-ae88-fd8ba07c60c1
Oct 26 00:19:58 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:19:58 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:19:58 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:f431d8b9-aa1e-46f5-b7da-39f4a550e050
Oct 26 00:19:58 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:19:58 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:19:58 user nova-compute[75165]: FIRMWARE:
Oct 26 00:19:58 user nova-compute[75165]: No targets found.
Oct 26 00:19:58 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:19:58 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-f158c805-8e16-4fa8-ae05-bfd19b508917 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 00:19:58 user nova-compute[75165]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 00:19:58 user nova-compute[75165]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75165) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 00:19:58 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-f158c805-8e16-4fa8-ae05-bfd19b508917 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f431d8b9-aa1e-46f5-b7da-39f4a550e050', 0)] {{(pid=75165) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 00:19:58 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:19:58 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:19:58 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8aea1e5-0623-4408-84c2-d567b60edf12]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99a43689-b7cd-47e6-ae88-fd8ba07c60c1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f06e40e7-3ca1-4a25-bd11-ff01280c6df2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f431d8b9-aa1e-46f5-b7da-39f4a550e050\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:19:58 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:19:58 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:19:58 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[70524ade-324b-4a1a-89d5-fc70fea63549]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f431d8b9-aa1e-46f5-b7da-39f4a550e050 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f06e40e7-3ca1-4a25-bd11-ff01280c6df2 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a43689-b7cd-47e6-ae88-fd8ba07c60c1 (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:19:58 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-f158c805-8e16-4fa8-ae05-bfd19b508917 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f431d8b9-aa1e-46f5-b7da-39f4a550e050 (non-flash)
Oct 26 00:19:58 user nova-compute[75165]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f06e40e7-3ca1-4a25-bd11-ff01280c6df2 (non-flash)
Oct 26 00:19:58 user nova-compute[75165]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a43689-b7cd-47e6-ae88-fd8ba07c60c1 (non-flash)
Oct 26 00:19:58 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:19:58 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-f158c805-8e16-4fa8-ae05-bfd19b508917 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f431d8b9-aa1e-46f5-b7da-39f4a550e050 (non-flash)
Oct 26 00:19:58 user nova-compute[75165]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f06e40e7-3ca1-4a25-bd11-ff01280c6df2 (non-flash)
Oct 26 00:19:58 user nova-compute[75165]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a43689-b7cd-47e6-ae88-fd8ba07c60c1 (non-flash)
Oct 26 00:19:58 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:19:58 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-f158c805-8e16-4fa8-ae05-bfd19b508917 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8be0522e60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f431d8b9-aa1e-46f5-b7da-39f4a550e050'): ({'sdb'}, set())}) {{(pid=75165) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 00:19:58 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-f158c805-8e16-4fa8-ae05-bfd19b508917 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Removing single pathed devices sdb {{(pid=75165) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 00:19:58 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:19:58 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:19:58 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[4852f3f6-f12d-427a-929c-ca5526866949]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:19:58 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:19:58 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:19:58 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ba0e79b-bcfb-451d-bbee-f961ea31645b]: (4, ('ok\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:19:58 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-f158c805-8e16-4fa8-ae05-bfd19b508917 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Flushing IO for device /dev/sdb {{(pid=75165) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 00:19:58 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:19:58 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:19:58 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[da208131-369d-4e0c-8162-67329983f99a]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:19:58 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-f158c805-8e16-4fa8-ae05-bfd19b508917 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75165) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 00:19:58 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:19:58 user nova-compute[75165]: DEBUG nova.compute.manager [None req-eec01a13-1ed0-449c-9732-3a232a3995de tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: 91fe894a-90a8-4545-9b27-91771554c4cb] Checking state {{(pid=75165) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 00:19:58 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:19:58 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[852f0221-f5b9-4798-94db-4c979ff3e935]: (4, ('1', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:19:58 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-f158c805-8e16-4fa8-ae05-bfd19b508917 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75165) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 00:19:58 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-f158c805-8e16-4fa8-ae05-bfd19b508917 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] SCSI volumes sdb have been removed. {{(pid=75165) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 00:19:59 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-f158c805-8e16-4fa8-ae05-bfd19b508917 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f431d8b9-aa1e-46f5-b7da-39f4a550e050')] {{(pid=75165) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 00:19:59 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f431d8b9-aa1e-46f5-b7da-39f4a550e050 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:19:59 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f431d8b9-aa1e-46f5-b7da-39f4a550e050 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:19:59 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[367d60ae-7420-4a7f-a750-ce0f234b5c06]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:19:59 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-f158c805-8e16-4fa8-ae05-bfd19b508917 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:19:59 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f431d8b9-aa1e-46f5-b7da-39f4a550e050 -p 172.16.0.220:3260 --logout {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:19:59 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f431d8b9-aa1e-46f5-b7da-39f4a550e050 -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:19:59 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[d71aa086-4ad7-4c9b-8e00-a05b49d8f73a]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:f431d8b9-aa1e-46f5-b7da-39f4a550e050, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:f431d8b9-aa1e-46f5-b7da-39f4a550e050, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:19:59 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-f158c805-8e16-4fa8-ae05-bfd19b508917 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:f431d8b9-aa1e-46f5-b7da-39f4a550e050, portal: 172.16.0.220,3260]
Oct 26 00:19:59 user nova-compute[75165]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:f431d8b9-aa1e-46f5-b7da-39f4a550e050, portal: 172.16.0.220,3260] successful.
Oct 26 00:19:59 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:19:59 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f431d8b9-aa1e-46f5-b7da-39f4a550e050 -p 172.16.0.220:3260 --op delete {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:19:59 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f431d8b9-aa1e-46f5-b7da-39f4a550e050 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:19:59 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8e50ac8-cd45-4ef0-8dae-4557e33d8e7a]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:19:59 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-f158c805-8e16-4fa8-ae05-bfd19b508917 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:19:59 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-f158c805-8e16-4fa8-ae05-bfd19b508917 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:19:59 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-f158c805-8e16-4fa8-ae05-bfd19b508917 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] <== disconnect_volume: return (323ms) None {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:19:59 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f158c805-8e16-4fa8-ae05-bfd19b508917 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] [instance: 27fa1771-fb69-49da-81b3-7f112e623170] Disconnected iSCSI Volume {{(pid=75165) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 00:20:00 user nova-compute[75165]: DEBUG nova.objects.instance [None req-f158c805-8e16-4fa8-ae05-bfd19b508917 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Lazy-loading 'flavor' on Instance uuid 27fa1771-fb69-49da-81b3-7f112e623170 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:20:00 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-f158c805-8e16-4fa8-ae05-bfd19b508917 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Lock "27fa1771-fb69-49da-81b3-7f112e623170" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.947s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:20:00 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:20:00 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-898e0f3e-6350-4a67-9ab0-0fc47701e6fe tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Acquiring lock "27fa1771-fb69-49da-81b3-7f112e623170" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:20:00 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-898e0f3e-6350-4a67-9ab0-0fc47701e6fe tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Lock "27fa1771-fb69-49da-81b3-7f112e623170" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.007s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:20:00 user nova-compute[75165]: DEBUG nova.compute.manager [None req-898e0f3e-6350-4a67-9ab0-0fc47701e6fe tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] [instance: 27fa1771-fb69-49da-81b3-7f112e623170] Checking state {{(pid=75165) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 00:20:00 user nova-compute[75165]: DEBUG nova.compute.manager [None req-898e0f3e-6350-4a67-9ab0-0fc47701e6fe tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] [instance: 27fa1771-fb69-49da-81b3-7f112e623170] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75165) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Oct 26 00:20:00 user nova-compute[75165]: DEBUG nova.objects.instance [None req-898e0f3e-6350-4a67-9ab0-0fc47701e6fe tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Lazy-loading 'flavor' on Instance uuid 27fa1771-fb69-49da-81b3-7f112e623170 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:20:01 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:20:01 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:20:01 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:20:01 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:20:01 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:20:01 user nova-compute[75165]: DEBUG nova.compute.manager [req-25eaf58a-88a9-424d-99de-0dabcfdfa8e6 req-3d303e13-c1b9-4b93-8989-ef793ceffcc2 service nova] [instance: 27fa1771-fb69-49da-81b3-7f112e623170] Received event network-vif-unplugged-4d97651b-5d7c-4778-85a4-a11588892b31 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:20:01 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-25eaf58a-88a9-424d-99de-0dabcfdfa8e6 req-3d303e13-c1b9-4b93-8989-ef793ceffcc2 service nova] Acquiring lock "27fa1771-fb69-49da-81b3-7f112e623170-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:20:01 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-25eaf58a-88a9-424d-99de-0dabcfdfa8e6 req-3d303e13-c1b9-4b93-8989-ef793ceffcc2 service nova] Lock "27fa1771-fb69-49da-81b3-7f112e623170-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:20:01 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-25eaf58a-88a9-424d-99de-0dabcfdfa8e6 req-3d303e13-c1b9-4b93-8989-ef793ceffcc2 service nova] Lock "27fa1771-fb69-49da-81b3-7f112e623170-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:20:01 user nova-compute[75165]: DEBUG nova.compute.manager [req-25eaf58a-88a9-424d-99de-0dabcfdfa8e6 req-3d303e13-c1b9-4b93-8989-ef793ceffcc2 service nova] [instance: 27fa1771-fb69-49da-81b3-7f112e623170] No waiting events found dispatching network-vif-unplugged-4d97651b-5d7c-4778-85a4-a11588892b31 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:20:01 user nova-compute[75165]: WARNING nova.compute.manager [req-25eaf58a-88a9-424d-99de-0dabcfdfa8e6 req-3d303e13-c1b9-4b93-8989-ef793ceffcc2 service nova] [instance: 27fa1771-fb69-49da-81b3-7f112e623170] Received unexpected event network-vif-unplugged-4d97651b-5d7c-4778-85a4-a11588892b31 for instance with vm_state active and task_state powering-off.
Oct 26 00:20:01 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: 27fa1771-fb69-49da-81b3-7f112e623170] Instance destroyed successfully.
Oct 26 00:20:01 user nova-compute[75165]: DEBUG nova.compute.manager [None req-898e0f3e-6350-4a67-9ab0-0fc47701e6fe tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] [instance: 27fa1771-fb69-49da-81b3-7f112e623170] Checking state {{(pid=75165) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 00:20:01 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-898e0f3e-6350-4a67-9ab0-0fc47701e6fe tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Lock "27fa1771-fb69-49da-81b3-7f112e623170" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.945s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:20:02 user nova-compute[75165]: DEBUG nova.compute.manager [None req-512b1314-268f-4214-9055-24379e41db81 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: 97fb67a7-637d-456f-b4dd-0a271ed6cfc4] Checking state {{(pid=75165) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 00:20:02 user nova-compute[75165]: INFO nova.compute.manager [None req-512b1314-268f-4214-9055-24379e41db81 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: 97fb67a7-637d-456f-b4dd-0a271ed6cfc4] instance snapshotting
Oct 26 00:20:02 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-512b1314-268f-4214-9055-24379e41db81 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: 97fb67a7-637d-456f-b4dd-0a271ed6cfc4] Beginning live snapshot process
Oct 26 00:20:02 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-512b1314-268f-4214-9055-24379e41db81 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97fb67a7-637d-456f-b4dd-0a271ed6cfc4/disk --force-share --output=json -f qcow2 {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:20:03 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-512b1314-268f-4214-9055-24379e41db81 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97fb67a7-637d-456f-b4dd-0a271ed6cfc4/disk --force-share --output=json -f qcow2" returned: 0 in 0.214s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:20:03 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-512b1314-268f-4214-9055-24379e41db81 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97fb67a7-637d-456f-b4dd-0a271ed6cfc4/disk --force-share --output=json -f qcow2 {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:20:03 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-512b1314-268f-4214-9055-24379e41db81 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97fb67a7-637d-456f-b4dd-0a271ed6cfc4/disk --force-share --output=json -f qcow2" returned: 0 in 0.194s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:20:03 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-512b1314-268f-4214-9055-24379e41db81 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:20:03 user nova-compute[75165]: DEBUG nova.compute.manager [req-00eb4e85-a644-4eab-a135-a92ca93fa7c7 req-991264bd-f0a3-416c-8837-83ba52062cf4 service nova] [instance: 27fa1771-fb69-49da-81b3-7f112e623170] Received event network-vif-plugged-4d97651b-5d7c-4778-85a4-a11588892b31 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:20:03 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-00eb4e85-a644-4eab-a135-a92ca93fa7c7 req-991264bd-f0a3-416c-8837-83ba52062cf4 service nova] Acquiring lock "27fa1771-fb69-49da-81b3-7f112e623170-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:20:03 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-00eb4e85-a644-4eab-a135-a92ca93fa7c7 req-991264bd-f0a3-416c-8837-83ba52062cf4 service nova] Lock "27fa1771-fb69-49da-81b3-7f112e623170-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:20:03 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-00eb4e85-a644-4eab-a135-a92ca93fa7c7 req-991264bd-f0a3-416c-8837-83ba52062cf4 service nova] Lock "27fa1771-fb69-49da-81b3-7f112e623170-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:20:03 user nova-compute[75165]: DEBUG nova.compute.manager [req-00eb4e85-a644-4eab-a135-a92ca93fa7c7 req-991264bd-f0a3-416c-8837-83ba52062cf4 service nova] [instance: 27fa1771-fb69-49da-81b3-7f112e623170] No waiting events found dispatching network-vif-plugged-4d97651b-5d7c-4778-85a4-a11588892b31 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:20:03 user nova-compute[75165]: WARNING nova.compute.manager [req-00eb4e85-a644-4eab-a135-a92ca93fa7c7 req-991264bd-f0a3-416c-8837-83ba52062cf4 service nova] [instance: 27fa1771-fb69-49da-81b3-7f112e623170] Received unexpected event network-vif-plugged-4d97651b-5d7c-4778-85a4-a11588892b31 for instance with vm_state stopped and task_state None.
Oct 26 00:20:03 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-512b1314-268f-4214-9055-24379e41db81 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json" returned: 0 in 0.193s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:20:03 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-512b1314-268f-4214-9055-24379e41db81 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpd9boccoq/25434e5dc1004fcaa13fd93de7676724.delta 1073741824 {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:20:03 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-512b1314-268f-4214-9055-24379e41db81 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpd9boccoq/25434e5dc1004fcaa13fd93de7676724.delta 1073741824" returned: 0 in 0.067s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:20:03 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-512b1314-268f-4214-9055-24379e41db81 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: 97fb67a7-637d-456f-b4dd-0a271ed6cfc4] Quiescing instance not available: QEMU guest agent is not enabled.
Oct 26 00:20:03 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:20:04 user nova-compute[75165]: DEBUG nova.virt.libvirt.guest [None req-512b1314-268f-4214-9055-24379e41db81 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75165) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 26 00:20:04 user nova-compute[75165]: DEBUG nova.virt.libvirt.guest [None req-512b1314-268f-4214-9055-24379e41db81 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75165) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 26 00:20:04 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-512b1314-268f-4214-9055-24379e41db81 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: 97fb67a7-637d-456f-b4dd-0a271ed6cfc4] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 26 00:20:04 user nova-compute[75165]: DEBUG nova.privsep.utils [None req-512b1314-268f-4214-9055-24379e41db81 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75165) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 26 00:20:04 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-512b1314-268f-4214-9055-24379e41db81 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpd9boccoq/25434e5dc1004fcaa13fd93de7676724.delta /opt/stack/data/nova/instances/snapshots/tmpd9boccoq/25434e5dc1004fcaa13fd93de7676724 {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:20:05 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:20:05 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-512b1314-268f-4214-9055-24379e41db81 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpd9boccoq/25434e5dc1004fcaa13fd93de7676724.delta /opt/stack/data/nova/instances/snapshots/tmpd9boccoq/25434e5dc1004fcaa13fd93de7676724" returned: 0 in 0.927s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:20:05 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-512b1314-268f-4214-9055-24379e41db81 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: 97fb67a7-637d-456f-b4dd-0a271ed6cfc4] Snapshot extracted, beginning image upload
Oct 26 00:20:06 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:20:06 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75165) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 00:20:07 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:20:08 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-512b1314-268f-4214-9055-24379e41db81 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: 97fb67a7-637d-456f-b4dd-0a271ed6cfc4] Snapshot image upload complete
Oct 26 00:20:08 user nova-compute[75165]: INFO nova.compute.manager [None req-512b1314-268f-4214-9055-24379e41db81 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: 97fb67a7-637d-456f-b4dd-0a271ed6cfc4] Took 5.77 seconds to snapshot the instance on the hypervisor.
Oct 26 00:20:08 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:20:10 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:20:10 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:20:10 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:20:10 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:20:10 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:20:10 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75165) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 00:20:10 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:20:11 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b041e0af-4635-495c-b72d-fbbbd8d43a9b/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:20:11 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b041e0af-4635-495c-b72d-fbbbd8d43a9b/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:20:11 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b041e0af-4635-495c-b72d-fbbbd8d43a9b/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:20:11 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b041e0af-4635-495c-b72d-fbbbd8d43a9b/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:20:11 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84c6b624-648b-40e2-a37e-ff08609bad84/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:20:11 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84c6b624-648b-40e2-a37e-ff08609bad84/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:20:11 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84c6b624-648b-40e2-a37e-ff08609bad84/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:20:11 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84c6b624-648b-40e2-a37e-ff08609bad84/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:20:11 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97fb67a7-637d-456f-b4dd-0a271ed6cfc4/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:20:11 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97fb67a7-637d-456f-b4dd-0a271ed6cfc4/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:20:11 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97fb67a7-637d-456f-b4dd-0a271ed6cfc4/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:20:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97fb67a7-637d-456f-b4dd-0a271ed6cfc4/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:20:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7eeb145-1565-4812-818b-fefda5f2436d/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:20:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7eeb145-1565-4812-818b-fefda5f2436d/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:20:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7eeb145-1565-4812-818b-fefda5f2436d/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:20:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7eeb145-1565-4812-818b-fefda5f2436d/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:20:12 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75165) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 00:20:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e44bfc-6a68-46ce-8335-aaaba5160d3e/disk.rescue --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:20:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e44bfc-6a68-46ce-8335-aaaba5160d3e/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:20:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e44bfc-6a68-46ce-8335-aaaba5160d3e/disk.rescue --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:20:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e44bfc-6a68-46ce-8335-aaaba5160d3e/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:20:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e44bfc-6a68-46ce-8335-aaaba5160d3e/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:20:13 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e44bfc-6a68-46ce-8335-aaaba5160d3e/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:20:13 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e44bfc-6a68-46ce-8335-aaaba5160d3e/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:20:13 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e44bfc-6a68-46ce-8335-aaaba5160d3e/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:20:13 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27fa1771-fb69-49da-81b3-7f112e623170/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:20:13 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27fa1771-fb69-49da-81b3-7f112e623170/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:20:13 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27fa1771-fb69-49da-81b3-7f112e623170/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:20:13 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27fa1771-fb69-49da-81b3-7f112e623170/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:20:13 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e847329-ad09-450d-854b-468a3b8bdf60/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:20:13 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e847329-ad09-450d-854b-468a3b8bdf60/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:20:13 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e847329-ad09-450d-854b-468a3b8bdf60/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:20:14 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e847329-ad09-450d-854b-468a3b8bdf60/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:20:14 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91fe894a-90a8-4545-9b27-91771554c4cb/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:20:14 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91fe894a-90a8-4545-9b27-91771554c4cb/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:20:14 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91fe894a-90a8-4545-9b27-91771554c4cb/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:20:14 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91fe894a-90a8-4545-9b27-91771554c4cb/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:20:14 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75165) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 00:20:14 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:20:14 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:20:14 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Hypervisor/Node resource view: name=user free_ram=7869MB free_disk=24.955303192138672GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75165) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 00:20:14 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:20:14 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:20:14 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 84c6b624-648b-40e2-a37e-ff08609bad84 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:20:14 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance c4e44bfc-6a68-46ce-8335-aaaba5160d3e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:20:14 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance a7eeb145-1565-4812-818b-fefda5f2436d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:20:14 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 27fa1771-fb69-49da-81b3-7f112e623170 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:20:14 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 91fe894a-90a8-4545-9b27-91771554c4cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:20:14 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 97fb67a7-637d-456f-b4dd-0a271ed6cfc4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:20:14 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance b041e0af-4635-495c-b72d-fbbbd8d43a9b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:20:14 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 8e847329-ad09-450d-854b-468a3b8bdf60 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:20:14 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance bad6c21f-885f-4348-86f7-b237ce2d241b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:20:14 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75165) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 00:20:14 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75165) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 00:20:15 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:20:15 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:20:15 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Compute_service record updated for user:user {{(pid=75165) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 00:20:15 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.474s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:20:15 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:20:16 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:20:16 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:20:16 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Starting heal instance info cache {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 00:20:16 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "refresh_cache-b041e0af-4635-495c-b72d-fbbbd8d43a9b" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:20:16 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquired lock "refresh_cache-b041e0af-4635-495c-b72d-fbbbd8d43a9b" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:20:16 user nova-compute[75165]: DEBUG nova.network.neutron [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: b041e0af-4635-495c-b72d-fbbbd8d43a9b] Forcefully refreshing network info cache for instance {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 00:20:16 user nova-compute[75165]: DEBUG nova.network.neutron [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: b041e0af-4635-495c-b72d-fbbbd8d43a9b] Updating instance_info_cache with network_info: [{"id": "1964255b-cf1e-4e17-a1f7-ae5d6ea25aef", "address": "fa:16:3e:76:6f:05", "network": {"id": "f54e2e9f-5c1e-44ca-bd4b-9cf0747b0f72", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-806146051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "920152101768459baa71010b380ea8f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1964255b-cf", "ovs_interfaceid": "1964255b-cf1e-4e17-a1f7-ae5d6ea25aef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:20:16 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Releasing lock "refresh_cache-b041e0af-4635-495c-b72d-fbbbd8d43a9b" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:20:16 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: b041e0af-4635-495c-b72d-fbbbd8d43a9b] Updated the network info_cache for instance {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 00:20:16 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:20:16 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:20:20 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:20:21 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:20:25 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:20:26 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:20:26 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-c519f2a5-2025-4d69-9c37-e73ea2bd0064 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Acquiring lock "b041e0af-4635-495c-b72d-fbbbd8d43a9b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:20:26 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-c519f2a5-2025-4d69-9c37-e73ea2bd0064 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Lock "b041e0af-4635-495c-b72d-fbbbd8d43a9b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:20:26 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-c519f2a5-2025-4d69-9c37-e73ea2bd0064 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Acquiring lock "b041e0af-4635-495c-b72d-fbbbd8d43a9b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:20:26 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-c519f2a5-2025-4d69-9c37-e73ea2bd0064 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Lock "b041e0af-4635-495c-b72d-fbbbd8d43a9b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:20:26 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-c519f2a5-2025-4d69-9c37-e73ea2bd0064 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Lock "b041e0af-4635-495c-b72d-fbbbd8d43a9b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.002s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:20:26 user nova-compute[75165]: INFO nova.compute.manager [None req-c519f2a5-2025-4d69-9c37-e73ea2bd0064 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] [instance: b041e0af-4635-495c-b72d-fbbbd8d43a9b] Terminating instance
Oct 26 00:20:26 user nova-compute[75165]: DEBUG nova.compute.manager [None req-c519f2a5-2025-4d69-9c37-e73ea2bd0064 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] [instance: b041e0af-4635-495c-b72d-fbbbd8d43a9b] Start destroying the instance on the hypervisor. {{(pid=75165) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 00:20:26 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:20:26 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:20:26 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:20:26 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:20:26 user nova-compute[75165]: DEBUG nova.compute.manager [req-0615f1ea-5b77-4a42-b19a-04d1560575ea req-d05b3b0d-2a08-40ff-b6cb-02e871353f40 service nova] [instance: b041e0af-4635-495c-b72d-fbbbd8d43a9b] Received event network-vif-unplugged-1964255b-cf1e-4e17-a1f7-ae5d6ea25aef {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:20:26 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-0615f1ea-5b77-4a42-b19a-04d1560575ea req-d05b3b0d-2a08-40ff-b6cb-02e871353f40 service nova] Acquiring lock "b041e0af-4635-495c-b72d-fbbbd8d43a9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:20:26 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-0615f1ea-5b77-4a42-b19a-04d1560575ea req-d05b3b0d-2a08-40ff-b6cb-02e871353f40 service nova] Lock "b041e0af-4635-495c-b72d-fbbbd8d43a9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:20:26 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-0615f1ea-5b77-4a42-b19a-04d1560575ea req-d05b3b0d-2a08-40ff-b6cb-02e871353f40 service nova] Lock "b041e0af-4635-495c-b72d-fbbbd8d43a9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:20:26 user nova-compute[75165]: DEBUG nova.compute.manager [req-0615f1ea-5b77-4a42-b19a-04d1560575ea req-d05b3b0d-2a08-40ff-b6cb-02e871353f40 service nova] [instance: b041e0af-4635-495c-b72d-fbbbd8d43a9b] No waiting events found dispatching network-vif-unplugged-1964255b-cf1e-4e17-a1f7-ae5d6ea25aef {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:20:26 user nova-compute[75165]: DEBUG nova.compute.manager [req-0615f1ea-5b77-4a42-b19a-04d1560575ea req-d05b3b0d-2a08-40ff-b6cb-02e871353f40 service nova] [instance: b041e0af-4635-495c-b72d-fbbbd8d43a9b] Received event network-vif-unplugged-1964255b-cf1e-4e17-a1f7-ae5d6ea25aef for instance with task_state deleting. {{(pid=75165) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 00:20:27 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: b041e0af-4635-495c-b72d-fbbbd8d43a9b] Instance destroyed successfully.
Oct 26 00:20:27 user nova-compute[75165]: DEBUG nova.objects.instance [None req-c519f2a5-2025-4d69-9c37-e73ea2bd0064 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Lazy-loading 'resources' on Instance uuid b041e0af-4635-495c-b72d-fbbbd8d43a9b {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:20:27 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-c519f2a5-2025-4d69-9c37-e73ea2bd0064 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-26T00:14:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1018278796',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1018278796',id=21,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFIx031L1+GlVTK7qzqFtuz0mMeB9gXcDnYf15sI5K9uRukBpGnVUMwr1kJMENEY2qClV++eI4EJ2qQekfK0Kpz2P/4UBmBjh5aCvNsjqbekaGDKFB27VB5WEQwCxB5PCA==',key_name='tempest-keypair-1875668396',keypairs=<?>,launch_index=0,launched_at=2023-10-26T00:18:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='920152101768459baa71010b380ea8f1',ramdisk_id='',reservation_id='r-agpdy52s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-6636270',owner_user_name='tempest-AttachVolumeShelveTestJSON-6636270-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T00:18:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a40cb1b08014444686bd0adad03f6c68',uuid=b041e0af-4635-495c-b72d-fbbbd8d43a9b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1964255b-cf1e-4e17-a1f7-ae5d6ea25aef", "address": "fa:16:3e:76:6f:05", "network": {"id": "f54e2e9f-5c1e-44ca-bd4b-9cf0747b0f72", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-806146051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "920152101768459baa71010b380ea8f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1964255b-cf", "ovs_interfaceid": "1964255b-cf1e-4e17-a1f7-ae5d6ea25aef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 00:20:27 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-c519f2a5-2025-4d69-9c37-e73ea2bd0064 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Converting VIF {"id": "1964255b-cf1e-4e17-a1f7-ae5d6ea25aef", "address": "fa:16:3e:76:6f:05", "network": {"id": "f54e2e9f-5c1e-44ca-bd4b-9cf0747b0f72", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-806146051-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "920152101768459baa71010b380ea8f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1964255b-cf", "ovs_interfaceid": "1964255b-cf1e-4e17-a1f7-ae5d6ea25aef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:20:27 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-c519f2a5-2025-4d69-9c37-e73ea2bd0064 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:76:6f:05,bridge_name='br-int',has_traffic_filtering=True,id=1964255b-cf1e-4e17-a1f7-ae5d6ea25aef,network=Network(f54e2e9f-5c1e-44ca-bd4b-9cf0747b0f72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1964255b-cf') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:20:27 user nova-compute[75165]: DEBUG os_vif [None req-c519f2a5-2025-4d69-9c37-e73ea2bd0064 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:76:6f:05,bridge_name='br-int',has_traffic_filtering=True,id=1964255b-cf1e-4e17-a1f7-ae5d6ea25aef,network=Network(f54e2e9f-5c1e-44ca-bd4b-9cf0747b0f72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1964255b-cf') {{(pid=75165) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 00:20:27 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:20:27 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1964255b-cf, bridge=br-int, if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:20:27 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:20:27 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:20:27 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:20:27 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:20:27 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c40381ad-1696-4cd6-8261-48e192625969) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:20:27 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:20:27 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:20:27 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:20:27 user nova-compute[75165]: INFO os_vif [None req-c519f2a5-2025-4d69-9c37-e73ea2bd0064 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:76:6f:05,bridge_name='br-int',has_traffic_filtering=True,id=1964255b-cf1e-4e17-a1f7-ae5d6ea25aef,network=Network(f54e2e9f-5c1e-44ca-bd4b-9cf0747b0f72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1964255b-cf')
Oct 26 00:20:27 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-c519f2a5-2025-4d69-9c37-e73ea2bd0064 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] [instance: b041e0af-4635-495c-b72d-fbbbd8d43a9b] Deleting instance files /opt/stack/data/nova/instances/b041e0af-4635-495c-b72d-fbbbd8d43a9b_del
Oct 26 00:20:27 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-c519f2a5-2025-4d69-9c37-e73ea2bd0064 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] [instance: b041e0af-4635-495c-b72d-fbbbd8d43a9b] Deletion of /opt/stack/data/nova/instances/b041e0af-4635-495c-b72d-fbbbd8d43a9b_del complete
Oct 26 00:20:27 user nova-compute[75165]: INFO nova.compute.manager [None req-c519f2a5-2025-4d69-9c37-e73ea2bd0064 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] [instance: b041e0af-4635-495c-b72d-fbbbd8d43a9b] Took 0.89 seconds to destroy the instance on the hypervisor.
Oct 26 00:20:27 user nova-compute[75165]: DEBUG oslo.service.loopingcall [None req-c519f2a5-2025-4d69-9c37-e73ea2bd0064 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75165) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 00:20:27 user nova-compute[75165]: DEBUG nova.compute.manager [-] [instance: b041e0af-4635-495c-b72d-fbbbd8d43a9b] Deallocating network for instance {{(pid=75165) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 00:20:27 user nova-compute[75165]: DEBUG nova.network.neutron [-] [instance: b041e0af-4635-495c-b72d-fbbbd8d43a9b] deallocate_for_instance() {{(pid=75165) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 00:20:27 user nova-compute[75165]: DEBUG nova.network.neutron [-] [instance: b041e0af-4635-495c-b72d-fbbbd8d43a9b] Updating instance_info_cache with network_info: [] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:20:27 user nova-compute[75165]: INFO nova.compute.manager [-] [instance: b041e0af-4635-495c-b72d-fbbbd8d43a9b] Took 0.69 seconds to deallocate network for instance.
Oct 26 00:20:27 user nova-compute[75165]: DEBUG nova.compute.manager [req-5b9a0978-40da-4f92-ae1b-c52943287937 req-df699316-6c36-49a8-bcfb-e2a899abe785 service nova] [instance: b041e0af-4635-495c-b72d-fbbbd8d43a9b] Received event network-vif-deleted-1964255b-cf1e-4e17-a1f7-ae5d6ea25aef {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:20:27 user nova-compute[75165]: INFO nova.compute.manager [req-5b9a0978-40da-4f92-ae1b-c52943287937 req-df699316-6c36-49a8-bcfb-e2a899abe785 service nova] [instance: b041e0af-4635-495c-b72d-fbbbd8d43a9b] Neutron deleted interface 1964255b-cf1e-4e17-a1f7-ae5d6ea25aef; detaching it from the instance and deleting it from the info cache
Oct 26 00:20:27 user nova-compute[75165]: DEBUG nova.network.neutron [req-5b9a0978-40da-4f92-ae1b-c52943287937 req-df699316-6c36-49a8-bcfb-e2a899abe785 service nova] [instance: b041e0af-4635-495c-b72d-fbbbd8d43a9b] Updating instance_info_cache with network_info: [] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:20:27 user nova-compute[75165]: DEBUG nova.compute.manager [req-5b9a0978-40da-4f92-ae1b-c52943287937 req-df699316-6c36-49a8-bcfb-e2a899abe785 service nova] [instance: b041e0af-4635-495c-b72d-fbbbd8d43a9b] Detach interface failed, port_id=1964255b-cf1e-4e17-a1f7-ae5d6ea25aef, reason: Instance b041e0af-4635-495c-b72d-fbbbd8d43a9b could not be found. {{(pid=75165) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 26 00:20:27 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-c519f2a5-2025-4d69-9c37-e73ea2bd0064 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:20:27 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-c519f2a5-2025-4d69-9c37-e73ea2bd0064 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:20:28 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-c519f2a5-2025-4d69-9c37-e73ea2bd0064 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:20:28 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-c519f2a5-2025-4d69-9c37-e73ea2bd0064 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:20:28 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-c519f2a5-2025-4d69-9c37-e73ea2bd0064 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.276s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:20:28 user nova-compute[75165]: INFO nova.scheduler.client.report [None req-c519f2a5-2025-4d69-9c37-e73ea2bd0064 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Deleted allocations for instance b041e0af-4635-495c-b72d-fbbbd8d43a9b
Oct 26 00:20:28 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-c519f2a5-2025-4d69-9c37-e73ea2bd0064 tempest-AttachVolumeShelveTestJSON-6636270 tempest-AttachVolumeShelveTestJSON-6636270-project-member] Lock "b041e0af-4635-495c-b72d-fbbbd8d43a9b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.043s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:20:28 user nova-compute[75165]: DEBUG nova.compute.manager [req-80632e92-c83c-4b50-a6fc-d3d2379ba3f2 req-e529ff00-913b-47ee-a089-e4f86abbc0be service nova] [instance: b041e0af-4635-495c-b72d-fbbbd8d43a9b] Received event network-vif-plugged-1964255b-cf1e-4e17-a1f7-ae5d6ea25aef {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:20:28 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-80632e92-c83c-4b50-a6fc-d3d2379ba3f2 req-e529ff00-913b-47ee-a089-e4f86abbc0be service nova] Acquiring lock "b041e0af-4635-495c-b72d-fbbbd8d43a9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:20:28 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-80632e92-c83c-4b50-a6fc-d3d2379ba3f2 req-e529ff00-913b-47ee-a089-e4f86abbc0be service nova] Lock "b041e0af-4635-495c-b72d-fbbbd8d43a9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:20:28 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-80632e92-c83c-4b50-a6fc-d3d2379ba3f2 req-e529ff00-913b-47ee-a089-e4f86abbc0be service nova] Lock "b041e0af-4635-495c-b72d-fbbbd8d43a9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:20:28 user nova-compute[75165]: DEBUG nova.compute.manager [req-80632e92-c83c-4b50-a6fc-d3d2379ba3f2 req-e529ff00-913b-47ee-a089-e4f86abbc0be service nova] [instance: b041e0af-4635-495c-b72d-fbbbd8d43a9b] No waiting events found dispatching network-vif-plugged-1964255b-cf1e-4e17-a1f7-ae5d6ea25aef {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:20:28 user nova-compute[75165]: WARNING nova.compute.manager [req-80632e92-c83c-4b50-a6fc-d3d2379ba3f2 req-e529ff00-913b-47ee-a089-e4f86abbc0be service nova] [instance: b041e0af-4635-495c-b72d-fbbbd8d43a9b] Received unexpected event network-vif-plugged-1964255b-cf1e-4e17-a1f7-ae5d6ea25aef for instance with vm_state deleted and task_state None.
Oct 26 00:20:31 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:20:32 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:20:33 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:20:34 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:20:36 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:20:37 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:20:42 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:20:47 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:20:47 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:20:47 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75165) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 00:20:47 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75165) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 00:20:47 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75165) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 00:20:47 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:20:52 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:20:57 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:20:58 user nova-compute[75165]: DEBUG nova.compute.manager [req-b488a9e6-f408-44a5-a783-c652dc49daf0 req-64592590-6891-46cc-ba3a-7c5c4bddc0df service nova] [instance: a7eeb145-1565-4812-818b-fefda5f2436d] Received event network-changed-7a43d085-a683-4c49-a7c8-13b8f35c943d {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:20:58 user nova-compute[75165]: DEBUG nova.compute.manager [req-b488a9e6-f408-44a5-a783-c652dc49daf0 req-64592590-6891-46cc-ba3a-7c5c4bddc0df service nova] [instance: a7eeb145-1565-4812-818b-fefda5f2436d] Refreshing instance network info cache due to event network-changed-7a43d085-a683-4c49-a7c8-13b8f35c943d. {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 00:20:58 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-b488a9e6-f408-44a5-a783-c652dc49daf0 req-64592590-6891-46cc-ba3a-7c5c4bddc0df service nova] Acquiring lock "refresh_cache-a7eeb145-1565-4812-818b-fefda5f2436d" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:20:58 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-b488a9e6-f408-44a5-a783-c652dc49daf0 req-64592590-6891-46cc-ba3a-7c5c4bddc0df service nova] Acquired lock "refresh_cache-a7eeb145-1565-4812-818b-fefda5f2436d" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:20:58 user nova-compute[75165]: DEBUG nova.network.neutron [req-b488a9e6-f408-44a5-a783-c652dc49daf0 req-64592590-6891-46cc-ba3a-7c5c4bddc0df service nova] [instance: a7eeb145-1565-4812-818b-fefda5f2436d] Refreshing network info cache for port 7a43d085-a683-4c49-a7c8-13b8f35c943d {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 00:20:59 user nova-compute[75165]: DEBUG nova.network.neutron [req-b488a9e6-f408-44a5-a783-c652dc49daf0 req-64592590-6891-46cc-ba3a-7c5c4bddc0df service nova] [instance: a7eeb145-1565-4812-818b-fefda5f2436d] Updated VIF entry in instance network info cache for port 7a43d085-a683-4c49-a7c8-13b8f35c943d. {{(pid=75165) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 00:20:59 user nova-compute[75165]: DEBUG nova.network.neutron [req-b488a9e6-f408-44a5-a783-c652dc49daf0 req-64592590-6891-46cc-ba3a-7c5c4bddc0df service nova] [instance: a7eeb145-1565-4812-818b-fefda5f2436d] Updating instance_info_cache with network_info: [{"id": "7a43d085-a683-4c49-a7c8-13b8f35c943d", "address": "fa:16:3e:e8:63:41", "network": {"id": "bd1c84f9-bba9-4a23-8bf2-17e65022136a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1557945804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2911497df44047d9a9ee36a5652298bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a43d085-a6", "ovs_interfaceid": "7a43d085-a683-4c49-a7c8-13b8f35c943d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:20:59 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-b488a9e6-f408-44a5-a783-c652dc49daf0 req-64592590-6891-46cc-ba3a-7c5c4bddc0df service nova] Releasing lock "refresh_cache-a7eeb145-1565-4812-818b-fefda5f2436d" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:21:00 user nova-compute[75165]: DEBUG nova.compute.manager [None req-479af9a7-a575-49e6-a522-b6c26c6c65a9 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: bad6c21f-885f-4348-86f7-b237ce2d241b] Stashing vm_state: active {{(pid=75165) _prep_resize /opt/stack/nova/nova/compute/manager.py:5614}}
Oct 26 00:21:00 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-479af9a7-a575-49e6-a522-b6c26c6c65a9 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:21:00 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-479af9a7-a575-49e6-a522-b6c26c6c65a9 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:21:00 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-479af9a7-a575-49e6-a522-b6c26c6c65a9 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75165) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 00:21:00 user nova-compute[75165]: INFO nova.compute.claims [None req-479af9a7-a575-49e6-a522-b6c26c6c65a9 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: bad6c21f-885f-4348-86f7-b237ce2d241b] Claim successful on node user
Oct 26 00:21:00 user nova-compute[75165]: INFO nova.compute.resource_tracker [None req-479af9a7-a575-49e6-a522-b6c26c6c65a9 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: bad6c21f-885f-4348-86f7-b237ce2d241b] Updating resource usage from migration ce1b14f5-5eda-4c2f-9326-42b5128167e0
Oct 26 00:21:00 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-479af9a7-a575-49e6-a522-b6c26c6c65a9 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:21:00 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-479af9a7-a575-49e6-a522-b6c26c6c65a9 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:21:00 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-479af9a7-a575-49e6-a522-b6c26c6c65a9 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.376s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:21:00 user nova-compute[75165]: INFO nova.compute.manager [None req-479af9a7-a575-49e6-a522-b6c26c6c65a9 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: bad6c21f-885f-4348-86f7-b237ce2d241b] Migrating
Oct 26 00:21:00 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-479af9a7-a575-49e6-a522-b6c26c6c65a9 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Acquiring lock "refresh_cache-bad6c21f-885f-4348-86f7-b237ce2d241b" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:21:00 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-479af9a7-a575-49e6-a522-b6c26c6c65a9 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Acquired lock "refresh_cache-bad6c21f-885f-4348-86f7-b237ce2d241b" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:21:00 user nova-compute[75165]: DEBUG nova.network.neutron [None req-479af9a7-a575-49e6-a522-b6c26c6c65a9 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: bad6c21f-885f-4348-86f7-b237ce2d241b] Building network info cache for instance {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 00:21:00 user nova-compute[75165]: DEBUG nova.compute.manager [req-5d472ca0-9909-4395-bd5e-ff6903d3caa1 req-40fd3dc8-3130-424f-b1a9-604b297a6c01 service nova] [instance: bad6c21f-885f-4348-86f7-b237ce2d241b] Received event network-changed-b64d421a-ca91-4f21-80f7-17b0c17ceb8a {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:21:00 user nova-compute[75165]: DEBUG nova.compute.manager [req-5d472ca0-9909-4395-bd5e-ff6903d3caa1 req-40fd3dc8-3130-424f-b1a9-604b297a6c01 service nova] [instance: bad6c21f-885f-4348-86f7-b237ce2d241b] Refreshing instance network info cache due to event network-changed-b64d421a-ca91-4f21-80f7-17b0c17ceb8a. {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 00:21:00 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-5d472ca0-9909-4395-bd5e-ff6903d3caa1 req-40fd3dc8-3130-424f-b1a9-604b297a6c01 service nova] Acquiring lock "refresh_cache-bad6c21f-885f-4348-86f7-b237ce2d241b" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:21:01 user nova-compute[75165]: DEBUG nova.network.neutron [None req-479af9a7-a575-49e6-a522-b6c26c6c65a9 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: bad6c21f-885f-4348-86f7-b237ce2d241b] Updating instance_info_cache with network_info: [{"id": "b64d421a-ca91-4f21-80f7-17b0c17ceb8a", "address": "fa:16:3e:54:54:b8", "network": {"id": "bd1c84f9-bba9-4a23-8bf2-17e65022136a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1557945804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2911497df44047d9a9ee36a5652298bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb64d421a-ca", "ovs_interfaceid": "b64d421a-ca91-4f21-80f7-17b0c17ceb8a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:21:01 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-479af9a7-a575-49e6-a522-b6c26c6c65a9 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Releasing lock "refresh_cache-bad6c21f-885f-4348-86f7-b237ce2d241b" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:21:01 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-5d472ca0-9909-4395-bd5e-ff6903d3caa1 req-40fd3dc8-3130-424f-b1a9-604b297a6c01 service nova] Acquired lock "refresh_cache-bad6c21f-885f-4348-86f7-b237ce2d241b" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:21:01 user nova-compute[75165]: DEBUG nova.network.neutron [req-5d472ca0-9909-4395-bd5e-ff6903d3caa1 req-40fd3dc8-3130-424f-b1a9-604b297a6c01 service nova] [instance: bad6c21f-885f-4348-86f7-b237ce2d241b] Refreshing network info cache for port b64d421a-ca91-4f21-80f7-17b0c17ceb8a {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 00:21:01 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-479af9a7-a575-49e6-a522-b6c26c6c65a9 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: bad6c21f-885f-4348-86f7-b237ce2d241b] Starting migrate_disk_and_power_off {{(pid=75165) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Oct 26 00:21:01 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:21:01 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:21:01 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:21:01 user nova-compute[75165]: DEBUG nova.network.neutron [req-5d472ca0-9909-4395-bd5e-ff6903d3caa1 req-40fd3dc8-3130-424f-b1a9-604b297a6c01 service nova] [instance: bad6c21f-885f-4348-86f7-b237ce2d241b] Updated VIF entry in instance network info cache for port b64d421a-ca91-4f21-80f7-17b0c17ceb8a. {{(pid=75165) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 00:21:01 user nova-compute[75165]: DEBUG nova.network.neutron [req-5d472ca0-9909-4395-bd5e-ff6903d3caa1 req-40fd3dc8-3130-424f-b1a9-604b297a6c01 service nova] [instance: bad6c21f-885f-4348-86f7-b237ce2d241b] Updating instance_info_cache with network_info: [{"id": "b64d421a-ca91-4f21-80f7-17b0c17ceb8a", "address": "fa:16:3e:54:54:b8", "network": {"id": "bd1c84f9-bba9-4a23-8bf2-17e65022136a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1557945804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2911497df44047d9a9ee36a5652298bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb64d421a-ca", "ovs_interfaceid": "b64d421a-ca91-4f21-80f7-17b0c17ceb8a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:21:01 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:21:01 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-5d472ca0-9909-4395-bd5e-ff6903d3caa1 req-40fd3dc8-3130-424f-b1a9-604b297a6c01 service nova] Releasing lock "refresh_cache-bad6c21f-885f-4348-86f7-b237ce2d241b" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:21:02 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: bad6c21f-885f-4348-86f7-b237ce2d241b] Instance destroyed successfully.
Oct 26 00:21:02 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-479af9a7-a575-49e6-a522-b6c26c6c65a9 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:19:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-71108019',display_name='tempest-ServerActionsTestOtherA-server-71108019',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-71108019',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOtsEaxSd5nKie4b+oTvKYqMVt06ToquYp528kCMFq0uGoZPhLpZteN38KkhJxhsHSzqyfMtJ24GLZPdcByyVczoa0tAnbSbuiNOiWj1Q2SiBRytz34zgMiDTwdnF2ayTw==',key_name='tempest-keypair-1300111',keypairs=<?>,launch_index=0,launched_at=2023-10-26T00:19:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2911497df44047d9a9ee36a5652298bc',ramdisk_id='',reservation_id='r-5k0e6xul',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1690932306',owner_user_name='tempest-ServerActionsTestOtherA-1690932306-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T00:21:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b3ce94f4c01446ebf79a1eba3833e01',uuid=bad6c21f-885f-4348-86f7-b237ce2d241b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b64d421a-ca91-4f21-80f7-17b0c17ceb8a", "address": "fa:16:3e:54:54:b8", "network": {"id": "bd1c84f9-bba9-4a23-8bf2-17e65022136a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1557945804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1557945804-network", "vif_mac": "fa:16:3e:54:54:b8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2911497df44047d9a9ee36a5652298bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb64d421a-ca", "ovs_interfaceid": "b64d421a-ca91-4f21-80f7-17b0c17ceb8a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 00:21:02 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-479af9a7-a575-49e6-a522-b6c26c6c65a9 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Converting VIF {"id": "b64d421a-ca91-4f21-80f7-17b0c17ceb8a", "address": "fa:16:3e:54:54:b8", "network": {"id": "bd1c84f9-bba9-4a23-8bf2-17e65022136a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1557945804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1557945804-network", "vif_mac": "fa:16:3e:54:54:b8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2911497df44047d9a9ee36a5652298bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb64d421a-ca", "ovs_interfaceid": "b64d421a-ca91-4f21-80f7-17b0c17ceb8a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:21:02 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-479af9a7-a575-49e6-a522-b6c26c6c65a9 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:54:54:b8,bridge_name='br-int',has_traffic_filtering=True,id=b64d421a-ca91-4f21-80f7-17b0c17ceb8a,network=Network(bd1c84f9-bba9-4a23-8bf2-17e65022136a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb64d421a-ca') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:21:02 user nova-compute[75165]: DEBUG os_vif [None req-479af9a7-a575-49e6-a522-b6c26c6c65a9 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:54:54:b8,bridge_name='br-int',has_traffic_filtering=True,id=b64d421a-ca91-4f21-80f7-17b0c17ceb8a,network=Network(bd1c84f9-bba9-4a23-8bf2-17e65022136a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb64d421a-ca') {{(pid=75165) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 00:21:02 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:21:02 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb64d421a-ca, bridge=br-int, if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:21:02 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:21:02 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:21:02 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:21:02 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:21:02 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2b8fb9de-2050-4f9d-93e4-9de6de4fcb32) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:21:02 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:21:02 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:21:02 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:21:02 user nova-compute[75165]: INFO os_vif [None req-479af9a7-a575-49e6-a522-b6c26c6c65a9 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:54:54:b8,bridge_name='br-int',has_traffic_filtering=True,id=b64d421a-ca91-4f21-80f7-17b0c17ceb8a,network=Network(bd1c84f9-bba9-4a23-8bf2-17e65022136a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb64d421a-ca')
Oct 26 00:21:02 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-479af9a7-a575-49e6-a522-b6c26c6c65a9 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: bad6c21f-885f-4348-86f7-b237ce2d241b] calling os-brick to detach iSCSI Volume {{(pid=75165) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 00:21:02 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-479af9a7-a575-49e6-a522-b6c26c6c65a9 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8bf8160e50>, {'target_iqn': 'iqn.2010-10.org.openstack:99a43689-b7cd-47e6-ae88-fd8ba07c60c1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RhTfzArp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:21:02 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-479af9a7-a575-49e6-a522-b6c26c6c65a9 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:21:02 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-479af9a7-a575-49e6-a522-b6c26c6c65a9 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:21:02 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-479af9a7-a575-49e6-a522-b6c26c6c65a9 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:21:02 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:21:02 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:21:02 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[702af571-d98e-4f5f-8af3-22c59a2157df]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f06e40e7-3ca1-4a25-bd11-ff01280c6df2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:99a43689-b7cd-47e6-ae88-fd8ba07c60c1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:21:02 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-479af9a7-a575-49e6-a522-b6c26c6c65a9 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 00:21:02 user nova-compute[75165]: No targets found.
Oct 26 00:21:02 user nova-compute[75165]: iSNS:
Oct 26 00:21:02 user nova-compute[75165]: No targets found.
Oct 26 00:21:02 user nova-compute[75165]: STATIC:
Oct 26 00:21:02 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:f06e40e7-3ca1-4a25-bd11-ff01280c6df2
Oct 26 00:21:02 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:21:02 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:21:02 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:99a43689-b7cd-47e6-ae88-fd8ba07c60c1
Oct 26 00:21:02 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:21:02 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:21:02 user nova-compute[75165]: FIRMWARE:
Oct 26 00:21:02 user nova-compute[75165]: No targets found.
Oct 26 00:21:02 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:21:02 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-479af9a7-a575-49e6-a522-b6c26c6c65a9 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 00:21:02 user nova-compute[75165]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 00:21:02 user nova-compute[75165]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75165) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 00:21:02 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-479af9a7-a575-49e6-a522-b6c26c6c65a9 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:99a43689-b7cd-47e6-ae88-fd8ba07c60c1', 0)] {{(pid=75165) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 00:21:02 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:21:02 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:21:02 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc59125a-0df5-4cfa-97ad-073affd46320]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99a43689-b7cd-47e6-ae88-fd8ba07c60c1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f06e40e7-3ca1-4a25-bd11-ff01280c6df2\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:21:02 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:21:02 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:21:02 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddac635d-e339-413e-acfe-e58b7cc8c6e3]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f06e40e7-3ca1-4a25-bd11-ff01280c6df2 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a43689-b7cd-47e6-ae88-fd8ba07c60c1 (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:21:02 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-479af9a7-a575-49e6-a522-b6c26c6c65a9 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f06e40e7-3ca1-4a25-bd11-ff01280c6df2 (non-flash)
Oct 26 00:21:02 user nova-compute[75165]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a43689-b7cd-47e6-ae88-fd8ba07c60c1 (non-flash)
Oct 26 00:21:02 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:21:02 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-479af9a7-a575-49e6-a522-b6c26c6c65a9 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f06e40e7-3ca1-4a25-bd11-ff01280c6df2 (non-flash)
Oct 26 00:21:02 user nova-compute[75165]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a43689-b7cd-47e6-ae88-fd8ba07c60c1 (non-flash)
Oct 26 00:21:02 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:21:02 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-479af9a7-a575-49e6-a522-b6c26c6c65a9 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8bf8175090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:99a43689-b7cd-47e6-ae88-fd8ba07c60c1'): ({'sdd'}, set())}) {{(pid=75165) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 00:21:02 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-479af9a7-a575-49e6-a522-b6c26c6c65a9 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Removing single pathed devices sdd {{(pid=75165) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 00:21:02 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:21:02 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:21:02 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[31999ecc-7a56-4f3e-9c61-c20ab4473839]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:21:02 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:21:02 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:21:02 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[552b7d48-a788-4f96-afdf-c52dd9da39b0]: (4, ('ok\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:21:02 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-479af9a7-a575-49e6-a522-b6c26c6c65a9 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Flushing IO for device /dev/sdd {{(pid=75165) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 00:21:02 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:21:02 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:21:02 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[21f024e2-5c6c-4184-a0c3-a1aabb983f70]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:21:02 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-479af9a7-a575-49e6-a522-b6c26c6c65a9 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75165) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 00:21:02 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:21:02 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.044s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:21:02 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f1aa006-cc0b-4ab1-922c-096b6beb6656]: (4, ('1', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:21:02 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-479af9a7-a575-49e6-a522-b6c26c6c65a9 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75165) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 00:21:02 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-479af9a7-a575-49e6-a522-b6c26c6c65a9 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] SCSI volumes sdd have been removed. {{(pid=75165) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 00:21:02 user nova-compute[75165]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_bca29eae', '/dev/disk/by-id/scsi-1SCST_BIObca29eae-60981dbbbe91b243', '/dev/disk/by-id/scsi-23630393831646262') {{(pid=86976) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 26 00:21:02 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[f289c988-3944-4c57-ab82-149424fd9c20]: (4, None) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:21:02 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-479af9a7-a575-49e6-a522-b6c26c6c65a9 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:99a43689-b7cd-47e6-ae88-fd8ba07c60c1')] {{(pid=75165) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 00:21:02 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99a43689-b7cd-47e6-ae88-fd8ba07c60c1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:21:02 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99a43689-b7cd-47e6-ae88-fd8ba07c60c1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:21:02 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[85f86a14-d0db-45a5-b783-dbdac581e296]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:21:02 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-479af9a7-a575-49e6-a522-b6c26c6c65a9 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:21:02 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99a43689-b7cd-47e6-ae88-fd8ba07c60c1 -p 172.16.0.220:3260 --logout {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:21:02 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99a43689-b7cd-47e6-ae88-fd8ba07c60c1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.041s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:21:02 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[35de402e-0d21-42b9-8e02-d00a80d67775]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:99a43689-b7cd-47e6-ae88-fd8ba07c60c1, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:99a43689-b7cd-47e6-ae88-fd8ba07c60c1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:21:02 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-479af9a7-a575-49e6-a522-b6c26c6c65a9 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:99a43689-b7cd-47e6-ae88-fd8ba07c60c1, portal: 172.16.0.220,3260]
Oct 26 00:21:02 user nova-compute[75165]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:99a43689-b7cd-47e6-ae88-fd8ba07c60c1, portal: 172.16.0.220,3260] successful.
Oct 26 00:21:02 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:21:02 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99a43689-b7cd-47e6-ae88-fd8ba07c60c1 -p 172.16.0.220:3260 --op delete {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:21:02 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99a43689-b7cd-47e6-ae88-fd8ba07c60c1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:21:02 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8ce7f56-de1b-4138-bdad-d379b25e28ea]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:21:02 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-479af9a7-a575-49e6-a522-b6c26c6c65a9 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:21:02 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-479af9a7-a575-49e6-a522-b6c26c6c65a9 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.293s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:21:02 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-479af9a7-a575-49e6-a522-b6c26c6c65a9 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] <== disconnect_volume: return (294ms) None {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:21:02 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-479af9a7-a575-49e6-a522-b6c26c6c65a9 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: bad6c21f-885f-4348-86f7-b237ce2d241b] Disconnected iSCSI Volume {{(pid=75165) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 00:21:02 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-479af9a7-a575-49e6-a522-b6c26c6c65a9 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75165) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 00:21:02 user nova-compute[75165]: DEBUG nova.compute.manager [req-e26ec50c-9e1a-44ef-b63a-97f6bcd3353a req-47da6e69-0a04-4b48-87da-9663ab6fa1c6 service nova] [instance: bad6c21f-885f-4348-86f7-b237ce2d241b] Received event network-vif-unplugged-b64d421a-ca91-4f21-80f7-17b0c17ceb8a {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:21:02 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-e26ec50c-9e1a-44ef-b63a-97f6bcd3353a req-47da6e69-0a04-4b48-87da-9663ab6fa1c6 service nova] Acquiring lock "bad6c21f-885f-4348-86f7-b237ce2d241b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:21:02 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-e26ec50c-9e1a-44ef-b63a-97f6bcd3353a req-47da6e69-0a04-4b48-87da-9663ab6fa1c6 service nova] Lock "bad6c21f-885f-4348-86f7-b237ce2d241b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:21:02 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-e26ec50c-9e1a-44ef-b63a-97f6bcd3353a req-47da6e69-0a04-4b48-87da-9663ab6fa1c6 service nova] Lock "bad6c21f-885f-4348-86f7-b237ce2d241b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:21:02 user nova-compute[75165]: DEBUG nova.compute.manager [req-e26ec50c-9e1a-44ef-b63a-97f6bcd3353a req-47da6e69-0a04-4b48-87da-9663ab6fa1c6 service nova] [instance: bad6c21f-885f-4348-86f7-b237ce2d241b] No waiting events found dispatching network-vif-unplugged-b64d421a-ca91-4f21-80f7-17b0c17ceb8a {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:21:02 user nova-compute[75165]: WARNING nova.compute.manager [req-e26ec50c-9e1a-44ef-b63a-97f6bcd3353a req-47da6e69-0a04-4b48-87da-9663ab6fa1c6 service nova] [instance: bad6c21f-885f-4348-86f7-b237ce2d241b] Received unexpected event network-vif-unplugged-b64d421a-ca91-4f21-80f7-17b0c17ceb8a for instance with vm_state active and task_state resize_migrating.
Oct 26 00:21:02 user nova-compute[75165]: DEBUG nova.compute.manager [req-e26ec50c-9e1a-44ef-b63a-97f6bcd3353a req-47da6e69-0a04-4b48-87da-9663ab6fa1c6 service nova] [instance: bad6c21f-885f-4348-86f7-b237ce2d241b] Received event network-vif-plugged-b64d421a-ca91-4f21-80f7-17b0c17ceb8a {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:21:02 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-e26ec50c-9e1a-44ef-b63a-97f6bcd3353a req-47da6e69-0a04-4b48-87da-9663ab6fa1c6 service nova] Acquiring lock "bad6c21f-885f-4348-86f7-b237ce2d241b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:21:02 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-e26ec50c-9e1a-44ef-b63a-97f6bcd3353a req-47da6e69-0a04-4b48-87da-9663ab6fa1c6 service nova] Lock "bad6c21f-885f-4348-86f7-b237ce2d241b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:21:02 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-e26ec50c-9e1a-44ef-b63a-97f6bcd3353a req-47da6e69-0a04-4b48-87da-9663ab6fa1c6 service nova] Lock "bad6c21f-885f-4348-86f7-b237ce2d241b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:21:02 user nova-compute[75165]: DEBUG nova.compute.manager [req-e26ec50c-9e1a-44ef-b63a-97f6bcd3353a req-47da6e69-0a04-4b48-87da-9663ab6fa1c6 service nova] [instance: bad6c21f-885f-4348-86f7-b237ce2d241b] No waiting events found dispatching network-vif-plugged-b64d421a-ca91-4f21-80f7-17b0c17ceb8a {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:21:02 user nova-compute[75165]: WARNING nova.compute.manager [req-e26ec50c-9e1a-44ef-b63a-97f6bcd3353a req-47da6e69-0a04-4b48-87da-9663ab6fa1c6 service nova] [instance: bad6c21f-885f-4348-86f7-b237ce2d241b] Received unexpected event network-vif-plugged-b64d421a-ca91-4f21-80f7-17b0c17ceb8a for instance with vm_state active and task_state resize_migrating.
Oct 26 00:21:05 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:21:06 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:21:06 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75165) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 00:21:07 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:21:08 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:21:09 user nova-compute[75165]: DEBUG nova.network.neutron [None req-479af9a7-a575-49e6-a522-b6c26c6c65a9 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: bad6c21f-885f-4348-86f7-b237ce2d241b] Port b64d421a-ca91-4f21-80f7-17b0c17ceb8a binding to destination host user is already ACTIVE {{(pid=75165) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Oct 26 00:21:09 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-479af9a7-a575-49e6-a522-b6c26c6c65a9 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Acquiring lock "bad6c21f-885f-4348-86f7-b237ce2d241b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:21:09 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-479af9a7-a575-49e6-a522-b6c26c6c65a9 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Lock "bad6c21f-885f-4348-86f7-b237ce2d241b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:21:09 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-479af9a7-a575-49e6-a522-b6c26c6c65a9 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Lock "bad6c21f-885f-4348-86f7-b237ce2d241b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:21:09 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-479af9a7-a575-49e6-a522-b6c26c6c65a9 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Acquiring lock "refresh_cache-bad6c21f-885f-4348-86f7-b237ce2d241b" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:21:09 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-479af9a7-a575-49e6-a522-b6c26c6c65a9 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Acquired lock "refresh_cache-bad6c21f-885f-4348-86f7-b237ce2d241b" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:21:09 user nova-compute[75165]: DEBUG nova.network.neutron [None req-479af9a7-a575-49e6-a522-b6c26c6c65a9 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: bad6c21f-885f-4348-86f7-b237ce2d241b] Building network info cache for instance {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 00:21:09 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:21:10 user nova-compute[75165]: DEBUG nova.network.neutron [None req-479af9a7-a575-49e6-a522-b6c26c6c65a9 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: bad6c21f-885f-4348-86f7-b237ce2d241b] Updating instance_info_cache with network_info: [{"id": "b64d421a-ca91-4f21-80f7-17b0c17ceb8a", "address": "fa:16:3e:54:54:b8", "network": {"id": "bd1c84f9-bba9-4a23-8bf2-17e65022136a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1557945804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2911497df44047d9a9ee36a5652298bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb64d421a-ca", "ovs_interfaceid": "b64d421a-ca91-4f21-80f7-17b0c17ceb8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:21:10 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-479af9a7-a575-49e6-a522-b6c26c6c65a9 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Releasing lock "refresh_cache-bad6c21f-885f-4348-86f7-b237ce2d241b" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:21:10 user nova-compute[75165]: DEBUG os_brick.utils [None req-479af9a7-a575-49e6-a522-b6c26c6c65a9 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:21:10 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:21:10 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:21:10 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[478f11cb-c219-4f96-b7be-246dbee2ed46]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa94814ccb35\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:21:10 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:21:10 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:21:10 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[079228eb-c888-416f-915c-410db8969dd8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:21:10 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:21:10 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:21:10 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[8697bcc6-bf75-4933-b4b5-846f0f930b76]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:21:10 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[75e03b1d-91bd-428e-9367-04d6e2795e32]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:21:10 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-479af9a7-a575-49e6-a522-b6c26c6c65a9 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Running cmd (subprocess): nvme version {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:21:10 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-479af9a7-a575-49e6-a522-b6c26c6c65a9 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] 'nvme version' failed. Not Retrying. {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 00:21:10 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.nvmeof [None req-479af9a7-a575-49e6-a522-b6c26c6c65a9 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] nvme not present on system {{(pid=75165) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 00:21:10 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:21:10 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 00:21:10 user nova-compute[75165]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 00:21:10 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[b26a0252-f543-40e0-a657-67454d915992]: (4, '') {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:21:10 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-479af9a7-a575-49e6-a522-b6c26c6c65a9 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75165) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 00:21:10 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-479af9a7-a575-49e6-a522-b6c26c6c65a9 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75165) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 00:21:10 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-479af9a7-a575-49e6-a522-b6c26c6c65a9 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] LIGHTOS: no hostnqn found. {{(pid=75165) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 00:21:10 user nova-compute[75165]: DEBUG os_brick.utils [None req-479af9a7-a575-49e6-a522-b6c26c6c65a9 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa94814ccb35', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:21:10 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-3e7a0511-7280-40bc-a602-080106a6f56e tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Acquiring lock "a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:21:10 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-3e7a0511-7280-40bc-a602-080106a6f56e tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Lock "a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:21:10 user nova-compute[75165]: DEBUG nova.compute.manager [None req-3e7a0511-7280-40bc-a602-080106a6f56e tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb] Starting instance... {{(pid=75165) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 00:21:10 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-3e7a0511-7280-40bc-a602-080106a6f56e tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:21:10 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-3e7a0511-7280-40bc-a602-080106a6f56e tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:21:10 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-3e7a0511-7280-40bc-a602-080106a6f56e tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75165) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 00:21:10 user nova-compute[75165]: INFO nova.compute.claims [None req-3e7a0511-7280-40bc-a602-080106a6f56e tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb] Claim successful on node user
Oct 26 00:21:10 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:21:10 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:21:11 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-3e7a0511-7280-40bc-a602-080106a6f56e tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:21:11 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-3e7a0511-7280-40bc-a602-080106a6f56e tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:21:11 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-3e7a0511-7280-40bc-a602-080106a6f56e tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.557s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:21:11 user nova-compute[75165]: DEBUG nova.compute.manager [None req-3e7a0511-7280-40bc-a602-080106a6f56e tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb] Start building networks asynchronously for instance. {{(pid=75165) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 00:21:11 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.370s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:21:11 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:21:11 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75165) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 00:21:11 user nova-compute[75165]: DEBUG nova.compute.manager [None req-3e7a0511-7280-40bc-a602-080106a6f56e tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb] Allocating IP information in the background. {{(pid=75165) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 00:21:11 user nova-compute[75165]: DEBUG nova.network.neutron [None req-3e7a0511-7280-40bc-a602-080106a6f56e tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb] allocate_for_instance() {{(pid=75165) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 00:21:11 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-3e7a0511-7280-40bc-a602-080106a6f56e tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 00:21:11 user nova-compute[75165]: DEBUG nova.compute.manager [None req-3e7a0511-7280-40bc-a602-080106a6f56e tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb] Start building block device mappings for instance. {{(pid=75165) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 00:21:11 user nova-compute[75165]: DEBUG nova.policy [None req-3e7a0511-7280-40bc-a602-080106a6f56e tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'dbe0d52293264f33ae86de41dabeefcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd616862c7c184de5b0ba3121552c5666', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75165) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 00:21:11 user nova-compute[75165]: INFO nova.virt.block_device [None req-3e7a0511-7280-40bc-a602-080106a6f56e tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb] Booting with blank volume at /dev/vda
Oct 26 00:21:11 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84c6b624-648b-40e2-a37e-ff08609bad84/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:21:11 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84c6b624-648b-40e2-a37e-ff08609bad84/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:21:11 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84c6b624-648b-40e2-a37e-ff08609bad84/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:21:11 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-f617f30c-b77c-49e5-9c6d-e991069dfee5 tempest-VolumesActionsTest-964746875 tempest-VolumesActionsTest-964746875-project-member] Acquiring lock "8e847329-ad09-450d-854b-468a3b8bdf60" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:21:11 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-f617f30c-b77c-49e5-9c6d-e991069dfee5 tempest-VolumesActionsTest-964746875 tempest-VolumesActionsTest-964746875-project-member] Lock "8e847329-ad09-450d-854b-468a3b8bdf60" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:21:11 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-f617f30c-b77c-49e5-9c6d-e991069dfee5 tempest-VolumesActionsTest-964746875 tempest-VolumesActionsTest-964746875-project-member] Acquiring lock "8e847329-ad09-450d-854b-468a3b8bdf60-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:21:11 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-f617f30c-b77c-49e5-9c6d-e991069dfee5 tempest-VolumesActionsTest-964746875 tempest-VolumesActionsTest-964746875-project-member] Lock "8e847329-ad09-450d-854b-468a3b8bdf60-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:21:11 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-f617f30c-b77c-49e5-9c6d-e991069dfee5 tempest-VolumesActionsTest-964746875 tempest-VolumesActionsTest-964746875-project-member] Lock "8e847329-ad09-450d-854b-468a3b8bdf60-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:21:11 user nova-compute[75165]: INFO nova.compute.manager [None req-f617f30c-b77c-49e5-9c6d-e991069dfee5 tempest-VolumesActionsTest-964746875 tempest-VolumesActionsTest-964746875-project-member] [instance: 8e847329-ad09-450d-854b-468a3b8bdf60] Terminating instance
Oct 26 00:21:11 user nova-compute[75165]: DEBUG nova.compute.manager [None req-f617f30c-b77c-49e5-9c6d-e991069dfee5 tempest-VolumesActionsTest-964746875 tempest-VolumesActionsTest-964746875-project-member] [instance: 8e847329-ad09-450d-854b-468a3b8bdf60] Start destroying the instance on the hypervisor. {{(pid=75165) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 00:21:11 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84c6b624-648b-40e2-a37e-ff08609bad84/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:21:11 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97fb67a7-637d-456f-b4dd-0a271ed6cfc4/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:21:11 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:21:11 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:21:12 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:21:12 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:21:12 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:21:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97fb67a7-637d-456f-b4dd-0a271ed6cfc4/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:21:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97fb67a7-637d-456f-b4dd-0a271ed6cfc4/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:21:12 user nova-compute[75165]: DEBUG nova.compute.manager [req-66d04bf5-7c4f-4b91-ac69-2427ef7a370b req-345813bd-c7b0-48e2-82bf-b3d96e7c8dd5 service nova] [instance: 8e847329-ad09-450d-854b-468a3b8bdf60] Received event network-vif-unplugged-7bc04115-a6b3-4514-b72d-4b73aa5fe793 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:21:12 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-66d04bf5-7c4f-4b91-ac69-2427ef7a370b req-345813bd-c7b0-48e2-82bf-b3d96e7c8dd5 service nova] Acquiring lock "8e847329-ad09-450d-854b-468a3b8bdf60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:21:12 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-66d04bf5-7c4f-4b91-ac69-2427ef7a370b req-345813bd-c7b0-48e2-82bf-b3d96e7c8dd5 service nova] Lock "8e847329-ad09-450d-854b-468a3b8bdf60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:21:12 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-66d04bf5-7c4f-4b91-ac69-2427ef7a370b req-345813bd-c7b0-48e2-82bf-b3d96e7c8dd5 service nova] Lock "8e847329-ad09-450d-854b-468a3b8bdf60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:21:12 user nova-compute[75165]: DEBUG nova.compute.manager [req-66d04bf5-7c4f-4b91-ac69-2427ef7a370b req-345813bd-c7b0-48e2-82bf-b3d96e7c8dd5 service nova] [instance: 8e847329-ad09-450d-854b-468a3b8bdf60] No waiting events found dispatching network-vif-unplugged-7bc04115-a6b3-4514-b72d-4b73aa5fe793 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:21:12 user nova-compute[75165]: DEBUG nova.compute.manager [req-66d04bf5-7c4f-4b91-ac69-2427ef7a370b req-345813bd-c7b0-48e2-82bf-b3d96e7c8dd5 service nova] [instance: 8e847329-ad09-450d-854b-468a3b8bdf60] Received event network-vif-unplugged-7bc04115-a6b3-4514-b72d-4b73aa5fe793 for instance with task_state deleting. {{(pid=75165) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 00:21:12 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:21:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97fb67a7-637d-456f-b4dd-0a271ed6cfc4/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:21:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7eeb145-1565-4812-818b-fefda5f2436d/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:21:12 user nova-compute[75165]: DEBUG nova.network.neutron [None req-3e7a0511-7280-40bc-a602-080106a6f56e tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb] Successfully created port: e2143e91-9f8c-4670-9f92-c2c00827a619 {{(pid=75165) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 00:21:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7eeb145-1565-4812-818b-fefda5f2436d/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:21:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7eeb145-1565-4812-818b-fefda5f2436d/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:21:12 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:21:12 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:21:12 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: 8e847329-ad09-450d-854b-468a3b8bdf60] Instance destroyed successfully.
Oct 26 00:21:12 user nova-compute[75165]: DEBUG nova.objects.instance [None req-f617f30c-b77c-49e5-9c6d-e991069dfee5 tempest-VolumesActionsTest-964746875 tempest-VolumesActionsTest-964746875-project-member] Lazy-loading 'resources' on Instance uuid 8e847329-ad09-450d-854b-468a3b8bdf60 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:21:12 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-f617f30c-b77c-49e5-9c6d-e991069dfee5 tempest-VolumesActionsTest-964746875 tempest-VolumesActionsTest-964746875-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:19:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-459487771',display_name='tempest-VolumesActionsTest-instance-459487771',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-459487771',id=26,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-26T00:19:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ac36ea060d7f4e43b4ff69ff32afd8a3',ramdisk_id='',reservation_id='r-pk0kfbhp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-964746875',owner_user_name='tempest-VolumesActionsTest-964746875-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T00:19:11Z,user_data=None,user_id='1bdac2b15e794e0da5ed2fd4740712ce',uuid=8e847329-ad09-450d-854b-468a3b8bdf60,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7bc04115-a6b3-4514-b72d-4b73aa5fe793", "address": "fa:16:3e:fb:a0:6b", "network": {"id": "302fba99-ca6c-41be-895d-a534355a2ffa", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1221818499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac36ea060d7f4e43b4ff69ff32afd8a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bc04115-a6", "ovs_interfaceid": "7bc04115-a6b3-4514-b72d-4b73aa5fe793", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 00:21:12 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-f617f30c-b77c-49e5-9c6d-e991069dfee5 tempest-VolumesActionsTest-964746875 tempest-VolumesActionsTest-964746875-project-member] Converting VIF {"id": "7bc04115-a6b3-4514-b72d-4b73aa5fe793", "address": "fa:16:3e:fb:a0:6b", "network": {"id": "302fba99-ca6c-41be-895d-a534355a2ffa", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1221818499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac36ea060d7f4e43b4ff69ff32afd8a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bc04115-a6", "ovs_interfaceid": "7bc04115-a6b3-4514-b72d-4b73aa5fe793", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:21:12 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-f617f30c-b77c-49e5-9c6d-e991069dfee5 tempest-VolumesActionsTest-964746875 tempest-VolumesActionsTest-964746875-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fb:a0:6b,bridge_name='br-int',has_traffic_filtering=True,id=7bc04115-a6b3-4514-b72d-4b73aa5fe793,network=Network(302fba99-ca6c-41be-895d-a534355a2ffa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bc04115-a6') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:21:12 user nova-compute[75165]: DEBUG os_vif [None req-f617f30c-b77c-49e5-9c6d-e991069dfee5 tempest-VolumesActionsTest-964746875 tempest-VolumesActionsTest-964746875-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:a0:6b,bridge_name='br-int',has_traffic_filtering=True,id=7bc04115-a6b3-4514-b72d-4b73aa5fe793,network=Network(302fba99-ca6c-41be-895d-a534355a2ffa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bc04115-a6') {{(pid=75165) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 00:21:12 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:21:12 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7bc04115-a6, bridge=br-int, if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:21:12 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:21:12 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:21:12 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:21:12 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:21:12 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c50a23ee-eaf1-457c-8b7f-a523f8320527) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:21:12 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:21:12 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:21:12 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:21:12 user nova-compute[75165]: INFO os_vif [None req-f617f30c-b77c-49e5-9c6d-e991069dfee5 tempest-VolumesActionsTest-964746875 tempest-VolumesActionsTest-964746875-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fb:a0:6b,bridge_name='br-int',has_traffic_filtering=True,id=7bc04115-a6b3-4514-b72d-4b73aa5fe793,network=Network(302fba99-ca6c-41be-895d-a534355a2ffa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bc04115-a6')
Oct 26 00:21:12 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-f617f30c-b77c-49e5-9c6d-e991069dfee5 tempest-VolumesActionsTest-964746875 tempest-VolumesActionsTest-964746875-project-member] [instance: 8e847329-ad09-450d-854b-468a3b8bdf60] Deleting instance files /opt/stack/data/nova/instances/8e847329-ad09-450d-854b-468a3b8bdf60_del
Oct 26 00:21:12 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-f617f30c-b77c-49e5-9c6d-e991069dfee5 tempest-VolumesActionsTest-964746875 tempest-VolumesActionsTest-964746875-project-member] [instance: 8e847329-ad09-450d-854b-468a3b8bdf60] Deletion of /opt/stack/data/nova/instances/8e847329-ad09-450d-854b-468a3b8bdf60_del complete
Oct 26 00:21:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7eeb145-1565-4812-818b-fefda5f2436d/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:21:12 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75165) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 00:21:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e44bfc-6a68-46ce-8335-aaaba5160d3e/disk.rescue --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:21:12 user nova-compute[75165]: INFO nova.compute.manager [None req-f617f30c-b77c-49e5-9c6d-e991069dfee5 tempest-VolumesActionsTest-964746875 tempest-VolumesActionsTest-964746875-project-member] [instance: 8e847329-ad09-450d-854b-468a3b8bdf60] Took 0.93 seconds to destroy the instance on the hypervisor.
Oct 26 00:21:12 user nova-compute[75165]: DEBUG oslo.service.loopingcall [None req-f617f30c-b77c-49e5-9c6d-e991069dfee5 tempest-VolumesActionsTest-964746875 tempest-VolumesActionsTest-964746875-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75165) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 00:21:12 user nova-compute[75165]: DEBUG nova.compute.manager [-] [instance: 8e847329-ad09-450d-854b-468a3b8bdf60] Deallocating network for instance {{(pid=75165) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 00:21:12 user nova-compute[75165]: DEBUG nova.network.neutron [-] [instance: 8e847329-ad09-450d-854b-468a3b8bdf60] deallocate_for_instance() {{(pid=75165) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 00:21:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e44bfc-6a68-46ce-8335-aaaba5160d3e/disk.rescue --force-share --output=json" returned: 0 in 0.204s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:21:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e44bfc-6a68-46ce-8335-aaaba5160d3e/disk.rescue --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:21:13 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e44bfc-6a68-46ce-8335-aaaba5160d3e/disk.rescue --force-share --output=json" returned: 0 in 0.204s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:21:13 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e44bfc-6a68-46ce-8335-aaaba5160d3e/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:21:13 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e44bfc-6a68-46ce-8335-aaaba5160d3e/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:21:13 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e44bfc-6a68-46ce-8335-aaaba5160d3e/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:21:13 user nova-compute[75165]: DEBUG nova.network.neutron [None req-3e7a0511-7280-40bc-a602-080106a6f56e tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb] Successfully updated port: e2143e91-9f8c-4670-9f92-c2c00827a619 {{(pid=75165) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 00:21:13 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e44bfc-6a68-46ce-8335-aaaba5160d3e/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:21:13 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27fa1771-fb69-49da-81b3-7f112e623170/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:21:13 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-3e7a0511-7280-40bc-a602-080106a6f56e tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Acquiring lock "refresh_cache-a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:21:13 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-3e7a0511-7280-40bc-a602-080106a6f56e tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Acquired lock "refresh_cache-a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:21:13 user nova-compute[75165]: DEBUG nova.network.neutron [None req-3e7a0511-7280-40bc-a602-080106a6f56e tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb] Building network info cache for instance {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 00:21:13 user nova-compute[75165]: DEBUG nova.network.neutron [-] [instance: 8e847329-ad09-450d-854b-468a3b8bdf60] Updating instance_info_cache with network_info: [] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:21:13 user nova-compute[75165]: INFO nova.compute.manager [-] [instance: 8e847329-ad09-450d-854b-468a3b8bdf60] Took 0.91 seconds to deallocate network for instance.
Oct 26 00:21:13 user nova-compute[75165]: DEBUG nova.network.neutron [None req-3e7a0511-7280-40bc-a602-080106a6f56e tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb] Instance cache missing network info. {{(pid=75165) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 00:21:13 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27fa1771-fb69-49da-81b3-7f112e623170/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:21:13 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27fa1771-fb69-49da-81b3-7f112e623170/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:21:13 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-f617f30c-b77c-49e5-9c6d-e991069dfee5 tempest-VolumesActionsTest-964746875 tempest-VolumesActionsTest-964746875-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:21:13 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-f617f30c-b77c-49e5-9c6d-e991069dfee5 tempest-VolumesActionsTest-964746875 tempest-VolumesActionsTest-964746875-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:21:13 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27fa1771-fb69-49da-81b3-7f112e623170/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:21:13 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Error from libvirt while getting description of instance-0000001a: [Error Code 42] Domain not found: no domain with matching uuid '8e847329-ad09-450d-854b-468a3b8bdf60' (instance-0000001a): libvirt.libvirtError: Domain not found: no domain with matching uuid '8e847329-ad09-450d-854b-468a3b8bdf60' (instance-0000001a)
Oct 26 00:21:13 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91fe894a-90a8-4545-9b27-91771554c4cb/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:21:14 user nova-compute[75165]: DEBUG nova.network.neutron [None req-3e7a0511-7280-40bc-a602-080106a6f56e tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb] Updating instance_info_cache with network_info: [{"id": "e2143e91-9f8c-4670-9f92-c2c00827a619", "address": "fa:16:3e:6c:b7:14", "network": {"id": "eb55c0bc-cae5-4ba3-851a-e31a50b52c88", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1081223830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d616862c7c184de5b0ba3121552c5666", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2143e91-9f", "ovs_interfaceid": "e2143e91-9f8c-4670-9f92-c2c00827a619", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:21:14 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-3e7a0511-7280-40bc-a602-080106a6f56e tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Releasing lock "refresh_cache-a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:21:14 user nova-compute[75165]: DEBUG nova.compute.manager [None req-3e7a0511-7280-40bc-a602-080106a6f56e tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb] Instance network_info: |[{"id": "e2143e91-9f8c-4670-9f92-c2c00827a619", "address": "fa:16:3e:6c:b7:14", "network": {"id": "eb55c0bc-cae5-4ba3-851a-e31a50b52c88", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1081223830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d616862c7c184de5b0ba3121552c5666", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2143e91-9f", "ovs_interfaceid": "e2143e91-9f8c-4670-9f92-c2c00827a619", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75165) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 00:21:14 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91fe894a-90a8-4545-9b27-91771554c4cb/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:21:14 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91fe894a-90a8-4545-9b27-91771554c4cb/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:21:14 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-f617f30c-b77c-49e5-9c6d-e991069dfee5 tempest-VolumesActionsTest-964746875 tempest-VolumesActionsTest-964746875-project-member] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:21:14 user nova-compute[75165]: DEBUG nova.compute.manager [req-a4c24367-f7ac-4bb4-b239-6cdf4d19afda req-03f6fc24-0c97-4aba-b37c-e2751a0fcde6 service nova] [instance: 8e847329-ad09-450d-854b-468a3b8bdf60] Received event network-vif-plugged-7bc04115-a6b3-4514-b72d-4b73aa5fe793 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:21:14 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-a4c24367-f7ac-4bb4-b239-6cdf4d19afda req-03f6fc24-0c97-4aba-b37c-e2751a0fcde6 service nova] Acquiring lock "8e847329-ad09-450d-854b-468a3b8bdf60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:21:14 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-a4c24367-f7ac-4bb4-b239-6cdf4d19afda req-03f6fc24-0c97-4aba-b37c-e2751a0fcde6 service nova] Lock "8e847329-ad09-450d-854b-468a3b8bdf60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:21:14 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-a4c24367-f7ac-4bb4-b239-6cdf4d19afda req-03f6fc24-0c97-4aba-b37c-e2751a0fcde6 service nova] Lock "8e847329-ad09-450d-854b-468a3b8bdf60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:21:14 user nova-compute[75165]: DEBUG nova.compute.manager [req-a4c24367-f7ac-4bb4-b239-6cdf4d19afda req-03f6fc24-0c97-4aba-b37c-e2751a0fcde6 service nova] [instance: 8e847329-ad09-450d-854b-468a3b8bdf60] No waiting events found dispatching network-vif-plugged-7bc04115-a6b3-4514-b72d-4b73aa5fe793 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:21:14 user nova-compute[75165]: WARNING nova.compute.manager [req-a4c24367-f7ac-4bb4-b239-6cdf4d19afda req-03f6fc24-0c97-4aba-b37c-e2751a0fcde6 service nova] [instance: 8e847329-ad09-450d-854b-468a3b8bdf60] Received unexpected event network-vif-plugged-7bc04115-a6b3-4514-b72d-4b73aa5fe793 for instance with vm_state deleted and task_state None.
Oct 26 00:21:14 user nova-compute[75165]: DEBUG nova.compute.manager [req-a4c24367-f7ac-4bb4-b239-6cdf4d19afda req-03f6fc24-0c97-4aba-b37c-e2751a0fcde6 service nova] [instance: a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb] Received event network-changed-e2143e91-9f8c-4670-9f92-c2c00827a619 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:21:14 user nova-compute[75165]: DEBUG nova.compute.manager [req-a4c24367-f7ac-4bb4-b239-6cdf4d19afda req-03f6fc24-0c97-4aba-b37c-e2751a0fcde6 service nova] [instance: a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb] Refreshing instance network info cache due to event network-changed-e2143e91-9f8c-4670-9f92-c2c00827a619. {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 00:21:14 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-a4c24367-f7ac-4bb4-b239-6cdf4d19afda req-03f6fc24-0c97-4aba-b37c-e2751a0fcde6 service nova] Acquiring lock "refresh_cache-a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:21:14 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-a4c24367-f7ac-4bb4-b239-6cdf4d19afda req-03f6fc24-0c97-4aba-b37c-e2751a0fcde6 service nova] Acquired lock "refresh_cache-a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:21:14 user nova-compute[75165]: DEBUG nova.network.neutron [req-a4c24367-f7ac-4bb4-b239-6cdf4d19afda req-03f6fc24-0c97-4aba-b37c-e2751a0fcde6 service nova] [instance: a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb] Refreshing network info cache for port e2143e91-9f8c-4670-9f92-c2c00827a619 {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 00:21:14 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-f617f30c-b77c-49e5-9c6d-e991069dfee5 tempest-VolumesActionsTest-964746875 tempest-VolumesActionsTest-964746875-project-member] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:21:14 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-f617f30c-b77c-49e5-9c6d-e991069dfee5 tempest-VolumesActionsTest-964746875 tempest-VolumesActionsTest-964746875-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.551s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:21:14 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91fe894a-90a8-4545-9b27-91771554c4cb/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:21:14 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75165) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 00:21:14 user nova-compute[75165]: INFO nova.scheduler.client.report [None req-f617f30c-b77c-49e5-9c6d-e991069dfee5 tempest-VolumesActionsTest-964746875 tempest-VolumesActionsTest-964746875-project-member] Deleted allocations for instance 8e847329-ad09-450d-854b-468a3b8bdf60
Oct 26 00:21:14 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:21:14 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:21:14 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Hypervisor/Node resource view: name=user free_ram=8264MB free_disk=24.980182647705078GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75165) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 00:21:14 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:21:14 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:21:14 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-f617f30c-b77c-49e5-9c6d-e991069dfee5 tempest-VolumesActionsTest-964746875 tempest-VolumesActionsTest-964746875-project-member] Lock "8e847329-ad09-450d-854b-468a3b8bdf60" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.066s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:21:14 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Applying migration context for instance bad6c21f-885f-4348-86f7-b237ce2d241b as it has an incoming, in-progress migration ce1b14f5-5eda-4c2f-9326-42b5128167e0. Migration status is post-migrating {{(pid=75165) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Oct 26 00:21:14 user nova-compute[75165]: INFO nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: bad6c21f-885f-4348-86f7-b237ce2d241b] Updating resource usage from migration ce1b14f5-5eda-4c2f-9326-42b5128167e0
Oct 26 00:21:14 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 84c6b624-648b-40e2-a37e-ff08609bad84 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:21:14 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance c4e44bfc-6a68-46ce-8335-aaaba5160d3e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:21:14 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance a7eeb145-1565-4812-818b-fefda5f2436d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:21:14 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 27fa1771-fb69-49da-81b3-7f112e623170 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:21:14 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 91fe894a-90a8-4545-9b27-91771554c4cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:21:14 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 97fb67a7-637d-456f-b4dd-0a271ed6cfc4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:21:14 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Migration ce1b14f5-5eda-4c2f-9326-42b5128167e0 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Oct 26 00:21:14 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance bad6c21f-885f-4348-86f7-b237ce2d241b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:21:14 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:21:14 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75165) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 00:21:15 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75165) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 00:21:15 user nova-compute[75165]: DEBUG nova.network.neutron [req-a4c24367-f7ac-4bb4-b239-6cdf4d19afda req-03f6fc24-0c97-4aba-b37c-e2751a0fcde6 service nova] [instance: a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb] Updated VIF entry in instance network info cache for port e2143e91-9f8c-4670-9f92-c2c00827a619. {{(pid=75165) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 00:21:15 user nova-compute[75165]: DEBUG nova.network.neutron [req-a4c24367-f7ac-4bb4-b239-6cdf4d19afda req-03f6fc24-0c97-4aba-b37c-e2751a0fcde6 service nova] [instance: a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb] Updating instance_info_cache with network_info: [{"id": "e2143e91-9f8c-4670-9f92-c2c00827a619", "address": "fa:16:3e:6c:b7:14", "network": {"id": "eb55c0bc-cae5-4ba3-851a-e31a50b52c88", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1081223830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d616862c7c184de5b0ba3121552c5666", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2143e91-9f", "ovs_interfaceid": "e2143e91-9f8c-4670-9f92-c2c00827a619", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:21:15 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-a4c24367-f7ac-4bb4-b239-6cdf4d19afda req-03f6fc24-0c97-4aba-b37c-e2751a0fcde6 service nova] Releasing lock "refresh_cache-a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:21:15 user nova-compute[75165]: DEBUG nova.compute.manager [req-a4c24367-f7ac-4bb4-b239-6cdf4d19afda req-03f6fc24-0c97-4aba-b37c-e2751a0fcde6 service nova] [instance: 8e847329-ad09-450d-854b-468a3b8bdf60] Received event network-vif-deleted-7bc04115-a6b3-4514-b72d-4b73aa5fe793 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:21:15 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:21:15 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:21:15 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Compute_service record updated for user:user {{(pid=75165) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 00:21:15 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.467s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:21:16 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:21:16 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:21:16 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Starting heal instance info cache {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 00:21:16 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Didn't find any instances for network info cache update. {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 26 00:21:16 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:21:16 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:21:16 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:21:17 user nova-compute[75165]: DEBUG os_brick.utils [None req-3e7a0511-7280-40bc-a602-080106a6f56e tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:21:17 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:21:17 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:21:17 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[92baa503-9380-4960-93c6-b2c6d4f2970d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa94814ccb35\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:21:17 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:21:17 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:21:17 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[87b15d1f-274f-4d67-9c36-83c5c8187ffc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:21:17 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:21:17 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:21:17 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3ceac91-e51c-4453-8d1d-6c751b080f80]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:21:17 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf09a0e2-d9bb-4381-847a-cd0f9856671f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:21:17 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-3e7a0511-7280-40bc-a602-080106a6f56e tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Running cmd (subprocess): nvme version {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:21:17 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-3e7a0511-7280-40bc-a602-080106a6f56e tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] 'nvme version' failed. Not Retrying. {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 00:21:17 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3e7a0511-7280-40bc-a602-080106a6f56e tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] nvme not present on system {{(pid=75165) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 00:21:17 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:21:17 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 00:21:17 user nova-compute[75165]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 00:21:17 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ee887e4-3554-4e7c-b296-120a48c63708]: (4, '') {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:21:17 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-3e7a0511-7280-40bc-a602-080106a6f56e tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75165) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 00:21:17 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-3e7a0511-7280-40bc-a602-080106a6f56e tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75165) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 00:21:17 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-3e7a0511-7280-40bc-a602-080106a6f56e tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] LIGHTOS: no hostnqn found. {{(pid=75165) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 00:21:17 user nova-compute[75165]: DEBUG os_brick.utils [None req-3e7a0511-7280-40bc-a602-080106a6f56e tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa94814ccb35', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:21:17 user nova-compute[75165]: DEBUG nova.virt.block_device [None req-3e7a0511-7280-40bc-a602-080106a6f56e tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb] Updating existing volume attachment record: 258fe323-40db-4228-9a4b-535c5dcd9b44 {{(pid=75165) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 00:21:17 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:21:22 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:21:27 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:21:32 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:21:35 user nova-compute[75165]: DEBUG nova.compute.manager [None req-3e7a0511-7280-40bc-a602-080106a6f56e tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb] Start spawning the instance on the hypervisor. {{(pid=75165) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 00:21:35 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-3e7a0511-7280-40bc-a602-080106a6f56e tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb] Creating instance directory {{(pid=75165) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 00:21:35 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-3e7a0511-7280-40bc-a602-080106a6f56e tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb] Creating image(s)
Oct 26 00:21:35 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-3e7a0511-7280-40bc-a602-080106a6f56e tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb] Did not create local disks {{(pid=75165) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 26 00:21:35 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-3e7a0511-7280-40bc-a602-080106a6f56e tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb] Ensure instance console log exists: /opt/stack/data/nova/instances/a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb/console.log {{(pid=75165) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 00:21:35 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-3e7a0511-7280-40bc-a602-080106a6f56e tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:21:35 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-3e7a0511-7280-40bc-a602-080106a6f56e tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:21:35 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-3e7a0511-7280-40bc-a602-080106a6f56e tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:21:35 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-3e7a0511-7280-40bc-a602-080106a6f56e tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb] Start _get_guest_xml network_info=[{"id": "e2143e91-9f8c-4670-9f92-c2c00827a619", "address": "fa:16:3e:6c:b7:14", "network": {"id": "eb55c0bc-cae5-4ba3-851a-e31a50b52c88", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1081223830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d616862c7c184de5b0ba3121552c5666", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2143e91-9f", "ovs_interfaceid": "e2143e91-9f8c-4670-9f92-c2c00827a619", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T00:03:24Z,direct_url=<?>,disk_format='qcow2',id=bff0d8a1-739e-4c4d-9efa-b73ba7b76d01,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e56bbf444fd34c348475c73673611447',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T00:03:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cnlTHGmy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb', 'attached_at': '', 'detached_at': '', 'volume_id': '9da1cf16-26d8-4277-823f-8ec488aa1795', 'serial': '9da1cf16-26d8-4277-823f-8ec488aa1795'}, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'attachment_id': '258fe323-40db-4228-9a4b-535c5dcd9b44', 'delete_on_termination': False, 'volume_type': None} {{(pid=75165) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 00:21:35 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-3e7a0511-7280-40bc-a602-080106a6f56e tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:21:35 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-3e7a0511-7280-40bc-a602-080106a6f56e tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:21:35 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-3e7a0511-7280-40bc-a602-080106a6f56e tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75165) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 00:21:35 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-3e7a0511-7280-40bc-a602-080106a6f56e tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] CPU controller missing on host. {{(pid=75165) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 00:21:35 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-3e7a0511-7280-40bc-a602-080106a6f56e tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75165) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 00:21:35 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-3e7a0511-7280-40bc-a602-080106a6f56e tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] CPU controller found on host. {{(pid=75165) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 00:21:35 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-3e7a0511-7280-40bc-a602-080106a6f56e tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75165) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 00:21:35 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-3e7a0511-7280-40bc-a602-080106a6f56e tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T00:03:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T00:03:24Z,direct_url=<?>,disk_format='qcow2',id=bff0d8a1-739e-4c4d-9efa-b73ba7b76d01,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e56bbf444fd34c348475c73673611447',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T00:03:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 00:21:35 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-3e7a0511-7280-40bc-a602-080106a6f56e tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Flavor limits 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 00:21:35 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-3e7a0511-7280-40bc-a602-080106a6f56e tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Image limits 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 00:21:35 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-3e7a0511-7280-40bc-a602-080106a6f56e tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Flavor pref 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 00:21:35 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-3e7a0511-7280-40bc-a602-080106a6f56e tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Image pref 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 00:21:35 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-3e7a0511-7280-40bc-a602-080106a6f56e tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 00:21:35 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-3e7a0511-7280-40bc-a602-080106a6f56e tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 00:21:35 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-3e7a0511-7280-40bc-a602-080106a6f56e tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75165) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 00:21:35 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-3e7a0511-7280-40bc-a602-080106a6f56e tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Got 1 possible topologies {{(pid=75165) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 00:21:35 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-3e7a0511-7280-40bc-a602-080106a6f56e tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 00:21:35 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-3e7a0511-7280-40bc-a602-080106a6f56e tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 00:21:35 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e7a0511-7280-40bc-a602-080106a6f56e tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb] Calling os-brick to attach iSCSI Volume {{(pid=75165) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 00:21:35 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e7a0511-7280-40bc-a602-080106a6f56e tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8bf8160e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cnlTHGmy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:21:35 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-3e7a0511-7280-40bc-a602-080106a6f56e tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:21:35 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-3e7a0511-7280-40bc-a602-080106a6f56e tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:21:35 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-3e7a0511-7280-40bc-a602-080106a6f56e tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:21:35 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-3e7a0511-7280-40bc-a602-080106a6f56e tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:21:35 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-3e7a0511-7280-40bc-a602-080106a6f56e tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:21:35 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-3e7a0511-7280-40bc-a602-080106a6f56e tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:21:35 user nova-compute[75165]: INFO os_brick.initiator.connectors.iscsi [None req-3e7a0511-7280-40bc-a602-080106a6f56e tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 00:21:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 -p 172.16.0.220:3260 {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:21:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:21:35 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[bca87293-5696-4a93-8cdf-ff206c64d27b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:21:35 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e7a0511-7280-40bc-a602-080106a6f56e tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 00:21:35 user nova-compute[75165]:  {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:21:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 -p 172.16.0.220:3260 --interface default --op new {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:21:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:21:35 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[47e01222-47bd-4255-a4a1-52a03e0dfe1e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795] added\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:21:35 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e7a0511-7280-40bc-a602-080106a6f56e tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795] added
Oct 26 00:21:35 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:21:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:21:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:21:35 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[6da1453d-a0ed-4b7f-83a7-acd19bb46f55]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:21:35 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e7a0511-7280-40bc-a602-080106a6f56e tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:21:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:21:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:21:35 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e1bde94-b33a-42db-a269-bdb2c6acbd55]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:21:35 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e7a0511-7280-40bc-a602-080106a6f56e tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:21:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cnlTHGmy {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:21:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cnlTHGmy" returned: 0 in 0.019s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:21:35 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea1b63fc-3f7b-45cc-826c-f4c6102d31a2]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:21:35 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e7a0511-7280-40bc-a602-080106a6f56e tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cnlTHGmy'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:21:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:21:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:21:35 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[51e8c9ff-98b0-4e5b-ab60-5d412e302dd1]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:21:35 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e7a0511-7280-40bc-a602-080106a6f56e tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:21:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:21:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:21:35 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[efcb2951-39e4-47fa-b519-8bc85536c370]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f06e40e7-3ca1-4a25-bd11-ff01280c6df2 (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:21:35 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e7a0511-7280-40bc-a602-080106a6f56e tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f06e40e7-3ca1-4a25-bd11-ff01280c6df2 (non-flash)
Oct 26 00:21:35 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:21:35 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e7a0511-7280-40bc-a602-080106a6f56e tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f06e40e7-3ca1-4a25-bd11-ff01280c6df2 (non-flash)
Oct 26 00:21:35 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:21:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 -p 172.16.0.220:3260 --login {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:21:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:21:35 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f87d315-734e-4f64-8ce9-db68c8ec7dd4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:21:35 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e7a0511-7280-40bc-a602-080106a6f56e tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795, portal: 172.16.0.220,3260]
Oct 26 00:21:35 user nova-compute[75165]: Login to [iface: default, target: iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795, portal: 172.16.0.220,3260] successful.
Oct 26 00:21:35 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:21:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:21:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:21:35 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[96cbd863-e5d4-4424-bc7b-1826a6bc639c]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:21:35 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e7a0511-7280-40bc-a602-080106a6f56e tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:21:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:21:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:21:35 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[54c858e7-3729-4f30-af28-07dc1233a250]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f06e40e7-3ca1-4a25-bd11-ff01280c6df2 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:21:35 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e7a0511-7280-40bc-a602-080106a6f56e tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f06e40e7-3ca1-4a25-bd11-ff01280c6df2 (non-flash)
Oct 26 00:21:35 user nova-compute[75165]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)
Oct 26 00:21:35 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:21:35 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e7a0511-7280-40bc-a602-080106a6f56e tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f06e40e7-3ca1-4a25-bd11-ff01280c6df2 (non-flash)
Oct 26 00:21:35 user nova-compute[75165]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)
Oct 26 00:21:35 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:21:35 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-3e7a0511-7280-40bc-a602-080106a6f56e tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.267s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:21:35 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e7a0511-7280-40bc-a602-080106a6f56e tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Connected to 172.16.0.220:3260 {{(pid=75165) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 00:21:35 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-3e7a0511-7280-40bc-a602-080106a6f56e tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] HCTL ('33', '-', '-', 0) found on session 26 with lun 0 {{(pid=75165) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 00:21:35 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-3e7a0511-7280-40bc-a602-080106a6f56e tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75165) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 00:21:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:21:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:21:35 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3b1a011-88ef-4c86-a2e1-ee48f5f0efdf]: (4, ('- - 0', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:21:35 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-3e7a0511-7280-40bc-a602-080106a6f56e tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Searching for a device in session 26 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75165) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 00:21:35 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e7a0511-7280-40bc-a602-080106a6f56e tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cnlTHGmy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75165) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 00:21:36 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-3e7a0511-7280-40bc-a602-080106a6f56e tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.299s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:21:36 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e7a0511-7280-40bc-a602-080106a6f56e tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] <== connect_volume: return (1300ms) {'type': 'block', 'scsi_wwn': '23636623037646265', 'path': '/dev/sdb'} {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:21:36 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e7a0511-7280-40bc-a602-080106a6f56e tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23636623037646265', 'path': '/dev/sdb'} {{(pid=75165) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 00:21:36 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-3e7a0511-7280-40bc-a602-080106a6f56e tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:21:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1103241586',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1103241586',id=28,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d616862c7c184de5b0ba3121552c5666',ramdisk_id='',reservation_id='r-ely1lsv4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-638746030',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T00:21:11Z,user_data=None,user_id='dbe0d52293264f33ae86de41dabeefcf',uuid=a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e2143e91-9f8c-4670-9f92-c2c00827a619", "address": "fa:16:3e:6c:b7:14", "network": {"id": "eb55c0bc-cae5-4ba3-851a-e31a50b52c88", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1081223830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d616862c7c184de5b0ba3121552c5666", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2143e91-9f", "ovs_interfaceid": "e2143e91-9f8c-4670-9f92-c2c00827a619", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75165) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 00:21:36 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-3e7a0511-7280-40bc-a602-080106a6f56e tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Converting VIF {"id": "e2143e91-9f8c-4670-9f92-c2c00827a619", "address": "fa:16:3e:6c:b7:14", "network": {"id": "eb55c0bc-cae5-4ba3-851a-e31a50b52c88", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1081223830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d616862c7c184de5b0ba3121552c5666", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2143e91-9f", "ovs_interfaceid": "e2143e91-9f8c-4670-9f92-c2c00827a619", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:21:36 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-3e7a0511-7280-40bc-a602-080106a6f56e tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:b7:14,bridge_name='br-int',has_traffic_filtering=True,id=e2143e91-9f8c-4670-9f92-c2c00827a619,network=Network(eb55c0bc-cae5-4ba3-851a-e31a50b52c88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2143e91-9f') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:21:36 user nova-compute[75165]: DEBUG nova.objects.instance [None req-3e7a0511-7280-40bc-a602-080106a6f56e tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Lazy-loading 'pci_devices' on Instance uuid a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:21:36 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-3e7a0511-7280-40bc-a602-080106a6f56e tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb] End _get_guest_xml xml=<domain type="kvm">
Oct 26 00:21:36 user nova-compute[75165]:   <uuid>a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb</uuid>
Oct 26 00:21:36 user nova-compute[75165]:   <name>instance-0000001c</name>
Oct 26 00:21:36 user nova-compute[75165]:   <memory>524288</memory>
Oct 26 00:21:36 user nova-compute[75165]:   <vcpu>1</vcpu>
Oct 26 00:21:36 user nova-compute[75165]:   <metadata>
Oct 26 00:21:36 user nova-compute[75165]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 00:21:36 user nova-compute[75165]:       <nova:package version="0.0.0"/>
Oct 26 00:21:36 user nova-compute[75165]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1103241586</nova:name>
Oct 26 00:21:36 user nova-compute[75165]:       <nova:creationTime>2023-10-26 00:21:35</nova:creationTime>
Oct 26 00:21:36 user nova-compute[75165]:       <nova:flavor name="m1.tiny">
Oct 26 00:21:36 user nova-compute[75165]:         <nova:memory>512</nova:memory>
Oct 26 00:21:36 user nova-compute[75165]:         <nova:disk>1</nova:disk>
Oct 26 00:21:36 user nova-compute[75165]:         <nova:swap>0</nova:swap>
Oct 26 00:21:36 user nova-compute[75165]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 00:21:36 user nova-compute[75165]:         <nova:vcpus>1</nova:vcpus>
Oct 26 00:21:36 user nova-compute[75165]:       </nova:flavor>
Oct 26 00:21:36 user nova-compute[75165]:       <nova:owner>
Oct 26 00:21:36 user nova-compute[75165]:         <nova:user uuid="dbe0d52293264f33ae86de41dabeefcf">tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member</nova:user>
Oct 26 00:21:36 user nova-compute[75165]:         <nova:project uuid="d616862c7c184de5b0ba3121552c5666">tempest-ServerBootFromVolumeStableRescueTest-638746030</nova:project>
Oct 26 00:21:36 user nova-compute[75165]:       </nova:owner>
Oct 26 00:21:36 user nova-compute[75165]:       <nova:root type="image" uuid="bff0d8a1-739e-4c4d-9efa-b73ba7b76d01"/>
Oct 26 00:21:36 user nova-compute[75165]:       <nova:ports>
Oct 26 00:21:36 user nova-compute[75165]:         <nova:port uuid="e2143e91-9f8c-4670-9f92-c2c00827a619">
Oct 26 00:21:36 user nova-compute[75165]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 26 00:21:36 user nova-compute[75165]:         </nova:port>
Oct 26 00:21:36 user nova-compute[75165]:       </nova:ports>
Oct 26 00:21:36 user nova-compute[75165]:     </nova:instance>
Oct 26 00:21:36 user nova-compute[75165]:   </metadata>
Oct 26 00:21:36 user nova-compute[75165]:   <sysinfo type="smbios">
Oct 26 00:21:36 user nova-compute[75165]:     <system>
Oct 26 00:21:36 user nova-compute[75165]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 00:21:36 user nova-compute[75165]:       <entry name="product">OpenStack Nova</entry>
Oct 26 00:21:36 user nova-compute[75165]:       <entry name="version">0.0.0</entry>
Oct 26 00:21:36 user nova-compute[75165]:       <entry name="serial">a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb</entry>
Oct 26 00:21:36 user nova-compute[75165]:       <entry name="uuid">a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb</entry>
Oct 26 00:21:36 user nova-compute[75165]:       <entry name="family">Virtual Machine</entry>
Oct 26 00:21:36 user nova-compute[75165]:     </system>
Oct 26 00:21:36 user nova-compute[75165]:   </sysinfo>
Oct 26 00:21:36 user nova-compute[75165]:   <os>
Oct 26 00:21:36 user nova-compute[75165]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 00:21:36 user nova-compute[75165]:     <boot dev="hd"/>
Oct 26 00:21:36 user nova-compute[75165]:     <smbios mode="sysinfo"/>
Oct 26 00:21:36 user nova-compute[75165]:   </os>
Oct 26 00:21:36 user nova-compute[75165]:   <features>
Oct 26 00:21:36 user nova-compute[75165]:     <acpi/>
Oct 26 00:21:36 user nova-compute[75165]:     <apic/>
Oct 26 00:21:36 user nova-compute[75165]:     <vmcoreinfo/>
Oct 26 00:21:36 user nova-compute[75165]:   </features>
Oct 26 00:21:36 user nova-compute[75165]:   <clock offset="utc">
Oct 26 00:21:36 user nova-compute[75165]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 00:21:36 user nova-compute[75165]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 00:21:36 user nova-compute[75165]:     <timer name="hpet" present="no"/>
Oct 26 00:21:36 user nova-compute[75165]:   </clock>
Oct 26 00:21:36 user nova-compute[75165]:   <cpu mode="custom" match="exact">
Oct 26 00:21:36 user nova-compute[75165]:     <model>Nehalem</model>
Oct 26 00:21:36 user nova-compute[75165]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 00:21:36 user nova-compute[75165]:   </cpu>
Oct 26 00:21:36 user nova-compute[75165]:   <devices>
Oct 26 00:21:36 user nova-compute[75165]:     <disk type="block" device="disk">
Oct 26 00:21:36 user nova-compute[75165]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 00:21:36 user nova-compute[75165]:       <source dev="/dev/sdb"/>
Oct 26 00:21:36 user nova-compute[75165]:       <target dev="vda" bus="virtio"/>
Oct 26 00:21:36 user nova-compute[75165]:       <serial>9da1cf16-26d8-4277-823f-8ec488aa1795</serial>
Oct 26 00:21:36 user nova-compute[75165]:     </disk>
Oct 26 00:21:36 user nova-compute[75165]:     <interface type="ethernet">
Oct 26 00:21:36 user nova-compute[75165]:       <mac address="fa:16:3e:6c:b7:14"/>
Oct 26 00:21:36 user nova-compute[75165]:       <model type="virtio"/>
Oct 26 00:21:36 user nova-compute[75165]:       <mtu size="1442"/>
Oct 26 00:21:36 user nova-compute[75165]:       <target dev="tape2143e91-9f"/>
Oct 26 00:21:36 user nova-compute[75165]:     </interface>
Oct 26 00:21:36 user nova-compute[75165]:     <serial type="pty">
Oct 26 00:21:36 user nova-compute[75165]:       <log file="/opt/stack/data/nova/instances/a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb/console.log" append="off"/>
Oct 26 00:21:36 user nova-compute[75165]:     </serial>
Oct 26 00:21:36 user nova-compute[75165]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 00:21:36 user nova-compute[75165]:     <video>
Oct 26 00:21:36 user nova-compute[75165]:       <model type="virtio"/>
Oct 26 00:21:36 user nova-compute[75165]:     </video>
Oct 26 00:21:36 user nova-compute[75165]:     <rng model="virtio">
Oct 26 00:21:36 user nova-compute[75165]:       <backend model="random">/dev/urandom</backend>
Oct 26 00:21:36 user nova-compute[75165]:     </rng>
Oct 26 00:21:36 user nova-compute[75165]:     <controller type="usb" index="0" model="none"/>
Oct 26 00:21:36 user nova-compute[75165]:     <memballoon model="virtio">
Oct 26 00:21:36 user nova-compute[75165]:       <stats period="10"/>
Oct 26 00:21:36 user nova-compute[75165]:     </memballoon>
Oct 26 00:21:36 user nova-compute[75165]:   </devices>
Oct 26 00:21:36 user nova-compute[75165]: </domain>
Oct 26 00:21:36 user nova-compute[75165]:  {{(pid=75165) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 00:21:36 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-3e7a0511-7280-40bc-a602-080106a6f56e tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:21:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1103241586',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1103241586',id=28,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d616862c7c184de5b0ba3121552c5666',ramdisk_id='',reservation_id='r-ely1lsv4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-638746030',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T00:21:11Z,user_data=None,user_id='dbe0d52293264f33ae86de41dabeefcf',uuid=a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e2143e91-9f8c-4670-9f92-c2c00827a619", "address": "fa:16:3e:6c:b7:14", "network": {"id": "eb55c0bc-cae5-4ba3-851a-e31a50b52c88", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1081223830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d616862c7c184de5b0ba3121552c5666", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2143e91-9f", "ovs_interfaceid": "e2143e91-9f8c-4670-9f92-c2c00827a619", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 00:21:36 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-3e7a0511-7280-40bc-a602-080106a6f56e tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Converting VIF {"id": "e2143e91-9f8c-4670-9f92-c2c00827a619", "address": "fa:16:3e:6c:b7:14", "network": {"id": "eb55c0bc-cae5-4ba3-851a-e31a50b52c88", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1081223830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d616862c7c184de5b0ba3121552c5666", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2143e91-9f", "ovs_interfaceid": "e2143e91-9f8c-4670-9f92-c2c00827a619", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:21:36 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-3e7a0511-7280-40bc-a602-080106a6f56e tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:b7:14,bridge_name='br-int',has_traffic_filtering=True,id=e2143e91-9f8c-4670-9f92-c2c00827a619,network=Network(eb55c0bc-cae5-4ba3-851a-e31a50b52c88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2143e91-9f') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:21:36 user nova-compute[75165]: DEBUG os_vif [None req-3e7a0511-7280-40bc-a602-080106a6f56e tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:b7:14,bridge_name='br-int',has_traffic_filtering=True,id=e2143e91-9f8c-4670-9f92-c2c00827a619,network=Network(eb55c0bc-cae5-4ba3-851a-e31a50b52c88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2143e91-9f') {{(pid=75165) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 00:21:36 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:21:36 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:21:36 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 00:21:36 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:21:36 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ef775e06-1c85-5034-ba5f-54722b94d6bb', '_type': 'linux-noop'}}, row=False) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:21:36 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:21:36 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:21:36 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:21:36 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:21:36 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape2143e91-9f, may_exist=True, interface_attrs={}) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:21:36 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape2143e91-9f, col_values=(('qos', UUID('c9aaf77f-728a-4864-8168-05bd438c1207')),), if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:21:36 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape2143e91-9f, col_values=(('external_ids', {'iface-id': 'e2143e91-9f8c-4670-9f92-c2c00827a619', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6c:b7:14', 'vm-uuid': 'a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb'}),), if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:21:36 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:21:36 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:21:36 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:21:36 user nova-compute[75165]: INFO os_vif [None req-3e7a0511-7280-40bc-a602-080106a6f56e tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:b7:14,bridge_name='br-int',has_traffic_filtering=True,id=e2143e91-9f8c-4670-9f92-c2c00827a619,network=Network(eb55c0bc-cae5-4ba3-851a-e31a50b52c88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2143e91-9f')
Oct 26 00:21:36 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-3e7a0511-7280-40bc-a602-080106a6f56e tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] No BDM found with device name vda, not building metadata. {{(pid=75165) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 00:21:36 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-3e7a0511-7280-40bc-a602-080106a6f56e tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] No VIF found with MAC fa:16:3e:6c:b7:14, not building metadata {{(pid=75165) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 00:21:37 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:21:37 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:21:38 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:21:38 user nova-compute[75165]: DEBUG nova.compute.manager [req-95c55c6c-2cb7-4e14-bd37-06d6b93ce204 req-08de8e51-be05-4560-a6ad-de8d4f6fef7c service nova] [instance: a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb] Received event network-vif-plugged-e2143e91-9f8c-4670-9f92-c2c00827a619 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:21:38 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-95c55c6c-2cb7-4e14-bd37-06d6b93ce204 req-08de8e51-be05-4560-a6ad-de8d4f6fef7c service nova] Acquiring lock "a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:21:38 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-95c55c6c-2cb7-4e14-bd37-06d6b93ce204 req-08de8e51-be05-4560-a6ad-de8d4f6fef7c service nova] Lock "a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:21:38 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-95c55c6c-2cb7-4e14-bd37-06d6b93ce204 req-08de8e51-be05-4560-a6ad-de8d4f6fef7c service nova] Lock "a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:21:38 user nova-compute[75165]: DEBUG nova.compute.manager [req-95c55c6c-2cb7-4e14-bd37-06d6b93ce204 req-08de8e51-be05-4560-a6ad-de8d4f6fef7c service nova] [instance: a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb] No waiting events found dispatching network-vif-plugged-e2143e91-9f8c-4670-9f92-c2c00827a619 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:21:38 user nova-compute[75165]: WARNING nova.compute.manager [req-95c55c6c-2cb7-4e14-bd37-06d6b93ce204 req-08de8e51-be05-4560-a6ad-de8d4f6fef7c service nova] [instance: a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb] Received unexpected event network-vif-plugged-e2143e91-9f8c-4670-9f92-c2c00827a619 for instance with vm_state building and task_state spawning.
Oct 26 00:21:38 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:21:40 user nova-compute[75165]: DEBUG nova.compute.manager [None req-3e7a0511-7280-40bc-a602-080106a6f56e tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb] Instance event wait completed in 0 seconds for  {{(pid=75165) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 00:21:40 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-3e7a0511-7280-40bc-a602-080106a6f56e tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb] Guest created on hypervisor {{(pid=75165) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 00:21:40 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb] Instance spawned successfully.
Oct 26 00:21:40 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-3e7a0511-7280-40bc-a602-080106a6f56e tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 00:21:40 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-3e7a0511-7280-40bc-a602-080106a6f56e tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb] Found default for hw_cdrom_bus of ide {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:21:40 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-3e7a0511-7280-40bc-a602-080106a6f56e tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb] Found default for hw_disk_bus of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:21:40 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-3e7a0511-7280-40bc-a602-080106a6f56e tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb] Found default for hw_input_bus of None {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:21:40 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-3e7a0511-7280-40bc-a602-080106a6f56e tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb] Found default for hw_pointer_model of None {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:21:40 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-3e7a0511-7280-40bc-a602-080106a6f56e tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb] Found default for hw_video_model of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:21:40 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-3e7a0511-7280-40bc-a602-080106a6f56e tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb] Found default for hw_vif_model of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:21:40 user nova-compute[75165]: INFO nova.compute.manager [None req-3e7a0511-7280-40bc-a602-080106a6f56e tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb] Took 5.11 seconds to spawn the instance on the hypervisor.
Oct 26 00:21:40 user nova-compute[75165]: DEBUG nova.compute.manager [None req-3e7a0511-7280-40bc-a602-080106a6f56e tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb] Checking state {{(pid=75165) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 00:21:40 user nova-compute[75165]: DEBUG nova.compute.manager [req-49e1ca96-83a2-404d-8f0c-79f6cd86562e req-2a016252-c935-4cc0-bcf3-a7382a41a147 service nova] [instance: a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb] Received event network-vif-plugged-e2143e91-9f8c-4670-9f92-c2c00827a619 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:21:40 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-49e1ca96-83a2-404d-8f0c-79f6cd86562e req-2a016252-c935-4cc0-bcf3-a7382a41a147 service nova] Acquiring lock "a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:21:40 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-49e1ca96-83a2-404d-8f0c-79f6cd86562e req-2a016252-c935-4cc0-bcf3-a7382a41a147 service nova] Lock "a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:21:40 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-49e1ca96-83a2-404d-8f0c-79f6cd86562e req-2a016252-c935-4cc0-bcf3-a7382a41a147 service nova] Lock "a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:21:40 user nova-compute[75165]: DEBUG nova.compute.manager [req-49e1ca96-83a2-404d-8f0c-79f6cd86562e req-2a016252-c935-4cc0-bcf3-a7382a41a147 service nova] [instance: a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb] No waiting events found dispatching network-vif-plugged-e2143e91-9f8c-4670-9f92-c2c00827a619 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:21:40 user nova-compute[75165]: WARNING nova.compute.manager [req-49e1ca96-83a2-404d-8f0c-79f6cd86562e req-2a016252-c935-4cc0-bcf3-a7382a41a147 service nova] [instance: a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb] Received unexpected event network-vif-plugged-e2143e91-9f8c-4670-9f92-c2c00827a619 for instance with vm_state building and task_state spawning.
Oct 26 00:21:40 user nova-compute[75165]: INFO nova.compute.manager [None req-3e7a0511-7280-40bc-a602-080106a6f56e tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb] Took 29.60 seconds to build instance.
Oct 26 00:21:40 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-3e7a0511-7280-40bc-a602-080106a6f56e tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Lock "a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 29.710s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:21:41 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:21:41 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:21:46 user nova-compute[75165]: DEBUG nova.compute.manager [req-e9d93760-1773-4f78-abdc-ce4bd4313923 req-592a95b2-f8e1-40fe-942a-4c8df187b545 service nova] [instance: 91fe894a-90a8-4545-9b27-91771554c4cb] Received event network-changed-67590aab-15ed-4684-abd7-64a5c0a9b3f5 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:21:46 user nova-compute[75165]: DEBUG nova.compute.manager [req-e9d93760-1773-4f78-abdc-ce4bd4313923 req-592a95b2-f8e1-40fe-942a-4c8df187b545 service nova] [instance: 91fe894a-90a8-4545-9b27-91771554c4cb] Refreshing instance network info cache due to event network-changed-67590aab-15ed-4684-abd7-64a5c0a9b3f5. {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 00:21:46 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-e9d93760-1773-4f78-abdc-ce4bd4313923 req-592a95b2-f8e1-40fe-942a-4c8df187b545 service nova] Acquiring lock "refresh_cache-91fe894a-90a8-4545-9b27-91771554c4cb" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:21:46 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-e9d93760-1773-4f78-abdc-ce4bd4313923 req-592a95b2-f8e1-40fe-942a-4c8df187b545 service nova] Acquired lock "refresh_cache-91fe894a-90a8-4545-9b27-91771554c4cb" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:21:46 user nova-compute[75165]: DEBUG nova.network.neutron [req-e9d93760-1773-4f78-abdc-ce4bd4313923 req-592a95b2-f8e1-40fe-942a-4c8df187b545 service nova] [instance: 91fe894a-90a8-4545-9b27-91771554c4cb] Refreshing network info cache for port 67590aab-15ed-4684-abd7-64a5c0a9b3f5 {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 00:21:46 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:21:46 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-8fe81392-6b1e-4c58-8465-728b8ff27078 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Acquiring lock "91fe894a-90a8-4545-9b27-91771554c4cb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:21:46 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-8fe81392-6b1e-4c58-8465-728b8ff27078 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Lock "91fe894a-90a8-4545-9b27-91771554c4cb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:21:46 user nova-compute[75165]: INFO nova.compute.manager [None req-8fe81392-6b1e-4c58-8465-728b8ff27078 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: 91fe894a-90a8-4545-9b27-91771554c4cb] Detaching volume f06e40e7-3ca1-4a25-bd11-ff01280c6df2
Oct 26 00:21:46 user nova-compute[75165]: DEBUG nova.network.neutron [req-e9d93760-1773-4f78-abdc-ce4bd4313923 req-592a95b2-f8e1-40fe-942a-4c8df187b545 service nova] [instance: 91fe894a-90a8-4545-9b27-91771554c4cb] Updated VIF entry in instance network info cache for port 67590aab-15ed-4684-abd7-64a5c0a9b3f5. {{(pid=75165) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 00:21:46 user nova-compute[75165]: DEBUG nova.network.neutron [req-e9d93760-1773-4f78-abdc-ce4bd4313923 req-592a95b2-f8e1-40fe-942a-4c8df187b545 service nova] [instance: 91fe894a-90a8-4545-9b27-91771554c4cb] Updating instance_info_cache with network_info: [{"id": "67590aab-15ed-4684-abd7-64a5c0a9b3f5", "address": "fa:16:3e:7a:ea:a8", "network": {"id": "b31bac4b-1951-4ca3-8682-f1f24de0a5c3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1323234642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71aa69c0ea2d49e184e1e055ff3efa1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67590aab-15", "ovs_interfaceid": "67590aab-15ed-4684-abd7-64a5c0a9b3f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:21:46 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-e9d93760-1773-4f78-abdc-ce4bd4313923 req-592a95b2-f8e1-40fe-942a-4c8df187b545 service nova] Releasing lock "refresh_cache-91fe894a-90a8-4545-9b27-91771554c4cb" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:21:46 user nova-compute[75165]: INFO nova.virt.block_device [None req-8fe81392-6b1e-4c58-8465-728b8ff27078 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: 91fe894a-90a8-4545-9b27-91771554c4cb] Attempting to driver detach volume f06e40e7-3ca1-4a25-bd11-ff01280c6df2 from mountpoint /dev/vdb
Oct 26 00:21:46 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-8fe81392-6b1e-4c58-8465-728b8ff27078 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Attempting to detach device vdb from instance 91fe894a-90a8-4545-9b27-91771554c4cb from the persistent domain config. {{(pid=75165) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 00:21:46 user nova-compute[75165]: DEBUG nova.virt.libvirt.guest [None req-8fe81392-6b1e-4c58-8465-728b8ff27078 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 00:21:46 user nova-compute[75165]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 00:21:46 user nova-compute[75165]:   <source dev="/dev/sdc"/>
Oct 26 00:21:46 user nova-compute[75165]:   <target dev="vdb" bus="virtio"/>
Oct 26 00:21:46 user nova-compute[75165]:   <serial>f06e40e7-3ca1-4a25-bd11-ff01280c6df2</serial>
Oct 26 00:21:46 user nova-compute[75165]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 00:21:46 user nova-compute[75165]: </disk>
Oct 26 00:21:46 user nova-compute[75165]:  {{(pid=75165) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 00:21:46 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-8fe81392-6b1e-4c58-8465-728b8ff27078 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Successfully detached device vdb from instance 91fe894a-90a8-4545-9b27-91771554c4cb from the persistent domain config.
Oct 26 00:21:46 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-8fe81392-6b1e-4c58-8465-728b8ff27078 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 91fe894a-90a8-4545-9b27-91771554c4cb from the live domain config. {{(pid=75165) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 00:21:46 user nova-compute[75165]: DEBUG nova.virt.libvirt.guest [None req-8fe81392-6b1e-4c58-8465-728b8ff27078 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 00:21:46 user nova-compute[75165]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 00:21:46 user nova-compute[75165]:   <source dev="/dev/sdc"/>
Oct 26 00:21:46 user nova-compute[75165]:   <target dev="vdb" bus="virtio"/>
Oct 26 00:21:46 user nova-compute[75165]:   <serial>f06e40e7-3ca1-4a25-bd11-ff01280c6df2</serial>
Oct 26 00:21:46 user nova-compute[75165]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 00:21:46 user nova-compute[75165]: </disk>
Oct 26 00:21:46 user nova-compute[75165]:  {{(pid=75165) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 00:21:47 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-8fe81392-6b1e-4c58-8465-728b8ff27078 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 91fe894a-90a8-4545-9b27-91771554c4cb {{(pid=75165) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 00:21:48 user nova-compute[75165]: DEBUG nova.compute.manager [req-e890df22-68f1-4802-9f80-103c69f4806d req-9ce89758-985f-4013-a2db-92c1a49828d4 service nova] [instance: 91fe894a-90a8-4545-9b27-91771554c4cb] Received event network-changed-67590aab-15ed-4684-abd7-64a5c0a9b3f5 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:21:48 user nova-compute[75165]: DEBUG nova.compute.manager [req-e890df22-68f1-4802-9f80-103c69f4806d req-9ce89758-985f-4013-a2db-92c1a49828d4 service nova] [instance: 91fe894a-90a8-4545-9b27-91771554c4cb] Refreshing instance network info cache due to event network-changed-67590aab-15ed-4684-abd7-64a5c0a9b3f5. {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 00:21:48 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-e890df22-68f1-4802-9f80-103c69f4806d req-9ce89758-985f-4013-a2db-92c1a49828d4 service nova] Acquiring lock "refresh_cache-91fe894a-90a8-4545-9b27-91771554c4cb" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:21:48 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-e890df22-68f1-4802-9f80-103c69f4806d req-9ce89758-985f-4013-a2db-92c1a49828d4 service nova] Acquired lock "refresh_cache-91fe894a-90a8-4545-9b27-91771554c4cb" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:21:48 user nova-compute[75165]: DEBUG nova.network.neutron [req-e890df22-68f1-4802-9f80-103c69f4806d req-9ce89758-985f-4013-a2db-92c1a49828d4 service nova] [instance: 91fe894a-90a8-4545-9b27-91771554c4cb] Refreshing network info cache for port 67590aab-15ed-4684-abd7-64a5c0a9b3f5 {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 00:21:48 user nova-compute[75165]: DEBUG nova.network.neutron [req-e890df22-68f1-4802-9f80-103c69f4806d req-9ce89758-985f-4013-a2db-92c1a49828d4 service nova] [instance: 91fe894a-90a8-4545-9b27-91771554c4cb] Updated VIF entry in instance network info cache for port 67590aab-15ed-4684-abd7-64a5c0a9b3f5. {{(pid=75165) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 00:21:48 user nova-compute[75165]: DEBUG nova.network.neutron [req-e890df22-68f1-4802-9f80-103c69f4806d req-9ce89758-985f-4013-a2db-92c1a49828d4 service nova] [instance: 91fe894a-90a8-4545-9b27-91771554c4cb] Updating instance_info_cache with network_info: [{"id": "67590aab-15ed-4684-abd7-64a5c0a9b3f5", "address": "fa:16:3e:7a:ea:a8", "network": {"id": "b31bac4b-1951-4ca3-8682-f1f24de0a5c3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1323234642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71aa69c0ea2d49e184e1e055ff3efa1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67590aab-15", "ovs_interfaceid": "67590aab-15ed-4684-abd7-64a5c0a9b3f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:21:48 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-e890df22-68f1-4802-9f80-103c69f4806d req-9ce89758-985f-4013-a2db-92c1a49828d4 service nova] Releasing lock "refresh_cache-91fe894a-90a8-4545-9b27-91771554c4cb" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:21:51 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:21:51 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:21:51 user nova-compute[75165]: DEBUG nova.objects.instance [None req-d4530d31-5bac-40d1-a08d-22ec2f429dda tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Lazy-loading 'flavor' on Instance uuid 27fa1771-fb69-49da-81b3-7f112e623170 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:21:51 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-d4530d31-5bac-40d1-a08d-22ec2f429dda tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Acquiring lock "refresh_cache-27fa1771-fb69-49da-81b3-7f112e623170" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:21:51 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-d4530d31-5bac-40d1-a08d-22ec2f429dda tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Acquired lock "refresh_cache-27fa1771-fb69-49da-81b3-7f112e623170" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:21:51 user nova-compute[75165]: DEBUG nova.network.neutron [None req-d4530d31-5bac-40d1-a08d-22ec2f429dda tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] [instance: 27fa1771-fb69-49da-81b3-7f112e623170] Building network info cache for instance {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 00:21:51 user nova-compute[75165]: DEBUG nova.objects.instance [None req-d4530d31-5bac-40d1-a08d-22ec2f429dda tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Lazy-loading 'info_cache' on Instance uuid 27fa1771-fb69-49da-81b3-7f112e623170 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:21:51 user nova-compute[75165]: DEBUG nova.objects.base [None req-d4530d31-5bac-40d1-a08d-22ec2f429dda tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Object Instance<27fa1771-fb69-49da-81b3-7f112e623170> lazy-loaded attributes: flavor,info_cache {{(pid=75165) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 00:21:52 user nova-compute[75165]: DEBUG nova.network.neutron [None req-d4530d31-5bac-40d1-a08d-22ec2f429dda tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] [instance: 27fa1771-fb69-49da-81b3-7f112e623170] Updating instance_info_cache with network_info: [{"id": "4d97651b-5d7c-4778-85a4-a11588892b31", "address": "fa:16:3e:c5:bb:76", "network": {"id": "7e330392-6256-405b-ab37-0b8af0c4fd48", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-430326049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ffbf5c944914cafac7aba65fb7ca402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d97651b-5d", "ovs_interfaceid": "4d97651b-5d7c-4778-85a4-a11588892b31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:21:52 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-d4530d31-5bac-40d1-a08d-22ec2f429dda tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Releasing lock "refresh_cache-27fa1771-fb69-49da-81b3-7f112e623170" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:21:52 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: 27fa1771-fb69-49da-81b3-7f112e623170] Instance destroyed successfully.
Oct 26 00:21:52 user nova-compute[75165]: DEBUG nova.objects.instance [None req-d4530d31-5bac-40d1-a08d-22ec2f429dda tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Lazy-loading 'resources' on Instance uuid 27fa1771-fb69-49da-81b3-7f112e623170 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:21:52 user nova-compute[75165]: DEBUG nova.objects.base [None req-d4530d31-5bac-40d1-a08d-22ec2f429dda tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Object Instance<27fa1771-fb69-49da-81b3-7f112e623170> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75165) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 00:21:52 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-d4530d31-5bac-40d1-a08d-22ec2f429dda tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:13:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1390737120',display_name='tempest-AttachVolumeTestJSON-server-1390737120',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1390737120',id=20,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEolsf1MVpCHotOftiJQ4Zgsnx29J3YYZZ32cA7FaSf4r6DElmgaLg7eBXc3I/pwZzl9KTJMnY6YgVOXkfwz2nESGnC4fUVVLf94BqH2qQSBNdKz1HLQzjXno+XfnON8kw==',key_name='tempest-keypair-763586997',keypairs=<?>,launch_index=0,launched_at=2023-10-26T00:13:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='3ffbf5c944914cafac7aba65fb7ca402',ramdisk_id='',reservation_id='r-ox40rq7n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2130746724',owner_user_name='tempest-AttachVolumeTestJSON-2130746724-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T00:20:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='841b5be7c0b348de979920fc9ae223ed',uuid=27fa1771-fb69-49da-81b3-7f112e623170,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "4d97651b-5d7c-4778-85a4-a11588892b31", "address": "fa:16:3e:c5:bb:76", "network": {"id": "7e330392-6256-405b-ab37-0b8af0c4fd48", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-430326049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ffbf5c944914cafac7aba65fb7ca402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d97651b-5d", "ovs_interfaceid": "4d97651b-5d7c-4778-85a4-a11588892b31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 00:21:52 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-d4530d31-5bac-40d1-a08d-22ec2f429dda tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Converting VIF {"id": "4d97651b-5d7c-4778-85a4-a11588892b31", "address": "fa:16:3e:c5:bb:76", "network": {"id": "7e330392-6256-405b-ab37-0b8af0c4fd48", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-430326049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ffbf5c944914cafac7aba65fb7ca402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d97651b-5d", "ovs_interfaceid": "4d97651b-5d7c-4778-85a4-a11588892b31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:21:52 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-d4530d31-5bac-40d1-a08d-22ec2f429dda tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:bb:76,bridge_name='br-int',has_traffic_filtering=True,id=4d97651b-5d7c-4778-85a4-a11588892b31,network=Network(7e330392-6256-405b-ab37-0b8af0c4fd48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d97651b-5d') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:21:52 user nova-compute[75165]: DEBUG os_vif [None req-d4530d31-5bac-40d1-a08d-22ec2f429dda tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:bb:76,bridge_name='br-int',has_traffic_filtering=True,id=4d97651b-5d7c-4778-85a4-a11588892b31,network=Network(7e330392-6256-405b-ab37-0b8af0c4fd48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d97651b-5d') {{(pid=75165) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 00:21:52 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:21:52 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4d97651b-5d, bridge=br-int, if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:21:52 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:21:52 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:21:52 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:21:52 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2aeb1c18-0809-46cc-92a1-5e41491f628f) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:21:52 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:21:52 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:21:52 user nova-compute[75165]: INFO os_vif [None req-d4530d31-5bac-40d1-a08d-22ec2f429dda tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:bb:76,bridge_name='br-int',has_traffic_filtering=True,id=4d97651b-5d7c-4778-85a4-a11588892b31,network=Network(7e330392-6256-405b-ab37-0b8af0c4fd48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d97651b-5d')
Oct 26 00:21:52 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-d4530d31-5bac-40d1-a08d-22ec2f429dda tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] [instance: 27fa1771-fb69-49da-81b3-7f112e623170] Start _get_guest_xml network_info=[{"id": "4d97651b-5d7c-4778-85a4-a11588892b31", "address": "fa:16:3e:c5:bb:76", "network": {"id": "7e330392-6256-405b-ab37-0b8af0c4fd48", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-430326049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ffbf5c944914cafac7aba65fb7ca402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d97651b-5d", "ovs_interfaceid": "4d97651b-5d7c-4778-85a4-a11588892b31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=bff0d8a1-739e-4c4d-9efa-b73ba7b76d01,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'size': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': 'bff0d8a1-739e-4c4d-9efa-b73ba7b76d01'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75165) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 00:21:52 user nova-compute[75165]: DEBUG nova.objects.instance [None req-d4530d31-5bac-40d1-a08d-22ec2f429dda tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Lazy-loading 'numa_topology' on Instance uuid 27fa1771-fb69-49da-81b3-7f112e623170 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:21:52 user nova-compute[75165]: DEBUG nova.objects.base [None req-d4530d31-5bac-40d1-a08d-22ec2f429dda tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Object Instance<27fa1771-fb69-49da-81b3-7f112e623170> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75165) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 00:21:52 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-d4530d31-5bac-40d1-a08d-22ec2f429dda tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:21:52 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-d4530d31-5bac-40d1-a08d-22ec2f429dda tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:21:52 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-d4530d31-5bac-40d1-a08d-22ec2f429dda tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75165) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 00:21:52 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-d4530d31-5bac-40d1-a08d-22ec2f429dda tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] CPU controller missing on host. {{(pid=75165) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 00:21:52 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-d4530d31-5bac-40d1-a08d-22ec2f429dda tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75165) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 00:21:52 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-d4530d31-5bac-40d1-a08d-22ec2f429dda tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] CPU controller found on host. {{(pid=75165) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 00:21:52 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-d4530d31-5bac-40d1-a08d-22ec2f429dda tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75165) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 00:21:52 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-d4530d31-5bac-40d1-a08d-22ec2f429dda tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T00:03:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=bff0d8a1-739e-4c4d-9efa-b73ba7b76d01,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 00:21:52 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-d4530d31-5bac-40d1-a08d-22ec2f429dda tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Flavor limits 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 00:21:52 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-d4530d31-5bac-40d1-a08d-22ec2f429dda tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Image limits 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 00:21:52 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-d4530d31-5bac-40d1-a08d-22ec2f429dda tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Flavor pref 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 00:21:52 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-d4530d31-5bac-40d1-a08d-22ec2f429dda tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Image pref 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 00:21:52 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-d4530d31-5bac-40d1-a08d-22ec2f429dda tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 00:21:52 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-d4530d31-5bac-40d1-a08d-22ec2f429dda tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 00:21:52 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-d4530d31-5bac-40d1-a08d-22ec2f429dda tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75165) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 00:21:52 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-d4530d31-5bac-40d1-a08d-22ec2f429dda tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Got 1 possible topologies {{(pid=75165) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 00:21:52 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-d4530d31-5bac-40d1-a08d-22ec2f429dda tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 00:21:52 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-d4530d31-5bac-40d1-a08d-22ec2f429dda tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 00:21:52 user nova-compute[75165]: DEBUG nova.objects.instance [None req-d4530d31-5bac-40d1-a08d-22ec2f429dda tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Lazy-loading 'vcpu_model' on Instance uuid 27fa1771-fb69-49da-81b3-7f112e623170 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:21:52 user nova-compute[75165]: DEBUG nova.objects.base [None req-d4530d31-5bac-40d1-a08d-22ec2f429dda tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Object Instance<27fa1771-fb69-49da-81b3-7f112e623170> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75165) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 00:21:52 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-d4530d31-5bac-40d1-a08d-22ec2f429dda tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:13:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1390737120',display_name='tempest-AttachVolumeTestJSON-server-1390737120',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1390737120',id=20,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEolsf1MVpCHotOftiJQ4Zgsnx29J3YYZZ32cA7FaSf4r6DElmgaLg7eBXc3I/pwZzl9KTJMnY6YgVOXkfwz2nESGnC4fUVVLf94BqH2qQSBNdKz1HLQzjXno+XfnON8kw==',key_name='tempest-keypair-763586997',keypairs=<?>,launch_index=0,launched_at=2023-10-26T00:13:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='3ffbf5c944914cafac7aba65fb7ca402',ramdisk_id='',reservation_id='r-ox40rq7n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2130746724',owner_user_name='tempest-AttachVolumeTestJSON-2130746724-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T00:20:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='841b5be7c0b348de979920fc9ae223ed',uuid=27fa1771-fb69-49da-81b3-7f112e623170,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "4d97651b-5d7c-4778-85a4-a11588892b31", "address": "fa:16:3e:c5:bb:76", "network": {"id": "7e330392-6256-405b-ab37-0b8af0c4fd48", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-430326049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ffbf5c944914cafac7aba65fb7ca402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d97651b-5d", "ovs_interfaceid": "4d97651b-5d7c-4778-85a4-a11588892b31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75165) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 00:21:52 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-d4530d31-5bac-40d1-a08d-22ec2f429dda tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Converting VIF {"id": "4d97651b-5d7c-4778-85a4-a11588892b31", "address": "fa:16:3e:c5:bb:76", "network": {"id": "7e330392-6256-405b-ab37-0b8af0c4fd48", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-430326049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ffbf5c944914cafac7aba65fb7ca402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d97651b-5d", "ovs_interfaceid": "4d97651b-5d7c-4778-85a4-a11588892b31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:21:52 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-d4530d31-5bac-40d1-a08d-22ec2f429dda tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:bb:76,bridge_name='br-int',has_traffic_filtering=True,id=4d97651b-5d7c-4778-85a4-a11588892b31,network=Network(7e330392-6256-405b-ab37-0b8af0c4fd48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d97651b-5d') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:21:52 user nova-compute[75165]: DEBUG nova.objects.instance [None req-d4530d31-5bac-40d1-a08d-22ec2f429dda tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Lazy-loading 'pci_devices' on Instance uuid 27fa1771-fb69-49da-81b3-7f112e623170 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:21:52 user nova-compute[75165]: DEBUG nova.objects.base [None req-d4530d31-5bac-40d1-a08d-22ec2f429dda tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Object Instance<27fa1771-fb69-49da-81b3-7f112e623170> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75165) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 00:21:52 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-d4530d31-5bac-40d1-a08d-22ec2f429dda tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] [instance: 27fa1771-fb69-49da-81b3-7f112e623170] End _get_guest_xml xml=<domain type="kvm">
Oct 26 00:21:52 user nova-compute[75165]:   <uuid>27fa1771-fb69-49da-81b3-7f112e623170</uuid>
Oct 26 00:21:52 user nova-compute[75165]:   <name>instance-00000014</name>
Oct 26 00:21:52 user nova-compute[75165]:   <memory>524288</memory>
Oct 26 00:21:52 user nova-compute[75165]:   <vcpu>1</vcpu>
Oct 26 00:21:52 user nova-compute[75165]:   <metadata>
Oct 26 00:21:52 user nova-compute[75165]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 00:21:52 user nova-compute[75165]:       <nova:package version="0.0.0"/>
Oct 26 00:21:52 user nova-compute[75165]:       <nova:name>tempest-AttachVolumeTestJSON-server-1390737120</nova:name>
Oct 26 00:21:52 user nova-compute[75165]:       <nova:creationTime>2023-10-26 00:21:52</nova:creationTime>
Oct 26 00:21:52 user nova-compute[75165]:       <nova:flavor name="m1.tiny">
Oct 26 00:21:52 user nova-compute[75165]:         <nova:memory>512</nova:memory>
Oct 26 00:21:52 user nova-compute[75165]:         <nova:disk>1</nova:disk>
Oct 26 00:21:52 user nova-compute[75165]:         <nova:swap>0</nova:swap>
Oct 26 00:21:52 user nova-compute[75165]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 00:21:52 user nova-compute[75165]:         <nova:vcpus>1</nova:vcpus>
Oct 26 00:21:52 user nova-compute[75165]:       </nova:flavor>
Oct 26 00:21:52 user nova-compute[75165]:       <nova:owner>
Oct 26 00:21:52 user nova-compute[75165]:         <nova:user uuid="841b5be7c0b348de979920fc9ae223ed">tempest-AttachVolumeTestJSON-2130746724-project-member</nova:user>
Oct 26 00:21:52 user nova-compute[75165]:         <nova:project uuid="3ffbf5c944914cafac7aba65fb7ca402">tempest-AttachVolumeTestJSON-2130746724</nova:project>
Oct 26 00:21:52 user nova-compute[75165]:       </nova:owner>
Oct 26 00:21:52 user nova-compute[75165]:       <nova:root type="image" uuid="bff0d8a1-739e-4c4d-9efa-b73ba7b76d01"/>
Oct 26 00:21:52 user nova-compute[75165]:       <nova:ports>
Oct 26 00:21:52 user nova-compute[75165]:         <nova:port uuid="4d97651b-5d7c-4778-85a4-a11588892b31">
Oct 26 00:21:52 user nova-compute[75165]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 26 00:21:52 user nova-compute[75165]:         </nova:port>
Oct 26 00:21:52 user nova-compute[75165]:       </nova:ports>
Oct 26 00:21:52 user nova-compute[75165]:     </nova:instance>
Oct 26 00:21:52 user nova-compute[75165]:   </metadata>
Oct 26 00:21:52 user nova-compute[75165]:   <sysinfo type="smbios">
Oct 26 00:21:52 user nova-compute[75165]:     <system>
Oct 26 00:21:52 user nova-compute[75165]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 00:21:52 user nova-compute[75165]:       <entry name="product">OpenStack Nova</entry>
Oct 26 00:21:52 user nova-compute[75165]:       <entry name="version">0.0.0</entry>
Oct 26 00:21:52 user nova-compute[75165]:       <entry name="serial">27fa1771-fb69-49da-81b3-7f112e623170</entry>
Oct 26 00:21:52 user nova-compute[75165]:       <entry name="uuid">27fa1771-fb69-49da-81b3-7f112e623170</entry>
Oct 26 00:21:52 user nova-compute[75165]:       <entry name="family">Virtual Machine</entry>
Oct 26 00:21:52 user nova-compute[75165]:     </system>
Oct 26 00:21:52 user nova-compute[75165]:   </sysinfo>
Oct 26 00:21:52 user nova-compute[75165]:   <os>
Oct 26 00:21:52 user nova-compute[75165]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 00:21:52 user nova-compute[75165]:     <boot dev="hd"/>
Oct 26 00:21:52 user nova-compute[75165]:     <smbios mode="sysinfo"/>
Oct 26 00:21:52 user nova-compute[75165]:   </os>
Oct 26 00:21:52 user nova-compute[75165]:   <features>
Oct 26 00:21:52 user nova-compute[75165]:     <acpi/>
Oct 26 00:21:52 user nova-compute[75165]:     <apic/>
Oct 26 00:21:52 user nova-compute[75165]:     <vmcoreinfo/>
Oct 26 00:21:52 user nova-compute[75165]:   </features>
Oct 26 00:21:52 user nova-compute[75165]:   <clock offset="utc">
Oct 26 00:21:52 user nova-compute[75165]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 00:21:52 user nova-compute[75165]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 00:21:52 user nova-compute[75165]:     <timer name="hpet" present="no"/>
Oct 26 00:21:52 user nova-compute[75165]:   </clock>
Oct 26 00:21:52 user nova-compute[75165]:   <cpu mode="custom" match="exact">
Oct 26 00:21:52 user nova-compute[75165]:     <model>Nehalem</model>
Oct 26 00:21:52 user nova-compute[75165]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 00:21:52 user nova-compute[75165]:   </cpu>
Oct 26 00:21:52 user nova-compute[75165]:   <devices>
Oct 26 00:21:52 user nova-compute[75165]:     <disk type="file" device="disk">
Oct 26 00:21:52 user nova-compute[75165]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 00:21:52 user nova-compute[75165]:       <source file="/opt/stack/data/nova/instances/27fa1771-fb69-49da-81b3-7f112e623170/disk"/>
Oct 26 00:21:52 user nova-compute[75165]:       <target dev="vda" bus="virtio"/>
Oct 26 00:21:52 user nova-compute[75165]:     </disk>
Oct 26 00:21:52 user nova-compute[75165]:     <interface type="ethernet">
Oct 26 00:21:52 user nova-compute[75165]:       <mac address="fa:16:3e:c5:bb:76"/>
Oct 26 00:21:52 user nova-compute[75165]:       <model type="virtio"/>
Oct 26 00:21:52 user nova-compute[75165]:       <mtu size="1442"/>
Oct 26 00:21:52 user nova-compute[75165]:       <target dev="tap4d97651b-5d"/>
Oct 26 00:21:52 user nova-compute[75165]:     </interface>
Oct 26 00:21:52 user nova-compute[75165]:     <serial type="pty">
Oct 26 00:21:52 user nova-compute[75165]:       <log file="/opt/stack/data/nova/instances/27fa1771-fb69-49da-81b3-7f112e623170/console.log" append="off"/>
Oct 26 00:21:52 user nova-compute[75165]:     </serial>
Oct 26 00:21:52 user nova-compute[75165]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 00:21:52 user nova-compute[75165]:     <video>
Oct 26 00:21:52 user nova-compute[75165]:       <model type="virtio"/>
Oct 26 00:21:52 user nova-compute[75165]:     </video>
Oct 26 00:21:52 user nova-compute[75165]:     <rng model="virtio">
Oct 26 00:21:52 user nova-compute[75165]:       <backend model="random">/dev/urandom</backend>
Oct 26 00:21:52 user nova-compute[75165]:     </rng>
Oct 26 00:21:52 user nova-compute[75165]:     <controller type="usb" index="0" model="none"/>
Oct 26 00:21:52 user nova-compute[75165]:     <memballoon model="virtio">
Oct 26 00:21:52 user nova-compute[75165]:       <stats period="10"/>
Oct 26 00:21:52 user nova-compute[75165]:     </memballoon>
Oct 26 00:21:52 user nova-compute[75165]:   </devices>
Oct 26 00:21:52 user nova-compute[75165]: </domain>
Oct 26 00:21:52 user nova-compute[75165]:  {{(pid=75165) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 00:21:52 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-d4530d31-5bac-40d1-a08d-22ec2f429dda tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27fa1771-fb69-49da-81b3-7f112e623170/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:21:53 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-d4530d31-5bac-40d1-a08d-22ec2f429dda tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27fa1771-fb69-49da-81b3-7f112e623170/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:21:53 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-d4530d31-5bac-40d1-a08d-22ec2f429dda tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27fa1771-fb69-49da-81b3-7f112e623170/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:21:53 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-d4530d31-5bac-40d1-a08d-22ec2f429dda tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27fa1771-fb69-49da-81b3-7f112e623170/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:21:53 user nova-compute[75165]: DEBUG nova.objects.instance [None req-d4530d31-5bac-40d1-a08d-22ec2f429dda tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Lazy-loading 'trusted_certs' on Instance uuid 27fa1771-fb69-49da-81b3-7f112e623170 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:21:53 user nova-compute[75165]: DEBUG nova.objects.base [None req-d4530d31-5bac-40d1-a08d-22ec2f429dda tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Object Instance<27fa1771-fb69-49da-81b3-7f112e623170> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75165) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 00:21:53 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-d4530d31-5bac-40d1-a08d-22ec2f429dda tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:21:53 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-d4530d31-5bac-40d1-a08d-22ec2f429dda tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json" returned: 0 in 0.169s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:21:53 user nova-compute[75165]: DEBUG nova.virt.disk.api [None req-d4530d31-5bac-40d1-a08d-22ec2f429dda tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Checking if we can resize image /opt/stack/data/nova/instances/27fa1771-fb69-49da-81b3-7f112e623170/disk. size=1073741824 {{(pid=75165) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 00:21:53 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-d4530d31-5bac-40d1-a08d-22ec2f429dda tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27fa1771-fb69-49da-81b3-7f112e623170/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:21:53 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-d4530d31-5bac-40d1-a08d-22ec2f429dda tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27fa1771-fb69-49da-81b3-7f112e623170/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:21:53 user nova-compute[75165]: DEBUG nova.virt.disk.api [None req-d4530d31-5bac-40d1-a08d-22ec2f429dda tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Cannot resize image /opt/stack/data/nova/instances/27fa1771-fb69-49da-81b3-7f112e623170/disk to a smaller size. {{(pid=75165) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 00:21:53 user nova-compute[75165]: DEBUG nova.objects.instance [None req-d4530d31-5bac-40d1-a08d-22ec2f429dda tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Lazy-loading 'migration_context' on Instance uuid 27fa1771-fb69-49da-81b3-7f112e623170 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:21:53 user nova-compute[75165]: DEBUG nova.objects.base [None req-d4530d31-5bac-40d1-a08d-22ec2f429dda tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Object Instance<27fa1771-fb69-49da-81b3-7f112e623170> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75165) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 00:21:53 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-d4530d31-5bac-40d1-a08d-22ec2f429dda tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:13:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1390737120',display_name='tempest-AttachVolumeTestJSON-server-1390737120',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1390737120',id=20,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEolsf1MVpCHotOftiJQ4Zgsnx29J3YYZZ32cA7FaSf4r6DElmgaLg7eBXc3I/pwZzl9KTJMnY6YgVOXkfwz2nESGnC4fUVVLf94BqH2qQSBNdKz1HLQzjXno+XfnON8kw==',key_name='tempest-keypair-763586997',keypairs=<?>,launch_index=0,launched_at=2023-10-26T00:13:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='3ffbf5c944914cafac7aba65fb7ca402',ramdisk_id='',reservation_id='r-ox40rq7n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2130746724',owner_user_name='tempest-AttachVolumeTestJSON-2130746724-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T00:20:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='841b5be7c0b348de979920fc9ae223ed',uuid=27fa1771-fb69-49da-81b3-7f112e623170,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "4d97651b-5d7c-4778-85a4-a11588892b31", "address": "fa:16:3e:c5:bb:76", "network": {"id": "7e330392-6256-405b-ab37-0b8af0c4fd48", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-430326049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ffbf5c944914cafac7aba65fb7ca402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d97651b-5d", "ovs_interfaceid": "4d97651b-5d7c-4778-85a4-a11588892b31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 00:21:53 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-d4530d31-5bac-40d1-a08d-22ec2f429dda tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Converting VIF {"id": "4d97651b-5d7c-4778-85a4-a11588892b31", "address": "fa:16:3e:c5:bb:76", "network": {"id": "7e330392-6256-405b-ab37-0b8af0c4fd48", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-430326049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ffbf5c944914cafac7aba65fb7ca402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d97651b-5d", "ovs_interfaceid": "4d97651b-5d7c-4778-85a4-a11588892b31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:21:53 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-d4530d31-5bac-40d1-a08d-22ec2f429dda tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:bb:76,bridge_name='br-int',has_traffic_filtering=True,id=4d97651b-5d7c-4778-85a4-a11588892b31,network=Network(7e330392-6256-405b-ab37-0b8af0c4fd48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d97651b-5d') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:21:53 user nova-compute[75165]: DEBUG os_vif [None req-d4530d31-5bac-40d1-a08d-22ec2f429dda tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:bb:76,bridge_name='br-int',has_traffic_filtering=True,id=4d97651b-5d7c-4778-85a4-a11588892b31,network=Network(7e330392-6256-405b-ab37-0b8af0c4fd48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d97651b-5d') {{(pid=75165) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 00:21:53 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:21:53 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:21:53 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 00:21:53 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:21:53 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4375787e-6f02-5202-9bbe-f9114f448eb1', '_type': 'linux-noop'}}, row=False) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:21:53 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:21:53 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:21:53 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:21:53 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4d97651b-5d, may_exist=True, interface_attrs={}) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:21:53 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4d97651b-5d, col_values=(('qos', UUID('a7b66165-26fb-49a9-96dc-e8cd90538900')),), if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:21:53 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4d97651b-5d, col_values=(('external_ids', {'iface-id': '4d97651b-5d7c-4778-85a4-a11588892b31', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c5:bb:76', 'vm-uuid': '27fa1771-fb69-49da-81b3-7f112e623170'}),), if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:21:53 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:21:53 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:21:53 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:21:53 user nova-compute[75165]: INFO os_vif [None req-d4530d31-5bac-40d1-a08d-22ec2f429dda tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:bb:76,bridge_name='br-int',has_traffic_filtering=True,id=4d97651b-5d7c-4778-85a4-a11588892b31,network=Network(7e330392-6256-405b-ab37-0b8af0c4fd48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d97651b-5d')
Oct 26 00:21:55 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:21:55 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:21:55 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:21:55 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:21:55 user nova-compute[75165]: DEBUG nova.compute.manager [req-a57ac94a-ea02-4491-9d5d-2022c9fc659b req-733c8239-d123-43d8-8a67-9037942ce2d8 service nova] [instance: 27fa1771-fb69-49da-81b3-7f112e623170] Received event network-vif-plugged-4d97651b-5d7c-4778-85a4-a11588892b31 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:21:55 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-a57ac94a-ea02-4491-9d5d-2022c9fc659b req-733c8239-d123-43d8-8a67-9037942ce2d8 service nova] Acquiring lock "27fa1771-fb69-49da-81b3-7f112e623170-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:21:55 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-a57ac94a-ea02-4491-9d5d-2022c9fc659b req-733c8239-d123-43d8-8a67-9037942ce2d8 service nova] Lock "27fa1771-fb69-49da-81b3-7f112e623170-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:21:55 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-a57ac94a-ea02-4491-9d5d-2022c9fc659b req-733c8239-d123-43d8-8a67-9037942ce2d8 service nova] Lock "27fa1771-fb69-49da-81b3-7f112e623170-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:21:55 user nova-compute[75165]: DEBUG nova.compute.manager [req-a57ac94a-ea02-4491-9d5d-2022c9fc659b req-733c8239-d123-43d8-8a67-9037942ce2d8 service nova] [instance: 27fa1771-fb69-49da-81b3-7f112e623170] No waiting events found dispatching network-vif-plugged-4d97651b-5d7c-4778-85a4-a11588892b31 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:21:55 user nova-compute[75165]: WARNING nova.compute.manager [req-a57ac94a-ea02-4491-9d5d-2022c9fc659b req-733c8239-d123-43d8-8a67-9037942ce2d8 service nova] [instance: 27fa1771-fb69-49da-81b3-7f112e623170] Received unexpected event network-vif-plugged-4d97651b-5d7c-4778-85a4-a11588892b31 for instance with vm_state stopped and task_state powering-on.
Oct 26 00:21:55 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-479af9a7-a575-49e6-a522-b6c26c6c65a9 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: bad6c21f-885f-4348-86f7-b237ce2d241b] Starting finish_migration {{(pid=75165) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Oct 26 00:21:55 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-479af9a7-a575-49e6-a522-b6c26c6c65a9 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: bad6c21f-885f-4348-86f7-b237ce2d241b] Instance directory exists: not creating {{(pid=75165) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 26 00:21:55 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-479af9a7-a575-49e6-a522-b6c26c6c65a9 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: bad6c21f-885f-4348-86f7-b237ce2d241b] Creating image(s)
Oct 26 00:21:55 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-479af9a7-a575-49e6-a522-b6c26c6c65a9 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: bad6c21f-885f-4348-86f7-b237ce2d241b] Did not create local disks {{(pid=75165) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 26 00:21:55 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-479af9a7-a575-49e6-a522-b6c26c6c65a9 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: bad6c21f-885f-4348-86f7-b237ce2d241b] Ensure instance console log exists: /opt/stack/data/nova/instances/bad6c21f-885f-4348-86f7-b237ce2d241b/console.log {{(pid=75165) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 00:21:55 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-479af9a7-a575-49e6-a522-b6c26c6c65a9 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:21:55 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-479af9a7-a575-49e6-a522-b6c26c6c65a9 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:21:55 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-479af9a7-a575-49e6-a522-b6c26c6c65a9 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:21:55 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-479af9a7-a575-49e6-a522-b6c26c6c65a9 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: bad6c21f-885f-4348-86f7-b237ce2d241b] Start _get_guest_xml network_info=[{"id": "b64d421a-ca91-4f21-80f7-17b0c17ceb8a", "address": "fa:16:3e:54:54:b8", "network": {"id": "bd1c84f9-bba9-4a23-8bf2-17e65022136a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1557945804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1557945804-network", "vif_mac": "fa:16:3e:54:54:b8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2911497df44047d9a9ee36a5652298bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb64d421a-ca", "ovs_interfaceid": "b64d421a-ca91-4f21-80f7-17b0c17ceb8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:99a43689-b7cd-47e6-ae88-fd8ba07c60c1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RhTfzArp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'bad6c21f-885f-4348-86f7-b237ce2d241b', 'attached_at': '2023-10-26T00:21:55.000000', 'detached_at': '', 'volume_id': '99a43689-b7cd-47e6-ae88-fd8ba07c60c1', 'serial': '99a43689-b7cd-47e6-ae88-fd8ba07c60c1'}, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'attachment_id': '3fca00a6-9cc2-4510-a173-e974caf674ef', 'delete_on_termination': True, 'volume_type': None} {{(pid=75165) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 00:21:55 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-479af9a7-a575-49e6-a522-b6c26c6c65a9 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:21:55 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-479af9a7-a575-49e6-a522-b6c26c6c65a9 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:21:55 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-479af9a7-a575-49e6-a522-b6c26c6c65a9 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75165) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 00:21:55 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-479af9a7-a575-49e6-a522-b6c26c6c65a9 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] CPU controller missing on host. {{(pid=75165) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 00:21:55 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-479af9a7-a575-49e6-a522-b6c26c6c65a9 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75165) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 00:21:55 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-479af9a7-a575-49e6-a522-b6c26c6c65a9 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] CPU controller found on host. {{(pid=75165) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 00:21:55 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-479af9a7-a575-49e6-a522-b6c26c6c65a9 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75165) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 00:21:55 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-479af9a7-a575-49e6-a522-b6c26c6c65a9 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T00:03:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 00:21:55 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-479af9a7-a575-49e6-a522-b6c26c6c65a9 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Flavor limits 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 00:21:55 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-479af9a7-a575-49e6-a522-b6c26c6c65a9 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Image limits 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 00:21:55 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-479af9a7-a575-49e6-a522-b6c26c6c65a9 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Flavor pref 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 00:21:55 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-479af9a7-a575-49e6-a522-b6c26c6c65a9 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Image pref 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 00:21:55 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-479af9a7-a575-49e6-a522-b6c26c6c65a9 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 00:21:55 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-479af9a7-a575-49e6-a522-b6c26c6c65a9 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 00:21:55 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-479af9a7-a575-49e6-a522-b6c26c6c65a9 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75165) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 00:21:55 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-479af9a7-a575-49e6-a522-b6c26c6c65a9 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Got 1 possible topologies {{(pid=75165) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 00:21:55 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-479af9a7-a575-49e6-a522-b6c26c6c65a9 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 00:21:55 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-479af9a7-a575-49e6-a522-b6c26c6c65a9 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 00:21:55 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-479af9a7-a575-49e6-a522-b6c26c6c65a9 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: bad6c21f-885f-4348-86f7-b237ce2d241b] Calling os-brick to attach iSCSI Volume {{(pid=75165) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 00:21:55 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-479af9a7-a575-49e6-a522-b6c26c6c65a9 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8bf8160e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:99a43689-b7cd-47e6-ae88-fd8ba07c60c1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RhTfzArp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:21:55 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-479af9a7-a575-49e6-a522-b6c26c6c65a9 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:21:55 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-479af9a7-a575-49e6-a522-b6c26c6c65a9 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:21:55 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-479af9a7-a575-49e6-a522-b6c26c6c65a9 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:21:55 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-479af9a7-a575-49e6-a522-b6c26c6c65a9 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:21:55 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-479af9a7-a575-49e6-a522-b6c26c6c65a9 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:99a43689-b7cd-47e6-ae88-fd8ba07c60c1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:21:55 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-479af9a7-a575-49e6-a522-b6c26c6c65a9 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:99a43689-b7cd-47e6-ae88-fd8ba07c60c1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:21:55 user nova-compute[75165]: INFO os_brick.initiator.connectors.iscsi [None req-479af9a7-a575-49e6-a522-b6c26c6c65a9 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 00:21:55 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:21:55 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99a43689-b7cd-47e6-ae88-fd8ba07c60c1 -p 172.16.0.220:3260 {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:21:55 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:21:55 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99a43689-b7cd-47e6-ae88-fd8ba07c60c1 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:21:55 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cce1bf9-70e9-4bec-a814-f1289dc64d68]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:21:55 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-479af9a7-a575-49e6-a522-b6c26c6c65a9 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 00:21:55 user nova-compute[75165]:  {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:21:55 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99a43689-b7cd-47e6-ae88-fd8ba07c60c1 -p 172.16.0.220:3260 --interface default --op new {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:21:55 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99a43689-b7cd-47e6-ae88-fd8ba07c60c1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:21:55 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[b832906c-0afb-459d-936f-0351e62c9cc9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:99a43689-b7cd-47e6-ae88-fd8ba07c60c1] added\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:21:55 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-479af9a7-a575-49e6-a522-b6c26c6c65a9 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:99a43689-b7cd-47e6-ae88-fd8ba07c60c1] added
Oct 26 00:21:55 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:21:55 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99a43689-b7cd-47e6-ae88-fd8ba07c60c1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:21:55 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99a43689-b7cd-47e6-ae88-fd8ba07c60c1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:21:55 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[792688b3-9bd2-45da-bc63-6b7e0f1c092f]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:21:55 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-479af9a7-a575-49e6-a522-b6c26c6c65a9 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:21:55 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99a43689-b7cd-47e6-ae88-fd8ba07c60c1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:21:55 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99a43689-b7cd-47e6-ae88-fd8ba07c60c1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:21:55 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a5ba56f-639e-49a7-8b9c-684d0722ba47]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:21:55 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-479af9a7-a575-49e6-a522-b6c26c6c65a9 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:21:55 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99a43689-b7cd-47e6-ae88-fd8ba07c60c1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RhTfzArp {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:21:55 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99a43689-b7cd-47e6-ae88-fd8ba07c60c1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RhTfzArp" returned: 0 in 0.026s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:21:55 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ccf5705-27e6-4313-b16c-1b7be543a6dc]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:21:55 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-479af9a7-a575-49e6-a522-b6c26c6c65a9 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RhTfzArp'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:21:55 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99a43689-b7cd-47e6-ae88-fd8ba07c60c1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:21:55 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99a43689-b7cd-47e6-ae88-fd8ba07c60c1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:21:55 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf20a933-f5eb-4118-8bde-ac1ac0a7808a]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:21:55 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-479af9a7-a575-49e6-a522-b6c26c6c65a9 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:21:55 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:21:55 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:21:55 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[c95bda37-bf2c-457e-add4-217658418496]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f06e40e7-3ca1-4a25-bd11-ff01280c6df2 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:652b4bd0-93f8-4553-bddd-e432f7ec1142 (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:21:55 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-479af9a7-a575-49e6-a522-b6c26c6c65a9 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f06e40e7-3ca1-4a25-bd11-ff01280c6df2 (non-flash)
Oct 26 00:21:55 user nova-compute[75165]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)
Oct 26 00:21:55 user nova-compute[75165]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:652b4bd0-93f8-4553-bddd-e432f7ec1142 (non-flash)
Oct 26 00:21:55 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:21:55 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-479af9a7-a575-49e6-a522-b6c26c6c65a9 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f06e40e7-3ca1-4a25-bd11-ff01280c6df2 (non-flash)
Oct 26 00:21:55 user nova-compute[75165]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)
Oct 26 00:21:55 user nova-compute[75165]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:652b4bd0-93f8-4553-bddd-e432f7ec1142 (non-flash)
Oct 26 00:21:55 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:21:55 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99a43689-b7cd-47e6-ae88-fd8ba07c60c1 -p 172.16.0.220:3260 --login {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:21:56 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99a43689-b7cd-47e6-ae88-fd8ba07c60c1 -p 172.16.0.220:3260 --login" returned: 0 in 0.091s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:21:56 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[68d1e7aa-6ef8-42cf-ad9b-87d848386413]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:99a43689-b7cd-47e6-ae88-fd8ba07c60c1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:99a43689-b7cd-47e6-ae88-fd8ba07c60c1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:21:56 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-479af9a7-a575-49e6-a522-b6c26c6c65a9 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:99a43689-b7cd-47e6-ae88-fd8ba07c60c1, portal: 172.16.0.220,3260]
Oct 26 00:21:56 user nova-compute[75165]: Login to [iface: default, target: iqn.2010-10.org.openstack:99a43689-b7cd-47e6-ae88-fd8ba07c60c1, portal: 172.16.0.220,3260] successful.
Oct 26 00:21:56 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:21:56 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99a43689-b7cd-47e6-ae88-fd8ba07c60c1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:21:56 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99a43689-b7cd-47e6-ae88-fd8ba07c60c1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:21:56 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[30286fe5-ca4e-46f5-b4bb-5094a4110975]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:21:56 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-479af9a7-a575-49e6-a522-b6c26c6c65a9 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:21:56 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:21:56 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:21:56 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[25c1fdab-f0aa-49eb-b4a3-b39b37c3e600]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f06e40e7-3ca1-4a25-bd11-ff01280c6df2 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:652b4bd0-93f8-4553-bddd-e432f7ec1142 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a43689-b7cd-47e6-ae88-fd8ba07c60c1 (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:21:56 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-479af9a7-a575-49e6-a522-b6c26c6c65a9 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f06e40e7-3ca1-4a25-bd11-ff01280c6df2 (non-flash)
Oct 26 00:21:56 user nova-compute[75165]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)
Oct 26 00:21:56 user nova-compute[75165]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:652b4bd0-93f8-4553-bddd-e432f7ec1142 (non-flash)
Oct 26 00:21:56 user nova-compute[75165]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a43689-b7cd-47e6-ae88-fd8ba07c60c1 (non-flash)
Oct 26 00:21:56 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:21:56 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-479af9a7-a575-49e6-a522-b6c26c6c65a9 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f06e40e7-3ca1-4a25-bd11-ff01280c6df2 (non-flash)
Oct 26 00:21:56 user nova-compute[75165]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)
Oct 26 00:21:56 user nova-compute[75165]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:652b4bd0-93f8-4553-bddd-e432f7ec1142 (non-flash)
Oct 26 00:21:56 user nova-compute[75165]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a43689-b7cd-47e6-ae88-fd8ba07c60c1 (non-flash)
Oct 26 00:21:56 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:21:56 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-479af9a7-a575-49e6-a522-b6c26c6c65a9 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:99a43689-b7cd-47e6-ae88-fd8ba07c60c1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.328s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:21:56 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-479af9a7-a575-49e6-a522-b6c26c6c65a9 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Connected to 172.16.0.220:3260 {{(pid=75165) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 00:21:56 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-479af9a7-a575-49e6-a522-b6c26c6c65a9 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] HCTL ('36', '-', '-', 0) found on session 28 with lun 0 {{(pid=75165) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 00:21:56 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-479af9a7-a575-49e6-a522-b6c26c6c65a9 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75165) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 00:21:56 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:21:56 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.025s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:21:56 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[429faddd-8449-444f-af9b-667643b1b99b]: (4, ('- - 0', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:21:56 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-479af9a7-a575-49e6-a522-b6c26c6c65a9 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Searching for a device in session 28 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75165) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 00:21:56 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-479af9a7-a575-49e6-a522-b6c26c6c65a9 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:99a43689-b7cd-47e6-ae88-fd8ba07c60c1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RhTfzArp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75165) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 00:21:56 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:21:57 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-479af9a7-a575-49e6-a522-b6c26c6c65a9 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.369s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:21:57 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-479af9a7-a575-49e6-a522-b6c26c6c65a9 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] <== connect_volume: return (1370ms) {'type': 'block', 'scsi_wwn': '23630393831646262', 'path': '/dev/sde'} {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:21:57 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-479af9a7-a575-49e6-a522-b6c26c6c65a9 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: bad6c21f-885f-4348-86f7-b237ce2d241b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23630393831646262', 'path': '/dev/sde'} {{(pid=75165) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 00:21:57 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-479af9a7-a575-49e6-a522-b6c26c6c65a9 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:19:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-71108019',display_name='tempest-ServerActionsTestOtherA-server-71108019',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-71108019',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOtsEaxSd5nKie4b+oTvKYqMVt06ToquYp528kCMFq0uGoZPhLpZteN38KkhJxhsHSzqyfMtJ24GLZPdcByyVczoa0tAnbSbuiNOiWj1Q2SiBRytz34zgMiDTwdnF2ayTw==',key_name='tempest-keypair-1300111',keypairs=<?>,launch_index=0,launched_at=2023-10-26T00:19:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2911497df44047d9a9ee36a5652298bc',ramdisk_id='',reservation_id='r-5k0e6xul',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1690932306',owner_user_name='tempest-ServerActionsTestOtherA-1690932306-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T00:21:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b3ce94f4c01446ebf79a1eba3833e01',uuid=bad6c21f-885f-4348-86f7-b237ce2d241b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b64d421a-ca91-4f21-80f7-17b0c17ceb8a", "address": "fa:16:3e:54:54:b8", "network": {"id": "bd1c84f9-bba9-4a23-8bf2-17e65022136a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1557945804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1557945804-network", "vif_mac": "fa:16:3e:54:54:b8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2911497df44047d9a9ee36a5652298bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb64d421a-ca", "ovs_interfaceid": "b64d421a-ca91-4f21-80f7-17b0c17ceb8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75165) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 00:21:57 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-479af9a7-a575-49e6-a522-b6c26c6c65a9 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Converting VIF {"id": "b64d421a-ca91-4f21-80f7-17b0c17ceb8a", "address": "fa:16:3e:54:54:b8", "network": {"id": "bd1c84f9-bba9-4a23-8bf2-17e65022136a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1557945804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1557945804-network", "vif_mac": "fa:16:3e:54:54:b8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2911497df44047d9a9ee36a5652298bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb64d421a-ca", "ovs_interfaceid": "b64d421a-ca91-4f21-80f7-17b0c17ceb8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:21:57 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-479af9a7-a575-49e6-a522-b6c26c6c65a9 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:54:b8,bridge_name='br-int',has_traffic_filtering=True,id=b64d421a-ca91-4f21-80f7-17b0c17ceb8a,network=Network(bd1c84f9-bba9-4a23-8bf2-17e65022136a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb64d421a-ca') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:21:57 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-479af9a7-a575-49e6-a522-b6c26c6c65a9 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: bad6c21f-885f-4348-86f7-b237ce2d241b] End _get_guest_xml xml=<domain type="kvm">
Oct 26 00:21:57 user nova-compute[75165]:   <uuid>bad6c21f-885f-4348-86f7-b237ce2d241b</uuid>
Oct 26 00:21:57 user nova-compute[75165]:   <name>instance-0000001b</name>
Oct 26 00:21:57 user nova-compute[75165]:   <memory>2097152</memory>
Oct 26 00:21:57 user nova-compute[75165]:   <vcpu>1</vcpu>
Oct 26 00:21:57 user nova-compute[75165]:   <metadata>
Oct 26 00:21:57 user nova-compute[75165]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 00:21:57 user nova-compute[75165]:       <nova:package version="0.0.0"/>
Oct 26 00:21:57 user nova-compute[75165]:       <nova:name>tempest-ServerActionsTestOtherA-server-71108019</nova:name>
Oct 26 00:21:57 user nova-compute[75165]:       <nova:creationTime>2023-10-26 00:21:55</nova:creationTime>
Oct 26 00:21:57 user nova-compute[75165]:       <nova:flavor name="m1.small">
Oct 26 00:21:57 user nova-compute[75165]:         <nova:memory>2048</nova:memory>
Oct 26 00:21:57 user nova-compute[75165]:         <nova:disk>20</nova:disk>
Oct 26 00:21:57 user nova-compute[75165]:         <nova:swap>0</nova:swap>
Oct 26 00:21:57 user nova-compute[75165]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 00:21:57 user nova-compute[75165]:         <nova:vcpus>1</nova:vcpus>
Oct 26 00:21:57 user nova-compute[75165]:       </nova:flavor>
Oct 26 00:21:57 user nova-compute[75165]:       <nova:owner>
Oct 26 00:21:57 user nova-compute[75165]:         <nova:user uuid="5b3ce94f4c01446ebf79a1eba3833e01">tempest-ServerActionsTestOtherA-1690932306-project-member</nova:user>
Oct 26 00:21:57 user nova-compute[75165]:         <nova:project uuid="2911497df44047d9a9ee36a5652298bc">tempest-ServerActionsTestOtherA-1690932306</nova:project>
Oct 26 00:21:57 user nova-compute[75165]:       </nova:owner>
Oct 26 00:21:57 user nova-compute[75165]:       <nova:ports>
Oct 26 00:21:57 user nova-compute[75165]:         <nova:port uuid="b64d421a-ca91-4f21-80f7-17b0c17ceb8a">
Oct 26 00:21:57 user nova-compute[75165]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 26 00:21:57 user nova-compute[75165]:         </nova:port>
Oct 26 00:21:57 user nova-compute[75165]:       </nova:ports>
Oct 26 00:21:57 user nova-compute[75165]:     </nova:instance>
Oct 26 00:21:57 user nova-compute[75165]:   </metadata>
Oct 26 00:21:57 user nova-compute[75165]:   <sysinfo type="smbios">
Oct 26 00:21:57 user nova-compute[75165]:     <system>
Oct 26 00:21:57 user nova-compute[75165]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 00:21:57 user nova-compute[75165]:       <entry name="product">OpenStack Nova</entry>
Oct 26 00:21:57 user nova-compute[75165]:       <entry name="version">0.0.0</entry>
Oct 26 00:21:57 user nova-compute[75165]:       <entry name="serial">bad6c21f-885f-4348-86f7-b237ce2d241b</entry>
Oct 26 00:21:57 user nova-compute[75165]:       <entry name="uuid">bad6c21f-885f-4348-86f7-b237ce2d241b</entry>
Oct 26 00:21:57 user nova-compute[75165]:       <entry name="family">Virtual Machine</entry>
Oct 26 00:21:57 user nova-compute[75165]:     </system>
Oct 26 00:21:57 user nova-compute[75165]:   </sysinfo>
Oct 26 00:21:57 user nova-compute[75165]:   <os>
Oct 26 00:21:57 user nova-compute[75165]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 00:21:57 user nova-compute[75165]:     <boot dev="hd"/>
Oct 26 00:21:57 user nova-compute[75165]:     <smbios mode="sysinfo"/>
Oct 26 00:21:57 user nova-compute[75165]:   </os>
Oct 26 00:21:57 user nova-compute[75165]:   <features>
Oct 26 00:21:57 user nova-compute[75165]:     <acpi/>
Oct 26 00:21:57 user nova-compute[75165]:     <apic/>
Oct 26 00:21:57 user nova-compute[75165]:     <vmcoreinfo/>
Oct 26 00:21:57 user nova-compute[75165]:   </features>
Oct 26 00:21:57 user nova-compute[75165]:   <clock offset="utc">
Oct 26 00:21:57 user nova-compute[75165]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 00:21:57 user nova-compute[75165]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 00:21:57 user nova-compute[75165]:     <timer name="hpet" present="no"/>
Oct 26 00:21:57 user nova-compute[75165]:   </clock>
Oct 26 00:21:57 user nova-compute[75165]:   <cpu mode="custom" match="exact">
Oct 26 00:21:57 user nova-compute[75165]:     <model>Nehalem</model>
Oct 26 00:21:57 user nova-compute[75165]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 00:21:57 user nova-compute[75165]:   </cpu>
Oct 26 00:21:57 user nova-compute[75165]:   <devices>
Oct 26 00:21:57 user nova-compute[75165]:     <disk type="block" device="disk">
Oct 26 00:21:57 user nova-compute[75165]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 00:21:57 user nova-compute[75165]:       <source dev="/dev/sde"/>
Oct 26 00:21:57 user nova-compute[75165]:       <target dev="vda" bus="virtio"/>
Oct 26 00:21:57 user nova-compute[75165]:       <serial>99a43689-b7cd-47e6-ae88-fd8ba07c60c1</serial>
Oct 26 00:21:57 user nova-compute[75165]:     </disk>
Oct 26 00:21:57 user nova-compute[75165]:     <interface type="ethernet">
Oct 26 00:21:57 user nova-compute[75165]:       <mac address="fa:16:3e:54:54:b8"/>
Oct 26 00:21:57 user nova-compute[75165]:       <model type="virtio"/>
Oct 26 00:21:57 user nova-compute[75165]:       <mtu size="1442"/>
Oct 26 00:21:57 user nova-compute[75165]:       <target dev="tapb64d421a-ca"/>
Oct 26 00:21:57 user nova-compute[75165]:     </interface>
Oct 26 00:21:57 user nova-compute[75165]:     <serial type="pty">
Oct 26 00:21:57 user nova-compute[75165]:       <log file="/opt/stack/data/nova/instances/bad6c21f-885f-4348-86f7-b237ce2d241b/console.log" append="off"/>
Oct 26 00:21:57 user nova-compute[75165]:     </serial>
Oct 26 00:21:57 user nova-compute[75165]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 00:21:57 user nova-compute[75165]:     <video>
Oct 26 00:21:57 user nova-compute[75165]:       <model type="virtio"/>
Oct 26 00:21:57 user nova-compute[75165]:     </video>
Oct 26 00:21:57 user nova-compute[75165]:     <rng model="virtio">
Oct 26 00:21:57 user nova-compute[75165]:       <backend model="random">/dev/urandom</backend>
Oct 26 00:21:57 user nova-compute[75165]:     </rng>
Oct 26 00:21:57 user nova-compute[75165]:     <controller type="usb" index="0" model="none"/>
Oct 26 00:21:57 user nova-compute[75165]:     <memballoon model="virtio">
Oct 26 00:21:57 user nova-compute[75165]:       <stats period="10"/>
Oct 26 00:21:57 user nova-compute[75165]:     </memballoon>
Oct 26 00:21:57 user nova-compute[75165]:   </devices>
Oct 26 00:21:57 user nova-compute[75165]: </domain>
Oct 26 00:21:57 user nova-compute[75165]:  {{(pid=75165) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 00:21:57 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-479af9a7-a575-49e6-a522-b6c26c6c65a9 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:19:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-71108019',display_name='tempest-ServerActionsTestOtherA-server-71108019',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-71108019',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOtsEaxSd5nKie4b+oTvKYqMVt06ToquYp528kCMFq0uGoZPhLpZteN38KkhJxhsHSzqyfMtJ24GLZPdcByyVczoa0tAnbSbuiNOiWj1Q2SiBRytz34zgMiDTwdnF2ayTw==',key_name='tempest-keypair-1300111',keypairs=<?>,launch_index=0,launched_at=2023-10-26T00:19:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2911497df44047d9a9ee36a5652298bc',ramdisk_id='',reservation_id='r-5k0e6xul',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1690932306',owner_user_name='tempest-ServerActionsTestOtherA-1690932306-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T00:21:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b3ce94f4c01446ebf79a1eba3833e01',uuid=bad6c21f-885f-4348-86f7-b237ce2d241b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b64d421a-ca91-4f21-80f7-17b0c17ceb8a", "address": "fa:16:3e:54:54:b8", "network": {"id": "bd1c84f9-bba9-4a23-8bf2-17e65022136a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1557945804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1557945804-network", "vif_mac": "fa:16:3e:54:54:b8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2911497df44047d9a9ee36a5652298bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb64d421a-ca", "ovs_interfaceid": "b64d421a-ca91-4f21-80f7-17b0c17ceb8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 00:21:57 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-479af9a7-a575-49e6-a522-b6c26c6c65a9 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Converting VIF {"id": "b64d421a-ca91-4f21-80f7-17b0c17ceb8a", "address": "fa:16:3e:54:54:b8", "network": {"id": "bd1c84f9-bba9-4a23-8bf2-17e65022136a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1557945804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1557945804-network", "vif_mac": "fa:16:3e:54:54:b8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2911497df44047d9a9ee36a5652298bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb64d421a-ca", "ovs_interfaceid": "b64d421a-ca91-4f21-80f7-17b0c17ceb8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:21:57 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-479af9a7-a575-49e6-a522-b6c26c6c65a9 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:54:b8,bridge_name='br-int',has_traffic_filtering=True,id=b64d421a-ca91-4f21-80f7-17b0c17ceb8a,network=Network(bd1c84f9-bba9-4a23-8bf2-17e65022136a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb64d421a-ca') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:21:57 user nova-compute[75165]: DEBUG os_vif [None req-479af9a7-a575-49e6-a522-b6c26c6c65a9 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:54:b8,bridge_name='br-int',has_traffic_filtering=True,id=b64d421a-ca91-4f21-80f7-17b0c17ceb8a,network=Network(bd1c84f9-bba9-4a23-8bf2-17e65022136a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb64d421a-ca') {{(pid=75165) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 00:21:57 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:21:57 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:21:57 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 00:21:57 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:21:57 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6f80f756-3d52-515d-9638-1ffa93684992', '_type': 'linux-noop'}}, row=False) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:21:57 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:21:57 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:21:57 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:21:57 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb64d421a-ca, may_exist=True, interface_attrs={}) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:21:57 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb64d421a-ca, col_values=(('qos', UUID('d66c478e-8079-4de5-9c5c-0d05ae475e0e')),), if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:21:57 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb64d421a-ca, col_values=(('external_ids', {'iface-id': 'b64d421a-ca91-4f21-80f7-17b0c17ceb8a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:54:54:b8', 'vm-uuid': 'bad6c21f-885f-4348-86f7-b237ce2d241b'}),), if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:21:57 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:21:57 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:21:57 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:21:57 user nova-compute[75165]: INFO os_vif [None req-479af9a7-a575-49e6-a522-b6c26c6c65a9 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:54:b8,bridge_name='br-int',has_traffic_filtering=True,id=b64d421a-ca91-4f21-80f7-17b0c17ceb8a,network=Network(bd1c84f9-bba9-4a23-8bf2-17e65022136a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb64d421a-ca')
Oct 26 00:21:57 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-479af9a7-a575-49e6-a522-b6c26c6c65a9 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] No BDM found with device name vda, not building metadata. {{(pid=75165) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 00:21:57 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-479af9a7-a575-49e6-a522-b6c26c6c65a9 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] No VIF found with MAC fa:16:3e:54:54:b8, not building metadata {{(pid=75165) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 00:21:57 user nova-compute[75165]: DEBUG nova.compute.manager [req-088247a0-8aa8-4dec-9f59-d87c7d06c17e req-201ca988-c3f3-40e2-9c36-8773abc911bc service nova] [instance: 27fa1771-fb69-49da-81b3-7f112e623170] Received event network-vif-plugged-4d97651b-5d7c-4778-85a4-a11588892b31 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:21:57 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-088247a0-8aa8-4dec-9f59-d87c7d06c17e req-201ca988-c3f3-40e2-9c36-8773abc911bc service nova] Acquiring lock "27fa1771-fb69-49da-81b3-7f112e623170-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:21:57 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-088247a0-8aa8-4dec-9f59-d87c7d06c17e req-201ca988-c3f3-40e2-9c36-8773abc911bc service nova] Lock "27fa1771-fb69-49da-81b3-7f112e623170-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:21:57 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-088247a0-8aa8-4dec-9f59-d87c7d06c17e req-201ca988-c3f3-40e2-9c36-8773abc911bc service nova] Lock "27fa1771-fb69-49da-81b3-7f112e623170-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:21:57 user nova-compute[75165]: DEBUG nova.compute.manager [req-088247a0-8aa8-4dec-9f59-d87c7d06c17e req-201ca988-c3f3-40e2-9c36-8773abc911bc service nova] [instance: 27fa1771-fb69-49da-81b3-7f112e623170] No waiting events found dispatching network-vif-plugged-4d97651b-5d7c-4778-85a4-a11588892b31 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:21:57 user nova-compute[75165]: WARNING nova.compute.manager [req-088247a0-8aa8-4dec-9f59-d87c7d06c17e req-201ca988-c3f3-40e2-9c36-8773abc911bc service nova] [instance: 27fa1771-fb69-49da-81b3-7f112e623170] Received unexpected event network-vif-plugged-4d97651b-5d7c-4778-85a4-a11588892b31 for instance with vm_state stopped and task_state powering-on.
Oct 26 00:21:57 user nova-compute[75165]: DEBUG nova.compute.manager [None req-d4530d31-5bac-40d1-a08d-22ec2f429dda tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] [instance: 27fa1771-fb69-49da-81b3-7f112e623170] Instance event wait completed in 0 seconds for  {{(pid=75165) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 00:21:57 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: 27fa1771-fb69-49da-81b3-7f112e623170] Instance rebooted successfully.
Oct 26 00:21:57 user nova-compute[75165]: DEBUG nova.compute.manager [None req-d4530d31-5bac-40d1-a08d-22ec2f429dda tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] [instance: 27fa1771-fb69-49da-81b3-7f112e623170] Checking state {{(pid=75165) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 00:21:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:21:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:21:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:21:58 user nova-compute[75165]: DEBUG nova.compute.manager [req-19e18322-4508-4777-8a60-4e6d2cb1a600 req-5aa7eef9-29ab-47b1-9cd5-77db74901291 service nova] [instance: bad6c21f-885f-4348-86f7-b237ce2d241b] Received event network-vif-plugged-b64d421a-ca91-4f21-80f7-17b0c17ceb8a {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:21:58 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-19e18322-4508-4777-8a60-4e6d2cb1a600 req-5aa7eef9-29ab-47b1-9cd5-77db74901291 service nova] Acquiring lock "bad6c21f-885f-4348-86f7-b237ce2d241b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:21:58 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-19e18322-4508-4777-8a60-4e6d2cb1a600 req-5aa7eef9-29ab-47b1-9cd5-77db74901291 service nova] Lock "bad6c21f-885f-4348-86f7-b237ce2d241b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:21:58 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-19e18322-4508-4777-8a60-4e6d2cb1a600 req-5aa7eef9-29ab-47b1-9cd5-77db74901291 service nova] Lock "bad6c21f-885f-4348-86f7-b237ce2d241b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:21:58 user nova-compute[75165]: DEBUG nova.compute.manager [req-19e18322-4508-4777-8a60-4e6d2cb1a600 req-5aa7eef9-29ab-47b1-9cd5-77db74901291 service nova] [instance: bad6c21f-885f-4348-86f7-b237ce2d241b] No waiting events found dispatching network-vif-plugged-b64d421a-ca91-4f21-80f7-17b0c17ceb8a {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:21:58 user nova-compute[75165]: WARNING nova.compute.manager [req-19e18322-4508-4777-8a60-4e6d2cb1a600 req-5aa7eef9-29ab-47b1-9cd5-77db74901291 service nova] [instance: bad6c21f-885f-4348-86f7-b237ce2d241b] Received unexpected event network-vif-plugged-b64d421a-ca91-4f21-80f7-17b0c17ceb8a for instance with vm_state active and task_state resize_finish.
Oct 26 00:21:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:21:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:21:59 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:22:00 user nova-compute[75165]: DEBUG nova.compute.manager [req-74e91d7e-4ab1-4ee0-a769-3c8369cc19c6 req-e170235b-e8aa-47fe-8549-da23ebc39090 service nova] [instance: bad6c21f-885f-4348-86f7-b237ce2d241b] Received event network-vif-plugged-b64d421a-ca91-4f21-80f7-17b0c17ceb8a {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:22:00 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-74e91d7e-4ab1-4ee0-a769-3c8369cc19c6 req-e170235b-e8aa-47fe-8549-da23ebc39090 service nova] Acquiring lock "bad6c21f-885f-4348-86f7-b237ce2d241b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:22:00 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-74e91d7e-4ab1-4ee0-a769-3c8369cc19c6 req-e170235b-e8aa-47fe-8549-da23ebc39090 service nova] Lock "bad6c21f-885f-4348-86f7-b237ce2d241b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:22:00 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-74e91d7e-4ab1-4ee0-a769-3c8369cc19c6 req-e170235b-e8aa-47fe-8549-da23ebc39090 service nova] Lock "bad6c21f-885f-4348-86f7-b237ce2d241b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:22:00 user nova-compute[75165]: DEBUG nova.compute.manager [req-74e91d7e-4ab1-4ee0-a769-3c8369cc19c6 req-e170235b-e8aa-47fe-8549-da23ebc39090 service nova] [instance: bad6c21f-885f-4348-86f7-b237ce2d241b] No waiting events found dispatching network-vif-plugged-b64d421a-ca91-4f21-80f7-17b0c17ceb8a {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:22:00 user nova-compute[75165]: WARNING nova.compute.manager [req-74e91d7e-4ab1-4ee0-a769-3c8369cc19c6 req-e170235b-e8aa-47fe-8549-da23ebc39090 service nova] [instance: bad6c21f-885f-4348-86f7-b237ce2d241b] Received unexpected event network-vif-plugged-b64d421a-ca91-4f21-80f7-17b0c17ceb8a for instance with vm_state active and task_state resize_finish.
Oct 26 00:22:00 user nova-compute[75165]: DEBUG nova.compute.manager [None req-479af9a7-a575-49e6-a522-b6c26c6c65a9 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: bad6c21f-885f-4348-86f7-b237ce2d241b] Instance event wait completed in 0 seconds for  {{(pid=75165) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 00:22:00 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: bad6c21f-885f-4348-86f7-b237ce2d241b] Instance running successfully.
Oct 26 00:22:00 user nova-compute[75165]: DEBUG nova.virt.libvirt.guest [None req-479af9a7-a575-49e6-a522-b6c26c6c65a9 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: bad6c21f-885f-4348-86f7-b237ce2d241b] Failed to set time: agent not configured {{(pid=75165) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Oct 26 00:22:00 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-479af9a7-a575-49e6-a522-b6c26c6c65a9 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: bad6c21f-885f-4348-86f7-b237ce2d241b] finish_migration finished successfully. {{(pid=75165) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Oct 26 00:22:01 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:22:02 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:22:06 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:22:06 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75165) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 00:22:07 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:22:07 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-8fe81392-6b1e-4c58-8465-728b8ff27078 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 91fe894a-90a8-4545-9b27-91771554c4cb is timed out.
Oct 26 00:22:07 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-8fe81392-6b1e-4c58-8465-728b8ff27078 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Successfully detached device vdb from instance 91fe894a-90a8-4545-9b27-91771554c4cb from the live domain config.
Oct 26 00:22:07 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8fe81392-6b1e-4c58-8465-728b8ff27078 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: 91fe894a-90a8-4545-9b27-91771554c4cb] calling os-brick to detach iSCSI Volume {{(pid=75165) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 00:22:07 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fe81392-6b1e-4c58-8465-728b8ff27078 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8bf8160e50>, {'target_iqn': 'iqn.2010-10.org.openstack:f06e40e7-3ca1-4a25-bd11-ff01280c6df2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mcRWVrAX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:22:07 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-8fe81392-6b1e-4c58-8465-728b8ff27078 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:22:07 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-8fe81392-6b1e-4c58-8465-728b8ff27078 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:22:07 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-8fe81392-6b1e-4c58-8465-728b8ff27078 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:22:07 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:22:07 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:22:07 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[cac88003-b5f5-4bd7-a8b2-de5494e9f595]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f06e40e7-3ca1-4a25-bd11-ff01280c6df2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:99a43689-b7cd-47e6-ae88-fd8ba07c60c1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:652b4bd0-93f8-4553-bddd-e432f7ec1142\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:22:07 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fe81392-6b1e-4c58-8465-728b8ff27078 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 00:22:07 user nova-compute[75165]: No targets found.
Oct 26 00:22:07 user nova-compute[75165]: iSNS:
Oct 26 00:22:07 user nova-compute[75165]: No targets found.
Oct 26 00:22:07 user nova-compute[75165]: STATIC:
Oct 26 00:22:07 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:f06e40e7-3ca1-4a25-bd11-ff01280c6df2
Oct 26 00:22:07 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:22:07 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:22:07 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:99a43689-b7cd-47e6-ae88-fd8ba07c60c1
Oct 26 00:22:07 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:22:07 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:22:07 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:652b4bd0-93f8-4553-bddd-e432f7ec1142
Oct 26 00:22:07 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:22:07 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:22:07 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795
Oct 26 00:22:07 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:22:07 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:22:07 user nova-compute[75165]: FIRMWARE:
Oct 26 00:22:07 user nova-compute[75165]: No targets found.
Oct 26 00:22:07 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:22:07 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fe81392-6b1e-4c58-8465-728b8ff27078 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 00:22:07 user nova-compute[75165]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 00:22:07 user nova-compute[75165]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75165) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 00:22:07 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fe81392-6b1e-4c58-8465-728b8ff27078 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f06e40e7-3ca1-4a25-bd11-ff01280c6df2', 0)] {{(pid=75165) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 00:22:07 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:22:07 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:22:07 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[50be8785-05d1-4b89-a06d-5b36bdf2202e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:652b4bd0-93f8-4553-bddd-e432f7ec1142\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99a43689-b7cd-47e6-ae88-fd8ba07c60c1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f06e40e7-3ca1-4a25-bd11-ff01280c6df2\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:22:07 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:22:07 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:22:07 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[8206ab1e-68aa-4425-a836-880d5cd1b096]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f06e40e7-3ca1-4a25-bd11-ff01280c6df2 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:652b4bd0-93f8-4553-bddd-e432f7ec1142 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a43689-b7cd-47e6-ae88-fd8ba07c60c1 (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:22:07 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fe81392-6b1e-4c58-8465-728b8ff27078 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f06e40e7-3ca1-4a25-bd11-ff01280c6df2 (non-flash)
Oct 26 00:22:07 user nova-compute[75165]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)
Oct 26 00:22:07 user nova-compute[75165]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:652b4bd0-93f8-4553-bddd-e432f7ec1142 (non-flash)
Oct 26 00:22:07 user nova-compute[75165]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a43689-b7cd-47e6-ae88-fd8ba07c60c1 (non-flash)
Oct 26 00:22:07 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:22:07 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fe81392-6b1e-4c58-8465-728b8ff27078 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f06e40e7-3ca1-4a25-bd11-ff01280c6df2 (non-flash)
Oct 26 00:22:07 user nova-compute[75165]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)
Oct 26 00:22:07 user nova-compute[75165]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:652b4bd0-93f8-4553-bddd-e432f7ec1142 (non-flash)
Oct 26 00:22:07 user nova-compute[75165]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a43689-b7cd-47e6-ae88-fd8ba07c60c1 (non-flash)
Oct 26 00:22:07 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:22:07 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fe81392-6b1e-4c58-8465-728b8ff27078 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8be02cbe20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f06e40e7-3ca1-4a25-bd11-ff01280c6df2'): ({'sdc'}, set())}) {{(pid=75165) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 00:22:07 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-8fe81392-6b1e-4c58-8465-728b8ff27078 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Removing single pathed devices sdc {{(pid=75165) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 00:22:07 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:22:07 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:22:07 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a5a881a-ba7a-4c41-974a-142d41502714]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:22:07 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:22:07 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:22:07 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[eece31d2-d02a-47ba-9d31-5b1e9f538cf7]: (4, ('ok\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:22:07 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-8fe81392-6b1e-4c58-8465-728b8ff27078 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Flushing IO for device /dev/sdc {{(pid=75165) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 00:22:07 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:22:07 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:22:07 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[3934f035-3e9b-4592-aa7b-7bd6916c5a12]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:22:07 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-8fe81392-6b1e-4c58-8465-728b8ff27078 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75165) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 00:22:07 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:22:07 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:22:07 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc69a7a2-901d-4216-bfc9-ab4e747c31fd]: (4, ('1', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:22:07 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-8fe81392-6b1e-4c58-8465-728b8ff27078 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75165) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 00:22:07 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-8fe81392-6b1e-4c58-8465-728b8ff27078 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] SCSI volumes sdc have been removed. {{(pid=75165) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 00:22:07 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fe81392-6b1e-4c58-8465-728b8ff27078 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f06e40e7-3ca1-4a25-bd11-ff01280c6df2')] {{(pid=75165) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 00:22:07 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f06e40e7-3ca1-4a25-bd11-ff01280c6df2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:22:07 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f06e40e7-3ca1-4a25-bd11-ff01280c6df2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:22:07 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[1241d7cb-c22e-45b2-ae2c-8b77b2c26ab2]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:22:07 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fe81392-6b1e-4c58-8465-728b8ff27078 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:22:07 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f06e40e7-3ca1-4a25-bd11-ff01280c6df2 -p 172.16.0.220:3260 --logout {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:22:07 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f06e40e7-3ca1-4a25-bd11-ff01280c6df2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:22:07 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6b9349c-34ab-41b4-8b16-bc70c7560e49]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:f06e40e7-3ca1-4a25-bd11-ff01280c6df2, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:f06e40e7-3ca1-4a25-bd11-ff01280c6df2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:22:07 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fe81392-6b1e-4c58-8465-728b8ff27078 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:f06e40e7-3ca1-4a25-bd11-ff01280c6df2, portal: 172.16.0.220,3260]
Oct 26 00:22:07 user nova-compute[75165]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:f06e40e7-3ca1-4a25-bd11-ff01280c6df2, portal: 172.16.0.220,3260] successful.
Oct 26 00:22:07 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:22:07 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f06e40e7-3ca1-4a25-bd11-ff01280c6df2 -p 172.16.0.220:3260 --op delete {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:22:07 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f06e40e7-3ca1-4a25-bd11-ff01280c6df2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:22:07 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf9fab18-f2d9-4221-a71b-dd41c92842f9]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:22:07 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fe81392-6b1e-4c58-8465-728b8ff27078 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:22:07 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-8fe81392-6b1e-4c58-8465-728b8ff27078 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.333s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:22:07 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fe81392-6b1e-4c58-8465-728b8ff27078 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] <== disconnect_volume: return (334ms) None {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:22:07 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8fe81392-6b1e-4c58-8465-728b8ff27078 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: 91fe894a-90a8-4545-9b27-91771554c4cb] Disconnected iSCSI Volume {{(pid=75165) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 00:22:07 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:22:08 user nova-compute[75165]: DEBUG nova.objects.instance [None req-8fe81392-6b1e-4c58-8465-728b8ff27078 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Lazy-loading 'flavor' on Instance uuid 91fe894a-90a8-4545-9b27-91771554c4cb {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:22:08 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-8fe81392-6b1e-4c58-8465-728b8ff27078 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Lock "91fe894a-90a8-4545-9b27-91771554c4cb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.148s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:22:10 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:22:10 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:22:11 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:22:12 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:22:12 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:22:12 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:22:12 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:22:12 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:22:12 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:22:12 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75165) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 00:22:13 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75165) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 00:22:13 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84c6b624-648b-40e2-a37e-ff08609bad84/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:22:13 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84c6b624-648b-40e2-a37e-ff08609bad84/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:22:13 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84c6b624-648b-40e2-a37e-ff08609bad84/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:22:13 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84c6b624-648b-40e2-a37e-ff08609bad84/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:22:13 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97fb67a7-637d-456f-b4dd-0a271ed6cfc4/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:22:13 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97fb67a7-637d-456f-b4dd-0a271ed6cfc4/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:22:13 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97fb67a7-637d-456f-b4dd-0a271ed6cfc4/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:22:13 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97fb67a7-637d-456f-b4dd-0a271ed6cfc4/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:22:13 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7eeb145-1565-4812-818b-fefda5f2436d/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:22:14 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7eeb145-1565-4812-818b-fefda5f2436d/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:22:14 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7eeb145-1565-4812-818b-fefda5f2436d/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:22:14 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7eeb145-1565-4812-818b-fefda5f2436d/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:22:14 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75165) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 00:22:14 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e44bfc-6a68-46ce-8335-aaaba5160d3e/disk.rescue --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:22:14 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e44bfc-6a68-46ce-8335-aaaba5160d3e/disk.rescue --force-share --output=json" returned: 0 in 0.200s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:22:14 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e44bfc-6a68-46ce-8335-aaaba5160d3e/disk.rescue --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:22:14 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e44bfc-6a68-46ce-8335-aaaba5160d3e/disk.rescue --force-share --output=json" returned: 0 in 0.210s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:22:14 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e44bfc-6a68-46ce-8335-aaaba5160d3e/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:22:14 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e44bfc-6a68-46ce-8335-aaaba5160d3e/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:22:14 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e44bfc-6a68-46ce-8335-aaaba5160d3e/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:22:15 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e44bfc-6a68-46ce-8335-aaaba5160d3e/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:22:15 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27fa1771-fb69-49da-81b3-7f112e623170/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:22:15 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27fa1771-fb69-49da-81b3-7f112e623170/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:22:15 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27fa1771-fb69-49da-81b3-7f112e623170/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:22:15 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27fa1771-fb69-49da-81b3-7f112e623170/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:22:15 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91fe894a-90a8-4545-9b27-91771554c4cb/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:22:15 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91fe894a-90a8-4545-9b27-91771554c4cb/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:22:15 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91fe894a-90a8-4545-9b27-91771554c4cb/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:22:15 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91fe894a-90a8-4545-9b27-91771554c4cb/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:22:16 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:22:16 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:22:16 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:22:16 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Hypervisor/Node resource view: name=user free_ram=8049MB free_disk=24.99496078491211GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75165) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 00:22:16 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:22:16 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:22:16 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Applying migration context for instance bad6c21f-885f-4348-86f7-b237ce2d241b as it has an incoming, in-progress migration ce1b14f5-5eda-4c2f-9326-42b5128167e0. Migration status is finished {{(pid=75165) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Oct 26 00:22:16 user nova-compute[75165]: INFO nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: bad6c21f-885f-4348-86f7-b237ce2d241b] Updating resource usage from migration ce1b14f5-5eda-4c2f-9326-42b5128167e0
Oct 26 00:22:16 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 84c6b624-648b-40e2-a37e-ff08609bad84 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:22:16 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance c4e44bfc-6a68-46ce-8335-aaaba5160d3e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:22:16 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance a7eeb145-1565-4812-818b-fefda5f2436d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:22:16 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 27fa1771-fb69-49da-81b3-7f112e623170 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:22:16 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 91fe894a-90a8-4545-9b27-91771554c4cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:22:16 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 97fb67a7-637d-456f-b4dd-0a271ed6cfc4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:22:16 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Migration ce1b14f5-5eda-4c2f-9326-42b5128167e0 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Oct 26 00:22:16 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance bad6c21f-885f-4348-86f7-b237ce2d241b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:22:16 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:22:16 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75165) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 00:22:16 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75165) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 00:22:16 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:22:16 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:22:17 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Compute_service record updated for user:user {{(pid=75165) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 00:22:17 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.538s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:22:17 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:22:18 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:22:18 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Starting heal instance info cache {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 00:22:18 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Rebuilding the list of instances to heal {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 00:22:18 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "refresh_cache-84c6b624-648b-40e2-a37e-ff08609bad84" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:22:18 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquired lock "refresh_cache-84c6b624-648b-40e2-a37e-ff08609bad84" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:22:18 user nova-compute[75165]: DEBUG nova.network.neutron [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: 84c6b624-648b-40e2-a37e-ff08609bad84] Forcefully refreshing network info cache for instance {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 00:22:18 user nova-compute[75165]: DEBUG nova.objects.instance [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lazy-loading 'info_cache' on Instance uuid 84c6b624-648b-40e2-a37e-ff08609bad84 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:22:18 user nova-compute[75165]: DEBUG nova.network.neutron [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: 84c6b624-648b-40e2-a37e-ff08609bad84] Updating instance_info_cache with network_info: [{"id": "2107529c-ec0e-4d1d-85b4-8605dcabc415", "address": "fa:16:3e:0c:8a:94", "network": {"id": "b31bac4b-1951-4ca3-8682-f1f24de0a5c3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1323234642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71aa69c0ea2d49e184e1e055ff3efa1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2107529c-ec", "ovs_interfaceid": "2107529c-ec0e-4d1d-85b4-8605dcabc415", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:22:18 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Releasing lock "refresh_cache-84c6b624-648b-40e2-a37e-ff08609bad84" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:22:18 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: 84c6b624-648b-40e2-a37e-ff08609bad84] Updated the network info_cache for instance {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 00:22:18 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:22:18 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:22:20 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:22:21 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:22:22 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:22:22 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:22:26 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:22:27 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:22:31 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:22:32 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:22:36 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:22:37 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-35f50adc-0a57-4d40-943a-694aa24a9c58 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Acquiring lock "91fe894a-90a8-4545-9b27-91771554c4cb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:22:37 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-35f50adc-0a57-4d40-943a-694aa24a9c58 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Lock "91fe894a-90a8-4545-9b27-91771554c4cb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:22:37 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-35f50adc-0a57-4d40-943a-694aa24a9c58 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Acquiring lock "91fe894a-90a8-4545-9b27-91771554c4cb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:22:37 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-35f50adc-0a57-4d40-943a-694aa24a9c58 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Lock "91fe894a-90a8-4545-9b27-91771554c4cb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:22:37 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-35f50adc-0a57-4d40-943a-694aa24a9c58 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Lock "91fe894a-90a8-4545-9b27-91771554c4cb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:22:37 user nova-compute[75165]: INFO nova.compute.manager [None req-35f50adc-0a57-4d40-943a-694aa24a9c58 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: 91fe894a-90a8-4545-9b27-91771554c4cb] Terminating instance
Oct 26 00:22:37 user nova-compute[75165]: DEBUG nova.compute.manager [None req-35f50adc-0a57-4d40-943a-694aa24a9c58 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: 91fe894a-90a8-4545-9b27-91771554c4cb] Start destroying the instance on the hypervisor. {{(pid=75165) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 00:22:37 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:22:37 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:22:37 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:22:37 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:22:37 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:22:37 user nova-compute[75165]: DEBUG nova.compute.manager [req-be231941-a2e8-4469-b86c-efedc052b8df req-37903ade-17b5-4586-af77-574537db7609 service nova] [instance: 91fe894a-90a8-4545-9b27-91771554c4cb] Received event network-vif-unplugged-67590aab-15ed-4684-abd7-64a5c0a9b3f5 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:22:37 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-be231941-a2e8-4469-b86c-efedc052b8df req-37903ade-17b5-4586-af77-574537db7609 service nova] Acquiring lock "91fe894a-90a8-4545-9b27-91771554c4cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:22:37 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-be231941-a2e8-4469-b86c-efedc052b8df req-37903ade-17b5-4586-af77-574537db7609 service nova] Lock "91fe894a-90a8-4545-9b27-91771554c4cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:22:37 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-be231941-a2e8-4469-b86c-efedc052b8df req-37903ade-17b5-4586-af77-574537db7609 service nova] Lock "91fe894a-90a8-4545-9b27-91771554c4cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:22:37 user nova-compute[75165]: DEBUG nova.compute.manager [req-be231941-a2e8-4469-b86c-efedc052b8df req-37903ade-17b5-4586-af77-574537db7609 service nova] [instance: 91fe894a-90a8-4545-9b27-91771554c4cb] No waiting events found dispatching network-vif-unplugged-67590aab-15ed-4684-abd7-64a5c0a9b3f5 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:22:37 user nova-compute[75165]: DEBUG nova.compute.manager [req-be231941-a2e8-4469-b86c-efedc052b8df req-37903ade-17b5-4586-af77-574537db7609 service nova] [instance: 91fe894a-90a8-4545-9b27-91771554c4cb] Received event network-vif-unplugged-67590aab-15ed-4684-abd7-64a5c0a9b3f5 for instance with task_state deleting. {{(pid=75165) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 00:22:37 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: 91fe894a-90a8-4545-9b27-91771554c4cb] Instance destroyed successfully.
Oct 26 00:22:37 user nova-compute[75165]: DEBUG nova.objects.instance [None req-35f50adc-0a57-4d40-943a-694aa24a9c58 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Lazy-loading 'resources' on Instance uuid 91fe894a-90a8-4545-9b27-91771554c4cb {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:22:37 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-35f50adc-0a57-4d40-943a-694aa24a9c58 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:15:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1293782971',display_name='tempest-ServerRescueNegativeTestJSON-server-1293782971',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1293782971',id=23,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBicVhnhgJ5DNvonotHh5eL/FfSiR8puDkSZx2aq/ImVCudvj05xCLa3mBVFpugWErX29hnO7slb7sxcE+mwD9p4LdVUoCg84e+AG2ngoSo376olvea13D0Ut/PwRlNsAQ==',key_name='tempest-keypair-12008961',keypairs=<?>,launch_index=0,launched_at=2023-10-26T00:18:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='71aa69c0ea2d49e184e1e055ff3efa1d',ramdisk_id='',reservation_id='r-ciht86kf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-2141505807',owner_user_name='tempest-ServerRescueNegativeTestJSON-2141505807-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T00:19:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='67876ca3211b47bc99af08436edeb91f',uuid=91fe894a-90a8-4545-9b27-91771554c4cb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "67590aab-15ed-4684-abd7-64a5c0a9b3f5", "address": "fa:16:3e:7a:ea:a8", "network": {"id": "b31bac4b-1951-4ca3-8682-f1f24de0a5c3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1323234642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71aa69c0ea2d49e184e1e055ff3efa1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67590aab-15", "ovs_interfaceid": "67590aab-15ed-4684-abd7-64a5c0a9b3f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 00:22:37 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-35f50adc-0a57-4d40-943a-694aa24a9c58 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Converting VIF {"id": "67590aab-15ed-4684-abd7-64a5c0a9b3f5", "address": "fa:16:3e:7a:ea:a8", "network": {"id": "b31bac4b-1951-4ca3-8682-f1f24de0a5c3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1323234642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71aa69c0ea2d49e184e1e055ff3efa1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67590aab-15", "ovs_interfaceid": "67590aab-15ed-4684-abd7-64a5c0a9b3f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:22:37 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-35f50adc-0a57-4d40-943a-694aa24a9c58 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7a:ea:a8,bridge_name='br-int',has_traffic_filtering=True,id=67590aab-15ed-4684-abd7-64a5c0a9b3f5,network=Network(b31bac4b-1951-4ca3-8682-f1f24de0a5c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67590aab-15') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:22:37 user nova-compute[75165]: DEBUG os_vif [None req-35f50adc-0a57-4d40-943a-694aa24a9c58 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7a:ea:a8,bridge_name='br-int',has_traffic_filtering=True,id=67590aab-15ed-4684-abd7-64a5c0a9b3f5,network=Network(b31bac4b-1951-4ca3-8682-f1f24de0a5c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67590aab-15') {{(pid=75165) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 00:22:37 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:22:37 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap67590aab-15, bridge=br-int, if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:22:37 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:22:37 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:22:37 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:22:37 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0bbf8d77-07bb-4c99-914b-0ecccb50e721) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:22:37 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:22:37 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:22:37 user nova-compute[75165]: INFO os_vif [None req-35f50adc-0a57-4d40-943a-694aa24a9c58 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7a:ea:a8,bridge_name='br-int',has_traffic_filtering=True,id=67590aab-15ed-4684-abd7-64a5c0a9b3f5,network=Network(b31bac4b-1951-4ca3-8682-f1f24de0a5c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67590aab-15')
Oct 26 00:22:37 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-35f50adc-0a57-4d40-943a-694aa24a9c58 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: 91fe894a-90a8-4545-9b27-91771554c4cb] Deleting instance files /opt/stack/data/nova/instances/91fe894a-90a8-4545-9b27-91771554c4cb_del
Oct 26 00:22:37 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-35f50adc-0a57-4d40-943a-694aa24a9c58 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: 91fe894a-90a8-4545-9b27-91771554c4cb] Deletion of /opt/stack/data/nova/instances/91fe894a-90a8-4545-9b27-91771554c4cb_del complete
Oct 26 00:22:38 user nova-compute[75165]: INFO nova.compute.manager [None req-35f50adc-0a57-4d40-943a-694aa24a9c58 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: 91fe894a-90a8-4545-9b27-91771554c4cb] Took 0.87 seconds to destroy the instance on the hypervisor.
Oct 26 00:22:38 user nova-compute[75165]: DEBUG oslo.service.loopingcall [None req-35f50adc-0a57-4d40-943a-694aa24a9c58 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75165) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 00:22:38 user nova-compute[75165]: DEBUG nova.compute.manager [-] [instance: 91fe894a-90a8-4545-9b27-91771554c4cb] Deallocating network for instance {{(pid=75165) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 00:22:38 user nova-compute[75165]: DEBUG nova.network.neutron [-] [instance: 91fe894a-90a8-4545-9b27-91771554c4cb] deallocate_for_instance() {{(pid=75165) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 00:22:38 user nova-compute[75165]: DEBUG nova.network.neutron [-] [instance: 91fe894a-90a8-4545-9b27-91771554c4cb] Updating instance_info_cache with network_info: [] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:22:38 user nova-compute[75165]: INFO nova.compute.manager [-] [instance: 91fe894a-90a8-4545-9b27-91771554c4cb] Took 0.89 seconds to deallocate network for instance.
Oct 26 00:22:38 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-35f50adc-0a57-4d40-943a-694aa24a9c58 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:22:38 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-35f50adc-0a57-4d40-943a-694aa24a9c58 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:22:39 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-35f50adc-0a57-4d40-943a-694aa24a9c58 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:22:39 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-35f50adc-0a57-4d40-943a-694aa24a9c58 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:22:39 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-35f50adc-0a57-4d40-943a-694aa24a9c58 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.322s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:22:39 user nova-compute[75165]: INFO nova.scheduler.client.report [None req-35f50adc-0a57-4d40-943a-694aa24a9c58 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Deleted allocations for instance 91fe894a-90a8-4545-9b27-91771554c4cb
Oct 26 00:22:39 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-35f50adc-0a57-4d40-943a-694aa24a9c58 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Lock "91fe894a-90a8-4545-9b27-91771554c4cb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.288s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:22:39 user nova-compute[75165]: DEBUG nova.compute.manager [req-9c729e53-8a1b-4300-bbd6-c6fd9f4f2f9d req-fc3b01a0-e05c-4871-a287-0d5c63aad90e service nova] [instance: 91fe894a-90a8-4545-9b27-91771554c4cb] Received event network-vif-plugged-67590aab-15ed-4684-abd7-64a5c0a9b3f5 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:22:39 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-9c729e53-8a1b-4300-bbd6-c6fd9f4f2f9d req-fc3b01a0-e05c-4871-a287-0d5c63aad90e service nova] Acquiring lock "91fe894a-90a8-4545-9b27-91771554c4cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:22:39 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-9c729e53-8a1b-4300-bbd6-c6fd9f4f2f9d req-fc3b01a0-e05c-4871-a287-0d5c63aad90e service nova] Lock "91fe894a-90a8-4545-9b27-91771554c4cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:22:39 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-9c729e53-8a1b-4300-bbd6-c6fd9f4f2f9d req-fc3b01a0-e05c-4871-a287-0d5c63aad90e service nova] Lock "91fe894a-90a8-4545-9b27-91771554c4cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:22:39 user nova-compute[75165]: DEBUG nova.compute.manager [req-9c729e53-8a1b-4300-bbd6-c6fd9f4f2f9d req-fc3b01a0-e05c-4871-a287-0d5c63aad90e service nova] [instance: 91fe894a-90a8-4545-9b27-91771554c4cb] No waiting events found dispatching network-vif-plugged-67590aab-15ed-4684-abd7-64a5c0a9b3f5 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:22:39 user nova-compute[75165]: WARNING nova.compute.manager [req-9c729e53-8a1b-4300-bbd6-c6fd9f4f2f9d req-fc3b01a0-e05c-4871-a287-0d5c63aad90e service nova] [instance: 91fe894a-90a8-4545-9b27-91771554c4cb] Received unexpected event network-vif-plugged-67590aab-15ed-4684-abd7-64a5c0a9b3f5 for instance with vm_state deleted and task_state None.
Oct 26 00:22:39 user nova-compute[75165]: DEBUG nova.compute.manager [req-9c729e53-8a1b-4300-bbd6-c6fd9f4f2f9d req-fc3b01a0-e05c-4871-a287-0d5c63aad90e service nova] [instance: 91fe894a-90a8-4545-9b27-91771554c4cb] Received event network-vif-deleted-67590aab-15ed-4684-abd7-64a5c0a9b3f5 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:22:42 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:22:47 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:22:52 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:22:56 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:22:57 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:23:01 user nova-compute[75165]: INFO nova.compute.manager [None req-33d2f8fe-8dbb-4332-bbfd-4c4ca061f7f7 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb] Rescuing
Oct 26 00:23:01 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-33d2f8fe-8dbb-4332-bbfd-4c4ca061f7f7 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Acquiring lock "refresh_cache-a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:23:01 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-33d2f8fe-8dbb-4332-bbfd-4c4ca061f7f7 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Acquired lock "refresh_cache-a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:23:01 user nova-compute[75165]: DEBUG nova.network.neutron [None req-33d2f8fe-8dbb-4332-bbfd-4c4ca061f7f7 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb] Building network info cache for instance {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 00:23:02 user nova-compute[75165]: DEBUG nova.network.neutron [None req-33d2f8fe-8dbb-4332-bbfd-4c4ca061f7f7 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb] Updating instance_info_cache with network_info: [{"id": "e2143e91-9f8c-4670-9f92-c2c00827a619", "address": "fa:16:3e:6c:b7:14", "network": {"id": "eb55c0bc-cae5-4ba3-851a-e31a50b52c88", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1081223830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d616862c7c184de5b0ba3121552c5666", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2143e91-9f", "ovs_interfaceid": "e2143e91-9f8c-4670-9f92-c2c00827a619", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:23:02 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-33d2f8fe-8dbb-4332-bbfd-4c4ca061f7f7 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Releasing lock "refresh_cache-a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:23:02 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:23:02 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:23:02 user nova-compute[75165]: DEBUG nova.compute.manager [req-d3dbc64a-98ea-4007-8f76-f54b06e0b69f req-a395a26f-9cb1-4531-b45e-7efa9494468e service nova] [instance: a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb] Received event network-vif-unplugged-e2143e91-9f8c-4670-9f92-c2c00827a619 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:23:02 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-d3dbc64a-98ea-4007-8f76-f54b06e0b69f req-a395a26f-9cb1-4531-b45e-7efa9494468e service nova] Acquiring lock "a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:23:02 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-d3dbc64a-98ea-4007-8f76-f54b06e0b69f req-a395a26f-9cb1-4531-b45e-7efa9494468e service nova] Lock "a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:23:02 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-d3dbc64a-98ea-4007-8f76-f54b06e0b69f req-a395a26f-9cb1-4531-b45e-7efa9494468e service nova] Lock "a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:23:02 user nova-compute[75165]: DEBUG nova.compute.manager [req-d3dbc64a-98ea-4007-8f76-f54b06e0b69f req-a395a26f-9cb1-4531-b45e-7efa9494468e service nova] [instance: a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb] No waiting events found dispatching network-vif-unplugged-e2143e91-9f8c-4670-9f92-c2c00827a619 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:23:02 user nova-compute[75165]: WARNING nova.compute.manager [req-d3dbc64a-98ea-4007-8f76-f54b06e0b69f req-a395a26f-9cb1-4531-b45e-7efa9494468e service nova] [instance: a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb] Received unexpected event network-vif-unplugged-e2143e91-9f8c-4670-9f92-c2c00827a619 for instance with vm_state active and task_state rescuing.
Oct 26 00:23:02 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:23:02 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:23:02 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:23:03 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb] Instance destroyed successfully.
Oct 26 00:23:03 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-33d2f8fe-8dbb-4332-bbfd-4c4ca061f7f7 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb] Attempting a stable device rescue
Oct 26 00:23:03 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-33d2f8fe-8dbb-4332-bbfd-4c4ca061f7f7 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75165) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 26 00:23:03 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-33d2f8fe-8dbb-4332-bbfd-4c4ca061f7f7 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb] Instance directory exists: not creating {{(pid=75165) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 26 00:23:03 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-33d2f8fe-8dbb-4332-bbfd-4c4ca061f7f7 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb] Creating image(s)
Oct 26 00:23:03 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-33d2f8fe-8dbb-4332-bbfd-4c4ca061f7f7 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Acquiring lock "/opt/stack/data/nova/instances/a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:23:03 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-33d2f8fe-8dbb-4332-bbfd-4c4ca061f7f7 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Lock "/opt/stack/data/nova/instances/a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:23:03 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-33d2f8fe-8dbb-4332-bbfd-4c4ca061f7f7 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Lock "/opt/stack/data/nova/instances/a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:23:03 user nova-compute[75165]: DEBUG nova.objects.instance [None req-33d2f8fe-8dbb-4332-bbfd-4c4ca061f7f7 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Lazy-loading 'trusted_certs' on Instance uuid a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:23:03 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-33d2f8fe-8dbb-4332-bbfd-4c4ca061f7f7 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Acquiring lock "49357207bed21777afe2b2880087c861e2355c6b" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:23:03 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-33d2f8fe-8dbb-4332-bbfd-4c4ca061f7f7 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Lock "49357207bed21777afe2b2880087c861e2355c6b" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:23:04 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-33d2f8fe-8dbb-4332-bbfd-4c4ca061f7f7 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/49357207bed21777afe2b2880087c861e2355c6b.part --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:23:04 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-33d2f8fe-8dbb-4332-bbfd-4c4ca061f7f7 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/49357207bed21777afe2b2880087c861e2355c6b.part --force-share --output=json" returned: 0 in 0.174s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:23:04 user nova-compute[75165]: DEBUG nova.virt.images [None req-33d2f8fe-8dbb-4332-bbfd-4c4ca061f7f7 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] 92122ab0-4996-4578-8487-3353aa4e4a8b was qcow2, converting to raw {{(pid=75165) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 26 00:23:04 user nova-compute[75165]: DEBUG nova.privsep.utils [None req-33d2f8fe-8dbb-4332-bbfd-4c4ca061f7f7 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75165) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 26 00:23:04 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-33d2f8fe-8dbb-4332-bbfd-4c4ca061f7f7 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/49357207bed21777afe2b2880087c861e2355c6b.part /opt/stack/data/nova/instances/_base/49357207bed21777afe2b2880087c861e2355c6b.converted {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:23:04 user nova-compute[75165]: DEBUG nova.compute.manager [req-cb27bc0d-8d83-4b79-bc6a-eefcce1ed5dd req-a9ccdff9-badd-4d96-8c4c-613a16e73eb7 service nova] [instance: a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb] Received event network-vif-plugged-e2143e91-9f8c-4670-9f92-c2c00827a619 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:23:04 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-cb27bc0d-8d83-4b79-bc6a-eefcce1ed5dd req-a9ccdff9-badd-4d96-8c4c-613a16e73eb7 service nova] Acquiring lock "a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:23:04 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-cb27bc0d-8d83-4b79-bc6a-eefcce1ed5dd req-a9ccdff9-badd-4d96-8c4c-613a16e73eb7 service nova] Lock "a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:23:04 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-cb27bc0d-8d83-4b79-bc6a-eefcce1ed5dd req-a9ccdff9-badd-4d96-8c4c-613a16e73eb7 service nova] Lock "a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:23:04 user nova-compute[75165]: DEBUG nova.compute.manager [req-cb27bc0d-8d83-4b79-bc6a-eefcce1ed5dd req-a9ccdff9-badd-4d96-8c4c-613a16e73eb7 service nova] [instance: a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb] No waiting events found dispatching network-vif-plugged-e2143e91-9f8c-4670-9f92-c2c00827a619 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:23:04 user nova-compute[75165]: WARNING nova.compute.manager [req-cb27bc0d-8d83-4b79-bc6a-eefcce1ed5dd req-a9ccdff9-badd-4d96-8c4c-613a16e73eb7 service nova] [instance: a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb] Received unexpected event network-vif-plugged-e2143e91-9f8c-4670-9f92-c2c00827a619 for instance with vm_state active and task_state rescuing.
Oct 26 00:23:05 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-33d2f8fe-8dbb-4332-bbfd-4c4ca061f7f7 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/49357207bed21777afe2b2880087c861e2355c6b.part /opt/stack/data/nova/instances/_base/49357207bed21777afe2b2880087c861e2355c6b.converted" returned: 0 in 0.604s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:23:05 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-33d2f8fe-8dbb-4332-bbfd-4c4ca061f7f7 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/49357207bed21777afe2b2880087c861e2355c6b.converted --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:23:05 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-33d2f8fe-8dbb-4332-bbfd-4c4ca061f7f7 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/49357207bed21777afe2b2880087c861e2355c6b.converted --force-share --output=json" returned: 0 in 0.200s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:23:05 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-33d2f8fe-8dbb-4332-bbfd-4c4ca061f7f7 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Lock "49357207bed21777afe2b2880087c861e2355c6b" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.199s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:23:05 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-33d2f8fe-8dbb-4332-bbfd-4c4ca061f7f7 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Acquiring lock "49357207bed21777afe2b2880087c861e2355c6b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:23:05 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-33d2f8fe-8dbb-4332-bbfd-4c4ca061f7f7 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Lock "49357207bed21777afe2b2880087c861e2355c6b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:23:05 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-33d2f8fe-8dbb-4332-bbfd-4c4ca061f7f7 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/49357207bed21777afe2b2880087c861e2355c6b --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:23:05 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-33d2f8fe-8dbb-4332-bbfd-4c4ca061f7f7 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/49357207bed21777afe2b2880087c861e2355c6b --force-share --output=json" returned: 0 in 0.183s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:23:05 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-33d2f8fe-8dbb-4332-bbfd-4c4ca061f7f7 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/49357207bed21777afe2b2880087c861e2355c6b,backing_fmt=raw /opt/stack/data/nova/instances/a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb/disk.rescue {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:23:05 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-33d2f8fe-8dbb-4332-bbfd-4c4ca061f7f7 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/49357207bed21777afe2b2880087c861e2355c6b,backing_fmt=raw /opt/stack/data/nova/instances/a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb/disk.rescue" returned: 0 in 0.052s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:23:05 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-33d2f8fe-8dbb-4332-bbfd-4c4ca061f7f7 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Lock "49357207bed21777afe2b2880087c861e2355c6b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:23:05 user nova-compute[75165]: DEBUG nova.objects.instance [None req-33d2f8fe-8dbb-4332-bbfd-4c4ca061f7f7 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Lazy-loading 'migration_context' on Instance uuid a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:23:05 user nova-compute[75165]: DEBUG nova.objects.base [None req-33d2f8fe-8dbb-4332-bbfd-4c4ca061f7f7 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Object Instance<a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75165) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 00:23:05 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-33d2f8fe-8dbb-4332-bbfd-4c4ca061f7f7 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb] Created local disks {{(pid=75165) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 00:23:05 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-33d2f8fe-8dbb-4332-bbfd-4c4ca061f7f7 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb] Start _get_guest_xml network_info=[{"id": "e2143e91-9f8c-4670-9f92-c2c00827a619", "address": "fa:16:3e:6c:b7:14", "network": {"id": "eb55c0bc-cae5-4ba3-851a-e31a50b52c88", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1081223830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1081223830-network", "vif_mac": "fa:16:3e:6c:b7:14"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d616862c7c184de5b0ba3121552c5666", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2143e91-9f", "ovs_interfaceid": "e2143e91-9f8c-4670-9f92-c2c00827a619", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T00:03:24Z,direct_url=<?>,disk_format='qcow2',id=bff0d8a1-739e-4c4d-9efa-b73ba7b76d01,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e56bbf444fd34c348475c73673611447',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T00:03:26Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '92122ab0-4996-4578-8487-3353aa4e4a8b', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cnlTHGmy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb', 'attached_at': '', 'detached_at': '', 'volume_id': '9da1cf16-26d8-4277-823f-8ec488aa1795', 'serial': '9da1cf16-26d8-4277-823f-8ec488aa1795'}, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'attachment_id': '258fe323-40db-4228-9a4b-535c5dcd9b44', 'delete_on_termination': False, 'volume_type': None} {{(pid=75165) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 00:23:05 user nova-compute[75165]: DEBUG nova.objects.instance [None req-33d2f8fe-8dbb-4332-bbfd-4c4ca061f7f7 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Lazy-loading 'resources' on Instance uuid a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:23:05 user nova-compute[75165]: DEBUG nova.objects.base [None req-33d2f8fe-8dbb-4332-bbfd-4c4ca061f7f7 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Object Instance<a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75165) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 00:23:05 user nova-compute[75165]: DEBUG nova.objects.instance [None req-33d2f8fe-8dbb-4332-bbfd-4c4ca061f7f7 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Lazy-loading 'numa_topology' on Instance uuid a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:23:05 user nova-compute[75165]: DEBUG nova.objects.base [None req-33d2f8fe-8dbb-4332-bbfd-4c4ca061f7f7 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Object Instance<a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75165) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 00:23:05 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-33d2f8fe-8dbb-4332-bbfd-4c4ca061f7f7 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:23:05 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-33d2f8fe-8dbb-4332-bbfd-4c4ca061f7f7 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:23:05 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-33d2f8fe-8dbb-4332-bbfd-4c4ca061f7f7 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75165) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 00:23:05 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-33d2f8fe-8dbb-4332-bbfd-4c4ca061f7f7 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] CPU controller missing on host. {{(pid=75165) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 00:23:05 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-33d2f8fe-8dbb-4332-bbfd-4c4ca061f7f7 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75165) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 00:23:05 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-33d2f8fe-8dbb-4332-bbfd-4c4ca061f7f7 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] CPU controller found on host. {{(pid=75165) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 00:23:05 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-33d2f8fe-8dbb-4332-bbfd-4c4ca061f7f7 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75165) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 00:23:05 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-33d2f8fe-8dbb-4332-bbfd-4c4ca061f7f7 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T00:03:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T00:03:24Z,direct_url=<?>,disk_format='qcow2',id=bff0d8a1-739e-4c4d-9efa-b73ba7b76d01,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e56bbf444fd34c348475c73673611447',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T00:03:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 00:23:05 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-33d2f8fe-8dbb-4332-bbfd-4c4ca061f7f7 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Flavor limits 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 00:23:05 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-33d2f8fe-8dbb-4332-bbfd-4c4ca061f7f7 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Image limits 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 00:23:05 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-33d2f8fe-8dbb-4332-bbfd-4c4ca061f7f7 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Flavor pref 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 00:23:05 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-33d2f8fe-8dbb-4332-bbfd-4c4ca061f7f7 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Image pref 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 00:23:05 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-33d2f8fe-8dbb-4332-bbfd-4c4ca061f7f7 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 00:23:05 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-33d2f8fe-8dbb-4332-bbfd-4c4ca061f7f7 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 00:23:05 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-33d2f8fe-8dbb-4332-bbfd-4c4ca061f7f7 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75165) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 00:23:05 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-33d2f8fe-8dbb-4332-bbfd-4c4ca061f7f7 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Got 1 possible topologies {{(pid=75165) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 00:23:05 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-33d2f8fe-8dbb-4332-bbfd-4c4ca061f7f7 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 00:23:05 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-33d2f8fe-8dbb-4332-bbfd-4c4ca061f7f7 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 00:23:05 user nova-compute[75165]: DEBUG nova.objects.instance [None req-33d2f8fe-8dbb-4332-bbfd-4c4ca061f7f7 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Lazy-loading 'vcpu_model' on Instance uuid a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:23:05 user nova-compute[75165]: DEBUG nova.objects.base [None req-33d2f8fe-8dbb-4332-bbfd-4c4ca061f7f7 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Object Instance<a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75165) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 00:23:05 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33d2f8fe-8dbb-4332-bbfd-4c4ca061f7f7 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb] Calling os-brick to attach iSCSI Volume {{(pid=75165) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 00:23:05 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-33d2f8fe-8dbb-4332-bbfd-4c4ca061f7f7 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8bf8160e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cnlTHGmy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:23:05 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-33d2f8fe-8dbb-4332-bbfd-4c4ca061f7f7 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:23:05 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-33d2f8fe-8dbb-4332-bbfd-4c4ca061f7f7 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:23:05 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-33d2f8fe-8dbb-4332-bbfd-4c4ca061f7f7 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:23:05 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-33d2f8fe-8dbb-4332-bbfd-4c4ca061f7f7 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:23:05 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-33d2f8fe-8dbb-4332-bbfd-4c4ca061f7f7 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:23:05 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-33d2f8fe-8dbb-4332-bbfd-4c4ca061f7f7 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:23:05 user nova-compute[75165]: INFO os_brick.initiator.connectors.iscsi [None req-33d2f8fe-8dbb-4332-bbfd-4c4ca061f7f7 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 00:23:05 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 -p 172.16.0.220:3260 {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:23:05 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 -p 172.16.0.220:3260" returned: 0 in 0.020s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:23:05 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[683978b1-c9a0-414c-986d-6131b3444822]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = cnlTHGmy\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:23:05 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-33d2f8fe-8dbb-4332-bbfd-4c4ca061f7f7 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Oct 26 00:23:05 user nova-compute[75165]: node.name = iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795
Oct 26 00:23:05 user nova-compute[75165]: node.tpgt = -1
Oct 26 00:23:05 user nova-compute[75165]: node.startup = automatic
Oct 26 00:23:05 user nova-compute[75165]: node.leading_login = No
Oct 26 00:23:05 user nova-compute[75165]: iface.iscsi_ifacename = default
Oct 26 00:23:05 user nova-compute[75165]: iface.net_ifacename = <empty>
Oct 26 00:23:05 user nova-compute[75165]: iface.ipaddress = <empty>
Oct 26 00:23:05 user nova-compute[75165]: iface.prefix_len = 0
Oct 26 00:23:05 user nova-compute[75165]: iface.hwaddress = <empty>
Oct 26 00:23:05 user nova-compute[75165]: iface.transport_name = tcp
Oct 26 00:23:05 user nova-compute[75165]: iface.initiatorname = <empty>
Oct 26 00:23:05 user nova-compute[75165]: iface.state = <empty>
Oct 26 00:23:05 user nova-compute[75165]: iface.vlan_id = 0
Oct 26 00:23:05 user nova-compute[75165]: iface.vlan_priority = 0
Oct 26 00:23:05 user nova-compute[75165]: iface.vlan_state = <empty>
Oct 26 00:23:05 user nova-compute[75165]: iface.iface_num = 0
Oct 26 00:23:05 user nova-compute[75165]: iface.mtu = 0
Oct 26 00:23:05 user nova-compute[75165]: iface.port = 0
Oct 26 00:23:05 user nova-compute[75165]: iface.bootproto = <empty>
Oct 26 00:23:05 user nova-compute[75165]: iface.subnet_mask = <empty>
Oct 26 00:23:05 user nova-compute[75165]: iface.gateway = <empty>
Oct 26 00:23:05 user nova-compute[75165]: iface.dhcp_alt_client_id_state = <empty>
Oct 26 00:23:05 user nova-compute[75165]: iface.dhcp_alt_client_id = <empty>
Oct 26 00:23:05 user nova-compute[75165]: iface.dhcp_dns = <empty>
Oct 26 00:23:05 user nova-compute[75165]: iface.dhcp_learn_iqn = <empty>
Oct 26 00:23:05 user nova-compute[75165]: iface.dhcp_req_vendor_id_state = <empty>
Oct 26 00:23:05 user nova-compute[75165]: iface.dhcp_vendor_id_state = <empty>
Oct 26 00:23:05 user nova-compute[75165]: iface.dhcp_vendor_id = <empty>
Oct 26 00:23:05 user nova-compute[75165]: iface.dhcp_slp_da = <empty>
Oct 26 00:23:05 user nova-compute[75165]: iface.fragmentation = <empty>
Oct 26 00:23:05 user nova-compute[75165]: iface.gratuitous_arp = <empty>
Oct 26 00:23:05 user nova-compute[75165]: iface.incoming_forwarding = <empty>
Oct 26 00:23:05 user nova-compute[75165]: iface.tos_state = <empty>
Oct 26 00:23:05 user nova-compute[75165]: iface.tos = 0
Oct 26 00:23:05 user nova-compute[75165]: iface.ttl = 0
Oct 26 00:23:05 user nova-compute[75165]: iface.delayed_ack = <empty>
Oct 26 00:23:05 user nova-compute[75165]: iface.tcp_nagle = <empty>
Oct 26 00:23:05 user nova-compute[75165]: iface.tcp_wsf_state = <empty>
Oct 26 00:23:05 user nova-compute[75165]: iface.tcp_wsf = 0
Oct 26 00:23:05 user nova-compute[75165]: iface.tcp_timer_scale = 0
Oct 26 00:23:05 user nova-compute[75165]: iface.tcp_timestamp = <empty>
Oct 26 00:23:05 user nova-compute[75165]: iface.redirect = <empty>
Oct 26 00:23:05 user nova-compute[75165]: iface.def_task_mgmt_timeout = 0
Oct 26 00:23:05 user nova-compute[75165]: iface.header_digest = <empty>
Oct 26 00:23:05 user nova-compute[75165]: iface.data_digest = <empty>
Oct 26 00:23:05 user nova-compute[75165]: iface.immediate_data = <empty>
Oct 26 00:23:05 user nova-compute[75165]: iface.initial_r2t = <empty>
Oct 26 00:23:05 user nova-compute[75165]: iface.data_seq_inorder = <empty>
Oct 26 00:23:05 user nova-compute[75165]: iface.data_pdu_inorder = <empty>
Oct 26 00:23:05 user nova-compute[75165]: iface.erl = 0
Oct 26 00:23:05 user nova-compute[75165]: iface.max_receive_data_len = 0
Oct 26 00:23:05 user nova-compute[75165]: iface.first_burst_len = 0
Oct 26 00:23:05 user nova-compute[75165]: iface.max_outstanding_r2t = 0
Oct 26 00:23:05 user nova-compute[75165]: iface.max_burst_len = 0
Oct 26 00:23:05 user nova-compute[75165]: iface.chap_auth = <empty>
Oct 26 00:23:05 user nova-compute[75165]: iface.bidi_chap = <empty>
Oct 26 00:23:05 user nova-compute[75165]: iface.strict_login_compliance = <empty>
Oct 26 00:23:05 user nova-compute[75165]: iface.discovery_auth = <empty>
Oct 26 00:23:05 user nova-compute[75165]: iface.discovery_logout = <empty>
Oct 26 00:23:05 user nova-compute[75165]: node.discovery_address = <empty>
Oct 26 00:23:05 user nova-compute[75165]: node.discovery_port = 0
Oct 26 00:23:05 user nova-compute[75165]: node.discovery_type = static
Oct 26 00:23:05 user nova-compute[75165]: node.session.initial_cmdsn = 0
Oct 26 00:23:05 user nova-compute[75165]: node.session.initial_login_retry_max = 8
Oct 26 00:23:05 user nova-compute[75165]: node.session.xmit_thread_priority = -20
Oct 26 00:23:05 user nova-compute[75165]: node.session.cmds_max = 128
Oct 26 00:23:05 user nova-compute[75165]: node.session.queue_depth = 32
Oct 26 00:23:05 user nova-compute[75165]: node.session.nr_sessions = 1
Oct 26 00:23:05 user nova-compute[75165]: node.session.auth.authmethod = CHAP
Oct 26 00:23:05 user nova-compute[75165]: node.session.auth.username = cnlTHGmy
Oct 26 00:23:05 user nova-compute[75165]: node.session.auth.password = ***
Oct 26 00:23:05 user nova-compute[75165]: node.session.auth.username_in = <empty>
Oct 26 00:23:05 user nova-compute[75165]: node.session.auth.password_in = <empty>
Oct 26 00:23:05 user nova-compute[75165]: node.session.auth.chap_algs = MD5
Oct 26 00:23:05 user nova-compute[75165]: node.session.timeo.replacement_timeout = 120
Oct 26 00:23:05 user nova-compute[75165]: node.session.err_timeo.abort_timeout = 15
Oct 26 00:23:05 user nova-compute[75165]: node.session.err_timeo.lu_reset_timeout = 30
Oct 26 00:23:05 user nova-compute[75165]: node.session.err_timeo.tgt_reset_timeout = 30
Oct 26 00:23:05 user nova-compute[75165]: node.session.err_timeo.host_reset_timeout = 60
Oct 26 00:23:05 user nova-compute[75165]: node.session.iscsi.FastAbort = Yes
Oct 26 00:23:05 user nova-compute[75165]: node.session.iscsi.InitialR2T = No
Oct 26 00:23:05 user nova-compute[75165]: node.session.iscsi.ImmediateData = Yes
Oct 26 00:23:05 user nova-compute[75165]: node.session.iscsi.FirstBurstLength = 262144
Oct 26 00:23:05 user nova-compute[75165]: node.session.iscsi.MaxBurstLength = 16776192
Oct 26 00:23:05 user nova-compute[75165]: node.session.iscsi.DefaultTime2Retain = 0
Oct 26 00:23:05 user nova-compute[75165]: node.session.iscsi.DefaultTime2Wait = 2
Oct 26 00:23:05 user nova-compute[75165]: node.session.iscsi.MaxConnections = 1
Oct 26 00:23:05 user nova-compute[75165]: node.session.iscsi.MaxOutstandingR2T = 1
Oct 26 00:23:05 user nova-compute[75165]: node.session.iscsi.ERL = 0
Oct 26 00:23:05 user nova-compute[75165]: node.session.scan = manual
Oct 26 00:23:05 user nova-compute[75165]: node.session.reopen_max = 0
Oct 26 00:23:05 user nova-compute[75165]: node.conn[0].address = 172.16.0.220
Oct 26 00:23:05 user nova-compute[75165]: node.conn[0].port = 3260
Oct 26 00:23:05 user nova-compute[75165]: node.conn[0].startup = manual
Oct 26 00:23:05 user nova-compute[75165]: node.conn[0].tcp.window_size = 524288
Oct 26 00:23:05 user nova-compute[75165]: node.conn[0].tcp.type_of_service = 0
Oct 26 00:23:05 user nova-compute[75165]: node.conn[0].timeo.logout_timeout = 15
Oct 26 00:23:05 user nova-compute[75165]: node.conn[0].timeo.login_timeout = 15
Oct 26 00:23:05 user nova-compute[75165]: node.conn[0].timeo.auth_timeout = 45
Oct 26 00:23:05 user nova-compute[75165]: node.conn[0].timeo.noop_out_interval = 5
Oct 26 00:23:05 user nova-compute[75165]: node.conn[0].timeo.noop_out_timeout = 5
Oct 26 00:23:05 user nova-compute[75165]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Oct 26 00:23:05 user nova-compute[75165]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Oct 26 00:23:05 user nova-compute[75165]: node.conn[0].iscsi.HeaderDigest = None
Oct 26 00:23:05 user nova-compute[75165]: node.conn[0].iscsi.DataDigest = None
Oct 26 00:23:05 user nova-compute[75165]: node.conn[0].iscsi.IFMarker = No
Oct 26 00:23:05 user nova-compute[75165]: node.conn[0].iscsi.OFMarker = No
Oct 26 00:23:05 user nova-compute[75165]: # END RECORD
Oct 26 00:23:05 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:23:05 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:23:05 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:23:05 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[3abbf863-0e07-45c4-9028-65cb80c403cf]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:23:05 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-33d2f8fe-8dbb-4332-bbfd-4c4ca061f7f7 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:23:05 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:23:05 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:23:05 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[60565627-eee2-46a3-84bd-e6f868c3c66f]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:23:05 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-33d2f8fe-8dbb-4332-bbfd-4c4ca061f7f7 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:23:05 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cnlTHGmy {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:23:05 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cnlTHGmy" returned: 0 in 0.019s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:23:05 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[80716afa-76fb-4987-8a08-8da68b001c08]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:23:05 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-33d2f8fe-8dbb-4332-bbfd-4c4ca061f7f7 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cnlTHGmy'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:23:05 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:23:05 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:23:05 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[f146cc2a-b625-4bcd-b91b-8ee978b931f1]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:23:06 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-33d2f8fe-8dbb-4332-bbfd-4c4ca061f7f7 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:23:06 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:23:06 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:23:06 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[df966a6c-b463-44d3-8086-781e3bd5f8b0]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:652b4bd0-93f8-4553-bddd-e432f7ec1142 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a43689-b7cd-47e6-ae88-fd8ba07c60c1 (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:23:06 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-33d2f8fe-8dbb-4332-bbfd-4c4ca061f7f7 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)
Oct 26 00:23:06 user nova-compute[75165]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:652b4bd0-93f8-4553-bddd-e432f7ec1142 (non-flash)
Oct 26 00:23:06 user nova-compute[75165]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a43689-b7cd-47e6-ae88-fd8ba07c60c1 (non-flash)
Oct 26 00:23:06 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:23:06 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-33d2f8fe-8dbb-4332-bbfd-4c4ca061f7f7 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)
Oct 26 00:23:06 user nova-compute[75165]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:652b4bd0-93f8-4553-bddd-e432f7ec1142 (non-flash)
Oct 26 00:23:06 user nova-compute[75165]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a43689-b7cd-47e6-ae88-fd8ba07c60c1 (non-flash)
Oct 26 00:23:06 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:23:06 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-33d2f8fe-8dbb-4332-bbfd-4c4ca061f7f7 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.155s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:23:06 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-33d2f8fe-8dbb-4332-bbfd-4c4ca061f7f7 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Connected to 172.16.0.220:3260 {{(pid=75165) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 00:23:06 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-33d2f8fe-8dbb-4332-bbfd-4c4ca061f7f7 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] HCTL ('33', '0', '0', 0) found on session 26 with lun 0 {{(pid=75165) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 00:23:06 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-33d2f8fe-8dbb-4332-bbfd-4c4ca061f7f7 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=75165) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 00:23:06 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:23:06 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.014s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:23:06 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[68bf368d-9c65-4626-ad54-ce8129a92d1b]: (4, ('0 0 0', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:23:06 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-33d2f8fe-8dbb-4332-bbfd-4c4ca061f7f7 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Searching for a device in session 26 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=75165) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 00:23:06 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-33d2f8fe-8dbb-4332-bbfd-4c4ca061f7f7 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cnlTHGmy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75165) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 00:23:06 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-33d2f8fe-8dbb-4332-bbfd-4c4ca061f7f7 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.180s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:23:06 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-33d2f8fe-8dbb-4332-bbfd-4c4ca061f7f7 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] <== connect_volume: return (181ms) {'type': 'block', 'scsi_wwn': '23636623037646265', 'path': '/dev/sdb'} {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:23:06 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33d2f8fe-8dbb-4332-bbfd-4c4ca061f7f7 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23636623037646265', 'path': '/dev/sdb'} {{(pid=75165) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 00:23:06 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-33d2f8fe-8dbb-4332-bbfd-4c4ca061f7f7 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:21:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1103241586',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1103241586',id=28,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-26T00:21:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d616862c7c184de5b0ba3121552c5666',ramdisk_id='',reservation_id='r-ely1lsv4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-638746030',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T00:21:40Z,user_data=None,user_id='dbe0d52293264f33ae86de41dabeefcf',uuid=a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e2143e91-9f8c-4670-9f92-c2c00827a619", "address": "fa:16:3e:6c:b7:14", "network": {"id": "eb55c0bc-cae5-4ba3-851a-e31a50b52c88", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1081223830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1081223830-network", "vif_mac": "fa:16:3e:6c:b7:14"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d616862c7c184de5b0ba3121552c5666", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2143e91-9f", "ovs_interfaceid": "e2143e91-9f8c-4670-9f92-c2c00827a619", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75165) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 00:23:06 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-33d2f8fe-8dbb-4332-bbfd-4c4ca061f7f7 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Converting VIF {"id": "e2143e91-9f8c-4670-9f92-c2c00827a619", "address": "fa:16:3e:6c:b7:14", "network": {"id": "eb55c0bc-cae5-4ba3-851a-e31a50b52c88", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1081223830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1081223830-network", "vif_mac": "fa:16:3e:6c:b7:14"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d616862c7c184de5b0ba3121552c5666", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2143e91-9f", "ovs_interfaceid": "e2143e91-9f8c-4670-9f92-c2c00827a619", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:23:06 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-33d2f8fe-8dbb-4332-bbfd-4c4ca061f7f7 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6c:b7:14,bridge_name='br-int',has_traffic_filtering=True,id=e2143e91-9f8c-4670-9f92-c2c00827a619,network=Network(eb55c0bc-cae5-4ba3-851a-e31a50b52c88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2143e91-9f') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:23:06 user nova-compute[75165]: DEBUG nova.objects.instance [None req-33d2f8fe-8dbb-4332-bbfd-4c4ca061f7f7 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Lazy-loading 'pci_devices' on Instance uuid a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:23:06 user nova-compute[75165]: DEBUG nova.objects.base [None req-33d2f8fe-8dbb-4332-bbfd-4c4ca061f7f7 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Object Instance<a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75165) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 00:23:06 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-33d2f8fe-8dbb-4332-bbfd-4c4ca061f7f7 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb] End _get_guest_xml xml=<domain type="kvm">
Oct 26 00:23:06 user nova-compute[75165]:   <uuid>a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb</uuid>
Oct 26 00:23:06 user nova-compute[75165]:   <name>instance-0000001c</name>
Oct 26 00:23:06 user nova-compute[75165]:   <memory>524288</memory>
Oct 26 00:23:06 user nova-compute[75165]:   <vcpu>1</vcpu>
Oct 26 00:23:06 user nova-compute[75165]:   <metadata>
Oct 26 00:23:06 user nova-compute[75165]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 00:23:06 user nova-compute[75165]:       <nova:package version="0.0.0"/>
Oct 26 00:23:06 user nova-compute[75165]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1103241586</nova:name>
Oct 26 00:23:06 user nova-compute[75165]:       <nova:creationTime>2023-10-26 00:23:05</nova:creationTime>
Oct 26 00:23:06 user nova-compute[75165]:       <nova:flavor name="m1.tiny">
Oct 26 00:23:06 user nova-compute[75165]:         <nova:memory>512</nova:memory>
Oct 26 00:23:06 user nova-compute[75165]:         <nova:disk>1</nova:disk>
Oct 26 00:23:06 user nova-compute[75165]:         <nova:swap>0</nova:swap>
Oct 26 00:23:06 user nova-compute[75165]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 00:23:06 user nova-compute[75165]:         <nova:vcpus>1</nova:vcpus>
Oct 26 00:23:06 user nova-compute[75165]:       </nova:flavor>
Oct 26 00:23:06 user nova-compute[75165]:       <nova:owner>
Oct 26 00:23:06 user nova-compute[75165]:         <nova:user uuid="dbe0d52293264f33ae86de41dabeefcf">tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member</nova:user>
Oct 26 00:23:06 user nova-compute[75165]:         <nova:project uuid="d616862c7c184de5b0ba3121552c5666">tempest-ServerBootFromVolumeStableRescueTest-638746030</nova:project>
Oct 26 00:23:06 user nova-compute[75165]:       </nova:owner>
Oct 26 00:23:06 user nova-compute[75165]:       <nova:root type="image" uuid="bff0d8a1-739e-4c4d-9efa-b73ba7b76d01"/>
Oct 26 00:23:06 user nova-compute[75165]:       <nova:ports>
Oct 26 00:23:06 user nova-compute[75165]:         <nova:port uuid="e2143e91-9f8c-4670-9f92-c2c00827a619">
Oct 26 00:23:06 user nova-compute[75165]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 26 00:23:06 user nova-compute[75165]:         </nova:port>
Oct 26 00:23:06 user nova-compute[75165]:       </nova:ports>
Oct 26 00:23:06 user nova-compute[75165]:     </nova:instance>
Oct 26 00:23:06 user nova-compute[75165]:   </metadata>
Oct 26 00:23:06 user nova-compute[75165]:   <sysinfo type="smbios">
Oct 26 00:23:06 user nova-compute[75165]:     <system>
Oct 26 00:23:06 user nova-compute[75165]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 00:23:06 user nova-compute[75165]:       <entry name="product">OpenStack Nova</entry>
Oct 26 00:23:06 user nova-compute[75165]:       <entry name="version">0.0.0</entry>
Oct 26 00:23:06 user nova-compute[75165]:       <entry name="serial">a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb</entry>
Oct 26 00:23:06 user nova-compute[75165]:       <entry name="uuid">a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb</entry>
Oct 26 00:23:06 user nova-compute[75165]:       <entry name="family">Virtual Machine</entry>
Oct 26 00:23:06 user nova-compute[75165]:     </system>
Oct 26 00:23:06 user nova-compute[75165]:   </sysinfo>
Oct 26 00:23:06 user nova-compute[75165]:   <os>
Oct 26 00:23:06 user nova-compute[75165]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 00:23:06 user nova-compute[75165]:     <smbios mode="sysinfo"/>
Oct 26 00:23:06 user nova-compute[75165]:   </os>
Oct 26 00:23:06 user nova-compute[75165]:   <features>
Oct 26 00:23:06 user nova-compute[75165]:     <acpi/>
Oct 26 00:23:06 user nova-compute[75165]:     <apic/>
Oct 26 00:23:06 user nova-compute[75165]:     <vmcoreinfo/>
Oct 26 00:23:06 user nova-compute[75165]:   </features>
Oct 26 00:23:06 user nova-compute[75165]:   <clock offset="utc">
Oct 26 00:23:06 user nova-compute[75165]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 00:23:06 user nova-compute[75165]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 00:23:06 user nova-compute[75165]:     <timer name="hpet" present="no"/>
Oct 26 00:23:06 user nova-compute[75165]:   </clock>
Oct 26 00:23:06 user nova-compute[75165]:   <cpu mode="custom" match="exact">
Oct 26 00:23:06 user nova-compute[75165]:     <model>Nehalem</model>
Oct 26 00:23:06 user nova-compute[75165]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 00:23:06 user nova-compute[75165]:   </cpu>
Oct 26 00:23:06 user nova-compute[75165]:   <devices>
Oct 26 00:23:06 user nova-compute[75165]:     <disk type="block" device="disk">
Oct 26 00:23:06 user nova-compute[75165]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 00:23:06 user nova-compute[75165]:       <source dev="/dev/sdb"/>
Oct 26 00:23:06 user nova-compute[75165]:       <target dev="vda" bus="virtio"/>
Oct 26 00:23:06 user nova-compute[75165]:       <serial>9da1cf16-26d8-4277-823f-8ec488aa1795</serial>
Oct 26 00:23:06 user nova-compute[75165]:     </disk>
Oct 26 00:23:06 user nova-compute[75165]:     <disk type="file" device="disk">
Oct 26 00:23:06 user nova-compute[75165]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 00:23:06 user nova-compute[75165]:       <source file="/opt/stack/data/nova/instances/a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb/disk.rescue"/>
Oct 26 00:23:06 user nova-compute[75165]:       <target dev="vdb" bus="virtio"/>
Oct 26 00:23:06 user nova-compute[75165]:       <boot order="1"/>
Oct 26 00:23:06 user nova-compute[75165]:     </disk>
Oct 26 00:23:06 user nova-compute[75165]:     <interface type="ethernet">
Oct 26 00:23:06 user nova-compute[75165]:       <mac address="fa:16:3e:6c:b7:14"/>
Oct 26 00:23:06 user nova-compute[75165]:       <model type="virtio"/>
Oct 26 00:23:06 user nova-compute[75165]:       <mtu size="1442"/>
Oct 26 00:23:06 user nova-compute[75165]:       <target dev="tape2143e91-9f"/>
Oct 26 00:23:06 user nova-compute[75165]:     </interface>
Oct 26 00:23:06 user nova-compute[75165]:     <serial type="pty">
Oct 26 00:23:06 user nova-compute[75165]:       <log file="/opt/stack/data/nova/instances/a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb/console.log" append="off"/>
Oct 26 00:23:06 user nova-compute[75165]:     </serial>
Oct 26 00:23:06 user nova-compute[75165]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 00:23:06 user nova-compute[75165]:     <video>
Oct 26 00:23:06 user nova-compute[75165]:       <model type="virtio"/>
Oct 26 00:23:06 user nova-compute[75165]:     </video>
Oct 26 00:23:06 user nova-compute[75165]:     <rng model="virtio">
Oct 26 00:23:06 user nova-compute[75165]:       <backend model="random">/dev/urandom</backend>
Oct 26 00:23:06 user nova-compute[75165]:     </rng>
Oct 26 00:23:06 user nova-compute[75165]:     <controller type="usb" index="0" model="none"/>
Oct 26 00:23:06 user nova-compute[75165]:     <memballoon model="virtio">
Oct 26 00:23:06 user nova-compute[75165]:       <stats period="10"/>
Oct 26 00:23:06 user nova-compute[75165]:     </memballoon>
Oct 26 00:23:06 user nova-compute[75165]:   </devices>
Oct 26 00:23:06 user nova-compute[75165]: </domain>
Oct 26 00:23:06 user nova-compute[75165]:  {{(pid=75165) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 00:23:06 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb] Instance destroyed successfully.
Oct 26 00:23:06 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-33d2f8fe-8dbb-4332-bbfd-4c4ca061f7f7 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] No BDM found with device name vda, not building metadata. {{(pid=75165) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 00:23:06 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-33d2f8fe-8dbb-4332-bbfd-4c4ca061f7f7 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75165) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 00:23:06 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-33d2f8fe-8dbb-4332-bbfd-4c4ca061f7f7 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] No VIF found with MAC fa:16:3e:6c:b7:14, not building metadata {{(pid=75165) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 00:23:06 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:23:06 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75165) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 00:23:07 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:23:07 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:23:07 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:23:07 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:23:07 user nova-compute[75165]: DEBUG nova.compute.manager [req-a3fe9fb2-6ce3-4971-afe5-c7fe7671d924 req-8fc826b8-7e89-43fb-b9d3-6c1766d4c21e service nova] [instance: a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb] Received event network-vif-plugged-e2143e91-9f8c-4670-9f92-c2c00827a619 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:23:07 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-a3fe9fb2-6ce3-4971-afe5-c7fe7671d924 req-8fc826b8-7e89-43fb-b9d3-6c1766d4c21e service nova] Acquiring lock "a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:23:07 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-a3fe9fb2-6ce3-4971-afe5-c7fe7671d924 req-8fc826b8-7e89-43fb-b9d3-6c1766d4c21e service nova] Lock "a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:23:07 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-a3fe9fb2-6ce3-4971-afe5-c7fe7671d924 req-8fc826b8-7e89-43fb-b9d3-6c1766d4c21e service nova] Lock "a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:23:07 user nova-compute[75165]: DEBUG nova.compute.manager [req-a3fe9fb2-6ce3-4971-afe5-c7fe7671d924 req-8fc826b8-7e89-43fb-b9d3-6c1766d4c21e service nova] [instance: a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb] No waiting events found dispatching network-vif-plugged-e2143e91-9f8c-4670-9f92-c2c00827a619 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:23:07 user nova-compute[75165]: WARNING nova.compute.manager [req-a3fe9fb2-6ce3-4971-afe5-c7fe7671d924 req-8fc826b8-7e89-43fb-b9d3-6c1766d4c21e service nova] [instance: a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb] Received unexpected event network-vif-plugged-e2143e91-9f8c-4670-9f92-c2c00827a619 for instance with vm_state active and task_state rescuing.
Oct 26 00:23:07 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:23:07 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:23:07 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:23:08 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:23:09 user nova-compute[75165]: DEBUG nova.compute.manager [req-ec6095a3-d32e-45a0-8a55-47917603e270 req-fdb9c6d8-d3dd-40f9-9794-0e749569178f service nova] [instance: a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb] Received event network-vif-plugged-e2143e91-9f8c-4670-9f92-c2c00827a619 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:23:09 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-ec6095a3-d32e-45a0-8a55-47917603e270 req-fdb9c6d8-d3dd-40f9-9794-0e749569178f service nova] Acquiring lock "a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:23:09 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-ec6095a3-d32e-45a0-8a55-47917603e270 req-fdb9c6d8-d3dd-40f9-9794-0e749569178f service nova] Lock "a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:23:09 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-ec6095a3-d32e-45a0-8a55-47917603e270 req-fdb9c6d8-d3dd-40f9-9794-0e749569178f service nova] Lock "a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:23:09 user nova-compute[75165]: DEBUG nova.compute.manager [req-ec6095a3-d32e-45a0-8a55-47917603e270 req-fdb9c6d8-d3dd-40f9-9794-0e749569178f service nova] [instance: a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb] No waiting events found dispatching network-vif-plugged-e2143e91-9f8c-4670-9f92-c2c00827a619 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:23:09 user nova-compute[75165]: WARNING nova.compute.manager [req-ec6095a3-d32e-45a0-8a55-47917603e270 req-fdb9c6d8-d3dd-40f9-9794-0e749569178f service nova] [instance: a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb] Received unexpected event network-vif-plugged-e2143e91-9f8c-4670-9f92-c2c00827a619 for instance with vm_state active and task_state rescuing.
Oct 26 00:23:10 user nova-compute[75165]: DEBUG nova.compute.manager [None req-33d2f8fe-8dbb-4332-bbfd-4c4ca061f7f7 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb] Checking state {{(pid=75165) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 00:23:10 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-a9547b50-841c-4118-a8ac-58d2a4adbf27 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Acquiring lock "91c62531-62f9-4f17-914c-11edc5010b54" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:23:10 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-a9547b50-841c-4118-a8ac-58d2a4adbf27 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Lock "91c62531-62f9-4f17-914c-11edc5010b54" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:23:10 user nova-compute[75165]: DEBUG nova.compute.manager [None req-a9547b50-841c-4118-a8ac-58d2a4adbf27 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] [instance: 91c62531-62f9-4f17-914c-11edc5010b54] Starting instance... {{(pid=75165) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 00:23:10 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-a9547b50-841c-4118-a8ac-58d2a4adbf27 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:23:10 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-a9547b50-841c-4118-a8ac-58d2a4adbf27 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:23:10 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-a9547b50-841c-4118-a8ac-58d2a4adbf27 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75165) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 00:23:10 user nova-compute[75165]: INFO nova.compute.claims [None req-a9547b50-841c-4118-a8ac-58d2a4adbf27 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] [instance: 91c62531-62f9-4f17-914c-11edc5010b54] Claim successful on node user
Oct 26 00:23:10 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-a9547b50-841c-4118-a8ac-58d2a4adbf27 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:23:10 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-a9547b50-841c-4118-a8ac-58d2a4adbf27 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:23:10 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-a9547b50-841c-4118-a8ac-58d2a4adbf27 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.562s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:23:10 user nova-compute[75165]: DEBUG nova.compute.manager [None req-a9547b50-841c-4118-a8ac-58d2a4adbf27 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] [instance: 91c62531-62f9-4f17-914c-11edc5010b54] Start building networks asynchronously for instance. {{(pid=75165) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 00:23:10 user nova-compute[75165]: DEBUG nova.compute.manager [None req-a9547b50-841c-4118-a8ac-58d2a4adbf27 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] [instance: 91c62531-62f9-4f17-914c-11edc5010b54] Allocating IP information in the background. {{(pid=75165) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 00:23:10 user nova-compute[75165]: DEBUG nova.network.neutron [None req-a9547b50-841c-4118-a8ac-58d2a4adbf27 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] [instance: 91c62531-62f9-4f17-914c-11edc5010b54] allocate_for_instance() {{(pid=75165) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 00:23:11 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-a9547b50-841c-4118-a8ac-58d2a4adbf27 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] [instance: 91c62531-62f9-4f17-914c-11edc5010b54] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 00:23:11 user nova-compute[75165]: DEBUG nova.compute.manager [None req-a9547b50-841c-4118-a8ac-58d2a4adbf27 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] [instance: 91c62531-62f9-4f17-914c-11edc5010b54] Start building block device mappings for instance. {{(pid=75165) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 00:23:11 user nova-compute[75165]: DEBUG nova.policy [None req-a9547b50-841c-4118-a8ac-58d2a4adbf27 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7cd8b7fb014340bcb4efbe7a0063cdc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eed16e1778f4ffb93afcc1ddbfe3d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75165) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 00:23:11 user nova-compute[75165]: DEBUG nova.compute.manager [None req-a9547b50-841c-4118-a8ac-58d2a4adbf27 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] [instance: 91c62531-62f9-4f17-914c-11edc5010b54] Start spawning the instance on the hypervisor. {{(pid=75165) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 00:23:11 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-a9547b50-841c-4118-a8ac-58d2a4adbf27 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] [instance: 91c62531-62f9-4f17-914c-11edc5010b54] Creating instance directory {{(pid=75165) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 00:23:11 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-a9547b50-841c-4118-a8ac-58d2a4adbf27 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] [instance: 91c62531-62f9-4f17-914c-11edc5010b54] Creating image(s)
Oct 26 00:23:11 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-a9547b50-841c-4118-a8ac-58d2a4adbf27 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Acquiring lock "/opt/stack/data/nova/instances/91c62531-62f9-4f17-914c-11edc5010b54/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:23:11 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-a9547b50-841c-4118-a8ac-58d2a4adbf27 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Lock "/opt/stack/data/nova/instances/91c62531-62f9-4f17-914c-11edc5010b54/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:23:11 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-a9547b50-841c-4118-a8ac-58d2a4adbf27 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Lock "/opt/stack/data/nova/instances/91c62531-62f9-4f17-914c-11edc5010b54/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:23:11 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-a9547b50-841c-4118-a8ac-58d2a4adbf27 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:23:11 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:23:11 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-a9547b50-841c-4118-a8ac-58d2a4adbf27 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json" returned: 0 in 0.214s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:23:11 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-a9547b50-841c-4118-a8ac-58d2a4adbf27 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Acquiring lock "7d3243421cf3fdc288b758f687a93103b7b95466" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:23:11 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-a9547b50-841c-4118-a8ac-58d2a4adbf27 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Lock "7d3243421cf3fdc288b758f687a93103b7b95466" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:23:11 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-a9547b50-841c-4118-a8ac-58d2a4adbf27 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:23:11 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-a9547b50-841c-4118-a8ac-58d2a4adbf27 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json" returned: 0 in 0.227s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:23:11 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-a9547b50-841c-4118-a8ac-58d2a4adbf27 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466,backing_fmt=raw /opt/stack/data/nova/instances/91c62531-62f9-4f17-914c-11edc5010b54/disk 1073741824 {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:23:11 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-a9547b50-841c-4118-a8ac-58d2a4adbf27 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466,backing_fmt=raw /opt/stack/data/nova/instances/91c62531-62f9-4f17-914c-11edc5010b54/disk 1073741824" returned: 0 in 0.067s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:23:11 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-a9547b50-841c-4118-a8ac-58d2a4adbf27 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Lock "7d3243421cf3fdc288b758f687a93103b7b95466" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.303s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:23:11 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-a9547b50-841c-4118-a8ac-58d2a4adbf27 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:23:11 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:23:11 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:23:11 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-a9547b50-841c-4118-a8ac-58d2a4adbf27 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json" returned: 0 in 0.205s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:23:11 user nova-compute[75165]: DEBUG nova.virt.disk.api [None req-a9547b50-841c-4118-a8ac-58d2a4adbf27 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Checking if we can resize image /opt/stack/data/nova/instances/91c62531-62f9-4f17-914c-11edc5010b54/disk. size=1073741824 {{(pid=75165) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 00:23:11 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-a9547b50-841c-4118-a8ac-58d2a4adbf27 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91c62531-62f9-4f17-914c-11edc5010b54/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:23:12 user nova-compute[75165]: DEBUG nova.network.neutron [None req-a9547b50-841c-4118-a8ac-58d2a4adbf27 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] [instance: 91c62531-62f9-4f17-914c-11edc5010b54] Successfully created port: 355e1ddf-4d49-4a04-8a77-e05df100b323 {{(pid=75165) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 00:23:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-a9547b50-841c-4118-a8ac-58d2a4adbf27 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91c62531-62f9-4f17-914c-11edc5010b54/disk --force-share --output=json" returned: 0 in 0.274s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:23:12 user nova-compute[75165]: DEBUG nova.virt.disk.api [None req-a9547b50-841c-4118-a8ac-58d2a4adbf27 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Cannot resize image /opt/stack/data/nova/instances/91c62531-62f9-4f17-914c-11edc5010b54/disk to a smaller size. {{(pid=75165) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 00:23:12 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-a9547b50-841c-4118-a8ac-58d2a4adbf27 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] [instance: 91c62531-62f9-4f17-914c-11edc5010b54] Created local disks {{(pid=75165) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 00:23:12 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-a9547b50-841c-4118-a8ac-58d2a4adbf27 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] [instance: 91c62531-62f9-4f17-914c-11edc5010b54] Ensure instance console log exists: /opt/stack/data/nova/instances/91c62531-62f9-4f17-914c-11edc5010b54/console.log {{(pid=75165) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 00:23:12 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-a9547b50-841c-4118-a8ac-58d2a4adbf27 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:23:12 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-a9547b50-841c-4118-a8ac-58d2a4adbf27 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:23:12 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-a9547b50-841c-4118-a8ac-58d2a4adbf27 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:23:12 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:23:12 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:23:13 user nova-compute[75165]: DEBUG nova.network.neutron [None req-a9547b50-841c-4118-a8ac-58d2a4adbf27 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] [instance: 91c62531-62f9-4f17-914c-11edc5010b54] Successfully updated port: 355e1ddf-4d49-4a04-8a77-e05df100b323 {{(pid=75165) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 00:23:13 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-a9547b50-841c-4118-a8ac-58d2a4adbf27 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Acquiring lock "refresh_cache-91c62531-62f9-4f17-914c-11edc5010b54" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:23:13 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-a9547b50-841c-4118-a8ac-58d2a4adbf27 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Acquired lock "refresh_cache-91c62531-62f9-4f17-914c-11edc5010b54" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:23:13 user nova-compute[75165]: DEBUG nova.network.neutron [None req-a9547b50-841c-4118-a8ac-58d2a4adbf27 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] [instance: 91c62531-62f9-4f17-914c-11edc5010b54] Building network info cache for instance {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 00:23:13 user nova-compute[75165]: DEBUG nova.compute.manager [req-a60b6a1d-9f43-49dd-a9b0-6deeb970ee4f req-f9f3348f-e836-430c-8671-03c6ebf80ed9 service nova] [instance: 91c62531-62f9-4f17-914c-11edc5010b54] Received event network-changed-355e1ddf-4d49-4a04-8a77-e05df100b323 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:23:13 user nova-compute[75165]: DEBUG nova.compute.manager [req-a60b6a1d-9f43-49dd-a9b0-6deeb970ee4f req-f9f3348f-e836-430c-8671-03c6ebf80ed9 service nova] [instance: 91c62531-62f9-4f17-914c-11edc5010b54] Refreshing instance network info cache due to event network-changed-355e1ddf-4d49-4a04-8a77-e05df100b323. {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 00:23:13 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-a60b6a1d-9f43-49dd-a9b0-6deeb970ee4f req-f9f3348f-e836-430c-8671-03c6ebf80ed9 service nova] Acquiring lock "refresh_cache-91c62531-62f9-4f17-914c-11edc5010b54" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:23:13 user nova-compute[75165]: DEBUG nova.network.neutron [None req-a9547b50-841c-4118-a8ac-58d2a4adbf27 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] [instance: 91c62531-62f9-4f17-914c-11edc5010b54] Instance cache missing network info. {{(pid=75165) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 00:23:13 user nova-compute[75165]: DEBUG nova.network.neutron [None req-a9547b50-841c-4118-a8ac-58d2a4adbf27 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] [instance: 91c62531-62f9-4f17-914c-11edc5010b54] Updating instance_info_cache with network_info: [{"id": "355e1ddf-4d49-4a04-8a77-e05df100b323", "address": "fa:16:3e:61:d7:b9", "network": {"id": "6b000f11-7be2-4a26-ba67-b10f275e8560", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1605988141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eed16e1778f4ffb93afcc1ddbfe3d72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap355e1ddf-4d", "ovs_interfaceid": "355e1ddf-4d49-4a04-8a77-e05df100b323", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:23:13 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-a9547b50-841c-4118-a8ac-58d2a4adbf27 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Releasing lock "refresh_cache-91c62531-62f9-4f17-914c-11edc5010b54" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:23:13 user nova-compute[75165]: DEBUG nova.compute.manager [None req-a9547b50-841c-4118-a8ac-58d2a4adbf27 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] [instance: 91c62531-62f9-4f17-914c-11edc5010b54] Instance network_info: |[{"id": "355e1ddf-4d49-4a04-8a77-e05df100b323", "address": "fa:16:3e:61:d7:b9", "network": {"id": "6b000f11-7be2-4a26-ba67-b10f275e8560", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1605988141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eed16e1778f4ffb93afcc1ddbfe3d72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap355e1ddf-4d", "ovs_interfaceid": "355e1ddf-4d49-4a04-8a77-e05df100b323", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75165) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 00:23:13 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-a60b6a1d-9f43-49dd-a9b0-6deeb970ee4f req-f9f3348f-e836-430c-8671-03c6ebf80ed9 service nova] Acquired lock "refresh_cache-91c62531-62f9-4f17-914c-11edc5010b54" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:23:13 user nova-compute[75165]: DEBUG nova.network.neutron [req-a60b6a1d-9f43-49dd-a9b0-6deeb970ee4f req-f9f3348f-e836-430c-8671-03c6ebf80ed9 service nova] [instance: 91c62531-62f9-4f17-914c-11edc5010b54] Refreshing network info cache for port 355e1ddf-4d49-4a04-8a77-e05df100b323 {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 00:23:13 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-a9547b50-841c-4118-a8ac-58d2a4adbf27 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] [instance: 91c62531-62f9-4f17-914c-11edc5010b54] Start _get_guest_xml network_info=[{"id": "355e1ddf-4d49-4a04-8a77-e05df100b323", "address": "fa:16:3e:61:d7:b9", "network": {"id": "6b000f11-7be2-4a26-ba67-b10f275e8560", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1605988141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eed16e1778f4ffb93afcc1ddbfe3d72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap355e1ddf-4d", "ovs_interfaceid": "355e1ddf-4d49-4a04-8a77-e05df100b323", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T00:03:24Z,direct_url=<?>,disk_format='qcow2',id=bff0d8a1-739e-4c4d-9efa-b73ba7b76d01,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e56bbf444fd34c348475c73673611447',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T00:03:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'size': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': 'bff0d8a1-739e-4c4d-9efa-b73ba7b76d01'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75165) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 00:23:13 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-a9547b50-841c-4118-a8ac-58d2a4adbf27 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:23:13 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-a9547b50-841c-4118-a8ac-58d2a4adbf27 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:23:13 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-a9547b50-841c-4118-a8ac-58d2a4adbf27 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75165) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 00:23:13 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-a9547b50-841c-4118-a8ac-58d2a4adbf27 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] CPU controller missing on host. {{(pid=75165) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 00:23:13 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-a9547b50-841c-4118-a8ac-58d2a4adbf27 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75165) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 00:23:13 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-a9547b50-841c-4118-a8ac-58d2a4adbf27 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] CPU controller found on host. {{(pid=75165) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 00:23:13 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-a9547b50-841c-4118-a8ac-58d2a4adbf27 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75165) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 00:23:13 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-a9547b50-841c-4118-a8ac-58d2a4adbf27 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T00:03:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T00:03:24Z,direct_url=<?>,disk_format='qcow2',id=bff0d8a1-739e-4c4d-9efa-b73ba7b76d01,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e56bbf444fd34c348475c73673611447',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T00:03:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 00:23:13 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-a9547b50-841c-4118-a8ac-58d2a4adbf27 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Flavor limits 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 00:23:13 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-a9547b50-841c-4118-a8ac-58d2a4adbf27 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Image limits 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 00:23:13 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-a9547b50-841c-4118-a8ac-58d2a4adbf27 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Flavor pref 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 00:23:13 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-a9547b50-841c-4118-a8ac-58d2a4adbf27 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Image pref 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 00:23:13 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-a9547b50-841c-4118-a8ac-58d2a4adbf27 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 00:23:13 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-a9547b50-841c-4118-a8ac-58d2a4adbf27 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 00:23:13 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-a9547b50-841c-4118-a8ac-58d2a4adbf27 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75165) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 00:23:13 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-a9547b50-841c-4118-a8ac-58d2a4adbf27 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Got 1 possible topologies {{(pid=75165) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 00:23:13 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-a9547b50-841c-4118-a8ac-58d2a4adbf27 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 00:23:13 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-a9547b50-841c-4118-a8ac-58d2a4adbf27 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 00:23:13 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-a9547b50-841c-4118-a8ac-58d2a4adbf27 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:23:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-458420097',display_name='tempest-VolumesSnapshotTestJSON-instance-458420097',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-458420097',id=29,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCUFJ542m4EQF4GLsHDGK3DhvJTpq/I9HCX9CEVTbeMR/PgJyJsAlaax4d8zX8eZcrMJi5ajyQQHnWVQNJULlSaYjv2PNnnQAV/Lwov9mpiKMXXssgCsM15ioIYwhOc9mg==',key_name='tempest-keypair-479927283',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9eed16e1778f4ffb93afcc1ddbfe3d72',ramdisk_id='',reservation_id='r-kikdnv09',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1190581483',owner_user_name='tempest-VolumesSnapshotTestJSON-1190581483-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T00:23:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7cd8b7fb014340bcb4efbe7a0063cdc7',uuid=91c62531-62f9-4f17-914c-11edc5010b54,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "355e1ddf-4d49-4a04-8a77-e05df100b323", "address": "fa:16:3e:61:d7:b9", "network": {"id": "6b000f11-7be2-4a26-ba67-b10f275e8560", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1605988141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eed16e1778f4ffb93afcc1ddbfe3d72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap355e1ddf-4d", "ovs_interfaceid": "355e1ddf-4d49-4a04-8a77-e05df100b323", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75165) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 00:23:13 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-a9547b50-841c-4118-a8ac-58d2a4adbf27 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Converting VIF {"id": "355e1ddf-4d49-4a04-8a77-e05df100b323", "address": "fa:16:3e:61:d7:b9", "network": {"id": "6b000f11-7be2-4a26-ba67-b10f275e8560", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1605988141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eed16e1778f4ffb93afcc1ddbfe3d72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap355e1ddf-4d", "ovs_interfaceid": "355e1ddf-4d49-4a04-8a77-e05df100b323", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:23:13 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-a9547b50-841c-4118-a8ac-58d2a4adbf27 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:d7:b9,bridge_name='br-int',has_traffic_filtering=True,id=355e1ddf-4d49-4a04-8a77-e05df100b323,network=Network(6b000f11-7be2-4a26-ba67-b10f275e8560),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap355e1ddf-4d') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:23:13 user nova-compute[75165]: DEBUG nova.objects.instance [None req-a9547b50-841c-4118-a8ac-58d2a4adbf27 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Lazy-loading 'pci_devices' on Instance uuid 91c62531-62f9-4f17-914c-11edc5010b54 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:23:13 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-a9547b50-841c-4118-a8ac-58d2a4adbf27 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] [instance: 91c62531-62f9-4f17-914c-11edc5010b54] End _get_guest_xml xml=<domain type="kvm">
Oct 26 00:23:13 user nova-compute[75165]:   <uuid>91c62531-62f9-4f17-914c-11edc5010b54</uuid>
Oct 26 00:23:13 user nova-compute[75165]:   <name>instance-0000001d</name>
Oct 26 00:23:13 user nova-compute[75165]:   <memory>524288</memory>
Oct 26 00:23:13 user nova-compute[75165]:   <vcpu>1</vcpu>
Oct 26 00:23:13 user nova-compute[75165]:   <metadata>
Oct 26 00:23:13 user nova-compute[75165]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 00:23:13 user nova-compute[75165]:       <nova:package version="0.0.0"/>
Oct 26 00:23:13 user nova-compute[75165]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-458420097</nova:name>
Oct 26 00:23:13 user nova-compute[75165]:       <nova:creationTime>2023-10-26 00:23:13</nova:creationTime>
Oct 26 00:23:13 user nova-compute[75165]:       <nova:flavor name="m1.tiny">
Oct 26 00:23:13 user nova-compute[75165]:         <nova:memory>512</nova:memory>
Oct 26 00:23:13 user nova-compute[75165]:         <nova:disk>1</nova:disk>
Oct 26 00:23:13 user nova-compute[75165]:         <nova:swap>0</nova:swap>
Oct 26 00:23:13 user nova-compute[75165]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 00:23:13 user nova-compute[75165]:         <nova:vcpus>1</nova:vcpus>
Oct 26 00:23:13 user nova-compute[75165]:       </nova:flavor>
Oct 26 00:23:13 user nova-compute[75165]:       <nova:owner>
Oct 26 00:23:13 user nova-compute[75165]:         <nova:user uuid="7cd8b7fb014340bcb4efbe7a0063cdc7">tempest-VolumesSnapshotTestJSON-1190581483-project-member</nova:user>
Oct 26 00:23:13 user nova-compute[75165]:         <nova:project uuid="9eed16e1778f4ffb93afcc1ddbfe3d72">tempest-VolumesSnapshotTestJSON-1190581483</nova:project>
Oct 26 00:23:13 user nova-compute[75165]:       </nova:owner>
Oct 26 00:23:13 user nova-compute[75165]:       <nova:root type="image" uuid="bff0d8a1-739e-4c4d-9efa-b73ba7b76d01"/>
Oct 26 00:23:13 user nova-compute[75165]:       <nova:ports>
Oct 26 00:23:13 user nova-compute[75165]:         <nova:port uuid="355e1ddf-4d49-4a04-8a77-e05df100b323">
Oct 26 00:23:13 user nova-compute[75165]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 26 00:23:13 user nova-compute[75165]:         </nova:port>
Oct 26 00:23:13 user nova-compute[75165]:       </nova:ports>
Oct 26 00:23:13 user nova-compute[75165]:     </nova:instance>
Oct 26 00:23:13 user nova-compute[75165]:   </metadata>
Oct 26 00:23:13 user nova-compute[75165]:   <sysinfo type="smbios">
Oct 26 00:23:13 user nova-compute[75165]:     <system>
Oct 26 00:23:13 user nova-compute[75165]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 00:23:13 user nova-compute[75165]:       <entry name="product">OpenStack Nova</entry>
Oct 26 00:23:13 user nova-compute[75165]:       <entry name="version">0.0.0</entry>
Oct 26 00:23:13 user nova-compute[75165]:       <entry name="serial">91c62531-62f9-4f17-914c-11edc5010b54</entry>
Oct 26 00:23:13 user nova-compute[75165]:       <entry name="uuid">91c62531-62f9-4f17-914c-11edc5010b54</entry>
Oct 26 00:23:13 user nova-compute[75165]:       <entry name="family">Virtual Machine</entry>
Oct 26 00:23:13 user nova-compute[75165]:     </system>
Oct 26 00:23:13 user nova-compute[75165]:   </sysinfo>
Oct 26 00:23:13 user nova-compute[75165]:   <os>
Oct 26 00:23:13 user nova-compute[75165]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 00:23:13 user nova-compute[75165]:     <boot dev="hd"/>
Oct 26 00:23:13 user nova-compute[75165]:     <smbios mode="sysinfo"/>
Oct 26 00:23:13 user nova-compute[75165]:   </os>
Oct 26 00:23:13 user nova-compute[75165]:   <features>
Oct 26 00:23:13 user nova-compute[75165]:     <acpi/>
Oct 26 00:23:13 user nova-compute[75165]:     <apic/>
Oct 26 00:23:13 user nova-compute[75165]:     <vmcoreinfo/>
Oct 26 00:23:13 user nova-compute[75165]:   </features>
Oct 26 00:23:13 user nova-compute[75165]:   <clock offset="utc">
Oct 26 00:23:13 user nova-compute[75165]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 00:23:13 user nova-compute[75165]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 00:23:13 user nova-compute[75165]:     <timer name="hpet" present="no"/>
Oct 26 00:23:13 user nova-compute[75165]:   </clock>
Oct 26 00:23:13 user nova-compute[75165]:   <cpu mode="custom" match="exact">
Oct 26 00:23:13 user nova-compute[75165]:     <model>Nehalem</model>
Oct 26 00:23:13 user nova-compute[75165]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 00:23:13 user nova-compute[75165]:   </cpu>
Oct 26 00:23:13 user nova-compute[75165]:   <devices>
Oct 26 00:23:13 user nova-compute[75165]:     <disk type="file" device="disk">
Oct 26 00:23:13 user nova-compute[75165]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 00:23:13 user nova-compute[75165]:       <source file="/opt/stack/data/nova/instances/91c62531-62f9-4f17-914c-11edc5010b54/disk"/>
Oct 26 00:23:13 user nova-compute[75165]:       <target dev="vda" bus="virtio"/>
Oct 26 00:23:13 user nova-compute[75165]:     </disk>
Oct 26 00:23:13 user nova-compute[75165]:     <interface type="ethernet">
Oct 26 00:23:13 user nova-compute[75165]:       <mac address="fa:16:3e:61:d7:b9"/>
Oct 26 00:23:13 user nova-compute[75165]:       <model type="virtio"/>
Oct 26 00:23:13 user nova-compute[75165]:       <mtu size="1442"/>
Oct 26 00:23:13 user nova-compute[75165]:       <target dev="tap355e1ddf-4d"/>
Oct 26 00:23:13 user nova-compute[75165]:     </interface>
Oct 26 00:23:13 user nova-compute[75165]:     <serial type="pty">
Oct 26 00:23:13 user nova-compute[75165]:       <log file="/opt/stack/data/nova/instances/91c62531-62f9-4f17-914c-11edc5010b54/console.log" append="off"/>
Oct 26 00:23:13 user nova-compute[75165]:     </serial>
Oct 26 00:23:13 user nova-compute[75165]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 00:23:13 user nova-compute[75165]:     <video>
Oct 26 00:23:13 user nova-compute[75165]:       <model type="virtio"/>
Oct 26 00:23:13 user nova-compute[75165]:     </video>
Oct 26 00:23:13 user nova-compute[75165]:     <rng model="virtio">
Oct 26 00:23:13 user nova-compute[75165]:       <backend model="random">/dev/urandom</backend>
Oct 26 00:23:13 user nova-compute[75165]:     </rng>
Oct 26 00:23:13 user nova-compute[75165]:     <controller type="usb" index="0" model="none"/>
Oct 26 00:23:13 user nova-compute[75165]:     <memballoon model="virtio">
Oct 26 00:23:13 user nova-compute[75165]:       <stats period="10"/>
Oct 26 00:23:13 user nova-compute[75165]:     </memballoon>
Oct 26 00:23:13 user nova-compute[75165]:   </devices>
Oct 26 00:23:13 user nova-compute[75165]: </domain>
Oct 26 00:23:13 user nova-compute[75165]:  {{(pid=75165) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 00:23:13 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-a9547b50-841c-4118-a8ac-58d2a4adbf27 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:23:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-458420097',display_name='tempest-VolumesSnapshotTestJSON-instance-458420097',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-458420097',id=29,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCUFJ542m4EQF4GLsHDGK3DhvJTpq/I9HCX9CEVTbeMR/PgJyJsAlaax4d8zX8eZcrMJi5ajyQQHnWVQNJULlSaYjv2PNnnQAV/Lwov9mpiKMXXssgCsM15ioIYwhOc9mg==',key_name='tempest-keypair-479927283',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9eed16e1778f4ffb93afcc1ddbfe3d72',ramdisk_id='',reservation_id='r-kikdnv09',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1190581483',owner_user_name='tempest-VolumesSnapshotTestJSON-1190581483-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T00:23:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7cd8b7fb014340bcb4efbe7a0063cdc7',uuid=91c62531-62f9-4f17-914c-11edc5010b54,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "355e1ddf-4d49-4a04-8a77-e05df100b323", "address": "fa:16:3e:61:d7:b9", "network": {"id": "6b000f11-7be2-4a26-ba67-b10f275e8560", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1605988141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eed16e1778f4ffb93afcc1ddbfe3d72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap355e1ddf-4d", "ovs_interfaceid": "355e1ddf-4d49-4a04-8a77-e05df100b323", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 00:23:13 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-a9547b50-841c-4118-a8ac-58d2a4adbf27 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Converting VIF {"id": "355e1ddf-4d49-4a04-8a77-e05df100b323", "address": "fa:16:3e:61:d7:b9", "network": {"id": "6b000f11-7be2-4a26-ba67-b10f275e8560", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1605988141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eed16e1778f4ffb93afcc1ddbfe3d72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap355e1ddf-4d", "ovs_interfaceid": "355e1ddf-4d49-4a04-8a77-e05df100b323", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:23:13 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-a9547b50-841c-4118-a8ac-58d2a4adbf27 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:d7:b9,bridge_name='br-int',has_traffic_filtering=True,id=355e1ddf-4d49-4a04-8a77-e05df100b323,network=Network(6b000f11-7be2-4a26-ba67-b10f275e8560),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap355e1ddf-4d') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:23:13 user nova-compute[75165]: DEBUG os_vif [None req-a9547b50-841c-4118-a8ac-58d2a4adbf27 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:d7:b9,bridge_name='br-int',has_traffic_filtering=True,id=355e1ddf-4d49-4a04-8a77-e05df100b323,network=Network(6b000f11-7be2-4a26-ba67-b10f275e8560),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap355e1ddf-4d') {{(pid=75165) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 00:23:13 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:23:13 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:23:13 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 00:23:13 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:23:13 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '03ea1ac7-cb06-5a6e-8c3d-e45e2c127e8b', '_type': 'linux-noop'}}, row=False) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:23:13 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:23:13 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:23:13 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap355e1ddf-4d, may_exist=True, interface_attrs={}) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:23:13 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap355e1ddf-4d, col_values=(('qos', UUID('686da31a-21c7-4086-b9e2-1625101f67be')),), if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:23:13 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap355e1ddf-4d, col_values=(('external_ids', {'iface-id': '355e1ddf-4d49-4a04-8a77-e05df100b323', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:61:d7:b9', 'vm-uuid': '91c62531-62f9-4f17-914c-11edc5010b54'}),), if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:23:13 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:23:13 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:23:13 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:23:13 user nova-compute[75165]: INFO os_vif [None req-a9547b50-841c-4118-a8ac-58d2a4adbf27 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:d7:b9,bridge_name='br-int',has_traffic_filtering=True,id=355e1ddf-4d49-4a04-8a77-e05df100b323,network=Network(6b000f11-7be2-4a26-ba67-b10f275e8560),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap355e1ddf-4d')
Oct 26 00:23:14 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-a9547b50-841c-4118-a8ac-58d2a4adbf27 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] No BDM found with device name vda, not building metadata. {{(pid=75165) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 00:23:14 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-a9547b50-841c-4118-a8ac-58d2a4adbf27 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] No VIF found with MAC fa:16:3e:61:d7:b9, not building metadata {{(pid=75165) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 00:23:14 user nova-compute[75165]: DEBUG nova.network.neutron [req-a60b6a1d-9f43-49dd-a9b0-6deeb970ee4f req-f9f3348f-e836-430c-8671-03c6ebf80ed9 service nova] [instance: 91c62531-62f9-4f17-914c-11edc5010b54] Updated VIF entry in instance network info cache for port 355e1ddf-4d49-4a04-8a77-e05df100b323. {{(pid=75165) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 00:23:14 user nova-compute[75165]: DEBUG nova.network.neutron [req-a60b6a1d-9f43-49dd-a9b0-6deeb970ee4f req-f9f3348f-e836-430c-8671-03c6ebf80ed9 service nova] [instance: 91c62531-62f9-4f17-914c-11edc5010b54] Updating instance_info_cache with network_info: [{"id": "355e1ddf-4d49-4a04-8a77-e05df100b323", "address": "fa:16:3e:61:d7:b9", "network": {"id": "6b000f11-7be2-4a26-ba67-b10f275e8560", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1605988141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eed16e1778f4ffb93afcc1ddbfe3d72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap355e1ddf-4d", "ovs_interfaceid": "355e1ddf-4d49-4a04-8a77-e05df100b323", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:23:14 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-a60b6a1d-9f43-49dd-a9b0-6deeb970ee4f req-f9f3348f-e836-430c-8671-03c6ebf80ed9 service nova] Releasing lock "refresh_cache-91c62531-62f9-4f17-914c-11edc5010b54" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:23:14 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:23:14 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:23:14 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:23:14 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:23:14 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:23:14 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:23:14 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75165) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 00:23:15 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:23:15 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:23:15 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:23:16 user nova-compute[75165]: DEBUG nova.compute.manager [req-228a300a-53c8-4f1b-b403-a6d44b504717 req-58a9d617-6a74-4433-88b8-78c1ffe989f9 service nova] [instance: 91c62531-62f9-4f17-914c-11edc5010b54] Received event network-vif-plugged-355e1ddf-4d49-4a04-8a77-e05df100b323 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:23:16 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-228a300a-53c8-4f1b-b403-a6d44b504717 req-58a9d617-6a74-4433-88b8-78c1ffe989f9 service nova] Acquiring lock "91c62531-62f9-4f17-914c-11edc5010b54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:23:16 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-228a300a-53c8-4f1b-b403-a6d44b504717 req-58a9d617-6a74-4433-88b8-78c1ffe989f9 service nova] Lock "91c62531-62f9-4f17-914c-11edc5010b54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:23:16 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-228a300a-53c8-4f1b-b403-a6d44b504717 req-58a9d617-6a74-4433-88b8-78c1ffe989f9 service nova] Lock "91c62531-62f9-4f17-914c-11edc5010b54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:23:16 user nova-compute[75165]: DEBUG nova.compute.manager [req-228a300a-53c8-4f1b-b403-a6d44b504717 req-58a9d617-6a74-4433-88b8-78c1ffe989f9 service nova] [instance: 91c62531-62f9-4f17-914c-11edc5010b54] No waiting events found dispatching network-vif-plugged-355e1ddf-4d49-4a04-8a77-e05df100b323 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:23:16 user nova-compute[75165]: WARNING nova.compute.manager [req-228a300a-53c8-4f1b-b403-a6d44b504717 req-58a9d617-6a74-4433-88b8-78c1ffe989f9 service nova] [instance: 91c62531-62f9-4f17-914c-11edc5010b54] Received unexpected event network-vif-plugged-355e1ddf-4d49-4a04-8a77-e05df100b323 for instance with vm_state building and task_state spawning.
Oct 26 00:23:16 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:23:16 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75165) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 00:23:16 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb/disk.rescue --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:23:16 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:23:16 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb/disk.rescue --force-share --output=json" returned: 0 in 0.216s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:23:16 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb/disk.rescue --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:23:16 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb/disk.rescue --force-share --output=json" returned: 0 in 0.210s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:23:16 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84c6b624-648b-40e2-a37e-ff08609bad84/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:23:17 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84c6b624-648b-40e2-a37e-ff08609bad84/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:23:17 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84c6b624-648b-40e2-a37e-ff08609bad84/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:23:17 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84c6b624-648b-40e2-a37e-ff08609bad84/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:23:17 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97fb67a7-637d-456f-b4dd-0a271ed6cfc4/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:23:17 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97fb67a7-637d-456f-b4dd-0a271ed6cfc4/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:23:17 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97fb67a7-637d-456f-b4dd-0a271ed6cfc4/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:23:17 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97fb67a7-637d-456f-b4dd-0a271ed6cfc4/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:23:17 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7eeb145-1565-4812-818b-fefda5f2436d/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:23:18 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7eeb145-1565-4812-818b-fefda5f2436d/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:23:18 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7eeb145-1565-4812-818b-fefda5f2436d/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:23:18 user nova-compute[75165]: DEBUG nova.compute.manager [req-d1111ce4-79fe-4ef9-ae06-a46664a1c50f req-8c6dfec1-d43d-453e-8a24-ffc5040277c5 service nova] [instance: 91c62531-62f9-4f17-914c-11edc5010b54] Received event network-vif-plugged-355e1ddf-4d49-4a04-8a77-e05df100b323 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:23:18 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-d1111ce4-79fe-4ef9-ae06-a46664a1c50f req-8c6dfec1-d43d-453e-8a24-ffc5040277c5 service nova] Acquiring lock "91c62531-62f9-4f17-914c-11edc5010b54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:23:18 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-d1111ce4-79fe-4ef9-ae06-a46664a1c50f req-8c6dfec1-d43d-453e-8a24-ffc5040277c5 service nova] Lock "91c62531-62f9-4f17-914c-11edc5010b54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:23:18 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-d1111ce4-79fe-4ef9-ae06-a46664a1c50f req-8c6dfec1-d43d-453e-8a24-ffc5040277c5 service nova] Lock "91c62531-62f9-4f17-914c-11edc5010b54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:23:18 user nova-compute[75165]: DEBUG nova.compute.manager [req-d1111ce4-79fe-4ef9-ae06-a46664a1c50f req-8c6dfec1-d43d-453e-8a24-ffc5040277c5 service nova] [instance: 91c62531-62f9-4f17-914c-11edc5010b54] No waiting events found dispatching network-vif-plugged-355e1ddf-4d49-4a04-8a77-e05df100b323 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:23:18 user nova-compute[75165]: WARNING nova.compute.manager [req-d1111ce4-79fe-4ef9-ae06-a46664a1c50f req-8c6dfec1-d43d-453e-8a24-ffc5040277c5 service nova] [instance: 91c62531-62f9-4f17-914c-11edc5010b54] Received unexpected event network-vif-plugged-355e1ddf-4d49-4a04-8a77-e05df100b323 for instance with vm_state building and task_state spawning.
Oct 26 00:23:18 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7eeb145-1565-4812-818b-fefda5f2436d/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:23:18 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91c62531-62f9-4f17-914c-11edc5010b54/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:23:18 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91c62531-62f9-4f17-914c-11edc5010b54/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:23:18 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91c62531-62f9-4f17-914c-11edc5010b54/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:23:18 user nova-compute[75165]: DEBUG nova.compute.manager [None req-a9547b50-841c-4118-a8ac-58d2a4adbf27 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] [instance: 91c62531-62f9-4f17-914c-11edc5010b54] Instance event wait completed in 0 seconds for  {{(pid=75165) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 00:23:18 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-a9547b50-841c-4118-a8ac-58d2a4adbf27 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] [instance: 91c62531-62f9-4f17-914c-11edc5010b54] Guest created on hypervisor {{(pid=75165) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 00:23:18 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: 91c62531-62f9-4f17-914c-11edc5010b54] Instance spawned successfully.
Oct 26 00:23:18 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-a9547b50-841c-4118-a8ac-58d2a4adbf27 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] [instance: 91c62531-62f9-4f17-914c-11edc5010b54] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 00:23:18 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-a9547b50-841c-4118-a8ac-58d2a4adbf27 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] [instance: 91c62531-62f9-4f17-914c-11edc5010b54] Found default for hw_cdrom_bus of ide {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:23:18 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-a9547b50-841c-4118-a8ac-58d2a4adbf27 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] [instance: 91c62531-62f9-4f17-914c-11edc5010b54] Found default for hw_disk_bus of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:23:18 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-a9547b50-841c-4118-a8ac-58d2a4adbf27 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] [instance: 91c62531-62f9-4f17-914c-11edc5010b54] Found default for hw_input_bus of None {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:23:18 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-a9547b50-841c-4118-a8ac-58d2a4adbf27 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] [instance: 91c62531-62f9-4f17-914c-11edc5010b54] Found default for hw_pointer_model of None {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:23:18 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-a9547b50-841c-4118-a8ac-58d2a4adbf27 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] [instance: 91c62531-62f9-4f17-914c-11edc5010b54] Found default for hw_video_model of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:23:18 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-a9547b50-841c-4118-a8ac-58d2a4adbf27 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] [instance: 91c62531-62f9-4f17-914c-11edc5010b54] Found default for hw_vif_model of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:23:18 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91c62531-62f9-4f17-914c-11edc5010b54/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:23:18 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75165) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 00:23:18 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e44bfc-6a68-46ce-8335-aaaba5160d3e/disk.rescue --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:23:18 user nova-compute[75165]: INFO nova.compute.manager [None req-a9547b50-841c-4118-a8ac-58d2a4adbf27 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] [instance: 91c62531-62f9-4f17-914c-11edc5010b54] Took 7.53 seconds to spawn the instance on the hypervisor.
Oct 26 00:23:18 user nova-compute[75165]: DEBUG nova.compute.manager [None req-a9547b50-841c-4118-a8ac-58d2a4adbf27 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] [instance: 91c62531-62f9-4f17-914c-11edc5010b54] Checking state {{(pid=75165) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 00:23:18 user nova-compute[75165]: INFO nova.compute.manager [None req-a9547b50-841c-4118-a8ac-58d2a4adbf27 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] [instance: 91c62531-62f9-4f17-914c-11edc5010b54] Took 8.54 seconds to build instance.
Oct 26 00:23:18 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e44bfc-6a68-46ce-8335-aaaba5160d3e/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:23:18 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e44bfc-6a68-46ce-8335-aaaba5160d3e/disk.rescue --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:23:18 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-a9547b50-841c-4118-a8ac-58d2a4adbf27 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Lock "91c62531-62f9-4f17-914c-11edc5010b54" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.712s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:23:18 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:23:19 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e44bfc-6a68-46ce-8335-aaaba5160d3e/disk.rescue --force-share --output=json" returned: 0 in 0.198s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:23:19 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e44bfc-6a68-46ce-8335-aaaba5160d3e/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:23:19 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e44bfc-6a68-46ce-8335-aaaba5160d3e/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:23:19 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e44bfc-6a68-46ce-8335-aaaba5160d3e/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:23:19 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4e44bfc-6a68-46ce-8335-aaaba5160d3e/disk --force-share --output=json" returned: 0 in 0.262s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:23:19 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27fa1771-fb69-49da-81b3-7f112e623170/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:23:19 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27fa1771-fb69-49da-81b3-7f112e623170/disk --force-share --output=json" returned: 0 in 0.281s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:23:19 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27fa1771-fb69-49da-81b3-7f112e623170/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:23:20 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27fa1771-fb69-49da-81b3-7f112e623170/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:23:20 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:23:20 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:23:20 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Hypervisor/Node resource view: name=user free_ram=8124MB free_disk=24.923107147216797GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75165) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 00:23:20 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:23:20 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:23:20 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Applying migration context for instance bad6c21f-885f-4348-86f7-b237ce2d241b as it has an incoming, in-progress migration ce1b14f5-5eda-4c2f-9326-42b5128167e0. Migration status is finished {{(pid=75165) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Oct 26 00:23:20 user nova-compute[75165]: INFO nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: bad6c21f-885f-4348-86f7-b237ce2d241b] Updating resource usage from migration ce1b14f5-5eda-4c2f-9326-42b5128167e0
Oct 26 00:23:20 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 84c6b624-648b-40e2-a37e-ff08609bad84 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:23:20 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance c4e44bfc-6a68-46ce-8335-aaaba5160d3e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:23:20 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance a7eeb145-1565-4812-818b-fefda5f2436d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:23:20 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 27fa1771-fb69-49da-81b3-7f112e623170 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:23:20 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 97fb67a7-637d-456f-b4dd-0a271ed6cfc4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:23:20 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Migration ce1b14f5-5eda-4c2f-9326-42b5128167e0 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Oct 26 00:23:20 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance bad6c21f-885f-4348-86f7-b237ce2d241b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:23:20 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:23:20 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 91c62531-62f9-4f17-914c-11edc5010b54 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:23:20 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75165) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 00:23:20 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75165) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 00:23:21 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Refreshing inventories for resource provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 26 00:23:21 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Updating ProviderTree inventory for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 26 00:23:21 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Updating inventory in ProviderTree for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 26 00:23:21 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Refreshing aggregate associations for resource provider 03214fd5-21d1-46ec-b6b0-6449b77ba230, aggregates: None {{(pid=75165) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 26 00:23:21 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Refreshing trait associations for resource provider 03214fd5-21d1-46ec-b6b0-6449b77ba230, traits: COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NODE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_TRUSTED_CERTS,COMPUTE_DEVICE_TAGGING,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO {{(pid=75165) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 26 00:23:21 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:23:21 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:23:21 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:23:21 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Compute_service record updated for user:user {{(pid=75165) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 00:23:21 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.869s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:23:21 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:23:21 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Cleaning up deleted instances {{(pid=75165) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 26 00:23:21 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] There are 0 instances to clean {{(pid=75165) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 26 00:23:21 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:23:22 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:23:22 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Starting heal instance info cache {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 00:23:22 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "refresh_cache-c4e44bfc-6a68-46ce-8335-aaaba5160d3e" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:23:22 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquired lock "refresh_cache-c4e44bfc-6a68-46ce-8335-aaaba5160d3e" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:23:22 user nova-compute[75165]: DEBUG nova.network.neutron [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: c4e44bfc-6a68-46ce-8335-aaaba5160d3e] Forcefully refreshing network info cache for instance {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 00:23:23 user nova-compute[75165]: DEBUG nova.network.neutron [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: c4e44bfc-6a68-46ce-8335-aaaba5160d3e] Updating instance_info_cache with network_info: [{"id": "842f3b7a-8da7-48d2-90f7-7241fbaab648", "address": "fa:16:3e:1f:64:04", "network": {"id": "b31bac4b-1951-4ca3-8682-f1f24de0a5c3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1323234642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71aa69c0ea2d49e184e1e055ff3efa1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap842f3b7a-8d", "ovs_interfaceid": "842f3b7a-8da7-48d2-90f7-7241fbaab648", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:23:23 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Releasing lock "refresh_cache-c4e44bfc-6a68-46ce-8335-aaaba5160d3e" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:23:23 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: c4e44bfc-6a68-46ce-8335-aaaba5160d3e] Updated the network info_cache for instance {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 00:23:23 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:23:23 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:23:23 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75165) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 26 00:23:23 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:23:26 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:23:28 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:23:31 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:23:33 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:23:36 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:23:38 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:23:40 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-ff93bc37-b774-480e-a8f8-bc82ea72a0c4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Acquiring lock "bad6c21f-885f-4348-86f7-b237ce2d241b" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:23:40 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-ff93bc37-b774-480e-a8f8-bc82ea72a0c4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Lock "bad6c21f-885f-4348-86f7-b237ce2d241b" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:23:40 user nova-compute[75165]: DEBUG nova.compute.manager [None req-ff93bc37-b774-480e-a8f8-bc82ea72a0c4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: bad6c21f-885f-4348-86f7-b237ce2d241b] Going to confirm migration 2 {{(pid=75165) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4773}}
Oct 26 00:23:40 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-ff93bc37-b774-480e-a8f8-bc82ea72a0c4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Acquiring lock "refresh_cache-bad6c21f-885f-4348-86f7-b237ce2d241b" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:23:40 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-ff93bc37-b774-480e-a8f8-bc82ea72a0c4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Acquired lock "refresh_cache-bad6c21f-885f-4348-86f7-b237ce2d241b" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:23:40 user nova-compute[75165]: DEBUG nova.network.neutron [None req-ff93bc37-b774-480e-a8f8-bc82ea72a0c4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: bad6c21f-885f-4348-86f7-b237ce2d241b] Building network info cache for instance {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 00:23:40 user nova-compute[75165]: DEBUG nova.objects.instance [None req-ff93bc37-b774-480e-a8f8-bc82ea72a0c4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Lazy-loading 'info_cache' on Instance uuid bad6c21f-885f-4348-86f7-b237ce2d241b {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:23:41 user nova-compute[75165]: DEBUG nova.network.neutron [None req-ff93bc37-b774-480e-a8f8-bc82ea72a0c4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: bad6c21f-885f-4348-86f7-b237ce2d241b] Updating instance_info_cache with network_info: [{"id": "b64d421a-ca91-4f21-80f7-17b0c17ceb8a", "address": "fa:16:3e:54:54:b8", "network": {"id": "bd1c84f9-bba9-4a23-8bf2-17e65022136a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1557945804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2911497df44047d9a9ee36a5652298bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb64d421a-ca", "ovs_interfaceid": "b64d421a-ca91-4f21-80f7-17b0c17ceb8a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:23:41 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-ff93bc37-b774-480e-a8f8-bc82ea72a0c4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Releasing lock "refresh_cache-bad6c21f-885f-4348-86f7-b237ce2d241b" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:23:41 user nova-compute[75165]: DEBUG nova.objects.instance [None req-ff93bc37-b774-480e-a8f8-bc82ea72a0c4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Lazy-loading 'migration_context' on Instance uuid bad6c21f-885f-4348-86f7-b237ce2d241b {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:23:41 user nova-compute[75165]: DEBUG nova.objects.base [None req-ff93bc37-b774-480e-a8f8-bc82ea72a0c4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Object Instance<bad6c21f-885f-4348-86f7-b237ce2d241b> lazy-loaded attributes: info_cache,migration_context {{(pid=75165) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 00:23:41 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-ff93bc37-b774-480e-a8f8-bc82ea72a0c4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:23:41 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-ff93bc37-b774-480e-a8f8-bc82ea72a0c4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:23:41 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:23:41 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-ff93bc37-b774-480e-a8f8-bc82ea72a0c4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:23:41 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-ff93bc37-b774-480e-a8f8-bc82ea72a0c4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:23:41 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-ff93bc37-b774-480e-a8f8-bc82ea72a0c4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.392s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:23:41 user nova-compute[75165]: INFO nova.scheduler.client.report [None req-ff93bc37-b774-480e-a8f8-bc82ea72a0c4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Deleted allocation for migration ce1b14f5-5eda-4c2f-9326-42b5128167e0
Oct 26 00:23:41 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-ff93bc37-b774-480e-a8f8-bc82ea72a0c4 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Lock "bad6c21f-885f-4348-86f7-b237ce2d241b" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.383s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:23:43 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-46f85bba-9004-4016-aeea-d84672dc4dfd tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Acquiring lock "27fa1771-fb69-49da-81b3-7f112e623170" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:23:43 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-46f85bba-9004-4016-aeea-d84672dc4dfd tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Lock "27fa1771-fb69-49da-81b3-7f112e623170" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:23:43 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-46f85bba-9004-4016-aeea-d84672dc4dfd tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Acquiring lock "27fa1771-fb69-49da-81b3-7f112e623170-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:23:43 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-46f85bba-9004-4016-aeea-d84672dc4dfd tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Lock "27fa1771-fb69-49da-81b3-7f112e623170-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:23:43 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-46f85bba-9004-4016-aeea-d84672dc4dfd tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Lock "27fa1771-fb69-49da-81b3-7f112e623170-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:23:43 user nova-compute[75165]: INFO nova.compute.manager [None req-46f85bba-9004-4016-aeea-d84672dc4dfd tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] [instance: 27fa1771-fb69-49da-81b3-7f112e623170] Terminating instance
Oct 26 00:23:43 user nova-compute[75165]: DEBUG nova.compute.manager [None req-46f85bba-9004-4016-aeea-d84672dc4dfd tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] [instance: 27fa1771-fb69-49da-81b3-7f112e623170] Start destroying the instance on the hypervisor. {{(pid=75165) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 00:23:43 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:23:43 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:23:43 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:23:43 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:23:43 user nova-compute[75165]: DEBUG nova.compute.manager [req-14f3f26a-3ae4-4913-a3eb-55079bb16326 req-a0f80f14-492d-43f6-b636-5054dd693069 service nova] [instance: 27fa1771-fb69-49da-81b3-7f112e623170] Received event network-vif-unplugged-4d97651b-5d7c-4778-85a4-a11588892b31 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:23:43 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-14f3f26a-3ae4-4913-a3eb-55079bb16326 req-a0f80f14-492d-43f6-b636-5054dd693069 service nova] Acquiring lock "27fa1771-fb69-49da-81b3-7f112e623170-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:23:43 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-14f3f26a-3ae4-4913-a3eb-55079bb16326 req-a0f80f14-492d-43f6-b636-5054dd693069 service nova] Lock "27fa1771-fb69-49da-81b3-7f112e623170-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:23:43 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-14f3f26a-3ae4-4913-a3eb-55079bb16326 req-a0f80f14-492d-43f6-b636-5054dd693069 service nova] Lock "27fa1771-fb69-49da-81b3-7f112e623170-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:23:43 user nova-compute[75165]: DEBUG nova.compute.manager [req-14f3f26a-3ae4-4913-a3eb-55079bb16326 req-a0f80f14-492d-43f6-b636-5054dd693069 service nova] [instance: 27fa1771-fb69-49da-81b3-7f112e623170] No waiting events found dispatching network-vif-unplugged-4d97651b-5d7c-4778-85a4-a11588892b31 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:23:43 user nova-compute[75165]: DEBUG nova.compute.manager [req-14f3f26a-3ae4-4913-a3eb-55079bb16326 req-a0f80f14-492d-43f6-b636-5054dd693069 service nova] [instance: 27fa1771-fb69-49da-81b3-7f112e623170] Received event network-vif-unplugged-4d97651b-5d7c-4778-85a4-a11588892b31 for instance with task_state deleting. {{(pid=75165) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 00:23:43 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: 27fa1771-fb69-49da-81b3-7f112e623170] Instance destroyed successfully.
Oct 26 00:23:43 user nova-compute[75165]: DEBUG nova.objects.instance [None req-46f85bba-9004-4016-aeea-d84672dc4dfd tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Lazy-loading 'resources' on Instance uuid 27fa1771-fb69-49da-81b3-7f112e623170 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:23:43 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-46f85bba-9004-4016-aeea-d84672dc4dfd tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:13:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1390737120',display_name='tempest-AttachVolumeTestJSON-server-1390737120',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1390737120',id=20,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEolsf1MVpCHotOftiJQ4Zgsnx29J3YYZZ32cA7FaSf4r6DElmgaLg7eBXc3I/pwZzl9KTJMnY6YgVOXkfwz2nESGnC4fUVVLf94BqH2qQSBNdKz1HLQzjXno+XfnON8kw==',key_name='tempest-keypair-763586997',keypairs=<?>,launch_index=0,launched_at=2023-10-26T00:13:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3ffbf5c944914cafac7aba65fb7ca402',ramdisk_id='',reservation_id='r-ox40rq7n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2130746724',owner_user_name='tempest-AttachVolumeTestJSON-2130746724-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T00:21:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='841b5be7c0b348de979920fc9ae223ed',uuid=27fa1771-fb69-49da-81b3-7f112e623170,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4d97651b-5d7c-4778-85a4-a11588892b31", "address": "fa:16:3e:c5:bb:76", "network": {"id": "7e330392-6256-405b-ab37-0b8af0c4fd48", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-430326049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ffbf5c944914cafac7aba65fb7ca402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d97651b-5d", "ovs_interfaceid": "4d97651b-5d7c-4778-85a4-a11588892b31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 00:23:43 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-46f85bba-9004-4016-aeea-d84672dc4dfd tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Converting VIF {"id": "4d97651b-5d7c-4778-85a4-a11588892b31", "address": "fa:16:3e:c5:bb:76", "network": {"id": "7e330392-6256-405b-ab37-0b8af0c4fd48", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-430326049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ffbf5c944914cafac7aba65fb7ca402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d97651b-5d", "ovs_interfaceid": "4d97651b-5d7c-4778-85a4-a11588892b31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:23:43 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-46f85bba-9004-4016-aeea-d84672dc4dfd tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:bb:76,bridge_name='br-int',has_traffic_filtering=True,id=4d97651b-5d7c-4778-85a4-a11588892b31,network=Network(7e330392-6256-405b-ab37-0b8af0c4fd48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d97651b-5d') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:23:43 user nova-compute[75165]: DEBUG os_vif [None req-46f85bba-9004-4016-aeea-d84672dc4dfd tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:bb:76,bridge_name='br-int',has_traffic_filtering=True,id=4d97651b-5d7c-4778-85a4-a11588892b31,network=Network(7e330392-6256-405b-ab37-0b8af0c4fd48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d97651b-5d') {{(pid=75165) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 00:23:43 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:23:43 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4d97651b-5d, bridge=br-int, if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:23:43 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:23:43 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:23:43 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:23:43 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a7b66165-26fb-49a9-96dc-e8cd90538900) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:23:43 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:23:43 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:23:43 user nova-compute[75165]: INFO os_vif [None req-46f85bba-9004-4016-aeea-d84672dc4dfd tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:bb:76,bridge_name='br-int',has_traffic_filtering=True,id=4d97651b-5d7c-4778-85a4-a11588892b31,network=Network(7e330392-6256-405b-ab37-0b8af0c4fd48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d97651b-5d')
Oct 26 00:23:43 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-46f85bba-9004-4016-aeea-d84672dc4dfd tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] [instance: 27fa1771-fb69-49da-81b3-7f112e623170] Deleting instance files /opt/stack/data/nova/instances/27fa1771-fb69-49da-81b3-7f112e623170_del
Oct 26 00:23:43 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-46f85bba-9004-4016-aeea-d84672dc4dfd tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] [instance: 27fa1771-fb69-49da-81b3-7f112e623170] Deletion of /opt/stack/data/nova/instances/27fa1771-fb69-49da-81b3-7f112e623170_del complete
Oct 26 00:23:43 user nova-compute[75165]: INFO nova.compute.manager [None req-46f85bba-9004-4016-aeea-d84672dc4dfd tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] [instance: 27fa1771-fb69-49da-81b3-7f112e623170] Took 0.69 seconds to destroy the instance on the hypervisor.
Oct 26 00:23:43 user nova-compute[75165]: DEBUG oslo.service.loopingcall [None req-46f85bba-9004-4016-aeea-d84672dc4dfd tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75165) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 00:23:43 user nova-compute[75165]: DEBUG nova.compute.manager [-] [instance: 27fa1771-fb69-49da-81b3-7f112e623170] Deallocating network for instance {{(pid=75165) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 00:23:43 user nova-compute[75165]: DEBUG nova.network.neutron [-] [instance: 27fa1771-fb69-49da-81b3-7f112e623170] deallocate_for_instance() {{(pid=75165) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 00:23:44 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:23:44 user nova-compute[75165]: WARNING nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] While synchronizing instance power states, found 8 instances in the database and 7 instances on the hypervisor.
Oct 26 00:23:44 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Triggering sync for uuid 84c6b624-648b-40e2-a37e-ff08609bad84 {{(pid=75165) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 00:23:44 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Triggering sync for uuid c4e44bfc-6a68-46ce-8335-aaaba5160d3e {{(pid=75165) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 00:23:44 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Triggering sync for uuid a7eeb145-1565-4812-818b-fefda5f2436d {{(pid=75165) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 00:23:44 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Triggering sync for uuid 97fb67a7-637d-456f-b4dd-0a271ed6cfc4 {{(pid=75165) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 00:23:44 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Triggering sync for uuid bad6c21f-885f-4348-86f7-b237ce2d241b {{(pid=75165) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 00:23:44 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Triggering sync for uuid a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb {{(pid=75165) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 00:23:44 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Triggering sync for uuid 91c62531-62f9-4f17-914c-11edc5010b54 {{(pid=75165) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 00:23:44 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Triggering sync for uuid 27fa1771-fb69-49da-81b3-7f112e623170 {{(pid=75165) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 00:23:44 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "84c6b624-648b-40e2-a37e-ff08609bad84" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:23:44 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "84c6b624-648b-40e2-a37e-ff08609bad84" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:23:44 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "c4e44bfc-6a68-46ce-8335-aaaba5160d3e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:23:44 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "c4e44bfc-6a68-46ce-8335-aaaba5160d3e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:23:44 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "a7eeb145-1565-4812-818b-fefda5f2436d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:23:44 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "a7eeb145-1565-4812-818b-fefda5f2436d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:23:44 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "97fb67a7-637d-456f-b4dd-0a271ed6cfc4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:23:44 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "97fb67a7-637d-456f-b4dd-0a271ed6cfc4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:23:44 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "bad6c21f-885f-4348-86f7-b237ce2d241b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:23:44 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "bad6c21f-885f-4348-86f7-b237ce2d241b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:23:44 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:23:44 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:23:44 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "91c62531-62f9-4f17-914c-11edc5010b54" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:23:44 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "91c62531-62f9-4f17-914c-11edc5010b54" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:23:44 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "27fa1771-fb69-49da-81b3-7f112e623170" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:23:44 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "a7eeb145-1565-4812-818b-fefda5f2436d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.044s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:23:44 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "c4e44bfc-6a68-46ce-8335-aaaba5160d3e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.049s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:23:44 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.050s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:23:44 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "bad6c21f-885f-4348-86f7-b237ce2d241b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.058s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:23:44 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "84c6b624-648b-40e2-a37e-ff08609bad84" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.069s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:23:44 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "97fb67a7-637d-456f-b4dd-0a271ed6cfc4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.079s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:23:44 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "91c62531-62f9-4f17-914c-11edc5010b54" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.091s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:23:44 user nova-compute[75165]: DEBUG nova.network.neutron [-] [instance: 27fa1771-fb69-49da-81b3-7f112e623170] Updating instance_info_cache with network_info: [] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:23:44 user nova-compute[75165]: DEBUG nova.compute.manager [req-62a356a8-7f8d-46e2-8758-05c75be46814 req-a299931f-bbc8-4808-a914-15626be7a728 service nova] [instance: 27fa1771-fb69-49da-81b3-7f112e623170] Received event network-vif-deleted-4d97651b-5d7c-4778-85a4-a11588892b31 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:23:44 user nova-compute[75165]: INFO nova.compute.manager [req-62a356a8-7f8d-46e2-8758-05c75be46814 req-a299931f-bbc8-4808-a914-15626be7a728 service nova] [instance: 27fa1771-fb69-49da-81b3-7f112e623170] Neutron deleted interface 4d97651b-5d7c-4778-85a4-a11588892b31; detaching it from the instance and deleting it from the info cache
Oct 26 00:23:44 user nova-compute[75165]: DEBUG nova.network.neutron [req-62a356a8-7f8d-46e2-8758-05c75be46814 req-a299931f-bbc8-4808-a914-15626be7a728 service nova] [instance: 27fa1771-fb69-49da-81b3-7f112e623170] Updating instance_info_cache with network_info: [] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:23:44 user nova-compute[75165]: INFO nova.compute.manager [-] [instance: 27fa1771-fb69-49da-81b3-7f112e623170] Took 1.10 seconds to deallocate network for instance.
Oct 26 00:23:44 user nova-compute[75165]: DEBUG nova.compute.manager [req-62a356a8-7f8d-46e2-8758-05c75be46814 req-a299931f-bbc8-4808-a914-15626be7a728 service nova] [instance: 27fa1771-fb69-49da-81b3-7f112e623170] Detach interface failed, port_id=4d97651b-5d7c-4778-85a4-a11588892b31, reason: Instance 27fa1771-fb69-49da-81b3-7f112e623170 could not be found. {{(pid=75165) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 26 00:23:45 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-46f85bba-9004-4016-aeea-d84672dc4dfd tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:23:45 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-46f85bba-9004-4016-aeea-d84672dc4dfd tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:23:45 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-46f85bba-9004-4016-aeea-d84672dc4dfd tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:23:45 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-46f85bba-9004-4016-aeea-d84672dc4dfd tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:23:45 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-46f85bba-9004-4016-aeea-d84672dc4dfd tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.386s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:23:45 user nova-compute[75165]: INFO nova.scheduler.client.report [None req-46f85bba-9004-4016-aeea-d84672dc4dfd tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Deleted allocations for instance 27fa1771-fb69-49da-81b3-7f112e623170
Oct 26 00:23:45 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-46f85bba-9004-4016-aeea-d84672dc4dfd tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Lock "27fa1771-fb69-49da-81b3-7f112e623170" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.376s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:23:45 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "27fa1771-fb69-49da-81b3-7f112e623170" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 1.262s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:23:45 user nova-compute[75165]: INFO nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: 27fa1771-fb69-49da-81b3-7f112e623170] During sync_power_state the instance has a pending task (deleting). Skip.
Oct 26 00:23:45 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "27fa1771-fb69-49da-81b3-7f112e623170" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:23:45 user nova-compute[75165]: DEBUG nova.compute.manager [req-3b399184-d7a0-487d-8ccd-30f15a726dbe req-97591e92-b7e7-42d8-bea9-95411ba5e77c service nova] [instance: 27fa1771-fb69-49da-81b3-7f112e623170] Received event network-vif-plugged-4d97651b-5d7c-4778-85a4-a11588892b31 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:23:45 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-3b399184-d7a0-487d-8ccd-30f15a726dbe req-97591e92-b7e7-42d8-bea9-95411ba5e77c service nova] Acquiring lock "27fa1771-fb69-49da-81b3-7f112e623170-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:23:45 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-3b399184-d7a0-487d-8ccd-30f15a726dbe req-97591e92-b7e7-42d8-bea9-95411ba5e77c service nova] Lock "27fa1771-fb69-49da-81b3-7f112e623170-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:23:45 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-3b399184-d7a0-487d-8ccd-30f15a726dbe req-97591e92-b7e7-42d8-bea9-95411ba5e77c service nova] Lock "27fa1771-fb69-49da-81b3-7f112e623170-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:23:45 user nova-compute[75165]: DEBUG nova.compute.manager [req-3b399184-d7a0-487d-8ccd-30f15a726dbe req-97591e92-b7e7-42d8-bea9-95411ba5e77c service nova] [instance: 27fa1771-fb69-49da-81b3-7f112e623170] No waiting events found dispatching network-vif-plugged-4d97651b-5d7c-4778-85a4-a11588892b31 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:23:45 user nova-compute[75165]: WARNING nova.compute.manager [req-3b399184-d7a0-487d-8ccd-30f15a726dbe req-97591e92-b7e7-42d8-bea9-95411ba5e77c service nova] [instance: 27fa1771-fb69-49da-81b3-7f112e623170] Received unexpected event network-vif-plugged-4d97651b-5d7c-4778-85a4-a11588892b31 for instance with vm_state deleted and task_state None.
Oct 26 00:23:46 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:23:48 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:23:50 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-6f22b28e-fa1d-443f-8ad8-58c52eff711f tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Acquiring lock "c4e44bfc-6a68-46ce-8335-aaaba5160d3e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:23:50 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-6f22b28e-fa1d-443f-8ad8-58c52eff711f tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Lock "c4e44bfc-6a68-46ce-8335-aaaba5160d3e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:23:50 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-6f22b28e-fa1d-443f-8ad8-58c52eff711f tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Acquiring lock "c4e44bfc-6a68-46ce-8335-aaaba5160d3e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:23:50 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-6f22b28e-fa1d-443f-8ad8-58c52eff711f tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Lock "c4e44bfc-6a68-46ce-8335-aaaba5160d3e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:23:50 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-6f22b28e-fa1d-443f-8ad8-58c52eff711f tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Lock "c4e44bfc-6a68-46ce-8335-aaaba5160d3e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:23:50 user nova-compute[75165]: INFO nova.compute.manager [None req-6f22b28e-fa1d-443f-8ad8-58c52eff711f tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: c4e44bfc-6a68-46ce-8335-aaaba5160d3e] Terminating instance
Oct 26 00:23:50 user nova-compute[75165]: DEBUG nova.compute.manager [None req-6f22b28e-fa1d-443f-8ad8-58c52eff711f tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: c4e44bfc-6a68-46ce-8335-aaaba5160d3e] Start destroying the instance on the hypervisor. {{(pid=75165) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 00:23:50 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:23:50 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:23:50 user nova-compute[75165]: DEBUG nova.compute.manager [req-e4f37e7d-62bc-45a7-9753-2b3af3f94c0c req-f9ea4da6-6277-448a-8bd4-a1c55519353b service nova] [instance: c4e44bfc-6a68-46ce-8335-aaaba5160d3e] Received event network-vif-unplugged-842f3b7a-8da7-48d2-90f7-7241fbaab648 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:23:50 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-e4f37e7d-62bc-45a7-9753-2b3af3f94c0c req-f9ea4da6-6277-448a-8bd4-a1c55519353b service nova] Acquiring lock "c4e44bfc-6a68-46ce-8335-aaaba5160d3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:23:50 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-e4f37e7d-62bc-45a7-9753-2b3af3f94c0c req-f9ea4da6-6277-448a-8bd4-a1c55519353b service nova] Lock "c4e44bfc-6a68-46ce-8335-aaaba5160d3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:23:50 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-e4f37e7d-62bc-45a7-9753-2b3af3f94c0c req-f9ea4da6-6277-448a-8bd4-a1c55519353b service nova] Lock "c4e44bfc-6a68-46ce-8335-aaaba5160d3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:23:50 user nova-compute[75165]: DEBUG nova.compute.manager [req-e4f37e7d-62bc-45a7-9753-2b3af3f94c0c req-f9ea4da6-6277-448a-8bd4-a1c55519353b service nova] [instance: c4e44bfc-6a68-46ce-8335-aaaba5160d3e] No waiting events found dispatching network-vif-unplugged-842f3b7a-8da7-48d2-90f7-7241fbaab648 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:23:50 user nova-compute[75165]: DEBUG nova.compute.manager [req-e4f37e7d-62bc-45a7-9753-2b3af3f94c0c req-f9ea4da6-6277-448a-8bd4-a1c55519353b service nova] [instance: c4e44bfc-6a68-46ce-8335-aaaba5160d3e] Received event network-vif-unplugged-842f3b7a-8da7-48d2-90f7-7241fbaab648 for instance with task_state deleting. {{(pid=75165) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 00:23:50 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:23:50 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:23:51 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: c4e44bfc-6a68-46ce-8335-aaaba5160d3e] Instance destroyed successfully.
Oct 26 00:23:51 user nova-compute[75165]: DEBUG nova.objects.instance [None req-6f22b28e-fa1d-443f-8ad8-58c52eff711f tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Lazy-loading 'resources' on Instance uuid c4e44bfc-6a68-46ce-8335-aaaba5160d3e {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:23:51 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-6f22b28e-fa1d-443f-8ad8-58c52eff711f tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:07:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1155771609',display_name='tempest-ServerRescueNegativeTestJSON-server-1155771609',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1155771609',id=4,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-26T00:09:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='71aa69c0ea2d49e184e1e055ff3efa1d',ramdisk_id='',reservation_id='r-6fsjgoly',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-2141505807',owner_user_name='tempest-ServerRescueNegativeTestJSON-2141505807-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T00:09:05Z,user_data=None,user_id='67876ca3211b47bc99af08436edeb91f',uuid=c4e44bfc-6a68-46ce-8335-aaaba5160d3e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "842f3b7a-8da7-48d2-90f7-7241fbaab648", "address": "fa:16:3e:1f:64:04", "network": {"id": "b31bac4b-1951-4ca3-8682-f1f24de0a5c3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1323234642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71aa69c0ea2d49e184e1e055ff3efa1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap842f3b7a-8d", "ovs_interfaceid": "842f3b7a-8da7-48d2-90f7-7241fbaab648", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 00:23:51 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-6f22b28e-fa1d-443f-8ad8-58c52eff711f tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Converting VIF {"id": "842f3b7a-8da7-48d2-90f7-7241fbaab648", "address": "fa:16:3e:1f:64:04", "network": {"id": "b31bac4b-1951-4ca3-8682-f1f24de0a5c3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1323234642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71aa69c0ea2d49e184e1e055ff3efa1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap842f3b7a-8d", "ovs_interfaceid": "842f3b7a-8da7-48d2-90f7-7241fbaab648", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:23:51 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-6f22b28e-fa1d-443f-8ad8-58c52eff711f tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1f:64:04,bridge_name='br-int',has_traffic_filtering=True,id=842f3b7a-8da7-48d2-90f7-7241fbaab648,network=Network(b31bac4b-1951-4ca3-8682-f1f24de0a5c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap842f3b7a-8d') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:23:51 user nova-compute[75165]: DEBUG os_vif [None req-6f22b28e-fa1d-443f-8ad8-58c52eff711f tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1f:64:04,bridge_name='br-int',has_traffic_filtering=True,id=842f3b7a-8da7-48d2-90f7-7241fbaab648,network=Network(b31bac4b-1951-4ca3-8682-f1f24de0a5c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap842f3b7a-8d') {{(pid=75165) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 00:23:51 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:23:51 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap842f3b7a-8d, bridge=br-int, if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:23:51 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:23:51 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:23:51 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:23:51 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7f7e277f-03b7-4b6c-b93b-e6e05cb9656a) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:23:51 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:23:51 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:23:51 user nova-compute[75165]: INFO os_vif [None req-6f22b28e-fa1d-443f-8ad8-58c52eff711f tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1f:64:04,bridge_name='br-int',has_traffic_filtering=True,id=842f3b7a-8da7-48d2-90f7-7241fbaab648,network=Network(b31bac4b-1951-4ca3-8682-f1f24de0a5c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap842f3b7a-8d')
Oct 26 00:23:51 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-6f22b28e-fa1d-443f-8ad8-58c52eff711f tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: c4e44bfc-6a68-46ce-8335-aaaba5160d3e] Deleting instance files /opt/stack/data/nova/instances/c4e44bfc-6a68-46ce-8335-aaaba5160d3e_del
Oct 26 00:23:51 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-6f22b28e-fa1d-443f-8ad8-58c52eff711f tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: c4e44bfc-6a68-46ce-8335-aaaba5160d3e] Deletion of /opt/stack/data/nova/instances/c4e44bfc-6a68-46ce-8335-aaaba5160d3e_del complete
Oct 26 00:23:51 user nova-compute[75165]: INFO nova.compute.manager [None req-6f22b28e-fa1d-443f-8ad8-58c52eff711f tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: c4e44bfc-6a68-46ce-8335-aaaba5160d3e] Took 0.98 seconds to destroy the instance on the hypervisor.
Oct 26 00:23:51 user nova-compute[75165]: DEBUG oslo.service.loopingcall [None req-6f22b28e-fa1d-443f-8ad8-58c52eff711f tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75165) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 00:23:51 user nova-compute[75165]: DEBUG nova.compute.manager [-] [instance: c4e44bfc-6a68-46ce-8335-aaaba5160d3e] Deallocating network for instance {{(pid=75165) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 00:23:51 user nova-compute[75165]: DEBUG nova.network.neutron [-] [instance: c4e44bfc-6a68-46ce-8335-aaaba5160d3e] deallocate_for_instance() {{(pid=75165) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 00:23:51 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:23:51 user nova-compute[75165]: DEBUG nova.network.neutron [-] [instance: c4e44bfc-6a68-46ce-8335-aaaba5160d3e] Updating instance_info_cache with network_info: [] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:23:51 user nova-compute[75165]: INFO nova.compute.manager [-] [instance: c4e44bfc-6a68-46ce-8335-aaaba5160d3e] Took 0.53 seconds to deallocate network for instance.
Oct 26 00:23:51 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-6f22b28e-fa1d-443f-8ad8-58c52eff711f tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:23:51 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-6f22b28e-fa1d-443f-8ad8-58c52eff711f tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:23:52 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-6f22b28e-fa1d-443f-8ad8-58c52eff711f tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:23:52 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-6f22b28e-fa1d-443f-8ad8-58c52eff711f tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:23:52 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-6f22b28e-fa1d-443f-8ad8-58c52eff711f tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.382s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:23:52 user nova-compute[75165]: INFO nova.scheduler.client.report [None req-6f22b28e-fa1d-443f-8ad8-58c52eff711f tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Deleted allocations for instance c4e44bfc-6a68-46ce-8335-aaaba5160d3e
Oct 26 00:23:52 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-6f22b28e-fa1d-443f-8ad8-58c52eff711f tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Lock "c4e44bfc-6a68-46ce-8335-aaaba5160d3e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.138s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:23:52 user nova-compute[75165]: DEBUG nova.compute.manager [req-6c7fcabc-6217-4f1b-ad1d-5d2d79d1bbc5 req-1eb7e485-f0c4-4a0b-84e0-8c8b99881865 service nova] [instance: c4e44bfc-6a68-46ce-8335-aaaba5160d3e] Received event network-vif-plugged-842f3b7a-8da7-48d2-90f7-7241fbaab648 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:23:52 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-6c7fcabc-6217-4f1b-ad1d-5d2d79d1bbc5 req-1eb7e485-f0c4-4a0b-84e0-8c8b99881865 service nova] Acquiring lock "c4e44bfc-6a68-46ce-8335-aaaba5160d3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:23:52 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-6c7fcabc-6217-4f1b-ad1d-5d2d79d1bbc5 req-1eb7e485-f0c4-4a0b-84e0-8c8b99881865 service nova] Lock "c4e44bfc-6a68-46ce-8335-aaaba5160d3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:23:52 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-6c7fcabc-6217-4f1b-ad1d-5d2d79d1bbc5 req-1eb7e485-f0c4-4a0b-84e0-8c8b99881865 service nova] Lock "c4e44bfc-6a68-46ce-8335-aaaba5160d3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:23:52 user nova-compute[75165]: DEBUG nova.compute.manager [req-6c7fcabc-6217-4f1b-ad1d-5d2d79d1bbc5 req-1eb7e485-f0c4-4a0b-84e0-8c8b99881865 service nova] [instance: c4e44bfc-6a68-46ce-8335-aaaba5160d3e] No waiting events found dispatching network-vif-plugged-842f3b7a-8da7-48d2-90f7-7241fbaab648 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:23:52 user nova-compute[75165]: WARNING nova.compute.manager [req-6c7fcabc-6217-4f1b-ad1d-5d2d79d1bbc5 req-1eb7e485-f0c4-4a0b-84e0-8c8b99881865 service nova] [instance: c4e44bfc-6a68-46ce-8335-aaaba5160d3e] Received unexpected event network-vif-plugged-842f3b7a-8da7-48d2-90f7-7241fbaab648 for instance with vm_state deleted and task_state None.
Oct 26 00:23:52 user nova-compute[75165]: DEBUG nova.compute.manager [req-6c7fcabc-6217-4f1b-ad1d-5d2d79d1bbc5 req-1eb7e485-f0c4-4a0b-84e0-8c8b99881865 service nova] [instance: c4e44bfc-6a68-46ce-8335-aaaba5160d3e] Received event network-vif-deleted-842f3b7a-8da7-48d2-90f7-7241fbaab648 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:23:56 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:24:01 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:24:03 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:24:06 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:24:06 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:24:06 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75165) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 00:24:07 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:24:08 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:24:09 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:24:11 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:24:12 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:24:13 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:24:14 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:24:14 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:24:14 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:24:14 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:24:14 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:24:14 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75165) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 00:24:15 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75165) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 00:24:15 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb/disk.rescue --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:24:15 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:24:15 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb/disk.rescue --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:24:15 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:24:15 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84c6b624-648b-40e2-a37e-ff08609bad84/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:24:15 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84c6b624-648b-40e2-a37e-ff08609bad84/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:24:15 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84c6b624-648b-40e2-a37e-ff08609bad84/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:24:15 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84c6b624-648b-40e2-a37e-ff08609bad84/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:24:15 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97fb67a7-637d-456f-b4dd-0a271ed6cfc4/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:24:15 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97fb67a7-637d-456f-b4dd-0a271ed6cfc4/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:24:15 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97fb67a7-637d-456f-b4dd-0a271ed6cfc4/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:24:16 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:24:16 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97fb67a7-637d-456f-b4dd-0a271ed6cfc4/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:24:16 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7eeb145-1565-4812-818b-fefda5f2436d/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:24:16 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7eeb145-1565-4812-818b-fefda5f2436d/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:24:16 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7eeb145-1565-4812-818b-fefda5f2436d/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:24:16 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7eeb145-1565-4812-818b-fefda5f2436d/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:24:16 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91c62531-62f9-4f17-914c-11edc5010b54/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:24:16 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91c62531-62f9-4f17-914c-11edc5010b54/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:24:16 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91c62531-62f9-4f17-914c-11edc5010b54/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:24:16 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91c62531-62f9-4f17-914c-11edc5010b54/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:24:16 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75165) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 00:24:17 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:24:17 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:24:17 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Hypervisor/Node resource view: name=user free_ram=8194MB free_disk=24.937183380126953GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75165) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 00:24:17 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:24:17 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:24:17 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 84c6b624-648b-40e2-a37e-ff08609bad84 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:24:17 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance a7eeb145-1565-4812-818b-fefda5f2436d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:24:17 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 97fb67a7-637d-456f-b4dd-0a271ed6cfc4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:24:17 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance bad6c21f-885f-4348-86f7-b237ce2d241b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:24:17 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:24:17 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 91c62531-62f9-4f17-914c-11edc5010b54 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:24:17 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75165) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 00:24:17 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75165) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 00:24:17 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:24:17 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:24:17 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Compute_service record updated for user:user {{(pid=75165) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 00:24:17 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.429s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:24:18 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:24:18 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Starting heal instance info cache {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 00:24:18 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "refresh_cache-a7eeb145-1565-4812-818b-fefda5f2436d" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:24:18 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquired lock "refresh_cache-a7eeb145-1565-4812-818b-fefda5f2436d" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:24:18 user nova-compute[75165]: DEBUG nova.network.neutron [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: a7eeb145-1565-4812-818b-fefda5f2436d] Forcefully refreshing network info cache for instance {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 00:24:19 user nova-compute[75165]: DEBUG nova.network.neutron [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: a7eeb145-1565-4812-818b-fefda5f2436d] Updating instance_info_cache with network_info: [{"id": "7a43d085-a683-4c49-a7c8-13b8f35c943d", "address": "fa:16:3e:e8:63:41", "network": {"id": "bd1c84f9-bba9-4a23-8bf2-17e65022136a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1557945804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2911497df44047d9a9ee36a5652298bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a43d085-a6", "ovs_interfaceid": "7a43d085-a683-4c49-a7c8-13b8f35c943d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:24:19 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Releasing lock "refresh_cache-a7eeb145-1565-4812-818b-fefda5f2436d" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:24:19 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: a7eeb145-1565-4812-818b-fefda5f2436d] Updated the network info_cache for instance {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 00:24:19 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:24:19 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:24:21 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:24:26 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:24:31 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:24:36 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:24:37 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-70c5d083-cdc5-4017-a4e2-de983d39692e tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Acquiring lock "ce058b47-d96f-4341-9104-1fa71ca2c997" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:24:37 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-70c5d083-cdc5-4017-a4e2-de983d39692e tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Lock "ce058b47-d96f-4341-9104-1fa71ca2c997" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:24:37 user nova-compute[75165]: DEBUG nova.compute.manager [None req-70c5d083-cdc5-4017-a4e2-de983d39692e tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] [instance: ce058b47-d96f-4341-9104-1fa71ca2c997] Starting instance... {{(pid=75165) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 00:24:37 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-70c5d083-cdc5-4017-a4e2-de983d39692e tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:24:37 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-70c5d083-cdc5-4017-a4e2-de983d39692e tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:24:37 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-70c5d083-cdc5-4017-a4e2-de983d39692e tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75165) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 00:24:37 user nova-compute[75165]: INFO nova.compute.claims [None req-70c5d083-cdc5-4017-a4e2-de983d39692e tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] [instance: ce058b47-d96f-4341-9104-1fa71ca2c997] Claim successful on node user
Oct 26 00:24:38 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-70c5d083-cdc5-4017-a4e2-de983d39692e tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:24:38 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-70c5d083-cdc5-4017-a4e2-de983d39692e tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:24:38 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-70c5d083-cdc5-4017-a4e2-de983d39692e tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.473s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:24:38 user nova-compute[75165]: DEBUG nova.compute.manager [None req-70c5d083-cdc5-4017-a4e2-de983d39692e tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] [instance: ce058b47-d96f-4341-9104-1fa71ca2c997] Start building networks asynchronously for instance. {{(pid=75165) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 00:24:38 user nova-compute[75165]: DEBUG nova.compute.manager [None req-70c5d083-cdc5-4017-a4e2-de983d39692e tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] [instance: ce058b47-d96f-4341-9104-1fa71ca2c997] Allocating IP information in the background. {{(pid=75165) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 00:24:38 user nova-compute[75165]: DEBUG nova.network.neutron [None req-70c5d083-cdc5-4017-a4e2-de983d39692e tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] [instance: ce058b47-d96f-4341-9104-1fa71ca2c997] allocate_for_instance() {{(pid=75165) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 00:24:38 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-70c5d083-cdc5-4017-a4e2-de983d39692e tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] [instance: ce058b47-d96f-4341-9104-1fa71ca2c997] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 00:24:38 user nova-compute[75165]: DEBUG nova.compute.manager [None req-70c5d083-cdc5-4017-a4e2-de983d39692e tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] [instance: ce058b47-d96f-4341-9104-1fa71ca2c997] Start building block device mappings for instance. {{(pid=75165) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 00:24:38 user nova-compute[75165]: DEBUG nova.policy [None req-70c5d083-cdc5-4017-a4e2-de983d39692e tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '841b5be7c0b348de979920fc9ae223ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ffbf5c944914cafac7aba65fb7ca402', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75165) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 00:24:38 user nova-compute[75165]: DEBUG nova.compute.manager [None req-70c5d083-cdc5-4017-a4e2-de983d39692e tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] [instance: ce058b47-d96f-4341-9104-1fa71ca2c997] Start spawning the instance on the hypervisor. {{(pid=75165) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 00:24:38 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-70c5d083-cdc5-4017-a4e2-de983d39692e tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] [instance: ce058b47-d96f-4341-9104-1fa71ca2c997] Creating instance directory {{(pid=75165) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 00:24:38 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-70c5d083-cdc5-4017-a4e2-de983d39692e tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] [instance: ce058b47-d96f-4341-9104-1fa71ca2c997] Creating image(s)
Oct 26 00:24:38 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-70c5d083-cdc5-4017-a4e2-de983d39692e tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Acquiring lock "/opt/stack/data/nova/instances/ce058b47-d96f-4341-9104-1fa71ca2c997/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:24:38 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-70c5d083-cdc5-4017-a4e2-de983d39692e tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Lock "/opt/stack/data/nova/instances/ce058b47-d96f-4341-9104-1fa71ca2c997/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:24:38 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-70c5d083-cdc5-4017-a4e2-de983d39692e tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Lock "/opt/stack/data/nova/instances/ce058b47-d96f-4341-9104-1fa71ca2c997/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:24:38 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-70c5d083-cdc5-4017-a4e2-de983d39692e tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:24:38 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-70c5d083-cdc5-4017-a4e2-de983d39692e tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json" returned: 0 in 0.198s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:24:38 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-70c5d083-cdc5-4017-a4e2-de983d39692e tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Acquiring lock "7d3243421cf3fdc288b758f687a93103b7b95466" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:24:38 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-70c5d083-cdc5-4017-a4e2-de983d39692e tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Lock "7d3243421cf3fdc288b758f687a93103b7b95466" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:24:38 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-70c5d083-cdc5-4017-a4e2-de983d39692e tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:24:38 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-70c5d083-cdc5-4017-a4e2-de983d39692e tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json" returned: 0 in 0.182s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:24:38 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-70c5d083-cdc5-4017-a4e2-de983d39692e tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466,backing_fmt=raw /opt/stack/data/nova/instances/ce058b47-d96f-4341-9104-1fa71ca2c997/disk 1073741824 {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:24:38 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-70c5d083-cdc5-4017-a4e2-de983d39692e tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466,backing_fmt=raw /opt/stack/data/nova/instances/ce058b47-d96f-4341-9104-1fa71ca2c997/disk 1073741824" returned: 0 in 0.070s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:24:38 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-70c5d083-cdc5-4017-a4e2-de983d39692e tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Lock "7d3243421cf3fdc288b758f687a93103b7b95466" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.261s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:24:38 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-70c5d083-cdc5-4017-a4e2-de983d39692e tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:24:39 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-70c5d083-cdc5-4017-a4e2-de983d39692e tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json" returned: 0 in 0.205s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:24:39 user nova-compute[75165]: DEBUG nova.virt.disk.api [None req-70c5d083-cdc5-4017-a4e2-de983d39692e tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ce058b47-d96f-4341-9104-1fa71ca2c997/disk. size=1073741824 {{(pid=75165) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 00:24:39 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-70c5d083-cdc5-4017-a4e2-de983d39692e tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce058b47-d96f-4341-9104-1fa71ca2c997/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:24:39 user nova-compute[75165]: DEBUG nova.network.neutron [None req-70c5d083-cdc5-4017-a4e2-de983d39692e tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] [instance: ce058b47-d96f-4341-9104-1fa71ca2c997] Successfully created port: 7df0d91d-ff60-4008-823f-f951cbf505d3 {{(pid=75165) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 00:24:39 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-70c5d083-cdc5-4017-a4e2-de983d39692e tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce058b47-d96f-4341-9104-1fa71ca2c997/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:24:39 user nova-compute[75165]: DEBUG nova.virt.disk.api [None req-70c5d083-cdc5-4017-a4e2-de983d39692e tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Cannot resize image /opt/stack/data/nova/instances/ce058b47-d96f-4341-9104-1fa71ca2c997/disk to a smaller size. {{(pid=75165) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 00:24:39 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-70c5d083-cdc5-4017-a4e2-de983d39692e tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] [instance: ce058b47-d96f-4341-9104-1fa71ca2c997] Created local disks {{(pid=75165) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 00:24:39 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-70c5d083-cdc5-4017-a4e2-de983d39692e tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] [instance: ce058b47-d96f-4341-9104-1fa71ca2c997] Ensure instance console log exists: /opt/stack/data/nova/instances/ce058b47-d96f-4341-9104-1fa71ca2c997/console.log {{(pid=75165) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 00:24:39 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-70c5d083-cdc5-4017-a4e2-de983d39692e tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:24:39 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-70c5d083-cdc5-4017-a4e2-de983d39692e tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:24:39 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-70c5d083-cdc5-4017-a4e2-de983d39692e tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:24:39 user nova-compute[75165]: DEBUG nova.network.neutron [None req-70c5d083-cdc5-4017-a4e2-de983d39692e tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] [instance: ce058b47-d96f-4341-9104-1fa71ca2c997] Successfully updated port: 7df0d91d-ff60-4008-823f-f951cbf505d3 {{(pid=75165) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 00:24:39 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-70c5d083-cdc5-4017-a4e2-de983d39692e tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Acquiring lock "refresh_cache-ce058b47-d96f-4341-9104-1fa71ca2c997" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:24:39 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-70c5d083-cdc5-4017-a4e2-de983d39692e tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Acquired lock "refresh_cache-ce058b47-d96f-4341-9104-1fa71ca2c997" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:24:39 user nova-compute[75165]: DEBUG nova.network.neutron [None req-70c5d083-cdc5-4017-a4e2-de983d39692e tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] [instance: ce058b47-d96f-4341-9104-1fa71ca2c997] Building network info cache for instance {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 00:24:39 user nova-compute[75165]: DEBUG nova.compute.manager [req-72f930d3-de8d-42b9-a5d1-f58110180011 req-a20ace0e-a7b3-442b-8b96-6c6dbd34b721 service nova] [instance: ce058b47-d96f-4341-9104-1fa71ca2c997] Received event network-changed-7df0d91d-ff60-4008-823f-f951cbf505d3 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:24:39 user nova-compute[75165]: DEBUG nova.compute.manager [req-72f930d3-de8d-42b9-a5d1-f58110180011 req-a20ace0e-a7b3-442b-8b96-6c6dbd34b721 service nova] [instance: ce058b47-d96f-4341-9104-1fa71ca2c997] Refreshing instance network info cache due to event network-changed-7df0d91d-ff60-4008-823f-f951cbf505d3. {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 00:24:39 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-72f930d3-de8d-42b9-a5d1-f58110180011 req-a20ace0e-a7b3-442b-8b96-6c6dbd34b721 service nova] Acquiring lock "refresh_cache-ce058b47-d96f-4341-9104-1fa71ca2c997" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:24:39 user nova-compute[75165]: DEBUG nova.network.neutron [None req-70c5d083-cdc5-4017-a4e2-de983d39692e tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] [instance: ce058b47-d96f-4341-9104-1fa71ca2c997] Instance cache missing network info. {{(pid=75165) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 00:24:40 user nova-compute[75165]: DEBUG nova.network.neutron [None req-70c5d083-cdc5-4017-a4e2-de983d39692e tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] [instance: ce058b47-d96f-4341-9104-1fa71ca2c997] Updating instance_info_cache with network_info: [{"id": "7df0d91d-ff60-4008-823f-f951cbf505d3", "address": "fa:16:3e:d8:e5:83", "network": {"id": "7e330392-6256-405b-ab37-0b8af0c4fd48", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-430326049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ffbf5c944914cafac7aba65fb7ca402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7df0d91d-ff", "ovs_interfaceid": "7df0d91d-ff60-4008-823f-f951cbf505d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:24:40 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-70c5d083-cdc5-4017-a4e2-de983d39692e tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Releasing lock "refresh_cache-ce058b47-d96f-4341-9104-1fa71ca2c997" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:24:40 user nova-compute[75165]: DEBUG nova.compute.manager [None req-70c5d083-cdc5-4017-a4e2-de983d39692e tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] [instance: ce058b47-d96f-4341-9104-1fa71ca2c997] Instance network_info: |[{"id": "7df0d91d-ff60-4008-823f-f951cbf505d3", "address": "fa:16:3e:d8:e5:83", "network": {"id": "7e330392-6256-405b-ab37-0b8af0c4fd48", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-430326049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ffbf5c944914cafac7aba65fb7ca402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7df0d91d-ff", "ovs_interfaceid": "7df0d91d-ff60-4008-823f-f951cbf505d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75165) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 00:24:40 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-72f930d3-de8d-42b9-a5d1-f58110180011 req-a20ace0e-a7b3-442b-8b96-6c6dbd34b721 service nova] Acquired lock "refresh_cache-ce058b47-d96f-4341-9104-1fa71ca2c997" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:24:40 user nova-compute[75165]: DEBUG nova.network.neutron [req-72f930d3-de8d-42b9-a5d1-f58110180011 req-a20ace0e-a7b3-442b-8b96-6c6dbd34b721 service nova] [instance: ce058b47-d96f-4341-9104-1fa71ca2c997] Refreshing network info cache for port 7df0d91d-ff60-4008-823f-f951cbf505d3 {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 00:24:40 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-70c5d083-cdc5-4017-a4e2-de983d39692e tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] [instance: ce058b47-d96f-4341-9104-1fa71ca2c997] Start _get_guest_xml network_info=[{"id": "7df0d91d-ff60-4008-823f-f951cbf505d3", "address": "fa:16:3e:d8:e5:83", "network": {"id": "7e330392-6256-405b-ab37-0b8af0c4fd48", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-430326049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ffbf5c944914cafac7aba65fb7ca402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7df0d91d-ff", "ovs_interfaceid": "7df0d91d-ff60-4008-823f-f951cbf505d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T00:03:24Z,direct_url=<?>,disk_format='qcow2',id=bff0d8a1-739e-4c4d-9efa-b73ba7b76d01,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e56bbf444fd34c348475c73673611447',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T00:03:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'size': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': 'bff0d8a1-739e-4c4d-9efa-b73ba7b76d01'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75165) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 00:24:40 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-70c5d083-cdc5-4017-a4e2-de983d39692e tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:24:40 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-70c5d083-cdc5-4017-a4e2-de983d39692e tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:24:40 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-70c5d083-cdc5-4017-a4e2-de983d39692e tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75165) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 00:24:40 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-70c5d083-cdc5-4017-a4e2-de983d39692e tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] CPU controller missing on host. {{(pid=75165) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 00:24:40 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-70c5d083-cdc5-4017-a4e2-de983d39692e tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75165) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 00:24:40 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-70c5d083-cdc5-4017-a4e2-de983d39692e tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] CPU controller found on host. {{(pid=75165) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 00:24:40 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-70c5d083-cdc5-4017-a4e2-de983d39692e tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75165) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 00:24:40 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-70c5d083-cdc5-4017-a4e2-de983d39692e tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T00:03:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T00:03:24Z,direct_url=<?>,disk_format='qcow2',id=bff0d8a1-739e-4c4d-9efa-b73ba7b76d01,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e56bbf444fd34c348475c73673611447',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T00:03:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 00:24:40 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-70c5d083-cdc5-4017-a4e2-de983d39692e tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Flavor limits 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 00:24:40 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-70c5d083-cdc5-4017-a4e2-de983d39692e tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Image limits 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 00:24:40 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-70c5d083-cdc5-4017-a4e2-de983d39692e tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Flavor pref 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 00:24:40 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-70c5d083-cdc5-4017-a4e2-de983d39692e tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Image pref 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 00:24:40 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-70c5d083-cdc5-4017-a4e2-de983d39692e tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 00:24:40 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-70c5d083-cdc5-4017-a4e2-de983d39692e tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 00:24:40 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-70c5d083-cdc5-4017-a4e2-de983d39692e tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75165) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 00:24:40 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-70c5d083-cdc5-4017-a4e2-de983d39692e tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Got 1 possible topologies {{(pid=75165) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 00:24:40 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-70c5d083-cdc5-4017-a4e2-de983d39692e tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 00:24:40 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-70c5d083-cdc5-4017-a4e2-de983d39692e tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 00:24:40 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-70c5d083-cdc5-4017-a4e2-de983d39692e tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:24:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1201622567',display_name='tempest-AttachVolumeTestJSON-server-1201622567',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1201622567',id=30,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAgcu5NKLgh2Gjw5hbaantiq3qG2SfzXf5AH2iL3fw+cZH/dlInnjj6/hN9asQd2ftgiOjxxB738NDKWw4BXmyFvNpbWuS7IGz0HZGpDTjUakksAvl+2z70TPMfzboBY2g==',key_name='tempest-keypair-1848999993',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3ffbf5c944914cafac7aba65fb7ca402',ramdisk_id='',reservation_id='r-l0ckr0qj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-2130746724',owner_user_name='tempest-AttachVolumeTestJSON-2130746724-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T00:24:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='841b5be7c0b348de979920fc9ae223ed',uuid=ce058b47-d96f-4341-9104-1fa71ca2c997,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7df0d91d-ff60-4008-823f-f951cbf505d3", "address": "fa:16:3e:d8:e5:83", "network": {"id": "7e330392-6256-405b-ab37-0b8af0c4fd48", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-430326049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ffbf5c944914cafac7aba65fb7ca402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7df0d91d-ff", "ovs_interfaceid": "7df0d91d-ff60-4008-823f-f951cbf505d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75165) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 00:24:40 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-70c5d083-cdc5-4017-a4e2-de983d39692e tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Converting VIF {"id": "7df0d91d-ff60-4008-823f-f951cbf505d3", "address": "fa:16:3e:d8:e5:83", "network": {"id": "7e330392-6256-405b-ab37-0b8af0c4fd48", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-430326049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ffbf5c944914cafac7aba65fb7ca402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7df0d91d-ff", "ovs_interfaceid": "7df0d91d-ff60-4008-823f-f951cbf505d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:24:40 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-70c5d083-cdc5-4017-a4e2-de983d39692e tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:e5:83,bridge_name='br-int',has_traffic_filtering=True,id=7df0d91d-ff60-4008-823f-f951cbf505d3,network=Network(7e330392-6256-405b-ab37-0b8af0c4fd48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7df0d91d-ff') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:24:40 user nova-compute[75165]: DEBUG nova.objects.instance [None req-70c5d083-cdc5-4017-a4e2-de983d39692e tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Lazy-loading 'pci_devices' on Instance uuid ce058b47-d96f-4341-9104-1fa71ca2c997 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:24:40 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-70c5d083-cdc5-4017-a4e2-de983d39692e tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] [instance: ce058b47-d96f-4341-9104-1fa71ca2c997] End _get_guest_xml xml=<domain type="kvm">
Oct 26 00:24:40 user nova-compute[75165]:   <uuid>ce058b47-d96f-4341-9104-1fa71ca2c997</uuid>
Oct 26 00:24:40 user nova-compute[75165]:   <name>instance-0000001e</name>
Oct 26 00:24:40 user nova-compute[75165]:   <memory>524288</memory>
Oct 26 00:24:40 user nova-compute[75165]:   <vcpu>1</vcpu>
Oct 26 00:24:40 user nova-compute[75165]:   <metadata>
Oct 26 00:24:40 user nova-compute[75165]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 00:24:40 user nova-compute[75165]:       <nova:package version="0.0.0"/>
Oct 26 00:24:40 user nova-compute[75165]:       <nova:name>tempest-AttachVolumeTestJSON-server-1201622567</nova:name>
Oct 26 00:24:40 user nova-compute[75165]:       <nova:creationTime>2023-10-26 00:24:40</nova:creationTime>
Oct 26 00:24:40 user nova-compute[75165]:       <nova:flavor name="m1.tiny">
Oct 26 00:24:40 user nova-compute[75165]:         <nova:memory>512</nova:memory>
Oct 26 00:24:40 user nova-compute[75165]:         <nova:disk>1</nova:disk>
Oct 26 00:24:40 user nova-compute[75165]:         <nova:swap>0</nova:swap>
Oct 26 00:24:40 user nova-compute[75165]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 00:24:40 user nova-compute[75165]:         <nova:vcpus>1</nova:vcpus>
Oct 26 00:24:40 user nova-compute[75165]:       </nova:flavor>
Oct 26 00:24:40 user nova-compute[75165]:       <nova:owner>
Oct 26 00:24:40 user nova-compute[75165]:         <nova:user uuid="841b5be7c0b348de979920fc9ae223ed">tempest-AttachVolumeTestJSON-2130746724-project-member</nova:user>
Oct 26 00:24:40 user nova-compute[75165]:         <nova:project uuid="3ffbf5c944914cafac7aba65fb7ca402">tempest-AttachVolumeTestJSON-2130746724</nova:project>
Oct 26 00:24:40 user nova-compute[75165]:       </nova:owner>
Oct 26 00:24:40 user nova-compute[75165]:       <nova:root type="image" uuid="bff0d8a1-739e-4c4d-9efa-b73ba7b76d01"/>
Oct 26 00:24:40 user nova-compute[75165]:       <nova:ports>
Oct 26 00:24:40 user nova-compute[75165]:         <nova:port uuid="7df0d91d-ff60-4008-823f-f951cbf505d3">
Oct 26 00:24:40 user nova-compute[75165]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 26 00:24:40 user nova-compute[75165]:         </nova:port>
Oct 26 00:24:40 user nova-compute[75165]:       </nova:ports>
Oct 26 00:24:40 user nova-compute[75165]:     </nova:instance>
Oct 26 00:24:40 user nova-compute[75165]:   </metadata>
Oct 26 00:24:40 user nova-compute[75165]:   <sysinfo type="smbios">
Oct 26 00:24:40 user nova-compute[75165]:     <system>
Oct 26 00:24:40 user nova-compute[75165]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 00:24:40 user nova-compute[75165]:       <entry name="product">OpenStack Nova</entry>
Oct 26 00:24:40 user nova-compute[75165]:       <entry name="version">0.0.0</entry>
Oct 26 00:24:40 user nova-compute[75165]:       <entry name="serial">ce058b47-d96f-4341-9104-1fa71ca2c997</entry>
Oct 26 00:24:40 user nova-compute[75165]:       <entry name="uuid">ce058b47-d96f-4341-9104-1fa71ca2c997</entry>
Oct 26 00:24:40 user nova-compute[75165]:       <entry name="family">Virtual Machine</entry>
Oct 26 00:24:40 user nova-compute[75165]:     </system>
Oct 26 00:24:40 user nova-compute[75165]:   </sysinfo>
Oct 26 00:24:40 user nova-compute[75165]:   <os>
Oct 26 00:24:40 user nova-compute[75165]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 00:24:40 user nova-compute[75165]:     <boot dev="hd"/>
Oct 26 00:24:40 user nova-compute[75165]:     <smbios mode="sysinfo"/>
Oct 26 00:24:40 user nova-compute[75165]:   </os>
Oct 26 00:24:40 user nova-compute[75165]:   <features>
Oct 26 00:24:40 user nova-compute[75165]:     <acpi/>
Oct 26 00:24:40 user nova-compute[75165]:     <apic/>
Oct 26 00:24:40 user nova-compute[75165]:     <vmcoreinfo/>
Oct 26 00:24:40 user nova-compute[75165]:   </features>
Oct 26 00:24:40 user nova-compute[75165]:   <clock offset="utc">
Oct 26 00:24:40 user nova-compute[75165]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 00:24:40 user nova-compute[75165]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 00:24:40 user nova-compute[75165]:     <timer name="hpet" present="no"/>
Oct 26 00:24:40 user nova-compute[75165]:   </clock>
Oct 26 00:24:40 user nova-compute[75165]:   <cpu mode="custom" match="exact">
Oct 26 00:24:40 user nova-compute[75165]:     <model>Nehalem</model>
Oct 26 00:24:40 user nova-compute[75165]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 00:24:40 user nova-compute[75165]:   </cpu>
Oct 26 00:24:40 user nova-compute[75165]:   <devices>
Oct 26 00:24:40 user nova-compute[75165]:     <disk type="file" device="disk">
Oct 26 00:24:40 user nova-compute[75165]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 00:24:40 user nova-compute[75165]:       <source file="/opt/stack/data/nova/instances/ce058b47-d96f-4341-9104-1fa71ca2c997/disk"/>
Oct 26 00:24:40 user nova-compute[75165]:       <target dev="vda" bus="virtio"/>
Oct 26 00:24:40 user nova-compute[75165]:     </disk>
Oct 26 00:24:40 user nova-compute[75165]:     <interface type="ethernet">
Oct 26 00:24:40 user nova-compute[75165]:       <mac address="fa:16:3e:d8:e5:83"/>
Oct 26 00:24:40 user nova-compute[75165]:       <model type="virtio"/>
Oct 26 00:24:40 user nova-compute[75165]:       <mtu size="1442"/>
Oct 26 00:24:40 user nova-compute[75165]:       <target dev="tap7df0d91d-ff"/>
Oct 26 00:24:40 user nova-compute[75165]:     </interface>
Oct 26 00:24:40 user nova-compute[75165]:     <serial type="pty">
Oct 26 00:24:40 user nova-compute[75165]:       <log file="/opt/stack/data/nova/instances/ce058b47-d96f-4341-9104-1fa71ca2c997/console.log" append="off"/>
Oct 26 00:24:40 user nova-compute[75165]:     </serial>
Oct 26 00:24:40 user nova-compute[75165]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 00:24:40 user nova-compute[75165]:     <video>
Oct 26 00:24:40 user nova-compute[75165]:       <model type="virtio"/>
Oct 26 00:24:40 user nova-compute[75165]:     </video>
Oct 26 00:24:40 user nova-compute[75165]:     <rng model="virtio">
Oct 26 00:24:40 user nova-compute[75165]:       <backend model="random">/dev/urandom</backend>
Oct 26 00:24:40 user nova-compute[75165]:     </rng>
Oct 26 00:24:40 user nova-compute[75165]:     <controller type="usb" index="0" model="none"/>
Oct 26 00:24:40 user nova-compute[75165]:     <memballoon model="virtio">
Oct 26 00:24:40 user nova-compute[75165]:       <stats period="10"/>
Oct 26 00:24:40 user nova-compute[75165]:     </memballoon>
Oct 26 00:24:40 user nova-compute[75165]:   </devices>
Oct 26 00:24:40 user nova-compute[75165]: </domain>
Oct 26 00:24:40 user nova-compute[75165]:  {{(pid=75165) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 00:24:40 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-70c5d083-cdc5-4017-a4e2-de983d39692e tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:24:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1201622567',display_name='tempest-AttachVolumeTestJSON-server-1201622567',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1201622567',id=30,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAgcu5NKLgh2Gjw5hbaantiq3qG2SfzXf5AH2iL3fw+cZH/dlInnjj6/hN9asQd2ftgiOjxxB738NDKWw4BXmyFvNpbWuS7IGz0HZGpDTjUakksAvl+2z70TPMfzboBY2g==',key_name='tempest-keypair-1848999993',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3ffbf5c944914cafac7aba65fb7ca402',ramdisk_id='',reservation_id='r-l0ckr0qj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-2130746724',owner_user_name='tempest-AttachVolumeTestJSON-2130746724-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T00:24:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='841b5be7c0b348de979920fc9ae223ed',uuid=ce058b47-d96f-4341-9104-1fa71ca2c997,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7df0d91d-ff60-4008-823f-f951cbf505d3", "address": "fa:16:3e:d8:e5:83", "network": {"id": "7e330392-6256-405b-ab37-0b8af0c4fd48", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-430326049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ffbf5c944914cafac7aba65fb7ca402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7df0d91d-ff", "ovs_interfaceid": "7df0d91d-ff60-4008-823f-f951cbf505d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 00:24:40 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-70c5d083-cdc5-4017-a4e2-de983d39692e tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Converting VIF {"id": "7df0d91d-ff60-4008-823f-f951cbf505d3", "address": "fa:16:3e:d8:e5:83", "network": {"id": "7e330392-6256-405b-ab37-0b8af0c4fd48", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-430326049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ffbf5c944914cafac7aba65fb7ca402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7df0d91d-ff", "ovs_interfaceid": "7df0d91d-ff60-4008-823f-f951cbf505d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:24:40 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-70c5d083-cdc5-4017-a4e2-de983d39692e tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:e5:83,bridge_name='br-int',has_traffic_filtering=True,id=7df0d91d-ff60-4008-823f-f951cbf505d3,network=Network(7e330392-6256-405b-ab37-0b8af0c4fd48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7df0d91d-ff') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:24:40 user nova-compute[75165]: DEBUG os_vif [None req-70c5d083-cdc5-4017-a4e2-de983d39692e tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:e5:83,bridge_name='br-int',has_traffic_filtering=True,id=7df0d91d-ff60-4008-823f-f951cbf505d3,network=Network(7e330392-6256-405b-ab37-0b8af0c4fd48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7df0d91d-ff') {{(pid=75165) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 00:24:40 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:24:40 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:24:40 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 00:24:40 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:24:40 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '07a9892d-0240-5d76-9085-3451c3c4cd63', '_type': 'linux-noop'}}, row=False) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:24:40 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:24:40 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:24:40 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:24:40 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7df0d91d-ff, may_exist=True, interface_attrs={}) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:24:40 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7df0d91d-ff, col_values=(('qos', UUID('28933e7a-1ab5-447d-8af2-f666a164dac2')),), if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:24:40 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7df0d91d-ff, col_values=(('external_ids', {'iface-id': '7df0d91d-ff60-4008-823f-f951cbf505d3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d8:e5:83', 'vm-uuid': 'ce058b47-d96f-4341-9104-1fa71ca2c997'}),), if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:24:40 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:24:40 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:24:40 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:24:40 user nova-compute[75165]: INFO os_vif [None req-70c5d083-cdc5-4017-a4e2-de983d39692e tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:e5:83,bridge_name='br-int',has_traffic_filtering=True,id=7df0d91d-ff60-4008-823f-f951cbf505d3,network=Network(7e330392-6256-405b-ab37-0b8af0c4fd48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7df0d91d-ff')
Oct 26 00:24:40 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-70c5d083-cdc5-4017-a4e2-de983d39692e tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] No BDM found with device name vda, not building metadata. {{(pid=75165) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 00:24:40 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-70c5d083-cdc5-4017-a4e2-de983d39692e tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] No VIF found with MAC fa:16:3e:d8:e5:83, not building metadata {{(pid=75165) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 00:24:40 user nova-compute[75165]: DEBUG nova.network.neutron [req-72f930d3-de8d-42b9-a5d1-f58110180011 req-a20ace0e-a7b3-442b-8b96-6c6dbd34b721 service nova] [instance: ce058b47-d96f-4341-9104-1fa71ca2c997] Updated VIF entry in instance network info cache for port 7df0d91d-ff60-4008-823f-f951cbf505d3. {{(pid=75165) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 00:24:40 user nova-compute[75165]: DEBUG nova.network.neutron [req-72f930d3-de8d-42b9-a5d1-f58110180011 req-a20ace0e-a7b3-442b-8b96-6c6dbd34b721 service nova] [instance: ce058b47-d96f-4341-9104-1fa71ca2c997] Updating instance_info_cache with network_info: [{"id": "7df0d91d-ff60-4008-823f-f951cbf505d3", "address": "fa:16:3e:d8:e5:83", "network": {"id": "7e330392-6256-405b-ab37-0b8af0c4fd48", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-430326049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ffbf5c944914cafac7aba65fb7ca402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7df0d91d-ff", "ovs_interfaceid": "7df0d91d-ff60-4008-823f-f951cbf505d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:24:40 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-72f930d3-de8d-42b9-a5d1-f58110180011 req-a20ace0e-a7b3-442b-8b96-6c6dbd34b721 service nova] Releasing lock "refresh_cache-ce058b47-d96f-4341-9104-1fa71ca2c997" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:24:40 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-e3b0a1ca-2fa8-4c97-85f3-a7f1caf8f204 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Acquiring lock "84c6b624-648b-40e2-a37e-ff08609bad84" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:24:40 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-e3b0a1ca-2fa8-4c97-85f3-a7f1caf8f204 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Lock "84c6b624-648b-40e2-a37e-ff08609bad84" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:24:40 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-e3b0a1ca-2fa8-4c97-85f3-a7f1caf8f204 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Acquiring lock "84c6b624-648b-40e2-a37e-ff08609bad84-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:24:40 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-e3b0a1ca-2fa8-4c97-85f3-a7f1caf8f204 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Lock "84c6b624-648b-40e2-a37e-ff08609bad84-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:24:40 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-e3b0a1ca-2fa8-4c97-85f3-a7f1caf8f204 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Lock "84c6b624-648b-40e2-a37e-ff08609bad84-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:24:40 user nova-compute[75165]: INFO nova.compute.manager [None req-e3b0a1ca-2fa8-4c97-85f3-a7f1caf8f204 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: 84c6b624-648b-40e2-a37e-ff08609bad84] Terminating instance
Oct 26 00:24:40 user nova-compute[75165]: DEBUG nova.compute.manager [None req-e3b0a1ca-2fa8-4c97-85f3-a7f1caf8f204 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: 84c6b624-648b-40e2-a37e-ff08609bad84] Start destroying the instance on the hypervisor. {{(pid=75165) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 00:24:41 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:24:41 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:24:41 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:24:41 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:24:41 user nova-compute[75165]: DEBUG nova.compute.manager [req-25dead21-bc74-4486-aba6-d1a145d9b4f3 req-49115427-b308-4262-b1d0-f9e0d040cd93 service nova] [instance: 84c6b624-648b-40e2-a37e-ff08609bad84] Received event network-vif-unplugged-2107529c-ec0e-4d1d-85b4-8605dcabc415 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:24:41 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-25dead21-bc74-4486-aba6-d1a145d9b4f3 req-49115427-b308-4262-b1d0-f9e0d040cd93 service nova] Acquiring lock "84c6b624-648b-40e2-a37e-ff08609bad84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:24:41 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-25dead21-bc74-4486-aba6-d1a145d9b4f3 req-49115427-b308-4262-b1d0-f9e0d040cd93 service nova] Lock "84c6b624-648b-40e2-a37e-ff08609bad84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:24:41 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-25dead21-bc74-4486-aba6-d1a145d9b4f3 req-49115427-b308-4262-b1d0-f9e0d040cd93 service nova] Lock "84c6b624-648b-40e2-a37e-ff08609bad84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:24:41 user nova-compute[75165]: DEBUG nova.compute.manager [req-25dead21-bc74-4486-aba6-d1a145d9b4f3 req-49115427-b308-4262-b1d0-f9e0d040cd93 service nova] [instance: 84c6b624-648b-40e2-a37e-ff08609bad84] No waiting events found dispatching network-vif-unplugged-2107529c-ec0e-4d1d-85b4-8605dcabc415 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:24:41 user nova-compute[75165]: DEBUG nova.compute.manager [req-25dead21-bc74-4486-aba6-d1a145d9b4f3 req-49115427-b308-4262-b1d0-f9e0d040cd93 service nova] [instance: 84c6b624-648b-40e2-a37e-ff08609bad84] Received event network-vif-unplugged-2107529c-ec0e-4d1d-85b4-8605dcabc415 for instance with task_state deleting. {{(pid=75165) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 00:24:42 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: 84c6b624-648b-40e2-a37e-ff08609bad84] Instance destroyed successfully.
Oct 26 00:24:42 user nova-compute[75165]: DEBUG nova.objects.instance [None req-e3b0a1ca-2fa8-4c97-85f3-a7f1caf8f204 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Lazy-loading 'resources' on Instance uuid 84c6b624-648b-40e2-a37e-ff08609bad84 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:24:42 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:24:42 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-e3b0a1ca-2fa8-4c97-85f3-a7f1caf8f204 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:07:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1528860087',display_name='tempest-ServerRescueNegativeTestJSON-server-1528860087',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1528860087',id=2,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-26T00:12:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='71aa69c0ea2d49e184e1e055ff3efa1d',ramdisk_id='',reservation_id='r-oa51f9pk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-2141505807',owner_user_name='tempest-ServerRescueNegativeTestJSON-2141505807-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T00:13:54Z,user_data=None,user_id='67876ca3211b47bc99af08436edeb91f',uuid=84c6b624-648b-40e2-a37e-ff08609bad84,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2107529c-ec0e-4d1d-85b4-8605dcabc415", "address": "fa:16:3e:0c:8a:94", "network": {"id": "b31bac4b-1951-4ca3-8682-f1f24de0a5c3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1323234642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71aa69c0ea2d49e184e1e055ff3efa1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2107529c-ec", "ovs_interfaceid": "2107529c-ec0e-4d1d-85b4-8605dcabc415", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 00:24:42 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-e3b0a1ca-2fa8-4c97-85f3-a7f1caf8f204 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Converting VIF {"id": "2107529c-ec0e-4d1d-85b4-8605dcabc415", "address": "fa:16:3e:0c:8a:94", "network": {"id": "b31bac4b-1951-4ca3-8682-f1f24de0a5c3", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1323234642-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71aa69c0ea2d49e184e1e055ff3efa1d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2107529c-ec", "ovs_interfaceid": "2107529c-ec0e-4d1d-85b4-8605dcabc415", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:24:42 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-e3b0a1ca-2fa8-4c97-85f3-a7f1caf8f204 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0c:8a:94,bridge_name='br-int',has_traffic_filtering=True,id=2107529c-ec0e-4d1d-85b4-8605dcabc415,network=Network(b31bac4b-1951-4ca3-8682-f1f24de0a5c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2107529c-ec') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:24:42 user nova-compute[75165]: DEBUG os_vif [None req-e3b0a1ca-2fa8-4c97-85f3-a7f1caf8f204 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0c:8a:94,bridge_name='br-int',has_traffic_filtering=True,id=2107529c-ec0e-4d1d-85b4-8605dcabc415,network=Network(b31bac4b-1951-4ca3-8682-f1f24de0a5c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2107529c-ec') {{(pid=75165) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 00:24:42 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:24:42 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2107529c-ec, bridge=br-int, if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:24:42 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:24:42 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:24:42 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:24:42 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:24:42 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:24:42 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:24:42 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=645ce881-2294-4095-92b4-7d6ce9fcb535) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:24:42 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:24:42 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:24:42 user nova-compute[75165]: INFO os_vif [None req-e3b0a1ca-2fa8-4c97-85f3-a7f1caf8f204 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0c:8a:94,bridge_name='br-int',has_traffic_filtering=True,id=2107529c-ec0e-4d1d-85b4-8605dcabc415,network=Network(b31bac4b-1951-4ca3-8682-f1f24de0a5c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2107529c-ec')
Oct 26 00:24:42 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-e3b0a1ca-2fa8-4c97-85f3-a7f1caf8f204 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: 84c6b624-648b-40e2-a37e-ff08609bad84] Deleting instance files /opt/stack/data/nova/instances/84c6b624-648b-40e2-a37e-ff08609bad84_del
Oct 26 00:24:42 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-e3b0a1ca-2fa8-4c97-85f3-a7f1caf8f204 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: 84c6b624-648b-40e2-a37e-ff08609bad84] Deletion of /opt/stack/data/nova/instances/84c6b624-648b-40e2-a37e-ff08609bad84_del complete
Oct 26 00:24:42 user nova-compute[75165]: INFO nova.compute.manager [None req-e3b0a1ca-2fa8-4c97-85f3-a7f1caf8f204 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] [instance: 84c6b624-648b-40e2-a37e-ff08609bad84] Took 1.48 seconds to destroy the instance on the hypervisor.
Oct 26 00:24:42 user nova-compute[75165]: DEBUG oslo.service.loopingcall [None req-e3b0a1ca-2fa8-4c97-85f3-a7f1caf8f204 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75165) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 00:24:42 user nova-compute[75165]: DEBUG nova.compute.manager [-] [instance: 84c6b624-648b-40e2-a37e-ff08609bad84] Deallocating network for instance {{(pid=75165) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 00:24:42 user nova-compute[75165]: DEBUG nova.network.neutron [-] [instance: 84c6b624-648b-40e2-a37e-ff08609bad84] deallocate_for_instance() {{(pid=75165) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 00:24:42 user nova-compute[75165]: DEBUG nova.compute.manager [req-326c3f88-c1cb-4e3a-a741-230b7a596905 req-1730717a-36d0-458b-80f1-4572957e207f service nova] [instance: ce058b47-d96f-4341-9104-1fa71ca2c997] Received event network-vif-plugged-7df0d91d-ff60-4008-823f-f951cbf505d3 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:24:42 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-326c3f88-c1cb-4e3a-a741-230b7a596905 req-1730717a-36d0-458b-80f1-4572957e207f service nova] Acquiring lock "ce058b47-d96f-4341-9104-1fa71ca2c997-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:24:42 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-326c3f88-c1cb-4e3a-a741-230b7a596905 req-1730717a-36d0-458b-80f1-4572957e207f service nova] Lock "ce058b47-d96f-4341-9104-1fa71ca2c997-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:24:42 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-326c3f88-c1cb-4e3a-a741-230b7a596905 req-1730717a-36d0-458b-80f1-4572957e207f service nova] Lock "ce058b47-d96f-4341-9104-1fa71ca2c997-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:24:42 user nova-compute[75165]: DEBUG nova.compute.manager [req-326c3f88-c1cb-4e3a-a741-230b7a596905 req-1730717a-36d0-458b-80f1-4572957e207f service nova] [instance: ce058b47-d96f-4341-9104-1fa71ca2c997] No waiting events found dispatching network-vif-plugged-7df0d91d-ff60-4008-823f-f951cbf505d3 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:24:42 user nova-compute[75165]: WARNING nova.compute.manager [req-326c3f88-c1cb-4e3a-a741-230b7a596905 req-1730717a-36d0-458b-80f1-4572957e207f service nova] [instance: ce058b47-d96f-4341-9104-1fa71ca2c997] Received unexpected event network-vif-plugged-7df0d91d-ff60-4008-823f-f951cbf505d3 for instance with vm_state building and task_state spawning.
Oct 26 00:24:42 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:24:42 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:24:43 user nova-compute[75165]: DEBUG nova.network.neutron [-] [instance: 84c6b624-648b-40e2-a37e-ff08609bad84] Updating instance_info_cache with network_info: [] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:24:43 user nova-compute[75165]: INFO nova.compute.manager [-] [instance: 84c6b624-648b-40e2-a37e-ff08609bad84] Took 0.79 seconds to deallocate network for instance.
Oct 26 00:24:43 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-e3b0a1ca-2fa8-4c97-85f3-a7f1caf8f204 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:24:43 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-e3b0a1ca-2fa8-4c97-85f3-a7f1caf8f204 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:24:43 user nova-compute[75165]: DEBUG nova.compute.manager [req-58685382-a952-4212-ad17-84dba9f785bc req-ae4baf7e-8f37-4cd3-a4f9-f367969f2d04 service nova] [instance: 84c6b624-648b-40e2-a37e-ff08609bad84] Received event network-vif-plugged-2107529c-ec0e-4d1d-85b4-8605dcabc415 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:24:43 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-58685382-a952-4212-ad17-84dba9f785bc req-ae4baf7e-8f37-4cd3-a4f9-f367969f2d04 service nova] Acquiring lock "84c6b624-648b-40e2-a37e-ff08609bad84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:24:43 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-58685382-a952-4212-ad17-84dba9f785bc req-ae4baf7e-8f37-4cd3-a4f9-f367969f2d04 service nova] Lock "84c6b624-648b-40e2-a37e-ff08609bad84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:24:43 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-58685382-a952-4212-ad17-84dba9f785bc req-ae4baf7e-8f37-4cd3-a4f9-f367969f2d04 service nova] Lock "84c6b624-648b-40e2-a37e-ff08609bad84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:24:43 user nova-compute[75165]: DEBUG nova.compute.manager [req-58685382-a952-4212-ad17-84dba9f785bc req-ae4baf7e-8f37-4cd3-a4f9-f367969f2d04 service nova] [instance: 84c6b624-648b-40e2-a37e-ff08609bad84] No waiting events found dispatching network-vif-plugged-2107529c-ec0e-4d1d-85b4-8605dcabc415 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:24:43 user nova-compute[75165]: WARNING nova.compute.manager [req-58685382-a952-4212-ad17-84dba9f785bc req-ae4baf7e-8f37-4cd3-a4f9-f367969f2d04 service nova] [instance: 84c6b624-648b-40e2-a37e-ff08609bad84] Received unexpected event network-vif-plugged-2107529c-ec0e-4d1d-85b4-8605dcabc415 for instance with vm_state deleted and task_state None.
Oct 26 00:24:43 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-e3b0a1ca-2fa8-4c97-85f3-a7f1caf8f204 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:24:43 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-e3b0a1ca-2fa8-4c97-85f3-a7f1caf8f204 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:24:43 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-e3b0a1ca-2fa8-4c97-85f3-a7f1caf8f204 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.283s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:24:43 user nova-compute[75165]: INFO nova.scheduler.client.report [None req-e3b0a1ca-2fa8-4c97-85f3-a7f1caf8f204 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Deleted allocations for instance 84c6b624-648b-40e2-a37e-ff08609bad84
Oct 26 00:24:43 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-e3b0a1ca-2fa8-4c97-85f3-a7f1caf8f204 tempest-ServerRescueNegativeTestJSON-2141505807 tempest-ServerRescueNegativeTestJSON-2141505807-project-member] Lock "84c6b624-648b-40e2-a37e-ff08609bad84" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.796s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:24:44 user nova-compute[75165]: DEBUG nova.compute.manager [req-ff53fbdc-09ed-4b59-b042-b52f175a9d3f req-c22bfee6-e29f-4542-8a03-72554802a0dc service nova] [instance: ce058b47-d96f-4341-9104-1fa71ca2c997] Received event network-vif-plugged-7df0d91d-ff60-4008-823f-f951cbf505d3 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:24:44 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-ff53fbdc-09ed-4b59-b042-b52f175a9d3f req-c22bfee6-e29f-4542-8a03-72554802a0dc service nova] Acquiring lock "ce058b47-d96f-4341-9104-1fa71ca2c997-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:24:44 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-ff53fbdc-09ed-4b59-b042-b52f175a9d3f req-c22bfee6-e29f-4542-8a03-72554802a0dc service nova] Lock "ce058b47-d96f-4341-9104-1fa71ca2c997-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:24:44 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-ff53fbdc-09ed-4b59-b042-b52f175a9d3f req-c22bfee6-e29f-4542-8a03-72554802a0dc service nova] Lock "ce058b47-d96f-4341-9104-1fa71ca2c997-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:24:44 user nova-compute[75165]: DEBUG nova.compute.manager [req-ff53fbdc-09ed-4b59-b042-b52f175a9d3f req-c22bfee6-e29f-4542-8a03-72554802a0dc service nova] [instance: ce058b47-d96f-4341-9104-1fa71ca2c997] No waiting events found dispatching network-vif-plugged-7df0d91d-ff60-4008-823f-f951cbf505d3 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:24:44 user nova-compute[75165]: WARNING nova.compute.manager [req-ff53fbdc-09ed-4b59-b042-b52f175a9d3f req-c22bfee6-e29f-4542-8a03-72554802a0dc service nova] [instance: ce058b47-d96f-4341-9104-1fa71ca2c997] Received unexpected event network-vif-plugged-7df0d91d-ff60-4008-823f-f951cbf505d3 for instance with vm_state building and task_state spawning.
Oct 26 00:24:44 user nova-compute[75165]: DEBUG nova.compute.manager [req-ff53fbdc-09ed-4b59-b042-b52f175a9d3f req-c22bfee6-e29f-4542-8a03-72554802a0dc service nova] [instance: 84c6b624-648b-40e2-a37e-ff08609bad84] Received event network-vif-deleted-2107529c-ec0e-4d1d-85b4-8605dcabc415 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:24:44 user nova-compute[75165]: DEBUG nova.compute.manager [None req-70c5d083-cdc5-4017-a4e2-de983d39692e tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] [instance: ce058b47-d96f-4341-9104-1fa71ca2c997] Instance event wait completed in 0 seconds for  {{(pid=75165) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 00:24:44 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-70c5d083-cdc5-4017-a4e2-de983d39692e tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] [instance: ce058b47-d96f-4341-9104-1fa71ca2c997] Guest created on hypervisor {{(pid=75165) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 00:24:44 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: ce058b47-d96f-4341-9104-1fa71ca2c997] Instance spawned successfully.
Oct 26 00:24:44 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-70c5d083-cdc5-4017-a4e2-de983d39692e tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] [instance: ce058b47-d96f-4341-9104-1fa71ca2c997] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 00:24:44 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-70c5d083-cdc5-4017-a4e2-de983d39692e tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] [instance: ce058b47-d96f-4341-9104-1fa71ca2c997] Found default for hw_cdrom_bus of ide {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:24:44 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-70c5d083-cdc5-4017-a4e2-de983d39692e tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] [instance: ce058b47-d96f-4341-9104-1fa71ca2c997] Found default for hw_disk_bus of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:24:44 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-70c5d083-cdc5-4017-a4e2-de983d39692e tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] [instance: ce058b47-d96f-4341-9104-1fa71ca2c997] Found default for hw_input_bus of None {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:24:44 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-70c5d083-cdc5-4017-a4e2-de983d39692e tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] [instance: ce058b47-d96f-4341-9104-1fa71ca2c997] Found default for hw_pointer_model of None {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:24:44 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-70c5d083-cdc5-4017-a4e2-de983d39692e tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] [instance: ce058b47-d96f-4341-9104-1fa71ca2c997] Found default for hw_video_model of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:24:44 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-70c5d083-cdc5-4017-a4e2-de983d39692e tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] [instance: ce058b47-d96f-4341-9104-1fa71ca2c997] Found default for hw_vif_model of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:24:44 user nova-compute[75165]: INFO nova.compute.manager [None req-70c5d083-cdc5-4017-a4e2-de983d39692e tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] [instance: ce058b47-d96f-4341-9104-1fa71ca2c997] Took 6.25 seconds to spawn the instance on the hypervisor.
Oct 26 00:24:44 user nova-compute[75165]: DEBUG nova.compute.manager [None req-70c5d083-cdc5-4017-a4e2-de983d39692e tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] [instance: ce058b47-d96f-4341-9104-1fa71ca2c997] Checking state {{(pid=75165) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 00:24:44 user nova-compute[75165]: INFO nova.compute.manager [None req-70c5d083-cdc5-4017-a4e2-de983d39692e tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] [instance: ce058b47-d96f-4341-9104-1fa71ca2c997] Took 7.09 seconds to build instance.
Oct 26 00:24:44 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-70c5d083-cdc5-4017-a4e2-de983d39692e tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Lock "ce058b47-d96f-4341-9104-1fa71ca2c997" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.212s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:24:46 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:24:47 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:24:52 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:24:52 user nova-compute[75165]: INFO nova.compute.manager [None req-271b4cf1-9108-422c-b77e-bff2909b0f76 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb] Unrescuing
Oct 26 00:24:52 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-271b4cf1-9108-422c-b77e-bff2909b0f76 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Acquiring lock "refresh_cache-a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:24:52 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-271b4cf1-9108-422c-b77e-bff2909b0f76 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Acquired lock "refresh_cache-a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:24:52 user nova-compute[75165]: DEBUG nova.network.neutron [None req-271b4cf1-9108-422c-b77e-bff2909b0f76 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb] Building network info cache for instance {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 00:24:53 user nova-compute[75165]: DEBUG nova.network.neutron [None req-271b4cf1-9108-422c-b77e-bff2909b0f76 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb] Updating instance_info_cache with network_info: [{"id": "e2143e91-9f8c-4670-9f92-c2c00827a619", "address": "fa:16:3e:6c:b7:14", "network": {"id": "eb55c0bc-cae5-4ba3-851a-e31a50b52c88", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1081223830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d616862c7c184de5b0ba3121552c5666", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2143e91-9f", "ovs_interfaceid": "e2143e91-9f8c-4670-9f92-c2c00827a619", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:24:53 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-271b4cf1-9108-422c-b77e-bff2909b0f76 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Releasing lock "refresh_cache-a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:24:53 user nova-compute[75165]: DEBUG nova.objects.instance [None req-271b4cf1-9108-422c-b77e-bff2909b0f76 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Lazy-loading 'flavor' on Instance uuid a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:24:53 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:24:53 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:24:53 user nova-compute[75165]: DEBUG nova.compute.manager [req-3febf366-79e1-4dc7-bbcb-257353871420 req-c44af249-feb9-497e-b902-559d53e60b0d service nova] [instance: a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb] Received event network-vif-unplugged-e2143e91-9f8c-4670-9f92-c2c00827a619 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:24:53 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-3febf366-79e1-4dc7-bbcb-257353871420 req-c44af249-feb9-497e-b902-559d53e60b0d service nova] Acquiring lock "a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:24:53 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-3febf366-79e1-4dc7-bbcb-257353871420 req-c44af249-feb9-497e-b902-559d53e60b0d service nova] Lock "a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:24:53 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-3febf366-79e1-4dc7-bbcb-257353871420 req-c44af249-feb9-497e-b902-559d53e60b0d service nova] Lock "a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:24:53 user nova-compute[75165]: DEBUG nova.compute.manager [req-3febf366-79e1-4dc7-bbcb-257353871420 req-c44af249-feb9-497e-b902-559d53e60b0d service nova] [instance: a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb] No waiting events found dispatching network-vif-unplugged-e2143e91-9f8c-4670-9f92-c2c00827a619 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:24:53 user nova-compute[75165]: WARNING nova.compute.manager [req-3febf366-79e1-4dc7-bbcb-257353871420 req-c44af249-feb9-497e-b902-559d53e60b0d service nova] [instance: a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb] Received unexpected event network-vif-unplugged-e2143e91-9f8c-4670-9f92-c2c00827a619 for instance with vm_state rescued and task_state unrescuing.
Oct 26 00:24:53 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:24:53 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:24:54 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb] Instance destroyed successfully.
Oct 26 00:24:55 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:24:55 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:24:55 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:24:55 user nova-compute[75165]: DEBUG nova.compute.manager [req-b9163d78-8f70-4486-8056-6094341804af req-c49594d6-af31-449f-ad2b-0c248a09dc78 service nova] [instance: a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb] Received event network-vif-plugged-e2143e91-9f8c-4670-9f92-c2c00827a619 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:24:55 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-b9163d78-8f70-4486-8056-6094341804af req-c49594d6-af31-449f-ad2b-0c248a09dc78 service nova] Acquiring lock "a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:24:55 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-b9163d78-8f70-4486-8056-6094341804af req-c49594d6-af31-449f-ad2b-0c248a09dc78 service nova] Lock "a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:24:55 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-b9163d78-8f70-4486-8056-6094341804af req-c49594d6-af31-449f-ad2b-0c248a09dc78 service nova] Lock "a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:24:55 user nova-compute[75165]: DEBUG nova.compute.manager [req-b9163d78-8f70-4486-8056-6094341804af req-c49594d6-af31-449f-ad2b-0c248a09dc78 service nova] [instance: a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb] No waiting events found dispatching network-vif-plugged-e2143e91-9f8c-4670-9f92-c2c00827a619 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:24:55 user nova-compute[75165]: WARNING nova.compute.manager [req-b9163d78-8f70-4486-8056-6094341804af req-c49594d6-af31-449f-ad2b-0c248a09dc78 service nova] [instance: a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb] Received unexpected event network-vif-plugged-e2143e91-9f8c-4670-9f92-c2c00827a619 for instance with vm_state rescued and task_state unrescuing.
Oct 26 00:24:55 user nova-compute[75165]: DEBUG nova.compute.manager [req-b9163d78-8f70-4486-8056-6094341804af req-c49594d6-af31-449f-ad2b-0c248a09dc78 service nova] [instance: a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb] Received event network-vif-plugged-e2143e91-9f8c-4670-9f92-c2c00827a619 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:24:55 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-b9163d78-8f70-4486-8056-6094341804af req-c49594d6-af31-449f-ad2b-0c248a09dc78 service nova] Acquiring lock "a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:24:55 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-b9163d78-8f70-4486-8056-6094341804af req-c49594d6-af31-449f-ad2b-0c248a09dc78 service nova] Lock "a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:24:55 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-b9163d78-8f70-4486-8056-6094341804af req-c49594d6-af31-449f-ad2b-0c248a09dc78 service nova] Lock "a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.006s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:24:55 user nova-compute[75165]: DEBUG nova.compute.manager [req-b9163d78-8f70-4486-8056-6094341804af req-c49594d6-af31-449f-ad2b-0c248a09dc78 service nova] [instance: a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb] No waiting events found dispatching network-vif-plugged-e2143e91-9f8c-4670-9f92-c2c00827a619 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:24:55 user nova-compute[75165]: WARNING nova.compute.manager [req-b9163d78-8f70-4486-8056-6094341804af req-c49594d6-af31-449f-ad2b-0c248a09dc78 service nova] [instance: a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb] Received unexpected event network-vif-plugged-e2143e91-9f8c-4670-9f92-c2c00827a619 for instance with vm_state rescued and task_state unrescuing.
Oct 26 00:24:55 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:24:56 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:24:57 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:24:57 user nova-compute[75165]: DEBUG nova.compute.manager [None req-271b4cf1-9108-422c-b77e-bff2909b0f76 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb] Checking state {{(pid=75165) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 00:24:57 user nova-compute[75165]: DEBUG nova.compute.manager [req-a24bbabc-d147-46ca-8c36-f6b0073a1410 req-bd46c0cf-0c70-4749-a3be-6767ebd8bae5 service nova] [instance: a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb] Received event network-vif-plugged-e2143e91-9f8c-4670-9f92-c2c00827a619 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:24:57 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-a24bbabc-d147-46ca-8c36-f6b0073a1410 req-bd46c0cf-0c70-4749-a3be-6767ebd8bae5 service nova] Acquiring lock "a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:24:57 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-a24bbabc-d147-46ca-8c36-f6b0073a1410 req-bd46c0cf-0c70-4749-a3be-6767ebd8bae5 service nova] Lock "a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:24:57 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-a24bbabc-d147-46ca-8c36-f6b0073a1410 req-bd46c0cf-0c70-4749-a3be-6767ebd8bae5 service nova] Lock "a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:24:57 user nova-compute[75165]: DEBUG nova.compute.manager [req-a24bbabc-d147-46ca-8c36-f6b0073a1410 req-bd46c0cf-0c70-4749-a3be-6767ebd8bae5 service nova] [instance: a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb] No waiting events found dispatching network-vif-plugged-e2143e91-9f8c-4670-9f92-c2c00827a619 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:24:57 user nova-compute[75165]: WARNING nova.compute.manager [req-a24bbabc-d147-46ca-8c36-f6b0073a1410 req-bd46c0cf-0c70-4749-a3be-6767ebd8bae5 service nova] [instance: a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb] Received unexpected event network-vif-plugged-e2143e91-9f8c-4670-9f92-c2c00827a619 for instance with vm_state rescued and task_state unrescuing.
Oct 26 00:25:00 user nova-compute[75165]: DEBUG nova.compute.manager [req-5575d4f9-d0dd-45c1-9b44-3e40b69d394c req-10a396c1-a085-43cb-8b03-e80a8eee7c76 service nova] [instance: 91c62531-62f9-4f17-914c-11edc5010b54] Received event network-changed-355e1ddf-4d49-4a04-8a77-e05df100b323 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:25:00 user nova-compute[75165]: DEBUG nova.compute.manager [req-5575d4f9-d0dd-45c1-9b44-3e40b69d394c req-10a396c1-a085-43cb-8b03-e80a8eee7c76 service nova] [instance: 91c62531-62f9-4f17-914c-11edc5010b54] Refreshing instance network info cache due to event network-changed-355e1ddf-4d49-4a04-8a77-e05df100b323. {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 00:25:00 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-5575d4f9-d0dd-45c1-9b44-3e40b69d394c req-10a396c1-a085-43cb-8b03-e80a8eee7c76 service nova] Acquiring lock "refresh_cache-91c62531-62f9-4f17-914c-11edc5010b54" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:25:00 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-5575d4f9-d0dd-45c1-9b44-3e40b69d394c req-10a396c1-a085-43cb-8b03-e80a8eee7c76 service nova] Acquired lock "refresh_cache-91c62531-62f9-4f17-914c-11edc5010b54" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:25:00 user nova-compute[75165]: DEBUG nova.network.neutron [req-5575d4f9-d0dd-45c1-9b44-3e40b69d394c req-10a396c1-a085-43cb-8b03-e80a8eee7c76 service nova] [instance: 91c62531-62f9-4f17-914c-11edc5010b54] Refreshing network info cache for port 355e1ddf-4d49-4a04-8a77-e05df100b323 {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 00:25:01 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-b13acfc2-cc3b-4a2b-b44c-f343779ffaa6 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Acquiring lock "91c62531-62f9-4f17-914c-11edc5010b54" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:25:01 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-b13acfc2-cc3b-4a2b-b44c-f343779ffaa6 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Lock "91c62531-62f9-4f17-914c-11edc5010b54" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:25:01 user nova-compute[75165]: DEBUG nova.objects.instance [None req-b13acfc2-cc3b-4a2b-b44c-f343779ffaa6 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Lazy-loading 'flavor' on Instance uuid 91c62531-62f9-4f17-914c-11edc5010b54 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:25:01 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-b13acfc2-cc3b-4a2b-b44c-f343779ffaa6 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] [instance: 91c62531-62f9-4f17-914c-11edc5010b54] Ignoring supplied device name: /dev/vdb
Oct 26 00:25:01 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-b13acfc2-cc3b-4a2b-b44c-f343779ffaa6 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Lock "91c62531-62f9-4f17-914c-11edc5010b54" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:25:01 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-b13acfc2-cc3b-4a2b-b44c-f343779ffaa6 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Acquiring lock "91c62531-62f9-4f17-914c-11edc5010b54" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:25:01 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-b13acfc2-cc3b-4a2b-b44c-f343779ffaa6 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Lock "91c62531-62f9-4f17-914c-11edc5010b54" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:25:01 user nova-compute[75165]: INFO nova.compute.manager [None req-b13acfc2-cc3b-4a2b-b44c-f343779ffaa6 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] [instance: 91c62531-62f9-4f17-914c-11edc5010b54] Attaching volume d8e60b0c-7a47-46fd-a330-5d78f73e659f to /dev/vdb
Oct 26 00:25:01 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:25:01 user nova-compute[75165]: DEBUG os_brick.utils [None req-b13acfc2-cc3b-4a2b-b44c-f343779ffaa6 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:25:01 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:25:01 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:25:01 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c058358-f467-4c66-9531-1bae3ae4199f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa94814ccb35\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:25:01 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:25:01 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:25:01 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bc75b91-d4d4-4f78-b92c-53b46e095cf9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:25:01 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:25:01 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:25:01 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6be4af5-5224-4dd4-a692-3d126f00ac25]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:25:01 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[20d84908-d377-4ef7-a088-e2abeccf4d0b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:25:01 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-b13acfc2-cc3b-4a2b-b44c-f343779ffaa6 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Running cmd (subprocess): nvme version {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:25:01 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-b13acfc2-cc3b-4a2b-b44c-f343779ffaa6 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] 'nvme version' failed. Not Retrying. {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 00:25:01 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b13acfc2-cc3b-4a2b-b44c-f343779ffaa6 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] nvme not present on system {{(pid=75165) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 00:25:01 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:25:01 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 00:25:01 user nova-compute[75165]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 00:25:01 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eb38298-54e0-4aa9-9b04-fcd67605bc2a]: (4, '') {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:25:01 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-b13acfc2-cc3b-4a2b-b44c-f343779ffaa6 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75165) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 00:25:01 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-b13acfc2-cc3b-4a2b-b44c-f343779ffaa6 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75165) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 00:25:01 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-b13acfc2-cc3b-4a2b-b44c-f343779ffaa6 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] LIGHTOS: no hostnqn found. {{(pid=75165) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 00:25:01 user nova-compute[75165]: DEBUG os_brick.utils [None req-b13acfc2-cc3b-4a2b-b44c-f343779ffaa6 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa94814ccb35', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:25:01 user nova-compute[75165]: DEBUG nova.virt.block_device [None req-b13acfc2-cc3b-4a2b-b44c-f343779ffaa6 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] [instance: 91c62531-62f9-4f17-914c-11edc5010b54] Updating existing volume attachment record: ccd11f28-732b-47ac-bfdb-df90c94ab23a {{(pid=75165) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 00:25:01 user nova-compute[75165]: DEBUG nova.network.neutron [req-5575d4f9-d0dd-45c1-9b44-3e40b69d394c req-10a396c1-a085-43cb-8b03-e80a8eee7c76 service nova] [instance: 91c62531-62f9-4f17-914c-11edc5010b54] Updated VIF entry in instance network info cache for port 355e1ddf-4d49-4a04-8a77-e05df100b323. {{(pid=75165) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 00:25:01 user nova-compute[75165]: DEBUG nova.network.neutron [req-5575d4f9-d0dd-45c1-9b44-3e40b69d394c req-10a396c1-a085-43cb-8b03-e80a8eee7c76 service nova] [instance: 91c62531-62f9-4f17-914c-11edc5010b54] Updating instance_info_cache with network_info: [{"id": "355e1ddf-4d49-4a04-8a77-e05df100b323", "address": "fa:16:3e:61:d7:b9", "network": {"id": "6b000f11-7be2-4a26-ba67-b10f275e8560", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1605988141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eed16e1778f4ffb93afcc1ddbfe3d72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap355e1ddf-4d", "ovs_interfaceid": "355e1ddf-4d49-4a04-8a77-e05df100b323", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:25:01 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-5575d4f9-d0dd-45c1-9b44-3e40b69d394c req-10a396c1-a085-43cb-8b03-e80a8eee7c76 service nova] Releasing lock "refresh_cache-91c62531-62f9-4f17-914c-11edc5010b54" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:25:02 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:25:06 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:25:07 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:25:08 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:25:08 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75165) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 00:25:10 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:25:11 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:25:12 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:25:12 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:25:14 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:25:14 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:25:14 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:25:14 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:25:14 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:25:14 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:25:14 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75165) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 00:25:15 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75165) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 00:25:15 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97fb67a7-637d-456f-b4dd-0a271ed6cfc4/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:25:15 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97fb67a7-637d-456f-b4dd-0a271ed6cfc4/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:25:15 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97fb67a7-637d-456f-b4dd-0a271ed6cfc4/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:25:15 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97fb67a7-637d-456f-b4dd-0a271ed6cfc4/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:25:15 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7eeb145-1565-4812-818b-fefda5f2436d/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:25:15 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7eeb145-1565-4812-818b-fefda5f2436d/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:25:15 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7eeb145-1565-4812-818b-fefda5f2436d/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:25:15 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7eeb145-1565-4812-818b-fefda5f2436d/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:25:15 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91c62531-62f9-4f17-914c-11edc5010b54/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:25:16 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91c62531-62f9-4f17-914c-11edc5010b54/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:25:16 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91c62531-62f9-4f17-914c-11edc5010b54/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:25:16 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91c62531-62f9-4f17-914c-11edc5010b54/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:25:16 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75165) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 00:25:16 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce058b47-d96f-4341-9104-1fa71ca2c997/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:25:16 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:25:16 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce058b47-d96f-4341-9104-1fa71ca2c997/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:25:16 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce058b47-d96f-4341-9104-1fa71ca2c997/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:25:16 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce058b47-d96f-4341-9104-1fa71ca2c997/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:25:17 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:25:17 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:25:17 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Hypervisor/Node resource view: name=user free_ram=8296MB free_disk=24.934669494628906GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75165) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 00:25:17 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:25:17 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:25:17 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance a7eeb145-1565-4812-818b-fefda5f2436d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:25:17 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 97fb67a7-637d-456f-b4dd-0a271ed6cfc4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:25:17 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance bad6c21f-885f-4348-86f7-b237ce2d241b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:25:17 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:25:17 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 91c62531-62f9-4f17-914c-11edc5010b54 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:25:17 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance ce058b47-d96f-4341-9104-1fa71ca2c997 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:25:17 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75165) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 00:25:17 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75165) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 00:25:17 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:25:17 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:25:17 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:25:17 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Compute_service record updated for user:user {{(pid=75165) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 00:25:17 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.412s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:25:18 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:25:18 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Starting heal instance info cache {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 00:25:18 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "refresh_cache-97fb67a7-637d-456f-b4dd-0a271ed6cfc4" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:25:18 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquired lock "refresh_cache-97fb67a7-637d-456f-b4dd-0a271ed6cfc4" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:25:18 user nova-compute[75165]: DEBUG nova.network.neutron [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: 97fb67a7-637d-456f-b4dd-0a271ed6cfc4] Forcefully refreshing network info cache for instance {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 00:25:19 user nova-compute[75165]: DEBUG nova.network.neutron [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: 97fb67a7-637d-456f-b4dd-0a271ed6cfc4] Updating instance_info_cache with network_info: [{"id": "254ea53c-6da9-46d5-a139-7926008cdf8b", "address": "fa:16:3e:08:21:2a", "network": {"id": "eb55c0bc-cae5-4ba3-851a-e31a50b52c88", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1081223830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d616862c7c184de5b0ba3121552c5666", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap254ea53c-6d", "ovs_interfaceid": "254ea53c-6da9-46d5-a139-7926008cdf8b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:25:19 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Releasing lock "refresh_cache-97fb67a7-637d-456f-b4dd-0a271ed6cfc4" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:25:19 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: 97fb67a7-637d-456f-b4dd-0a271ed6cfc4] Updated the network info_cache for instance {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 00:25:19 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:25:19 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:25:19 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:25:19 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b13acfc2-cc3b-4a2b-b44c-f343779ffaa6 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] [instance: 91c62531-62f9-4f17-914c-11edc5010b54] Calling os-brick to attach iSCSI Volume {{(pid=75165) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 00:25:19 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-b13acfc2-cc3b-4a2b-b44c-f343779ffaa6 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8bf8160e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d8e60b0c-7a47-46fd-a330-5d78f73e659f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FBMzcVRh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:25:19 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-b13acfc2-cc3b-4a2b-b44c-f343779ffaa6 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:25:19 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-b13acfc2-cc3b-4a2b-b44c-f343779ffaa6 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:25:19 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-b13acfc2-cc3b-4a2b-b44c-f343779ffaa6 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:25:19 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-b13acfc2-cc3b-4a2b-b44c-f343779ffaa6 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:25:19 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-b13acfc2-cc3b-4a2b-b44c-f343779ffaa6 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d8e60b0c-7a47-46fd-a330-5d78f73e659f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:25:19 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-b13acfc2-cc3b-4a2b-b44c-f343779ffaa6 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d8e60b0c-7a47-46fd-a330-5d78f73e659f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:25:19 user nova-compute[75165]: INFO os_brick.initiator.connectors.iscsi [None req-b13acfc2-cc3b-4a2b-b44c-f343779ffaa6 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 00:25:19 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8e60b0c-7a47-46fd-a330-5d78f73e659f -p 172.16.0.220:3260 {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:25:19 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8e60b0c-7a47-46fd-a330-5d78f73e659f -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:25:19 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7f47b11-7a19-4535-88a0-cfbea4fd65ad]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:25:19 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-b13acfc2-cc3b-4a2b-b44c-f343779ffaa6 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 00:25:19 user nova-compute[75165]:  {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:25:19 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8e60b0c-7a47-46fd-a330-5d78f73e659f -p 172.16.0.220:3260 --interface default --op new {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:25:19 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8e60b0c-7a47-46fd-a330-5d78f73e659f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:25:19 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f4f9514-021e-4fd9-b13f-eae75750ba8d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d8e60b0c-7a47-46fd-a330-5d78f73e659f] added\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:25:19 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-b13acfc2-cc3b-4a2b-b44c-f343779ffaa6 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d8e60b0c-7a47-46fd-a330-5d78f73e659f] added
Oct 26 00:25:19 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:25:19 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8e60b0c-7a47-46fd-a330-5d78f73e659f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:25:19 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8e60b0c-7a47-46fd-a330-5d78f73e659f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:25:19 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[f67b0534-2f08-4521-a006-5d0144287871]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:25:19 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-b13acfc2-cc3b-4a2b-b44c-f343779ffaa6 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:25:19 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8e60b0c-7a47-46fd-a330-5d78f73e659f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:25:19 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8e60b0c-7a47-46fd-a330-5d78f73e659f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:25:19 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ec73ca6-635b-4eb2-8fe0-7454976bc1a2]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:25:19 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-b13acfc2-cc3b-4a2b-b44c-f343779ffaa6 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:25:19 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8e60b0c-7a47-46fd-a330-5d78f73e659f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FBMzcVRh {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:25:19 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8e60b0c-7a47-46fd-a330-5d78f73e659f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FBMzcVRh" returned: 0 in 0.019s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:25:19 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0cccd39-e730-43b0-8878-622bf8f7d76a]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:25:19 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-b13acfc2-cc3b-4a2b-b44c-f343779ffaa6 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FBMzcVRh'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:25:19 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8e60b0c-7a47-46fd-a330-5d78f73e659f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:25:19 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8e60b0c-7a47-46fd-a330-5d78f73e659f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.036s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:25:19 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[2497304d-c940-4c93-82fb-688d96019542]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:25:19 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-b13acfc2-cc3b-4a2b-b44c-f343779ffaa6 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:25:19 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:25:19 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:25:19 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[539c99a6-435b-45b9-bb1b-a2034e2951e2]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a43689-b7cd-47e6-ae88-fd8ba07c60c1 (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:25:19 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-b13acfc2-cc3b-4a2b-b44c-f343779ffaa6 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)
Oct 26 00:25:19 user nova-compute[75165]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a43689-b7cd-47e6-ae88-fd8ba07c60c1 (non-flash)
Oct 26 00:25:19 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:25:19 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-b13acfc2-cc3b-4a2b-b44c-f343779ffaa6 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)
Oct 26 00:25:19 user nova-compute[75165]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a43689-b7cd-47e6-ae88-fd8ba07c60c1 (non-flash)
Oct 26 00:25:19 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:25:19 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8e60b0c-7a47-46fd-a330-5d78f73e659f -p 172.16.0.220:3260 --login {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:25:19 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8e60b0c-7a47-46fd-a330-5d78f73e659f -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:25:19 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8ad782d-c42e-4ce0-a93f-b00000bb2621]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d8e60b0c-7a47-46fd-a330-5d78f73e659f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d8e60b0c-7a47-46fd-a330-5d78f73e659f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:25:19 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-b13acfc2-cc3b-4a2b-b44c-f343779ffaa6 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d8e60b0c-7a47-46fd-a330-5d78f73e659f, portal: 172.16.0.220,3260]
Oct 26 00:25:19 user nova-compute[75165]: Login to [iface: default, target: iqn.2010-10.org.openstack:d8e60b0c-7a47-46fd-a330-5d78f73e659f, portal: 172.16.0.220,3260] successful.
Oct 26 00:25:19 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:25:19 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8e60b0c-7a47-46fd-a330-5d78f73e659f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:25:19 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8e60b0c-7a47-46fd-a330-5d78f73e659f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:25:19 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[a63ba55d-b794-42aa-b1be-380c3b49b58a]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:25:19 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-b13acfc2-cc3b-4a2b-b44c-f343779ffaa6 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:25:19 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:25:19 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:25:19 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca346ecd-47ef-4a2e-9226-b7d1c88cf248]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a43689-b7cd-47e6-ae88-fd8ba07c60c1 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8e60b0c-7a47-46fd-a330-5d78f73e659f (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:25:19 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-b13acfc2-cc3b-4a2b-b44c-f343779ffaa6 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)
Oct 26 00:25:19 user nova-compute[75165]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a43689-b7cd-47e6-ae88-fd8ba07c60c1 (non-flash)
Oct 26 00:25:19 user nova-compute[75165]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8e60b0c-7a47-46fd-a330-5d78f73e659f (non-flash)
Oct 26 00:25:19 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:25:19 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-b13acfc2-cc3b-4a2b-b44c-f343779ffaa6 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)
Oct 26 00:25:19 user nova-compute[75165]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a43689-b7cd-47e6-ae88-fd8ba07c60c1 (non-flash)
Oct 26 00:25:19 user nova-compute[75165]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8e60b0c-7a47-46fd-a330-5d78f73e659f (non-flash)
Oct 26 00:25:19 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:25:19 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-b13acfc2-cc3b-4a2b-b44c-f343779ffaa6 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d8e60b0c-7a47-46fd-a330-5d78f73e659f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:25:19 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-b13acfc2-cc3b-4a2b-b44c-f343779ffaa6 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Connected to 172.16.0.220:3260 {{(pid=75165) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 00:25:19 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-b13acfc2-cc3b-4a2b-b44c-f343779ffaa6 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] HCTL ('34', '-', '-', 0) found on session 30 with lun 0 {{(pid=75165) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 00:25:19 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-b13acfc2-cc3b-4a2b-b44c-f343779ffaa6 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75165) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 00:25:19 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:25:19 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:25:19 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[63f26f78-10cd-4ff0-97a4-4c29255922c3]: (4, ('- - 0', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:25:19 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-b13acfc2-cc3b-4a2b-b44c-f343779ffaa6 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Searching for a device in session 30 and hctl ['34', '*', '*', 0] yield: None {{(pid=75165) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 00:25:20 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-b13acfc2-cc3b-4a2b-b44c-f343779ffaa6 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Searching for a device in session 30 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75165) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 00:25:20 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-b13acfc2-cc3b-4a2b-b44c-f343779ffaa6 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:d8e60b0c-7a47-46fd-a330-5d78f73e659f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FBMzcVRh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75165) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 00:25:20 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-b13acfc2-cc3b-4a2b-b44c-f343779ffaa6 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:25:20 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-b13acfc2-cc3b-4a2b-b44c-f343779ffaa6 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] <== connect_volume: return (1316ms) {'type': 'block', 'scsi_wwn': '26235663735333363', 'path': '/dev/sdc'} {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:25:20 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b13acfc2-cc3b-4a2b-b44c-f343779ffaa6 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] [instance: 91c62531-62f9-4f17-914c-11edc5010b54] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26235663735333363', 'path': '/dev/sdc'} {{(pid=75165) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 00:25:20 user nova-compute[75165]: DEBUG nova.objects.instance [None req-b13acfc2-cc3b-4a2b-b44c-f343779ffaa6 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Lazy-loading 'flavor' on Instance uuid 91c62531-62f9-4f17-914c-11edc5010b54 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:25:20 user nova-compute[75165]: DEBUG nova.virt.libvirt.guest [None req-b13acfc2-cc3b-4a2b-b44c-f343779ffaa6 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 00:25:20 user nova-compute[75165]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 00:25:20 user nova-compute[75165]:   <source dev="/dev/sdc"/>
Oct 26 00:25:20 user nova-compute[75165]:   <target dev="vdb" bus="virtio"/>
Oct 26 00:25:20 user nova-compute[75165]:   <serial>d8e60b0c-7a47-46fd-a330-5d78f73e659f</serial>
Oct 26 00:25:20 user nova-compute[75165]: </disk>
Oct 26 00:25:20 user nova-compute[75165]:  {{(pid=75165) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 00:25:21 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-b13acfc2-cc3b-4a2b-b44c-f343779ffaa6 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] No BDM found with device name vda, not building metadata. {{(pid=75165) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 00:25:21 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-b13acfc2-cc3b-4a2b-b44c-f343779ffaa6 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75165) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 00:25:21 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-b13acfc2-cc3b-4a2b-b44c-f343779ffaa6 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] No VIF found with MAC fa:16:3e:61:d7:b9, not building metadata {{(pid=75165) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 00:25:21 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-b13acfc2-cc3b-4a2b-b44c-f343779ffaa6 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Lock "91c62531-62f9-4f17-914c-11edc5010b54" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.394s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:25:22 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:25:27 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:25:31 user nova-compute[75165]: INFO nova.compute.manager [None req-f4f21eca-6920-4e60-bb33-058b5d651667 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: bad6c21f-885f-4348-86f7-b237ce2d241b] Get console output
Oct 26 00:25:32 user nova-compute[75165]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Oct 26 00:25:32 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:25:33 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:25:34 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:25:36 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:25:37 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:25:42 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:25:47 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:25:52 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:25:57 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:26:02 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:26:07 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:26:08 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:26:08 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75165) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 00:26:12 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:26:12 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:26:13 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:26:13 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:26:15 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:26:15 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Starting heal instance info cache {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 00:26:15 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "refresh_cache-bad6c21f-885f-4348-86f7-b237ce2d241b" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:26:15 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquired lock "refresh_cache-bad6c21f-885f-4348-86f7-b237ce2d241b" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:26:15 user nova-compute[75165]: DEBUG nova.network.neutron [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: bad6c21f-885f-4348-86f7-b237ce2d241b] Forcefully refreshing network info cache for instance {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 00:26:16 user nova-compute[75165]: DEBUG nova.network.neutron [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: bad6c21f-885f-4348-86f7-b237ce2d241b] Updating instance_info_cache with network_info: [{"id": "b64d421a-ca91-4f21-80f7-17b0c17ceb8a", "address": "fa:16:3e:54:54:b8", "network": {"id": "bd1c84f9-bba9-4a23-8bf2-17e65022136a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1557945804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2911497df44047d9a9ee36a5652298bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb64d421a-ca", "ovs_interfaceid": "b64d421a-ca91-4f21-80f7-17b0c17ceb8a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:26:16 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Releasing lock "refresh_cache-bad6c21f-885f-4348-86f7-b237ce2d241b" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:26:16 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: bad6c21f-885f-4348-86f7-b237ce2d241b] Updated the network info_cache for instance {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 00:26:16 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:26:16 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:26:16 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:26:16 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:26:16 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:26:16 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75165) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 00:26:16 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75165) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 00:26:16 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97fb67a7-637d-456f-b4dd-0a271ed6cfc4/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:26:16 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97fb67a7-637d-456f-b4dd-0a271ed6cfc4/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:26:16 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97fb67a7-637d-456f-b4dd-0a271ed6cfc4/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:26:16 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97fb67a7-637d-456f-b4dd-0a271ed6cfc4/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:26:16 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7eeb145-1565-4812-818b-fefda5f2436d/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:26:17 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7eeb145-1565-4812-818b-fefda5f2436d/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:26:17 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7eeb145-1565-4812-818b-fefda5f2436d/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:26:17 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:26:17 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:26:17 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7eeb145-1565-4812-818b-fefda5f2436d/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:26:17 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91c62531-62f9-4f17-914c-11edc5010b54/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:26:17 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91c62531-62f9-4f17-914c-11edc5010b54/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:26:17 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91c62531-62f9-4f17-914c-11edc5010b54/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:26:17 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91c62531-62f9-4f17-914c-11edc5010b54/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:26:17 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75165) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 00:26:17 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75165) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 00:26:17 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce058b47-d96f-4341-9104-1fa71ca2c997/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:26:17 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce058b47-d96f-4341-9104-1fa71ca2c997/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:26:17 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce058b47-d96f-4341-9104-1fa71ca2c997/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:26:18 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce058b47-d96f-4341-9104-1fa71ca2c997/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:26:18 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:26:18 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:26:18 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Hypervisor/Node resource view: name=user free_ram=8419MB free_disk=24.923439025878906GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75165) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 00:26:18 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:26:18 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:26:18 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance a7eeb145-1565-4812-818b-fefda5f2436d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:26:18 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 97fb67a7-637d-456f-b4dd-0a271ed6cfc4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:26:18 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance bad6c21f-885f-4348-86f7-b237ce2d241b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:26:18 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:26:18 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 91c62531-62f9-4f17-914c-11edc5010b54 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:26:18 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance ce058b47-d96f-4341-9104-1fa71ca2c997 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:26:18 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75165) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 00:26:18 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75165) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 00:26:18 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:26:18 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:26:18 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Compute_service record updated for user:user {{(pid=75165) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 00:26:18 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.347s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:26:19 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:26:19 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:26:19 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:26:19 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:26:21 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:26:22 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:26:23 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:26:25 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:26:26 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:26:27 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:26:29 user nova-compute[75165]: DEBUG nova.compute.manager [req-285542ee-d936-4b27-bcf7-032be9536a95 req-4bcca128-9e91-4879-8b9f-112e12e60054 service nova] [instance: ce058b47-d96f-4341-9104-1fa71ca2c997] Received event network-changed-7df0d91d-ff60-4008-823f-f951cbf505d3 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:26:29 user nova-compute[75165]: DEBUG nova.compute.manager [req-285542ee-d936-4b27-bcf7-032be9536a95 req-4bcca128-9e91-4879-8b9f-112e12e60054 service nova] [instance: ce058b47-d96f-4341-9104-1fa71ca2c997] Refreshing instance network info cache due to event network-changed-7df0d91d-ff60-4008-823f-f951cbf505d3. {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 00:26:29 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-285542ee-d936-4b27-bcf7-032be9536a95 req-4bcca128-9e91-4879-8b9f-112e12e60054 service nova] Acquiring lock "refresh_cache-ce058b47-d96f-4341-9104-1fa71ca2c997" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:26:29 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-285542ee-d936-4b27-bcf7-032be9536a95 req-4bcca128-9e91-4879-8b9f-112e12e60054 service nova] Acquired lock "refresh_cache-ce058b47-d96f-4341-9104-1fa71ca2c997" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:26:29 user nova-compute[75165]: DEBUG nova.network.neutron [req-285542ee-d936-4b27-bcf7-032be9536a95 req-4bcca128-9e91-4879-8b9f-112e12e60054 service nova] [instance: ce058b47-d96f-4341-9104-1fa71ca2c997] Refreshing network info cache for port 7df0d91d-ff60-4008-823f-f951cbf505d3 {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 00:26:29 user nova-compute[75165]: DEBUG nova.network.neutron [req-285542ee-d936-4b27-bcf7-032be9536a95 req-4bcca128-9e91-4879-8b9f-112e12e60054 service nova] [instance: ce058b47-d96f-4341-9104-1fa71ca2c997] Updated VIF entry in instance network info cache for port 7df0d91d-ff60-4008-823f-f951cbf505d3. {{(pid=75165) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 00:26:29 user nova-compute[75165]: DEBUG nova.network.neutron [req-285542ee-d936-4b27-bcf7-032be9536a95 req-4bcca128-9e91-4879-8b9f-112e12e60054 service nova] [instance: ce058b47-d96f-4341-9104-1fa71ca2c997] Updating instance_info_cache with network_info: [{"id": "7df0d91d-ff60-4008-823f-f951cbf505d3", "address": "fa:16:3e:d8:e5:83", "network": {"id": "7e330392-6256-405b-ab37-0b8af0c4fd48", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-430326049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ffbf5c944914cafac7aba65fb7ca402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7df0d91d-ff", "ovs_interfaceid": "7df0d91d-ff60-4008-823f-f951cbf505d3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:26:29 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-285542ee-d936-4b27-bcf7-032be9536a95 req-4bcca128-9e91-4879-8b9f-112e12e60054 service nova] Releasing lock "refresh_cache-ce058b47-d96f-4341-9104-1fa71ca2c997" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:26:30 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-59a55c97-3643-48dd-ba23-623ee857e7e1 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Acquiring lock "fe2984ce-8958-4049-8af7-496b313b26c8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:26:30 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-59a55c97-3643-48dd-ba23-623ee857e7e1 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Lock "fe2984ce-8958-4049-8af7-496b313b26c8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:26:30 user nova-compute[75165]: DEBUG nova.compute.manager [None req-59a55c97-3643-48dd-ba23-623ee857e7e1 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] [instance: fe2984ce-8958-4049-8af7-496b313b26c8] Starting instance... {{(pid=75165) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 00:26:30 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-59a55c97-3643-48dd-ba23-623ee857e7e1 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:26:30 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-59a55c97-3643-48dd-ba23-623ee857e7e1 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:26:30 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-59a55c97-3643-48dd-ba23-623ee857e7e1 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75165) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 00:26:30 user nova-compute[75165]: INFO nova.compute.claims [None req-59a55c97-3643-48dd-ba23-623ee857e7e1 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] [instance: fe2984ce-8958-4049-8af7-496b313b26c8] Claim successful on node user
Oct 26 00:26:31 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-59a55c97-3643-48dd-ba23-623ee857e7e1 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:26:31 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-59a55c97-3643-48dd-ba23-623ee857e7e1 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:26:31 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-59a55c97-3643-48dd-ba23-623ee857e7e1 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.407s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:26:31 user nova-compute[75165]: DEBUG nova.compute.manager [None req-59a55c97-3643-48dd-ba23-623ee857e7e1 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] [instance: fe2984ce-8958-4049-8af7-496b313b26c8] Start building networks asynchronously for instance. {{(pid=75165) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 00:26:31 user nova-compute[75165]: DEBUG nova.compute.manager [None req-59a55c97-3643-48dd-ba23-623ee857e7e1 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] [instance: fe2984ce-8958-4049-8af7-496b313b26c8] Allocating IP information in the background. {{(pid=75165) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 00:26:31 user nova-compute[75165]: DEBUG nova.network.neutron [None req-59a55c97-3643-48dd-ba23-623ee857e7e1 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] [instance: fe2984ce-8958-4049-8af7-496b313b26c8] allocate_for_instance() {{(pid=75165) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 00:26:31 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-59a55c97-3643-48dd-ba23-623ee857e7e1 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] [instance: fe2984ce-8958-4049-8af7-496b313b26c8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 00:26:31 user nova-compute[75165]: DEBUG nova.compute.manager [None req-59a55c97-3643-48dd-ba23-623ee857e7e1 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] [instance: fe2984ce-8958-4049-8af7-496b313b26c8] Start building block device mappings for instance. {{(pid=75165) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 00:26:31 user nova-compute[75165]: DEBUG nova.policy [None req-59a55c97-3643-48dd-ba23-623ee857e7e1 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '45d43fd7499347cc88bee0319be12cde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '567a90e8d8b24ca4b5e5da923d537134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75165) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 00:26:31 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:26:31 user nova-compute[75165]: DEBUG nova.compute.manager [None req-59a55c97-3643-48dd-ba23-623ee857e7e1 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] [instance: fe2984ce-8958-4049-8af7-496b313b26c8] Start spawning the instance on the hypervisor. {{(pid=75165) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 00:26:31 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-59a55c97-3643-48dd-ba23-623ee857e7e1 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] [instance: fe2984ce-8958-4049-8af7-496b313b26c8] Creating instance directory {{(pid=75165) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 00:26:31 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-59a55c97-3643-48dd-ba23-623ee857e7e1 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] [instance: fe2984ce-8958-4049-8af7-496b313b26c8] Creating image(s)
Oct 26 00:26:31 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-59a55c97-3643-48dd-ba23-623ee857e7e1 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Acquiring lock "/opt/stack/data/nova/instances/fe2984ce-8958-4049-8af7-496b313b26c8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:26:31 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-59a55c97-3643-48dd-ba23-623ee857e7e1 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Lock "/opt/stack/data/nova/instances/fe2984ce-8958-4049-8af7-496b313b26c8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:26:31 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-59a55c97-3643-48dd-ba23-623ee857e7e1 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Lock "/opt/stack/data/nova/instances/fe2984ce-8958-4049-8af7-496b313b26c8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:26:31 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-59a55c97-3643-48dd-ba23-623ee857e7e1 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:26:31 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-59a55c97-3643-48dd-ba23-623ee857e7e1 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json" returned: 0 in 0.190s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:26:31 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-59a55c97-3643-48dd-ba23-623ee857e7e1 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Acquiring lock "7d3243421cf3fdc288b758f687a93103b7b95466" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:26:31 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-59a55c97-3643-48dd-ba23-623ee857e7e1 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Lock "7d3243421cf3fdc288b758f687a93103b7b95466" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:26:31 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-59a55c97-3643-48dd-ba23-623ee857e7e1 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:26:31 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-59a55c97-3643-48dd-ba23-623ee857e7e1 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json" returned: 0 in 0.191s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:26:31 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-59a55c97-3643-48dd-ba23-623ee857e7e1 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466,backing_fmt=raw /opt/stack/data/nova/instances/fe2984ce-8958-4049-8af7-496b313b26c8/disk 1073741824 {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:26:31 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-59a55c97-3643-48dd-ba23-623ee857e7e1 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466,backing_fmt=raw /opt/stack/data/nova/instances/fe2984ce-8958-4049-8af7-496b313b26c8/disk 1073741824" returned: 0 in 0.053s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:26:31 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-59a55c97-3643-48dd-ba23-623ee857e7e1 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Lock "7d3243421cf3fdc288b758f687a93103b7b95466" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:26:31 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-59a55c97-3643-48dd-ba23-623ee857e7e1 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:26:32 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-59a55c97-3643-48dd-ba23-623ee857e7e1 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json" returned: 0 in 0.182s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:26:32 user nova-compute[75165]: DEBUG nova.virt.disk.api [None req-59a55c97-3643-48dd-ba23-623ee857e7e1 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fe2984ce-8958-4049-8af7-496b313b26c8/disk. size=1073741824 {{(pid=75165) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 00:26:32 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-59a55c97-3643-48dd-ba23-623ee857e7e1 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe2984ce-8958-4049-8af7-496b313b26c8/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:26:32 user nova-compute[75165]: DEBUG nova.network.neutron [None req-59a55c97-3643-48dd-ba23-623ee857e7e1 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] [instance: fe2984ce-8958-4049-8af7-496b313b26c8] Successfully created port: 5995df96-1576-4616-8834-45073add32a2 {{(pid=75165) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 00:26:32 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-59a55c97-3643-48dd-ba23-623ee857e7e1 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe2984ce-8958-4049-8af7-496b313b26c8/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:26:32 user nova-compute[75165]: DEBUG nova.virt.disk.api [None req-59a55c97-3643-48dd-ba23-623ee857e7e1 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Cannot resize image /opt/stack/data/nova/instances/fe2984ce-8958-4049-8af7-496b313b26c8/disk to a smaller size. {{(pid=75165) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 00:26:32 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-59a55c97-3643-48dd-ba23-623ee857e7e1 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] [instance: fe2984ce-8958-4049-8af7-496b313b26c8] Created local disks {{(pid=75165) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 00:26:32 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-59a55c97-3643-48dd-ba23-623ee857e7e1 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] [instance: fe2984ce-8958-4049-8af7-496b313b26c8] Ensure instance console log exists: /opt/stack/data/nova/instances/fe2984ce-8958-4049-8af7-496b313b26c8/console.log {{(pid=75165) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 00:26:32 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-59a55c97-3643-48dd-ba23-623ee857e7e1 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:26:32 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-59a55c97-3643-48dd-ba23-623ee857e7e1 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:26:32 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-59a55c97-3643-48dd-ba23-623ee857e7e1 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:26:32 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:26:32 user nova-compute[75165]: DEBUG nova.network.neutron [None req-59a55c97-3643-48dd-ba23-623ee857e7e1 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] [instance: fe2984ce-8958-4049-8af7-496b313b26c8] Successfully updated port: 5995df96-1576-4616-8834-45073add32a2 {{(pid=75165) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 00:26:32 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-59a55c97-3643-48dd-ba23-623ee857e7e1 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Acquiring lock "refresh_cache-fe2984ce-8958-4049-8af7-496b313b26c8" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:26:32 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-59a55c97-3643-48dd-ba23-623ee857e7e1 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Acquired lock "refresh_cache-fe2984ce-8958-4049-8af7-496b313b26c8" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:26:32 user nova-compute[75165]: DEBUG nova.network.neutron [None req-59a55c97-3643-48dd-ba23-623ee857e7e1 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] [instance: fe2984ce-8958-4049-8af7-496b313b26c8] Building network info cache for instance {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 00:26:32 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-7a6517e2-3229-4cf2-8db2-159ba2abb079 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Acquiring lock "bad6c21f-885f-4348-86f7-b237ce2d241b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:26:32 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-7a6517e2-3229-4cf2-8db2-159ba2abb079 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Lock "bad6c21f-885f-4348-86f7-b237ce2d241b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:26:32 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-7a6517e2-3229-4cf2-8db2-159ba2abb079 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Acquiring lock "bad6c21f-885f-4348-86f7-b237ce2d241b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:26:32 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-7a6517e2-3229-4cf2-8db2-159ba2abb079 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Lock "bad6c21f-885f-4348-86f7-b237ce2d241b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:26:32 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-7a6517e2-3229-4cf2-8db2-159ba2abb079 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Lock "bad6c21f-885f-4348-86f7-b237ce2d241b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.002s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:26:32 user nova-compute[75165]: INFO nova.compute.manager [None req-7a6517e2-3229-4cf2-8db2-159ba2abb079 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: bad6c21f-885f-4348-86f7-b237ce2d241b] Terminating instance
Oct 26 00:26:32 user nova-compute[75165]: DEBUG nova.compute.manager [None req-7a6517e2-3229-4cf2-8db2-159ba2abb079 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: bad6c21f-885f-4348-86f7-b237ce2d241b] Start destroying the instance on the hypervisor. {{(pid=75165) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 00:26:32 user nova-compute[75165]: DEBUG nova.compute.manager [req-0bb7f5a0-8a18-4b12-a139-2f0323772c10 req-12c49805-d7e5-4d7a-a806-724ac1c209b9 service nova] [instance: fe2984ce-8958-4049-8af7-496b313b26c8] Received event network-changed-5995df96-1576-4616-8834-45073add32a2 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:26:32 user nova-compute[75165]: DEBUG nova.compute.manager [req-0bb7f5a0-8a18-4b12-a139-2f0323772c10 req-12c49805-d7e5-4d7a-a806-724ac1c209b9 service nova] [instance: fe2984ce-8958-4049-8af7-496b313b26c8] Refreshing instance network info cache due to event network-changed-5995df96-1576-4616-8834-45073add32a2. {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 00:26:32 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-0bb7f5a0-8a18-4b12-a139-2f0323772c10 req-12c49805-d7e5-4d7a-a806-724ac1c209b9 service nova] Acquiring lock "refresh_cache-fe2984ce-8958-4049-8af7-496b313b26c8" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:26:32 user nova-compute[75165]: DEBUG nova.network.neutron [None req-59a55c97-3643-48dd-ba23-623ee857e7e1 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] [instance: fe2984ce-8958-4049-8af7-496b313b26c8] Instance cache missing network info. {{(pid=75165) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 00:26:32 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:26:32 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:26:33 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:26:33 user nova-compute[75165]: DEBUG nova.compute.manager [req-2c229c51-bdb2-4e36-9995-a7ea4ed799bc req-8e23de77-cc2a-488e-a13a-3c054e001ebe service nova] [instance: bad6c21f-885f-4348-86f7-b237ce2d241b] Received event network-vif-unplugged-b64d421a-ca91-4f21-80f7-17b0c17ceb8a {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:26:33 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-2c229c51-bdb2-4e36-9995-a7ea4ed799bc req-8e23de77-cc2a-488e-a13a-3c054e001ebe service nova] Acquiring lock "bad6c21f-885f-4348-86f7-b237ce2d241b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:26:33 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-2c229c51-bdb2-4e36-9995-a7ea4ed799bc req-8e23de77-cc2a-488e-a13a-3c054e001ebe service nova] Lock "bad6c21f-885f-4348-86f7-b237ce2d241b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:26:33 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-2c229c51-bdb2-4e36-9995-a7ea4ed799bc req-8e23de77-cc2a-488e-a13a-3c054e001ebe service nova] Lock "bad6c21f-885f-4348-86f7-b237ce2d241b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:26:33 user nova-compute[75165]: DEBUG nova.compute.manager [req-2c229c51-bdb2-4e36-9995-a7ea4ed799bc req-8e23de77-cc2a-488e-a13a-3c054e001ebe service nova] [instance: bad6c21f-885f-4348-86f7-b237ce2d241b] No waiting events found dispatching network-vif-unplugged-b64d421a-ca91-4f21-80f7-17b0c17ceb8a {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:26:33 user nova-compute[75165]: DEBUG nova.compute.manager [req-2c229c51-bdb2-4e36-9995-a7ea4ed799bc req-8e23de77-cc2a-488e-a13a-3c054e001ebe service nova] [instance: bad6c21f-885f-4348-86f7-b237ce2d241b] Received event network-vif-unplugged-b64d421a-ca91-4f21-80f7-17b0c17ceb8a for instance with task_state deleting. {{(pid=75165) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 00:26:33 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:26:33 user nova-compute[75165]: DEBUG nova.network.neutron [None req-59a55c97-3643-48dd-ba23-623ee857e7e1 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] [instance: fe2984ce-8958-4049-8af7-496b313b26c8] Updating instance_info_cache with network_info: [{"id": "5995df96-1576-4616-8834-45073add32a2", "address": "fa:16:3e:ca:36:c4", "network": {"id": "7c8ed206-c41f-4c32-837b-b50fb4ee5479", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1704810529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "567a90e8d8b24ca4b5e5da923d537134", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5995df96-15", "ovs_interfaceid": "5995df96-1576-4616-8834-45073add32a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:26:33 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-59a55c97-3643-48dd-ba23-623ee857e7e1 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Releasing lock "refresh_cache-fe2984ce-8958-4049-8af7-496b313b26c8" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:26:33 user nova-compute[75165]: DEBUG nova.compute.manager [None req-59a55c97-3643-48dd-ba23-623ee857e7e1 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] [instance: fe2984ce-8958-4049-8af7-496b313b26c8] Instance network_info: |[{"id": "5995df96-1576-4616-8834-45073add32a2", "address": "fa:16:3e:ca:36:c4", "network": {"id": "7c8ed206-c41f-4c32-837b-b50fb4ee5479", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1704810529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "567a90e8d8b24ca4b5e5da923d537134", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5995df96-15", "ovs_interfaceid": "5995df96-1576-4616-8834-45073add32a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75165) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 00:26:33 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-0bb7f5a0-8a18-4b12-a139-2f0323772c10 req-12c49805-d7e5-4d7a-a806-724ac1c209b9 service nova] Acquired lock "refresh_cache-fe2984ce-8958-4049-8af7-496b313b26c8" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:26:33 user nova-compute[75165]: DEBUG nova.network.neutron [req-0bb7f5a0-8a18-4b12-a139-2f0323772c10 req-12c49805-d7e5-4d7a-a806-724ac1c209b9 service nova] [instance: fe2984ce-8958-4049-8af7-496b313b26c8] Refreshing network info cache for port 5995df96-1576-4616-8834-45073add32a2 {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 00:26:33 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-59a55c97-3643-48dd-ba23-623ee857e7e1 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] [instance: fe2984ce-8958-4049-8af7-496b313b26c8] Start _get_guest_xml network_info=[{"id": "5995df96-1576-4616-8834-45073add32a2", "address": "fa:16:3e:ca:36:c4", "network": {"id": "7c8ed206-c41f-4c32-837b-b50fb4ee5479", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1704810529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "567a90e8d8b24ca4b5e5da923d537134", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5995df96-15", "ovs_interfaceid": "5995df96-1576-4616-8834-45073add32a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T00:03:24Z,direct_url=<?>,disk_format='qcow2',id=bff0d8a1-739e-4c4d-9efa-b73ba7b76d01,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e56bbf444fd34c348475c73673611447',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T00:03:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'size': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': 'bff0d8a1-739e-4c4d-9efa-b73ba7b76d01'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75165) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 00:26:33 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-59a55c97-3643-48dd-ba23-623ee857e7e1 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:26:33 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-59a55c97-3643-48dd-ba23-623ee857e7e1 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:26:33 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-59a55c97-3643-48dd-ba23-623ee857e7e1 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75165) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 00:26:33 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-59a55c97-3643-48dd-ba23-623ee857e7e1 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] CPU controller missing on host. {{(pid=75165) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 00:26:33 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-59a55c97-3643-48dd-ba23-623ee857e7e1 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75165) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 00:26:33 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-59a55c97-3643-48dd-ba23-623ee857e7e1 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] CPU controller found on host. {{(pid=75165) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 00:26:33 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-59a55c97-3643-48dd-ba23-623ee857e7e1 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75165) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 00:26:33 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-59a55c97-3643-48dd-ba23-623ee857e7e1 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T00:03:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T00:03:24Z,direct_url=<?>,disk_format='qcow2',id=bff0d8a1-739e-4c4d-9efa-b73ba7b76d01,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e56bbf444fd34c348475c73673611447',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T00:03:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 00:26:33 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-59a55c97-3643-48dd-ba23-623ee857e7e1 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Flavor limits 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 00:26:33 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-59a55c97-3643-48dd-ba23-623ee857e7e1 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Image limits 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 00:26:33 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-59a55c97-3643-48dd-ba23-623ee857e7e1 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Flavor pref 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 00:26:33 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-59a55c97-3643-48dd-ba23-623ee857e7e1 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Image pref 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 00:26:33 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-59a55c97-3643-48dd-ba23-623ee857e7e1 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 00:26:33 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-59a55c97-3643-48dd-ba23-623ee857e7e1 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 00:26:33 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-59a55c97-3643-48dd-ba23-623ee857e7e1 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75165) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 00:26:33 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-59a55c97-3643-48dd-ba23-623ee857e7e1 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Got 1 possible topologies {{(pid=75165) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 00:26:33 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-59a55c97-3643-48dd-ba23-623ee857e7e1 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 00:26:33 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-59a55c97-3643-48dd-ba23-623ee857e7e1 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 00:26:33 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-59a55c97-3643-48dd-ba23-623ee857e7e1 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:26:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1141467913',display_name='tempest-SnapshotDataIntegrityTests-server-1141467913',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1141467913',id=31,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI+vth0hk579pqQeeS/MKW3TKZMa4PnA2Of6MESYRXKuIbVYKn+mAkFyTNTrT5boIwixdOlrBzWNNZ0Q785iOnwKYc4gc8K1MskTqrgB8rSyYWLrcP1gI5xIT5S18XJYkg==',key_name='tempest-keypair-1679341335',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='567a90e8d8b24ca4b5e5da923d537134',ramdisk_id='',reservation_id='r-92wnx5jj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-2142389765',owner_user_name='tempest-SnapshotDataIntegrityTests-2142389765-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T00:26:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='45d43fd7499347cc88bee0319be12cde',uuid=fe2984ce-8958-4049-8af7-496b313b26c8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5995df96-1576-4616-8834-45073add32a2", "address": "fa:16:3e:ca:36:c4", "network": {"id": "7c8ed206-c41f-4c32-837b-b50fb4ee5479", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1704810529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "567a90e8d8b24ca4b5e5da923d537134", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5995df96-15", "ovs_interfaceid": "5995df96-1576-4616-8834-45073add32a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75165) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 00:26:33 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-59a55c97-3643-48dd-ba23-623ee857e7e1 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Converting VIF {"id": "5995df96-1576-4616-8834-45073add32a2", "address": "fa:16:3e:ca:36:c4", "network": {"id": "7c8ed206-c41f-4c32-837b-b50fb4ee5479", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1704810529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "567a90e8d8b24ca4b5e5da923d537134", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5995df96-15", "ovs_interfaceid": "5995df96-1576-4616-8834-45073add32a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:26:33 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-59a55c97-3643-48dd-ba23-623ee857e7e1 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:36:c4,bridge_name='br-int',has_traffic_filtering=True,id=5995df96-1576-4616-8834-45073add32a2,network=Network(7c8ed206-c41f-4c32-837b-b50fb4ee5479),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5995df96-15') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:26:33 user nova-compute[75165]: DEBUG nova.objects.instance [None req-59a55c97-3643-48dd-ba23-623ee857e7e1 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Lazy-loading 'pci_devices' on Instance uuid fe2984ce-8958-4049-8af7-496b313b26c8 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:26:33 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-59a55c97-3643-48dd-ba23-623ee857e7e1 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] [instance: fe2984ce-8958-4049-8af7-496b313b26c8] End _get_guest_xml xml=<domain type="kvm">
Oct 26 00:26:33 user nova-compute[75165]:   <uuid>fe2984ce-8958-4049-8af7-496b313b26c8</uuid>
Oct 26 00:26:33 user nova-compute[75165]:   <name>instance-0000001f</name>
Oct 26 00:26:33 user nova-compute[75165]:   <memory>524288</memory>
Oct 26 00:26:33 user nova-compute[75165]:   <vcpu>1</vcpu>
Oct 26 00:26:33 user nova-compute[75165]:   <metadata>
Oct 26 00:26:33 user nova-compute[75165]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 00:26:33 user nova-compute[75165]:       <nova:package version="0.0.0"/>
Oct 26 00:26:33 user nova-compute[75165]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1141467913</nova:name>
Oct 26 00:26:33 user nova-compute[75165]:       <nova:creationTime>2023-10-26 00:26:33</nova:creationTime>
Oct 26 00:26:33 user nova-compute[75165]:       <nova:flavor name="m1.tiny">
Oct 26 00:26:33 user nova-compute[75165]:         <nova:memory>512</nova:memory>
Oct 26 00:26:33 user nova-compute[75165]:         <nova:disk>1</nova:disk>
Oct 26 00:26:33 user nova-compute[75165]:         <nova:swap>0</nova:swap>
Oct 26 00:26:33 user nova-compute[75165]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 00:26:33 user nova-compute[75165]:         <nova:vcpus>1</nova:vcpus>
Oct 26 00:26:33 user nova-compute[75165]:       </nova:flavor>
Oct 26 00:26:33 user nova-compute[75165]:       <nova:owner>
Oct 26 00:26:33 user nova-compute[75165]:         <nova:user uuid="45d43fd7499347cc88bee0319be12cde">tempest-SnapshotDataIntegrityTests-2142389765-project-member</nova:user>
Oct 26 00:26:33 user nova-compute[75165]:         <nova:project uuid="567a90e8d8b24ca4b5e5da923d537134">tempest-SnapshotDataIntegrityTests-2142389765</nova:project>
Oct 26 00:26:33 user nova-compute[75165]:       </nova:owner>
Oct 26 00:26:33 user nova-compute[75165]:       <nova:root type="image" uuid="bff0d8a1-739e-4c4d-9efa-b73ba7b76d01"/>
Oct 26 00:26:33 user nova-compute[75165]:       <nova:ports>
Oct 26 00:26:33 user nova-compute[75165]:         <nova:port uuid="5995df96-1576-4616-8834-45073add32a2">
Oct 26 00:26:33 user nova-compute[75165]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 26 00:26:33 user nova-compute[75165]:         </nova:port>
Oct 26 00:26:33 user nova-compute[75165]:       </nova:ports>
Oct 26 00:26:33 user nova-compute[75165]:     </nova:instance>
Oct 26 00:26:33 user nova-compute[75165]:   </metadata>
Oct 26 00:26:33 user nova-compute[75165]:   <sysinfo type="smbios">
Oct 26 00:26:33 user nova-compute[75165]:     <system>
Oct 26 00:26:33 user nova-compute[75165]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 00:26:33 user nova-compute[75165]:       <entry name="product">OpenStack Nova</entry>
Oct 26 00:26:33 user nova-compute[75165]:       <entry name="version">0.0.0</entry>
Oct 26 00:26:33 user nova-compute[75165]:       <entry name="serial">fe2984ce-8958-4049-8af7-496b313b26c8</entry>
Oct 26 00:26:33 user nova-compute[75165]:       <entry name="uuid">fe2984ce-8958-4049-8af7-496b313b26c8</entry>
Oct 26 00:26:33 user nova-compute[75165]:       <entry name="family">Virtual Machine</entry>
Oct 26 00:26:33 user nova-compute[75165]:     </system>
Oct 26 00:26:33 user nova-compute[75165]:   </sysinfo>
Oct 26 00:26:33 user nova-compute[75165]:   <os>
Oct 26 00:26:33 user nova-compute[75165]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 00:26:33 user nova-compute[75165]:     <boot dev="hd"/>
Oct 26 00:26:33 user nova-compute[75165]:     <smbios mode="sysinfo"/>
Oct 26 00:26:33 user nova-compute[75165]:   </os>
Oct 26 00:26:33 user nova-compute[75165]:   <features>
Oct 26 00:26:33 user nova-compute[75165]:     <acpi/>
Oct 26 00:26:33 user nova-compute[75165]:     <apic/>
Oct 26 00:26:33 user nova-compute[75165]:     <vmcoreinfo/>
Oct 26 00:26:33 user nova-compute[75165]:   </features>
Oct 26 00:26:33 user nova-compute[75165]:   <clock offset="utc">
Oct 26 00:26:33 user nova-compute[75165]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 00:26:33 user nova-compute[75165]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 00:26:33 user nova-compute[75165]:     <timer name="hpet" present="no"/>
Oct 26 00:26:33 user nova-compute[75165]:   </clock>
Oct 26 00:26:33 user nova-compute[75165]:   <cpu mode="custom" match="exact">
Oct 26 00:26:33 user nova-compute[75165]:     <model>Nehalem</model>
Oct 26 00:26:33 user nova-compute[75165]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 00:26:33 user nova-compute[75165]:   </cpu>
Oct 26 00:26:33 user nova-compute[75165]:   <devices>
Oct 26 00:26:33 user nova-compute[75165]:     <disk type="file" device="disk">
Oct 26 00:26:33 user nova-compute[75165]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 00:26:33 user nova-compute[75165]:       <source file="/opt/stack/data/nova/instances/fe2984ce-8958-4049-8af7-496b313b26c8/disk"/>
Oct 26 00:26:33 user nova-compute[75165]:       <target dev="vda" bus="virtio"/>
Oct 26 00:26:33 user nova-compute[75165]:     </disk>
Oct 26 00:26:33 user nova-compute[75165]:     <interface type="ethernet">
Oct 26 00:26:33 user nova-compute[75165]:       <mac address="fa:16:3e:ca:36:c4"/>
Oct 26 00:26:33 user nova-compute[75165]:       <model type="virtio"/>
Oct 26 00:26:33 user nova-compute[75165]:       <mtu size="1442"/>
Oct 26 00:26:33 user nova-compute[75165]:       <target dev="tap5995df96-15"/>
Oct 26 00:26:33 user nova-compute[75165]:     </interface>
Oct 26 00:26:33 user nova-compute[75165]:     <serial type="pty">
Oct 26 00:26:33 user nova-compute[75165]:       <log file="/opt/stack/data/nova/instances/fe2984ce-8958-4049-8af7-496b313b26c8/console.log" append="off"/>
Oct 26 00:26:33 user nova-compute[75165]:     </serial>
Oct 26 00:26:33 user nova-compute[75165]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 00:26:33 user nova-compute[75165]:     <video>
Oct 26 00:26:33 user nova-compute[75165]:       <model type="virtio"/>
Oct 26 00:26:33 user nova-compute[75165]:     </video>
Oct 26 00:26:33 user nova-compute[75165]:     <rng model="virtio">
Oct 26 00:26:33 user nova-compute[75165]:       <backend model="random">/dev/urandom</backend>
Oct 26 00:26:33 user nova-compute[75165]:     </rng>
Oct 26 00:26:33 user nova-compute[75165]:     <controller type="usb" index="0" model="none"/>
Oct 26 00:26:33 user nova-compute[75165]:     <memballoon model="virtio">
Oct 26 00:26:33 user nova-compute[75165]:       <stats period="10"/>
Oct 26 00:26:33 user nova-compute[75165]:     </memballoon>
Oct 26 00:26:33 user nova-compute[75165]:   </devices>
Oct 26 00:26:33 user nova-compute[75165]: </domain>
Oct 26 00:26:33 user nova-compute[75165]:  {{(pid=75165) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 00:26:33 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-59a55c97-3643-48dd-ba23-623ee857e7e1 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:26:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1141467913',display_name='tempest-SnapshotDataIntegrityTests-server-1141467913',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1141467913',id=31,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI+vth0hk579pqQeeS/MKW3TKZMa4PnA2Of6MESYRXKuIbVYKn+mAkFyTNTrT5boIwixdOlrBzWNNZ0Q785iOnwKYc4gc8K1MskTqrgB8rSyYWLrcP1gI5xIT5S18XJYkg==',key_name='tempest-keypair-1679341335',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='567a90e8d8b24ca4b5e5da923d537134',ramdisk_id='',reservation_id='r-92wnx5jj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-2142389765',owner_user_name='tempest-SnapshotDataIntegrityTests-2142389765-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T00:26:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='45d43fd7499347cc88bee0319be12cde',uuid=fe2984ce-8958-4049-8af7-496b313b26c8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5995df96-1576-4616-8834-45073add32a2", "address": "fa:16:3e:ca:36:c4", "network": {"id": "7c8ed206-c41f-4c32-837b-b50fb4ee5479", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1704810529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "567a90e8d8b24ca4b5e5da923d537134", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5995df96-15", "ovs_interfaceid": "5995df96-1576-4616-8834-45073add32a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 00:26:33 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-59a55c97-3643-48dd-ba23-623ee857e7e1 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Converting VIF {"id": "5995df96-1576-4616-8834-45073add32a2", "address": "fa:16:3e:ca:36:c4", "network": {"id": "7c8ed206-c41f-4c32-837b-b50fb4ee5479", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1704810529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "567a90e8d8b24ca4b5e5da923d537134", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5995df96-15", "ovs_interfaceid": "5995df96-1576-4616-8834-45073add32a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:26:33 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-59a55c97-3643-48dd-ba23-623ee857e7e1 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:36:c4,bridge_name='br-int',has_traffic_filtering=True,id=5995df96-1576-4616-8834-45073add32a2,network=Network(7c8ed206-c41f-4c32-837b-b50fb4ee5479),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5995df96-15') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:26:33 user nova-compute[75165]: DEBUG os_vif [None req-59a55c97-3643-48dd-ba23-623ee857e7e1 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:36:c4,bridge_name='br-int',has_traffic_filtering=True,id=5995df96-1576-4616-8834-45073add32a2,network=Network(7c8ed206-c41f-4c32-837b-b50fb4ee5479),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5995df96-15') {{(pid=75165) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 00:26:33 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:26:33 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:26:33 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 00:26:33 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:26:33 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e02dcf58-1561-5e08-9e50-f05b51185560', '_type': 'linux-noop'}}, row=False) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:26:33 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:26:33 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:26:33 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:26:33 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:26:33 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5995df96-15, may_exist=True, interface_attrs={}) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:26:33 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5995df96-15, col_values=(('qos', UUID('8ca3ab80-c296-4487-8295-4e75786cf93b')),), if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:26:33 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5995df96-15, col_values=(('external_ids', {'iface-id': '5995df96-1576-4616-8834-45073add32a2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ca:36:c4', 'vm-uuid': 'fe2984ce-8958-4049-8af7-496b313b26c8'}),), if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:26:33 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:26:33 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:26:33 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:26:33 user nova-compute[75165]: INFO os_vif [None req-59a55c97-3643-48dd-ba23-623ee857e7e1 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:36:c4,bridge_name='br-int',has_traffic_filtering=True,id=5995df96-1576-4616-8834-45073add32a2,network=Network(7c8ed206-c41f-4c32-837b-b50fb4ee5479),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5995df96-15')
Oct 26 00:26:33 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-59a55c97-3643-48dd-ba23-623ee857e7e1 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] No BDM found with device name vda, not building metadata. {{(pid=75165) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 00:26:33 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-59a55c97-3643-48dd-ba23-623ee857e7e1 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] No VIF found with MAC fa:16:3e:ca:36:c4, not building metadata {{(pid=75165) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 00:26:33 user nova-compute[75165]: DEBUG nova.network.neutron [req-0bb7f5a0-8a18-4b12-a139-2f0323772c10 req-12c49805-d7e5-4d7a-a806-724ac1c209b9 service nova] [instance: fe2984ce-8958-4049-8af7-496b313b26c8] Updated VIF entry in instance network info cache for port 5995df96-1576-4616-8834-45073add32a2. {{(pid=75165) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 00:26:33 user nova-compute[75165]: DEBUG nova.network.neutron [req-0bb7f5a0-8a18-4b12-a139-2f0323772c10 req-12c49805-d7e5-4d7a-a806-724ac1c209b9 service nova] [instance: fe2984ce-8958-4049-8af7-496b313b26c8] Updating instance_info_cache with network_info: [{"id": "5995df96-1576-4616-8834-45073add32a2", "address": "fa:16:3e:ca:36:c4", "network": {"id": "7c8ed206-c41f-4c32-837b-b50fb4ee5479", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1704810529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "567a90e8d8b24ca4b5e5da923d537134", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5995df96-15", "ovs_interfaceid": "5995df96-1576-4616-8834-45073add32a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:26:33 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-0bb7f5a0-8a18-4b12-a139-2f0323772c10 req-12c49805-d7e5-4d7a-a806-724ac1c209b9 service nova] Releasing lock "refresh_cache-fe2984ce-8958-4049-8af7-496b313b26c8" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:26:33 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: bad6c21f-885f-4348-86f7-b237ce2d241b] Instance destroyed successfully.
Oct 26 00:26:33 user nova-compute[75165]: DEBUG nova.objects.instance [None req-7a6517e2-3229-4cf2-8db2-159ba2abb079 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Lazy-loading 'resources' on Instance uuid bad6c21f-885f-4348-86f7-b237ce2d241b {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:26:33 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-7a6517e2-3229-4cf2-8db2-159ba2abb079 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:19:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-71108019',display_name='tempest-ServerActionsTestOtherA-server-71108019',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-71108019',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOtsEaxSd5nKie4b+oTvKYqMVt06ToquYp528kCMFq0uGoZPhLpZteN38KkhJxhsHSzqyfMtJ24GLZPdcByyVczoa0tAnbSbuiNOiWj1Q2SiBRytz34zgMiDTwdnF2ayTw==',key_name='tempest-keypair-1300111',keypairs=<?>,launch_index=0,launched_at=2023-10-26T00:22:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2911497df44047d9a9ee36a5652298bc',ramdisk_id='',reservation_id='r-5k0e6xul',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1690932306',owner_user_name='tempest-ServerActionsTestOtherA-1690932306-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T00:23:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b3ce94f4c01446ebf79a1eba3833e01',uuid=bad6c21f-885f-4348-86f7-b237ce2d241b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b64d421a-ca91-4f21-80f7-17b0c17ceb8a", "address": "fa:16:3e:54:54:b8", "network": {"id": "bd1c84f9-bba9-4a23-8bf2-17e65022136a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1557945804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2911497df44047d9a9ee36a5652298bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb64d421a-ca", "ovs_interfaceid": "b64d421a-ca91-4f21-80f7-17b0c17ceb8a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 00:26:33 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-7a6517e2-3229-4cf2-8db2-159ba2abb079 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Converting VIF {"id": "b64d421a-ca91-4f21-80f7-17b0c17ceb8a", "address": "fa:16:3e:54:54:b8", "network": {"id": "bd1c84f9-bba9-4a23-8bf2-17e65022136a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1557945804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2911497df44047d9a9ee36a5652298bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb64d421a-ca", "ovs_interfaceid": "b64d421a-ca91-4f21-80f7-17b0c17ceb8a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:26:33 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-7a6517e2-3229-4cf2-8db2-159ba2abb079 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:54:54:b8,bridge_name='br-int',has_traffic_filtering=True,id=b64d421a-ca91-4f21-80f7-17b0c17ceb8a,network=Network(bd1c84f9-bba9-4a23-8bf2-17e65022136a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb64d421a-ca') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:26:33 user nova-compute[75165]: DEBUG os_vif [None req-7a6517e2-3229-4cf2-8db2-159ba2abb079 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:54:54:b8,bridge_name='br-int',has_traffic_filtering=True,id=b64d421a-ca91-4f21-80f7-17b0c17ceb8a,network=Network(bd1c84f9-bba9-4a23-8bf2-17e65022136a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb64d421a-ca') {{(pid=75165) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 00:26:33 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:26:33 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb64d421a-ca, bridge=br-int, if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:26:33 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:26:33 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:26:33 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:26:33 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:26:33 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d66c478e-8079-4de5-9c5c-0d05ae475e0e) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:26:33 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:26:33 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:26:33 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:26:33 user nova-compute[75165]: INFO os_vif [None req-7a6517e2-3229-4cf2-8db2-159ba2abb079 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:54:54:b8,bridge_name='br-int',has_traffic_filtering=True,id=b64d421a-ca91-4f21-80f7-17b0c17ceb8a,network=Network(bd1c84f9-bba9-4a23-8bf2-17e65022136a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb64d421a-ca')
Oct 26 00:26:33 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a6517e2-3229-4cf2-8db2-159ba2abb079 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: bad6c21f-885f-4348-86f7-b237ce2d241b] calling os-brick to detach iSCSI Volume {{(pid=75165) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 00:26:33 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a6517e2-3229-4cf2-8db2-159ba2abb079 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8bf8160e50>, {'target_iqn': 'iqn.2010-10.org.openstack:99a43689-b7cd-47e6-ae88-fd8ba07c60c1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RhTfzArp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:26:34 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-7a6517e2-3229-4cf2-8db2-159ba2abb079 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:26:34 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-7a6517e2-3229-4cf2-8db2-159ba2abb079 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:26:34 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-7a6517e2-3229-4cf2-8db2-159ba2abb079 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:26:34 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:26:34 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:26:34 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a267070-45a6-45f2-af38-a8b33d69f3cc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:99a43689-b7cd-47e6-ae88-fd8ba07c60c1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d8e60b0c-7a47-46fd-a330-5d78f73e659f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:26:34 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a6517e2-3229-4cf2-8db2-159ba2abb079 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 00:26:34 user nova-compute[75165]: No targets found.
Oct 26 00:26:34 user nova-compute[75165]: iSNS:
Oct 26 00:26:34 user nova-compute[75165]: No targets found.
Oct 26 00:26:34 user nova-compute[75165]: STATIC:
Oct 26 00:26:34 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:99a43689-b7cd-47e6-ae88-fd8ba07c60c1
Oct 26 00:26:34 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:26:34 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:26:34 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795
Oct 26 00:26:34 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:26:34 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:26:34 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:d8e60b0c-7a47-46fd-a330-5d78f73e659f
Oct 26 00:26:34 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:26:34 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:26:34 user nova-compute[75165]: FIRMWARE:
Oct 26 00:26:34 user nova-compute[75165]: No targets found.
Oct 26 00:26:34 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:26:34 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a6517e2-3229-4cf2-8db2-159ba2abb079 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 00:26:34 user nova-compute[75165]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 00:26:34 user nova-compute[75165]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75165) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 00:26:34 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a6517e2-3229-4cf2-8db2-159ba2abb079 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:99a43689-b7cd-47e6-ae88-fd8ba07c60c1', 0)] {{(pid=75165) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 00:26:34 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:26:34 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:26:34 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e5a3a0c-698f-4e27-8efa-6a309611e94f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:99a43689-b7cd-47e6-ae88-fd8ba07c60c1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d8e60b0c-7a47-46fd-a330-5d78f73e659f\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:26:34 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:26:34 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:26:34 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9f3733f-480d-4db5-afb6-a5159a4d387b]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a43689-b7cd-47e6-ae88-fd8ba07c60c1 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8e60b0c-7a47-46fd-a330-5d78f73e659f (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:26:34 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a6517e2-3229-4cf2-8db2-159ba2abb079 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)
Oct 26 00:26:34 user nova-compute[75165]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a43689-b7cd-47e6-ae88-fd8ba07c60c1 (non-flash)
Oct 26 00:26:34 user nova-compute[75165]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8e60b0c-7a47-46fd-a330-5d78f73e659f (non-flash)
Oct 26 00:26:34 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:26:34 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a6517e2-3229-4cf2-8db2-159ba2abb079 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)
Oct 26 00:26:34 user nova-compute[75165]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:99a43689-b7cd-47e6-ae88-fd8ba07c60c1 (non-flash)
Oct 26 00:26:34 user nova-compute[75165]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8e60b0c-7a47-46fd-a330-5d78f73e659f (non-flash)
Oct 26 00:26:34 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:26:34 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a6517e2-3229-4cf2-8db2-159ba2abb079 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8be04e6b00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:99a43689-b7cd-47e6-ae88-fd8ba07c60c1'): ({'sde'}, set())}) {{(pid=75165) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 00:26:34 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-7a6517e2-3229-4cf2-8db2-159ba2abb079 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Removing single pathed devices sde {{(pid=75165) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 00:26:34 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:26:34 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:26:34 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[e75443ca-86a0-437b-8ff2-0513431b6cb8]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:26:34 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:26:34 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:26:34 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[645998fa-4de6-4697-b8bc-caf091048653]: (4, ('ok\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:26:34 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-7a6517e2-3229-4cf2-8db2-159ba2abb079 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Flushing IO for device /dev/sde {{(pid=75165) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 00:26:34 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:26:34 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.017s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:26:34 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[caf7b132-72a4-403a-a863-a5d6283e9fac]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:26:34 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-7a6517e2-3229-4cf2-8db2-159ba2abb079 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75165) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 00:26:34 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:26:34 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.060s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:26:34 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a7ca9b9-428b-42e6-98dc-493f6ef67e0e]: (4, ('1', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:26:34 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-7a6517e2-3229-4cf2-8db2-159ba2abb079 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75165) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 00:26:34 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-7a6517e2-3229-4cf2-8db2-159ba2abb079 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] SCSI volumes sde have been removed. {{(pid=75165) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 00:26:34 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a6517e2-3229-4cf2-8db2-159ba2abb079 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:99a43689-b7cd-47e6-ae88-fd8ba07c60c1')] {{(pid=75165) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 00:26:34 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99a43689-b7cd-47e6-ae88-fd8ba07c60c1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:26:34 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99a43689-b7cd-47e6-ae88-fd8ba07c60c1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:26:34 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac4a745d-bbdf-4240-a98d-f8305e899f4c]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:26:34 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a6517e2-3229-4cf2-8db2-159ba2abb079 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:26:34 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99a43689-b7cd-47e6-ae88-fd8ba07c60c1 -p 172.16.0.220:3260 --logout {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:26:34 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99a43689-b7cd-47e6-ae88-fd8ba07c60c1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:26:34 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[99654701-efea-48fc-9233-ef618ff65b55]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:99a43689-b7cd-47e6-ae88-fd8ba07c60c1, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:99a43689-b7cd-47e6-ae88-fd8ba07c60c1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:26:34 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a6517e2-3229-4cf2-8db2-159ba2abb079 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:99a43689-b7cd-47e6-ae88-fd8ba07c60c1, portal: 172.16.0.220,3260]
Oct 26 00:26:34 user nova-compute[75165]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:99a43689-b7cd-47e6-ae88-fd8ba07c60c1, portal: 172.16.0.220,3260] successful.
Oct 26 00:26:34 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:26:34 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:99a43689-b7cd-47e6-ae88-fd8ba07c60c1 -p 172.16.0.220:3260 --op delete {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:26:34 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:99a43689-b7cd-47e6-ae88-fd8ba07c60c1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:26:34 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[75b5e5e9-ab17-4fdf-9e74-b97c0722146f]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:26:34 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a6517e2-3229-4cf2-8db2-159ba2abb079 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:26:34 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-7a6517e2-3229-4cf2-8db2-159ba2abb079 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.348s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:26:34 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a6517e2-3229-4cf2-8db2-159ba2abb079 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] <== disconnect_volume: return (351ms) None {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:26:34 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a6517e2-3229-4cf2-8db2-159ba2abb079 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: bad6c21f-885f-4348-86f7-b237ce2d241b] Disconnected iSCSI Volume {{(pid=75165) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 00:26:34 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-7a6517e2-3229-4cf2-8db2-159ba2abb079 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: bad6c21f-885f-4348-86f7-b237ce2d241b] Deleting instance files /opt/stack/data/nova/instances/bad6c21f-885f-4348-86f7-b237ce2d241b_del
Oct 26 00:26:34 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-7a6517e2-3229-4cf2-8db2-159ba2abb079 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: bad6c21f-885f-4348-86f7-b237ce2d241b] Deletion of /opt/stack/data/nova/instances/bad6c21f-885f-4348-86f7-b237ce2d241b_del complete
Oct 26 00:26:34 user nova-compute[75165]: INFO nova.compute.manager [None req-7a6517e2-3229-4cf2-8db2-159ba2abb079 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: bad6c21f-885f-4348-86f7-b237ce2d241b] Took 1.58 seconds to destroy the instance on the hypervisor.
Oct 26 00:26:34 user nova-compute[75165]: DEBUG oslo.service.loopingcall [None req-7a6517e2-3229-4cf2-8db2-159ba2abb079 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75165) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 00:26:34 user nova-compute[75165]: DEBUG nova.compute.manager [-] [instance: bad6c21f-885f-4348-86f7-b237ce2d241b] Deallocating network for instance {{(pid=75165) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 00:26:34 user nova-compute[75165]: DEBUG nova.network.neutron [-] [instance: bad6c21f-885f-4348-86f7-b237ce2d241b] deallocate_for_instance() {{(pid=75165) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 00:26:34 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:26:34 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:26:34 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:26:34 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:26:35 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-6ec15b8d-6154-4eeb-8fe1-ec0cf83f36d4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Acquiring lock "ce058b47-d96f-4341-9104-1fa71ca2c997" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:26:35 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-6ec15b8d-6154-4eeb-8fe1-ec0cf83f36d4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Lock "ce058b47-d96f-4341-9104-1fa71ca2c997" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.003s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:26:35 user nova-compute[75165]: DEBUG nova.objects.instance [None req-6ec15b8d-6154-4eeb-8fe1-ec0cf83f36d4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Lazy-loading 'flavor' on Instance uuid ce058b47-d96f-4341-9104-1fa71ca2c997 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:26:35 user nova-compute[75165]: DEBUG nova.network.neutron [-] [instance: bad6c21f-885f-4348-86f7-b237ce2d241b] Updating instance_info_cache with network_info: [] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:26:35 user nova-compute[75165]: INFO nova.compute.manager [-] [instance: bad6c21f-885f-4348-86f7-b237ce2d241b] Took 0.79 seconds to deallocate network for instance.
Oct 26 00:26:35 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-6ec15b8d-6154-4eeb-8fe1-ec0cf83f36d4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Lock "ce058b47-d96f-4341-9104-1fa71ca2c997" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.103s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:26:35 user nova-compute[75165]: DEBUG nova.compute.manager [req-dc4abf9a-8694-46d7-8949-c3342d6692d5 req-fe07c180-af01-47fc-bdfd-2baadd541eaa service nova] [instance: bad6c21f-885f-4348-86f7-b237ce2d241b] Received event network-vif-deleted-b64d421a-ca91-4f21-80f7-17b0c17ceb8a {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:26:35 user nova-compute[75165]: INFO nova.compute.manager [req-dc4abf9a-8694-46d7-8949-c3342d6692d5 req-fe07c180-af01-47fc-bdfd-2baadd541eaa service nova] [instance: bad6c21f-885f-4348-86f7-b237ce2d241b] Neutron deleted interface b64d421a-ca91-4f21-80f7-17b0c17ceb8a; detaching it from the instance and deleting it from the info cache
Oct 26 00:26:35 user nova-compute[75165]: DEBUG nova.network.neutron [req-dc4abf9a-8694-46d7-8949-c3342d6692d5 req-fe07c180-af01-47fc-bdfd-2baadd541eaa service nova] [instance: bad6c21f-885f-4348-86f7-b237ce2d241b] Updating instance_info_cache with network_info: [] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:26:35 user nova-compute[75165]: DEBUG nova.compute.manager [req-dc4abf9a-8694-46d7-8949-c3342d6692d5 req-fe07c180-af01-47fc-bdfd-2baadd541eaa service nova] [instance: bad6c21f-885f-4348-86f7-b237ce2d241b] Detach interface failed, port_id=b64d421a-ca91-4f21-80f7-17b0c17ceb8a, reason: Instance bad6c21f-885f-4348-86f7-b237ce2d241b could not be found. {{(pid=75165) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 26 00:26:35 user nova-compute[75165]: DEBUG nova.compute.manager [req-f71c3528-17e6-4b28-9fc9-89299ea79184 req-6ee19884-a575-4b2f-bbe1-68cf80c5ea09 service nova] [instance: bad6c21f-885f-4348-86f7-b237ce2d241b] Received event network-vif-plugged-b64d421a-ca91-4f21-80f7-17b0c17ceb8a {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:26:35 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-f71c3528-17e6-4b28-9fc9-89299ea79184 req-6ee19884-a575-4b2f-bbe1-68cf80c5ea09 service nova] Acquiring lock "bad6c21f-885f-4348-86f7-b237ce2d241b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:26:35 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-f71c3528-17e6-4b28-9fc9-89299ea79184 req-6ee19884-a575-4b2f-bbe1-68cf80c5ea09 service nova] Lock "bad6c21f-885f-4348-86f7-b237ce2d241b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:26:35 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-f71c3528-17e6-4b28-9fc9-89299ea79184 req-6ee19884-a575-4b2f-bbe1-68cf80c5ea09 service nova] Lock "bad6c21f-885f-4348-86f7-b237ce2d241b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:26:35 user nova-compute[75165]: DEBUG nova.compute.manager [req-f71c3528-17e6-4b28-9fc9-89299ea79184 req-6ee19884-a575-4b2f-bbe1-68cf80c5ea09 service nova] [instance: bad6c21f-885f-4348-86f7-b237ce2d241b] No waiting events found dispatching network-vif-plugged-b64d421a-ca91-4f21-80f7-17b0c17ceb8a {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:26:35 user nova-compute[75165]: WARNING nova.compute.manager [req-f71c3528-17e6-4b28-9fc9-89299ea79184 req-6ee19884-a575-4b2f-bbe1-68cf80c5ea09 service nova] [instance: bad6c21f-885f-4348-86f7-b237ce2d241b] Received unexpected event network-vif-plugged-b64d421a-ca91-4f21-80f7-17b0c17ceb8a for instance with vm_state active and task_state deleting.
Oct 26 00:26:35 user nova-compute[75165]: DEBUG nova.compute.manager [req-f71c3528-17e6-4b28-9fc9-89299ea79184 req-6ee19884-a575-4b2f-bbe1-68cf80c5ea09 service nova] [instance: fe2984ce-8958-4049-8af7-496b313b26c8] Received event network-vif-plugged-5995df96-1576-4616-8834-45073add32a2 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:26:35 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-f71c3528-17e6-4b28-9fc9-89299ea79184 req-6ee19884-a575-4b2f-bbe1-68cf80c5ea09 service nova] Acquiring lock "fe2984ce-8958-4049-8af7-496b313b26c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:26:35 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-f71c3528-17e6-4b28-9fc9-89299ea79184 req-6ee19884-a575-4b2f-bbe1-68cf80c5ea09 service nova] Lock "fe2984ce-8958-4049-8af7-496b313b26c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:26:35 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-f71c3528-17e6-4b28-9fc9-89299ea79184 req-6ee19884-a575-4b2f-bbe1-68cf80c5ea09 service nova] Lock "fe2984ce-8958-4049-8af7-496b313b26c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:26:35 user nova-compute[75165]: DEBUG nova.compute.manager [req-f71c3528-17e6-4b28-9fc9-89299ea79184 req-6ee19884-a575-4b2f-bbe1-68cf80c5ea09 service nova] [instance: fe2984ce-8958-4049-8af7-496b313b26c8] No waiting events found dispatching network-vif-plugged-5995df96-1576-4616-8834-45073add32a2 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:26:35 user nova-compute[75165]: WARNING nova.compute.manager [req-f71c3528-17e6-4b28-9fc9-89299ea79184 req-6ee19884-a575-4b2f-bbe1-68cf80c5ea09 service nova] [instance: fe2984ce-8958-4049-8af7-496b313b26c8] Received unexpected event network-vif-plugged-5995df96-1576-4616-8834-45073add32a2 for instance with vm_state building and task_state spawning.
Oct 26 00:26:35 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-6ec15b8d-6154-4eeb-8fe1-ec0cf83f36d4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Acquiring lock "ce058b47-d96f-4341-9104-1fa71ca2c997" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:26:35 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-6ec15b8d-6154-4eeb-8fe1-ec0cf83f36d4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Lock "ce058b47-d96f-4341-9104-1fa71ca2c997" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:26:35 user nova-compute[75165]: INFO nova.compute.manager [None req-6ec15b8d-6154-4eeb-8fe1-ec0cf83f36d4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] [instance: ce058b47-d96f-4341-9104-1fa71ca2c997] Attaching volume ff19ba88-2bf9-451f-afcc-e149c1578b95 to /dev/vdb
Oct 26 00:26:35 user nova-compute[75165]: DEBUG os_brick.utils [None req-6ec15b8d-6154-4eeb-8fe1-ec0cf83f36d4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:26:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:26:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:26:35 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[cda82dfc-dd61-4ed7-97f2-f06b05744612]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa94814ccb35\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:26:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:26:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:26:35 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[a13fbcaf-e846-494a-8672-7c083e91dd66]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:26:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:26:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:26:35 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6ef2c0c-b3b7-4045-93c6-e4d3c27b40c7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:26:35 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[83580ab2-4eb1-4a29-b771-3259511391ef]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:26:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-6ec15b8d-6154-4eeb-8fe1-ec0cf83f36d4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Running cmd (subprocess): nvme version {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:26:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-6ec15b8d-6154-4eeb-8fe1-ec0cf83f36d4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] 'nvme version' failed. Not Retrying. {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 00:26:35 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6ec15b8d-6154-4eeb-8fe1-ec0cf83f36d4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] nvme not present on system {{(pid=75165) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 00:26:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:26:35 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:26:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 00:26:35 user nova-compute[75165]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 00:26:35 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[b00bbdca-8740-4929-88b2-1b843480d15a]: (4, '') {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:26:35 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-6ec15b8d-6154-4eeb-8fe1-ec0cf83f36d4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75165) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 00:26:35 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-6ec15b8d-6154-4eeb-8fe1-ec0cf83f36d4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75165) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 00:26:35 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-6ec15b8d-6154-4eeb-8fe1-ec0cf83f36d4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] LIGHTOS: no hostnqn found. {{(pid=75165) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 00:26:35 user nova-compute[75165]: DEBUG os_brick.utils [None req-6ec15b8d-6154-4eeb-8fe1-ec0cf83f36d4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa94814ccb35', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:26:35 user nova-compute[75165]: DEBUG nova.virt.block_device [None req-6ec15b8d-6154-4eeb-8fe1-ec0cf83f36d4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] [instance: ce058b47-d96f-4341-9104-1fa71ca2c997] Updating existing volume attachment record: 1dee58b0-15ee-4184-a2be-94cebcc2884a {{(pid=75165) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 00:26:35 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:26:36 user nova-compute[75165]: INFO nova.compute.manager [None req-7a6517e2-3229-4cf2-8db2-159ba2abb079 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: bad6c21f-885f-4348-86f7-b237ce2d241b] Took 0.93 seconds to detach 1 volumes for instance.
Oct 26 00:26:36 user nova-compute[75165]: DEBUG nova.compute.manager [None req-7a6517e2-3229-4cf2-8db2-159ba2abb079 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: bad6c21f-885f-4348-86f7-b237ce2d241b] Deleting volume: 99a43689-b7cd-47e6-ae88-fd8ba07c60c1 {{(pid=75165) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 26 00:26:36 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-7a6517e2-3229-4cf2-8db2-159ba2abb079 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:26:36 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-7a6517e2-3229-4cf2-8db2-159ba2abb079 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:26:36 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:26:36 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-7a6517e2-3229-4cf2-8db2-159ba2abb079 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:26:36 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-7a6517e2-3229-4cf2-8db2-159ba2abb079 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:26:36 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-7a6517e2-3229-4cf2-8db2-159ba2abb079 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.317s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:26:36 user nova-compute[75165]: INFO nova.scheduler.client.report [None req-7a6517e2-3229-4cf2-8db2-159ba2abb079 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Deleted allocations for instance bad6c21f-885f-4348-86f7-b237ce2d241b
Oct 26 00:26:36 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-7a6517e2-3229-4cf2-8db2-159ba2abb079 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Lock "bad6c21f-885f-4348-86f7-b237ce2d241b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.926s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:26:37 user nova-compute[75165]: DEBUG nova.compute.manager [None req-59a55c97-3643-48dd-ba23-623ee857e7e1 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] [instance: fe2984ce-8958-4049-8af7-496b313b26c8] Instance event wait completed in 0 seconds for  {{(pid=75165) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 00:26:37 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-59a55c97-3643-48dd-ba23-623ee857e7e1 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] [instance: fe2984ce-8958-4049-8af7-496b313b26c8] Guest created on hypervisor {{(pid=75165) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 00:26:37 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: fe2984ce-8958-4049-8af7-496b313b26c8] Instance spawned successfully.
Oct 26 00:26:37 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-59a55c97-3643-48dd-ba23-623ee857e7e1 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] [instance: fe2984ce-8958-4049-8af7-496b313b26c8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 00:26:37 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-59a55c97-3643-48dd-ba23-623ee857e7e1 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] [instance: fe2984ce-8958-4049-8af7-496b313b26c8] Found default for hw_cdrom_bus of ide {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:26:37 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-59a55c97-3643-48dd-ba23-623ee857e7e1 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] [instance: fe2984ce-8958-4049-8af7-496b313b26c8] Found default for hw_disk_bus of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:26:37 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-59a55c97-3643-48dd-ba23-623ee857e7e1 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] [instance: fe2984ce-8958-4049-8af7-496b313b26c8] Found default for hw_input_bus of None {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:26:37 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-59a55c97-3643-48dd-ba23-623ee857e7e1 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] [instance: fe2984ce-8958-4049-8af7-496b313b26c8] Found default for hw_pointer_model of None {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:26:37 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-59a55c97-3643-48dd-ba23-623ee857e7e1 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] [instance: fe2984ce-8958-4049-8af7-496b313b26c8] Found default for hw_video_model of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:26:37 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-59a55c97-3643-48dd-ba23-623ee857e7e1 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] [instance: fe2984ce-8958-4049-8af7-496b313b26c8] Found default for hw_vif_model of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:26:37 user nova-compute[75165]: DEBUG nova.compute.manager [req-cdc7c097-835a-48b1-8013-35298e4b5600 req-921ef0d3-1a91-4f49-99d9-ac5890e08a95 service nova] [instance: fe2984ce-8958-4049-8af7-496b313b26c8] Received event network-vif-plugged-5995df96-1576-4616-8834-45073add32a2 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:26:37 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-cdc7c097-835a-48b1-8013-35298e4b5600 req-921ef0d3-1a91-4f49-99d9-ac5890e08a95 service nova] Acquiring lock "fe2984ce-8958-4049-8af7-496b313b26c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:26:37 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-cdc7c097-835a-48b1-8013-35298e4b5600 req-921ef0d3-1a91-4f49-99d9-ac5890e08a95 service nova] Lock "fe2984ce-8958-4049-8af7-496b313b26c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:26:37 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-cdc7c097-835a-48b1-8013-35298e4b5600 req-921ef0d3-1a91-4f49-99d9-ac5890e08a95 service nova] Lock "fe2984ce-8958-4049-8af7-496b313b26c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:26:37 user nova-compute[75165]: DEBUG nova.compute.manager [req-cdc7c097-835a-48b1-8013-35298e4b5600 req-921ef0d3-1a91-4f49-99d9-ac5890e08a95 service nova] [instance: fe2984ce-8958-4049-8af7-496b313b26c8] No waiting events found dispatching network-vif-plugged-5995df96-1576-4616-8834-45073add32a2 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:26:37 user nova-compute[75165]: WARNING nova.compute.manager [req-cdc7c097-835a-48b1-8013-35298e4b5600 req-921ef0d3-1a91-4f49-99d9-ac5890e08a95 service nova] [instance: fe2984ce-8958-4049-8af7-496b313b26c8] Received unexpected event network-vif-plugged-5995df96-1576-4616-8834-45073add32a2 for instance with vm_state building and task_state spawning.
Oct 26 00:26:37 user nova-compute[75165]: INFO nova.compute.manager [None req-59a55c97-3643-48dd-ba23-623ee857e7e1 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] [instance: fe2984ce-8958-4049-8af7-496b313b26c8] Took 6.06 seconds to spawn the instance on the hypervisor.
Oct 26 00:26:37 user nova-compute[75165]: DEBUG nova.compute.manager [None req-59a55c97-3643-48dd-ba23-623ee857e7e1 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] [instance: fe2984ce-8958-4049-8af7-496b313b26c8] Checking state {{(pid=75165) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 00:26:37 user nova-compute[75165]: INFO nova.compute.manager [None req-59a55c97-3643-48dd-ba23-623ee857e7e1 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] [instance: fe2984ce-8958-4049-8af7-496b313b26c8] Took 6.89 seconds to build instance.
Oct 26 00:26:37 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-59a55c97-3643-48dd-ba23-623ee857e7e1 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Lock "fe2984ce-8958-4049-8af7-496b313b26c8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.008s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:26:38 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:26:41 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:26:43 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:26:44 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-39ba501f-b45a-4394-857f-bc2544260008 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Acquiring lock "b3c87b07-5c16-4f45-b320-06d3503d23e6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:26:44 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-39ba501f-b45a-4394-857f-bc2544260008 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Lock "b3c87b07-5c16-4f45-b320-06d3503d23e6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:26:44 user nova-compute[75165]: DEBUG nova.compute.manager [None req-39ba501f-b45a-4394-857f-bc2544260008 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: b3c87b07-5c16-4f45-b320-06d3503d23e6] Starting instance... {{(pid=75165) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 00:26:44 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-39ba501f-b45a-4394-857f-bc2544260008 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:26:44 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-39ba501f-b45a-4394-857f-bc2544260008 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:26:44 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-39ba501f-b45a-4394-857f-bc2544260008 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75165) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 00:26:44 user nova-compute[75165]: INFO nova.compute.claims [None req-39ba501f-b45a-4394-857f-bc2544260008 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: b3c87b07-5c16-4f45-b320-06d3503d23e6] Claim successful on node user
Oct 26 00:26:45 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-39ba501f-b45a-4394-857f-bc2544260008 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:26:45 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-39ba501f-b45a-4394-857f-bc2544260008 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:26:45 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-39ba501f-b45a-4394-857f-bc2544260008 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.418s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:26:45 user nova-compute[75165]: DEBUG nova.compute.manager [None req-39ba501f-b45a-4394-857f-bc2544260008 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: b3c87b07-5c16-4f45-b320-06d3503d23e6] Start building networks asynchronously for instance. {{(pid=75165) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 00:26:45 user nova-compute[75165]: DEBUG nova.compute.manager [None req-39ba501f-b45a-4394-857f-bc2544260008 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: b3c87b07-5c16-4f45-b320-06d3503d23e6] Allocating IP information in the background. {{(pid=75165) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 00:26:45 user nova-compute[75165]: DEBUG nova.network.neutron [None req-39ba501f-b45a-4394-857f-bc2544260008 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: b3c87b07-5c16-4f45-b320-06d3503d23e6] allocate_for_instance() {{(pid=75165) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 00:26:45 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-39ba501f-b45a-4394-857f-bc2544260008 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: b3c87b07-5c16-4f45-b320-06d3503d23e6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 00:26:45 user nova-compute[75165]: DEBUG nova.compute.manager [None req-39ba501f-b45a-4394-857f-bc2544260008 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: b3c87b07-5c16-4f45-b320-06d3503d23e6] Start building block device mappings for instance. {{(pid=75165) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 00:26:45 user nova-compute[75165]: DEBUG nova.policy [None req-39ba501f-b45a-4394-857f-bc2544260008 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'dbe0d52293264f33ae86de41dabeefcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd616862c7c184de5b0ba3121552c5666', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75165) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 00:26:45 user nova-compute[75165]: DEBUG nova.compute.manager [None req-39ba501f-b45a-4394-857f-bc2544260008 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: b3c87b07-5c16-4f45-b320-06d3503d23e6] Start spawning the instance on the hypervisor. {{(pid=75165) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 00:26:45 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-39ba501f-b45a-4394-857f-bc2544260008 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: b3c87b07-5c16-4f45-b320-06d3503d23e6] Creating instance directory {{(pid=75165) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 00:26:45 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-39ba501f-b45a-4394-857f-bc2544260008 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: b3c87b07-5c16-4f45-b320-06d3503d23e6] Creating image(s)
Oct 26 00:26:45 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-39ba501f-b45a-4394-857f-bc2544260008 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Acquiring lock "/opt/stack/data/nova/instances/b3c87b07-5c16-4f45-b320-06d3503d23e6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:26:45 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-39ba501f-b45a-4394-857f-bc2544260008 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Lock "/opt/stack/data/nova/instances/b3c87b07-5c16-4f45-b320-06d3503d23e6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:26:45 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-39ba501f-b45a-4394-857f-bc2544260008 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Lock "/opt/stack/data/nova/instances/b3c87b07-5c16-4f45-b320-06d3503d23e6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:26:45 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-39ba501f-b45a-4394-857f-bc2544260008 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:26:46 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-39ba501f-b45a-4394-857f-bc2544260008 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json" returned: 0 in 0.358s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:26:46 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-39ba501f-b45a-4394-857f-bc2544260008 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Acquiring lock "7d3243421cf3fdc288b758f687a93103b7b95466" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:26:46 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-39ba501f-b45a-4394-857f-bc2544260008 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Lock "7d3243421cf3fdc288b758f687a93103b7b95466" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:26:46 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-39ba501f-b45a-4394-857f-bc2544260008 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:26:46 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:26:46 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-39ba501f-b45a-4394-857f-bc2544260008 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json" returned: 0 in 0.248s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:26:46 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-39ba501f-b45a-4394-857f-bc2544260008 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466,backing_fmt=raw /opt/stack/data/nova/instances/b3c87b07-5c16-4f45-b320-06d3503d23e6/disk 1073741824 {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:26:46 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-39ba501f-b45a-4394-857f-bc2544260008 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466,backing_fmt=raw /opt/stack/data/nova/instances/b3c87b07-5c16-4f45-b320-06d3503d23e6/disk 1073741824" returned: 0 in 0.073s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:26:46 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-39ba501f-b45a-4394-857f-bc2544260008 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Lock "7d3243421cf3fdc288b758f687a93103b7b95466" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.328s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:26:46 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-39ba501f-b45a-4394-857f-bc2544260008 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:26:46 user nova-compute[75165]: DEBUG nova.network.neutron [None req-39ba501f-b45a-4394-857f-bc2544260008 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: b3c87b07-5c16-4f45-b320-06d3503d23e6] Successfully created port: eec50cb9-592b-4b34-ac42-37a92ebb2a27 {{(pid=75165) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 00:26:46 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-39ba501f-b45a-4394-857f-bc2544260008 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json" returned: 0 in 0.267s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:26:46 user nova-compute[75165]: DEBUG nova.virt.disk.api [None req-39ba501f-b45a-4394-857f-bc2544260008 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b3c87b07-5c16-4f45-b320-06d3503d23e6/disk. size=1073741824 {{(pid=75165) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 00:26:46 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-39ba501f-b45a-4394-857f-bc2544260008 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3c87b07-5c16-4f45-b320-06d3503d23e6/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:26:46 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-39ba501f-b45a-4394-857f-bc2544260008 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3c87b07-5c16-4f45-b320-06d3503d23e6/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:26:46 user nova-compute[75165]: DEBUG nova.virt.disk.api [None req-39ba501f-b45a-4394-857f-bc2544260008 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Cannot resize image /opt/stack/data/nova/instances/b3c87b07-5c16-4f45-b320-06d3503d23e6/disk to a smaller size. {{(pid=75165) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 00:26:46 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-39ba501f-b45a-4394-857f-bc2544260008 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: b3c87b07-5c16-4f45-b320-06d3503d23e6] Created local disks {{(pid=75165) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 00:26:46 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-39ba501f-b45a-4394-857f-bc2544260008 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: b3c87b07-5c16-4f45-b320-06d3503d23e6] Ensure instance console log exists: /opt/stack/data/nova/instances/b3c87b07-5c16-4f45-b320-06d3503d23e6/console.log {{(pid=75165) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 00:26:46 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-39ba501f-b45a-4394-857f-bc2544260008 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:26:46 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-39ba501f-b45a-4394-857f-bc2544260008 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:26:46 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-39ba501f-b45a-4394-857f-bc2544260008 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:26:47 user nova-compute[75165]: DEBUG nova.network.neutron [None req-39ba501f-b45a-4394-857f-bc2544260008 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: b3c87b07-5c16-4f45-b320-06d3503d23e6] Successfully updated port: eec50cb9-592b-4b34-ac42-37a92ebb2a27 {{(pid=75165) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 00:26:47 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-39ba501f-b45a-4394-857f-bc2544260008 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Acquiring lock "refresh_cache-b3c87b07-5c16-4f45-b320-06d3503d23e6" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:26:47 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-39ba501f-b45a-4394-857f-bc2544260008 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Acquired lock "refresh_cache-b3c87b07-5c16-4f45-b320-06d3503d23e6" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:26:47 user nova-compute[75165]: DEBUG nova.network.neutron [None req-39ba501f-b45a-4394-857f-bc2544260008 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: b3c87b07-5c16-4f45-b320-06d3503d23e6] Building network info cache for instance {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 00:26:47 user nova-compute[75165]: DEBUG nova.compute.manager [req-8bbf3da7-cb8d-4600-89e7-a2437be707c4 req-a648c9ba-0357-4e7e-9280-4e90947e7858 service nova] [instance: b3c87b07-5c16-4f45-b320-06d3503d23e6] Received event network-changed-eec50cb9-592b-4b34-ac42-37a92ebb2a27 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:26:47 user nova-compute[75165]: DEBUG nova.compute.manager [req-8bbf3da7-cb8d-4600-89e7-a2437be707c4 req-a648c9ba-0357-4e7e-9280-4e90947e7858 service nova] [instance: b3c87b07-5c16-4f45-b320-06d3503d23e6] Refreshing instance network info cache due to event network-changed-eec50cb9-592b-4b34-ac42-37a92ebb2a27. {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 00:26:47 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-8bbf3da7-cb8d-4600-89e7-a2437be707c4 req-a648c9ba-0357-4e7e-9280-4e90947e7858 service nova] Acquiring lock "refresh_cache-b3c87b07-5c16-4f45-b320-06d3503d23e6" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:26:47 user nova-compute[75165]: DEBUG nova.network.neutron [None req-39ba501f-b45a-4394-857f-bc2544260008 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: b3c87b07-5c16-4f45-b320-06d3503d23e6] Instance cache missing network info. {{(pid=75165) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 00:26:47 user nova-compute[75165]: DEBUG nova.network.neutron [None req-39ba501f-b45a-4394-857f-bc2544260008 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: b3c87b07-5c16-4f45-b320-06d3503d23e6] Updating instance_info_cache with network_info: [{"id": "eec50cb9-592b-4b34-ac42-37a92ebb2a27", "address": "fa:16:3e:dc:68:1d", "network": {"id": "eb55c0bc-cae5-4ba3-851a-e31a50b52c88", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1081223830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d616862c7c184de5b0ba3121552c5666", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeec50cb9-59", "ovs_interfaceid": "eec50cb9-592b-4b34-ac42-37a92ebb2a27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:26:47 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-39ba501f-b45a-4394-857f-bc2544260008 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Releasing lock "refresh_cache-b3c87b07-5c16-4f45-b320-06d3503d23e6" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:26:47 user nova-compute[75165]: DEBUG nova.compute.manager [None req-39ba501f-b45a-4394-857f-bc2544260008 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: b3c87b07-5c16-4f45-b320-06d3503d23e6] Instance network_info: |[{"id": "eec50cb9-592b-4b34-ac42-37a92ebb2a27", "address": "fa:16:3e:dc:68:1d", "network": {"id": "eb55c0bc-cae5-4ba3-851a-e31a50b52c88", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1081223830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d616862c7c184de5b0ba3121552c5666", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeec50cb9-59", "ovs_interfaceid": "eec50cb9-592b-4b34-ac42-37a92ebb2a27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75165) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 00:26:47 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-8bbf3da7-cb8d-4600-89e7-a2437be707c4 req-a648c9ba-0357-4e7e-9280-4e90947e7858 service nova] Acquired lock "refresh_cache-b3c87b07-5c16-4f45-b320-06d3503d23e6" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:26:47 user nova-compute[75165]: DEBUG nova.network.neutron [req-8bbf3da7-cb8d-4600-89e7-a2437be707c4 req-a648c9ba-0357-4e7e-9280-4e90947e7858 service nova] [instance: b3c87b07-5c16-4f45-b320-06d3503d23e6] Refreshing network info cache for port eec50cb9-592b-4b34-ac42-37a92ebb2a27 {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 00:26:47 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-39ba501f-b45a-4394-857f-bc2544260008 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: b3c87b07-5c16-4f45-b320-06d3503d23e6] Start _get_guest_xml network_info=[{"id": "eec50cb9-592b-4b34-ac42-37a92ebb2a27", "address": "fa:16:3e:dc:68:1d", "network": {"id": "eb55c0bc-cae5-4ba3-851a-e31a50b52c88", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1081223830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d616862c7c184de5b0ba3121552c5666", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeec50cb9-59", "ovs_interfaceid": "eec50cb9-592b-4b34-ac42-37a92ebb2a27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T00:03:24Z,direct_url=<?>,disk_format='qcow2',id=bff0d8a1-739e-4c4d-9efa-b73ba7b76d01,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e56bbf444fd34c348475c73673611447',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T00:03:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'size': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': 'bff0d8a1-739e-4c4d-9efa-b73ba7b76d01'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75165) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 00:26:47 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-39ba501f-b45a-4394-857f-bc2544260008 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:26:47 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-39ba501f-b45a-4394-857f-bc2544260008 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:26:47 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-39ba501f-b45a-4394-857f-bc2544260008 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75165) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 00:26:47 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-39ba501f-b45a-4394-857f-bc2544260008 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] CPU controller missing on host. {{(pid=75165) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 00:26:47 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-39ba501f-b45a-4394-857f-bc2544260008 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75165) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 00:26:47 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-39ba501f-b45a-4394-857f-bc2544260008 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] CPU controller found on host. {{(pid=75165) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 00:26:47 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-39ba501f-b45a-4394-857f-bc2544260008 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75165) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 00:26:47 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-39ba501f-b45a-4394-857f-bc2544260008 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T00:03:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T00:03:24Z,direct_url=<?>,disk_format='qcow2',id=bff0d8a1-739e-4c4d-9efa-b73ba7b76d01,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e56bbf444fd34c348475c73673611447',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T00:03:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 00:26:47 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-39ba501f-b45a-4394-857f-bc2544260008 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Flavor limits 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 00:26:47 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-39ba501f-b45a-4394-857f-bc2544260008 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Image limits 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 00:26:47 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-39ba501f-b45a-4394-857f-bc2544260008 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Flavor pref 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 00:26:47 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-39ba501f-b45a-4394-857f-bc2544260008 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Image pref 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 00:26:47 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-39ba501f-b45a-4394-857f-bc2544260008 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 00:26:47 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-39ba501f-b45a-4394-857f-bc2544260008 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 00:26:47 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-39ba501f-b45a-4394-857f-bc2544260008 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75165) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 00:26:47 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-39ba501f-b45a-4394-857f-bc2544260008 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Got 1 possible topologies {{(pid=75165) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 00:26:47 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-39ba501f-b45a-4394-857f-bc2544260008 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 00:26:47 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-39ba501f-b45a-4394-857f-bc2544260008 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 00:26:47 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-39ba501f-b45a-4394-857f-bc2544260008 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:26:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1470044363',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1470044363',id=32,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d616862c7c184de5b0ba3121552c5666',ramdisk_id='',reservation_id='r-gx2s4vm9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-638746030',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T00:26:46Z,user_data=None,user_id='dbe0d52293264f33ae86de41dabeefcf',uuid=b3c87b07-5c16-4f45-b320-06d3503d23e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eec50cb9-592b-4b34-ac42-37a92ebb2a27", "address": "fa:16:3e:dc:68:1d", "network": {"id": "eb55c0bc-cae5-4ba3-851a-e31a50b52c88", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1081223830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d616862c7c184de5b0ba3121552c5666", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeec50cb9-59", "ovs_interfaceid": "eec50cb9-592b-4b34-ac42-37a92ebb2a27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75165) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 00:26:47 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-39ba501f-b45a-4394-857f-bc2544260008 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Converting VIF {"id": "eec50cb9-592b-4b34-ac42-37a92ebb2a27", "address": "fa:16:3e:dc:68:1d", "network": {"id": "eb55c0bc-cae5-4ba3-851a-e31a50b52c88", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1081223830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d616862c7c184de5b0ba3121552c5666", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeec50cb9-59", "ovs_interfaceid": "eec50cb9-592b-4b34-ac42-37a92ebb2a27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:26:47 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-39ba501f-b45a-4394-857f-bc2544260008 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:68:1d,bridge_name='br-int',has_traffic_filtering=True,id=eec50cb9-592b-4b34-ac42-37a92ebb2a27,network=Network(eb55c0bc-cae5-4ba3-851a-e31a50b52c88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeec50cb9-59') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:26:47 user nova-compute[75165]: DEBUG nova.objects.instance [None req-39ba501f-b45a-4394-857f-bc2544260008 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Lazy-loading 'pci_devices' on Instance uuid b3c87b07-5c16-4f45-b320-06d3503d23e6 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:26:48 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-39ba501f-b45a-4394-857f-bc2544260008 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: b3c87b07-5c16-4f45-b320-06d3503d23e6] End _get_guest_xml xml=<domain type="kvm">
Oct 26 00:26:48 user nova-compute[75165]:   <uuid>b3c87b07-5c16-4f45-b320-06d3503d23e6</uuid>
Oct 26 00:26:48 user nova-compute[75165]:   <name>instance-00000020</name>
Oct 26 00:26:48 user nova-compute[75165]:   <memory>524288</memory>
Oct 26 00:26:48 user nova-compute[75165]:   <vcpu>1</vcpu>
Oct 26 00:26:48 user nova-compute[75165]:   <metadata>
Oct 26 00:26:48 user nova-compute[75165]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 00:26:48 user nova-compute[75165]:       <nova:package version="0.0.0"/>
Oct 26 00:26:48 user nova-compute[75165]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1470044363</nova:name>
Oct 26 00:26:48 user nova-compute[75165]:       <nova:creationTime>2023-10-26 00:26:47</nova:creationTime>
Oct 26 00:26:48 user nova-compute[75165]:       <nova:flavor name="m1.tiny">
Oct 26 00:26:48 user nova-compute[75165]:         <nova:memory>512</nova:memory>
Oct 26 00:26:48 user nova-compute[75165]:         <nova:disk>1</nova:disk>
Oct 26 00:26:48 user nova-compute[75165]:         <nova:swap>0</nova:swap>
Oct 26 00:26:48 user nova-compute[75165]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 00:26:48 user nova-compute[75165]:         <nova:vcpus>1</nova:vcpus>
Oct 26 00:26:48 user nova-compute[75165]:       </nova:flavor>
Oct 26 00:26:48 user nova-compute[75165]:       <nova:owner>
Oct 26 00:26:48 user nova-compute[75165]:         <nova:user uuid="dbe0d52293264f33ae86de41dabeefcf">tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member</nova:user>
Oct 26 00:26:48 user nova-compute[75165]:         <nova:project uuid="d616862c7c184de5b0ba3121552c5666">tempest-ServerBootFromVolumeStableRescueTest-638746030</nova:project>
Oct 26 00:26:48 user nova-compute[75165]:       </nova:owner>
Oct 26 00:26:48 user nova-compute[75165]:       <nova:root type="image" uuid="bff0d8a1-739e-4c4d-9efa-b73ba7b76d01"/>
Oct 26 00:26:48 user nova-compute[75165]:       <nova:ports>
Oct 26 00:26:48 user nova-compute[75165]:         <nova:port uuid="eec50cb9-592b-4b34-ac42-37a92ebb2a27">
Oct 26 00:26:48 user nova-compute[75165]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 26 00:26:48 user nova-compute[75165]:         </nova:port>
Oct 26 00:26:48 user nova-compute[75165]:       </nova:ports>
Oct 26 00:26:48 user nova-compute[75165]:     </nova:instance>
Oct 26 00:26:48 user nova-compute[75165]:   </metadata>
Oct 26 00:26:48 user nova-compute[75165]:   <sysinfo type="smbios">
Oct 26 00:26:48 user nova-compute[75165]:     <system>
Oct 26 00:26:48 user nova-compute[75165]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 00:26:48 user nova-compute[75165]:       <entry name="product">OpenStack Nova</entry>
Oct 26 00:26:48 user nova-compute[75165]:       <entry name="version">0.0.0</entry>
Oct 26 00:26:48 user nova-compute[75165]:       <entry name="serial">b3c87b07-5c16-4f45-b320-06d3503d23e6</entry>
Oct 26 00:26:48 user nova-compute[75165]:       <entry name="uuid">b3c87b07-5c16-4f45-b320-06d3503d23e6</entry>
Oct 26 00:26:48 user nova-compute[75165]:       <entry name="family">Virtual Machine</entry>
Oct 26 00:26:48 user nova-compute[75165]:     </system>
Oct 26 00:26:48 user nova-compute[75165]:   </sysinfo>
Oct 26 00:26:48 user nova-compute[75165]:   <os>
Oct 26 00:26:48 user nova-compute[75165]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 00:26:48 user nova-compute[75165]:     <boot dev="hd"/>
Oct 26 00:26:48 user nova-compute[75165]:     <smbios mode="sysinfo"/>
Oct 26 00:26:48 user nova-compute[75165]:   </os>
Oct 26 00:26:48 user nova-compute[75165]:   <features>
Oct 26 00:26:48 user nova-compute[75165]:     <acpi/>
Oct 26 00:26:48 user nova-compute[75165]:     <apic/>
Oct 26 00:26:48 user nova-compute[75165]:     <vmcoreinfo/>
Oct 26 00:26:48 user nova-compute[75165]:   </features>
Oct 26 00:26:48 user nova-compute[75165]:   <clock offset="utc">
Oct 26 00:26:48 user nova-compute[75165]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 00:26:48 user nova-compute[75165]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 00:26:48 user nova-compute[75165]:     <timer name="hpet" present="no"/>
Oct 26 00:26:48 user nova-compute[75165]:   </clock>
Oct 26 00:26:48 user nova-compute[75165]:   <cpu mode="custom" match="exact">
Oct 26 00:26:48 user nova-compute[75165]:     <model>Nehalem</model>
Oct 26 00:26:48 user nova-compute[75165]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 00:26:48 user nova-compute[75165]:   </cpu>
Oct 26 00:26:48 user nova-compute[75165]:   <devices>
Oct 26 00:26:48 user nova-compute[75165]:     <disk type="file" device="disk">
Oct 26 00:26:48 user nova-compute[75165]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 00:26:48 user nova-compute[75165]:       <source file="/opt/stack/data/nova/instances/b3c87b07-5c16-4f45-b320-06d3503d23e6/disk"/>
Oct 26 00:26:48 user nova-compute[75165]:       <target dev="vda" bus="virtio"/>
Oct 26 00:26:48 user nova-compute[75165]:     </disk>
Oct 26 00:26:48 user nova-compute[75165]:     <interface type="ethernet">
Oct 26 00:26:48 user nova-compute[75165]:       <mac address="fa:16:3e:dc:68:1d"/>
Oct 26 00:26:48 user nova-compute[75165]:       <model type="virtio"/>
Oct 26 00:26:48 user nova-compute[75165]:       <mtu size="1442"/>
Oct 26 00:26:48 user nova-compute[75165]:       <target dev="tapeec50cb9-59"/>
Oct 26 00:26:48 user nova-compute[75165]:     </interface>
Oct 26 00:26:48 user nova-compute[75165]:     <serial type="pty">
Oct 26 00:26:48 user nova-compute[75165]:       <log file="/opt/stack/data/nova/instances/b3c87b07-5c16-4f45-b320-06d3503d23e6/console.log" append="off"/>
Oct 26 00:26:48 user nova-compute[75165]:     </serial>
Oct 26 00:26:48 user nova-compute[75165]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 00:26:48 user nova-compute[75165]:     <video>
Oct 26 00:26:48 user nova-compute[75165]:       <model type="virtio"/>
Oct 26 00:26:48 user nova-compute[75165]:     </video>
Oct 26 00:26:48 user nova-compute[75165]:     <rng model="virtio">
Oct 26 00:26:48 user nova-compute[75165]:       <backend model="random">/dev/urandom</backend>
Oct 26 00:26:48 user nova-compute[75165]:     </rng>
Oct 26 00:26:48 user nova-compute[75165]:     <controller type="usb" index="0" model="none"/>
Oct 26 00:26:48 user nova-compute[75165]:     <memballoon model="virtio">
Oct 26 00:26:48 user nova-compute[75165]:       <stats period="10"/>
Oct 26 00:26:48 user nova-compute[75165]:     </memballoon>
Oct 26 00:26:48 user nova-compute[75165]:   </devices>
Oct 26 00:26:48 user nova-compute[75165]: </domain>
Oct 26 00:26:48 user nova-compute[75165]:  {{(pid=75165) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 00:26:48 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-39ba501f-b45a-4394-857f-bc2544260008 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:26:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1470044363',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1470044363',id=32,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d616862c7c184de5b0ba3121552c5666',ramdisk_id='',reservation_id='r-gx2s4vm9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-638746030',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T00:26:46Z,user_data=None,user_id='dbe0d52293264f33ae86de41dabeefcf',uuid=b3c87b07-5c16-4f45-b320-06d3503d23e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eec50cb9-592b-4b34-ac42-37a92ebb2a27", "address": "fa:16:3e:dc:68:1d", "network": {"id": "eb55c0bc-cae5-4ba3-851a-e31a50b52c88", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1081223830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d616862c7c184de5b0ba3121552c5666", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeec50cb9-59", "ovs_interfaceid": "eec50cb9-592b-4b34-ac42-37a92ebb2a27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 00:26:48 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-39ba501f-b45a-4394-857f-bc2544260008 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Converting VIF {"id": "eec50cb9-592b-4b34-ac42-37a92ebb2a27", "address": "fa:16:3e:dc:68:1d", "network": {"id": "eb55c0bc-cae5-4ba3-851a-e31a50b52c88", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1081223830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d616862c7c184de5b0ba3121552c5666", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeec50cb9-59", "ovs_interfaceid": "eec50cb9-592b-4b34-ac42-37a92ebb2a27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:26:48 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-39ba501f-b45a-4394-857f-bc2544260008 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:68:1d,bridge_name='br-int',has_traffic_filtering=True,id=eec50cb9-592b-4b34-ac42-37a92ebb2a27,network=Network(eb55c0bc-cae5-4ba3-851a-e31a50b52c88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeec50cb9-59') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:26:48 user nova-compute[75165]: DEBUG os_vif [None req-39ba501f-b45a-4394-857f-bc2544260008 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:68:1d,bridge_name='br-int',has_traffic_filtering=True,id=eec50cb9-592b-4b34-ac42-37a92ebb2a27,network=Network(eb55c0bc-cae5-4ba3-851a-e31a50b52c88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeec50cb9-59') {{(pid=75165) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 00:26:48 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:26:48 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:26:48 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 00:26:48 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:26:48 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '64d3863d-64e1-599d-87e7-847f2742498e', '_type': 'linux-noop'}}, row=False) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:26:48 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:26:48 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:26:48 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:26:48 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeec50cb9-59, may_exist=True, interface_attrs={}) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:26:48 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapeec50cb9-59, col_values=(('qos', UUID('d43707d1-3489-4c64-a515-4cd30be39fce')),), if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:26:48 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapeec50cb9-59, col_values=(('external_ids', {'iface-id': 'eec50cb9-592b-4b34-ac42-37a92ebb2a27', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dc:68:1d', 'vm-uuid': 'b3c87b07-5c16-4f45-b320-06d3503d23e6'}),), if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:26:48 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:26:48 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:26:48 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:26:48 user nova-compute[75165]: INFO os_vif [None req-39ba501f-b45a-4394-857f-bc2544260008 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:68:1d,bridge_name='br-int',has_traffic_filtering=True,id=eec50cb9-592b-4b34-ac42-37a92ebb2a27,network=Network(eb55c0bc-cae5-4ba3-851a-e31a50b52c88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeec50cb9-59')
Oct 26 00:26:48 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-39ba501f-b45a-4394-857f-bc2544260008 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] No BDM found with device name vda, not building metadata. {{(pid=75165) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 00:26:48 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-39ba501f-b45a-4394-857f-bc2544260008 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] No VIF found with MAC fa:16:3e:dc:68:1d, not building metadata {{(pid=75165) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 00:26:48 user nova-compute[75165]: DEBUG nova.network.neutron [req-8bbf3da7-cb8d-4600-89e7-a2437be707c4 req-a648c9ba-0357-4e7e-9280-4e90947e7858 service nova] [instance: b3c87b07-5c16-4f45-b320-06d3503d23e6] Updated VIF entry in instance network info cache for port eec50cb9-592b-4b34-ac42-37a92ebb2a27. {{(pid=75165) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 00:26:48 user nova-compute[75165]: DEBUG nova.network.neutron [req-8bbf3da7-cb8d-4600-89e7-a2437be707c4 req-a648c9ba-0357-4e7e-9280-4e90947e7858 service nova] [instance: b3c87b07-5c16-4f45-b320-06d3503d23e6] Updating instance_info_cache with network_info: [{"id": "eec50cb9-592b-4b34-ac42-37a92ebb2a27", "address": "fa:16:3e:dc:68:1d", "network": {"id": "eb55c0bc-cae5-4ba3-851a-e31a50b52c88", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1081223830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d616862c7c184de5b0ba3121552c5666", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeec50cb9-59", "ovs_interfaceid": "eec50cb9-592b-4b34-ac42-37a92ebb2a27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:26:48 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-8bbf3da7-cb8d-4600-89e7-a2437be707c4 req-a648c9ba-0357-4e7e-9280-4e90947e7858 service nova] Releasing lock "refresh_cache-b3c87b07-5c16-4f45-b320-06d3503d23e6" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:26:49 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:26:49 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:26:49 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:26:50 user nova-compute[75165]: DEBUG nova.compute.manager [req-d8e88642-a8ce-4a50-ac5a-89a604437053 req-01ecbe83-f68c-421a-af3d-8efd9e94be54 service nova] [instance: b3c87b07-5c16-4f45-b320-06d3503d23e6] Received event network-vif-plugged-eec50cb9-592b-4b34-ac42-37a92ebb2a27 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:26:50 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-d8e88642-a8ce-4a50-ac5a-89a604437053 req-01ecbe83-f68c-421a-af3d-8efd9e94be54 service nova] Acquiring lock "b3c87b07-5c16-4f45-b320-06d3503d23e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:26:50 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-d8e88642-a8ce-4a50-ac5a-89a604437053 req-01ecbe83-f68c-421a-af3d-8efd9e94be54 service nova] Lock "b3c87b07-5c16-4f45-b320-06d3503d23e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:26:50 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-d8e88642-a8ce-4a50-ac5a-89a604437053 req-01ecbe83-f68c-421a-af3d-8efd9e94be54 service nova] Lock "b3c87b07-5c16-4f45-b320-06d3503d23e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:26:50 user nova-compute[75165]: DEBUG nova.compute.manager [req-d8e88642-a8ce-4a50-ac5a-89a604437053 req-01ecbe83-f68c-421a-af3d-8efd9e94be54 service nova] [instance: b3c87b07-5c16-4f45-b320-06d3503d23e6] No waiting events found dispatching network-vif-plugged-eec50cb9-592b-4b34-ac42-37a92ebb2a27 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:26:50 user nova-compute[75165]: WARNING nova.compute.manager [req-d8e88642-a8ce-4a50-ac5a-89a604437053 req-01ecbe83-f68c-421a-af3d-8efd9e94be54 service nova] [instance: b3c87b07-5c16-4f45-b320-06d3503d23e6] Received unexpected event network-vif-plugged-eec50cb9-592b-4b34-ac42-37a92ebb2a27 for instance with vm_state building and task_state spawning.
Oct 26 00:26:50 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:26:51 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:26:52 user nova-compute[75165]: DEBUG nova.compute.manager [req-6d74efc5-49eb-4bc2-807e-0687fc92500e req-5779aa76-80f8-4c78-b7dd-cf2a53f5ab49 service nova] [instance: b3c87b07-5c16-4f45-b320-06d3503d23e6] Received event network-vif-plugged-eec50cb9-592b-4b34-ac42-37a92ebb2a27 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:26:52 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-6d74efc5-49eb-4bc2-807e-0687fc92500e req-5779aa76-80f8-4c78-b7dd-cf2a53f5ab49 service nova] Acquiring lock "b3c87b07-5c16-4f45-b320-06d3503d23e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:26:52 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-6d74efc5-49eb-4bc2-807e-0687fc92500e req-5779aa76-80f8-4c78-b7dd-cf2a53f5ab49 service nova] Lock "b3c87b07-5c16-4f45-b320-06d3503d23e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:26:52 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-6d74efc5-49eb-4bc2-807e-0687fc92500e req-5779aa76-80f8-4c78-b7dd-cf2a53f5ab49 service nova] Lock "b3c87b07-5c16-4f45-b320-06d3503d23e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:26:52 user nova-compute[75165]: DEBUG nova.compute.manager [req-6d74efc5-49eb-4bc2-807e-0687fc92500e req-5779aa76-80f8-4c78-b7dd-cf2a53f5ab49 service nova] [instance: b3c87b07-5c16-4f45-b320-06d3503d23e6] No waiting events found dispatching network-vif-plugged-eec50cb9-592b-4b34-ac42-37a92ebb2a27 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:26:52 user nova-compute[75165]: WARNING nova.compute.manager [req-6d74efc5-49eb-4bc2-807e-0687fc92500e req-5779aa76-80f8-4c78-b7dd-cf2a53f5ab49 service nova] [instance: b3c87b07-5c16-4f45-b320-06d3503d23e6] Received unexpected event network-vif-plugged-eec50cb9-592b-4b34-ac42-37a92ebb2a27 for instance with vm_state building and task_state spawning.
Oct 26 00:26:52 user nova-compute[75165]: DEBUG nova.compute.manager [None req-39ba501f-b45a-4394-857f-bc2544260008 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: b3c87b07-5c16-4f45-b320-06d3503d23e6] Instance event wait completed in 0 seconds for  {{(pid=75165) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 00:26:52 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-39ba501f-b45a-4394-857f-bc2544260008 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: b3c87b07-5c16-4f45-b320-06d3503d23e6] Guest created on hypervisor {{(pid=75165) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 00:26:52 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: b3c87b07-5c16-4f45-b320-06d3503d23e6] Instance spawned successfully.
Oct 26 00:26:52 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-39ba501f-b45a-4394-857f-bc2544260008 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: b3c87b07-5c16-4f45-b320-06d3503d23e6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 00:26:52 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-39ba501f-b45a-4394-857f-bc2544260008 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: b3c87b07-5c16-4f45-b320-06d3503d23e6] Found default for hw_cdrom_bus of ide {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:26:52 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-39ba501f-b45a-4394-857f-bc2544260008 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: b3c87b07-5c16-4f45-b320-06d3503d23e6] Found default for hw_disk_bus of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:26:52 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-39ba501f-b45a-4394-857f-bc2544260008 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: b3c87b07-5c16-4f45-b320-06d3503d23e6] Found default for hw_input_bus of None {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:26:52 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-39ba501f-b45a-4394-857f-bc2544260008 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: b3c87b07-5c16-4f45-b320-06d3503d23e6] Found default for hw_pointer_model of None {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:26:52 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-39ba501f-b45a-4394-857f-bc2544260008 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: b3c87b07-5c16-4f45-b320-06d3503d23e6] Found default for hw_video_model of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:26:52 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-39ba501f-b45a-4394-857f-bc2544260008 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: b3c87b07-5c16-4f45-b320-06d3503d23e6] Found default for hw_vif_model of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:26:52 user nova-compute[75165]: INFO nova.compute.manager [None req-39ba501f-b45a-4394-857f-bc2544260008 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: b3c87b07-5c16-4f45-b320-06d3503d23e6] Took 6.74 seconds to spawn the instance on the hypervisor.
Oct 26 00:26:52 user nova-compute[75165]: DEBUG nova.compute.manager [None req-39ba501f-b45a-4394-857f-bc2544260008 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: b3c87b07-5c16-4f45-b320-06d3503d23e6] Checking state {{(pid=75165) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 00:26:52 user nova-compute[75165]: INFO nova.compute.manager [None req-39ba501f-b45a-4394-857f-bc2544260008 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: b3c87b07-5c16-4f45-b320-06d3503d23e6] Took 7.66 seconds to build instance.
Oct 26 00:26:52 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-39ba501f-b45a-4394-857f-bc2544260008 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Lock "b3c87b07-5c16-4f45-b320-06d3503d23e6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.771s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:26:53 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:26:55 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-33309c12-992f-4298-9069-19729ca3ac24 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Acquiring lock "91c62531-62f9-4f17-914c-11edc5010b54" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:26:55 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-33309c12-992f-4298-9069-19729ca3ac24 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Lock "91c62531-62f9-4f17-914c-11edc5010b54" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:26:55 user nova-compute[75165]: INFO nova.compute.manager [None req-33309c12-992f-4298-9069-19729ca3ac24 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] [instance: 91c62531-62f9-4f17-914c-11edc5010b54] Detaching volume d8e60b0c-7a47-46fd-a330-5d78f73e659f
Oct 26 00:26:55 user nova-compute[75165]: INFO nova.virt.block_device [None req-33309c12-992f-4298-9069-19729ca3ac24 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] [instance: 91c62531-62f9-4f17-914c-11edc5010b54] Attempting to driver detach volume d8e60b0c-7a47-46fd-a330-5d78f73e659f from mountpoint /dev/vdb
Oct 26 00:26:55 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-33309c12-992f-4298-9069-19729ca3ac24 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Attempting to detach device vdb from instance 91c62531-62f9-4f17-914c-11edc5010b54 from the persistent domain config. {{(pid=75165) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 00:26:55 user nova-compute[75165]: DEBUG nova.virt.libvirt.guest [None req-33309c12-992f-4298-9069-19729ca3ac24 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 00:26:55 user nova-compute[75165]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 00:26:55 user nova-compute[75165]:   <source dev="/dev/sdc"/>
Oct 26 00:26:55 user nova-compute[75165]:   <target dev="vdb" bus="virtio"/>
Oct 26 00:26:55 user nova-compute[75165]:   <serial>d8e60b0c-7a47-46fd-a330-5d78f73e659f</serial>
Oct 26 00:26:55 user nova-compute[75165]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 00:26:55 user nova-compute[75165]: </disk>
Oct 26 00:26:55 user nova-compute[75165]:  {{(pid=75165) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 00:26:55 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-33309c12-992f-4298-9069-19729ca3ac24 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Successfully detached device vdb from instance 91c62531-62f9-4f17-914c-11edc5010b54 from the persistent domain config.
Oct 26 00:26:55 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-33309c12-992f-4298-9069-19729ca3ac24 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 91c62531-62f9-4f17-914c-11edc5010b54 from the live domain config. {{(pid=75165) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 00:26:55 user nova-compute[75165]: DEBUG nova.virt.libvirt.guest [None req-33309c12-992f-4298-9069-19729ca3ac24 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 00:26:55 user nova-compute[75165]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 00:26:55 user nova-compute[75165]:   <source dev="/dev/sdc"/>
Oct 26 00:26:55 user nova-compute[75165]:   <target dev="vdb" bus="virtio"/>
Oct 26 00:26:55 user nova-compute[75165]:   <serial>d8e60b0c-7a47-46fd-a330-5d78f73e659f</serial>
Oct 26 00:26:55 user nova-compute[75165]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 00:26:55 user nova-compute[75165]: </disk>
Oct 26 00:26:55 user nova-compute[75165]:  {{(pid=75165) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 00:26:55 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-61c290d9-0c96-4d0d-b8e7-7b21f6517ef6 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Acquiring lock "91c62531-62f9-4f17-914c-11edc5010b54" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:26:55 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-33309c12-992f-4298-9069-19729ca3ac24 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 91c62531-62f9-4f17-914c-11edc5010b54 {{(pid=75165) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 00:26:56 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:26:56 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ec15b8d-6154-4eeb-8fe1-ec0cf83f36d4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] [instance: ce058b47-d96f-4341-9104-1fa71ca2c997] Calling os-brick to attach iSCSI Volume {{(pid=75165) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 00:26:56 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ec15b8d-6154-4eeb-8fe1-ec0cf83f36d4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8bf8160e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ff19ba88-2bf9-451f-afcc-e149c1578b95', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kKoIVgMG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:26:56 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-6ec15b8d-6154-4eeb-8fe1-ec0cf83f36d4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:26:56 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-6ec15b8d-6154-4eeb-8fe1-ec0cf83f36d4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:26:56 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-6ec15b8d-6154-4eeb-8fe1-ec0cf83f36d4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:26:56 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-6ec15b8d-6154-4eeb-8fe1-ec0cf83f36d4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:26:56 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-6ec15b8d-6154-4eeb-8fe1-ec0cf83f36d4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ff19ba88-2bf9-451f-afcc-e149c1578b95" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:26:56 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-6ec15b8d-6154-4eeb-8fe1-ec0cf83f36d4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ff19ba88-2bf9-451f-afcc-e149c1578b95" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:26:56 user nova-compute[75165]: INFO os_brick.initiator.connectors.iscsi [None req-6ec15b8d-6154-4eeb-8fe1-ec0cf83f36d4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 00:26:56 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff19ba88-2bf9-451f-afcc-e149c1578b95 -p 172.16.0.220:3260 {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:26:56 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff19ba88-2bf9-451f-afcc-e149c1578b95 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:26:56 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[9811b03c-e9a9-46a4-b2da-e8184118e3d2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:26:56 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ec15b8d-6154-4eeb-8fe1-ec0cf83f36d4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 00:26:56 user nova-compute[75165]:  {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:26:56 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff19ba88-2bf9-451f-afcc-e149c1578b95 -p 172.16.0.220:3260 --interface default --op new {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:26:56 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff19ba88-2bf9-451f-afcc-e149c1578b95 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:26:56 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c00efb6-ae1b-49c3-9370-0f91706e82e0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ff19ba88-2bf9-451f-afcc-e149c1578b95] added\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:26:56 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ec15b8d-6154-4eeb-8fe1-ec0cf83f36d4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ff19ba88-2bf9-451f-afcc-e149c1578b95] added
Oct 26 00:26:56 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:26:56 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff19ba88-2bf9-451f-afcc-e149c1578b95 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:26:56 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff19ba88-2bf9-451f-afcc-e149c1578b95 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:26:56 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[407c6a9e-7605-4c5b-9b10-c41b0a1ac94b]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:26:56 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ec15b8d-6154-4eeb-8fe1-ec0cf83f36d4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:26:56 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff19ba88-2bf9-451f-afcc-e149c1578b95 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:26:56 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff19ba88-2bf9-451f-afcc-e149c1578b95 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:26:56 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[044b3898-1a92-4352-b022-14a24038cab0]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:26:56 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ec15b8d-6154-4eeb-8fe1-ec0cf83f36d4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:26:56 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff19ba88-2bf9-451f-afcc-e149c1578b95 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kKoIVgMG {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:26:56 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff19ba88-2bf9-451f-afcc-e149c1578b95 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kKoIVgMG" returned: 0 in 0.018s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:26:56 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[efc2a6db-60b4-4316-822a-1a75825da3cb]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:26:56 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ec15b8d-6154-4eeb-8fe1-ec0cf83f36d4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kKoIVgMG'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:26:56 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff19ba88-2bf9-451f-afcc-e149c1578b95 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:26:56 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff19ba88-2bf9-451f-afcc-e149c1578b95 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:26:56 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c15b344-3432-4ef5-aaef-329c175b3939]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:26:56 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ec15b8d-6154-4eeb-8fe1-ec0cf83f36d4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:26:56 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:26:56 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:26:56 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[44899ab0-4dbb-4e85-b839-a1f95df47bed]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8e60b0c-7a47-46fd-a330-5d78f73e659f (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:26:56 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ec15b8d-6154-4eeb-8fe1-ec0cf83f36d4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)
Oct 26 00:26:56 user nova-compute[75165]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8e60b0c-7a47-46fd-a330-5d78f73e659f (non-flash)
Oct 26 00:26:56 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:26:56 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ec15b8d-6154-4eeb-8fe1-ec0cf83f36d4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)
Oct 26 00:26:56 user nova-compute[75165]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8e60b0c-7a47-46fd-a330-5d78f73e659f (non-flash)
Oct 26 00:26:56 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:26:56 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff19ba88-2bf9-451f-afcc-e149c1578b95 -p 172.16.0.220:3260 --login {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:26:56 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff19ba88-2bf9-451f-afcc-e149c1578b95 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:26:56 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d2f01db-f9c8-44e2-b3a7-017d1d812afa]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ff19ba88-2bf9-451f-afcc-e149c1578b95, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ff19ba88-2bf9-451f-afcc-e149c1578b95, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:26:56 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ec15b8d-6154-4eeb-8fe1-ec0cf83f36d4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ff19ba88-2bf9-451f-afcc-e149c1578b95, portal: 172.16.0.220,3260]
Oct 26 00:26:56 user nova-compute[75165]: Login to [iface: default, target: iqn.2010-10.org.openstack:ff19ba88-2bf9-451f-afcc-e149c1578b95, portal: 172.16.0.220,3260] successful.
Oct 26 00:26:56 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:26:56 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff19ba88-2bf9-451f-afcc-e149c1578b95 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:26:56 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff19ba88-2bf9-451f-afcc-e149c1578b95 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:26:56 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[385e7166-2374-4a3a-a00a-da1df525000b]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:26:56 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ec15b8d-6154-4eeb-8fe1-ec0cf83f36d4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:26:56 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:26:56 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:26:56 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[3339329d-bad4-40f5-9360-d94bfe8948a5]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8e60b0c-7a47-46fd-a330-5d78f73e659f (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff19ba88-2bf9-451f-afcc-e149c1578b95 (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:26:56 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ec15b8d-6154-4eeb-8fe1-ec0cf83f36d4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)
Oct 26 00:26:56 user nova-compute[75165]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8e60b0c-7a47-46fd-a330-5d78f73e659f (non-flash)
Oct 26 00:26:56 user nova-compute[75165]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff19ba88-2bf9-451f-afcc-e149c1578b95 (non-flash)
Oct 26 00:26:56 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:26:56 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ec15b8d-6154-4eeb-8fe1-ec0cf83f36d4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)
Oct 26 00:26:56 user nova-compute[75165]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8e60b0c-7a47-46fd-a330-5d78f73e659f (non-flash)
Oct 26 00:26:56 user nova-compute[75165]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff19ba88-2bf9-451f-afcc-e149c1578b95 (non-flash)
Oct 26 00:26:56 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:26:56 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-6ec15b8d-6154-4eeb-8fe1-ec0cf83f36d4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ff19ba88-2bf9-451f-afcc-e149c1578b95" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:26:56 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ec15b8d-6154-4eeb-8fe1-ec0cf83f36d4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Connected to 172.16.0.220:3260 {{(pid=75165) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 00:26:56 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-6ec15b8d-6154-4eeb-8fe1-ec0cf83f36d4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] HCTL ('35', '-', '-', 0) found on session 31 with lun 0 {{(pid=75165) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 00:26:56 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-6ec15b8d-6154-4eeb-8fe1-ec0cf83f36d4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75165) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 00:26:56 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:26:56 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:26:56 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bbbc805-9685-43ea-b153-a63baf38071a]: (4, ('- - 0', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:26:56 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-6ec15b8d-6154-4eeb-8fe1-ec0cf83f36d4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Searching for a device in session 31 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75165) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 00:26:56 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ec15b8d-6154-4eeb-8fe1-ec0cf83f36d4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:ff19ba88-2bf9-451f-afcc-e149c1578b95', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kKoIVgMG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75165) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 00:26:57 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-6ec15b8d-6154-4eeb-8fe1-ec0cf83f36d4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.320s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:26:57 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ec15b8d-6154-4eeb-8fe1-ec0cf83f36d4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] <== connect_volume: return (1323ms) {'type': 'block', 'scsi_wwn': '23434636236316565', 'path': '/dev/sdd'} {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:26:57 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ec15b8d-6154-4eeb-8fe1-ec0cf83f36d4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] [instance: ce058b47-d96f-4341-9104-1fa71ca2c997] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23434636236316565', 'path': '/dev/sdd'} {{(pid=75165) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 00:26:57 user nova-compute[75165]: DEBUG nova.objects.instance [None req-6ec15b8d-6154-4eeb-8fe1-ec0cf83f36d4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Lazy-loading 'flavor' on Instance uuid ce058b47-d96f-4341-9104-1fa71ca2c997 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:26:57 user nova-compute[75165]: DEBUG nova.virt.libvirt.guest [None req-6ec15b8d-6154-4eeb-8fe1-ec0cf83f36d4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 00:26:57 user nova-compute[75165]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 00:26:57 user nova-compute[75165]:   <source dev="/dev/sdd"/>
Oct 26 00:26:57 user nova-compute[75165]:   <target dev="vdb" bus="virtio"/>
Oct 26 00:26:57 user nova-compute[75165]:   <serial>ff19ba88-2bf9-451f-afcc-e149c1578b95</serial>
Oct 26 00:26:57 user nova-compute[75165]: </disk>
Oct 26 00:26:57 user nova-compute[75165]:  {{(pid=75165) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 00:26:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:26:58 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-6ec15b8d-6154-4eeb-8fe1-ec0cf83f36d4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] No BDM found with device name vda, not building metadata. {{(pid=75165) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 00:26:58 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-6ec15b8d-6154-4eeb-8fe1-ec0cf83f36d4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75165) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 00:26:58 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-6ec15b8d-6154-4eeb-8fe1-ec0cf83f36d4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] No VIF found with MAC fa:16:3e:d8:e5:83, not building metadata {{(pid=75165) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 00:26:58 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-6ec15b8d-6154-4eeb-8fe1-ec0cf83f36d4 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Lock "ce058b47-d96f-4341-9104-1fa71ca2c997" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 22.930s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:27:01 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:27:03 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:27:05 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-fc6faa13-8fbe-461a-ab04-feeef1327943 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Acquiring lock "ce058b47-d96f-4341-9104-1fa71ca2c997" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:27:05 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-fc6faa13-8fbe-461a-ab04-feeef1327943 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Lock "ce058b47-d96f-4341-9104-1fa71ca2c997" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:27:05 user nova-compute[75165]: DEBUG nova.objects.instance [None req-fc6faa13-8fbe-461a-ab04-feeef1327943 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Lazy-loading 'flavor' on Instance uuid ce058b47-d96f-4341-9104-1fa71ca2c997 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:27:05 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-fc6faa13-8fbe-461a-ab04-feeef1327943 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Lock "ce058b47-d96f-4341-9104-1fa71ca2c997" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:27:05 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-fc6faa13-8fbe-461a-ab04-feeef1327943 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Acquiring lock "ce058b47-d96f-4341-9104-1fa71ca2c997" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:27:05 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-fc6faa13-8fbe-461a-ab04-feeef1327943 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Lock "ce058b47-d96f-4341-9104-1fa71ca2c997" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:27:05 user nova-compute[75165]: INFO nova.compute.manager [None req-fc6faa13-8fbe-461a-ab04-feeef1327943 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] [instance: ce058b47-d96f-4341-9104-1fa71ca2c997] Attaching volume 79cd1a2b-17f3-4a34-95a1-c8169a436f42 to /dev/vdc
Oct 26 00:27:05 user nova-compute[75165]: DEBUG os_brick.utils [None req-fc6faa13-8fbe-461a-ab04-feeef1327943 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:27:05 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:27:05 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:27:05 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a14b61c-f853-420b-9848-74235b044225]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa94814ccb35\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:27:05 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:27:05 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:27:05 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[387b4725-20bf-409b-b223-5c35a607f3f9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:27:05 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:27:05 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:27:05 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c1de348-655b-4a52-aa1d-5aba953d8112]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:27:05 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b1a83de-bfd0-4a31-84c1-bc77631d5219]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:27:05 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-fc6faa13-8fbe-461a-ab04-feeef1327943 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Running cmd (subprocess): nvme version {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:27:05 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-fc6faa13-8fbe-461a-ab04-feeef1327943 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] 'nvme version' failed. Not Retrying. {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 00:27:05 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fc6faa13-8fbe-461a-ab04-feeef1327943 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] nvme not present on system {{(pid=75165) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 00:27:05 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:27:05 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 00:27:05 user nova-compute[75165]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 00:27:05 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[236351f3-df17-499e-aab6-4d667e866f2a]: (4, '') {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:27:05 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-fc6faa13-8fbe-461a-ab04-feeef1327943 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75165) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 00:27:05 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-fc6faa13-8fbe-461a-ab04-feeef1327943 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75165) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 00:27:05 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-fc6faa13-8fbe-461a-ab04-feeef1327943 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] LIGHTOS: no hostnqn found. {{(pid=75165) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 00:27:05 user nova-compute[75165]: DEBUG os_brick.utils [None req-fc6faa13-8fbe-461a-ab04-feeef1327943 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa94814ccb35', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:27:05 user nova-compute[75165]: DEBUG nova.virt.block_device [None req-fc6faa13-8fbe-461a-ab04-feeef1327943 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] [instance: ce058b47-d96f-4341-9104-1fa71ca2c997] Updating existing volume attachment record: d9e68fa4-1bc3-436c-ad88-a1b6c44bf0bb {{(pid=75165) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 00:27:06 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:27:08 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:27:09 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:27:09 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75165) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 00:27:11 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:27:13 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:27:13 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:27:14 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:27:15 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:27:15 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Starting heal instance info cache {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 00:27:15 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-33309c12-992f-4298-9069-19729ca3ac24 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 91c62531-62f9-4f17-914c-11edc5010b54 is timed out.
Oct 26 00:27:15 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-33309c12-992f-4298-9069-19729ca3ac24 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Successfully detached device vdb from instance 91c62531-62f9-4f17-914c-11edc5010b54 from the live domain config.
Oct 26 00:27:15 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33309c12-992f-4298-9069-19729ca3ac24 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] [instance: 91c62531-62f9-4f17-914c-11edc5010b54] calling os-brick to detach iSCSI Volume {{(pid=75165) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 00:27:15 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-33309c12-992f-4298-9069-19729ca3ac24 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8bf8160e50>, {'target_iqn': 'iqn.2010-10.org.openstack:d8e60b0c-7a47-46fd-a330-5d78f73e659f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FBMzcVRh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:27:15 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-33309c12-992f-4298-9069-19729ca3ac24 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:27:15 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-33309c12-992f-4298-9069-19729ca3ac24 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:27:15 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-33309c12-992f-4298-9069-19729ca3ac24 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:27:15 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:27:15 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:27:15 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[af46c62a-2ae4-4869-9022-1fc091f0537b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ff19ba88-2bf9-451f-afcc-e149c1578b95\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d8e60b0c-7a47-46fd-a330-5d78f73e659f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:27:15 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-33309c12-992f-4298-9069-19729ca3ac24 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 00:27:15 user nova-compute[75165]: No targets found.
Oct 26 00:27:15 user nova-compute[75165]: iSNS:
Oct 26 00:27:15 user nova-compute[75165]: No targets found.
Oct 26 00:27:15 user nova-compute[75165]: STATIC:
Oct 26 00:27:15 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795
Oct 26 00:27:15 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:27:15 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:27:15 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:ff19ba88-2bf9-451f-afcc-e149c1578b95
Oct 26 00:27:15 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:27:15 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:27:15 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:d8e60b0c-7a47-46fd-a330-5d78f73e659f
Oct 26 00:27:15 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:27:15 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:27:15 user nova-compute[75165]: FIRMWARE:
Oct 26 00:27:15 user nova-compute[75165]: No targets found.
Oct 26 00:27:15 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:27:15 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-33309c12-992f-4298-9069-19729ca3ac24 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 00:27:15 user nova-compute[75165]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 00:27:15 user nova-compute[75165]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75165) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 00:27:15 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-33309c12-992f-4298-9069-19729ca3ac24 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d8e60b0c-7a47-46fd-a330-5d78f73e659f', 0)] {{(pid=75165) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 00:27:15 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:27:15 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:27:15 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f5c6e9b-b7e5-452c-a40d-a53835aa0070]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d8e60b0c-7a47-46fd-a330-5d78f73e659f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ff19ba88-2bf9-451f-afcc-e149c1578b95\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:27:15 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:27:15 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:27:15 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[141bc61c-7922-439d-b1ea-a8ab5eb3fe9c]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8e60b0c-7a47-46fd-a330-5d78f73e659f (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff19ba88-2bf9-451f-afcc-e149c1578b95 (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:27:15 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-33309c12-992f-4298-9069-19729ca3ac24 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)
Oct 26 00:27:15 user nova-compute[75165]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8e60b0c-7a47-46fd-a330-5d78f73e659f (non-flash)
Oct 26 00:27:15 user nova-compute[75165]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff19ba88-2bf9-451f-afcc-e149c1578b95 (non-flash)
Oct 26 00:27:15 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:27:15 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-33309c12-992f-4298-9069-19729ca3ac24 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)
Oct 26 00:27:15 user nova-compute[75165]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8e60b0c-7a47-46fd-a330-5d78f73e659f (non-flash)
Oct 26 00:27:15 user nova-compute[75165]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff19ba88-2bf9-451f-afcc-e149c1578b95 (non-flash)
Oct 26 00:27:15 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:27:15 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-33309c12-992f-4298-9069-19729ca3ac24 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8bf8175360>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d8e60b0c-7a47-46fd-a330-5d78f73e659f'): ({'sdc'}, set())}) {{(pid=75165) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 00:27:15 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-33309c12-992f-4298-9069-19729ca3ac24 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Removing single pathed devices sdc {{(pid=75165) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 00:27:15 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:27:15 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:27:15 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb8e8a06-b42b-4f7a-91ac-501fc501eeda]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:27:15 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:27:16 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.025s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:27:16 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[77b9f2cc-2ba9-47eb-9c52-06d9b3c8f216]: (4, ('ok\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:27:16 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-33309c12-992f-4298-9069-19729ca3ac24 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Flushing IO for device /dev/sdc {{(pid=75165) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 00:27:16 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:27:16 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:27:16 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[33bf9a32-711f-450d-a027-7dd88091a0f5]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:27:16 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-33309c12-992f-4298-9069-19729ca3ac24 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75165) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 00:27:16 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:27:16 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.036s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:27:16 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc6345f2-4e69-455a-8f59-26f95cfdd554]: (4, ('1', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:27:16 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-33309c12-992f-4298-9069-19729ca3ac24 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75165) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 00:27:16 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-33309c12-992f-4298-9069-19729ca3ac24 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] SCSI volumes sdc have been removed. {{(pid=75165) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 00:27:16 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-33309c12-992f-4298-9069-19729ca3ac24 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d8e60b0c-7a47-46fd-a330-5d78f73e659f')] {{(pid=75165) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 00:27:16 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8e60b0c-7a47-46fd-a330-5d78f73e659f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:27:16 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8e60b0c-7a47-46fd-a330-5d78f73e659f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:27:16 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ea5c41a-aa33-4ced-92f7-cf786b1950d1]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:27:16 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-33309c12-992f-4298-9069-19729ca3ac24 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:27:16 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8e60b0c-7a47-46fd-a330-5d78f73e659f -p 172.16.0.220:3260 --logout {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:27:16 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8e60b0c-7a47-46fd-a330-5d78f73e659f -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:27:16 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[6985e3ae-83ae-4a93-ba9e-73626e267d94]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:d8e60b0c-7a47-46fd-a330-5d78f73e659f, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:d8e60b0c-7a47-46fd-a330-5d78f73e659f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:27:16 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-33309c12-992f-4298-9069-19729ca3ac24 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:d8e60b0c-7a47-46fd-a330-5d78f73e659f, portal: 172.16.0.220,3260]
Oct 26 00:27:16 user nova-compute[75165]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:d8e60b0c-7a47-46fd-a330-5d78f73e659f, portal: 172.16.0.220,3260] successful.
Oct 26 00:27:16 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:27:16 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8e60b0c-7a47-46fd-a330-5d78f73e659f -p 172.16.0.220:3260 --op delete {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:27:16 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8e60b0c-7a47-46fd-a330-5d78f73e659f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:27:16 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8978b99-20fe-4cee-ada6-299887ff1ecc]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:27:16 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-33309c12-992f-4298-9069-19729ca3ac24 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:27:16 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-33309c12-992f-4298-9069-19729ca3ac24 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.330s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:27:16 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-33309c12-992f-4298-9069-19729ca3ac24 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] <== disconnect_volume: return (331ms) None {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:27:16 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33309c12-992f-4298-9069-19729ca3ac24 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] [instance: 91c62531-62f9-4f17-914c-11edc5010b54] Disconnected iSCSI Volume {{(pid=75165) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 00:27:16 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "refresh_cache-a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:27:16 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquired lock "refresh_cache-a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:27:16 user nova-compute[75165]: DEBUG nova.network.neutron [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb] Forcefully refreshing network info cache for instance {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 00:27:16 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:27:16 user nova-compute[75165]: DEBUG nova.network.neutron [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb] Updating instance_info_cache with network_info: [{"id": "e2143e91-9f8c-4670-9f92-c2c00827a619", "address": "fa:16:3e:6c:b7:14", "network": {"id": "eb55c0bc-cae5-4ba3-851a-e31a50b52c88", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1081223830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d616862c7c184de5b0ba3121552c5666", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2143e91-9f", "ovs_interfaceid": "e2143e91-9f8c-4670-9f92-c2c00827a619", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:27:16 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Releasing lock "refresh_cache-a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:27:16 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb] Updated the network info_cache for instance {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 00:27:16 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:27:16 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:27:17 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:27:17 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:27:17 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:27:17 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75165) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 00:27:17 user nova-compute[75165]: DEBUG nova.objects.instance [None req-33309c12-992f-4298-9069-19729ca3ac24 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Lazy-loading 'flavor' on Instance uuid 91c62531-62f9-4f17-914c-11edc5010b54 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:27:17 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-33309c12-992f-4298-9069-19729ca3ac24 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Lock "91c62531-62f9-4f17-914c-11edc5010b54" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.936s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:27:17 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-61c290d9-0c96-4d0d-b8e7-7b21f6517ef6 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Lock "91c62531-62f9-4f17-914c-11edc5010b54" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.726s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:27:17 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-61c290d9-0c96-4d0d-b8e7-7b21f6517ef6 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Acquiring lock "91c62531-62f9-4f17-914c-11edc5010b54-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:27:17 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-61c290d9-0c96-4d0d-b8e7-7b21f6517ef6 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Lock "91c62531-62f9-4f17-914c-11edc5010b54-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:27:17 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-61c290d9-0c96-4d0d-b8e7-7b21f6517ef6 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Lock "91c62531-62f9-4f17-914c-11edc5010b54-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:27:17 user nova-compute[75165]: INFO nova.compute.manager [None req-61c290d9-0c96-4d0d-b8e7-7b21f6517ef6 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] [instance: 91c62531-62f9-4f17-914c-11edc5010b54] Terminating instance
Oct 26 00:27:17 user nova-compute[75165]: DEBUG nova.compute.manager [None req-61c290d9-0c96-4d0d-b8e7-7b21f6517ef6 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] [instance: 91c62531-62f9-4f17-914c-11edc5010b54] Start destroying the instance on the hypervisor. {{(pid=75165) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 00:27:17 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75165) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 00:27:17 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97fb67a7-637d-456f-b4dd-0a271ed6cfc4/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:27:17 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:27:17 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:27:17 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:27:17 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:27:17 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:27:17 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97fb67a7-637d-456f-b4dd-0a271ed6cfc4/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:27:17 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97fb67a7-637d-456f-b4dd-0a271ed6cfc4/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:27:17 user nova-compute[75165]: ERROR nova.volume.cinder [None req-fc6faa13-8fbe-461a-ab04-feeef1327943 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Update attachment failed for attachment d9e68fa4-1bc3-436c-ad88-a1b6c44bf0bb. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-825e955c-c477-4e3f-83a5-512ada0a0547) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-825e955c-c477-4e3f-83a5-512ada0a0547)
Oct 26 00:27:17 user nova-compute[75165]: DEBUG nova.compute.manager [req-d904d977-7b8c-4640-8f6e-0f752a41aec1 req-5a1bab5c-efc2-40c3-a607-2e2ce408a930 service nova] [instance: 91c62531-62f9-4f17-914c-11edc5010b54] Received event network-vif-unplugged-355e1ddf-4d49-4a04-8a77-e05df100b323 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:27:17 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-d904d977-7b8c-4640-8f6e-0f752a41aec1 req-5a1bab5c-efc2-40c3-a607-2e2ce408a930 service nova] Acquiring lock "91c62531-62f9-4f17-914c-11edc5010b54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:27:17 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-d904d977-7b8c-4640-8f6e-0f752a41aec1 req-5a1bab5c-efc2-40c3-a607-2e2ce408a930 service nova] Lock "91c62531-62f9-4f17-914c-11edc5010b54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:27:17 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-d904d977-7b8c-4640-8f6e-0f752a41aec1 req-5a1bab5c-efc2-40c3-a607-2e2ce408a930 service nova] Lock "91c62531-62f9-4f17-914c-11edc5010b54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:27:17 user nova-compute[75165]: DEBUG nova.compute.manager [req-d904d977-7b8c-4640-8f6e-0f752a41aec1 req-5a1bab5c-efc2-40c3-a607-2e2ce408a930 service nova] [instance: 91c62531-62f9-4f17-914c-11edc5010b54] No waiting events found dispatching network-vif-unplugged-355e1ddf-4d49-4a04-8a77-e05df100b323 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:27:17 user nova-compute[75165]: DEBUG nova.compute.manager [req-d904d977-7b8c-4640-8f6e-0f752a41aec1 req-5a1bab5c-efc2-40c3-a607-2e2ce408a930 service nova] [instance: 91c62531-62f9-4f17-914c-11edc5010b54] Received event network-vif-unplugged-355e1ddf-4d49-4a04-8a77-e05df100b323 for instance with task_state deleting. {{(pid=75165) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 00:27:17 user nova-compute[75165]: ERROR nova.compute.manager [None req-fc6faa13-8fbe-461a-ab04-feeef1327943 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] [instance: ce058b47-d96f-4341-9104-1fa71ca2c997] Failed to attach 79cd1a2b-17f3-4a34-95a1-c8169a436f42 at /dev/vdc: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-825e955c-c477-4e3f-83a5-512ada0a0547)
Oct 26 00:27:17 user nova-compute[75165]: ERROR nova.compute.manager [instance: ce058b47-d96f-4341-9104-1fa71ca2c997] Traceback (most recent call last):
Oct 26 00:27:17 user nova-compute[75165]: ERROR nova.compute.manager [instance: ce058b47-d96f-4341-9104-1fa71ca2c997]   File "/opt/stack/nova/nova/compute/manager.py", line 7566, in _attach_volume
Oct 26 00:27:17 user nova-compute[75165]: ERROR nova.compute.manager [instance: ce058b47-d96f-4341-9104-1fa71ca2c997]     bdm.attach(context, instance, self.volume_api, self.driver,
Oct 26 00:27:17 user nova-compute[75165]: ERROR nova.compute.manager [instance: ce058b47-d96f-4341-9104-1fa71ca2c997]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Oct 26 00:27:17 user nova-compute[75165]: ERROR nova.compute.manager [instance: ce058b47-d96f-4341-9104-1fa71ca2c997]     ret_val = method(obj, context, *args, **kwargs)
Oct 26 00:27:17 user nova-compute[75165]: ERROR nova.compute.manager [instance: ce058b47-d96f-4341-9104-1fa71ca2c997]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Oct 26 00:27:17 user nova-compute[75165]: ERROR nova.compute.manager [instance: ce058b47-d96f-4341-9104-1fa71ca2c997]     self._do_attach(context, instance, volume, volume_api,
Oct 26 00:27:17 user nova-compute[75165]: ERROR nova.compute.manager [instance: ce058b47-d96f-4341-9104-1fa71ca2c997]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Oct 26 00:27:17 user nova-compute[75165]: ERROR nova.compute.manager [instance: ce058b47-d96f-4341-9104-1fa71ca2c997]     self._volume_attach(context, volume, connector, instance,
Oct 26 00:27:17 user nova-compute[75165]: ERROR nova.compute.manager [instance: ce058b47-d96f-4341-9104-1fa71ca2c997]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Oct 26 00:27:17 user nova-compute[75165]: ERROR nova.compute.manager [instance: ce058b47-d96f-4341-9104-1fa71ca2c997]     connection_info = volume_api.attachment_update(
Oct 26 00:27:17 user nova-compute[75165]: ERROR nova.compute.manager [instance: ce058b47-d96f-4341-9104-1fa71ca2c997]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 26 00:27:17 user nova-compute[75165]: ERROR nova.compute.manager [instance: ce058b47-d96f-4341-9104-1fa71ca2c997]     res = method(self, ctx, *args, **kwargs)
Oct 26 00:27:17 user nova-compute[75165]: ERROR nova.compute.manager [instance: ce058b47-d96f-4341-9104-1fa71ca2c997]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Oct 26 00:27:17 user nova-compute[75165]: ERROR nova.compute.manager [instance: ce058b47-d96f-4341-9104-1fa71ca2c997]     res = method(self, ctx, attachment_id, *args, **kwargs)
Oct 26 00:27:17 user nova-compute[75165]: ERROR nova.compute.manager [instance: ce058b47-d96f-4341-9104-1fa71ca2c997]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Oct 26 00:27:17 user nova-compute[75165]: ERROR nova.compute.manager [instance: ce058b47-d96f-4341-9104-1fa71ca2c997]     with excutils.save_and_reraise_exception():
Oct 26 00:27:17 user nova-compute[75165]: ERROR nova.compute.manager [instance: ce058b47-d96f-4341-9104-1fa71ca2c997]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 26 00:27:17 user nova-compute[75165]: ERROR nova.compute.manager [instance: ce058b47-d96f-4341-9104-1fa71ca2c997]     self.force_reraise()
Oct 26 00:27:17 user nova-compute[75165]: ERROR nova.compute.manager [instance: ce058b47-d96f-4341-9104-1fa71ca2c997]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 26 00:27:17 user nova-compute[75165]: ERROR nova.compute.manager [instance: ce058b47-d96f-4341-9104-1fa71ca2c997]     raise self.value
Oct 26 00:27:17 user nova-compute[75165]: ERROR nova.compute.manager [instance: ce058b47-d96f-4341-9104-1fa71ca2c997]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Oct 26 00:27:17 user nova-compute[75165]: ERROR nova.compute.manager [instance: ce058b47-d96f-4341-9104-1fa71ca2c997]     context, '3.44', skip_version_check=True).attachments.update(
Oct 26 00:27:17 user nova-compute[75165]: ERROR nova.compute.manager [instance: ce058b47-d96f-4341-9104-1fa71ca2c997]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Oct 26 00:27:17 user nova-compute[75165]: ERROR nova.compute.manager [instance: ce058b47-d96f-4341-9104-1fa71ca2c997]     return method.func(obj, *args, **kwargs)
Oct 26 00:27:17 user nova-compute[75165]: ERROR nova.compute.manager [instance: ce058b47-d96f-4341-9104-1fa71ca2c997]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Oct 26 00:27:17 user nova-compute[75165]: ERROR nova.compute.manager [instance: ce058b47-d96f-4341-9104-1fa71ca2c997]     resp = self._update('/attachments/%s' % id, body)
Oct 26 00:27:17 user nova-compute[75165]: ERROR nova.compute.manager [instance: ce058b47-d96f-4341-9104-1fa71ca2c997]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Oct 26 00:27:17 user nova-compute[75165]: ERROR nova.compute.manager [instance: ce058b47-d96f-4341-9104-1fa71ca2c997]     resp, body = self.api.client.put(url, body=body, **kwargs)
Oct 26 00:27:17 user nova-compute[75165]: ERROR nova.compute.manager [instance: ce058b47-d96f-4341-9104-1fa71ca2c997]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Oct 26 00:27:17 user nova-compute[75165]: ERROR nova.compute.manager [instance: ce058b47-d96f-4341-9104-1fa71ca2c997]     return self._cs_request(url, 'PUT', **kwargs)
Oct 26 00:27:17 user nova-compute[75165]: ERROR nova.compute.manager [instance: ce058b47-d96f-4341-9104-1fa71ca2c997]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 26 00:27:17 user nova-compute[75165]: ERROR nova.compute.manager [instance: ce058b47-d96f-4341-9104-1fa71ca2c997]     return self.request(url, method, **kwargs)
Oct 26 00:27:17 user nova-compute[75165]: ERROR nova.compute.manager [instance: ce058b47-d96f-4341-9104-1fa71ca2c997]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 26 00:27:17 user nova-compute[75165]: ERROR nova.compute.manager [instance: ce058b47-d96f-4341-9104-1fa71ca2c997]     raise exceptions.from_response(resp, body)
Oct 26 00:27:17 user nova-compute[75165]: ERROR nova.compute.manager [instance: ce058b47-d96f-4341-9104-1fa71ca2c997] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-825e955c-c477-4e3f-83a5-512ada0a0547)
Oct 26 00:27:17 user nova-compute[75165]: ERROR nova.compute.manager [instance: ce058b47-d96f-4341-9104-1fa71ca2c997] 
Oct 26 00:27:17 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:27:17 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97fb67a7-637d-456f-b4dd-0a271ed6cfc4/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:27:17 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7eeb145-1565-4812-818b-fefda5f2436d/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:27:17 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-fc6faa13-8fbe-461a-ab04-feeef1327943 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Lock "ce058b47-d96f-4341-9104-1fa71ca2c997" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.251s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:27:17 user nova-compute[75165]: ERROR oslo_messaging.rpc.server [None req-fc6faa13-8fbe-461a-ab04-feeef1327943 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-825e955c-c477-4e3f-83a5-512ada0a0547)
Oct 26 00:27:17 user nova-compute[75165]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Oct 26 00:27:17 user nova-compute[75165]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Oct 26 00:27:17 user nova-compute[75165]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Oct 26 00:27:17 user nova-compute[75165]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Oct 26 00:27:17 user nova-compute[75165]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Oct 26 00:27:17 user nova-compute[75165]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Oct 26 00:27:17 user nova-compute[75165]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Oct 26 00:27:17 user nova-compute[75165]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Oct 26 00:27:17 user nova-compute[75165]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 26 00:27:17 user nova-compute[75165]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 26 00:27:17 user nova-compute[75165]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 26 00:27:17 user nova-compute[75165]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 26 00:27:17 user nova-compute[75165]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 26 00:27:17 user nova-compute[75165]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Oct 26 00:27:17 user nova-compute[75165]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Oct 26 00:27:17 user nova-compute[75165]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Oct 26 00:27:17 user nova-compute[75165]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Oct 26 00:27:17 user nova-compute[75165]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Oct 26 00:27:17 user nova-compute[75165]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 26 00:27:17 user nova-compute[75165]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 26 00:27:17 user nova-compute[75165]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 26 00:27:17 user nova-compute[75165]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 26 00:27:17 user nova-compute[75165]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 26 00:27:17 user nova-compute[75165]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Oct 26 00:27:17 user nova-compute[75165]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Oct 26 00:27:17 user nova-compute[75165]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7552, in attach_volume
Oct 26 00:27:17 user nova-compute[75165]: ERROR oslo_messaging.rpc.server     do_attach_volume(context, instance, driver_bdm)
Oct 26 00:27:17 user nova-compute[75165]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Oct 26 00:27:17 user nova-compute[75165]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Oct 26 00:27:17 user nova-compute[75165]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7549, in do_attach_volume
Oct 26 00:27:17 user nova-compute[75165]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 26 00:27:17 user nova-compute[75165]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 26 00:27:17 user nova-compute[75165]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 26 00:27:17 user nova-compute[75165]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 26 00:27:17 user nova-compute[75165]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 26 00:27:17 user nova-compute[75165]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7547, in do_attach_volume
Oct 26 00:27:17 user nova-compute[75165]: ERROR oslo_messaging.rpc.server     return self._attach_volume(context, instance, driver_bdm)
Oct 26 00:27:17 user nova-compute[75165]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7569, in _attach_volume
Oct 26 00:27:17 user nova-compute[75165]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 26 00:27:17 user nova-compute[75165]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 26 00:27:17 user nova-compute[75165]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 26 00:27:17 user nova-compute[75165]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 26 00:27:17 user nova-compute[75165]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 26 00:27:17 user nova-compute[75165]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7566, in _attach_volume
Oct 26 00:27:17 user nova-compute[75165]: ERROR oslo_messaging.rpc.server     bdm.attach(context, instance, self.volume_api, self.driver,
Oct 26 00:27:17 user nova-compute[75165]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Oct 26 00:27:17 user nova-compute[75165]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Oct 26 00:27:17 user nova-compute[75165]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Oct 26 00:27:17 user nova-compute[75165]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Oct 26 00:27:17 user nova-compute[75165]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Oct 26 00:27:17 user nova-compute[75165]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Oct 26 00:27:17 user nova-compute[75165]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Oct 26 00:27:17 user nova-compute[75165]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Oct 26 00:27:17 user nova-compute[75165]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 26 00:27:17 user nova-compute[75165]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Oct 26 00:27:17 user nova-compute[75165]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Oct 26 00:27:17 user nova-compute[75165]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Oct 26 00:27:17 user nova-compute[75165]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Oct 26 00:27:17 user nova-compute[75165]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 26 00:27:17 user nova-compute[75165]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 26 00:27:17 user nova-compute[75165]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 26 00:27:17 user nova-compute[75165]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 26 00:27:17 user nova-compute[75165]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 26 00:27:17 user nova-compute[75165]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Oct 26 00:27:17 user nova-compute[75165]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Oct 26 00:27:17 user nova-compute[75165]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Oct 26 00:27:17 user nova-compute[75165]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Oct 26 00:27:17 user nova-compute[75165]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Oct 26 00:27:17 user nova-compute[75165]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Oct 26 00:27:17 user nova-compute[75165]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Oct 26 00:27:17 user nova-compute[75165]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Oct 26 00:27:17 user nova-compute[75165]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Oct 26 00:27:17 user nova-compute[75165]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Oct 26 00:27:17 user nova-compute[75165]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 26 00:27:17 user nova-compute[75165]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Oct 26 00:27:17 user nova-compute[75165]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 26 00:27:17 user nova-compute[75165]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Oct 26 00:27:17 user nova-compute[75165]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-825e955c-c477-4e3f-83a5-512ada0a0547)
Oct 26 00:27:17 user nova-compute[75165]: ERROR oslo_messaging.rpc.server 
Oct 26 00:27:17 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7eeb145-1565-4812-818b-fefda5f2436d/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:27:17 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7eeb145-1565-4812-818b-fefda5f2436d/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:27:17 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: 91c62531-62f9-4f17-914c-11edc5010b54] Instance destroyed successfully.
Oct 26 00:27:17 user nova-compute[75165]: DEBUG nova.objects.instance [None req-61c290d9-0c96-4d0d-b8e7-7b21f6517ef6 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Lazy-loading 'resources' on Instance uuid 91c62531-62f9-4f17-914c-11edc5010b54 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:27:17 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-61c290d9-0c96-4d0d-b8e7-7b21f6517ef6 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:23:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-458420097',display_name='tempest-VolumesSnapshotTestJSON-instance-458420097',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-458420097',id=29,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCUFJ542m4EQF4GLsHDGK3DhvJTpq/I9HCX9CEVTbeMR/PgJyJsAlaax4d8zX8eZcrMJi5ajyQQHnWVQNJULlSaYjv2PNnnQAV/Lwov9mpiKMXXssgCsM15ioIYwhOc9mg==',key_name='tempest-keypair-479927283',keypairs=<?>,launch_index=0,launched_at=2023-10-26T00:23:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9eed16e1778f4ffb93afcc1ddbfe3d72',ramdisk_id='',reservation_id='r-kikdnv09',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1190581483',owner_user_name='tempest-VolumesSnapshotTestJSON-1190581483-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T00:23:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7cd8b7fb014340bcb4efbe7a0063cdc7',uuid=91c62531-62f9-4f17-914c-11edc5010b54,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "355e1ddf-4d49-4a04-8a77-e05df100b323", "address": "fa:16:3e:61:d7:b9", "network": {"id": "6b000f11-7be2-4a26-ba67-b10f275e8560", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1605988141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eed16e1778f4ffb93afcc1ddbfe3d72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap355e1ddf-4d", "ovs_interfaceid": "355e1ddf-4d49-4a04-8a77-e05df100b323", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 00:27:17 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-61c290d9-0c96-4d0d-b8e7-7b21f6517ef6 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Converting VIF {"id": "355e1ddf-4d49-4a04-8a77-e05df100b323", "address": "fa:16:3e:61:d7:b9", "network": {"id": "6b000f11-7be2-4a26-ba67-b10f275e8560", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1605988141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eed16e1778f4ffb93afcc1ddbfe3d72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap355e1ddf-4d", "ovs_interfaceid": "355e1ddf-4d49-4a04-8a77-e05df100b323", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:27:18 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-61c290d9-0c96-4d0d-b8e7-7b21f6517ef6 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:61:d7:b9,bridge_name='br-int',has_traffic_filtering=True,id=355e1ddf-4d49-4a04-8a77-e05df100b323,network=Network(6b000f11-7be2-4a26-ba67-b10f275e8560),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap355e1ddf-4d') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:27:18 user nova-compute[75165]: DEBUG os_vif [None req-61c290d9-0c96-4d0d-b8e7-7b21f6517ef6 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:61:d7:b9,bridge_name='br-int',has_traffic_filtering=True,id=355e1ddf-4d49-4a04-8a77-e05df100b323,network=Network(6b000f11-7be2-4a26-ba67-b10f275e8560),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap355e1ddf-4d') {{(pid=75165) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 00:27:18 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:27:18 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap355e1ddf-4d, bridge=br-int, if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:27:18 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:27:18 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:27:18 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:27:18 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=686da31a-21c7-4086-b9e2-1625101f67be) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:27:18 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:27:18 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:27:18 user nova-compute[75165]: INFO os_vif [None req-61c290d9-0c96-4d0d-b8e7-7b21f6517ef6 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:61:d7:b9,bridge_name='br-int',has_traffic_filtering=True,id=355e1ddf-4d49-4a04-8a77-e05df100b323,network=Network(6b000f11-7be2-4a26-ba67-b10f275e8560),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap355e1ddf-4d')
Oct 26 00:27:18 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61c290d9-0c96-4d0d-b8e7-7b21f6517ef6 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] [instance: 91c62531-62f9-4f17-914c-11edc5010b54] calling os-brick to detach iSCSI Volume {{(pid=75165) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 00:27:18 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-61c290d9-0c96-4d0d-b8e7-7b21f6517ef6 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8bf8160e50>, {'target_iqn': 'iqn.2010-10.org.openstack:d8e60b0c-7a47-46fd-a330-5d78f73e659f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FBMzcVRh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:27:18 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-61c290d9-0c96-4d0d-b8e7-7b21f6517ef6 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:27:18 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-61c290d9-0c96-4d0d-b8e7-7b21f6517ef6 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:27:18 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-61c290d9-0c96-4d0d-b8e7-7b21f6517ef6 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:27:18 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:27:18 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:27:18 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[834efc60-4d69-4bf8-a6ed-d0747067bd25]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ff19ba88-2bf9-451f-afcc-e149c1578b95\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:27:18 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-61c290d9-0c96-4d0d-b8e7-7b21f6517ef6 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 00:27:18 user nova-compute[75165]: No targets found.
Oct 26 00:27:18 user nova-compute[75165]: iSNS:
Oct 26 00:27:18 user nova-compute[75165]: No targets found.
Oct 26 00:27:18 user nova-compute[75165]: STATIC:
Oct 26 00:27:18 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795
Oct 26 00:27:18 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:27:18 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:27:18 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:ff19ba88-2bf9-451f-afcc-e149c1578b95
Oct 26 00:27:18 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:27:18 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:27:18 user nova-compute[75165]: FIRMWARE:
Oct 26 00:27:18 user nova-compute[75165]: No targets found.
Oct 26 00:27:18 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:27:18 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-61c290d9-0c96-4d0d-b8e7-7b21f6517ef6 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 00:27:18 user nova-compute[75165]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 00:27:18 user nova-compute[75165]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75165) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 00:27:18 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-61c290d9-0c96-4d0d-b8e7-7b21f6517ef6 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d8e60b0c-7a47-46fd-a330-5d78f73e659f', 0)] {{(pid=75165) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 00:27:18 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:27:18 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:27:18 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f30094d-9b81-4305-8a3f-869d20842abd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ff19ba88-2bf9-451f-afcc-e149c1578b95\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:27:18 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:27:18 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:27:18 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[69512bc9-0bc0-4989-bd7d-a4f32da20046]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff19ba88-2bf9-451f-afcc-e149c1578b95 (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:27:18 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-61c290d9-0c96-4d0d-b8e7-7b21f6517ef6 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)
Oct 26 00:27:18 user nova-compute[75165]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff19ba88-2bf9-451f-afcc-e149c1578b95 (non-flash)
Oct 26 00:27:18 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:27:18 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-61c290d9-0c96-4d0d-b8e7-7b21f6517ef6 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)
Oct 26 00:27:18 user nova-compute[75165]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff19ba88-2bf9-451f-afcc-e149c1578b95 (non-flash)
Oct 26 00:27:18 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:27:18 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-61c290d9-0c96-4d0d-b8e7-7b21f6517ef6 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8bf8267d90>, {}) {{(pid=75165) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 00:27:18 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-61c290d9-0c96-4d0d-b8e7-7b21f6517ef6 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Disconnecting from: [] {{(pid=75165) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 00:27:18 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-61c290d9-0c96-4d0d-b8e7-7b21f6517ef6 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.077s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:27:18 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-61c290d9-0c96-4d0d-b8e7-7b21f6517ef6 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] <== disconnect_volume: return (79ms) None {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:27:18 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61c290d9-0c96-4d0d-b8e7-7b21f6517ef6 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] [instance: 91c62531-62f9-4f17-914c-11edc5010b54] Disconnected iSCSI Volume {{(pid=75165) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 00:27:18 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-61c290d9-0c96-4d0d-b8e7-7b21f6517ef6 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] [instance: 91c62531-62f9-4f17-914c-11edc5010b54] Deleting instance files /opt/stack/data/nova/instances/91c62531-62f9-4f17-914c-11edc5010b54_del
Oct 26 00:27:18 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-61c290d9-0c96-4d0d-b8e7-7b21f6517ef6 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] [instance: 91c62531-62f9-4f17-914c-11edc5010b54] Deletion of /opt/stack/data/nova/instances/91c62531-62f9-4f17-914c-11edc5010b54_del complete
Oct 26 00:27:18 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7eeb145-1565-4812-818b-fefda5f2436d/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:27:18 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Periodic task is updating the host stats, it is trying to get disk info for instance-0000001d, but the backing disk storage was removed by a concurrent operation such as resize. Error: No disk at /opt/stack/data/nova/instances/91c62531-62f9-4f17-914c-11edc5010b54/disk: nova.exception.DiskNotFound: No disk at /opt/stack/data/nova/instances/91c62531-62f9-4f17-914c-11edc5010b54/disk
Oct 26 00:27:18 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3c87b07-5c16-4f45-b320-06d3503d23e6/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:27:18 user nova-compute[75165]: INFO nova.compute.manager [None req-61c290d9-0c96-4d0d-b8e7-7b21f6517ef6 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] [instance: 91c62531-62f9-4f17-914c-11edc5010b54] Took 1.00 seconds to destroy the instance on the hypervisor.
Oct 26 00:27:18 user nova-compute[75165]: DEBUG oslo.service.loopingcall [None req-61c290d9-0c96-4d0d-b8e7-7b21f6517ef6 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75165) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 00:27:18 user nova-compute[75165]: DEBUG nova.compute.manager [-] [instance: 91c62531-62f9-4f17-914c-11edc5010b54] Deallocating network for instance {{(pid=75165) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 00:27:18 user nova-compute[75165]: DEBUG nova.network.neutron [-] [instance: 91c62531-62f9-4f17-914c-11edc5010b54] deallocate_for_instance() {{(pid=75165) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 00:27:18 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3c87b07-5c16-4f45-b320-06d3503d23e6/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:27:18 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3c87b07-5c16-4f45-b320-06d3503d23e6/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:27:18 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3c87b07-5c16-4f45-b320-06d3503d23e6/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:27:18 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce058b47-d96f-4341-9104-1fa71ca2c997/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:27:18 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce058b47-d96f-4341-9104-1fa71ca2c997/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:27:18 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce058b47-d96f-4341-9104-1fa71ca2c997/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:27:18 user nova-compute[75165]: DEBUG nova.network.neutron [-] [instance: 91c62531-62f9-4f17-914c-11edc5010b54] Updating instance_info_cache with network_info: [] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:27:18 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce058b47-d96f-4341-9104-1fa71ca2c997/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:27:18 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75165) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 00:27:18 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe2984ce-8958-4049-8af7-496b313b26c8/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:27:19 user nova-compute[75165]: INFO nova.compute.manager [-] [instance: 91c62531-62f9-4f17-914c-11edc5010b54] Took 0.80 seconds to deallocate network for instance.
Oct 26 00:27:19 user nova-compute[75165]: WARNING nova.volume.cinder [None req-61c290d9-0c96-4d0d-b8e7-7b21f6517ef6 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Attachment ccd11f28-732b-47ac-bfdb-df90c94ab23a does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = ccd11f28-732b-47ac-bfdb-df90c94ab23a. (HTTP 404) (Request-ID: req-38c8e0ce-d6e1-40e7-af88-6cf89b6eb661)
Oct 26 00:27:19 user nova-compute[75165]: INFO nova.compute.manager [None req-61c290d9-0c96-4d0d-b8e7-7b21f6517ef6 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] [instance: 91c62531-62f9-4f17-914c-11edc5010b54] Took 0.03 seconds to detach 1 volumes for instance.
Oct 26 00:27:19 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-61c290d9-0c96-4d0d-b8e7-7b21f6517ef6 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:27:19 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-61c290d9-0c96-4d0d-b8e7-7b21f6517ef6 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:27:19 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe2984ce-8958-4049-8af7-496b313b26c8/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:27:19 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe2984ce-8958-4049-8af7-496b313b26c8/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:27:19 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe2984ce-8958-4049-8af7-496b313b26c8/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:27:19 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-61c290d9-0c96-4d0d-b8e7-7b21f6517ef6 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:27:19 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-61c290d9-0c96-4d0d-b8e7-7b21f6517ef6 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:27:19 user nova-compute[75165]: DEBUG nova.compute.manager [req-7b7a6f47-4347-4b9e-8d21-bb6904284df0 req-2c23c536-f368-4728-b731-e92701dc5c24 service nova] [instance: 91c62531-62f9-4f17-914c-11edc5010b54] Received event network-vif-plugged-355e1ddf-4d49-4a04-8a77-e05df100b323 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:27:19 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-7b7a6f47-4347-4b9e-8d21-bb6904284df0 req-2c23c536-f368-4728-b731-e92701dc5c24 service nova] Acquiring lock "91c62531-62f9-4f17-914c-11edc5010b54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:27:19 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-7b7a6f47-4347-4b9e-8d21-bb6904284df0 req-2c23c536-f368-4728-b731-e92701dc5c24 service nova] Lock "91c62531-62f9-4f17-914c-11edc5010b54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:27:19 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-7b7a6f47-4347-4b9e-8d21-bb6904284df0 req-2c23c536-f368-4728-b731-e92701dc5c24 service nova] Lock "91c62531-62f9-4f17-914c-11edc5010b54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:27:19 user nova-compute[75165]: DEBUG nova.compute.manager [req-7b7a6f47-4347-4b9e-8d21-bb6904284df0 req-2c23c536-f368-4728-b731-e92701dc5c24 service nova] [instance: 91c62531-62f9-4f17-914c-11edc5010b54] No waiting events found dispatching network-vif-plugged-355e1ddf-4d49-4a04-8a77-e05df100b323 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:27:19 user nova-compute[75165]: WARNING nova.compute.manager [req-7b7a6f47-4347-4b9e-8d21-bb6904284df0 req-2c23c536-f368-4728-b731-e92701dc5c24 service nova] [instance: 91c62531-62f9-4f17-914c-11edc5010b54] Received unexpected event network-vif-plugged-355e1ddf-4d49-4a04-8a77-e05df100b323 for instance with vm_state deleted and task_state None.
Oct 26 00:27:19 user nova-compute[75165]: DEBUG nova.compute.manager [req-7b7a6f47-4347-4b9e-8d21-bb6904284df0 req-2c23c536-f368-4728-b731-e92701dc5c24 service nova] [instance: 91c62531-62f9-4f17-914c-11edc5010b54] Received event network-vif-deleted-355e1ddf-4d49-4a04-8a77-e05df100b323 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:27:19 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:27:19 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:27:19 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Hypervisor/Node resource view: name=user free_ram=8169MB free_disk=24.845523834228516GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75165) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 00:27:19 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:27:19 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-61c290d9-0c96-4d0d-b8e7-7b21f6517ef6 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.663s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:27:19 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.018s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:27:19 user nova-compute[75165]: INFO nova.scheduler.client.report [None req-61c290d9-0c96-4d0d-b8e7-7b21f6517ef6 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Deleted allocations for instance 91c62531-62f9-4f17-914c-11edc5010b54
Oct 26 00:27:19 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-61c290d9-0c96-4d0d-b8e7-7b21f6517ef6 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Lock "91c62531-62f9-4f17-914c-11edc5010b54" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.735s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:27:19 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance a7eeb145-1565-4812-818b-fefda5f2436d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:27:19 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 97fb67a7-637d-456f-b4dd-0a271ed6cfc4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:27:19 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:27:19 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance ce058b47-d96f-4341-9104-1fa71ca2c997 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:27:19 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance fe2984ce-8958-4049-8af7-496b313b26c8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:27:19 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance b3c87b07-5c16-4f45-b320-06d3503d23e6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:27:19 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75165) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 00:27:19 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75165) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 00:27:20 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:27:20 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:27:20 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Compute_service record updated for user:user {{(pid=75165) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 00:27:20 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.408s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:27:21 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:27:21 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:27:21 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:27:21 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:27:21 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:27:23 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:27:26 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:27:28 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:27:33 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:27:33 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:27:33 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75165) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 00:27:33 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75165) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 00:27:33 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75165) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 00:27:33 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:27:34 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-439e3920-0612-47fd-b054-a738c79fe579 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Acquiring lock "a7eeb145-1565-4812-818b-fefda5f2436d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:27:34 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-439e3920-0612-47fd-b054-a738c79fe579 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Lock "a7eeb145-1565-4812-818b-fefda5f2436d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:27:34 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-439e3920-0612-47fd-b054-a738c79fe579 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Acquiring lock "a7eeb145-1565-4812-818b-fefda5f2436d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:27:34 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-439e3920-0612-47fd-b054-a738c79fe579 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Lock "a7eeb145-1565-4812-818b-fefda5f2436d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:27:34 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-439e3920-0612-47fd-b054-a738c79fe579 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Lock "a7eeb145-1565-4812-818b-fefda5f2436d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:27:34 user nova-compute[75165]: INFO nova.compute.manager [None req-439e3920-0612-47fd-b054-a738c79fe579 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: a7eeb145-1565-4812-818b-fefda5f2436d] Terminating instance
Oct 26 00:27:34 user nova-compute[75165]: DEBUG nova.compute.manager [None req-439e3920-0612-47fd-b054-a738c79fe579 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: a7eeb145-1565-4812-818b-fefda5f2436d] Start destroying the instance on the hypervisor. {{(pid=75165) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 00:27:34 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:27:34 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:27:34 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:27:34 user nova-compute[75165]: DEBUG nova.compute.manager [req-80b78aa2-e06b-47e6-9a79-cd5b132d3041 req-93a290cd-74a5-4c66-9c38-a04de1e8025a service nova] [instance: a7eeb145-1565-4812-818b-fefda5f2436d] Received event network-vif-unplugged-7a43d085-a683-4c49-a7c8-13b8f35c943d {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:27:34 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-80b78aa2-e06b-47e6-9a79-cd5b132d3041 req-93a290cd-74a5-4c66-9c38-a04de1e8025a service nova] Acquiring lock "a7eeb145-1565-4812-818b-fefda5f2436d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:27:34 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-80b78aa2-e06b-47e6-9a79-cd5b132d3041 req-93a290cd-74a5-4c66-9c38-a04de1e8025a service nova] Lock "a7eeb145-1565-4812-818b-fefda5f2436d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:27:34 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-80b78aa2-e06b-47e6-9a79-cd5b132d3041 req-93a290cd-74a5-4c66-9c38-a04de1e8025a service nova] Lock "a7eeb145-1565-4812-818b-fefda5f2436d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:27:34 user nova-compute[75165]: DEBUG nova.compute.manager [req-80b78aa2-e06b-47e6-9a79-cd5b132d3041 req-93a290cd-74a5-4c66-9c38-a04de1e8025a service nova] [instance: a7eeb145-1565-4812-818b-fefda5f2436d] No waiting events found dispatching network-vif-unplugged-7a43d085-a683-4c49-a7c8-13b8f35c943d {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:27:34 user nova-compute[75165]: DEBUG nova.compute.manager [req-80b78aa2-e06b-47e6-9a79-cd5b132d3041 req-93a290cd-74a5-4c66-9c38-a04de1e8025a service nova] [instance: a7eeb145-1565-4812-818b-fefda5f2436d] Received event network-vif-unplugged-7a43d085-a683-4c49-a7c8-13b8f35c943d for instance with task_state deleting. {{(pid=75165) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 00:27:35 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: a7eeb145-1565-4812-818b-fefda5f2436d] Instance destroyed successfully.
Oct 26 00:27:35 user nova-compute[75165]: DEBUG nova.objects.instance [None req-439e3920-0612-47fd-b054-a738c79fe579 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Lazy-loading 'resources' on Instance uuid a7eeb145-1565-4812-818b-fefda5f2436d {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:27:35 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-439e3920-0612-47fd-b054-a738c79fe579 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:07:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-626914428',display_name='tempest-ServerActionsTestOtherA-server-626914428',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-626914428',id=5,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOtsEaxSd5nKie4b+oTvKYqMVt06ToquYp528kCMFq0uGoZPhLpZteN38KkhJxhsHSzqyfMtJ24GLZPdcByyVczoa0tAnbSbuiNOiWj1Q2SiBRytz34zgMiDTwdnF2ayTw==',key_name='tempest-keypair-1300111',keypairs=<?>,launch_index=0,launched_at=2023-10-26T00:07:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2911497df44047d9a9ee36a5652298bc',ramdisk_id='',reservation_id='r-0fmnza9p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1690932306',owner_user_name='tempest-ServerActionsTestOtherA-1690932306-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T00:07:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b3ce94f4c01446ebf79a1eba3833e01',uuid=a7eeb145-1565-4812-818b-fefda5f2436d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7a43d085-a683-4c49-a7c8-13b8f35c943d", "address": "fa:16:3e:e8:63:41", "network": {"id": "bd1c84f9-bba9-4a23-8bf2-17e65022136a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1557945804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2911497df44047d9a9ee36a5652298bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a43d085-a6", "ovs_interfaceid": "7a43d085-a683-4c49-a7c8-13b8f35c943d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 00:27:35 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-439e3920-0612-47fd-b054-a738c79fe579 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Converting VIF {"id": "7a43d085-a683-4c49-a7c8-13b8f35c943d", "address": "fa:16:3e:e8:63:41", "network": {"id": "bd1c84f9-bba9-4a23-8bf2-17e65022136a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1557945804-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2911497df44047d9a9ee36a5652298bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a43d085-a6", "ovs_interfaceid": "7a43d085-a683-4c49-a7c8-13b8f35c943d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:27:35 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-439e3920-0612-47fd-b054-a738c79fe579 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e8:63:41,bridge_name='br-int',has_traffic_filtering=True,id=7a43d085-a683-4c49-a7c8-13b8f35c943d,network=Network(bd1c84f9-bba9-4a23-8bf2-17e65022136a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a43d085-a6') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:27:35 user nova-compute[75165]: DEBUG os_vif [None req-439e3920-0612-47fd-b054-a738c79fe579 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e8:63:41,bridge_name='br-int',has_traffic_filtering=True,id=7a43d085-a683-4c49-a7c8-13b8f35c943d,network=Network(bd1c84f9-bba9-4a23-8bf2-17e65022136a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a43d085-a6') {{(pid=75165) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 00:27:35 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:27:35 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7a43d085-a6, bridge=br-int, if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:27:35 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:27:35 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:27:35 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:27:35 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2169deac-3018-482d-9f7a-a05665c00954) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:27:35 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:27:35 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:27:35 user nova-compute[75165]: INFO os_vif [None req-439e3920-0612-47fd-b054-a738c79fe579 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e8:63:41,bridge_name='br-int',has_traffic_filtering=True,id=7a43d085-a683-4c49-a7c8-13b8f35c943d,network=Network(bd1c84f9-bba9-4a23-8bf2-17e65022136a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a43d085-a6')
Oct 26 00:27:35 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-439e3920-0612-47fd-b054-a738c79fe579 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: a7eeb145-1565-4812-818b-fefda5f2436d] Deleting instance files /opt/stack/data/nova/instances/a7eeb145-1565-4812-818b-fefda5f2436d_del
Oct 26 00:27:35 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-439e3920-0612-47fd-b054-a738c79fe579 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: a7eeb145-1565-4812-818b-fefda5f2436d] Deletion of /opt/stack/data/nova/instances/a7eeb145-1565-4812-818b-fefda5f2436d_del complete
Oct 26 00:27:35 user nova-compute[75165]: INFO nova.compute.manager [None req-439e3920-0612-47fd-b054-a738c79fe579 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] [instance: a7eeb145-1565-4812-818b-fefda5f2436d] Took 0.90 seconds to destroy the instance on the hypervisor.
Oct 26 00:27:35 user nova-compute[75165]: DEBUG oslo.service.loopingcall [None req-439e3920-0612-47fd-b054-a738c79fe579 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75165) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 00:27:35 user nova-compute[75165]: DEBUG nova.compute.manager [-] [instance: a7eeb145-1565-4812-818b-fefda5f2436d] Deallocating network for instance {{(pid=75165) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 00:27:35 user nova-compute[75165]: DEBUG nova.network.neutron [-] [instance: a7eeb145-1565-4812-818b-fefda5f2436d] deallocate_for_instance() {{(pid=75165) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 00:27:35 user nova-compute[75165]: DEBUG nova.network.neutron [-] [instance: a7eeb145-1565-4812-818b-fefda5f2436d] Updating instance_info_cache with network_info: [] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:27:35 user nova-compute[75165]: INFO nova.compute.manager [-] [instance: a7eeb145-1565-4812-818b-fefda5f2436d] Took 0.51 seconds to deallocate network for instance.
Oct 26 00:27:35 user nova-compute[75165]: DEBUG nova.compute.manager [req-caaa7fea-7df3-4e9d-916c-3ca566965819 req-f417c97a-7a46-41ea-9b3d-0b6a991255dc service nova] [instance: a7eeb145-1565-4812-818b-fefda5f2436d] Received event network-vif-deleted-7a43d085-a683-4c49-a7c8-13b8f35c943d {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:27:35 user nova-compute[75165]: INFO nova.compute.manager [req-caaa7fea-7df3-4e9d-916c-3ca566965819 req-f417c97a-7a46-41ea-9b3d-0b6a991255dc service nova] [instance: a7eeb145-1565-4812-818b-fefda5f2436d] Neutron deleted interface 7a43d085-a683-4c49-a7c8-13b8f35c943d; detaching it from the instance and deleting it from the info cache
Oct 26 00:27:35 user nova-compute[75165]: DEBUG nova.network.neutron [req-caaa7fea-7df3-4e9d-916c-3ca566965819 req-f417c97a-7a46-41ea-9b3d-0b6a991255dc service nova] [instance: a7eeb145-1565-4812-818b-fefda5f2436d] Updating instance_info_cache with network_info: [] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:27:35 user nova-compute[75165]: DEBUG nova.compute.manager [req-caaa7fea-7df3-4e9d-916c-3ca566965819 req-f417c97a-7a46-41ea-9b3d-0b6a991255dc service nova] [instance: a7eeb145-1565-4812-818b-fefda5f2436d] Detach interface failed, port_id=7a43d085-a683-4c49-a7c8-13b8f35c943d, reason: Instance a7eeb145-1565-4812-818b-fefda5f2436d could not be found. {{(pid=75165) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 26 00:27:35 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-439e3920-0612-47fd-b054-a738c79fe579 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:27:35 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-439e3920-0612-47fd-b054-a738c79fe579 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:27:35 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-439e3920-0612-47fd-b054-a738c79fe579 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:27:36 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-439e3920-0612-47fd-b054-a738c79fe579 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:27:36 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-439e3920-0612-47fd-b054-a738c79fe579 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.311s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:27:36 user nova-compute[75165]: INFO nova.scheduler.client.report [None req-439e3920-0612-47fd-b054-a738c79fe579 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Deleted allocations for instance a7eeb145-1565-4812-818b-fefda5f2436d
Oct 26 00:27:36 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-439e3920-0612-47fd-b054-a738c79fe579 tempest-ServerActionsTestOtherA-1690932306 tempest-ServerActionsTestOtherA-1690932306-project-member] Lock "a7eeb145-1565-4812-818b-fefda5f2436d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.930s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:27:36 user nova-compute[75165]: DEBUG nova.compute.manager [req-a0fe2f6c-9720-4bcd-8b62-e11e51daee20 req-bd06ae9a-266e-4f0b-acd6-6604869f2de4 service nova] [instance: a7eeb145-1565-4812-818b-fefda5f2436d] Received event network-vif-plugged-7a43d085-a683-4c49-a7c8-13b8f35c943d {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:27:36 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-a0fe2f6c-9720-4bcd-8b62-e11e51daee20 req-bd06ae9a-266e-4f0b-acd6-6604869f2de4 service nova] Acquiring lock "a7eeb145-1565-4812-818b-fefda5f2436d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:27:36 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-a0fe2f6c-9720-4bcd-8b62-e11e51daee20 req-bd06ae9a-266e-4f0b-acd6-6604869f2de4 service nova] Lock "a7eeb145-1565-4812-818b-fefda5f2436d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:27:36 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-a0fe2f6c-9720-4bcd-8b62-e11e51daee20 req-bd06ae9a-266e-4f0b-acd6-6604869f2de4 service nova] Lock "a7eeb145-1565-4812-818b-fefda5f2436d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:27:36 user nova-compute[75165]: DEBUG nova.compute.manager [req-a0fe2f6c-9720-4bcd-8b62-e11e51daee20 req-bd06ae9a-266e-4f0b-acd6-6604869f2de4 service nova] [instance: a7eeb145-1565-4812-818b-fefda5f2436d] No waiting events found dispatching network-vif-plugged-7a43d085-a683-4c49-a7c8-13b8f35c943d {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:27:36 user nova-compute[75165]: WARNING nova.compute.manager [req-a0fe2f6c-9720-4bcd-8b62-e11e51daee20 req-bd06ae9a-266e-4f0b-acd6-6604869f2de4 service nova] [instance: a7eeb145-1565-4812-818b-fefda5f2436d] Received unexpected event network-vif-plugged-7a43d085-a683-4c49-a7c8-13b8f35c943d for instance with vm_state deleted and task_state None.
Oct 26 00:27:40 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:27:45 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:27:45 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:27:45 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75165) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 00:27:45 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75165) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 00:27:45 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75165) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 00:27:45 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:27:50 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:27:55 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:28:00 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:28:05 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:28:10 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:28:10 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:28:10 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75165) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 00:28:10 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75165) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 00:28:10 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75165) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 00:28:10 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:28:10 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:28:10 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75165) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 00:28:15 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:28:15 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:28:15 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:28:17 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:28:17 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:28:17 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Starting heal instance info cache {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 00:28:17 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Rebuilding the list of instances to heal {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 00:28:18 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "refresh_cache-97fb67a7-637d-456f-b4dd-0a271ed6cfc4" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:28:18 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquired lock "refresh_cache-97fb67a7-637d-456f-b4dd-0a271ed6cfc4" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:28:18 user nova-compute[75165]: DEBUG nova.network.neutron [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: 97fb67a7-637d-456f-b4dd-0a271ed6cfc4] Forcefully refreshing network info cache for instance {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 00:28:18 user nova-compute[75165]: DEBUG nova.objects.instance [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lazy-loading 'info_cache' on Instance uuid 97fb67a7-637d-456f-b4dd-0a271ed6cfc4 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:28:18 user nova-compute[75165]: DEBUG nova.network.neutron [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: 97fb67a7-637d-456f-b4dd-0a271ed6cfc4] Updating instance_info_cache with network_info: [{"id": "254ea53c-6da9-46d5-a139-7926008cdf8b", "address": "fa:16:3e:08:21:2a", "network": {"id": "eb55c0bc-cae5-4ba3-851a-e31a50b52c88", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1081223830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d616862c7c184de5b0ba3121552c5666", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap254ea53c-6d", "ovs_interfaceid": "254ea53c-6da9-46d5-a139-7926008cdf8b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:28:18 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Releasing lock "refresh_cache-97fb67a7-637d-456f-b4dd-0a271ed6cfc4" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:28:18 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: 97fb67a7-637d-456f-b4dd-0a271ed6cfc4] Updated the network info_cache for instance {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 00:28:18 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:28:18 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:28:18 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:28:18 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:28:18 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:28:18 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:28:18 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75165) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 00:28:18 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75165) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 00:28:18 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97fb67a7-637d-456f-b4dd-0a271ed6cfc4/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:28:18 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97fb67a7-637d-456f-b4dd-0a271ed6cfc4/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:28:18 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97fb67a7-637d-456f-b4dd-0a271ed6cfc4/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:28:19 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97fb67a7-637d-456f-b4dd-0a271ed6cfc4/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:28:19 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3c87b07-5c16-4f45-b320-06d3503d23e6/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:28:19 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3c87b07-5c16-4f45-b320-06d3503d23e6/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:28:19 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3c87b07-5c16-4f45-b320-06d3503d23e6/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:28:19 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3c87b07-5c16-4f45-b320-06d3503d23e6/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:28:19 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce058b47-d96f-4341-9104-1fa71ca2c997/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:28:19 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce058b47-d96f-4341-9104-1fa71ca2c997/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:28:19 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce058b47-d96f-4341-9104-1fa71ca2c997/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:28:20 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce058b47-d96f-4341-9104-1fa71ca2c997/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:28:20 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75165) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 00:28:20 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe2984ce-8958-4049-8af7-496b313b26c8/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:28:20 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:28:20 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe2984ce-8958-4049-8af7-496b313b26c8/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:28:20 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe2984ce-8958-4049-8af7-496b313b26c8/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:28:20 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe2984ce-8958-4049-8af7-496b313b26c8/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:28:20 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:28:20 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:28:20 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Hypervisor/Node resource view: name=user free_ram=8508MB free_disk=24.888916015625GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75165) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 00:28:20 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:28:20 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:28:21 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 97fb67a7-637d-456f-b4dd-0a271ed6cfc4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:28:21 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:28:21 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance ce058b47-d96f-4341-9104-1fa71ca2c997 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:28:21 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance fe2984ce-8958-4049-8af7-496b313b26c8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:28:21 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance b3c87b07-5c16-4f45-b320-06d3503d23e6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:28:21 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75165) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 00:28:21 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75165) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 00:28:21 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Refreshing inventories for resource provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 26 00:28:21 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Updating ProviderTree inventory for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 26 00:28:21 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Updating inventory in ProviderTree for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 26 00:28:21 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Refreshing aggregate associations for resource provider 03214fd5-21d1-46ec-b6b0-6449b77ba230, aggregates: None {{(pid=75165) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 26 00:28:21 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Refreshing trait associations for resource provider 03214fd5-21d1-46ec-b6b0-6449b77ba230, traits: COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NODE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_TRUSTED_CERTS,COMPUTE_DEVICE_TAGGING,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO {{(pid=75165) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 26 00:28:21 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:28:21 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:28:21 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Compute_service record updated for user:user {{(pid=75165) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 00:28:21 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.712s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:28:21 user nova-compute[75165]: DEBUG nova.compute.manager [req-859b71b0-0962-4d97-9d24-b0f4ccc02f24 req-bdc97758-b2be-4af4-bbe3-ba0601acaf2e service nova] [instance: fe2984ce-8958-4049-8af7-496b313b26c8] Received event network-changed-5995df96-1576-4616-8834-45073add32a2 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:28:21 user nova-compute[75165]: DEBUG nova.compute.manager [req-859b71b0-0962-4d97-9d24-b0f4ccc02f24 req-bdc97758-b2be-4af4-bbe3-ba0601acaf2e service nova] [instance: fe2984ce-8958-4049-8af7-496b313b26c8] Refreshing instance network info cache due to event network-changed-5995df96-1576-4616-8834-45073add32a2. {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 00:28:21 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-859b71b0-0962-4d97-9d24-b0f4ccc02f24 req-bdc97758-b2be-4af4-bbe3-ba0601acaf2e service nova] Acquiring lock "refresh_cache-fe2984ce-8958-4049-8af7-496b313b26c8" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:28:21 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-859b71b0-0962-4d97-9d24-b0f4ccc02f24 req-bdc97758-b2be-4af4-bbe3-ba0601acaf2e service nova] Acquired lock "refresh_cache-fe2984ce-8958-4049-8af7-496b313b26c8" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:28:21 user nova-compute[75165]: DEBUG nova.network.neutron [req-859b71b0-0962-4d97-9d24-b0f4ccc02f24 req-bdc97758-b2be-4af4-bbe3-ba0601acaf2e service nova] [instance: fe2984ce-8958-4049-8af7-496b313b26c8] Refreshing network info cache for port 5995df96-1576-4616-8834-45073add32a2 {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 00:28:22 user nova-compute[75165]: DEBUG nova.network.neutron [req-859b71b0-0962-4d97-9d24-b0f4ccc02f24 req-bdc97758-b2be-4af4-bbe3-ba0601acaf2e service nova] [instance: fe2984ce-8958-4049-8af7-496b313b26c8] Updated VIF entry in instance network info cache for port 5995df96-1576-4616-8834-45073add32a2. {{(pid=75165) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 00:28:22 user nova-compute[75165]: DEBUG nova.network.neutron [req-859b71b0-0962-4d97-9d24-b0f4ccc02f24 req-bdc97758-b2be-4af4-bbe3-ba0601acaf2e service nova] [instance: fe2984ce-8958-4049-8af7-496b313b26c8] Updating instance_info_cache with network_info: [{"id": "5995df96-1576-4616-8834-45073add32a2", "address": "fa:16:3e:ca:36:c4", "network": {"id": "7c8ed206-c41f-4c32-837b-b50fb4ee5479", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1704810529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "567a90e8d8b24ca4b5e5da923d537134", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5995df96-15", "ovs_interfaceid": "5995df96-1576-4616-8834-45073add32a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:28:22 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-859b71b0-0962-4d97-9d24-b0f4ccc02f24 req-bdc97758-b2be-4af4-bbe3-ba0601acaf2e service nova] Releasing lock "refresh_cache-fe2984ce-8958-4049-8af7-496b313b26c8" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:28:22 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:28:22 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:28:25 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:28:26 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:28:27 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:28:27 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:28:30 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:28:30 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-99e35b3f-c528-456d-837c-73b7b206d335 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Acquiring lock "fe2984ce-8958-4049-8af7-496b313b26c8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:28:30 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-99e35b3f-c528-456d-837c-73b7b206d335 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Lock "fe2984ce-8958-4049-8af7-496b313b26c8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:28:30 user nova-compute[75165]: DEBUG nova.objects.instance [None req-99e35b3f-c528-456d-837c-73b7b206d335 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Lazy-loading 'flavor' on Instance uuid fe2984ce-8958-4049-8af7-496b313b26c8 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:28:30 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-99e35b3f-c528-456d-837c-73b7b206d335 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Lock "fe2984ce-8958-4049-8af7-496b313b26c8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:28:30 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-99e35b3f-c528-456d-837c-73b7b206d335 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Acquiring lock "fe2984ce-8958-4049-8af7-496b313b26c8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:28:30 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-99e35b3f-c528-456d-837c-73b7b206d335 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Lock "fe2984ce-8958-4049-8af7-496b313b26c8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:28:30 user nova-compute[75165]: INFO nova.compute.manager [None req-99e35b3f-c528-456d-837c-73b7b206d335 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] [instance: fe2984ce-8958-4049-8af7-496b313b26c8] Attaching volume d69dc6d8-04c4-41a5-bf87-04f0b01f1d09 to /dev/vdb
Oct 26 00:28:30 user nova-compute[75165]: DEBUG os_brick.utils [None req-99e35b3f-c528-456d-837c-73b7b206d335 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:28:30 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:28:30 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:28:30 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab8dc2bc-e0f1-48e9-8b24-17ad00ba0433]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa94814ccb35\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:28:30 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:28:30 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:28:30 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[a360798e-64ef-49bd-a7af-cc2d6d061b0c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:28:30 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:28:30 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:28:30 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a93c86b-a1f8-4f2b-8437-06ab807cd433]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:28:30 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ab7c08f-d55c-4179-a064-e1134a9f2455]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:28:30 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-99e35b3f-c528-456d-837c-73b7b206d335 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Running cmd (subprocess): nvme version {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:28:30 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-99e35b3f-c528-456d-837c-73b7b206d335 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] 'nvme version' failed. Not Retrying. {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 00:28:30 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.nvmeof [None req-99e35b3f-c528-456d-837c-73b7b206d335 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] nvme not present on system {{(pid=75165) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 00:28:30 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:28:30 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 00:28:30 user nova-compute[75165]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 00:28:30 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[b00632a7-bb70-4f0a-9ce3-0c28bba3a4e2]: (4, '') {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:28:30 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-99e35b3f-c528-456d-837c-73b7b206d335 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75165) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 00:28:30 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-99e35b3f-c528-456d-837c-73b7b206d335 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75165) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 00:28:30 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-99e35b3f-c528-456d-837c-73b7b206d335 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] LIGHTOS: no hostnqn found. {{(pid=75165) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 00:28:30 user nova-compute[75165]: DEBUG os_brick.utils [None req-99e35b3f-c528-456d-837c-73b7b206d335 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa94814ccb35', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:28:30 user nova-compute[75165]: DEBUG nova.virt.block_device [None req-99e35b3f-c528-456d-837c-73b7b206d335 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] [instance: fe2984ce-8958-4049-8af7-496b313b26c8] Updating existing volume attachment record: 292e46ce-bda1-4506-90c9-c5bffe3a313c {{(pid=75165) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 00:28:30 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:28:30 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Cleaning up deleted instances {{(pid=75165) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 26 00:28:30 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] There are 0 instances to clean {{(pid=75165) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 26 00:28:31 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:28:31 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-59aa34de-614a-4739-9983-53b14d5099fe tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Acquiring lock "bb77893d-263a-40a6-9acc-63fcd1481a38" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:28:31 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-59aa34de-614a-4739-9983-53b14d5099fe tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Lock "bb77893d-263a-40a6-9acc-63fcd1481a38" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:28:31 user nova-compute[75165]: DEBUG nova.compute.manager [None req-59aa34de-614a-4739-9983-53b14d5099fe tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] [instance: bb77893d-263a-40a6-9acc-63fcd1481a38] Starting instance... {{(pid=75165) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 00:28:32 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-59aa34de-614a-4739-9983-53b14d5099fe tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:28:32 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-59aa34de-614a-4739-9983-53b14d5099fe tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:28:32 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-59aa34de-614a-4739-9983-53b14d5099fe tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75165) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 00:28:32 user nova-compute[75165]: INFO nova.compute.claims [None req-59aa34de-614a-4739-9983-53b14d5099fe tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] [instance: bb77893d-263a-40a6-9acc-63fcd1481a38] Claim successful on node user
Oct 26 00:28:32 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-59aa34de-614a-4739-9983-53b14d5099fe tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:28:32 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-59aa34de-614a-4739-9983-53b14d5099fe tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:28:32 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-59aa34de-614a-4739-9983-53b14d5099fe tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.345s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:28:32 user nova-compute[75165]: DEBUG nova.compute.manager [None req-59aa34de-614a-4739-9983-53b14d5099fe tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] [instance: bb77893d-263a-40a6-9acc-63fcd1481a38] Start building networks asynchronously for instance. {{(pid=75165) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 00:28:32 user nova-compute[75165]: DEBUG nova.compute.manager [None req-59aa34de-614a-4739-9983-53b14d5099fe tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] [instance: bb77893d-263a-40a6-9acc-63fcd1481a38] Allocating IP information in the background. {{(pid=75165) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 00:28:32 user nova-compute[75165]: DEBUG nova.network.neutron [None req-59aa34de-614a-4739-9983-53b14d5099fe tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] [instance: bb77893d-263a-40a6-9acc-63fcd1481a38] allocate_for_instance() {{(pid=75165) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 00:28:32 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-59aa34de-614a-4739-9983-53b14d5099fe tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] [instance: bb77893d-263a-40a6-9acc-63fcd1481a38] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 00:28:32 user nova-compute[75165]: DEBUG nova.compute.manager [None req-59aa34de-614a-4739-9983-53b14d5099fe tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] [instance: bb77893d-263a-40a6-9acc-63fcd1481a38] Start building block device mappings for instance. {{(pid=75165) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 00:28:32 user nova-compute[75165]: DEBUG nova.policy [None req-59aa34de-614a-4739-9983-53b14d5099fe tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7cd8b7fb014340bcb4efbe7a0063cdc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9eed16e1778f4ffb93afcc1ddbfe3d72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75165) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 00:28:32 user nova-compute[75165]: DEBUG nova.compute.manager [None req-59aa34de-614a-4739-9983-53b14d5099fe tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] [instance: bb77893d-263a-40a6-9acc-63fcd1481a38] Start spawning the instance on the hypervisor. {{(pid=75165) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 00:28:32 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-59aa34de-614a-4739-9983-53b14d5099fe tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] [instance: bb77893d-263a-40a6-9acc-63fcd1481a38] Creating instance directory {{(pid=75165) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 00:28:32 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-59aa34de-614a-4739-9983-53b14d5099fe tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] [instance: bb77893d-263a-40a6-9acc-63fcd1481a38] Creating image(s)
Oct 26 00:28:32 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-59aa34de-614a-4739-9983-53b14d5099fe tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Acquiring lock "/opt/stack/data/nova/instances/bb77893d-263a-40a6-9acc-63fcd1481a38/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:28:32 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-59aa34de-614a-4739-9983-53b14d5099fe tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Lock "/opt/stack/data/nova/instances/bb77893d-263a-40a6-9acc-63fcd1481a38/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:28:32 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-59aa34de-614a-4739-9983-53b14d5099fe tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Lock "/opt/stack/data/nova/instances/bb77893d-263a-40a6-9acc-63fcd1481a38/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:28:32 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-59aa34de-614a-4739-9983-53b14d5099fe tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:28:32 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-59aa34de-614a-4739-9983-53b14d5099fe tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json" returned: 0 in 0.196s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:28:32 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-59aa34de-614a-4739-9983-53b14d5099fe tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Acquiring lock "7d3243421cf3fdc288b758f687a93103b7b95466" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:28:32 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-59aa34de-614a-4739-9983-53b14d5099fe tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Lock "7d3243421cf3fdc288b758f687a93103b7b95466" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:28:32 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-59aa34de-614a-4739-9983-53b14d5099fe tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:28:33 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-59aa34de-614a-4739-9983-53b14d5099fe tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json" returned: 0 in 0.193s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:28:33 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-59aa34de-614a-4739-9983-53b14d5099fe tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466,backing_fmt=raw /opt/stack/data/nova/instances/bb77893d-263a-40a6-9acc-63fcd1481a38/disk 1073741824 {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:28:33 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-59aa34de-614a-4739-9983-53b14d5099fe tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466,backing_fmt=raw /opt/stack/data/nova/instances/bb77893d-263a-40a6-9acc-63fcd1481a38/disk 1073741824" returned: 0 in 0.049s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:28:33 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-59aa34de-614a-4739-9983-53b14d5099fe tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Lock "7d3243421cf3fdc288b758f687a93103b7b95466" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:28:33 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-59aa34de-614a-4739-9983-53b14d5099fe tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:28:33 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-59aa34de-614a-4739-9983-53b14d5099fe tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json" returned: 0 in 0.185s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:28:33 user nova-compute[75165]: DEBUG nova.virt.disk.api [None req-59aa34de-614a-4739-9983-53b14d5099fe tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bb77893d-263a-40a6-9acc-63fcd1481a38/disk. size=1073741824 {{(pid=75165) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 00:28:33 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-59aa34de-614a-4739-9983-53b14d5099fe tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb77893d-263a-40a6-9acc-63fcd1481a38/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:28:33 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-59aa34de-614a-4739-9983-53b14d5099fe tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb77893d-263a-40a6-9acc-63fcd1481a38/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:28:33 user nova-compute[75165]: DEBUG nova.virt.disk.api [None req-59aa34de-614a-4739-9983-53b14d5099fe tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Cannot resize image /opt/stack/data/nova/instances/bb77893d-263a-40a6-9acc-63fcd1481a38/disk to a smaller size. {{(pid=75165) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 00:28:33 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-59aa34de-614a-4739-9983-53b14d5099fe tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] [instance: bb77893d-263a-40a6-9acc-63fcd1481a38] Created local disks {{(pid=75165) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 00:28:33 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-59aa34de-614a-4739-9983-53b14d5099fe tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] [instance: bb77893d-263a-40a6-9acc-63fcd1481a38] Ensure instance console log exists: /opt/stack/data/nova/instances/bb77893d-263a-40a6-9acc-63fcd1481a38/console.log {{(pid=75165) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 00:28:33 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-59aa34de-614a-4739-9983-53b14d5099fe tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:28:33 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-59aa34de-614a-4739-9983-53b14d5099fe tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:28:33 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-59aa34de-614a-4739-9983-53b14d5099fe tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:28:33 user nova-compute[75165]: DEBUG nova.network.neutron [None req-59aa34de-614a-4739-9983-53b14d5099fe tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] [instance: bb77893d-263a-40a6-9acc-63fcd1481a38] Successfully created port: f6053f89-f617-42db-8747-b5cc98ee387d {{(pid=75165) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 00:28:33 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:28:34 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:28:34 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75165) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 26 00:28:35 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:28:35 user nova-compute[75165]: DEBUG nova.network.neutron [None req-59aa34de-614a-4739-9983-53b14d5099fe tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] [instance: bb77893d-263a-40a6-9acc-63fcd1481a38] Successfully updated port: f6053f89-f617-42db-8747-b5cc98ee387d {{(pid=75165) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 00:28:35 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-59aa34de-614a-4739-9983-53b14d5099fe tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Acquiring lock "refresh_cache-bb77893d-263a-40a6-9acc-63fcd1481a38" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:28:35 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-59aa34de-614a-4739-9983-53b14d5099fe tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Acquired lock "refresh_cache-bb77893d-263a-40a6-9acc-63fcd1481a38" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:28:35 user nova-compute[75165]: DEBUG nova.network.neutron [None req-59aa34de-614a-4739-9983-53b14d5099fe tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] [instance: bb77893d-263a-40a6-9acc-63fcd1481a38] Building network info cache for instance {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 00:28:35 user nova-compute[75165]: DEBUG nova.compute.manager [req-3e73f58a-359a-445f-b4f0-ed5eb14d4f6a req-ff1421bb-4884-4aed-abdd-a1c5ff53675a service nova] [instance: bb77893d-263a-40a6-9acc-63fcd1481a38] Received event network-changed-f6053f89-f617-42db-8747-b5cc98ee387d {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:28:35 user nova-compute[75165]: DEBUG nova.compute.manager [req-3e73f58a-359a-445f-b4f0-ed5eb14d4f6a req-ff1421bb-4884-4aed-abdd-a1c5ff53675a service nova] [instance: bb77893d-263a-40a6-9acc-63fcd1481a38] Refreshing instance network info cache due to event network-changed-f6053f89-f617-42db-8747-b5cc98ee387d. {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 00:28:35 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-3e73f58a-359a-445f-b4f0-ed5eb14d4f6a req-ff1421bb-4884-4aed-abdd-a1c5ff53675a service nova] Acquiring lock "refresh_cache-bb77893d-263a-40a6-9acc-63fcd1481a38" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:28:35 user nova-compute[75165]: DEBUG nova.network.neutron [None req-59aa34de-614a-4739-9983-53b14d5099fe tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] [instance: bb77893d-263a-40a6-9acc-63fcd1481a38] Instance cache missing network info. {{(pid=75165) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 00:28:36 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:28:36 user nova-compute[75165]: DEBUG nova.compute.manager [None req-e16e7d4c-9f7d-4e26-874a-a830970c4f3b tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: b3c87b07-5c16-4f45-b320-06d3503d23e6] Checking state {{(pid=75165) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 00:28:36 user nova-compute[75165]: INFO nova.compute.manager [None req-e16e7d4c-9f7d-4e26-874a-a830970c4f3b tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: b3c87b07-5c16-4f45-b320-06d3503d23e6] instance snapshotting
Oct 26 00:28:36 user nova-compute[75165]: DEBUG nova.network.neutron [None req-59aa34de-614a-4739-9983-53b14d5099fe tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] [instance: bb77893d-263a-40a6-9acc-63fcd1481a38] Updating instance_info_cache with network_info: [{"id": "f6053f89-f617-42db-8747-b5cc98ee387d", "address": "fa:16:3e:82:0a:f8", "network": {"id": "6b000f11-7be2-4a26-ba67-b10f275e8560", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1605988141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eed16e1778f4ffb93afcc1ddbfe3d72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6053f89-f6", "ovs_interfaceid": "f6053f89-f617-42db-8747-b5cc98ee387d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:28:36 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-59aa34de-614a-4739-9983-53b14d5099fe tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Releasing lock "refresh_cache-bb77893d-263a-40a6-9acc-63fcd1481a38" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:28:36 user nova-compute[75165]: DEBUG nova.compute.manager [None req-59aa34de-614a-4739-9983-53b14d5099fe tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] [instance: bb77893d-263a-40a6-9acc-63fcd1481a38] Instance network_info: |[{"id": "f6053f89-f617-42db-8747-b5cc98ee387d", "address": "fa:16:3e:82:0a:f8", "network": {"id": "6b000f11-7be2-4a26-ba67-b10f275e8560", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1605988141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eed16e1778f4ffb93afcc1ddbfe3d72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6053f89-f6", "ovs_interfaceid": "f6053f89-f617-42db-8747-b5cc98ee387d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75165) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 00:28:36 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-3e73f58a-359a-445f-b4f0-ed5eb14d4f6a req-ff1421bb-4884-4aed-abdd-a1c5ff53675a service nova] Acquired lock "refresh_cache-bb77893d-263a-40a6-9acc-63fcd1481a38" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:28:36 user nova-compute[75165]: DEBUG nova.network.neutron [req-3e73f58a-359a-445f-b4f0-ed5eb14d4f6a req-ff1421bb-4884-4aed-abdd-a1c5ff53675a service nova] [instance: bb77893d-263a-40a6-9acc-63fcd1481a38] Refreshing network info cache for port f6053f89-f617-42db-8747-b5cc98ee387d {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 00:28:36 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-59aa34de-614a-4739-9983-53b14d5099fe tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] [instance: bb77893d-263a-40a6-9acc-63fcd1481a38] Start _get_guest_xml network_info=[{"id": "f6053f89-f617-42db-8747-b5cc98ee387d", "address": "fa:16:3e:82:0a:f8", "network": {"id": "6b000f11-7be2-4a26-ba67-b10f275e8560", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1605988141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eed16e1778f4ffb93afcc1ddbfe3d72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6053f89-f6", "ovs_interfaceid": "f6053f89-f617-42db-8747-b5cc98ee387d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T00:03:24Z,direct_url=<?>,disk_format='qcow2',id=bff0d8a1-739e-4c4d-9efa-b73ba7b76d01,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e56bbf444fd34c348475c73673611447',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T00:03:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'size': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': 'bff0d8a1-739e-4c4d-9efa-b73ba7b76d01'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75165) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 00:28:36 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-59aa34de-614a-4739-9983-53b14d5099fe tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:28:36 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-59aa34de-614a-4739-9983-53b14d5099fe tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:28:36 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-59aa34de-614a-4739-9983-53b14d5099fe tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75165) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 00:28:36 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-59aa34de-614a-4739-9983-53b14d5099fe tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] CPU controller missing on host. {{(pid=75165) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 00:28:36 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-59aa34de-614a-4739-9983-53b14d5099fe tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75165) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 00:28:36 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-59aa34de-614a-4739-9983-53b14d5099fe tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] CPU controller found on host. {{(pid=75165) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 00:28:36 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-59aa34de-614a-4739-9983-53b14d5099fe tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75165) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 00:28:36 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-59aa34de-614a-4739-9983-53b14d5099fe tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T00:03:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T00:03:24Z,direct_url=<?>,disk_format='qcow2',id=bff0d8a1-739e-4c4d-9efa-b73ba7b76d01,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e56bbf444fd34c348475c73673611447',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T00:03:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 00:28:36 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-59aa34de-614a-4739-9983-53b14d5099fe tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Flavor limits 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 00:28:36 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-59aa34de-614a-4739-9983-53b14d5099fe tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Image limits 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 00:28:36 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-59aa34de-614a-4739-9983-53b14d5099fe tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Flavor pref 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 00:28:36 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-59aa34de-614a-4739-9983-53b14d5099fe tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Image pref 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 00:28:36 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-59aa34de-614a-4739-9983-53b14d5099fe tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 00:28:36 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-59aa34de-614a-4739-9983-53b14d5099fe tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 00:28:36 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-59aa34de-614a-4739-9983-53b14d5099fe tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75165) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 00:28:36 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-59aa34de-614a-4739-9983-53b14d5099fe tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Got 1 possible topologies {{(pid=75165) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 00:28:36 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-59aa34de-614a-4739-9983-53b14d5099fe tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 00:28:36 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-59aa34de-614a-4739-9983-53b14d5099fe tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 00:28:36 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-59aa34de-614a-4739-9983-53b14d5099fe tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:28:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-470954302',display_name='tempest-VolumesSnapshotTestJSON-instance-470954302',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-470954302',id=33,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNBXS5sHvrV8NXVlX5KinYRSSLGTTHGvsBzLJMinsINdK3DpdP5tm/H/Mopc7zIaTi4qqsdizO1fW5e6IW0tvJ6RSVAqRbNJVBIPPb+EelO0XiWfg7DcO+hprC0/WazIaQ==',key_name='tempest-keypair-2122161877',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9eed16e1778f4ffb93afcc1ddbfe3d72',ramdisk_id='',reservation_id='r-mlm0l7qb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1190581483',owner_user_name='tempest-VolumesSnapshotTestJSON-1190581483-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T00:28:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7cd8b7fb014340bcb4efbe7a0063cdc7',uuid=bb77893d-263a-40a6-9acc-63fcd1481a38,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f6053f89-f617-42db-8747-b5cc98ee387d", "address": "fa:16:3e:82:0a:f8", "network": {"id": "6b000f11-7be2-4a26-ba67-b10f275e8560", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1605988141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eed16e1778f4ffb93afcc1ddbfe3d72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6053f89-f6", "ovs_interfaceid": "f6053f89-f617-42db-8747-b5cc98ee387d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75165) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 00:28:36 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-59aa34de-614a-4739-9983-53b14d5099fe tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Converting VIF {"id": "f6053f89-f617-42db-8747-b5cc98ee387d", "address": "fa:16:3e:82:0a:f8", "network": {"id": "6b000f11-7be2-4a26-ba67-b10f275e8560", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1605988141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eed16e1778f4ffb93afcc1ddbfe3d72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6053f89-f6", "ovs_interfaceid": "f6053f89-f617-42db-8747-b5cc98ee387d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:28:36 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-59aa34de-614a-4739-9983-53b14d5099fe tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:0a:f8,bridge_name='br-int',has_traffic_filtering=True,id=f6053f89-f617-42db-8747-b5cc98ee387d,network=Network(6b000f11-7be2-4a26-ba67-b10f275e8560),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6053f89-f6') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:28:36 user nova-compute[75165]: DEBUG nova.objects.instance [None req-59aa34de-614a-4739-9983-53b14d5099fe tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Lazy-loading 'pci_devices' on Instance uuid bb77893d-263a-40a6-9acc-63fcd1481a38 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:28:36 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-59aa34de-614a-4739-9983-53b14d5099fe tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] [instance: bb77893d-263a-40a6-9acc-63fcd1481a38] End _get_guest_xml xml=<domain type="kvm">
Oct 26 00:28:36 user nova-compute[75165]:   <uuid>bb77893d-263a-40a6-9acc-63fcd1481a38</uuid>
Oct 26 00:28:36 user nova-compute[75165]:   <name>instance-00000021</name>
Oct 26 00:28:36 user nova-compute[75165]:   <memory>524288</memory>
Oct 26 00:28:36 user nova-compute[75165]:   <vcpu>1</vcpu>
Oct 26 00:28:36 user nova-compute[75165]:   <metadata>
Oct 26 00:28:36 user nova-compute[75165]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 00:28:36 user nova-compute[75165]:       <nova:package version="0.0.0"/>
Oct 26 00:28:36 user nova-compute[75165]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-470954302</nova:name>
Oct 26 00:28:36 user nova-compute[75165]:       <nova:creationTime>2023-10-26 00:28:36</nova:creationTime>
Oct 26 00:28:36 user nova-compute[75165]:       <nova:flavor name="m1.tiny">
Oct 26 00:28:36 user nova-compute[75165]:         <nova:memory>512</nova:memory>
Oct 26 00:28:36 user nova-compute[75165]:         <nova:disk>1</nova:disk>
Oct 26 00:28:36 user nova-compute[75165]:         <nova:swap>0</nova:swap>
Oct 26 00:28:36 user nova-compute[75165]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 00:28:36 user nova-compute[75165]:         <nova:vcpus>1</nova:vcpus>
Oct 26 00:28:36 user nova-compute[75165]:       </nova:flavor>
Oct 26 00:28:36 user nova-compute[75165]:       <nova:owner>
Oct 26 00:28:36 user nova-compute[75165]:         <nova:user uuid="7cd8b7fb014340bcb4efbe7a0063cdc7">tempest-VolumesSnapshotTestJSON-1190581483-project-member</nova:user>
Oct 26 00:28:36 user nova-compute[75165]:         <nova:project uuid="9eed16e1778f4ffb93afcc1ddbfe3d72">tempest-VolumesSnapshotTestJSON-1190581483</nova:project>
Oct 26 00:28:36 user nova-compute[75165]:       </nova:owner>
Oct 26 00:28:36 user nova-compute[75165]:       <nova:root type="image" uuid="bff0d8a1-739e-4c4d-9efa-b73ba7b76d01"/>
Oct 26 00:28:36 user nova-compute[75165]:       <nova:ports>
Oct 26 00:28:36 user nova-compute[75165]:         <nova:port uuid="f6053f89-f617-42db-8747-b5cc98ee387d">
Oct 26 00:28:36 user nova-compute[75165]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 26 00:28:36 user nova-compute[75165]:         </nova:port>
Oct 26 00:28:36 user nova-compute[75165]:       </nova:ports>
Oct 26 00:28:36 user nova-compute[75165]:     </nova:instance>
Oct 26 00:28:36 user nova-compute[75165]:   </metadata>
Oct 26 00:28:36 user nova-compute[75165]:   <sysinfo type="smbios">
Oct 26 00:28:36 user nova-compute[75165]:     <system>
Oct 26 00:28:36 user nova-compute[75165]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 00:28:36 user nova-compute[75165]:       <entry name="product">OpenStack Nova</entry>
Oct 26 00:28:36 user nova-compute[75165]:       <entry name="version">0.0.0</entry>
Oct 26 00:28:36 user nova-compute[75165]:       <entry name="serial">bb77893d-263a-40a6-9acc-63fcd1481a38</entry>
Oct 26 00:28:36 user nova-compute[75165]:       <entry name="uuid">bb77893d-263a-40a6-9acc-63fcd1481a38</entry>
Oct 26 00:28:36 user nova-compute[75165]:       <entry name="family">Virtual Machine</entry>
Oct 26 00:28:36 user nova-compute[75165]:     </system>
Oct 26 00:28:36 user nova-compute[75165]:   </sysinfo>
Oct 26 00:28:36 user nova-compute[75165]:   <os>
Oct 26 00:28:36 user nova-compute[75165]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 00:28:36 user nova-compute[75165]:     <boot dev="hd"/>
Oct 26 00:28:36 user nova-compute[75165]:     <smbios mode="sysinfo"/>
Oct 26 00:28:36 user nova-compute[75165]:   </os>
Oct 26 00:28:36 user nova-compute[75165]:   <features>
Oct 26 00:28:36 user nova-compute[75165]:     <acpi/>
Oct 26 00:28:36 user nova-compute[75165]:     <apic/>
Oct 26 00:28:36 user nova-compute[75165]:     <vmcoreinfo/>
Oct 26 00:28:36 user nova-compute[75165]:   </features>
Oct 26 00:28:36 user nova-compute[75165]:   <clock offset="utc">
Oct 26 00:28:36 user nova-compute[75165]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 00:28:36 user nova-compute[75165]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 00:28:36 user nova-compute[75165]:     <timer name="hpet" present="no"/>
Oct 26 00:28:36 user nova-compute[75165]:   </clock>
Oct 26 00:28:36 user nova-compute[75165]:   <cpu mode="custom" match="exact">
Oct 26 00:28:36 user nova-compute[75165]:     <model>Nehalem</model>
Oct 26 00:28:36 user nova-compute[75165]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 00:28:36 user nova-compute[75165]:   </cpu>
Oct 26 00:28:36 user nova-compute[75165]:   <devices>
Oct 26 00:28:36 user nova-compute[75165]:     <disk type="file" device="disk">
Oct 26 00:28:36 user nova-compute[75165]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 00:28:36 user nova-compute[75165]:       <source file="/opt/stack/data/nova/instances/bb77893d-263a-40a6-9acc-63fcd1481a38/disk"/>
Oct 26 00:28:36 user nova-compute[75165]:       <target dev="vda" bus="virtio"/>
Oct 26 00:28:36 user nova-compute[75165]:     </disk>
Oct 26 00:28:36 user nova-compute[75165]:     <interface type="ethernet">
Oct 26 00:28:36 user nova-compute[75165]:       <mac address="fa:16:3e:82:0a:f8"/>
Oct 26 00:28:36 user nova-compute[75165]:       <model type="virtio"/>
Oct 26 00:28:36 user nova-compute[75165]:       <mtu size="1442"/>
Oct 26 00:28:36 user nova-compute[75165]:       <target dev="tapf6053f89-f6"/>
Oct 26 00:28:36 user nova-compute[75165]:     </interface>
Oct 26 00:28:36 user nova-compute[75165]:     <serial type="pty">
Oct 26 00:28:36 user nova-compute[75165]:       <log file="/opt/stack/data/nova/instances/bb77893d-263a-40a6-9acc-63fcd1481a38/console.log" append="off"/>
Oct 26 00:28:36 user nova-compute[75165]:     </serial>
Oct 26 00:28:36 user nova-compute[75165]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 00:28:36 user nova-compute[75165]:     <video>
Oct 26 00:28:36 user nova-compute[75165]:       <model type="virtio"/>
Oct 26 00:28:36 user nova-compute[75165]:     </video>
Oct 26 00:28:36 user nova-compute[75165]:     <rng model="virtio">
Oct 26 00:28:36 user nova-compute[75165]:       <backend model="random">/dev/urandom</backend>
Oct 26 00:28:36 user nova-compute[75165]:     </rng>
Oct 26 00:28:36 user nova-compute[75165]:     <controller type="usb" index="0" model="none"/>
Oct 26 00:28:36 user nova-compute[75165]:     <memballoon model="virtio">
Oct 26 00:28:36 user nova-compute[75165]:       <stats period="10"/>
Oct 26 00:28:36 user nova-compute[75165]:     </memballoon>
Oct 26 00:28:36 user nova-compute[75165]:   </devices>
Oct 26 00:28:36 user nova-compute[75165]: </domain>
Oct 26 00:28:36 user nova-compute[75165]:  {{(pid=75165) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 00:28:36 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-59aa34de-614a-4739-9983-53b14d5099fe tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:28:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-470954302',display_name='tempest-VolumesSnapshotTestJSON-instance-470954302',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-470954302',id=33,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNBXS5sHvrV8NXVlX5KinYRSSLGTTHGvsBzLJMinsINdK3DpdP5tm/H/Mopc7zIaTi4qqsdizO1fW5e6IW0tvJ6RSVAqRbNJVBIPPb+EelO0XiWfg7DcO+hprC0/WazIaQ==',key_name='tempest-keypair-2122161877',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9eed16e1778f4ffb93afcc1ddbfe3d72',ramdisk_id='',reservation_id='r-mlm0l7qb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1190581483',owner_user_name='tempest-VolumesSnapshotTestJSON-1190581483-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T00:28:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7cd8b7fb014340bcb4efbe7a0063cdc7',uuid=bb77893d-263a-40a6-9acc-63fcd1481a38,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f6053f89-f617-42db-8747-b5cc98ee387d", "address": "fa:16:3e:82:0a:f8", "network": {"id": "6b000f11-7be2-4a26-ba67-b10f275e8560", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1605988141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eed16e1778f4ffb93afcc1ddbfe3d72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6053f89-f6", "ovs_interfaceid": "f6053f89-f617-42db-8747-b5cc98ee387d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 00:28:36 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-59aa34de-614a-4739-9983-53b14d5099fe tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Converting VIF {"id": "f6053f89-f617-42db-8747-b5cc98ee387d", "address": "fa:16:3e:82:0a:f8", "network": {"id": "6b000f11-7be2-4a26-ba67-b10f275e8560", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1605988141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eed16e1778f4ffb93afcc1ddbfe3d72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6053f89-f6", "ovs_interfaceid": "f6053f89-f617-42db-8747-b5cc98ee387d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:28:36 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-59aa34de-614a-4739-9983-53b14d5099fe tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:0a:f8,bridge_name='br-int',has_traffic_filtering=True,id=f6053f89-f617-42db-8747-b5cc98ee387d,network=Network(6b000f11-7be2-4a26-ba67-b10f275e8560),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6053f89-f6') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:28:36 user nova-compute[75165]: DEBUG os_vif [None req-59aa34de-614a-4739-9983-53b14d5099fe tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:0a:f8,bridge_name='br-int',has_traffic_filtering=True,id=f6053f89-f617-42db-8747-b5cc98ee387d,network=Network(6b000f11-7be2-4a26-ba67-b10f275e8560),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6053f89-f6') {{(pid=75165) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 00:28:36 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:28:36 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:28:36 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 00:28:36 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:28:36 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ee566c13-f0ec-5e70-a497-460fe9f60ee5', '_type': 'linux-noop'}}, row=False) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:28:36 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:28:36 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:28:36 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:28:36 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:28:36 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf6053f89-f6, may_exist=True, interface_attrs={}) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:28:36 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf6053f89-f6, col_values=(('qos', UUID('3a4afe40-7222-4697-8630-713d12060a30')),), if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:28:36 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf6053f89-f6, col_values=(('external_ids', {'iface-id': 'f6053f89-f617-42db-8747-b5cc98ee387d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:82:0a:f8', 'vm-uuid': 'bb77893d-263a-40a6-9acc-63fcd1481a38'}),), if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:28:36 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:28:36 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-e16e7d4c-9f7d-4e26-874a-a830970c4f3b tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: b3c87b07-5c16-4f45-b320-06d3503d23e6] Beginning live snapshot process
Oct 26 00:28:36 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:28:36 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:28:36 user nova-compute[75165]: INFO os_vif [None req-59aa34de-614a-4739-9983-53b14d5099fe tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:0a:f8,bridge_name='br-int',has_traffic_filtering=True,id=f6053f89-f617-42db-8747-b5cc98ee387d,network=Network(6b000f11-7be2-4a26-ba67-b10f275e8560),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6053f89-f6')
Oct 26 00:28:36 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-59aa34de-614a-4739-9983-53b14d5099fe tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] No BDM found with device name vda, not building metadata. {{(pid=75165) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 00:28:36 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-59aa34de-614a-4739-9983-53b14d5099fe tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] No VIF found with MAC fa:16:3e:82:0a:f8, not building metadata {{(pid=75165) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 00:28:36 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-e16e7d4c-9f7d-4e26-874a-a830970c4f3b tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3c87b07-5c16-4f45-b320-06d3503d23e6/disk --force-share --output=json -f qcow2 {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:28:36 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-e16e7d4c-9f7d-4e26-874a-a830970c4f3b tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3c87b07-5c16-4f45-b320-06d3503d23e6/disk --force-share --output=json -f qcow2" returned: 0 in 0.200s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:28:36 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-e16e7d4c-9f7d-4e26-874a-a830970c4f3b tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3c87b07-5c16-4f45-b320-06d3503d23e6/disk --force-share --output=json -f qcow2 {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:28:37 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-e16e7d4c-9f7d-4e26-874a-a830970c4f3b tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3c87b07-5c16-4f45-b320-06d3503d23e6/disk --force-share --output=json -f qcow2" returned: 0 in 0.224s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:28:37 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-e16e7d4c-9f7d-4e26-874a-a830970c4f3b tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:28:37 user nova-compute[75165]: DEBUG nova.network.neutron [req-3e73f58a-359a-445f-b4f0-ed5eb14d4f6a req-ff1421bb-4884-4aed-abdd-a1c5ff53675a service nova] [instance: bb77893d-263a-40a6-9acc-63fcd1481a38] Updated VIF entry in instance network info cache for port f6053f89-f617-42db-8747-b5cc98ee387d. {{(pid=75165) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 00:28:37 user nova-compute[75165]: DEBUG nova.network.neutron [req-3e73f58a-359a-445f-b4f0-ed5eb14d4f6a req-ff1421bb-4884-4aed-abdd-a1c5ff53675a service nova] [instance: bb77893d-263a-40a6-9acc-63fcd1481a38] Updating instance_info_cache with network_info: [{"id": "f6053f89-f617-42db-8747-b5cc98ee387d", "address": "fa:16:3e:82:0a:f8", "network": {"id": "6b000f11-7be2-4a26-ba67-b10f275e8560", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1605988141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eed16e1778f4ffb93afcc1ddbfe3d72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6053f89-f6", "ovs_interfaceid": "f6053f89-f617-42db-8747-b5cc98ee387d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:28:37 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-e16e7d4c-9f7d-4e26-874a-a830970c4f3b tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json" returned: 0 in 0.187s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:28:37 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-e16e7d4c-9f7d-4e26-874a-a830970c4f3b tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpxn9hthds/c78a8551e77a472dbc331cda9cf11b0b.delta 1073741824 {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:28:37 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-3e73f58a-359a-445f-b4f0-ed5eb14d4f6a req-ff1421bb-4884-4aed-abdd-a1c5ff53675a service nova] Releasing lock "refresh_cache-bb77893d-263a-40a6-9acc-63fcd1481a38" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:28:37 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-e16e7d4c-9f7d-4e26-874a-a830970c4f3b tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpxn9hthds/c78a8551e77a472dbc331cda9cf11b0b.delta 1073741824" returned: 0 in 0.058s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:28:37 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-e16e7d4c-9f7d-4e26-874a-a830970c4f3b tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: b3c87b07-5c16-4f45-b320-06d3503d23e6] Quiescing instance not available: QEMU guest agent is not enabled.
Oct 26 00:28:38 user nova-compute[75165]: DEBUG nova.virt.libvirt.guest [None req-e16e7d4c-9f7d-4e26-874a-a830970c4f3b tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] COPY block job progress, current cursor: 65536 final cursor: 75497472 {{(pid=75165) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 26 00:28:38 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:28:38 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:28:38 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:28:39 user nova-compute[75165]: DEBUG nova.virt.libvirt.guest [None req-e16e7d4c-9f7d-4e26-874a-a830970c4f3b tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75165) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 26 00:28:39 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-e16e7d4c-9f7d-4e26-874a-a830970c4f3b tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: b3c87b07-5c16-4f45-b320-06d3503d23e6] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 26 00:28:39 user nova-compute[75165]: DEBUG nova.compute.manager [req-1ffec327-389a-4b9b-88aa-9cd4ff441796 req-61953116-08cf-401f-9254-29a2d801766c service nova] [instance: bb77893d-263a-40a6-9acc-63fcd1481a38] Received event network-vif-plugged-f6053f89-f617-42db-8747-b5cc98ee387d {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:28:39 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-1ffec327-389a-4b9b-88aa-9cd4ff441796 req-61953116-08cf-401f-9254-29a2d801766c service nova] Acquiring lock "bb77893d-263a-40a6-9acc-63fcd1481a38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:28:39 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-1ffec327-389a-4b9b-88aa-9cd4ff441796 req-61953116-08cf-401f-9254-29a2d801766c service nova] Lock "bb77893d-263a-40a6-9acc-63fcd1481a38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:28:39 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-1ffec327-389a-4b9b-88aa-9cd4ff441796 req-61953116-08cf-401f-9254-29a2d801766c service nova] Lock "bb77893d-263a-40a6-9acc-63fcd1481a38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:28:39 user nova-compute[75165]: DEBUG nova.compute.manager [req-1ffec327-389a-4b9b-88aa-9cd4ff441796 req-61953116-08cf-401f-9254-29a2d801766c service nova] [instance: bb77893d-263a-40a6-9acc-63fcd1481a38] No waiting events found dispatching network-vif-plugged-f6053f89-f617-42db-8747-b5cc98ee387d {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:28:39 user nova-compute[75165]: WARNING nova.compute.manager [req-1ffec327-389a-4b9b-88aa-9cd4ff441796 req-61953116-08cf-401f-9254-29a2d801766c service nova] [instance: bb77893d-263a-40a6-9acc-63fcd1481a38] Received unexpected event network-vif-plugged-f6053f89-f617-42db-8747-b5cc98ee387d for instance with vm_state building and task_state spawning.
Oct 26 00:28:39 user nova-compute[75165]: DEBUG nova.privsep.utils [None req-e16e7d4c-9f7d-4e26-874a-a830970c4f3b tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75165) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 26 00:28:39 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-e16e7d4c-9f7d-4e26-874a-a830970c4f3b tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpxn9hthds/c78a8551e77a472dbc331cda9cf11b0b.delta /opt/stack/data/nova/instances/snapshots/tmpxn9hthds/c78a8551e77a472dbc331cda9cf11b0b {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:28:39 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:28:39 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:28:39 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-e16e7d4c-9f7d-4e26-874a-a830970c4f3b tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpxn9hthds/c78a8551e77a472dbc331cda9cf11b0b.delta /opt/stack/data/nova/instances/snapshots/tmpxn9hthds/c78a8551e77a472dbc331cda9cf11b0b" returned: 0 in 0.700s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:28:39 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-e16e7d4c-9f7d-4e26-874a-a830970c4f3b tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: b3c87b07-5c16-4f45-b320-06d3503d23e6] Snapshot extracted, beginning image upload
Oct 26 00:28:41 user nova-compute[75165]: DEBUG nova.compute.manager [req-ef76e7c6-ba96-4e7c-ba45-f56c663ef6a3 req-a7ce4aa0-ebf7-471b-8cec-f723e09b9b1c service nova] [instance: bb77893d-263a-40a6-9acc-63fcd1481a38] Received event network-vif-plugged-f6053f89-f617-42db-8747-b5cc98ee387d {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:28:41 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-ef76e7c6-ba96-4e7c-ba45-f56c663ef6a3 req-a7ce4aa0-ebf7-471b-8cec-f723e09b9b1c service nova] Acquiring lock "bb77893d-263a-40a6-9acc-63fcd1481a38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:28:41 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-ef76e7c6-ba96-4e7c-ba45-f56c663ef6a3 req-a7ce4aa0-ebf7-471b-8cec-f723e09b9b1c service nova] Lock "bb77893d-263a-40a6-9acc-63fcd1481a38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:28:41 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-ef76e7c6-ba96-4e7c-ba45-f56c663ef6a3 req-a7ce4aa0-ebf7-471b-8cec-f723e09b9b1c service nova] Lock "bb77893d-263a-40a6-9acc-63fcd1481a38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:28:41 user nova-compute[75165]: DEBUG nova.compute.manager [req-ef76e7c6-ba96-4e7c-ba45-f56c663ef6a3 req-a7ce4aa0-ebf7-471b-8cec-f723e09b9b1c service nova] [instance: bb77893d-263a-40a6-9acc-63fcd1481a38] No waiting events found dispatching network-vif-plugged-f6053f89-f617-42db-8747-b5cc98ee387d {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:28:41 user nova-compute[75165]: WARNING nova.compute.manager [req-ef76e7c6-ba96-4e7c-ba45-f56c663ef6a3 req-a7ce4aa0-ebf7-471b-8cec-f723e09b9b1c service nova] [instance: bb77893d-263a-40a6-9acc-63fcd1481a38] Received unexpected event network-vif-plugged-f6053f89-f617-42db-8747-b5cc98ee387d for instance with vm_state building and task_state spawning.
Oct 26 00:28:41 user nova-compute[75165]: DEBUG nova.compute.manager [None req-59aa34de-614a-4739-9983-53b14d5099fe tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] [instance: bb77893d-263a-40a6-9acc-63fcd1481a38] Instance event wait completed in 0 seconds for  {{(pid=75165) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 00:28:41 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-59aa34de-614a-4739-9983-53b14d5099fe tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] [instance: bb77893d-263a-40a6-9acc-63fcd1481a38] Guest created on hypervisor {{(pid=75165) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 00:28:41 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: bb77893d-263a-40a6-9acc-63fcd1481a38] Instance spawned successfully.
Oct 26 00:28:41 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-59aa34de-614a-4739-9983-53b14d5099fe tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] [instance: bb77893d-263a-40a6-9acc-63fcd1481a38] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 00:28:41 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-59aa34de-614a-4739-9983-53b14d5099fe tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] [instance: bb77893d-263a-40a6-9acc-63fcd1481a38] Found default for hw_cdrom_bus of ide {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:28:41 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-59aa34de-614a-4739-9983-53b14d5099fe tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] [instance: bb77893d-263a-40a6-9acc-63fcd1481a38] Found default for hw_disk_bus of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:28:41 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-59aa34de-614a-4739-9983-53b14d5099fe tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] [instance: bb77893d-263a-40a6-9acc-63fcd1481a38] Found default for hw_input_bus of None {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:28:41 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-59aa34de-614a-4739-9983-53b14d5099fe tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] [instance: bb77893d-263a-40a6-9acc-63fcd1481a38] Found default for hw_pointer_model of None {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:28:41 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-59aa34de-614a-4739-9983-53b14d5099fe tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] [instance: bb77893d-263a-40a6-9acc-63fcd1481a38] Found default for hw_video_model of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:28:41 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-59aa34de-614a-4739-9983-53b14d5099fe tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] [instance: bb77893d-263a-40a6-9acc-63fcd1481a38] Found default for hw_vif_model of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:28:41 user nova-compute[75165]: INFO nova.compute.manager [None req-59aa34de-614a-4739-9983-53b14d5099fe tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] [instance: bb77893d-263a-40a6-9acc-63fcd1481a38] Took 8.90 seconds to spawn the instance on the hypervisor.
Oct 26 00:28:41 user nova-compute[75165]: DEBUG nova.compute.manager [None req-59aa34de-614a-4739-9983-53b14d5099fe tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] [instance: bb77893d-263a-40a6-9acc-63fcd1481a38] Checking state {{(pid=75165) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 00:28:41 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:28:41 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:28:41 user nova-compute[75165]: INFO nova.compute.manager [None req-59aa34de-614a-4739-9983-53b14d5099fe tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] [instance: bb77893d-263a-40a6-9acc-63fcd1481a38] Took 9.66 seconds to build instance.
Oct 26 00:28:41 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-59aa34de-614a-4739-9983-53b14d5099fe tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Lock "bb77893d-263a-40a6-9acc-63fcd1481a38" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.775s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:28:43 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-e16e7d4c-9f7d-4e26-874a-a830970c4f3b tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: b3c87b07-5c16-4f45-b320-06d3503d23e6] Snapshot image upload complete
Oct 26 00:28:43 user nova-compute[75165]: INFO nova.compute.manager [None req-e16e7d4c-9f7d-4e26-874a-a830970c4f3b tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: b3c87b07-5c16-4f45-b320-06d3503d23e6] Took 6.90 seconds to snapshot the instance on the hypervisor.
Oct 26 00:28:45 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:28:46 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:28:48 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:28:51 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:28:52 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:28:54 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:28:56 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:28:56 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-b6546711-91a7-4816-9326-2633e52621c9 tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Acquiring lock "250afc24-0c38-4959-a77c-d51365dd1c4e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:28:56 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-b6546711-91a7-4816-9326-2633e52621c9 tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Lock "250afc24-0c38-4959-a77c-d51365dd1c4e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:28:56 user nova-compute[75165]: DEBUG nova.compute.manager [None req-b6546711-91a7-4816-9326-2633e52621c9 tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] [instance: 250afc24-0c38-4959-a77c-d51365dd1c4e] Starting instance... {{(pid=75165) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 00:28:56 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-b6546711-91a7-4816-9326-2633e52621c9 tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:28:56 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-b6546711-91a7-4816-9326-2633e52621c9 tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:28:56 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-b6546711-91a7-4816-9326-2633e52621c9 tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75165) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 00:28:56 user nova-compute[75165]: INFO nova.compute.claims [None req-b6546711-91a7-4816-9326-2633e52621c9 tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] [instance: 250afc24-0c38-4959-a77c-d51365dd1c4e] Claim successful on node user
Oct 26 00:28:57 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-b6546711-91a7-4816-9326-2633e52621c9 tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:28:57 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-b6546711-91a7-4816-9326-2633e52621c9 tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:28:57 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-b6546711-91a7-4816-9326-2633e52621c9 tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.464s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:28:57 user nova-compute[75165]: DEBUG nova.compute.manager [None req-b6546711-91a7-4816-9326-2633e52621c9 tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] [instance: 250afc24-0c38-4959-a77c-d51365dd1c4e] Start building networks asynchronously for instance. {{(pid=75165) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 00:28:57 user nova-compute[75165]: DEBUG nova.compute.manager [None req-b6546711-91a7-4816-9326-2633e52621c9 tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] [instance: 250afc24-0c38-4959-a77c-d51365dd1c4e] Allocating IP information in the background. {{(pid=75165) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 00:28:57 user nova-compute[75165]: DEBUG nova.network.neutron [None req-b6546711-91a7-4816-9326-2633e52621c9 tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] [instance: 250afc24-0c38-4959-a77c-d51365dd1c4e] allocate_for_instance() {{(pid=75165) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 00:28:57 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-b6546711-91a7-4816-9326-2633e52621c9 tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] [instance: 250afc24-0c38-4959-a77c-d51365dd1c4e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 00:28:57 user nova-compute[75165]: DEBUG nova.compute.manager [None req-b6546711-91a7-4816-9326-2633e52621c9 tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] [instance: 250afc24-0c38-4959-a77c-d51365dd1c4e] Start building block device mappings for instance. {{(pid=75165) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 00:28:57 user nova-compute[75165]: INFO nova.virt.block_device [None req-b6546711-91a7-4816-9326-2633e52621c9 tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] [instance: 250afc24-0c38-4959-a77c-d51365dd1c4e] Booting with volume af851e79-3073-4793-929f-877775c91de0 at /dev/vda
Oct 26 00:28:57 user nova-compute[75165]: DEBUG nova.policy [None req-b6546711-91a7-4816-9326-2633e52621c9 tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2c471e2bc8dc4e5f93dd321369821a99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf09714f89484ff5ad700a5528b8d7c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75165) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 00:28:57 user nova-compute[75165]: DEBUG os_brick.utils [None req-b6546711-91a7-4816-9326-2633e52621c9 tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:28:57 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:28:57 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:28:57 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf31e8c5-08f0-4e87-bd7d-f6e935faa086]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa94814ccb35\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:28:57 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:28:57 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:28:57 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[102f47d6-3d27-4f68-acfa-5e4a6047686a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:28:57 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:28:57 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:28:57 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[85cca01d-1260-4b24-9e0e-2900a4fa68c2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:28:57 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4882112-5ec7-4a2a-8ae4-e861d55ab1ec]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:28:57 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-b6546711-91a7-4816-9326-2633e52621c9 tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Running cmd (subprocess): nvme version {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:28:57 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-b6546711-91a7-4816-9326-2633e52621c9 tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] 'nvme version' failed. Not Retrying. {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 00:28:57 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b6546711-91a7-4816-9326-2633e52621c9 tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] nvme not present on system {{(pid=75165) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 00:28:57 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:28:57 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 00:28:57 user nova-compute[75165]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 00:28:57 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e93c1dd-9994-4af8-899f-f8b549de82c2]: (4, '') {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:28:57 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-b6546711-91a7-4816-9326-2633e52621c9 tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75165) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 00:28:57 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-b6546711-91a7-4816-9326-2633e52621c9 tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75165) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 00:28:57 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-b6546711-91a7-4816-9326-2633e52621c9 tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] LIGHTOS: no hostnqn found. {{(pid=75165) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 00:28:57 user nova-compute[75165]: DEBUG os_brick.utils [None req-b6546711-91a7-4816-9326-2633e52621c9 tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa94814ccb35', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:28:57 user nova-compute[75165]: DEBUG nova.virt.block_device [None req-b6546711-91a7-4816-9326-2633e52621c9 tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] [instance: 250afc24-0c38-4959-a77c-d51365dd1c4e] Updating existing volume attachment record: 13bb4e4b-fb62-4f5d-8a98-54f0ab113ee5 {{(pid=75165) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 00:28:58 user nova-compute[75165]: DEBUG nova.network.neutron [None req-b6546711-91a7-4816-9326-2633e52621c9 tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] [instance: 250afc24-0c38-4959-a77c-d51365dd1c4e] Successfully created port: 0372e87f-5631-4444-bfe8-ae5af9f09a46 {{(pid=75165) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 00:28:59 user nova-compute[75165]: DEBUG nova.network.neutron [None req-b6546711-91a7-4816-9326-2633e52621c9 tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] [instance: 250afc24-0c38-4959-a77c-d51365dd1c4e] Successfully updated port: 0372e87f-5631-4444-bfe8-ae5af9f09a46 {{(pid=75165) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 00:28:59 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-b6546711-91a7-4816-9326-2633e52621c9 tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Acquiring lock "refresh_cache-250afc24-0c38-4959-a77c-d51365dd1c4e" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:28:59 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-b6546711-91a7-4816-9326-2633e52621c9 tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Acquired lock "refresh_cache-250afc24-0c38-4959-a77c-d51365dd1c4e" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:28:59 user nova-compute[75165]: DEBUG nova.network.neutron [None req-b6546711-91a7-4816-9326-2633e52621c9 tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] [instance: 250afc24-0c38-4959-a77c-d51365dd1c4e] Building network info cache for instance {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 00:28:59 user nova-compute[75165]: DEBUG nova.compute.manager [req-638fdd3d-c07b-40ae-90e8-7d85b913cd83 req-796288fc-b989-434e-8f21-7e5452e5c970 service nova] [instance: 250afc24-0c38-4959-a77c-d51365dd1c4e] Received event network-changed-0372e87f-5631-4444-bfe8-ae5af9f09a46 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:28:59 user nova-compute[75165]: DEBUG nova.compute.manager [req-638fdd3d-c07b-40ae-90e8-7d85b913cd83 req-796288fc-b989-434e-8f21-7e5452e5c970 service nova] [instance: 250afc24-0c38-4959-a77c-d51365dd1c4e] Refreshing instance network info cache due to event network-changed-0372e87f-5631-4444-bfe8-ae5af9f09a46. {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 00:28:59 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-638fdd3d-c07b-40ae-90e8-7d85b913cd83 req-796288fc-b989-434e-8f21-7e5452e5c970 service nova] Acquiring lock "refresh_cache-250afc24-0c38-4959-a77c-d51365dd1c4e" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:28:59 user nova-compute[75165]: DEBUG nova.network.neutron [None req-b6546711-91a7-4816-9326-2633e52621c9 tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] [instance: 250afc24-0c38-4959-a77c-d51365dd1c4e] Instance cache missing network info. {{(pid=75165) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 00:28:59 user nova-compute[75165]: DEBUG nova.network.neutron [None req-b6546711-91a7-4816-9326-2633e52621c9 tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] [instance: 250afc24-0c38-4959-a77c-d51365dd1c4e] Updating instance_info_cache with network_info: [{"id": "0372e87f-5631-4444-bfe8-ae5af9f09a46", "address": "fa:16:3e:76:de:bf", "network": {"id": "3fa5f12d-c7f4-4f2f-8934-6fa94f598a4c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1095967566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf09714f89484ff5ad700a5528b8d7c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0372e87f-56", "ovs_interfaceid": "0372e87f-5631-4444-bfe8-ae5af9f09a46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:28:59 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-b6546711-91a7-4816-9326-2633e52621c9 tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Releasing lock "refresh_cache-250afc24-0c38-4959-a77c-d51365dd1c4e" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:28:59 user nova-compute[75165]: DEBUG nova.compute.manager [None req-b6546711-91a7-4816-9326-2633e52621c9 tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] [instance: 250afc24-0c38-4959-a77c-d51365dd1c4e] Instance network_info: |[{"id": "0372e87f-5631-4444-bfe8-ae5af9f09a46", "address": "fa:16:3e:76:de:bf", "network": {"id": "3fa5f12d-c7f4-4f2f-8934-6fa94f598a4c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1095967566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf09714f89484ff5ad700a5528b8d7c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0372e87f-56", "ovs_interfaceid": "0372e87f-5631-4444-bfe8-ae5af9f09a46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75165) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 00:28:59 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-638fdd3d-c07b-40ae-90e8-7d85b913cd83 req-796288fc-b989-434e-8f21-7e5452e5c970 service nova] Acquired lock "refresh_cache-250afc24-0c38-4959-a77c-d51365dd1c4e" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:28:59 user nova-compute[75165]: DEBUG nova.network.neutron [req-638fdd3d-c07b-40ae-90e8-7d85b913cd83 req-796288fc-b989-434e-8f21-7e5452e5c970 service nova] [instance: 250afc24-0c38-4959-a77c-d51365dd1c4e] Refreshing network info cache for port 0372e87f-5631-4444-bfe8-ae5af9f09a46 {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 00:28:59 user nova-compute[75165]: DEBUG nova.network.neutron [req-638fdd3d-c07b-40ae-90e8-7d85b913cd83 req-796288fc-b989-434e-8f21-7e5452e5c970 service nova] [instance: 250afc24-0c38-4959-a77c-d51365dd1c4e] Updated VIF entry in instance network info cache for port 0372e87f-5631-4444-bfe8-ae5af9f09a46. {{(pid=75165) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 00:28:59 user nova-compute[75165]: DEBUG nova.network.neutron [req-638fdd3d-c07b-40ae-90e8-7d85b913cd83 req-796288fc-b989-434e-8f21-7e5452e5c970 service nova] [instance: 250afc24-0c38-4959-a77c-d51365dd1c4e] Updating instance_info_cache with network_info: [{"id": "0372e87f-5631-4444-bfe8-ae5af9f09a46", "address": "fa:16:3e:76:de:bf", "network": {"id": "3fa5f12d-c7f4-4f2f-8934-6fa94f598a4c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1095967566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf09714f89484ff5ad700a5528b8d7c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0372e87f-56", "ovs_interfaceid": "0372e87f-5631-4444-bfe8-ae5af9f09a46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:28:59 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-638fdd3d-c07b-40ae-90e8-7d85b913cd83 req-796288fc-b989-434e-8f21-7e5452e5c970 service nova] Releasing lock "refresh_cache-250afc24-0c38-4959-a77c-d51365dd1c4e" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:29:01 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:29:06 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:29:11 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:29:11 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:29:11 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:29:11 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75165) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 00:29:13 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99e35b3f-c528-456d-837c-73b7b206d335 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] [instance: fe2984ce-8958-4049-8af7-496b313b26c8] Calling os-brick to attach iSCSI Volume {{(pid=75165) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 00:29:13 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-99e35b3f-c528-456d-837c-73b7b206d335 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8bf8160e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d69dc6d8-04c4-41a5-bf87-04f0b01f1d09', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pBmjoxVZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:29:13 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-99e35b3f-c528-456d-837c-73b7b206d335 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:29:13 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-99e35b3f-c528-456d-837c-73b7b206d335 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:29:13 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-99e35b3f-c528-456d-837c-73b7b206d335 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:29:13 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-99e35b3f-c528-456d-837c-73b7b206d335 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:29:13 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-99e35b3f-c528-456d-837c-73b7b206d335 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d69dc6d8-04c4-41a5-bf87-04f0b01f1d09" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:29:13 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-99e35b3f-c528-456d-837c-73b7b206d335 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d69dc6d8-04c4-41a5-bf87-04f0b01f1d09" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:29:13 user nova-compute[75165]: INFO os_brick.initiator.connectors.iscsi [None req-99e35b3f-c528-456d-837c-73b7b206d335 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 00:29:13 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d69dc6d8-04c4-41a5-bf87-04f0b01f1d09 -p 172.16.0.220:3260 {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:29:13 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d69dc6d8-04c4-41a5-bf87-04f0b01f1d09 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:29:13 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[64e973da-e190-47d2-84e1-0726ed7b3c33]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:29:13 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-99e35b3f-c528-456d-837c-73b7b206d335 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 00:29:13 user nova-compute[75165]:  {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:29:13 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d69dc6d8-04c4-41a5-bf87-04f0b01f1d09 -p 172.16.0.220:3260 --interface default --op new {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:29:13 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d69dc6d8-04c4-41a5-bf87-04f0b01f1d09 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:29:13 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cfb5465-a79e-4d3f-a033-e9c8ddcc66e0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d69dc6d8-04c4-41a5-bf87-04f0b01f1d09] added\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:29:13 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-99e35b3f-c528-456d-837c-73b7b206d335 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d69dc6d8-04c4-41a5-bf87-04f0b01f1d09] added
Oct 26 00:29:13 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:29:13 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d69dc6d8-04c4-41a5-bf87-04f0b01f1d09 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:29:13 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d69dc6d8-04c4-41a5-bf87-04f0b01f1d09 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:29:13 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[76411422-a900-44c6-9f2a-f79c40697d0e]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:29:13 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-99e35b3f-c528-456d-837c-73b7b206d335 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:29:13 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d69dc6d8-04c4-41a5-bf87-04f0b01f1d09 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:29:13 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d69dc6d8-04c4-41a5-bf87-04f0b01f1d09 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:29:13 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf219680-e1cb-44c9-a165-a1f3587a7a8e]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:29:13 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-99e35b3f-c528-456d-837c-73b7b206d335 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:29:13 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d69dc6d8-04c4-41a5-bf87-04f0b01f1d09 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pBmjoxVZ {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:29:13 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d69dc6d8-04c4-41a5-bf87-04f0b01f1d09 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pBmjoxVZ" returned: 0 in 0.019s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:29:13 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bdb4345-dc7e-450a-ae29-4c596a030626]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:29:13 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-99e35b3f-c528-456d-837c-73b7b206d335 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pBmjoxVZ'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:29:13 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d69dc6d8-04c4-41a5-bf87-04f0b01f1d09 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:29:13 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d69dc6d8-04c4-41a5-bf87-04f0b01f1d09 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:29:13 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[d45d9289-646f-4b2b-8593-3cc1b5057467]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:29:13 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-99e35b3f-c528-456d-837c-73b7b206d335 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:29:13 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:29:13 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:29:13 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec63754b-b271-4764-a5ef-b5d01da9ed6e]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff19ba88-2bf9-451f-afcc-e149c1578b95 (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:29:13 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-99e35b3f-c528-456d-837c-73b7b206d335 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)
Oct 26 00:29:13 user nova-compute[75165]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff19ba88-2bf9-451f-afcc-e149c1578b95 (non-flash)
Oct 26 00:29:13 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:29:13 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-99e35b3f-c528-456d-837c-73b7b206d335 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)
Oct 26 00:29:13 user nova-compute[75165]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff19ba88-2bf9-451f-afcc-e149c1578b95 (non-flash)
Oct 26 00:29:13 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:29:13 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d69dc6d8-04c4-41a5-bf87-04f0b01f1d09 -p 172.16.0.220:3260 --login {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:29:13 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d69dc6d8-04c4-41a5-bf87-04f0b01f1d09 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:29:13 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[01c79b15-d726-466f-b45a-9127b828395f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d69dc6d8-04c4-41a5-bf87-04f0b01f1d09, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d69dc6d8-04c4-41a5-bf87-04f0b01f1d09, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:29:13 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-99e35b3f-c528-456d-837c-73b7b206d335 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d69dc6d8-04c4-41a5-bf87-04f0b01f1d09, portal: 172.16.0.220,3260]
Oct 26 00:29:13 user nova-compute[75165]: Login to [iface: default, target: iqn.2010-10.org.openstack:d69dc6d8-04c4-41a5-bf87-04f0b01f1d09, portal: 172.16.0.220,3260] successful.
Oct 26 00:29:13 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:29:13 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d69dc6d8-04c4-41a5-bf87-04f0b01f1d09 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:29:13 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d69dc6d8-04c4-41a5-bf87-04f0b01f1d09 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:29:13 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[fadb4336-8b16-4268-968d-b14930435208]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:29:13 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-99e35b3f-c528-456d-837c-73b7b206d335 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:29:13 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:29:13 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:29:13 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[17971e1b-c001-46fe-9698-4d1c5c9c7611]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff19ba88-2bf9-451f-afcc-e149c1578b95 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d69dc6d8-04c4-41a5-bf87-04f0b01f1d09 (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:29:13 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-99e35b3f-c528-456d-837c-73b7b206d335 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)
Oct 26 00:29:13 user nova-compute[75165]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff19ba88-2bf9-451f-afcc-e149c1578b95 (non-flash)
Oct 26 00:29:13 user nova-compute[75165]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d69dc6d8-04c4-41a5-bf87-04f0b01f1d09 (non-flash)
Oct 26 00:29:13 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:29:13 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-99e35b3f-c528-456d-837c-73b7b206d335 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)
Oct 26 00:29:13 user nova-compute[75165]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff19ba88-2bf9-451f-afcc-e149c1578b95 (non-flash)
Oct 26 00:29:13 user nova-compute[75165]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d69dc6d8-04c4-41a5-bf87-04f0b01f1d09 (non-flash)
Oct 26 00:29:13 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:29:13 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-99e35b3f-c528-456d-837c-73b7b206d335 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d69dc6d8-04c4-41a5-bf87-04f0b01f1d09" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.322s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:29:13 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-99e35b3f-c528-456d-837c-73b7b206d335 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Connected to 172.16.0.220:3260 {{(pid=75165) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 00:29:13 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-99e35b3f-c528-456d-837c-73b7b206d335 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] HCTL ('34', '-', '-', 0) found on session 32 with lun 0 {{(pid=75165) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 00:29:13 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-99e35b3f-c528-456d-837c-73b7b206d335 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75165) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 00:29:13 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:29:13 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:29:13 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[c98b550f-2fa2-444c-ae39-ac5aabdab659]: (4, ('- - 0', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:29:13 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-99e35b3f-c528-456d-837c-73b7b206d335 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Searching for a device in session 32 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75165) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 00:29:13 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-99e35b3f-c528-456d-837c-73b7b206d335 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:d69dc6d8-04c4-41a5-bf87-04f0b01f1d09', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pBmjoxVZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75165) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 00:29:14 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-99e35b3f-c528-456d-837c-73b7b206d335 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.354s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:29:14 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-99e35b3f-c528-456d-837c-73b7b206d335 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] <== connect_volume: return (1356ms) {'type': 'block', 'scsi_wwn': '23130323663633934', 'path': '/dev/sdc'} {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:29:14 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99e35b3f-c528-456d-837c-73b7b206d335 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] [instance: fe2984ce-8958-4049-8af7-496b313b26c8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23130323663633934', 'path': '/dev/sdc'} {{(pid=75165) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 00:29:14 user nova-compute[75165]: DEBUG nova.objects.instance [None req-99e35b3f-c528-456d-837c-73b7b206d335 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Lazy-loading 'flavor' on Instance uuid fe2984ce-8958-4049-8af7-496b313b26c8 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:29:14 user nova-compute[75165]: DEBUG nova.virt.libvirt.guest [None req-99e35b3f-c528-456d-837c-73b7b206d335 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 00:29:14 user nova-compute[75165]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 00:29:14 user nova-compute[75165]:   <source dev="/dev/sdc"/>
Oct 26 00:29:14 user nova-compute[75165]:   <target dev="vdb" bus="virtio"/>
Oct 26 00:29:14 user nova-compute[75165]:   <serial>d69dc6d8-04c4-41a5-bf87-04f0b01f1d09</serial>
Oct 26 00:29:14 user nova-compute[75165]: </disk>
Oct 26 00:29:14 user nova-compute[75165]:  {{(pid=75165) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 00:29:15 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-157cff87-a0ff-428b-8daa-cf0390eef7b5 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Acquiring lock "c396d555-70cf-4642-a0a0-485760cdf3fa" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:29:15 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-157cff87-a0ff-428b-8daa-cf0390eef7b5 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Lock "c396d555-70cf-4642-a0a0-485760cdf3fa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:29:15 user nova-compute[75165]: DEBUG nova.compute.manager [None req-157cff87-a0ff-428b-8daa-cf0390eef7b5 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] [instance: c396d555-70cf-4642-a0a0-485760cdf3fa] Starting instance... {{(pid=75165) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 00:29:15 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-99e35b3f-c528-456d-837c-73b7b206d335 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] No BDM found with device name vda, not building metadata. {{(pid=75165) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 00:29:15 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-99e35b3f-c528-456d-837c-73b7b206d335 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75165) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 00:29:15 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-99e35b3f-c528-456d-837c-73b7b206d335 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] No VIF found with MAC fa:16:3e:ca:36:c4, not building metadata {{(pid=75165) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 00:29:15 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-157cff87-a0ff-428b-8daa-cf0390eef7b5 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:29:15 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-157cff87-a0ff-428b-8daa-cf0390eef7b5 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:29:15 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-157cff87-a0ff-428b-8daa-cf0390eef7b5 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75165) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 00:29:15 user nova-compute[75165]: INFO nova.compute.claims [None req-157cff87-a0ff-428b-8daa-cf0390eef7b5 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] [instance: c396d555-70cf-4642-a0a0-485760cdf3fa] Claim successful on node user
Oct 26 00:29:15 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-99e35b3f-c528-456d-837c-73b7b206d335 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Lock "fe2984ce-8958-4049-8af7-496b313b26c8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 44.627s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:29:15 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-157cff87-a0ff-428b-8daa-cf0390eef7b5 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:29:15 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-157cff87-a0ff-428b-8daa-cf0390eef7b5 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:29:15 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-157cff87-a0ff-428b-8daa-cf0390eef7b5 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.353s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:29:15 user nova-compute[75165]: DEBUG nova.compute.manager [None req-157cff87-a0ff-428b-8daa-cf0390eef7b5 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] [instance: c396d555-70cf-4642-a0a0-485760cdf3fa] Start building networks asynchronously for instance. {{(pid=75165) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 00:29:15 user nova-compute[75165]: DEBUG nova.compute.manager [None req-157cff87-a0ff-428b-8daa-cf0390eef7b5 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] [instance: c396d555-70cf-4642-a0a0-485760cdf3fa] Allocating IP information in the background. {{(pid=75165) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 00:29:15 user nova-compute[75165]: DEBUG nova.network.neutron [None req-157cff87-a0ff-428b-8daa-cf0390eef7b5 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] [instance: c396d555-70cf-4642-a0a0-485760cdf3fa] allocate_for_instance() {{(pid=75165) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 00:29:15 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-157cff87-a0ff-428b-8daa-cf0390eef7b5 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] [instance: c396d555-70cf-4642-a0a0-485760cdf3fa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 00:29:15 user nova-compute[75165]: DEBUG nova.compute.manager [None req-157cff87-a0ff-428b-8daa-cf0390eef7b5 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] [instance: c396d555-70cf-4642-a0a0-485760cdf3fa] Start building block device mappings for instance. {{(pid=75165) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 00:29:15 user nova-compute[75165]: INFO nova.virt.block_device [None req-157cff87-a0ff-428b-8daa-cf0390eef7b5 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] [instance: c396d555-70cf-4642-a0a0-485760cdf3fa] Booting with volume 9894622e-4af8-47e2-82c6-3f4e301caeb7 at /dev/vda
Oct 26 00:29:15 user nova-compute[75165]: DEBUG nova.policy [None req-157cff87-a0ff-428b-8daa-cf0390eef7b5 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2aa1bebf8931436d80d792651953a57b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f000be4e226e4e3db3c0832bbf04cd29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75165) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 00:29:15 user nova-compute[75165]: DEBUG os_brick.utils [None req-157cff87-a0ff-428b-8daa-cf0390eef7b5 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:29:15 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:29:15 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:29:15 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[42b19666-5a9f-4a4a-9d7b-eeae05257497]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa94814ccb35\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:29:15 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:29:15 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:29:15 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab32e095-1cae-436f-b326-4f596ac5b801]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:29:15 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:29:15 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:29:15 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[10b5f4de-bb94-4dce-ba96-0b055716d864]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:29:15 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f30d9ee-093a-4321-9650-c55f5b1f7045]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:29:15 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-157cff87-a0ff-428b-8daa-cf0390eef7b5 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Running cmd (subprocess): nvme version {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:29:15 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-157cff87-a0ff-428b-8daa-cf0390eef7b5 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] 'nvme version' failed. Not Retrying. {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 00:29:15 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.nvmeof [None req-157cff87-a0ff-428b-8daa-cf0390eef7b5 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] nvme not present on system {{(pid=75165) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 00:29:15 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:29:15 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 00:29:15 user nova-compute[75165]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 00:29:15 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[758861ba-a8a9-4b09-97e4-5c00059c4e2a]: (4, '') {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:29:15 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-157cff87-a0ff-428b-8daa-cf0390eef7b5 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75165) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 00:29:15 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-157cff87-a0ff-428b-8daa-cf0390eef7b5 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75165) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 00:29:15 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-157cff87-a0ff-428b-8daa-cf0390eef7b5 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] LIGHTOS: no hostnqn found. {{(pid=75165) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 00:29:15 user nova-compute[75165]: DEBUG os_brick.utils [None req-157cff87-a0ff-428b-8daa-cf0390eef7b5 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa94814ccb35', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:29:15 user nova-compute[75165]: DEBUG nova.virt.block_device [None req-157cff87-a0ff-428b-8daa-cf0390eef7b5 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] [instance: c396d555-70cf-4642-a0a0-485760cdf3fa] Updating existing volume attachment record: e9d2b74e-5512-4926-a69e-216a01217db1 {{(pid=75165) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 00:29:16 user nova-compute[75165]: DEBUG nova.compute.manager [None req-b6546711-91a7-4816-9326-2633e52621c9 tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] [instance: 250afc24-0c38-4959-a77c-d51365dd1c4e] Start spawning the instance on the hypervisor. {{(pid=75165) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 00:29:16 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-b6546711-91a7-4816-9326-2633e52621c9 tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] [instance: 250afc24-0c38-4959-a77c-d51365dd1c4e] Creating instance directory {{(pid=75165) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 00:29:16 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-b6546711-91a7-4816-9326-2633e52621c9 tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] [instance: 250afc24-0c38-4959-a77c-d51365dd1c4e] Creating image(s)
Oct 26 00:29:16 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-b6546711-91a7-4816-9326-2633e52621c9 tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] [instance: 250afc24-0c38-4959-a77c-d51365dd1c4e] Did not create local disks {{(pid=75165) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 26 00:29:16 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-b6546711-91a7-4816-9326-2633e52621c9 tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] [instance: 250afc24-0c38-4959-a77c-d51365dd1c4e] Ensure instance console log exists: /opt/stack/data/nova/instances/250afc24-0c38-4959-a77c-d51365dd1c4e/console.log {{(pid=75165) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 00:29:16 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-b6546711-91a7-4816-9326-2633e52621c9 tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:29:16 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-b6546711-91a7-4816-9326-2633e52621c9 tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:29:16 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-b6546711-91a7-4816-9326-2633e52621c9 tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:29:16 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-b6546711-91a7-4816-9326-2633e52621c9 tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] [instance: 250afc24-0c38-4959-a77c-d51365dd1c4e] Start _get_guest_xml network_info=[{"id": "0372e87f-5631-4444-bfe8-ae5af9f09a46", "address": "fa:16:3e:76:de:bf", "network": {"id": "3fa5f12d-c7f4-4f2f-8934-6fa94f598a4c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1095967566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf09714f89484ff5ad700a5528b8d7c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0372e87f-56", "ovs_interfaceid": "0372e87f-5631-4444-bfe8-ae5af9f09a46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OQmglCFc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '250afc24-0c38-4959-a77c-d51365dd1c4e', 'attached_at': '', 'detached_at': '', 'volume_id': 'af851e79-3073-4793-929f-877775c91de0', 'serial': 'af851e79-3073-4793-929f-877775c91de0'}, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'attachment_id': '13bb4e4b-fb62-4f5d-8a98-54f0ab113ee5', 'delete_on_termination': True, 'volume_type': None} {{(pid=75165) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 00:29:16 user nova-compute[75165]: DEBUG nova.network.neutron [None req-157cff87-a0ff-428b-8daa-cf0390eef7b5 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] [instance: c396d555-70cf-4642-a0a0-485760cdf3fa] Successfully created port: 500c8c79-cf9c-46ef-a5d1-273f387e410a {{(pid=75165) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 00:29:16 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-b6546711-91a7-4816-9326-2633e52621c9 tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:29:16 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-b6546711-91a7-4816-9326-2633e52621c9 tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:29:16 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-b6546711-91a7-4816-9326-2633e52621c9 tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75165) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 00:29:16 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-b6546711-91a7-4816-9326-2633e52621c9 tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] CPU controller missing on host. {{(pid=75165) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 00:29:16 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-b6546711-91a7-4816-9326-2633e52621c9 tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75165) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 00:29:16 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-b6546711-91a7-4816-9326-2633e52621c9 tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] CPU controller found on host. {{(pid=75165) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 00:29:16 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-b6546711-91a7-4816-9326-2633e52621c9 tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75165) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 00:29:16 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-b6546711-91a7-4816-9326-2633e52621c9 tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T00:03:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 00:29:16 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-b6546711-91a7-4816-9326-2633e52621c9 tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Flavor limits 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 00:29:16 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-b6546711-91a7-4816-9326-2633e52621c9 tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Image limits 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 00:29:16 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-b6546711-91a7-4816-9326-2633e52621c9 tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Flavor pref 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 00:29:16 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-b6546711-91a7-4816-9326-2633e52621c9 tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Image pref 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 00:29:16 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-b6546711-91a7-4816-9326-2633e52621c9 tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 00:29:16 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-b6546711-91a7-4816-9326-2633e52621c9 tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 00:29:16 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-b6546711-91a7-4816-9326-2633e52621c9 tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75165) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 00:29:16 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-b6546711-91a7-4816-9326-2633e52621c9 tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Got 1 possible topologies {{(pid=75165) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 00:29:16 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-b6546711-91a7-4816-9326-2633e52621c9 tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 00:29:16 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-b6546711-91a7-4816-9326-2633e52621c9 tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 00:29:16 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6546711-91a7-4816-9326-2633e52621c9 tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] [instance: 250afc24-0c38-4959-a77c-d51365dd1c4e] Calling os-brick to attach iSCSI Volume {{(pid=75165) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 00:29:16 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6546711-91a7-4816-9326-2633e52621c9 tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8bf8160e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OQmglCFc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:29:16 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-b6546711-91a7-4816-9326-2633e52621c9 tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:29:16 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-b6546711-91a7-4816-9326-2633e52621c9 tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:29:16 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-b6546711-91a7-4816-9326-2633e52621c9 tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:29:16 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-b6546711-91a7-4816-9326-2633e52621c9 tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:29:16 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-b6546711-91a7-4816-9326-2633e52621c9 tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:29:16 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-b6546711-91a7-4816-9326-2633e52621c9 tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:29:16 user nova-compute[75165]: INFO os_brick.initiator.connectors.iscsi [None req-b6546711-91a7-4816-9326-2633e52621c9 tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 00:29:16 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0 -p 172.16.0.220:3260 {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:29:16 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:29:16 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[a66b6ed7-a842-43d8-8642-95be5ccf527e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:29:16 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6546711-91a7-4816-9326-2633e52621c9 tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 00:29:16 user nova-compute[75165]:  {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:29:16 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0 -p 172.16.0.220:3260 --interface default --op new {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:29:16 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:29:16 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:29:16 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[c134df2c-828c-4675-8aff-23fc71ff4930]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0] added\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:29:16 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6546711-91a7-4816-9326-2633e52621c9 tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0] added
Oct 26 00:29:16 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:29:16 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:29:16 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:29:16 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc8f0271-6f3e-47b7-9ad0-13e0df97c2ad]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:29:16 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6546711-91a7-4816-9326-2633e52621c9 tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:29:16 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:29:16 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:29:16 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[d60d1adf-f748-41a4-9e85-fcdb17443679]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:29:16 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6546711-91a7-4816-9326-2633e52621c9 tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:29:16 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OQmglCFc {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:29:16 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OQmglCFc" returned: 0 in 0.021s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:29:16 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[24a78b25-8863-49f5-83b6-afb1ac1cf876]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:29:16 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6546711-91a7-4816-9326-2633e52621c9 tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OQmglCFc'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:29:16 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:29:16 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:29:16 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9a017d8-aea8-4abd-a49b-e3e8c7d9036c]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:29:16 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6546711-91a7-4816-9326-2633e52621c9 tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:29:16 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:29:16 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:29:16 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[beb19e69-2b10-4d48-9fe6-ca46716d2965]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff19ba88-2bf9-451f-afcc-e149c1578b95 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d69dc6d8-04c4-41a5-bf87-04f0b01f1d09 (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:29:16 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6546711-91a7-4816-9326-2633e52621c9 tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)
Oct 26 00:29:16 user nova-compute[75165]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff19ba88-2bf9-451f-afcc-e149c1578b95 (non-flash)
Oct 26 00:29:16 user nova-compute[75165]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d69dc6d8-04c4-41a5-bf87-04f0b01f1d09 (non-flash)
Oct 26 00:29:16 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:29:16 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6546711-91a7-4816-9326-2633e52621c9 tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)
Oct 26 00:29:16 user nova-compute[75165]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff19ba88-2bf9-451f-afcc-e149c1578b95 (non-flash)
Oct 26 00:29:16 user nova-compute[75165]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d69dc6d8-04c4-41a5-bf87-04f0b01f1d09 (non-flash)
Oct 26 00:29:16 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:29:16 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0 -p 172.16.0.220:3260 --login {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:29:16 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0 -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:29:16 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d1d1562-8e15-4b3d-bc13-02828f5d677b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:29:16 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6546711-91a7-4816-9326-2633e52621c9 tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0, portal: 172.16.0.220,3260]
Oct 26 00:29:16 user nova-compute[75165]: Login to [iface: default, target: iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0, portal: 172.16.0.220,3260] successful.
Oct 26 00:29:16 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:29:16 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:29:16 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:29:16 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[f64681e2-d4c7-47ed-a619-f202040c8800]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:29:16 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6546711-91a7-4816-9326-2633e52621c9 tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:29:16 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:29:16 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:29:16 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:29:16 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:29:16 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aac73b2-c9d6-4740-9168-538aeba0e5d6]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff19ba88-2bf9-451f-afcc-e149c1578b95 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d69dc6d8-04c4-41a5-bf87-04f0b01f1d09 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0 (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:29:16 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6546711-91a7-4816-9326-2633e52621c9 tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)
Oct 26 00:29:16 user nova-compute[75165]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff19ba88-2bf9-451f-afcc-e149c1578b95 (non-flash)
Oct 26 00:29:16 user nova-compute[75165]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d69dc6d8-04c4-41a5-bf87-04f0b01f1d09 (non-flash)
Oct 26 00:29:16 user nova-compute[75165]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0 (non-flash)
Oct 26 00:29:16 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:29:16 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6546711-91a7-4816-9326-2633e52621c9 tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)
Oct 26 00:29:16 user nova-compute[75165]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff19ba88-2bf9-451f-afcc-e149c1578b95 (non-flash)
Oct 26 00:29:16 user nova-compute[75165]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d69dc6d8-04c4-41a5-bf87-04f0b01f1d09 (non-flash)
Oct 26 00:29:16 user nova-compute[75165]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0 (non-flash)
Oct 26 00:29:16 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:29:16 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-b6546711-91a7-4816-9326-2633e52621c9 tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.322s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:29:16 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6546711-91a7-4816-9326-2633e52621c9 tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Connected to 172.16.0.220:3260 {{(pid=75165) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 00:29:16 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-b6546711-91a7-4816-9326-2633e52621c9 tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] HCTL ('36', '-', '-', 0) found on session 33 with lun 0 {{(pid=75165) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 00:29:16 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-b6546711-91a7-4816-9326-2633e52621c9 tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75165) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 00:29:16 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:29:16 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.022s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:29:16 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[636a02a5-2b1b-420a-9035-268acf0fc0af]: (4, ('- - 0', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:29:16 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-b6546711-91a7-4816-9326-2633e52621c9 tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Searching for a device in session 33 and hctl ['36', '*', '*', 0] yield: None {{(pid=75165) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 00:29:17 user nova-compute[75165]: DEBUG nova.network.neutron [None req-157cff87-a0ff-428b-8daa-cf0390eef7b5 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] [instance: c396d555-70cf-4642-a0a0-485760cdf3fa] Successfully updated port: 500c8c79-cf9c-46ef-a5d1-273f387e410a {{(pid=75165) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 00:29:17 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-157cff87-a0ff-428b-8daa-cf0390eef7b5 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Acquiring lock "refresh_cache-c396d555-70cf-4642-a0a0-485760cdf3fa" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:29:17 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-157cff87-a0ff-428b-8daa-cf0390eef7b5 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Acquired lock "refresh_cache-c396d555-70cf-4642-a0a0-485760cdf3fa" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:29:17 user nova-compute[75165]: DEBUG nova.network.neutron [None req-157cff87-a0ff-428b-8daa-cf0390eef7b5 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] [instance: c396d555-70cf-4642-a0a0-485760cdf3fa] Building network info cache for instance {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 00:29:17 user nova-compute[75165]: DEBUG nova.compute.manager [req-2cc32d7c-7a94-49ff-adc8-14769bf92c5a req-591670d7-ca25-473a-a48a-7cd215a6a03a service nova] [instance: c396d555-70cf-4642-a0a0-485760cdf3fa] Received event network-changed-500c8c79-cf9c-46ef-a5d1-273f387e410a {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:29:17 user nova-compute[75165]: DEBUG nova.compute.manager [req-2cc32d7c-7a94-49ff-adc8-14769bf92c5a req-591670d7-ca25-473a-a48a-7cd215a6a03a service nova] [instance: c396d555-70cf-4642-a0a0-485760cdf3fa] Refreshing instance network info cache due to event network-changed-500c8c79-cf9c-46ef-a5d1-273f387e410a. {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 00:29:17 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-2cc32d7c-7a94-49ff-adc8-14769bf92c5a req-591670d7-ca25-473a-a48a-7cd215a6a03a service nova] Acquiring lock "refresh_cache-c396d555-70cf-4642-a0a0-485760cdf3fa" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:29:17 user nova-compute[75165]: DEBUG nova.network.neutron [None req-157cff87-a0ff-428b-8daa-cf0390eef7b5 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] [instance: c396d555-70cf-4642-a0a0-485760cdf3fa] Instance cache missing network info. {{(pid=75165) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 00:29:17 user nova-compute[75165]: DEBUG nova.network.neutron [None req-157cff87-a0ff-428b-8daa-cf0390eef7b5 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] [instance: c396d555-70cf-4642-a0a0-485760cdf3fa] Updating instance_info_cache with network_info: [{"id": "500c8c79-cf9c-46ef-a5d1-273f387e410a", "address": "fa:16:3e:89:15:98", "network": {"id": "7f96025b-485f-4ba3-9f45-708c09822ffa", "bridge": "br-int", "label": "tempest-TestShelveInstance-363925751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f000be4e226e4e3db3c0832bbf04cd29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap500c8c79-cf", "ovs_interfaceid": "500c8c79-cf9c-46ef-a5d1-273f387e410a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:29:17 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-157cff87-a0ff-428b-8daa-cf0390eef7b5 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Releasing lock "refresh_cache-c396d555-70cf-4642-a0a0-485760cdf3fa" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:29:17 user nova-compute[75165]: DEBUG nova.compute.manager [None req-157cff87-a0ff-428b-8daa-cf0390eef7b5 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] [instance: c396d555-70cf-4642-a0a0-485760cdf3fa] Instance network_info: |[{"id": "500c8c79-cf9c-46ef-a5d1-273f387e410a", "address": "fa:16:3e:89:15:98", "network": {"id": "7f96025b-485f-4ba3-9f45-708c09822ffa", "bridge": "br-int", "label": "tempest-TestShelveInstance-363925751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f000be4e226e4e3db3c0832bbf04cd29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap500c8c79-cf", "ovs_interfaceid": "500c8c79-cf9c-46ef-a5d1-273f387e410a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75165) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 00:29:17 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-2cc32d7c-7a94-49ff-adc8-14769bf92c5a req-591670d7-ca25-473a-a48a-7cd215a6a03a service nova] Acquired lock "refresh_cache-c396d555-70cf-4642-a0a0-485760cdf3fa" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:29:17 user nova-compute[75165]: DEBUG nova.network.neutron [req-2cc32d7c-7a94-49ff-adc8-14769bf92c5a req-591670d7-ca25-473a-a48a-7cd215a6a03a service nova] [instance: c396d555-70cf-4642-a0a0-485760cdf3fa] Refreshing network info cache for port 500c8c79-cf9c-46ef-a5d1-273f387e410a {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 00:29:17 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-b6546711-91a7-4816-9326-2633e52621c9 tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Searching for a device in session 33 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75165) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 00:29:17 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6546711-91a7-4816-9326-2633e52621c9 tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OQmglCFc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75165) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 00:29:17 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-b6546711-91a7-4816-9326-2633e52621c9 tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.358s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:29:17 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6546711-91a7-4816-9326-2633e52621c9 tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] <== connect_volume: return (1360ms) {'type': 'block', 'scsi_wwn': '23565326264353065', 'path': '/dev/sde'} {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:29:17 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6546711-91a7-4816-9326-2633e52621c9 tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] [instance: 250afc24-0c38-4959-a77c-d51365dd1c4e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23565326264353065', 'path': '/dev/sde'} {{(pid=75165) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 00:29:17 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-b6546711-91a7-4816-9326-2633e52621c9 tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:28:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1212881648',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1212881648',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFEgAg/Q1sMeId7lJYLOcThhEJxasXz49LMiw6Ps6oE3Fcs9iqtrJ+O72pBFxY/rgxlAUWtLD4fFFfgvtCEdgpuiC+rAwqWmjPE8j/TwqxmovOpzhEUnuTgmVOvLZYE6qw==',key_name='tempest-keypair-1823122855',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cf09714f89484ff5ad700a5528b8d7c8',ramdisk_id='',reservation_id='r-e88bj6ps',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1175798990',owner_user_name='tempest-ServerActionsV293TestJSON-1175798990-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T00:28:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2c471e2bc8dc4e5f93dd321369821a99',uuid=250afc24-0c38-4959-a77c-d51365dd1c4e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0372e87f-5631-4444-bfe8-ae5af9f09a46", "address": "fa:16:3e:76:de:bf", "network": {"id": "3fa5f12d-c7f4-4f2f-8934-6fa94f598a4c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1095967566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf09714f89484ff5ad700a5528b8d7c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0372e87f-56", "ovs_interfaceid": "0372e87f-5631-4444-bfe8-ae5af9f09a46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75165) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 00:29:17 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-b6546711-91a7-4816-9326-2633e52621c9 tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Converting VIF {"id": "0372e87f-5631-4444-bfe8-ae5af9f09a46", "address": "fa:16:3e:76:de:bf", "network": {"id": "3fa5f12d-c7f4-4f2f-8934-6fa94f598a4c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1095967566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf09714f89484ff5ad700a5528b8d7c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0372e87f-56", "ovs_interfaceid": "0372e87f-5631-4444-bfe8-ae5af9f09a46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:29:17 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-b6546711-91a7-4816-9326-2633e52621c9 tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:de:bf,bridge_name='br-int',has_traffic_filtering=True,id=0372e87f-5631-4444-bfe8-ae5af9f09a46,network=Network(3fa5f12d-c7f4-4f2f-8934-6fa94f598a4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0372e87f-56') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:29:17 user nova-compute[75165]: DEBUG nova.objects.instance [None req-b6546711-91a7-4816-9326-2633e52621c9 tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Lazy-loading 'pci_devices' on Instance uuid 250afc24-0c38-4959-a77c-d51365dd1c4e {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:29:17 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-b6546711-91a7-4816-9326-2633e52621c9 tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] [instance: 250afc24-0c38-4959-a77c-d51365dd1c4e] End _get_guest_xml xml=<domain type="kvm">
Oct 26 00:29:17 user nova-compute[75165]:   <uuid>250afc24-0c38-4959-a77c-d51365dd1c4e</uuid>
Oct 26 00:29:17 user nova-compute[75165]:   <name>instance-00000022</name>
Oct 26 00:29:17 user nova-compute[75165]:   <memory>524288</memory>
Oct 26 00:29:17 user nova-compute[75165]:   <vcpu>1</vcpu>
Oct 26 00:29:17 user nova-compute[75165]:   <metadata>
Oct 26 00:29:17 user nova-compute[75165]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 00:29:17 user nova-compute[75165]:       <nova:package version="0.0.0"/>
Oct 26 00:29:17 user nova-compute[75165]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1212881648</nova:name>
Oct 26 00:29:17 user nova-compute[75165]:       <nova:creationTime>2023-10-26 00:29:16</nova:creationTime>
Oct 26 00:29:17 user nova-compute[75165]:       <nova:flavor name="m1.tiny">
Oct 26 00:29:17 user nova-compute[75165]:         <nova:memory>512</nova:memory>
Oct 26 00:29:17 user nova-compute[75165]:         <nova:disk>1</nova:disk>
Oct 26 00:29:17 user nova-compute[75165]:         <nova:swap>0</nova:swap>
Oct 26 00:29:17 user nova-compute[75165]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 00:29:17 user nova-compute[75165]:         <nova:vcpus>1</nova:vcpus>
Oct 26 00:29:17 user nova-compute[75165]:       </nova:flavor>
Oct 26 00:29:17 user nova-compute[75165]:       <nova:owner>
Oct 26 00:29:17 user nova-compute[75165]:         <nova:user uuid="2c471e2bc8dc4e5f93dd321369821a99">tempest-ServerActionsV293TestJSON-1175798990-project-member</nova:user>
Oct 26 00:29:17 user nova-compute[75165]:         <nova:project uuid="cf09714f89484ff5ad700a5528b8d7c8">tempest-ServerActionsV293TestJSON-1175798990</nova:project>
Oct 26 00:29:17 user nova-compute[75165]:       </nova:owner>
Oct 26 00:29:17 user nova-compute[75165]:       <nova:ports>
Oct 26 00:29:17 user nova-compute[75165]:         <nova:port uuid="0372e87f-5631-4444-bfe8-ae5af9f09a46">
Oct 26 00:29:17 user nova-compute[75165]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 26 00:29:17 user nova-compute[75165]:         </nova:port>
Oct 26 00:29:17 user nova-compute[75165]:       </nova:ports>
Oct 26 00:29:17 user nova-compute[75165]:     </nova:instance>
Oct 26 00:29:17 user nova-compute[75165]:   </metadata>
Oct 26 00:29:17 user nova-compute[75165]:   <sysinfo type="smbios">
Oct 26 00:29:17 user nova-compute[75165]:     <system>
Oct 26 00:29:17 user nova-compute[75165]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 00:29:17 user nova-compute[75165]:       <entry name="product">OpenStack Nova</entry>
Oct 26 00:29:17 user nova-compute[75165]:       <entry name="version">0.0.0</entry>
Oct 26 00:29:17 user nova-compute[75165]:       <entry name="serial">250afc24-0c38-4959-a77c-d51365dd1c4e</entry>
Oct 26 00:29:17 user nova-compute[75165]:       <entry name="uuid">250afc24-0c38-4959-a77c-d51365dd1c4e</entry>
Oct 26 00:29:17 user nova-compute[75165]:       <entry name="family">Virtual Machine</entry>
Oct 26 00:29:17 user nova-compute[75165]:     </system>
Oct 26 00:29:17 user nova-compute[75165]:   </sysinfo>
Oct 26 00:29:17 user nova-compute[75165]:   <os>
Oct 26 00:29:17 user nova-compute[75165]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 00:29:17 user nova-compute[75165]:     <boot dev="hd"/>
Oct 26 00:29:17 user nova-compute[75165]:     <smbios mode="sysinfo"/>
Oct 26 00:29:17 user nova-compute[75165]:   </os>
Oct 26 00:29:17 user nova-compute[75165]:   <features>
Oct 26 00:29:17 user nova-compute[75165]:     <acpi/>
Oct 26 00:29:17 user nova-compute[75165]:     <apic/>
Oct 26 00:29:17 user nova-compute[75165]:     <vmcoreinfo/>
Oct 26 00:29:17 user nova-compute[75165]:   </features>
Oct 26 00:29:17 user nova-compute[75165]:   <clock offset="utc">
Oct 26 00:29:17 user nova-compute[75165]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 00:29:17 user nova-compute[75165]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 00:29:17 user nova-compute[75165]:     <timer name="hpet" present="no"/>
Oct 26 00:29:17 user nova-compute[75165]:   </clock>
Oct 26 00:29:17 user nova-compute[75165]:   <cpu mode="custom" match="exact">
Oct 26 00:29:17 user nova-compute[75165]:     <model>Nehalem</model>
Oct 26 00:29:17 user nova-compute[75165]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 00:29:17 user nova-compute[75165]:   </cpu>
Oct 26 00:29:17 user nova-compute[75165]:   <devices>
Oct 26 00:29:17 user nova-compute[75165]:     <disk type="block" device="disk">
Oct 26 00:29:17 user nova-compute[75165]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 00:29:17 user nova-compute[75165]:       <source dev="/dev/sde"/>
Oct 26 00:29:17 user nova-compute[75165]:       <target dev="vda" bus="virtio"/>
Oct 26 00:29:17 user nova-compute[75165]:       <serial>af851e79-3073-4793-929f-877775c91de0</serial>
Oct 26 00:29:17 user nova-compute[75165]:     </disk>
Oct 26 00:29:17 user nova-compute[75165]:     <interface type="ethernet">
Oct 26 00:29:17 user nova-compute[75165]:       <mac address="fa:16:3e:76:de:bf"/>
Oct 26 00:29:17 user nova-compute[75165]:       <model type="virtio"/>
Oct 26 00:29:17 user nova-compute[75165]:       <mtu size="1442"/>
Oct 26 00:29:17 user nova-compute[75165]:       <target dev="tap0372e87f-56"/>
Oct 26 00:29:17 user nova-compute[75165]:     </interface>
Oct 26 00:29:17 user nova-compute[75165]:     <serial type="pty">
Oct 26 00:29:17 user nova-compute[75165]:       <log file="/opt/stack/data/nova/instances/250afc24-0c38-4959-a77c-d51365dd1c4e/console.log" append="off"/>
Oct 26 00:29:17 user nova-compute[75165]:     </serial>
Oct 26 00:29:17 user nova-compute[75165]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 00:29:17 user nova-compute[75165]:     <video>
Oct 26 00:29:17 user nova-compute[75165]:       <model type="virtio"/>
Oct 26 00:29:17 user nova-compute[75165]:     </video>
Oct 26 00:29:17 user nova-compute[75165]:     <rng model="virtio">
Oct 26 00:29:17 user nova-compute[75165]:       <backend model="random">/dev/urandom</backend>
Oct 26 00:29:17 user nova-compute[75165]:     </rng>
Oct 26 00:29:17 user nova-compute[75165]:     <controller type="usb" index="0" model="none"/>
Oct 26 00:29:17 user nova-compute[75165]:     <memballoon model="virtio">
Oct 26 00:29:17 user nova-compute[75165]:       <stats period="10"/>
Oct 26 00:29:17 user nova-compute[75165]:     </memballoon>
Oct 26 00:29:17 user nova-compute[75165]:   </devices>
Oct 26 00:29:17 user nova-compute[75165]: </domain>
Oct 26 00:29:17 user nova-compute[75165]:  {{(pid=75165) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 00:29:17 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-b6546711-91a7-4816-9326-2633e52621c9 tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:28:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1212881648',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1212881648',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFEgAg/Q1sMeId7lJYLOcThhEJxasXz49LMiw6Ps6oE3Fcs9iqtrJ+O72pBFxY/rgxlAUWtLD4fFFfgvtCEdgpuiC+rAwqWmjPE8j/TwqxmovOpzhEUnuTgmVOvLZYE6qw==',key_name='tempest-keypair-1823122855',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cf09714f89484ff5ad700a5528b8d7c8',ramdisk_id='',reservation_id='r-e88bj6ps',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1175798990',owner_user_name='tempest-ServerActionsV293TestJSON-1175798990-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T00:28:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2c471e2bc8dc4e5f93dd321369821a99',uuid=250afc24-0c38-4959-a77c-d51365dd1c4e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0372e87f-5631-4444-bfe8-ae5af9f09a46", "address": "fa:16:3e:76:de:bf", "network": {"id": "3fa5f12d-c7f4-4f2f-8934-6fa94f598a4c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1095967566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf09714f89484ff5ad700a5528b8d7c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0372e87f-56", "ovs_interfaceid": "0372e87f-5631-4444-bfe8-ae5af9f09a46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 00:29:17 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-b6546711-91a7-4816-9326-2633e52621c9 tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Converting VIF {"id": "0372e87f-5631-4444-bfe8-ae5af9f09a46", "address": "fa:16:3e:76:de:bf", "network": {"id": "3fa5f12d-c7f4-4f2f-8934-6fa94f598a4c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1095967566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf09714f89484ff5ad700a5528b8d7c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0372e87f-56", "ovs_interfaceid": "0372e87f-5631-4444-bfe8-ae5af9f09a46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:29:17 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-b6546711-91a7-4816-9326-2633e52621c9 tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:de:bf,bridge_name='br-int',has_traffic_filtering=True,id=0372e87f-5631-4444-bfe8-ae5af9f09a46,network=Network(3fa5f12d-c7f4-4f2f-8934-6fa94f598a4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0372e87f-56') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:29:17 user nova-compute[75165]: DEBUG os_vif [None req-b6546711-91a7-4816-9326-2633e52621c9 tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:de:bf,bridge_name='br-int',has_traffic_filtering=True,id=0372e87f-5631-4444-bfe8-ae5af9f09a46,network=Network(3fa5f12d-c7f4-4f2f-8934-6fa94f598a4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0372e87f-56') {{(pid=75165) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 00:29:17 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:29:17 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:29:17 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 00:29:17 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:29:17 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a229fe34-d625-5d83-bf77-90778562b637', '_type': 'linux-noop'}}, row=False) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:29:17 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:29:17 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:29:17 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:29:17 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0372e87f-56, may_exist=True, interface_attrs={}) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:29:17 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0372e87f-56, col_values=(('qos', UUID('4d9286e0-2fc2-48f8-8c7a-28ee7c8e7730')),), if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:29:17 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0372e87f-56, col_values=(('external_ids', {'iface-id': '0372e87f-5631-4444-bfe8-ae5af9f09a46', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:76:de:bf', 'vm-uuid': '250afc24-0c38-4959-a77c-d51365dd1c4e'}),), if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:29:18 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:29:18 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:29:18 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:29:18 user nova-compute[75165]: INFO os_vif [None req-b6546711-91a7-4816-9326-2633e52621c9 tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:de:bf,bridge_name='br-int',has_traffic_filtering=True,id=0372e87f-5631-4444-bfe8-ae5af9f09a46,network=Network(3fa5f12d-c7f4-4f2f-8934-6fa94f598a4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0372e87f-56')
Oct 26 00:29:18 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-b6546711-91a7-4816-9326-2633e52621c9 tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] No BDM found with device name vda, not building metadata. {{(pid=75165) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 00:29:18 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-b6546711-91a7-4816-9326-2633e52621c9 tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] No VIF found with MAC fa:16:3e:76:de:bf, not building metadata {{(pid=75165) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 00:29:18 user nova-compute[75165]: DEBUG nova.network.neutron [req-2cc32d7c-7a94-49ff-adc8-14769bf92c5a req-591670d7-ca25-473a-a48a-7cd215a6a03a service nova] [instance: c396d555-70cf-4642-a0a0-485760cdf3fa] Updated VIF entry in instance network info cache for port 500c8c79-cf9c-46ef-a5d1-273f387e410a. {{(pid=75165) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 00:29:18 user nova-compute[75165]: DEBUG nova.network.neutron [req-2cc32d7c-7a94-49ff-adc8-14769bf92c5a req-591670d7-ca25-473a-a48a-7cd215a6a03a service nova] [instance: c396d555-70cf-4642-a0a0-485760cdf3fa] Updating instance_info_cache with network_info: [{"id": "500c8c79-cf9c-46ef-a5d1-273f387e410a", "address": "fa:16:3e:89:15:98", "network": {"id": "7f96025b-485f-4ba3-9f45-708c09822ffa", "bridge": "br-int", "label": "tempest-TestShelveInstance-363925751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f000be4e226e4e3db3c0832bbf04cd29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap500c8c79-cf", "ovs_interfaceid": "500c8c79-cf9c-46ef-a5d1-273f387e410a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:29:18 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-2cc32d7c-7a94-49ff-adc8-14769bf92c5a req-591670d7-ca25-473a-a48a-7cd215a6a03a service nova] Releasing lock "refresh_cache-c396d555-70cf-4642-a0a0-485760cdf3fa" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:29:18 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:29:18 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:29:18 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Starting heal instance info cache {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 00:29:18 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "refresh_cache-a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:29:18 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquired lock "refresh_cache-a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:29:18 user nova-compute[75165]: DEBUG nova.network.neutron [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb] Forcefully refreshing network info cache for instance {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 00:29:19 user nova-compute[75165]: DEBUG nova.network.neutron [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb] Updating instance_info_cache with network_info: [{"id": "e2143e91-9f8c-4670-9f92-c2c00827a619", "address": "fa:16:3e:6c:b7:14", "network": {"id": "eb55c0bc-cae5-4ba3-851a-e31a50b52c88", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1081223830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d616862c7c184de5b0ba3121552c5666", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2143e91-9f", "ovs_interfaceid": "e2143e91-9f8c-4670-9f92-c2c00827a619", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:29:19 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:29:19 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Releasing lock "refresh_cache-a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:29:19 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb] Updated the network info_cache for instance {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 00:29:19 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:29:19 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:29:19 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:29:19 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:29:19 user nova-compute[75165]: DEBUG nova.compute.manager [req-d552b382-8e48-4582-89c7-32a7b45f3f5f req-dcc3375c-16c0-4ff5-b445-d52c529b1c84 service nova] [instance: 250afc24-0c38-4959-a77c-d51365dd1c4e] Received event network-vif-plugged-0372e87f-5631-4444-bfe8-ae5af9f09a46 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:29:19 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-d552b382-8e48-4582-89c7-32a7b45f3f5f req-dcc3375c-16c0-4ff5-b445-d52c529b1c84 service nova] Acquiring lock "250afc24-0c38-4959-a77c-d51365dd1c4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:29:19 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-d552b382-8e48-4582-89c7-32a7b45f3f5f req-dcc3375c-16c0-4ff5-b445-d52c529b1c84 service nova] Lock "250afc24-0c38-4959-a77c-d51365dd1c4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:29:19 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-d552b382-8e48-4582-89c7-32a7b45f3f5f req-dcc3375c-16c0-4ff5-b445-d52c529b1c84 service nova] Lock "250afc24-0c38-4959-a77c-d51365dd1c4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:29:19 user nova-compute[75165]: DEBUG nova.compute.manager [req-d552b382-8e48-4582-89c7-32a7b45f3f5f req-dcc3375c-16c0-4ff5-b445-d52c529b1c84 service nova] [instance: 250afc24-0c38-4959-a77c-d51365dd1c4e] No waiting events found dispatching network-vif-plugged-0372e87f-5631-4444-bfe8-ae5af9f09a46 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:29:19 user nova-compute[75165]: WARNING nova.compute.manager [req-d552b382-8e48-4582-89c7-32a7b45f3f5f req-dcc3375c-16c0-4ff5-b445-d52c529b1c84 service nova] [instance: 250afc24-0c38-4959-a77c-d51365dd1c4e] Received unexpected event network-vif-plugged-0372e87f-5631-4444-bfe8-ae5af9f09a46 for instance with vm_state building and task_state spawning.
Oct 26 00:29:19 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:29:19 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:29:19 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:29:19 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:29:19 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:29:19 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75165) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 00:29:20 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:29:20 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:29:20 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:29:21 user nova-compute[75165]: DEBUG nova.compute.manager [None req-b6546711-91a7-4816-9326-2633e52621c9 tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] [instance: 250afc24-0c38-4959-a77c-d51365dd1c4e] Instance event wait completed in 0 seconds for  {{(pid=75165) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 00:29:21 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-b6546711-91a7-4816-9326-2633e52621c9 tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] [instance: 250afc24-0c38-4959-a77c-d51365dd1c4e] Guest created on hypervisor {{(pid=75165) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 00:29:21 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: 250afc24-0c38-4959-a77c-d51365dd1c4e] Instance spawned successfully.
Oct 26 00:29:21 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-b6546711-91a7-4816-9326-2633e52621c9 tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] [instance: 250afc24-0c38-4959-a77c-d51365dd1c4e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 00:29:21 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-b6546711-91a7-4816-9326-2633e52621c9 tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] [instance: 250afc24-0c38-4959-a77c-d51365dd1c4e] Found default for hw_cdrom_bus of ide {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:29:21 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-b6546711-91a7-4816-9326-2633e52621c9 tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] [instance: 250afc24-0c38-4959-a77c-d51365dd1c4e] Found default for hw_disk_bus of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:29:21 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-b6546711-91a7-4816-9326-2633e52621c9 tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] [instance: 250afc24-0c38-4959-a77c-d51365dd1c4e] Found default for hw_input_bus of None {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:29:21 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-b6546711-91a7-4816-9326-2633e52621c9 tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] [instance: 250afc24-0c38-4959-a77c-d51365dd1c4e] Found default for hw_pointer_model of None {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:29:21 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-b6546711-91a7-4816-9326-2633e52621c9 tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] [instance: 250afc24-0c38-4959-a77c-d51365dd1c4e] Found default for hw_video_model of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:29:21 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-b6546711-91a7-4816-9326-2633e52621c9 tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] [instance: 250afc24-0c38-4959-a77c-d51365dd1c4e] Found default for hw_vif_model of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:29:21 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:29:21 user nova-compute[75165]: INFO nova.compute.manager [None req-b6546711-91a7-4816-9326-2633e52621c9 tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] [instance: 250afc24-0c38-4959-a77c-d51365dd1c4e] Took 5.24 seconds to spawn the instance on the hypervisor.
Oct 26 00:29:21 user nova-compute[75165]: DEBUG nova.compute.manager [None req-b6546711-91a7-4816-9326-2633e52621c9 tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] [instance: 250afc24-0c38-4959-a77c-d51365dd1c4e] Checking state {{(pid=75165) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 00:29:21 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75165) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 00:29:21 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97fb67a7-637d-456f-b4dd-0a271ed6cfc4/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:29:21 user nova-compute[75165]: INFO nova.compute.manager [None req-b6546711-91a7-4816-9326-2633e52621c9 tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] [instance: 250afc24-0c38-4959-a77c-d51365dd1c4e] Took 24.96 seconds to build instance.
Oct 26 00:29:21 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-b6546711-91a7-4816-9326-2633e52621c9 tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Lock "250afc24-0c38-4959-a77c-d51365dd1c4e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 25.070s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:29:21 user nova-compute[75165]: DEBUG nova.compute.manager [req-eeb79707-5ed3-4fa9-bbe3-9cf74ece1866 req-e4938eda-557b-4c93-9b86-ff4efe36ee19 service nova] [instance: 250afc24-0c38-4959-a77c-d51365dd1c4e] Received event network-vif-plugged-0372e87f-5631-4444-bfe8-ae5af9f09a46 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:29:21 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-eeb79707-5ed3-4fa9-bbe3-9cf74ece1866 req-e4938eda-557b-4c93-9b86-ff4efe36ee19 service nova] Acquiring lock "250afc24-0c38-4959-a77c-d51365dd1c4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:29:21 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-eeb79707-5ed3-4fa9-bbe3-9cf74ece1866 req-e4938eda-557b-4c93-9b86-ff4efe36ee19 service nova] Lock "250afc24-0c38-4959-a77c-d51365dd1c4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:29:21 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-eeb79707-5ed3-4fa9-bbe3-9cf74ece1866 req-e4938eda-557b-4c93-9b86-ff4efe36ee19 service nova] Lock "250afc24-0c38-4959-a77c-d51365dd1c4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:29:21 user nova-compute[75165]: DEBUG nova.compute.manager [req-eeb79707-5ed3-4fa9-bbe3-9cf74ece1866 req-e4938eda-557b-4c93-9b86-ff4efe36ee19 service nova] [instance: 250afc24-0c38-4959-a77c-d51365dd1c4e] No waiting events found dispatching network-vif-plugged-0372e87f-5631-4444-bfe8-ae5af9f09a46 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:29:21 user nova-compute[75165]: WARNING nova.compute.manager [req-eeb79707-5ed3-4fa9-bbe3-9cf74ece1866 req-e4938eda-557b-4c93-9b86-ff4efe36ee19 service nova] [instance: 250afc24-0c38-4959-a77c-d51365dd1c4e] Received unexpected event network-vif-plugged-0372e87f-5631-4444-bfe8-ae5af9f09a46 for instance with vm_state active and task_state None.
Oct 26 00:29:21 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97fb67a7-637d-456f-b4dd-0a271ed6cfc4/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:29:21 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97fb67a7-637d-456f-b4dd-0a271ed6cfc4/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:29:22 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97fb67a7-637d-456f-b4dd-0a271ed6cfc4/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:29:22 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb77893d-263a-40a6-9acc-63fcd1481a38/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:29:22 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb77893d-263a-40a6-9acc-63fcd1481a38/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:29:22 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb77893d-263a-40a6-9acc-63fcd1481a38/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:29:22 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb77893d-263a-40a6-9acc-63fcd1481a38/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:29:22 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75165) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 00:29:22 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3c87b07-5c16-4f45-b320-06d3503d23e6/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:29:22 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3c87b07-5c16-4f45-b320-06d3503d23e6/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:29:22 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3c87b07-5c16-4f45-b320-06d3503d23e6/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:29:23 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:29:23 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3c87b07-5c16-4f45-b320-06d3503d23e6/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:29:23 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce058b47-d96f-4341-9104-1fa71ca2c997/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:29:23 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce058b47-d96f-4341-9104-1fa71ca2c997/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:29:23 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce058b47-d96f-4341-9104-1fa71ca2c997/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:29:23 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce058b47-d96f-4341-9104-1fa71ca2c997/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:29:23 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75165) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 00:29:23 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe2984ce-8958-4049-8af7-496b313b26c8/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:29:23 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe2984ce-8958-4049-8af7-496b313b26c8/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:29:23 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe2984ce-8958-4049-8af7-496b313b26c8/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:29:23 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe2984ce-8958-4049-8af7-496b313b26c8/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:29:23 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75165) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 00:29:24 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:29:24 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:29:24 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Hypervisor/Node resource view: name=user free_ram=8295MB free_disk=24.79733657836914GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75165) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 00:29:24 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:29:24 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:29:24 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 97fb67a7-637d-456f-b4dd-0a271ed6cfc4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:29:24 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:29:24 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance ce058b47-d96f-4341-9104-1fa71ca2c997 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:29:24 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance fe2984ce-8958-4049-8af7-496b313b26c8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:29:24 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance b3c87b07-5c16-4f45-b320-06d3503d23e6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:29:24 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance bb77893d-263a-40a6-9acc-63fcd1481a38 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:29:24 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 250afc24-0c38-4959-a77c-d51365dd1c4e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:29:24 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance c396d555-70cf-4642-a0a0-485760cdf3fa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:29:24 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75165) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 00:29:24 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75165) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 00:29:24 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:29:24 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:29:24 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Compute_service record updated for user:user {{(pid=75165) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 00:29:24 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.494s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:29:26 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:29:26 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:29:28 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:29:31 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:29:33 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:29:34 user nova-compute[75165]: DEBUG nova.compute.manager [None req-157cff87-a0ff-428b-8daa-cf0390eef7b5 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] [instance: c396d555-70cf-4642-a0a0-485760cdf3fa] Start spawning the instance on the hypervisor. {{(pid=75165) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 00:29:34 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-157cff87-a0ff-428b-8daa-cf0390eef7b5 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] [instance: c396d555-70cf-4642-a0a0-485760cdf3fa] Creating instance directory {{(pid=75165) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 00:29:34 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-157cff87-a0ff-428b-8daa-cf0390eef7b5 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] [instance: c396d555-70cf-4642-a0a0-485760cdf3fa] Creating image(s)
Oct 26 00:29:34 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-157cff87-a0ff-428b-8daa-cf0390eef7b5 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] [instance: c396d555-70cf-4642-a0a0-485760cdf3fa] Did not create local disks {{(pid=75165) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 26 00:29:34 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-157cff87-a0ff-428b-8daa-cf0390eef7b5 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] [instance: c396d555-70cf-4642-a0a0-485760cdf3fa] Ensure instance console log exists: /opt/stack/data/nova/instances/c396d555-70cf-4642-a0a0-485760cdf3fa/console.log {{(pid=75165) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 00:29:34 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-157cff87-a0ff-428b-8daa-cf0390eef7b5 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:29:34 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-157cff87-a0ff-428b-8daa-cf0390eef7b5 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:29:34 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-157cff87-a0ff-428b-8daa-cf0390eef7b5 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:29:34 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-157cff87-a0ff-428b-8daa-cf0390eef7b5 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] [instance: c396d555-70cf-4642-a0a0-485760cdf3fa] Start _get_guest_xml network_info=[{"id": "500c8c79-cf9c-46ef-a5d1-273f387e410a", "address": "fa:16:3e:89:15:98", "network": {"id": "7f96025b-485f-4ba3-9f45-708c09822ffa", "bridge": "br-int", "label": "tempest-TestShelveInstance-363925751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f000be4e226e4e3db3c0832bbf04cd29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap500c8c79-cf", "ovs_interfaceid": "500c8c79-cf9c-46ef-a5d1-273f387e410a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LIXPagZW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c396d555-70cf-4642-a0a0-485760cdf3fa', 'attached_at': '', 'detached_at': '', 'volume_id': '9894622e-4af8-47e2-82c6-3f4e301caeb7', 'serial': '9894622e-4af8-47e2-82c6-3f4e301caeb7'}, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'attachment_id': 'e9d2b74e-5512-4926-a69e-216a01217db1', 'delete_on_termination': True, 'volume_type': None} {{(pid=75165) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 00:29:34 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-157cff87-a0ff-428b-8daa-cf0390eef7b5 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:29:34 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-157cff87-a0ff-428b-8daa-cf0390eef7b5 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:29:34 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-157cff87-a0ff-428b-8daa-cf0390eef7b5 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75165) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 00:29:34 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-157cff87-a0ff-428b-8daa-cf0390eef7b5 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] CPU controller missing on host. {{(pid=75165) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 00:29:35 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-157cff87-a0ff-428b-8daa-cf0390eef7b5 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75165) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 00:29:35 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-157cff87-a0ff-428b-8daa-cf0390eef7b5 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] CPU controller found on host. {{(pid=75165) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 00:29:35 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-157cff87-a0ff-428b-8daa-cf0390eef7b5 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75165) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 00:29:35 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-157cff87-a0ff-428b-8daa-cf0390eef7b5 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T00:03:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 00:29:35 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-157cff87-a0ff-428b-8daa-cf0390eef7b5 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Flavor limits 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 00:29:35 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-157cff87-a0ff-428b-8daa-cf0390eef7b5 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Image limits 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 00:29:35 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-157cff87-a0ff-428b-8daa-cf0390eef7b5 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Flavor pref 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 00:29:35 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-157cff87-a0ff-428b-8daa-cf0390eef7b5 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Image pref 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 00:29:35 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-157cff87-a0ff-428b-8daa-cf0390eef7b5 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 00:29:35 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-157cff87-a0ff-428b-8daa-cf0390eef7b5 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 00:29:35 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-157cff87-a0ff-428b-8daa-cf0390eef7b5 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75165) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 00:29:35 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-157cff87-a0ff-428b-8daa-cf0390eef7b5 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Got 1 possible topologies {{(pid=75165) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 00:29:35 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-157cff87-a0ff-428b-8daa-cf0390eef7b5 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 00:29:35 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-157cff87-a0ff-428b-8daa-cf0390eef7b5 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 00:29:35 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-157cff87-a0ff-428b-8daa-cf0390eef7b5 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] [instance: c396d555-70cf-4642-a0a0-485760cdf3fa] Calling os-brick to attach iSCSI Volume {{(pid=75165) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 00:29:35 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-157cff87-a0ff-428b-8daa-cf0390eef7b5 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8bf8160e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LIXPagZW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:29:35 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-157cff87-a0ff-428b-8daa-cf0390eef7b5 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:29:35 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-157cff87-a0ff-428b-8daa-cf0390eef7b5 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:29:35 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-157cff87-a0ff-428b-8daa-cf0390eef7b5 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:29:35 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-157cff87-a0ff-428b-8daa-cf0390eef7b5 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:29:35 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-157cff87-a0ff-428b-8daa-cf0390eef7b5 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:29:35 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-157cff87-a0ff-428b-8daa-cf0390eef7b5 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:29:35 user nova-compute[75165]: INFO os_brick.initiator.connectors.iscsi [None req-157cff87-a0ff-428b-8daa-cf0390eef7b5 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 00:29:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7 -p 172.16.0.220:3260 {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:29:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:29:35 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea7bb740-dc58-4aac-8c95-975b3650c07a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:29:35 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-157cff87-a0ff-428b-8daa-cf0390eef7b5 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 00:29:35 user nova-compute[75165]:  {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:29:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7 -p 172.16.0.220:3260 --interface default --op new {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:29:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.031s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:29:35 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fede857-dacf-44f7-9607-bf2df8739e26]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7] added\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:29:35 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-157cff87-a0ff-428b-8daa-cf0390eef7b5 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7] added
Oct 26 00:29:35 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:29:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:29:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:29:35 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[461aeeb7-5394-4f52-88e5-2f9b122f3529]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:29:35 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-157cff87-a0ff-428b-8daa-cf0390eef7b5 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:29:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:29:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:29:35 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d268a35-8f4e-4d1d-9547-c69c9007414a]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:29:35 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-157cff87-a0ff-428b-8daa-cf0390eef7b5 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:29:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LIXPagZW {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:29:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LIXPagZW" returned: 0 in 0.025s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:29:35 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfe63dc0-f965-41eb-a449-614e87ca416d]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:29:35 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-157cff87-a0ff-428b-8daa-cf0390eef7b5 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LIXPagZW'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:29:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:29:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:29:35 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[89aa965e-fd50-4b1c-8239-9521378dcf45]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:29:35 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-157cff87-a0ff-428b-8daa-cf0390eef7b5 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:29:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:29:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:29:35 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1677efd-0725-4e63-88fe-069f11663dc4]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff19ba88-2bf9-451f-afcc-e149c1578b95 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d69dc6d8-04c4-41a5-bf87-04f0b01f1d09 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0 (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:29:35 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-157cff87-a0ff-428b-8daa-cf0390eef7b5 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)
Oct 26 00:29:35 user nova-compute[75165]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff19ba88-2bf9-451f-afcc-e149c1578b95 (non-flash)
Oct 26 00:29:35 user nova-compute[75165]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d69dc6d8-04c4-41a5-bf87-04f0b01f1d09 (non-flash)
Oct 26 00:29:35 user nova-compute[75165]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0 (non-flash)
Oct 26 00:29:35 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:29:35 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-157cff87-a0ff-428b-8daa-cf0390eef7b5 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)
Oct 26 00:29:35 user nova-compute[75165]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff19ba88-2bf9-451f-afcc-e149c1578b95 (non-flash)
Oct 26 00:29:35 user nova-compute[75165]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d69dc6d8-04c4-41a5-bf87-04f0b01f1d09 (non-flash)
Oct 26 00:29:35 user nova-compute[75165]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0 (non-flash)
Oct 26 00:29:35 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:29:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7 -p 172.16.0.220:3260 --login {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:29:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7 -p 172.16.0.220:3260 --login" returned: 0 in 0.124s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:29:35 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dab917b-34a2-4f8e-83c1-4ef81a93272c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:29:35 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-157cff87-a0ff-428b-8daa-cf0390eef7b5 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7, portal: 172.16.0.220,3260]
Oct 26 00:29:35 user nova-compute[75165]: Login to [iface: default, target: iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7, portal: 172.16.0.220,3260] successful.
Oct 26 00:29:35 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:29:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:29:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:29:35 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[91dc0300-4ab5-43b8-b9c0-01e0bafd7b68]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:29:35 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-157cff87-a0ff-428b-8daa-cf0390eef7b5 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:29:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:29:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:29:35 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4d37bad-05bd-4038-b44b-987567895e90]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff19ba88-2bf9-451f-afcc-e149c1578b95 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d69dc6d8-04c4-41a5-bf87-04f0b01f1d09 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7 (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:29:35 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-157cff87-a0ff-428b-8daa-cf0390eef7b5 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)
Oct 26 00:29:35 user nova-compute[75165]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff19ba88-2bf9-451f-afcc-e149c1578b95 (non-flash)
Oct 26 00:29:35 user nova-compute[75165]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d69dc6d8-04c4-41a5-bf87-04f0b01f1d09 (non-flash)
Oct 26 00:29:35 user nova-compute[75165]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0 (non-flash)
Oct 26 00:29:35 user nova-compute[75165]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7 (non-flash)
Oct 26 00:29:35 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:29:35 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-157cff87-a0ff-428b-8daa-cf0390eef7b5 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)
Oct 26 00:29:35 user nova-compute[75165]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff19ba88-2bf9-451f-afcc-e149c1578b95 (non-flash)
Oct 26 00:29:35 user nova-compute[75165]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d69dc6d8-04c4-41a5-bf87-04f0b01f1d09 (non-flash)
Oct 26 00:29:35 user nova-compute[75165]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0 (non-flash)
Oct 26 00:29:35 user nova-compute[75165]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7 (non-flash)
Oct 26 00:29:35 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:29:35 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-157cff87-a0ff-428b-8daa-cf0390eef7b5 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.397s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:29:35 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-157cff87-a0ff-428b-8daa-cf0390eef7b5 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Connected to 172.16.0.220:3260 {{(pid=75165) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 00:29:35 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-157cff87-a0ff-428b-8daa-cf0390eef7b5 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] HCTL ('37', '-', '-', 0) found on session 34 with lun 0 {{(pid=75165) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 00:29:35 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-157cff87-a0ff-428b-8daa-cf0390eef7b5 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75165) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 00:29:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:29:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.023s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:29:35 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[40e84be0-298c-4465-80d5-7d6b90b45a49]: (4, ('- - 0', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:29:35 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-157cff87-a0ff-428b-8daa-cf0390eef7b5 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Searching for a device in session 34 and hctl ['37', '*', '*', 0] yield: None {{(pid=75165) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 00:29:36 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-157cff87-a0ff-428b-8daa-cf0390eef7b5 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Searching for a device in session 34 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75165) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 00:29:36 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-157cff87-a0ff-428b-8daa-cf0390eef7b5 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LIXPagZW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75165) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 00:29:36 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-157cff87-a0ff-428b-8daa-cf0390eef7b5 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.436s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:29:36 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-157cff87-a0ff-428b-8daa-cf0390eef7b5 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] <== connect_volume: return (1438ms) {'type': 'block', 'scsi_wwn': '23731306436633339', 'path': '/dev/sdf'} {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:29:36 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-157cff87-a0ff-428b-8daa-cf0390eef7b5 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] [instance: c396d555-70cf-4642-a0a0-485760cdf3fa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23731306436633339', 'path': '/dev/sdf'} {{(pid=75165) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 00:29:36 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-157cff87-a0ff-428b-8daa-cf0390eef7b5 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:29:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1147251319',display_name='tempest-TestShelveInstance-server-1147251319',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1147251319',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI1GphBq+tk5lRmbelpBK0KpqDkFZnosMfdxY4BqIo+7ZOlBcMsm+STwRow/vl0wWn7mhh5tvgBHLuRaIRxMFlso5lFS/bf8FEG/Q81BXIGG9aV/g3SgBEoP3RMfJ8OM0g==',key_name='tempest-TestShelveInstance-2132263804',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f000be4e226e4e3db3c0832bbf04cd29',ramdisk_id='',reservation_id='r-sg6zubxf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-323693311',owner_user_name='tempest-TestShelveInstance-323693311-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T00:29:16Z,user_data=None,user_id='2aa1bebf8931436d80d792651953a57b',uuid=c396d555-70cf-4642-a0a0-485760cdf3fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "500c8c79-cf9c-46ef-a5d1-273f387e410a", "address": "fa:16:3e:89:15:98", "network": {"id": "7f96025b-485f-4ba3-9f45-708c09822ffa", "bridge": "br-int", "label": "tempest-TestShelveInstance-363925751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f000be4e226e4e3db3c0832bbf04cd29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap500c8c79-cf", "ovs_interfaceid": "500c8c79-cf9c-46ef-a5d1-273f387e410a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75165) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 00:29:36 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-157cff87-a0ff-428b-8daa-cf0390eef7b5 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Converting VIF {"id": "500c8c79-cf9c-46ef-a5d1-273f387e410a", "address": "fa:16:3e:89:15:98", "network": {"id": "7f96025b-485f-4ba3-9f45-708c09822ffa", "bridge": "br-int", "label": "tempest-TestShelveInstance-363925751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f000be4e226e4e3db3c0832bbf04cd29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap500c8c79-cf", "ovs_interfaceid": "500c8c79-cf9c-46ef-a5d1-273f387e410a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:29:36 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-157cff87-a0ff-428b-8daa-cf0390eef7b5 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:15:98,bridge_name='br-int',has_traffic_filtering=True,id=500c8c79-cf9c-46ef-a5d1-273f387e410a,network=Network(7f96025b-485f-4ba3-9f45-708c09822ffa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap500c8c79-cf') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:29:36 user nova-compute[75165]: DEBUG nova.objects.instance [None req-157cff87-a0ff-428b-8daa-cf0390eef7b5 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Lazy-loading 'pci_devices' on Instance uuid c396d555-70cf-4642-a0a0-485760cdf3fa {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:29:36 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-157cff87-a0ff-428b-8daa-cf0390eef7b5 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] [instance: c396d555-70cf-4642-a0a0-485760cdf3fa] End _get_guest_xml xml=<domain type="kvm">
Oct 26 00:29:36 user nova-compute[75165]:   <uuid>c396d555-70cf-4642-a0a0-485760cdf3fa</uuid>
Oct 26 00:29:36 user nova-compute[75165]:   <name>instance-00000023</name>
Oct 26 00:29:36 user nova-compute[75165]:   <memory>524288</memory>
Oct 26 00:29:36 user nova-compute[75165]:   <vcpu>1</vcpu>
Oct 26 00:29:36 user nova-compute[75165]:   <metadata>
Oct 26 00:29:36 user nova-compute[75165]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 00:29:36 user nova-compute[75165]:       <nova:package version="0.0.0"/>
Oct 26 00:29:36 user nova-compute[75165]:       <nova:name>tempest-TestShelveInstance-server-1147251319</nova:name>
Oct 26 00:29:36 user nova-compute[75165]:       <nova:creationTime>2023-10-26 00:29:34</nova:creationTime>
Oct 26 00:29:36 user nova-compute[75165]:       <nova:flavor name="m1.tiny">
Oct 26 00:29:36 user nova-compute[75165]:         <nova:memory>512</nova:memory>
Oct 26 00:29:36 user nova-compute[75165]:         <nova:disk>1</nova:disk>
Oct 26 00:29:36 user nova-compute[75165]:         <nova:swap>0</nova:swap>
Oct 26 00:29:36 user nova-compute[75165]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 00:29:36 user nova-compute[75165]:         <nova:vcpus>1</nova:vcpus>
Oct 26 00:29:36 user nova-compute[75165]:       </nova:flavor>
Oct 26 00:29:36 user nova-compute[75165]:       <nova:owner>
Oct 26 00:29:36 user nova-compute[75165]:         <nova:user uuid="2aa1bebf8931436d80d792651953a57b">tempest-TestShelveInstance-323693311-project-member</nova:user>
Oct 26 00:29:36 user nova-compute[75165]:         <nova:project uuid="f000be4e226e4e3db3c0832bbf04cd29">tempest-TestShelveInstance-323693311</nova:project>
Oct 26 00:29:36 user nova-compute[75165]:       </nova:owner>
Oct 26 00:29:36 user nova-compute[75165]:       <nova:ports>
Oct 26 00:29:36 user nova-compute[75165]:         <nova:port uuid="500c8c79-cf9c-46ef-a5d1-273f387e410a">
Oct 26 00:29:36 user nova-compute[75165]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 26 00:29:36 user nova-compute[75165]:         </nova:port>
Oct 26 00:29:36 user nova-compute[75165]:       </nova:ports>
Oct 26 00:29:36 user nova-compute[75165]:     </nova:instance>
Oct 26 00:29:36 user nova-compute[75165]:   </metadata>
Oct 26 00:29:36 user nova-compute[75165]:   <sysinfo type="smbios">
Oct 26 00:29:36 user nova-compute[75165]:     <system>
Oct 26 00:29:36 user nova-compute[75165]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 00:29:36 user nova-compute[75165]:       <entry name="product">OpenStack Nova</entry>
Oct 26 00:29:36 user nova-compute[75165]:       <entry name="version">0.0.0</entry>
Oct 26 00:29:36 user nova-compute[75165]:       <entry name="serial">c396d555-70cf-4642-a0a0-485760cdf3fa</entry>
Oct 26 00:29:36 user nova-compute[75165]:       <entry name="uuid">c396d555-70cf-4642-a0a0-485760cdf3fa</entry>
Oct 26 00:29:36 user nova-compute[75165]:       <entry name="family">Virtual Machine</entry>
Oct 26 00:29:36 user nova-compute[75165]:     </system>
Oct 26 00:29:36 user nova-compute[75165]:   </sysinfo>
Oct 26 00:29:36 user nova-compute[75165]:   <os>
Oct 26 00:29:36 user nova-compute[75165]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 00:29:36 user nova-compute[75165]:     <boot dev="hd"/>
Oct 26 00:29:36 user nova-compute[75165]:     <smbios mode="sysinfo"/>
Oct 26 00:29:36 user nova-compute[75165]:   </os>
Oct 26 00:29:36 user nova-compute[75165]:   <features>
Oct 26 00:29:36 user nova-compute[75165]:     <acpi/>
Oct 26 00:29:36 user nova-compute[75165]:     <apic/>
Oct 26 00:29:36 user nova-compute[75165]:     <vmcoreinfo/>
Oct 26 00:29:36 user nova-compute[75165]:   </features>
Oct 26 00:29:36 user nova-compute[75165]:   <clock offset="utc">
Oct 26 00:29:36 user nova-compute[75165]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 00:29:36 user nova-compute[75165]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 00:29:36 user nova-compute[75165]:     <timer name="hpet" present="no"/>
Oct 26 00:29:36 user nova-compute[75165]:   </clock>
Oct 26 00:29:36 user nova-compute[75165]:   <cpu mode="custom" match="exact">
Oct 26 00:29:36 user nova-compute[75165]:     <model>Nehalem</model>
Oct 26 00:29:36 user nova-compute[75165]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 00:29:36 user nova-compute[75165]:   </cpu>
Oct 26 00:29:36 user nova-compute[75165]:   <devices>
Oct 26 00:29:36 user nova-compute[75165]:     <disk type="block" device="disk">
Oct 26 00:29:36 user nova-compute[75165]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 00:29:36 user nova-compute[75165]:       <source dev="/dev/sdf"/>
Oct 26 00:29:36 user nova-compute[75165]:       <target dev="vda" bus="virtio"/>
Oct 26 00:29:36 user nova-compute[75165]:       <serial>9894622e-4af8-47e2-82c6-3f4e301caeb7</serial>
Oct 26 00:29:36 user nova-compute[75165]:     </disk>
Oct 26 00:29:36 user nova-compute[75165]:     <interface type="ethernet">
Oct 26 00:29:36 user nova-compute[75165]:       <mac address="fa:16:3e:89:15:98"/>
Oct 26 00:29:36 user nova-compute[75165]:       <model type="virtio"/>
Oct 26 00:29:36 user nova-compute[75165]:       <mtu size="1442"/>
Oct 26 00:29:36 user nova-compute[75165]:       <target dev="tap500c8c79-cf"/>
Oct 26 00:29:36 user nova-compute[75165]:     </interface>
Oct 26 00:29:36 user nova-compute[75165]:     <serial type="pty">
Oct 26 00:29:36 user nova-compute[75165]:       <log file="/opt/stack/data/nova/instances/c396d555-70cf-4642-a0a0-485760cdf3fa/console.log" append="off"/>
Oct 26 00:29:36 user nova-compute[75165]:     </serial>
Oct 26 00:29:36 user nova-compute[75165]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 00:29:36 user nova-compute[75165]:     <video>
Oct 26 00:29:36 user nova-compute[75165]:       <model type="virtio"/>
Oct 26 00:29:36 user nova-compute[75165]:     </video>
Oct 26 00:29:36 user nova-compute[75165]:     <rng model="virtio">
Oct 26 00:29:36 user nova-compute[75165]:       <backend model="random">/dev/urandom</backend>
Oct 26 00:29:36 user nova-compute[75165]:     </rng>
Oct 26 00:29:36 user nova-compute[75165]:     <controller type="usb" index="0" model="none"/>
Oct 26 00:29:36 user nova-compute[75165]:     <memballoon model="virtio">
Oct 26 00:29:36 user nova-compute[75165]:       <stats period="10"/>
Oct 26 00:29:36 user nova-compute[75165]:     </memballoon>
Oct 26 00:29:36 user nova-compute[75165]:   </devices>
Oct 26 00:29:36 user nova-compute[75165]: </domain>
Oct 26 00:29:36 user nova-compute[75165]:  {{(pid=75165) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 00:29:36 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-157cff87-a0ff-428b-8daa-cf0390eef7b5 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:29:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1147251319',display_name='tempest-TestShelveInstance-server-1147251319',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1147251319',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI1GphBq+tk5lRmbelpBK0KpqDkFZnosMfdxY4BqIo+7ZOlBcMsm+STwRow/vl0wWn7mhh5tvgBHLuRaIRxMFlso5lFS/bf8FEG/Q81BXIGG9aV/g3SgBEoP3RMfJ8OM0g==',key_name='tempest-TestShelveInstance-2132263804',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f000be4e226e4e3db3c0832bbf04cd29',ramdisk_id='',reservation_id='r-sg6zubxf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-323693311',owner_user_name='tempest-TestShelveInstance-323693311-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T00:29:16Z,user_data=None,user_id='2aa1bebf8931436d80d792651953a57b',uuid=c396d555-70cf-4642-a0a0-485760cdf3fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "500c8c79-cf9c-46ef-a5d1-273f387e410a", "address": "fa:16:3e:89:15:98", "network": {"id": "7f96025b-485f-4ba3-9f45-708c09822ffa", "bridge": "br-int", "label": "tempest-TestShelveInstance-363925751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f000be4e226e4e3db3c0832bbf04cd29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap500c8c79-cf", "ovs_interfaceid": "500c8c79-cf9c-46ef-a5d1-273f387e410a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 00:29:36 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-157cff87-a0ff-428b-8daa-cf0390eef7b5 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Converting VIF {"id": "500c8c79-cf9c-46ef-a5d1-273f387e410a", "address": "fa:16:3e:89:15:98", "network": {"id": "7f96025b-485f-4ba3-9f45-708c09822ffa", "bridge": "br-int", "label": "tempest-TestShelveInstance-363925751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f000be4e226e4e3db3c0832bbf04cd29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap500c8c79-cf", "ovs_interfaceid": "500c8c79-cf9c-46ef-a5d1-273f387e410a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:29:36 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-157cff87-a0ff-428b-8daa-cf0390eef7b5 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:15:98,bridge_name='br-int',has_traffic_filtering=True,id=500c8c79-cf9c-46ef-a5d1-273f387e410a,network=Network(7f96025b-485f-4ba3-9f45-708c09822ffa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap500c8c79-cf') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:29:36 user nova-compute[75165]: DEBUG os_vif [None req-157cff87-a0ff-428b-8daa-cf0390eef7b5 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:15:98,bridge_name='br-int',has_traffic_filtering=True,id=500c8c79-cf9c-46ef-a5d1-273f387e410a,network=Network(7f96025b-485f-4ba3-9f45-708c09822ffa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap500c8c79-cf') {{(pid=75165) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 00:29:36 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:29:36 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:29:36 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 00:29:36 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:29:36 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cdb8f78b-f21d-580a-b9a2-13c17945c802', '_type': 'linux-noop'}}, row=False) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:29:36 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:29:36 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:29:36 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:29:36 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap500c8c79-cf, may_exist=True, interface_attrs={}) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:29:36 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap500c8c79-cf, col_values=(('qos', UUID('2b3df231-7d38-4dd5-8b7e-359595c06173')),), if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:29:36 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap500c8c79-cf, col_values=(('external_ids', {'iface-id': '500c8c79-cf9c-46ef-a5d1-273f387e410a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:89:15:98', 'vm-uuid': 'c396d555-70cf-4642-a0a0-485760cdf3fa'}),), if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:29:36 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:29:36 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:29:36 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:29:36 user nova-compute[75165]: INFO os_vif [None req-157cff87-a0ff-428b-8daa-cf0390eef7b5 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:15:98,bridge_name='br-int',has_traffic_filtering=True,id=500c8c79-cf9c-46ef-a5d1-273f387e410a,network=Network(7f96025b-485f-4ba3-9f45-708c09822ffa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap500c8c79-cf')
Oct 26 00:29:36 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-157cff87-a0ff-428b-8daa-cf0390eef7b5 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] No BDM found with device name vda, not building metadata. {{(pid=75165) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 00:29:36 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-157cff87-a0ff-428b-8daa-cf0390eef7b5 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] No VIF found with MAC fa:16:3e:89:15:98, not building metadata {{(pid=75165) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 00:29:37 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:29:37 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:29:37 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:29:38 user nova-compute[75165]: DEBUG nova.compute.manager [req-b04a6756-4173-4c10-b29f-d567b2151be2 req-abac7c42-ac10-4eeb-97f2-d12480d7b599 service nova] [instance: c396d555-70cf-4642-a0a0-485760cdf3fa] Received event network-vif-plugged-500c8c79-cf9c-46ef-a5d1-273f387e410a {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:29:38 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-b04a6756-4173-4c10-b29f-d567b2151be2 req-abac7c42-ac10-4eeb-97f2-d12480d7b599 service nova] Acquiring lock "c396d555-70cf-4642-a0a0-485760cdf3fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:29:38 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-b04a6756-4173-4c10-b29f-d567b2151be2 req-abac7c42-ac10-4eeb-97f2-d12480d7b599 service nova] Lock "c396d555-70cf-4642-a0a0-485760cdf3fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:29:38 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-b04a6756-4173-4c10-b29f-d567b2151be2 req-abac7c42-ac10-4eeb-97f2-d12480d7b599 service nova] Lock "c396d555-70cf-4642-a0a0-485760cdf3fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:29:38 user nova-compute[75165]: DEBUG nova.compute.manager [req-b04a6756-4173-4c10-b29f-d567b2151be2 req-abac7c42-ac10-4eeb-97f2-d12480d7b599 service nova] [instance: c396d555-70cf-4642-a0a0-485760cdf3fa] No waiting events found dispatching network-vif-plugged-500c8c79-cf9c-46ef-a5d1-273f387e410a {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:29:38 user nova-compute[75165]: WARNING nova.compute.manager [req-b04a6756-4173-4c10-b29f-d567b2151be2 req-abac7c42-ac10-4eeb-97f2-d12480d7b599 service nova] [instance: c396d555-70cf-4642-a0a0-485760cdf3fa] Received unexpected event network-vif-plugged-500c8c79-cf9c-46ef-a5d1-273f387e410a for instance with vm_state building and task_state spawning.
Oct 26 00:29:38 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:29:38 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:29:38 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:29:38 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:29:40 user nova-compute[75165]: DEBUG nova.compute.manager [None req-157cff87-a0ff-428b-8daa-cf0390eef7b5 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] [instance: c396d555-70cf-4642-a0a0-485760cdf3fa] Instance event wait completed in 0 seconds for  {{(pid=75165) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 00:29:40 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-157cff87-a0ff-428b-8daa-cf0390eef7b5 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] [instance: c396d555-70cf-4642-a0a0-485760cdf3fa] Guest created on hypervisor {{(pid=75165) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 00:29:40 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: c396d555-70cf-4642-a0a0-485760cdf3fa] Instance spawned successfully.
Oct 26 00:29:40 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-157cff87-a0ff-428b-8daa-cf0390eef7b5 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] [instance: c396d555-70cf-4642-a0a0-485760cdf3fa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 00:29:40 user nova-compute[75165]: DEBUG nova.compute.manager [req-5acbe546-2e70-4263-ae97-ef44fc51b28e req-df2b78e4-d4a1-456c-ace8-d359932374e4 service nova] [instance: c396d555-70cf-4642-a0a0-485760cdf3fa] Received event network-vif-plugged-500c8c79-cf9c-46ef-a5d1-273f387e410a {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:29:40 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-5acbe546-2e70-4263-ae97-ef44fc51b28e req-df2b78e4-d4a1-456c-ace8-d359932374e4 service nova] Acquiring lock "c396d555-70cf-4642-a0a0-485760cdf3fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:29:40 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-5acbe546-2e70-4263-ae97-ef44fc51b28e req-df2b78e4-d4a1-456c-ace8-d359932374e4 service nova] Lock "c396d555-70cf-4642-a0a0-485760cdf3fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:29:40 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-5acbe546-2e70-4263-ae97-ef44fc51b28e req-df2b78e4-d4a1-456c-ace8-d359932374e4 service nova] Lock "c396d555-70cf-4642-a0a0-485760cdf3fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:29:40 user nova-compute[75165]: DEBUG nova.compute.manager [req-5acbe546-2e70-4263-ae97-ef44fc51b28e req-df2b78e4-d4a1-456c-ace8-d359932374e4 service nova] [instance: c396d555-70cf-4642-a0a0-485760cdf3fa] No waiting events found dispatching network-vif-plugged-500c8c79-cf9c-46ef-a5d1-273f387e410a {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:29:40 user nova-compute[75165]: WARNING nova.compute.manager [req-5acbe546-2e70-4263-ae97-ef44fc51b28e req-df2b78e4-d4a1-456c-ace8-d359932374e4 service nova] [instance: c396d555-70cf-4642-a0a0-485760cdf3fa] Received unexpected event network-vif-plugged-500c8c79-cf9c-46ef-a5d1-273f387e410a for instance with vm_state building and task_state spawning.
Oct 26 00:29:40 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-157cff87-a0ff-428b-8daa-cf0390eef7b5 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] [instance: c396d555-70cf-4642-a0a0-485760cdf3fa] Found default for hw_cdrom_bus of ide {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:29:40 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-157cff87-a0ff-428b-8daa-cf0390eef7b5 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] [instance: c396d555-70cf-4642-a0a0-485760cdf3fa] Found default for hw_disk_bus of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:29:40 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-157cff87-a0ff-428b-8daa-cf0390eef7b5 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] [instance: c396d555-70cf-4642-a0a0-485760cdf3fa] Found default for hw_input_bus of None {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:29:40 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-157cff87-a0ff-428b-8daa-cf0390eef7b5 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] [instance: c396d555-70cf-4642-a0a0-485760cdf3fa] Found default for hw_pointer_model of None {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:29:40 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-157cff87-a0ff-428b-8daa-cf0390eef7b5 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] [instance: c396d555-70cf-4642-a0a0-485760cdf3fa] Found default for hw_video_model of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:29:40 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-157cff87-a0ff-428b-8daa-cf0390eef7b5 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] [instance: c396d555-70cf-4642-a0a0-485760cdf3fa] Found default for hw_vif_model of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:29:40 user nova-compute[75165]: INFO nova.compute.manager [None req-157cff87-a0ff-428b-8daa-cf0390eef7b5 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] [instance: c396d555-70cf-4642-a0a0-485760cdf3fa] Took 5.39 seconds to spawn the instance on the hypervisor.
Oct 26 00:29:40 user nova-compute[75165]: DEBUG nova.compute.manager [None req-157cff87-a0ff-428b-8daa-cf0390eef7b5 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] [instance: c396d555-70cf-4642-a0a0-485760cdf3fa] Checking state {{(pid=75165) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 00:29:40 user nova-compute[75165]: INFO nova.compute.manager [None req-157cff87-a0ff-428b-8daa-cf0390eef7b5 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] [instance: c396d555-70cf-4642-a0a0-485760cdf3fa] Took 25.33 seconds to build instance.
Oct 26 00:29:40 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-157cff87-a0ff-428b-8daa-cf0390eef7b5 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Lock "c396d555-70cf-4642-a0a0-485760cdf3fa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 25.472s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:29:41 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:29:41 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:29:46 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-a65f4b4f-1eb1-4473-aaf1-9ba1a60130fe tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Acquiring lock "c7a55179-cde6-4fbd-a8b3-c3df149bc6f3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:29:46 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-a65f4b4f-1eb1-4473-aaf1-9ba1a60130fe tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Lock "c7a55179-cde6-4fbd-a8b3-c3df149bc6f3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:29:46 user nova-compute[75165]: DEBUG nova.compute.manager [None req-a65f4b4f-1eb1-4473-aaf1-9ba1a60130fe tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: c7a55179-cde6-4fbd-a8b3-c3df149bc6f3] Starting instance... {{(pid=75165) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 00:29:46 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-a65f4b4f-1eb1-4473-aaf1-9ba1a60130fe tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:29:46 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-a65f4b4f-1eb1-4473-aaf1-9ba1a60130fe tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:29:46 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-a65f4b4f-1eb1-4473-aaf1-9ba1a60130fe tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75165) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 00:29:46 user nova-compute[75165]: INFO nova.compute.claims [None req-a65f4b4f-1eb1-4473-aaf1-9ba1a60130fe tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: c7a55179-cde6-4fbd-a8b3-c3df149bc6f3] Claim successful on node user
Oct 26 00:29:46 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:29:46 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-a65f4b4f-1eb1-4473-aaf1-9ba1a60130fe tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:29:46 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-a65f4b4f-1eb1-4473-aaf1-9ba1a60130fe tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:29:46 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:29:46 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-a65f4b4f-1eb1-4473-aaf1-9ba1a60130fe tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.431s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:29:46 user nova-compute[75165]: DEBUG nova.compute.manager [None req-a65f4b4f-1eb1-4473-aaf1-9ba1a60130fe tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: c7a55179-cde6-4fbd-a8b3-c3df149bc6f3] Start building networks asynchronously for instance. {{(pid=75165) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 00:29:46 user nova-compute[75165]: DEBUG nova.compute.manager [None req-a65f4b4f-1eb1-4473-aaf1-9ba1a60130fe tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: c7a55179-cde6-4fbd-a8b3-c3df149bc6f3] Allocating IP information in the background. {{(pid=75165) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 00:29:46 user nova-compute[75165]: DEBUG nova.network.neutron [None req-a65f4b4f-1eb1-4473-aaf1-9ba1a60130fe tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: c7a55179-cde6-4fbd-a8b3-c3df149bc6f3] allocate_for_instance() {{(pid=75165) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 00:29:46 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-a65f4b4f-1eb1-4473-aaf1-9ba1a60130fe tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: c7a55179-cde6-4fbd-a8b3-c3df149bc6f3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 00:29:46 user nova-compute[75165]: DEBUG nova.compute.manager [None req-a65f4b4f-1eb1-4473-aaf1-9ba1a60130fe tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: c7a55179-cde6-4fbd-a8b3-c3df149bc6f3] Start building block device mappings for instance. {{(pid=75165) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 00:29:46 user nova-compute[75165]: DEBUG nova.policy [None req-a65f4b4f-1eb1-4473-aaf1-9ba1a60130fe tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'dbe0d52293264f33ae86de41dabeefcf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd616862c7c184de5b0ba3121552c5666', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75165) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 00:29:46 user nova-compute[75165]: INFO nova.virt.block_device [None req-a65f4b4f-1eb1-4473-aaf1-9ba1a60130fe tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: c7a55179-cde6-4fbd-a8b3-c3df149bc6f3] Booting with volume-backed-image bff0d8a1-739e-4c4d-9efa-b73ba7b76d01 at /dev/vda
Oct 26 00:29:47 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:29:47 user nova-compute[75165]: DEBUG nova.network.neutron [None req-a65f4b4f-1eb1-4473-aaf1-9ba1a60130fe tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: c7a55179-cde6-4fbd-a8b3-c3df149bc6f3] Successfully created port: 70711118-68ee-4ea5-bfc2-df652ed0f3c1 {{(pid=75165) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 00:29:48 user nova-compute[75165]: DEBUG nova.network.neutron [None req-a65f4b4f-1eb1-4473-aaf1-9ba1a60130fe tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: c7a55179-cde6-4fbd-a8b3-c3df149bc6f3] Successfully updated port: 70711118-68ee-4ea5-bfc2-df652ed0f3c1 {{(pid=75165) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 00:29:48 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-a65f4b4f-1eb1-4473-aaf1-9ba1a60130fe tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Acquiring lock "refresh_cache-c7a55179-cde6-4fbd-a8b3-c3df149bc6f3" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:29:48 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-a65f4b4f-1eb1-4473-aaf1-9ba1a60130fe tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Acquired lock "refresh_cache-c7a55179-cde6-4fbd-a8b3-c3df149bc6f3" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:29:48 user nova-compute[75165]: DEBUG nova.network.neutron [None req-a65f4b4f-1eb1-4473-aaf1-9ba1a60130fe tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: c7a55179-cde6-4fbd-a8b3-c3df149bc6f3] Building network info cache for instance {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 00:29:48 user nova-compute[75165]: DEBUG nova.compute.manager [req-8f9e865d-dfc8-478f-b4ac-b59d877344f0 req-b4cbe506-85a0-42b1-a65a-5f8a0ea29eb7 service nova] [instance: c7a55179-cde6-4fbd-a8b3-c3df149bc6f3] Received event network-changed-70711118-68ee-4ea5-bfc2-df652ed0f3c1 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:29:48 user nova-compute[75165]: DEBUG nova.compute.manager [req-8f9e865d-dfc8-478f-b4ac-b59d877344f0 req-b4cbe506-85a0-42b1-a65a-5f8a0ea29eb7 service nova] [instance: c7a55179-cde6-4fbd-a8b3-c3df149bc6f3] Refreshing instance network info cache due to event network-changed-70711118-68ee-4ea5-bfc2-df652ed0f3c1. {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 00:29:48 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-8f9e865d-dfc8-478f-b4ac-b59d877344f0 req-b4cbe506-85a0-42b1-a65a-5f8a0ea29eb7 service nova] Acquiring lock "refresh_cache-c7a55179-cde6-4fbd-a8b3-c3df149bc6f3" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:29:48 user nova-compute[75165]: DEBUG nova.network.neutron [None req-a65f4b4f-1eb1-4473-aaf1-9ba1a60130fe tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: c7a55179-cde6-4fbd-a8b3-c3df149bc6f3] Instance cache missing network info. {{(pid=75165) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 00:29:49 user nova-compute[75165]: DEBUG nova.network.neutron [None req-a65f4b4f-1eb1-4473-aaf1-9ba1a60130fe tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: c7a55179-cde6-4fbd-a8b3-c3df149bc6f3] Updating instance_info_cache with network_info: [{"id": "70711118-68ee-4ea5-bfc2-df652ed0f3c1", "address": "fa:16:3e:91:b1:a6", "network": {"id": "eb55c0bc-cae5-4ba3-851a-e31a50b52c88", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1081223830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d616862c7c184de5b0ba3121552c5666", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70711118-68", "ovs_interfaceid": "70711118-68ee-4ea5-bfc2-df652ed0f3c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:29:49 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-a65f4b4f-1eb1-4473-aaf1-9ba1a60130fe tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Releasing lock "refresh_cache-c7a55179-cde6-4fbd-a8b3-c3df149bc6f3" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:29:49 user nova-compute[75165]: DEBUG nova.compute.manager [None req-a65f4b4f-1eb1-4473-aaf1-9ba1a60130fe tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: c7a55179-cde6-4fbd-a8b3-c3df149bc6f3] Instance network_info: |[{"id": "70711118-68ee-4ea5-bfc2-df652ed0f3c1", "address": "fa:16:3e:91:b1:a6", "network": {"id": "eb55c0bc-cae5-4ba3-851a-e31a50b52c88", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1081223830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d616862c7c184de5b0ba3121552c5666", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70711118-68", "ovs_interfaceid": "70711118-68ee-4ea5-bfc2-df652ed0f3c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75165) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 00:29:49 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-8f9e865d-dfc8-478f-b4ac-b59d877344f0 req-b4cbe506-85a0-42b1-a65a-5f8a0ea29eb7 service nova] Acquired lock "refresh_cache-c7a55179-cde6-4fbd-a8b3-c3df149bc6f3" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:29:49 user nova-compute[75165]: DEBUG nova.network.neutron [req-8f9e865d-dfc8-478f-b4ac-b59d877344f0 req-b4cbe506-85a0-42b1-a65a-5f8a0ea29eb7 service nova] [instance: c7a55179-cde6-4fbd-a8b3-c3df149bc6f3] Refreshing network info cache for port 70711118-68ee-4ea5-bfc2-df652ed0f3c1 {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 00:29:49 user nova-compute[75165]: DEBUG nova.network.neutron [req-8f9e865d-dfc8-478f-b4ac-b59d877344f0 req-b4cbe506-85a0-42b1-a65a-5f8a0ea29eb7 service nova] [instance: c7a55179-cde6-4fbd-a8b3-c3df149bc6f3] Updated VIF entry in instance network info cache for port 70711118-68ee-4ea5-bfc2-df652ed0f3c1. {{(pid=75165) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 00:29:49 user nova-compute[75165]: DEBUG nova.network.neutron [req-8f9e865d-dfc8-478f-b4ac-b59d877344f0 req-b4cbe506-85a0-42b1-a65a-5f8a0ea29eb7 service nova] [instance: c7a55179-cde6-4fbd-a8b3-c3df149bc6f3] Updating instance_info_cache with network_info: [{"id": "70711118-68ee-4ea5-bfc2-df652ed0f3c1", "address": "fa:16:3e:91:b1:a6", "network": {"id": "eb55c0bc-cae5-4ba3-851a-e31a50b52c88", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1081223830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d616862c7c184de5b0ba3121552c5666", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70711118-68", "ovs_interfaceid": "70711118-68ee-4ea5-bfc2-df652ed0f3c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:29:49 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-8f9e865d-dfc8-478f-b4ac-b59d877344f0 req-b4cbe506-85a0-42b1-a65a-5f8a0ea29eb7 service nova] Releasing lock "refresh_cache-c7a55179-cde6-4fbd-a8b3-c3df149bc6f3" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:29:51 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-3bade319-deb5-4e3f-9baf-dbb693438c82 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Acquiring lock "fe2984ce-8958-4049-8af7-496b313b26c8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:29:51 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-3bade319-deb5-4e3f-9baf-dbb693438c82 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Lock "fe2984ce-8958-4049-8af7-496b313b26c8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:29:51 user nova-compute[75165]: INFO nova.compute.manager [None req-3bade319-deb5-4e3f-9baf-dbb693438c82 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] [instance: fe2984ce-8958-4049-8af7-496b313b26c8] Detaching volume d69dc6d8-04c4-41a5-bf87-04f0b01f1d09
Oct 26 00:29:51 user nova-compute[75165]: INFO nova.virt.block_device [None req-3bade319-deb5-4e3f-9baf-dbb693438c82 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] [instance: fe2984ce-8958-4049-8af7-496b313b26c8] Attempting to driver detach volume d69dc6d8-04c4-41a5-bf87-04f0b01f1d09 from mountpoint /dev/vdb
Oct 26 00:29:51 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-3bade319-deb5-4e3f-9baf-dbb693438c82 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Attempting to detach device vdb from instance fe2984ce-8958-4049-8af7-496b313b26c8 from the persistent domain config. {{(pid=75165) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 00:29:51 user nova-compute[75165]: DEBUG nova.virt.libvirt.guest [None req-3bade319-deb5-4e3f-9baf-dbb693438c82 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 00:29:51 user nova-compute[75165]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 00:29:51 user nova-compute[75165]:   <source dev="/dev/sdc"/>
Oct 26 00:29:51 user nova-compute[75165]:   <target dev="vdb" bus="virtio"/>
Oct 26 00:29:51 user nova-compute[75165]:   <serial>d69dc6d8-04c4-41a5-bf87-04f0b01f1d09</serial>
Oct 26 00:29:51 user nova-compute[75165]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 00:29:51 user nova-compute[75165]: </disk>
Oct 26 00:29:51 user nova-compute[75165]:  {{(pid=75165) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 00:29:51 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-3bade319-deb5-4e3f-9baf-dbb693438c82 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Successfully detached device vdb from instance fe2984ce-8958-4049-8af7-496b313b26c8 from the persistent domain config.
Oct 26 00:29:51 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-3bade319-deb5-4e3f-9baf-dbb693438c82 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fe2984ce-8958-4049-8af7-496b313b26c8 from the live domain config. {{(pid=75165) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 00:29:51 user nova-compute[75165]: DEBUG nova.virt.libvirt.guest [None req-3bade319-deb5-4e3f-9baf-dbb693438c82 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 00:29:51 user nova-compute[75165]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 00:29:51 user nova-compute[75165]:   <source dev="/dev/sdc"/>
Oct 26 00:29:51 user nova-compute[75165]:   <target dev="vdb" bus="virtio"/>
Oct 26 00:29:51 user nova-compute[75165]:   <serial>d69dc6d8-04c4-41a5-bf87-04f0b01f1d09</serial>
Oct 26 00:29:51 user nova-compute[75165]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 00:29:51 user nova-compute[75165]: </disk>
Oct 26 00:29:51 user nova-compute[75165]:  {{(pid=75165) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 00:29:51 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:29:51 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:29:51 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-3bade319-deb5-4e3f-9baf-dbb693438c82 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fe2984ce-8958-4049-8af7-496b313b26c8 {{(pid=75165) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 00:29:56 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:29:56 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:30:01 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:30:01 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:30:02 user nova-compute[75165]: DEBUG os_brick.utils [None req-a65f4b4f-1eb1-4473-aaf1-9ba1a60130fe tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:30:02 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:30:02 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:30:02 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a2a54a9-ea6c-4a39-9ce6-7ab9bb5bb22b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa94814ccb35\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:30:02 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:30:02 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:30:02 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[9183ba0b-1721-44ce-900e-16ef6d4af98d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:30:02 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:30:02 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:30:02 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a056166-a7da-4a7b-a037-2147fed73443]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:30:02 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca616a24-88fa-4f32-bb4e-e9aeb8bf0a54]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:30:02 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-a65f4b4f-1eb1-4473-aaf1-9ba1a60130fe tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Running cmd (subprocess): nvme version {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:30:02 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-a65f4b4f-1eb1-4473-aaf1-9ba1a60130fe tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] 'nvme version' failed. Not Retrying. {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 00:30:02 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a65f4b4f-1eb1-4473-aaf1-9ba1a60130fe tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] nvme not present on system {{(pid=75165) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 00:30:02 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:30:02 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 00:30:02 user nova-compute[75165]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 00:30:02 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[a06cff6b-e11c-41f2-bb29-b5eb0a873732]: (4, '') {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:30:02 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-a65f4b4f-1eb1-4473-aaf1-9ba1a60130fe tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75165) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 00:30:02 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-a65f4b4f-1eb1-4473-aaf1-9ba1a60130fe tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75165) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 00:30:02 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-a65f4b4f-1eb1-4473-aaf1-9ba1a60130fe tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] LIGHTOS: no hostnqn found. {{(pid=75165) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 00:30:02 user nova-compute[75165]: DEBUG os_brick.utils [None req-a65f4b4f-1eb1-4473-aaf1-9ba1a60130fe tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa94814ccb35', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:30:02 user nova-compute[75165]: DEBUG nova.virt.block_device [None req-a65f4b4f-1eb1-4473-aaf1-9ba1a60130fe tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: c7a55179-cde6-4fbd-a8b3-c3df149bc6f3] Updating existing volume attachment record: 35974d6f-b38c-499b-bfee-122434ec2778 {{(pid=75165) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 00:30:06 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:30:06 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:30:11 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:30:11 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:30:11 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:30:11 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75165) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 00:30:11 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-3bade319-deb5-4e3f-9baf-dbb693438c82 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance fe2984ce-8958-4049-8af7-496b313b26c8 is timed out.
Oct 26 00:30:11 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-3bade319-deb5-4e3f-9baf-dbb693438c82 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Successfully detached device vdb from instance fe2984ce-8958-4049-8af7-496b313b26c8 from the live domain config.
Oct 26 00:30:12 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3bade319-deb5-4e3f-9baf-dbb693438c82 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] [instance: fe2984ce-8958-4049-8af7-496b313b26c8] calling os-brick to detach iSCSI Volume {{(pid=75165) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 00:30:12 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bade319-deb5-4e3f-9baf-dbb693438c82 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8bf8160e50>, {'target_iqn': 'iqn.2010-10.org.openstack:d69dc6d8-04c4-41a5-bf87-04f0b01f1d09', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pBmjoxVZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:30:12 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-3bade319-deb5-4e3f-9baf-dbb693438c82 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:30:12 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-3bade319-deb5-4e3f-9baf-dbb693438c82 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:30:12 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-3bade319-deb5-4e3f-9baf-dbb693438c82 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:30:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:30:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:30:12 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[17e0785f-c122-4046-b879-dbbf0061b92a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d69dc6d8-04c4-41a5-bf87-04f0b01f1d09\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ff19ba88-2bf9-451f-afcc-e149c1578b95\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:30:12 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bade319-deb5-4e3f-9baf-dbb693438c82 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 00:30:12 user nova-compute[75165]: No targets found.
Oct 26 00:30:12 user nova-compute[75165]: iSNS:
Oct 26 00:30:12 user nova-compute[75165]: No targets found.
Oct 26 00:30:12 user nova-compute[75165]: STATIC:
Oct 26 00:30:12 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:d69dc6d8-04c4-41a5-bf87-04f0b01f1d09
Oct 26 00:30:12 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:30:12 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:30:12 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7
Oct 26 00:30:12 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:30:12 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:30:12 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795
Oct 26 00:30:12 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:30:12 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:30:12 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:ff19ba88-2bf9-451f-afcc-e149c1578b95
Oct 26 00:30:12 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:30:12 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:30:12 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0
Oct 26 00:30:12 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:30:12 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:30:12 user nova-compute[75165]: FIRMWARE:
Oct 26 00:30:12 user nova-compute[75165]: No targets found.
Oct 26 00:30:12 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:30:12 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bade319-deb5-4e3f-9baf-dbb693438c82 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 00:30:12 user nova-compute[75165]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 00:30:12 user nova-compute[75165]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75165) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 00:30:12 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bade319-deb5-4e3f-9baf-dbb693438c82 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d69dc6d8-04c4-41a5-bf87-04f0b01f1d09', 0)] {{(pid=75165) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 00:30:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:30:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:30:12 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc55facc-0452-489d-9b1d-0a9ade4991aa]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d69dc6d8-04c4-41a5-bf87-04f0b01f1d09\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ff19ba88-2bf9-451f-afcc-e149c1578b95\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:30:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:30:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:30:12 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7765b65-b3db-44b2-854a-8ed48d937bca]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff19ba88-2bf9-451f-afcc-e149c1578b95 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d69dc6d8-04c4-41a5-bf87-04f0b01f1d09 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7 (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:30:12 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bade319-deb5-4e3f-9baf-dbb693438c82 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)
Oct 26 00:30:12 user nova-compute[75165]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff19ba88-2bf9-451f-afcc-e149c1578b95 (non-flash)
Oct 26 00:30:12 user nova-compute[75165]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d69dc6d8-04c4-41a5-bf87-04f0b01f1d09 (non-flash)
Oct 26 00:30:12 user nova-compute[75165]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0 (non-flash)
Oct 26 00:30:12 user nova-compute[75165]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7 (non-flash)
Oct 26 00:30:12 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:30:12 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bade319-deb5-4e3f-9baf-dbb693438c82 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)
Oct 26 00:30:12 user nova-compute[75165]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff19ba88-2bf9-451f-afcc-e149c1578b95 (non-flash)
Oct 26 00:30:12 user nova-compute[75165]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d69dc6d8-04c4-41a5-bf87-04f0b01f1d09 (non-flash)
Oct 26 00:30:12 user nova-compute[75165]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0 (non-flash)
Oct 26 00:30:12 user nova-compute[75165]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7 (non-flash)
Oct 26 00:30:12 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:30:12 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bade319-deb5-4e3f-9baf-dbb693438c82 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8be04c8670>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d69dc6d8-04c4-41a5-bf87-04f0b01f1d09'): ({'sdc'}, set())}) {{(pid=75165) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 00:30:12 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-3bade319-deb5-4e3f-9baf-dbb693438c82 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Removing single pathed devices sdc {{(pid=75165) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 00:30:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:30:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:30:12 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6866b39-b8a9-4d66-8718-17ec715a7f4a]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:30:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:30:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:30:12 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[b49a1081-1961-4ced-ac5a-4e34ca6d3a75]: (4, ('ok\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:30:12 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-3bade319-deb5-4e3f-9baf-dbb693438c82 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Flushing IO for device /dev/sdc {{(pid=75165) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 00:30:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:30:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:30:12 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[38eddeee-747d-4faa-ba2e-584f09464c41]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:30:12 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-3bade319-deb5-4e3f-9baf-dbb693438c82 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75165) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 00:30:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:30:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.053s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:30:12 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f731c5c-dc4b-47db-9659-bf1d79eabb0a]: (4, ('1', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:30:12 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-3bade319-deb5-4e3f-9baf-dbb693438c82 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75165) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 00:30:12 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-3bade319-deb5-4e3f-9baf-dbb693438c82 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] SCSI volumes sdc have been removed. {{(pid=75165) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 00:30:12 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bade319-deb5-4e3f-9baf-dbb693438c82 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d69dc6d8-04c4-41a5-bf87-04f0b01f1d09')] {{(pid=75165) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 00:30:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d69dc6d8-04c4-41a5-bf87-04f0b01f1d09 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:30:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d69dc6d8-04c4-41a5-bf87-04f0b01f1d09 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:30:12 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3358e96-69f1-4710-8282-025ff4e77397]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:30:12 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bade319-deb5-4e3f-9baf-dbb693438c82 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:30:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d69dc6d8-04c4-41a5-bf87-04f0b01f1d09 -p 172.16.0.220:3260 --logout {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:30:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d69dc6d8-04c4-41a5-bf87-04f0b01f1d09 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:30:12 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fe07816-5c7b-47f7-bed7-7a16cb57ae36]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:d69dc6d8-04c4-41a5-bf87-04f0b01f1d09, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:d69dc6d8-04c4-41a5-bf87-04f0b01f1d09, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:30:12 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bade319-deb5-4e3f-9baf-dbb693438c82 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:d69dc6d8-04c4-41a5-bf87-04f0b01f1d09, portal: 172.16.0.220,3260]
Oct 26 00:30:12 user nova-compute[75165]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:d69dc6d8-04c4-41a5-bf87-04f0b01f1d09, portal: 172.16.0.220,3260] successful.
Oct 26 00:30:12 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:30:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d69dc6d8-04c4-41a5-bf87-04f0b01f1d09 -p 172.16.0.220:3260 --op delete {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:30:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d69dc6d8-04c4-41a5-bf87-04f0b01f1d09 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:30:12 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[48f7948d-df47-4df6-915a-bac648a58557]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:30:12 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bade319-deb5-4e3f-9baf-dbb693438c82 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:30:12 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-3bade319-deb5-4e3f-9baf-dbb693438c82 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.346s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:30:12 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bade319-deb5-4e3f-9baf-dbb693438c82 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] <== disconnect_volume: return (348ms) None {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:30:12 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3bade319-deb5-4e3f-9baf-dbb693438c82 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] [instance: fe2984ce-8958-4049-8af7-496b313b26c8] Disconnected iSCSI Volume {{(pid=75165) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 00:30:13 user nova-compute[75165]: DEBUG nova.objects.instance [None req-3bade319-deb5-4e3f-9baf-dbb693438c82 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Lazy-loading 'flavor' on Instance uuid fe2984ce-8958-4049-8af7-496b313b26c8 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:30:13 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-3bade319-deb5-4e3f-9baf-dbb693438c82 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Lock "fe2984ce-8958-4049-8af7-496b313b26c8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.817s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:30:16 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:30:16 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:30:16 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:30:18 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:30:20 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:30:20 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Starting heal instance info cache {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 00:30:20 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "refresh_cache-ce058b47-d96f-4341-9104-1fa71ca2c997" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:30:20 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquired lock "refresh_cache-ce058b47-d96f-4341-9104-1fa71ca2c997" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:30:20 user nova-compute[75165]: DEBUG nova.network.neutron [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: ce058b47-d96f-4341-9104-1fa71ca2c997] Forcefully refreshing network info cache for instance {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 00:30:21 user nova-compute[75165]: DEBUG nova.network.neutron [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: ce058b47-d96f-4341-9104-1fa71ca2c997] Updating instance_info_cache with network_info: [{"id": "7df0d91d-ff60-4008-823f-f951cbf505d3", "address": "fa:16:3e:d8:e5:83", "network": {"id": "7e330392-6256-405b-ab37-0b8af0c4fd48", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-430326049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ffbf5c944914cafac7aba65fb7ca402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7df0d91d-ff", "ovs_interfaceid": "7df0d91d-ff60-4008-823f-f951cbf505d3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:30:21 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-b1207cd1-02d6-4e54-add0-07be38054f6a tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Acquiring lock "ce058b47-d96f-4341-9104-1fa71ca2c997" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:30:21 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-b1207cd1-02d6-4e54-add0-07be38054f6a tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Lock "ce058b47-d96f-4341-9104-1fa71ca2c997" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:30:21 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Releasing lock "refresh_cache-ce058b47-d96f-4341-9104-1fa71ca2c997" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:30:21 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: ce058b47-d96f-4341-9104-1fa71ca2c997] Updated the network info_cache for instance {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 00:30:21 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:30:21 user nova-compute[75165]: INFO nova.compute.manager [None req-b1207cd1-02d6-4e54-add0-07be38054f6a tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] [instance: ce058b47-d96f-4341-9104-1fa71ca2c997] Detaching volume ff19ba88-2bf9-451f-afcc-e149c1578b95
Oct 26 00:30:21 user nova-compute[75165]: INFO nova.virt.block_device [None req-b1207cd1-02d6-4e54-add0-07be38054f6a tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] [instance: ce058b47-d96f-4341-9104-1fa71ca2c997] Attempting to driver detach volume ff19ba88-2bf9-451f-afcc-e149c1578b95 from mountpoint /dev/vdb
Oct 26 00:30:21 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-b1207cd1-02d6-4e54-add0-07be38054f6a tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Attempting to detach device vdb from instance ce058b47-d96f-4341-9104-1fa71ca2c997 from the persistent domain config. {{(pid=75165) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 00:30:21 user nova-compute[75165]: DEBUG nova.virt.libvirt.guest [None req-b1207cd1-02d6-4e54-add0-07be38054f6a tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 00:30:21 user nova-compute[75165]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 00:30:21 user nova-compute[75165]:   <source dev="/dev/sdd"/>
Oct 26 00:30:21 user nova-compute[75165]:   <target dev="vdb" bus="virtio"/>
Oct 26 00:30:21 user nova-compute[75165]:   <serial>ff19ba88-2bf9-451f-afcc-e149c1578b95</serial>
Oct 26 00:30:21 user nova-compute[75165]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 00:30:21 user nova-compute[75165]: </disk>
Oct 26 00:30:21 user nova-compute[75165]:  {{(pid=75165) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 00:30:21 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-b1207cd1-02d6-4e54-add0-07be38054f6a tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Successfully detached device vdb from instance ce058b47-d96f-4341-9104-1fa71ca2c997 from the persistent domain config.
Oct 26 00:30:21 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-b1207cd1-02d6-4e54-add0-07be38054f6a tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ce058b47-d96f-4341-9104-1fa71ca2c997 from the live domain config. {{(pid=75165) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 00:30:21 user nova-compute[75165]: DEBUG nova.virt.libvirt.guest [None req-b1207cd1-02d6-4e54-add0-07be38054f6a tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 00:30:21 user nova-compute[75165]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 00:30:21 user nova-compute[75165]:   <source dev="/dev/sdd"/>
Oct 26 00:30:21 user nova-compute[75165]:   <target dev="vdb" bus="virtio"/>
Oct 26 00:30:21 user nova-compute[75165]:   <serial>ff19ba88-2bf9-451f-afcc-e149c1578b95</serial>
Oct 26 00:30:21 user nova-compute[75165]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 00:30:21 user nova-compute[75165]: </disk>
Oct 26 00:30:21 user nova-compute[75165]:  {{(pid=75165) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 00:30:21 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:30:21 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:30:21 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75165) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 00:30:21 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75165) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 00:30:21 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75165) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 00:30:21 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:30:21 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:30:21 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:30:21 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:30:21 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:30:21 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:30:21 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:30:21 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75165) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 00:30:21 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-b1207cd1-02d6-4e54-add0-07be38054f6a tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ce058b47-d96f-4341-9104-1fa71ca2c997 {{(pid=75165) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 00:30:21 user nova-compute[75165]: DEBUG nova.compute.manager [None req-a65f4b4f-1eb1-4473-aaf1-9ba1a60130fe tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: c7a55179-cde6-4fbd-a8b3-c3df149bc6f3] Start spawning the instance on the hypervisor. {{(pid=75165) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 00:30:21 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-a65f4b4f-1eb1-4473-aaf1-9ba1a60130fe tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: c7a55179-cde6-4fbd-a8b3-c3df149bc6f3] Creating instance directory {{(pid=75165) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 00:30:21 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-a65f4b4f-1eb1-4473-aaf1-9ba1a60130fe tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: c7a55179-cde6-4fbd-a8b3-c3df149bc6f3] Creating image(s)
Oct 26 00:30:21 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-a65f4b4f-1eb1-4473-aaf1-9ba1a60130fe tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: c7a55179-cde6-4fbd-a8b3-c3df149bc6f3] Did not create local disks {{(pid=75165) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 26 00:30:21 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-a65f4b4f-1eb1-4473-aaf1-9ba1a60130fe tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: c7a55179-cde6-4fbd-a8b3-c3df149bc6f3] Ensure instance console log exists: /opt/stack/data/nova/instances/c7a55179-cde6-4fbd-a8b3-c3df149bc6f3/console.log {{(pid=75165) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 00:30:21 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-a65f4b4f-1eb1-4473-aaf1-9ba1a60130fe tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:30:21 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-a65f4b4f-1eb1-4473-aaf1-9ba1a60130fe tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:30:21 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-a65f4b4f-1eb1-4473-aaf1-9ba1a60130fe tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:30:21 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-a65f4b4f-1eb1-4473-aaf1-9ba1a60130fe tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: c7a55179-cde6-4fbd-a8b3-c3df149bc6f3] Start _get_guest_xml network_info=[{"id": "70711118-68ee-4ea5-bfc2-df652ed0f3c1", "address": "fa:16:3e:91:b1:a6", "network": {"id": "eb55c0bc-cae5-4ba3-851a-e31a50b52c88", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1081223830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d616862c7c184de5b0ba3121552c5666", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70711118-68", "ovs_interfaceid": "70711118-68ee-4ea5-bfc2-df652ed0f3c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T00:03:24Z,direct_url=<?>,disk_format='qcow2',id=bff0d8a1-739e-4c4d-9efa-b73ba7b76d01,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e56bbf444fd34c348475c73673611447',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T00:03:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nWaNcYSH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c7a55179-cde6-4fbd-a8b3-c3df149bc6f3', 'attached_at': '', 'detached_at': '', 'volume_id': 'd249e808-e145-4ed5-a1a6-a550f7c6b3b8', 'serial': 'd249e808-e145-4ed5-a1a6-a550f7c6b3b8'}, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'attachment_id': '35974d6f-b38c-499b-bfee-122434ec2778', 'delete_on_termination': False, 'volume_type': None} {{(pid=75165) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 00:30:21 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-a65f4b4f-1eb1-4473-aaf1-9ba1a60130fe tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:30:21 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-a65f4b4f-1eb1-4473-aaf1-9ba1a60130fe tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:30:21 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-a65f4b4f-1eb1-4473-aaf1-9ba1a60130fe tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75165) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 00:30:21 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-a65f4b4f-1eb1-4473-aaf1-9ba1a60130fe tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] CPU controller missing on host. {{(pid=75165) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 00:30:21 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-a65f4b4f-1eb1-4473-aaf1-9ba1a60130fe tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75165) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 00:30:21 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-a65f4b4f-1eb1-4473-aaf1-9ba1a60130fe tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] CPU controller found on host. {{(pid=75165) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 00:30:21 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-a65f4b4f-1eb1-4473-aaf1-9ba1a60130fe tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75165) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 00:30:21 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-a65f4b4f-1eb1-4473-aaf1-9ba1a60130fe tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T00:03:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T00:03:24Z,direct_url=<?>,disk_format='qcow2',id=bff0d8a1-739e-4c4d-9efa-b73ba7b76d01,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e56bbf444fd34c348475c73673611447',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T00:03:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 00:30:21 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-a65f4b4f-1eb1-4473-aaf1-9ba1a60130fe tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Flavor limits 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 00:30:21 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-a65f4b4f-1eb1-4473-aaf1-9ba1a60130fe tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Image limits 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 00:30:21 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-a65f4b4f-1eb1-4473-aaf1-9ba1a60130fe tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Flavor pref 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 00:30:22 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-a65f4b4f-1eb1-4473-aaf1-9ba1a60130fe tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Image pref 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 00:30:22 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-a65f4b4f-1eb1-4473-aaf1-9ba1a60130fe tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 00:30:22 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-a65f4b4f-1eb1-4473-aaf1-9ba1a60130fe tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 00:30:22 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-a65f4b4f-1eb1-4473-aaf1-9ba1a60130fe tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75165) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 00:30:22 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-a65f4b4f-1eb1-4473-aaf1-9ba1a60130fe tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Got 1 possible topologies {{(pid=75165) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 00:30:22 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-a65f4b4f-1eb1-4473-aaf1-9ba1a60130fe tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 00:30:22 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-a65f4b4f-1eb1-4473-aaf1-9ba1a60130fe tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 00:30:22 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a65f4b4f-1eb1-4473-aaf1-9ba1a60130fe tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: c7a55179-cde6-4fbd-a8b3-c3df149bc6f3] Calling os-brick to attach iSCSI Volume {{(pid=75165) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 00:30:22 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-a65f4b4f-1eb1-4473-aaf1-9ba1a60130fe tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8bf8160e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nWaNcYSH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:30:22 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-a65f4b4f-1eb1-4473-aaf1-9ba1a60130fe tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:30:22 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-a65f4b4f-1eb1-4473-aaf1-9ba1a60130fe tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:30:22 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-a65f4b4f-1eb1-4473-aaf1-9ba1a60130fe tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:30:22 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-a65f4b4f-1eb1-4473-aaf1-9ba1a60130fe tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:30:22 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-a65f4b4f-1eb1-4473-aaf1-9ba1a60130fe tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:30:22 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-a65f4b4f-1eb1-4473-aaf1-9ba1a60130fe tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:30:22 user nova-compute[75165]: INFO os_brick.initiator.connectors.iscsi [None req-a65f4b4f-1eb1-4473-aaf1-9ba1a60130fe tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 00:30:22 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8 -p 172.16.0.220:3260 {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:30:22 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:30:22 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ca5eccc-7402-4721-a9dd-2a2b3fa1135b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:30:22 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-a65f4b4f-1eb1-4473-aaf1-9ba1a60130fe tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 00:30:22 user nova-compute[75165]:  {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:30:22 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8 -p 172.16.0.220:3260 --interface default --op new {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:30:22 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75165) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 00:30:22 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:30:22 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f479bba-dcb2-4286-a2d4-8cf94391e406]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8] added\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:30:22 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97fb67a7-637d-456f-b4dd-0a271ed6cfc4/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:30:22 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-a65f4b4f-1eb1-4473-aaf1-9ba1a60130fe tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8] added
Oct 26 00:30:22 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:30:22 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:30:22 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:30:22 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cdda8d2-8031-45fc-b835-71b10a231934]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:30:22 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-a65f4b4f-1eb1-4473-aaf1-9ba1a60130fe tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:30:22 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:30:22 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:30:22 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbca6693-d163-47b9-8fea-d550398e7af2]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:30:22 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-a65f4b4f-1eb1-4473-aaf1-9ba1a60130fe tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:30:22 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nWaNcYSH {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:30:22 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nWaNcYSH" returned: 0 in 0.022s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:30:22 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e4eff76-bec5-45e0-949e-bb4260e32f53]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:30:22 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-a65f4b4f-1eb1-4473-aaf1-9ba1a60130fe tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nWaNcYSH'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:30:22 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:30:22 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:30:22 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d6504dd-e415-482d-a65e-2169fe9e00f7]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:30:22 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-a65f4b4f-1eb1-4473-aaf1-9ba1a60130fe tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:30:22 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:30:22 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:30:22 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b394543-94f1-489b-bc78-c7ffc57236f6]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff19ba88-2bf9-451f-afcc-e149c1578b95 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7 (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:30:22 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-a65f4b4f-1eb1-4473-aaf1-9ba1a60130fe tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)
Oct 26 00:30:22 user nova-compute[75165]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff19ba88-2bf9-451f-afcc-e149c1578b95 (non-flash)
Oct 26 00:30:22 user nova-compute[75165]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0 (non-flash)
Oct 26 00:30:22 user nova-compute[75165]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7 (non-flash)
Oct 26 00:30:22 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:30:22 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-a65f4b4f-1eb1-4473-aaf1-9ba1a60130fe tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)
Oct 26 00:30:22 user nova-compute[75165]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff19ba88-2bf9-451f-afcc-e149c1578b95 (non-flash)
Oct 26 00:30:22 user nova-compute[75165]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0 (non-flash)
Oct 26 00:30:22 user nova-compute[75165]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7 (non-flash)
Oct 26 00:30:22 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:30:22 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8 -p 172.16.0.220:3260 --login {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:30:22 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97fb67a7-637d-456f-b4dd-0a271ed6cfc4/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:30:22 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97fb67a7-637d-456f-b4dd-0a271ed6cfc4/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:30:22 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:30:22 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[53374baa-7361-4ad2-9270-d03569a2e563]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:30:22 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-a65f4b4f-1eb1-4473-aaf1-9ba1a60130fe tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8, portal: 172.16.0.220,3260]
Oct 26 00:30:22 user nova-compute[75165]: Login to [iface: default, target: iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8, portal: 172.16.0.220,3260] successful.
Oct 26 00:30:22 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:30:22 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:30:22 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:30:22 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff8e67f4-4bd2-4efe-8a9b-62143179f02c]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:30:22 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-a65f4b4f-1eb1-4473-aaf1-9ba1a60130fe tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:30:22 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:30:22 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:30:22 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[a75bdf2f-ec3c-459b-a5c4-02a9a0ebdbe4]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff19ba88-2bf9-451f-afcc-e149c1578b95 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8 (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:30:22 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-a65f4b4f-1eb1-4473-aaf1-9ba1a60130fe tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)
Oct 26 00:30:22 user nova-compute[75165]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff19ba88-2bf9-451f-afcc-e149c1578b95 (non-flash)
Oct 26 00:30:22 user nova-compute[75165]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0 (non-flash)
Oct 26 00:30:22 user nova-compute[75165]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7 (non-flash)
Oct 26 00:30:22 user nova-compute[75165]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8 (non-flash)
Oct 26 00:30:22 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:30:22 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-a65f4b4f-1eb1-4473-aaf1-9ba1a60130fe tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)
Oct 26 00:30:22 user nova-compute[75165]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff19ba88-2bf9-451f-afcc-e149c1578b95 (non-flash)
Oct 26 00:30:22 user nova-compute[75165]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0 (non-flash)
Oct 26 00:30:22 user nova-compute[75165]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7 (non-flash)
Oct 26 00:30:22 user nova-compute[75165]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8 (non-flash)
Oct 26 00:30:22 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:30:22 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-a65f4b4f-1eb1-4473-aaf1-9ba1a60130fe tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.388s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:30:22 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-a65f4b4f-1eb1-4473-aaf1-9ba1a60130fe tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Connected to 172.16.0.220:3260 {{(pid=75165) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 00:30:22 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-a65f4b4f-1eb1-4473-aaf1-9ba1a60130fe tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] HCTL ('34', '-', '-', 0) found on session 35 with lun 0 {{(pid=75165) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 00:30:22 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-a65f4b4f-1eb1-4473-aaf1-9ba1a60130fe tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75165) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 00:30:22 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:30:22 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:30:22 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f6f0c2c-e1b2-4a40-a778-440097ef6f8c]: (4, ('- - 0', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:30:22 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-a65f4b4f-1eb1-4473-aaf1-9ba1a60130fe tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Searching for a device in session 35 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75165) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 00:30:22 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-a65f4b4f-1eb1-4473-aaf1-9ba1a60130fe tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nWaNcYSH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75165) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 00:30:22 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97fb67a7-637d-456f-b4dd-0a271ed6cfc4/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:30:22 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb77893d-263a-40a6-9acc-63fcd1481a38/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:30:22 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb77893d-263a-40a6-9acc-63fcd1481a38/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:30:22 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb77893d-263a-40a6-9acc-63fcd1481a38/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:30:22 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb77893d-263a-40a6-9acc-63fcd1481a38/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:30:22 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75165) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 00:30:22 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3c87b07-5c16-4f45-b320-06d3503d23e6/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:30:23 user nova-compute[75165]: DEBUG nova.compute.manager [req-4c6fd30b-50e1-4143-aeaa-dc1eab105875 req-e9d2d332-5406-4045-9d15-4e9b6ee9c689 service nova] [instance: bb77893d-263a-40a6-9acc-63fcd1481a38] Received event network-changed-f6053f89-f617-42db-8747-b5cc98ee387d {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:30:23 user nova-compute[75165]: DEBUG nova.compute.manager [req-4c6fd30b-50e1-4143-aeaa-dc1eab105875 req-e9d2d332-5406-4045-9d15-4e9b6ee9c689 service nova] [instance: bb77893d-263a-40a6-9acc-63fcd1481a38] Refreshing instance network info cache due to event network-changed-f6053f89-f617-42db-8747-b5cc98ee387d. {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 00:30:23 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-4c6fd30b-50e1-4143-aeaa-dc1eab105875 req-e9d2d332-5406-4045-9d15-4e9b6ee9c689 service nova] Acquiring lock "refresh_cache-bb77893d-263a-40a6-9acc-63fcd1481a38" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:30:23 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-4c6fd30b-50e1-4143-aeaa-dc1eab105875 req-e9d2d332-5406-4045-9d15-4e9b6ee9c689 service nova] Acquired lock "refresh_cache-bb77893d-263a-40a6-9acc-63fcd1481a38" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:30:23 user nova-compute[75165]: DEBUG nova.network.neutron [req-4c6fd30b-50e1-4143-aeaa-dc1eab105875 req-e9d2d332-5406-4045-9d15-4e9b6ee9c689 service nova] [instance: bb77893d-263a-40a6-9acc-63fcd1481a38] Refreshing network info cache for port f6053f89-f617-42db-8747-b5cc98ee387d {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 00:30:23 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3c87b07-5c16-4f45-b320-06d3503d23e6/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:30:23 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3c87b07-5c16-4f45-b320-06d3503d23e6/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:30:23 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-05172142-7b5a-4c59-9a4a-d567e71543d1 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Acquiring lock "bb77893d-263a-40a6-9acc-63fcd1481a38" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:30:23 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-05172142-7b5a-4c59-9a4a-d567e71543d1 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Lock "bb77893d-263a-40a6-9acc-63fcd1481a38" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:30:23 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3c87b07-5c16-4f45-b320-06d3503d23e6/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:30:23 user nova-compute[75165]: DEBUG nova.objects.instance [None req-05172142-7b5a-4c59-9a4a-d567e71543d1 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Lazy-loading 'flavor' on Instance uuid bb77893d-263a-40a6-9acc-63fcd1481a38 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:30:23 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce058b47-d96f-4341-9104-1fa71ca2c997/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:30:23 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-05172142-7b5a-4c59-9a4a-d567e71543d1 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] [instance: bb77893d-263a-40a6-9acc-63fcd1481a38] Ignoring supplied device name: /dev/vdb
Oct 26 00:30:23 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-05172142-7b5a-4c59-9a4a-d567e71543d1 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Lock "bb77893d-263a-40a6-9acc-63fcd1481a38" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.102s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:30:23 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-a65f4b4f-1eb1-4473-aaf1-9ba1a60130fe tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.434s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:30:23 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-a65f4b4f-1eb1-4473-aaf1-9ba1a60130fe tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] <== connect_volume: return (1435ms) {'type': 'block', 'scsi_wwn': '26333323866393330', 'path': '/dev/sdc'} {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:30:23 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a65f4b4f-1eb1-4473-aaf1-9ba1a60130fe tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: c7a55179-cde6-4fbd-a8b3-c3df149bc6f3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26333323866393330', 'path': '/dev/sdc'} {{(pid=75165) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 00:30:23 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce058b47-d96f-4341-9104-1fa71ca2c997/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:30:23 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce058b47-d96f-4341-9104-1fa71ca2c997/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:30:23 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-a65f4b4f-1eb1-4473-aaf1-9ba1a60130fe tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:29:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1904019446',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1904019446',id=36,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d616862c7c184de5b0ba3121552c5666',ramdisk_id='',reservation_id='r-jr45148e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-638746030',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T00:29:47Z,user_data=None,user_id='dbe0d52293264f33ae86de41dabeefcf',uuid=c7a55179-cde6-4fbd-a8b3-c3df149bc6f3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "70711118-68ee-4ea5-bfc2-df652ed0f3c1", "address": "fa:16:3e:91:b1:a6", "network": {"id": "eb55c0bc-cae5-4ba3-851a-e31a50b52c88", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1081223830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d616862c7c184de5b0ba3121552c5666", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70711118-68", "ovs_interfaceid": "70711118-68ee-4ea5-bfc2-df652ed0f3c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75165) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 00:30:23 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-a65f4b4f-1eb1-4473-aaf1-9ba1a60130fe tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Converting VIF {"id": "70711118-68ee-4ea5-bfc2-df652ed0f3c1", "address": "fa:16:3e:91:b1:a6", "network": {"id": "eb55c0bc-cae5-4ba3-851a-e31a50b52c88", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1081223830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d616862c7c184de5b0ba3121552c5666", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70711118-68", "ovs_interfaceid": "70711118-68ee-4ea5-bfc2-df652ed0f3c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:30:23 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-a65f4b4f-1eb1-4473-aaf1-9ba1a60130fe tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:b1:a6,bridge_name='br-int',has_traffic_filtering=True,id=70711118-68ee-4ea5-bfc2-df652ed0f3c1,network=Network(eb55c0bc-cae5-4ba3-851a-e31a50b52c88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70711118-68') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:30:23 user nova-compute[75165]: DEBUG nova.objects.instance [None req-a65f4b4f-1eb1-4473-aaf1-9ba1a60130fe tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Lazy-loading 'pci_devices' on Instance uuid c7a55179-cde6-4fbd-a8b3-c3df149bc6f3 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:30:23 user nova-compute[75165]: DEBUG nova.network.neutron [req-4c6fd30b-50e1-4143-aeaa-dc1eab105875 req-e9d2d332-5406-4045-9d15-4e9b6ee9c689 service nova] [instance: bb77893d-263a-40a6-9acc-63fcd1481a38] Updated VIF entry in instance network info cache for port f6053f89-f617-42db-8747-b5cc98ee387d. {{(pid=75165) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 00:30:23 user nova-compute[75165]: DEBUG nova.network.neutron [req-4c6fd30b-50e1-4143-aeaa-dc1eab105875 req-e9d2d332-5406-4045-9d15-4e9b6ee9c689 service nova] [instance: bb77893d-263a-40a6-9acc-63fcd1481a38] Updating instance_info_cache with network_info: [{"id": "f6053f89-f617-42db-8747-b5cc98ee387d", "address": "fa:16:3e:82:0a:f8", "network": {"id": "6b000f11-7be2-4a26-ba67-b10f275e8560", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1605988141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eed16e1778f4ffb93afcc1ddbfe3d72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6053f89-f6", "ovs_interfaceid": "f6053f89-f617-42db-8747-b5cc98ee387d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:30:23 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-a65f4b4f-1eb1-4473-aaf1-9ba1a60130fe tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: c7a55179-cde6-4fbd-a8b3-c3df149bc6f3] End _get_guest_xml xml=<domain type="kvm">
Oct 26 00:30:23 user nova-compute[75165]:   <uuid>c7a55179-cde6-4fbd-a8b3-c3df149bc6f3</uuid>
Oct 26 00:30:23 user nova-compute[75165]:   <name>instance-00000024</name>
Oct 26 00:30:23 user nova-compute[75165]:   <memory>524288</memory>
Oct 26 00:30:23 user nova-compute[75165]:   <vcpu>1</vcpu>
Oct 26 00:30:23 user nova-compute[75165]:   <metadata>
Oct 26 00:30:23 user nova-compute[75165]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 00:30:23 user nova-compute[75165]:       <nova:package version="0.0.0"/>
Oct 26 00:30:23 user nova-compute[75165]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1904019446</nova:name>
Oct 26 00:30:23 user nova-compute[75165]:       <nova:creationTime>2023-10-26 00:30:21</nova:creationTime>
Oct 26 00:30:23 user nova-compute[75165]:       <nova:flavor name="m1.tiny">
Oct 26 00:30:23 user nova-compute[75165]:         <nova:memory>512</nova:memory>
Oct 26 00:30:23 user nova-compute[75165]:         <nova:disk>1</nova:disk>
Oct 26 00:30:23 user nova-compute[75165]:         <nova:swap>0</nova:swap>
Oct 26 00:30:23 user nova-compute[75165]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 00:30:23 user nova-compute[75165]:         <nova:vcpus>1</nova:vcpus>
Oct 26 00:30:23 user nova-compute[75165]:       </nova:flavor>
Oct 26 00:30:23 user nova-compute[75165]:       <nova:owner>
Oct 26 00:30:23 user nova-compute[75165]:         <nova:user uuid="dbe0d52293264f33ae86de41dabeefcf">tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member</nova:user>
Oct 26 00:30:23 user nova-compute[75165]:         <nova:project uuid="d616862c7c184de5b0ba3121552c5666">tempest-ServerBootFromVolumeStableRescueTest-638746030</nova:project>
Oct 26 00:30:23 user nova-compute[75165]:       </nova:owner>
Oct 26 00:30:23 user nova-compute[75165]:       <nova:root type="image" uuid="bff0d8a1-739e-4c4d-9efa-b73ba7b76d01"/>
Oct 26 00:30:23 user nova-compute[75165]:       <nova:ports>
Oct 26 00:30:23 user nova-compute[75165]:         <nova:port uuid="70711118-68ee-4ea5-bfc2-df652ed0f3c1">
Oct 26 00:30:23 user nova-compute[75165]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 26 00:30:23 user nova-compute[75165]:         </nova:port>
Oct 26 00:30:23 user nova-compute[75165]:       </nova:ports>
Oct 26 00:30:23 user nova-compute[75165]:     </nova:instance>
Oct 26 00:30:23 user nova-compute[75165]:   </metadata>
Oct 26 00:30:23 user nova-compute[75165]:   <sysinfo type="smbios">
Oct 26 00:30:23 user nova-compute[75165]:     <system>
Oct 26 00:30:23 user nova-compute[75165]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 00:30:23 user nova-compute[75165]:       <entry name="product">OpenStack Nova</entry>
Oct 26 00:30:23 user nova-compute[75165]:       <entry name="version">0.0.0</entry>
Oct 26 00:30:23 user nova-compute[75165]:       <entry name="serial">c7a55179-cde6-4fbd-a8b3-c3df149bc6f3</entry>
Oct 26 00:30:23 user nova-compute[75165]:       <entry name="uuid">c7a55179-cde6-4fbd-a8b3-c3df149bc6f3</entry>
Oct 26 00:30:23 user nova-compute[75165]:       <entry name="family">Virtual Machine</entry>
Oct 26 00:30:23 user nova-compute[75165]:     </system>
Oct 26 00:30:23 user nova-compute[75165]:   </sysinfo>
Oct 26 00:30:23 user nova-compute[75165]:   <os>
Oct 26 00:30:23 user nova-compute[75165]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 00:30:23 user nova-compute[75165]:     <boot dev="hd"/>
Oct 26 00:30:23 user nova-compute[75165]:     <smbios mode="sysinfo"/>
Oct 26 00:30:23 user nova-compute[75165]:   </os>
Oct 26 00:30:23 user nova-compute[75165]:   <features>
Oct 26 00:30:23 user nova-compute[75165]:     <acpi/>
Oct 26 00:30:23 user nova-compute[75165]:     <apic/>
Oct 26 00:30:23 user nova-compute[75165]:     <vmcoreinfo/>
Oct 26 00:30:23 user nova-compute[75165]:   </features>
Oct 26 00:30:23 user nova-compute[75165]:   <clock offset="utc">
Oct 26 00:30:23 user nova-compute[75165]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 00:30:23 user nova-compute[75165]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 00:30:23 user nova-compute[75165]:     <timer name="hpet" present="no"/>
Oct 26 00:30:23 user nova-compute[75165]:   </clock>
Oct 26 00:30:23 user nova-compute[75165]:   <cpu mode="custom" match="exact">
Oct 26 00:30:23 user nova-compute[75165]:     <model>Nehalem</model>
Oct 26 00:30:23 user nova-compute[75165]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 00:30:23 user nova-compute[75165]:   </cpu>
Oct 26 00:30:23 user nova-compute[75165]:   <devices>
Oct 26 00:30:23 user nova-compute[75165]:     <disk type="block" device="disk">
Oct 26 00:30:23 user nova-compute[75165]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 00:30:23 user nova-compute[75165]:       <source dev="/dev/sdc"/>
Oct 26 00:30:23 user nova-compute[75165]:       <target dev="vda" bus="virtio"/>
Oct 26 00:30:23 user nova-compute[75165]:       <serial>d249e808-e145-4ed5-a1a6-a550f7c6b3b8</serial>
Oct 26 00:30:23 user nova-compute[75165]:     </disk>
Oct 26 00:30:23 user nova-compute[75165]:     <interface type="ethernet">
Oct 26 00:30:23 user nova-compute[75165]:       <mac address="fa:16:3e:91:b1:a6"/>
Oct 26 00:30:23 user nova-compute[75165]:       <model type="virtio"/>
Oct 26 00:30:23 user nova-compute[75165]:       <mtu size="1442"/>
Oct 26 00:30:23 user nova-compute[75165]:       <target dev="tap70711118-68"/>
Oct 26 00:30:23 user nova-compute[75165]:     </interface>
Oct 26 00:30:23 user nova-compute[75165]:     <serial type="pty">
Oct 26 00:30:23 user nova-compute[75165]:       <log file="/opt/stack/data/nova/instances/c7a55179-cde6-4fbd-a8b3-c3df149bc6f3/console.log" append="off"/>
Oct 26 00:30:23 user nova-compute[75165]:     </serial>
Oct 26 00:30:23 user nova-compute[75165]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 00:30:23 user nova-compute[75165]:     <video>
Oct 26 00:30:23 user nova-compute[75165]:       <model type="virtio"/>
Oct 26 00:30:23 user nova-compute[75165]:     </video>
Oct 26 00:30:23 user nova-compute[75165]:     <rng model="virtio">
Oct 26 00:30:23 user nova-compute[75165]:       <backend model="random">/dev/urandom</backend>
Oct 26 00:30:23 user nova-compute[75165]:     </rng>
Oct 26 00:30:23 user nova-compute[75165]:     <controller type="usb" index="0" model="none"/>
Oct 26 00:30:23 user nova-compute[75165]:     <memballoon model="virtio">
Oct 26 00:30:23 user nova-compute[75165]:       <stats period="10"/>
Oct 26 00:30:23 user nova-compute[75165]:     </memballoon>
Oct 26 00:30:23 user nova-compute[75165]:   </devices>
Oct 26 00:30:23 user nova-compute[75165]: </domain>
Oct 26 00:30:23 user nova-compute[75165]:  {{(pid=75165) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 00:30:23 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-a65f4b4f-1eb1-4473-aaf1-9ba1a60130fe tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:29:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1904019446',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1904019446',id=36,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d616862c7c184de5b0ba3121552c5666',ramdisk_id='',reservation_id='r-jr45148e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-638746030',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T00:29:47Z,user_data=None,user_id='dbe0d52293264f33ae86de41dabeefcf',uuid=c7a55179-cde6-4fbd-a8b3-c3df149bc6f3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "70711118-68ee-4ea5-bfc2-df652ed0f3c1", "address": "fa:16:3e:91:b1:a6", "network": {"id": "eb55c0bc-cae5-4ba3-851a-e31a50b52c88", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1081223830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d616862c7c184de5b0ba3121552c5666", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70711118-68", "ovs_interfaceid": "70711118-68ee-4ea5-bfc2-df652ed0f3c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 00:30:23 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-a65f4b4f-1eb1-4473-aaf1-9ba1a60130fe tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Converting VIF {"id": "70711118-68ee-4ea5-bfc2-df652ed0f3c1", "address": "fa:16:3e:91:b1:a6", "network": {"id": "eb55c0bc-cae5-4ba3-851a-e31a50b52c88", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1081223830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d616862c7c184de5b0ba3121552c5666", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70711118-68", "ovs_interfaceid": "70711118-68ee-4ea5-bfc2-df652ed0f3c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:30:23 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-a65f4b4f-1eb1-4473-aaf1-9ba1a60130fe tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:b1:a6,bridge_name='br-int',has_traffic_filtering=True,id=70711118-68ee-4ea5-bfc2-df652ed0f3c1,network=Network(eb55c0bc-cae5-4ba3-851a-e31a50b52c88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70711118-68') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:30:23 user nova-compute[75165]: DEBUG os_vif [None req-a65f4b4f-1eb1-4473-aaf1-9ba1a60130fe tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:b1:a6,bridge_name='br-int',has_traffic_filtering=True,id=70711118-68ee-4ea5-bfc2-df652ed0f3c1,network=Network(eb55c0bc-cae5-4ba3-851a-e31a50b52c88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70711118-68') {{(pid=75165) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 00:30:23 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:30:23 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:30:23 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 00:30:23 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-05172142-7b5a-4c59-9a4a-d567e71543d1 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Acquiring lock "bb77893d-263a-40a6-9acc-63fcd1481a38" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:30:23 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-05172142-7b5a-4c59-9a4a-d567e71543d1 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Lock "bb77893d-263a-40a6-9acc-63fcd1481a38" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:30:23 user nova-compute[75165]: INFO nova.compute.manager [None req-05172142-7b5a-4c59-9a4a-d567e71543d1 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] [instance: bb77893d-263a-40a6-9acc-63fcd1481a38] Attaching volume 20bc9a02-2908-4429-8524-fcc9553f3a29 to /dev/vdb
Oct 26 00:30:23 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:30:23 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '400f86a9-041b-5a84-bb5d-f1f0c2cf163d', '_type': 'linux-noop'}}, row=False) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:30:23 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:30:23 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-4c6fd30b-50e1-4143-aeaa-dc1eab105875 req-e9d2d332-5406-4045-9d15-4e9b6ee9c689 service nova] Releasing lock "refresh_cache-bb77893d-263a-40a6-9acc-63fcd1481a38" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:30:23 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:30:23 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:30:23 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap70711118-68, may_exist=True, interface_attrs={}) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:30:23 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap70711118-68, col_values=(('qos', UUID('7ceee95b-28ab-4752-a905-4faa67b81dad')),), if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:30:23 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap70711118-68, col_values=(('external_ids', {'iface-id': '70711118-68ee-4ea5-bfc2-df652ed0f3c1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:91:b1:a6', 'vm-uuid': 'c7a55179-cde6-4fbd-a8b3-c3df149bc6f3'}),), if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:30:23 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:30:23 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:30:23 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:30:23 user nova-compute[75165]: INFO os_vif [None req-a65f4b4f-1eb1-4473-aaf1-9ba1a60130fe tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:b1:a6,bridge_name='br-int',has_traffic_filtering=True,id=70711118-68ee-4ea5-bfc2-df652ed0f3c1,network=Network(eb55c0bc-cae5-4ba3-851a-e31a50b52c88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70711118-68')
Oct 26 00:30:23 user nova-compute[75165]: DEBUG os_brick.utils [None req-05172142-7b5a-4c59-9a4a-d567e71543d1 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:30:23 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:30:23 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-a65f4b4f-1eb1-4473-aaf1-9ba1a60130fe tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] No BDM found with device name vda, not building metadata. {{(pid=75165) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 00:30:23 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-a65f4b4f-1eb1-4473-aaf1-9ba1a60130fe tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] No VIF found with MAC fa:16:3e:91:b1:a6, not building metadata {{(pid=75165) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 00:30:23 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:30:23 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[69bbb735-df5c-4348-a26b-b875be647463]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa94814ccb35\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:30:23 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:30:23 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce058b47-d96f-4341-9104-1fa71ca2c997/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:30:23 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75165) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 00:30:23 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe2984ce-8958-4049-8af7-496b313b26c8/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:30:23 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:30:23 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[78b041e3-15cc-42e8-a656-d458d1056831]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:30:23 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:30:23 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:30:23 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[11a9df76-4ab9-46f2-908a-2a85c7dd21ca]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:30:23 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa5cd0cf-c0da-40da-9cdb-c9a90e275b7e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:30:23 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-05172142-7b5a-4c59-9a4a-d567e71543d1 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Running cmd (subprocess): nvme version {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:30:23 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-05172142-7b5a-4c59-9a4a-d567e71543d1 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] 'nvme version' failed. Not Retrying. {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 00:30:23 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.nvmeof [None req-05172142-7b5a-4c59-9a4a-d567e71543d1 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] nvme not present on system {{(pid=75165) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 00:30:23 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:30:23 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 00:30:23 user nova-compute[75165]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 00:30:23 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[edc978e5-7dbf-4e28-b518-0b9490c5888e]: (4, '') {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:30:23 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-05172142-7b5a-4c59-9a4a-d567e71543d1 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75165) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 00:30:23 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-05172142-7b5a-4c59-9a4a-d567e71543d1 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75165) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 00:30:23 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-05172142-7b5a-4c59-9a4a-d567e71543d1 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] LIGHTOS: no hostnqn found. {{(pid=75165) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 00:30:23 user nova-compute[75165]: DEBUG os_brick.utils [None req-05172142-7b5a-4c59-9a4a-d567e71543d1 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] <== get_connector_properties: return (159ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa94814ccb35', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:30:23 user nova-compute[75165]: DEBUG nova.virt.block_device [None req-05172142-7b5a-4c59-9a4a-d567e71543d1 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] [instance: bb77893d-263a-40a6-9acc-63fcd1481a38] Updating existing volume attachment record: 6012cb3a-cbe8-4798-b1e3-61db1869a3ef {{(pid=75165) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 00:30:23 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe2984ce-8958-4049-8af7-496b313b26c8/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:30:23 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe2984ce-8958-4049-8af7-496b313b26c8/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:30:24 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe2984ce-8958-4049-8af7-496b313b26c8/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:30:27 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:30:27 user nova-compute[75165]: DEBUG nova.compute.manager [None req-a65f4b4f-1eb1-4473-aaf1-9ba1a60130fe tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: c7a55179-cde6-4fbd-a8b3-c3df149bc6f3] Instance event wait completed in 0 seconds for  {{(pid=75165) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 00:30:27 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-a65f4b4f-1eb1-4473-aaf1-9ba1a60130fe tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: c7a55179-cde6-4fbd-a8b3-c3df149bc6f3] Guest created on hypervisor {{(pid=75165) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 00:30:27 user nova-compute[75165]: DEBUG nova.compute.manager [req-5fc4b409-c369-4516-bc8f-49d2766606e3 req-c649de1e-5f0c-4fc5-af49-a34a4726c271 service nova] [instance: c7a55179-cde6-4fbd-a8b3-c3df149bc6f3] Received event network-vif-plugged-70711118-68ee-4ea5-bfc2-df652ed0f3c1 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:30:27 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-5fc4b409-c369-4516-bc8f-49d2766606e3 req-c649de1e-5f0c-4fc5-af49-a34a4726c271 service nova] Acquiring lock "c7a55179-cde6-4fbd-a8b3-c3df149bc6f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:30:27 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-5fc4b409-c369-4516-bc8f-49d2766606e3 req-c649de1e-5f0c-4fc5-af49-a34a4726c271 service nova] Lock "c7a55179-cde6-4fbd-a8b3-c3df149bc6f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:30:27 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-5fc4b409-c369-4516-bc8f-49d2766606e3 req-c649de1e-5f0c-4fc5-af49-a34a4726c271 service nova] Lock "c7a55179-cde6-4fbd-a8b3-c3df149bc6f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:30:27 user nova-compute[75165]: DEBUG nova.compute.manager [req-5fc4b409-c369-4516-bc8f-49d2766606e3 req-c649de1e-5f0c-4fc5-af49-a34a4726c271 service nova] [instance: c7a55179-cde6-4fbd-a8b3-c3df149bc6f3] No waiting events found dispatching network-vif-plugged-70711118-68ee-4ea5-bfc2-df652ed0f3c1 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:30:27 user nova-compute[75165]: WARNING nova.compute.manager [req-5fc4b409-c369-4516-bc8f-49d2766606e3 req-c649de1e-5f0c-4fc5-af49-a34a4726c271 service nova] [instance: c7a55179-cde6-4fbd-a8b3-c3df149bc6f3] Received unexpected event network-vif-plugged-70711118-68ee-4ea5-bfc2-df652ed0f3c1 for instance with vm_state building and task_state spawning.
Oct 26 00:30:27 user nova-compute[75165]: DEBUG nova.compute.manager [req-f773de3c-33e6-468e-b5e7-cb5b6fdea533 req-61839531-f64a-445d-9e90-000b49e8aebe service nova] [instance: c7a55179-cde6-4fbd-a8b3-c3df149bc6f3] Received event network-vif-plugged-70711118-68ee-4ea5-bfc2-df652ed0f3c1 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:30:27 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-f773de3c-33e6-468e-b5e7-cb5b6fdea533 req-61839531-f64a-445d-9e90-000b49e8aebe service nova] Acquiring lock "c7a55179-cde6-4fbd-a8b3-c3df149bc6f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:30:27 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-f773de3c-33e6-468e-b5e7-cb5b6fdea533 req-61839531-f64a-445d-9e90-000b49e8aebe service nova] Lock "c7a55179-cde6-4fbd-a8b3-c3df149bc6f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:30:27 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-f773de3c-33e6-468e-b5e7-cb5b6fdea533 req-61839531-f64a-445d-9e90-000b49e8aebe service nova] Lock "c7a55179-cde6-4fbd-a8b3-c3df149bc6f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:30:27 user nova-compute[75165]: DEBUG nova.compute.manager [req-f773de3c-33e6-468e-b5e7-cb5b6fdea533 req-61839531-f64a-445d-9e90-000b49e8aebe service nova] [instance: c7a55179-cde6-4fbd-a8b3-c3df149bc6f3] No waiting events found dispatching network-vif-plugged-70711118-68ee-4ea5-bfc2-df652ed0f3c1 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:30:27 user nova-compute[75165]: WARNING nova.compute.manager [req-f773de3c-33e6-468e-b5e7-cb5b6fdea533 req-61839531-f64a-445d-9e90-000b49e8aebe service nova] [instance: c7a55179-cde6-4fbd-a8b3-c3df149bc6f3] Received unexpected event network-vif-plugged-70711118-68ee-4ea5-bfc2-df652ed0f3c1 for instance with vm_state building and task_state spawning.
Oct 26 00:30:27 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: c7a55179-cde6-4fbd-a8b3-c3df149bc6f3] Instance spawned successfully.
Oct 26 00:30:27 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:30:27 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:30:27 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Hypervisor/Node resource view: name=user free_ram=8040MB free_disk=24.785579681396484GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75165) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 00:30:27 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:30:27 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:30:27 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-a65f4b4f-1eb1-4473-aaf1-9ba1a60130fe tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: c7a55179-cde6-4fbd-a8b3-c3df149bc6f3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 00:30:27 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-a65f4b4f-1eb1-4473-aaf1-9ba1a60130fe tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: c7a55179-cde6-4fbd-a8b3-c3df149bc6f3] Found default for hw_cdrom_bus of ide {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:30:27 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-a65f4b4f-1eb1-4473-aaf1-9ba1a60130fe tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: c7a55179-cde6-4fbd-a8b3-c3df149bc6f3] Found default for hw_disk_bus of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:30:27 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-a65f4b4f-1eb1-4473-aaf1-9ba1a60130fe tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: c7a55179-cde6-4fbd-a8b3-c3df149bc6f3] Found default for hw_input_bus of None {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:30:27 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-a65f4b4f-1eb1-4473-aaf1-9ba1a60130fe tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: c7a55179-cde6-4fbd-a8b3-c3df149bc6f3] Found default for hw_pointer_model of None {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:30:27 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-a65f4b4f-1eb1-4473-aaf1-9ba1a60130fe tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: c7a55179-cde6-4fbd-a8b3-c3df149bc6f3] Found default for hw_video_model of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:30:27 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-a65f4b4f-1eb1-4473-aaf1-9ba1a60130fe tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: c7a55179-cde6-4fbd-a8b3-c3df149bc6f3] Found default for hw_vif_model of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:30:27 user nova-compute[75165]: INFO nova.compute.manager [None req-a65f4b4f-1eb1-4473-aaf1-9ba1a60130fe tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: c7a55179-cde6-4fbd-a8b3-c3df149bc6f3] Took 5.54 seconds to spawn the instance on the hypervisor.
Oct 26 00:30:27 user nova-compute[75165]: DEBUG nova.compute.manager [None req-a65f4b4f-1eb1-4473-aaf1-9ba1a60130fe tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: c7a55179-cde6-4fbd-a8b3-c3df149bc6f3] Checking state {{(pid=75165) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 00:30:27 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 97fb67a7-637d-456f-b4dd-0a271ed6cfc4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:30:27 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:30:27 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance ce058b47-d96f-4341-9104-1fa71ca2c997 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:30:27 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance fe2984ce-8958-4049-8af7-496b313b26c8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:30:27 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance b3c87b07-5c16-4f45-b320-06d3503d23e6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:30:27 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance bb77893d-263a-40a6-9acc-63fcd1481a38 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:30:27 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 250afc24-0c38-4959-a77c-d51365dd1c4e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:30:27 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance c396d555-70cf-4642-a0a0-485760cdf3fa actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:30:27 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance c7a55179-cde6-4fbd-a8b3-c3df149bc6f3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:30:27 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75165) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 00:30:27 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75165) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 00:30:27 user nova-compute[75165]: INFO nova.compute.manager [None req-a65f4b4f-1eb1-4473-aaf1-9ba1a60130fe tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: c7a55179-cde6-4fbd-a8b3-c3df149bc6f3] Took 41.39 seconds to build instance.
Oct 26 00:30:27 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-a65f4b4f-1eb1-4473-aaf1-9ba1a60130fe tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Lock "c7a55179-cde6-4fbd-a8b3-c3df149bc6f3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 41.495s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:30:27 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:30:27 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:30:27 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Compute_service record updated for user:user {{(pid=75165) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 00:30:27 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.541s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:30:28 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:30:31 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:30:33 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:30:38 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:30:41 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:30:41 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-b1207cd1-02d6-4e54-add0-07be38054f6a tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ce058b47-d96f-4341-9104-1fa71ca2c997 is timed out.
Oct 26 00:30:41 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-b1207cd1-02d6-4e54-add0-07be38054f6a tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Successfully detached device vdb from instance ce058b47-d96f-4341-9104-1fa71ca2c997 from the live domain config.
Oct 26 00:30:41 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b1207cd1-02d6-4e54-add0-07be38054f6a tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] [instance: ce058b47-d96f-4341-9104-1fa71ca2c997] calling os-brick to detach iSCSI Volume {{(pid=75165) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 00:30:41 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1207cd1-02d6-4e54-add0-07be38054f6a tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8bf8160e50>, {'target_iqn': 'iqn.2010-10.org.openstack:ff19ba88-2bf9-451f-afcc-e149c1578b95', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kKoIVgMG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:30:41 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-b1207cd1-02d6-4e54-add0-07be38054f6a tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:30:41 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-b1207cd1-02d6-4e54-add0-07be38054f6a tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:30:41 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-b1207cd1-02d6-4e54-add0-07be38054f6a tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:30:41 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:30:41 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:30:41 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f2889e3-275f-40c2-87d1-c57e28e0bb88]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ff19ba88-2bf9-451f-afcc-e149c1578b95\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:30:41 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1207cd1-02d6-4e54-add0-07be38054f6a tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 00:30:41 user nova-compute[75165]: No targets found.
Oct 26 00:30:41 user nova-compute[75165]: iSNS:
Oct 26 00:30:41 user nova-compute[75165]: No targets found.
Oct 26 00:30:41 user nova-compute[75165]: STATIC:
Oct 26 00:30:41 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8
Oct 26 00:30:41 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:30:41 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:30:41 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7
Oct 26 00:30:41 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:30:41 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:30:41 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795
Oct 26 00:30:41 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:30:41 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:30:41 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:ff19ba88-2bf9-451f-afcc-e149c1578b95
Oct 26 00:30:41 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:30:41 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:30:41 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0
Oct 26 00:30:41 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:30:41 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:30:41 user nova-compute[75165]: FIRMWARE:
Oct 26 00:30:41 user nova-compute[75165]: No targets found.
Oct 26 00:30:41 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:30:41 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1207cd1-02d6-4e54-add0-07be38054f6a tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 00:30:41 user nova-compute[75165]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 00:30:41 user nova-compute[75165]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75165) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 00:30:41 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1207cd1-02d6-4e54-add0-07be38054f6a tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ff19ba88-2bf9-451f-afcc-e149c1578b95', 0)] {{(pid=75165) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 00:30:41 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:30:41 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:30:41 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[565fc12f-b885-486d-9866-37664fec2306]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ff19ba88-2bf9-451f-afcc-e149c1578b95\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:30:41 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:30:42 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:30:42 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6b1800d-4b86-44ba-b7e8-02b11e40553b]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff19ba88-2bf9-451f-afcc-e149c1578b95 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8 (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:30:42 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1207cd1-02d6-4e54-add0-07be38054f6a tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)
Oct 26 00:30:42 user nova-compute[75165]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff19ba88-2bf9-451f-afcc-e149c1578b95 (non-flash)
Oct 26 00:30:42 user nova-compute[75165]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0 (non-flash)
Oct 26 00:30:42 user nova-compute[75165]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7 (non-flash)
Oct 26 00:30:42 user nova-compute[75165]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8 (non-flash)
Oct 26 00:30:42 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:30:42 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1207cd1-02d6-4e54-add0-07be38054f6a tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)
Oct 26 00:30:42 user nova-compute[75165]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff19ba88-2bf9-451f-afcc-e149c1578b95 (non-flash)
Oct 26 00:30:42 user nova-compute[75165]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0 (non-flash)
Oct 26 00:30:42 user nova-compute[75165]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7 (non-flash)
Oct 26 00:30:42 user nova-compute[75165]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8 (non-flash)
Oct 26 00:30:42 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:30:42 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1207cd1-02d6-4e54-add0-07be38054f6a tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8c00137250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ff19ba88-2bf9-451f-afcc-e149c1578b95'): ({'sdd'}, set())}) {{(pid=75165) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 00:30:42 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-b1207cd1-02d6-4e54-add0-07be38054f6a tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Removing single pathed devices sdd {{(pid=75165) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 00:30:42 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:30:42 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:30:42 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[542dca84-86ad-4b6e-8d91-f1aa2d5471fe]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:30:42 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:30:42 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:30:42 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ca47ceb-1108-45e2-920c-e8b10c0e6eca]: (4, ('ok\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:30:42 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-b1207cd1-02d6-4e54-add0-07be38054f6a tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Flushing IO for device /dev/sdd {{(pid=75165) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 00:30:42 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:30:42 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:30:42 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[fefe4a1a-9768-42bc-b9ab-5a518d58918c]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:30:42 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-b1207cd1-02d6-4e54-add0-07be38054f6a tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75165) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 00:30:42 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:30:42 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.044s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:30:42 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[b768d2cf-d59e-4ec4-81d3-0e87be17040d]: (4, ('1', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:30:42 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-b1207cd1-02d6-4e54-add0-07be38054f6a tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75165) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 00:30:42 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-b1207cd1-02d6-4e54-add0-07be38054f6a tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] SCSI volumes sdd have been removed. {{(pid=75165) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 00:30:42 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1207cd1-02d6-4e54-add0-07be38054f6a tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ff19ba88-2bf9-451f-afcc-e149c1578b95')] {{(pid=75165) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 00:30:42 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff19ba88-2bf9-451f-afcc-e149c1578b95 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:30:42 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff19ba88-2bf9-451f-afcc-e149c1578b95 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.073s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:30:42 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d1209a8-c40c-4692-8641-53085e244ebe]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:30:42 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1207cd1-02d6-4e54-add0-07be38054f6a tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:30:42 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff19ba88-2bf9-451f-afcc-e149c1578b95 -p 172.16.0.220:3260 --logout {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:30:42 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff19ba88-2bf9-451f-afcc-e149c1578b95 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:30:42 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[6209ee4a-3960-4a7c-8bf4-9cfed5e062a0]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:ff19ba88-2bf9-451f-afcc-e149c1578b95, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:ff19ba88-2bf9-451f-afcc-e149c1578b95, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:30:42 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1207cd1-02d6-4e54-add0-07be38054f6a tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:ff19ba88-2bf9-451f-afcc-e149c1578b95, portal: 172.16.0.220,3260]
Oct 26 00:30:42 user nova-compute[75165]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:ff19ba88-2bf9-451f-afcc-e149c1578b95, portal: 172.16.0.220,3260] successful.
Oct 26 00:30:42 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:30:42 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff19ba88-2bf9-451f-afcc-e149c1578b95 -p 172.16.0.220:3260 --op delete {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:30:42 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff19ba88-2bf9-451f-afcc-e149c1578b95 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:30:42 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ada8107-2c4b-40a5-a6e5-f22bb602d513]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:30:42 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1207cd1-02d6-4e54-add0-07be38054f6a tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:30:42 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-b1207cd1-02d6-4e54-add0-07be38054f6a tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.383s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:30:42 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1207cd1-02d6-4e54-add0-07be38054f6a tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] <== disconnect_volume: return (384ms) None {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:30:42 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b1207cd1-02d6-4e54-add0-07be38054f6a tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] [instance: ce058b47-d96f-4341-9104-1fa71ca2c997] Disconnected iSCSI Volume {{(pid=75165) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 00:30:43 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05172142-7b5a-4c59-9a4a-d567e71543d1 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] [instance: bb77893d-263a-40a6-9acc-63fcd1481a38] Calling os-brick to attach iSCSI Volume {{(pid=75165) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 00:30:43 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-05172142-7b5a-4c59-9a4a-d567e71543d1 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8bf8160e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:20bc9a02-2908-4429-8524-fcc9553f3a29', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'antKmxGH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:30:43 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-05172142-7b5a-4c59-9a4a-d567e71543d1 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:30:43 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-05172142-7b5a-4c59-9a4a-d567e71543d1 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:30:43 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-05172142-7b5a-4c59-9a4a-d567e71543d1 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:30:43 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-05172142-7b5a-4c59-9a4a-d567e71543d1 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:30:43 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-05172142-7b5a-4c59-9a4a-d567e71543d1 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:20bc9a02-2908-4429-8524-fcc9553f3a29" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:30:43 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-05172142-7b5a-4c59-9a4a-d567e71543d1 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:20bc9a02-2908-4429-8524-fcc9553f3a29" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:30:43 user nova-compute[75165]: INFO os_brick.initiator.connectors.iscsi [None req-05172142-7b5a-4c59-9a4a-d567e71543d1 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 00:30:43 user nova-compute[75165]: DEBUG nova.objects.instance [None req-b1207cd1-02d6-4e54-add0-07be38054f6a tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Lazy-loading 'flavor' on Instance uuid ce058b47-d96f-4341-9104-1fa71ca2c997 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:30:43 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20bc9a02-2908-4429-8524-fcc9553f3a29 -p 172.16.0.220:3260 {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:30:43 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20bc9a02-2908-4429-8524-fcc9553f3a29 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:30:43 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[77314d2c-30cd-4577-a8f8-617f1d8652d9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:30:43 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-05172142-7b5a-4c59-9a4a-d567e71543d1 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 00:30:43 user nova-compute[75165]:  {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:30:43 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20bc9a02-2908-4429-8524-fcc9553f3a29 -p 172.16.0.220:3260 --interface default --op new {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:30:43 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20bc9a02-2908-4429-8524-fcc9553f3a29 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:30:43 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ca68976-b496-4ec3-9aa8-5782bfcb9e7f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:20bc9a02-2908-4429-8524-fcc9553f3a29] added\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:30:43 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-05172142-7b5a-4c59-9a4a-d567e71543d1 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:20bc9a02-2908-4429-8524-fcc9553f3a29] added
Oct 26 00:30:43 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:30:43 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-b1207cd1-02d6-4e54-add0-07be38054f6a tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Lock "ce058b47-d96f-4341-9104-1fa71ca2c997" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.870s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:30:43 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20bc9a02-2908-4429-8524-fcc9553f3a29 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:30:43 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20bc9a02-2908-4429-8524-fcc9553f3a29 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:30:43 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[b98ea9af-0dc9-4ad2-a795-081c3ad6d5f0]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:30:43 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-05172142-7b5a-4c59-9a4a-d567e71543d1 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:30:43 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20bc9a02-2908-4429-8524-fcc9553f3a29 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:30:43 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20bc9a02-2908-4429-8524-fcc9553f3a29 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:30:43 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c0f93d3-d61e-4a2c-9bc0-c8cc0fffbc8b]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:30:43 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-05172142-7b5a-4c59-9a4a-d567e71543d1 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:30:43 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20bc9a02-2908-4429-8524-fcc9553f3a29 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v antKmxGH {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:30:43 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20bc9a02-2908-4429-8524-fcc9553f3a29 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v antKmxGH" returned: 0 in 0.021s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:30:43 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae5fab2c-f735-4eb3-8ec0-78357222e230]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:30:43 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-05172142-7b5a-4c59-9a4a-d567e71543d1 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'antKmxGH'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:30:43 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20bc9a02-2908-4429-8524-fcc9553f3a29 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:30:43 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20bc9a02-2908-4429-8524-fcc9553f3a29 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:30:43 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae0bab3f-41ed-4069-8435-ea2ef1f4386f]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:30:43 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-05172142-7b5a-4c59-9a4a-d567e71543d1 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:30:43 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:30:43 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:30:43 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[f25d24bc-e0fc-4a19-b837-d15ded3c59e9]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8 (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:30:43 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-05172142-7b5a-4c59-9a4a-d567e71543d1 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)
Oct 26 00:30:43 user nova-compute[75165]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0 (non-flash)
Oct 26 00:30:43 user nova-compute[75165]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7 (non-flash)
Oct 26 00:30:43 user nova-compute[75165]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8 (non-flash)
Oct 26 00:30:43 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:30:43 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-05172142-7b5a-4c59-9a4a-d567e71543d1 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)
Oct 26 00:30:43 user nova-compute[75165]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0 (non-flash)
Oct 26 00:30:43 user nova-compute[75165]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7 (non-flash)
Oct 26 00:30:43 user nova-compute[75165]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8 (non-flash)
Oct 26 00:30:43 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:30:43 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20bc9a02-2908-4429-8524-fcc9553f3a29 -p 172.16.0.220:3260 --login {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:30:43 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20bc9a02-2908-4429-8524-fcc9553f3a29 -p 172.16.0.220:3260 --login" returned: 0 in 0.088s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:30:43 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[93307a0a-93ad-454e-b2e3-289943a8a8be]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:20bc9a02-2908-4429-8524-fcc9553f3a29, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:20bc9a02-2908-4429-8524-fcc9553f3a29, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:30:43 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-05172142-7b5a-4c59-9a4a-d567e71543d1 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:20bc9a02-2908-4429-8524-fcc9553f3a29, portal: 172.16.0.220,3260]
Oct 26 00:30:43 user nova-compute[75165]: Login to [iface: default, target: iqn.2010-10.org.openstack:20bc9a02-2908-4429-8524-fcc9553f3a29, portal: 172.16.0.220,3260] successful.
Oct 26 00:30:43 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:30:43 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20bc9a02-2908-4429-8524-fcc9553f3a29 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:30:43 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20bc9a02-2908-4429-8524-fcc9553f3a29 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:30:43 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[24e939c9-50a9-4d1e-bada-1292d1c129f2]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:30:43 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-05172142-7b5a-4c59-9a4a-d567e71543d1 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:30:43 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:30:43 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:30:43 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2b851c2-b108-41de-9488-d0d481e12a67]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20bc9a02-2908-4429-8524-fcc9553f3a29 (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:30:43 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-05172142-7b5a-4c59-9a4a-d567e71543d1 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)
Oct 26 00:30:43 user nova-compute[75165]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0 (non-flash)
Oct 26 00:30:43 user nova-compute[75165]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7 (non-flash)
Oct 26 00:30:43 user nova-compute[75165]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8 (non-flash)
Oct 26 00:30:43 user nova-compute[75165]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20bc9a02-2908-4429-8524-fcc9553f3a29 (non-flash)
Oct 26 00:30:43 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:30:43 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-05172142-7b5a-4c59-9a4a-d567e71543d1 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)
Oct 26 00:30:43 user nova-compute[75165]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0 (non-flash)
Oct 26 00:30:43 user nova-compute[75165]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7 (non-flash)
Oct 26 00:30:43 user nova-compute[75165]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8 (non-flash)
Oct 26 00:30:43 user nova-compute[75165]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20bc9a02-2908-4429-8524-fcc9553f3a29 (non-flash)
Oct 26 00:30:43 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:30:43 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-05172142-7b5a-4c59-9a4a-d567e71543d1 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:20bc9a02-2908-4429-8524-fcc9553f3a29" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.324s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:30:43 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-05172142-7b5a-4c59-9a4a-d567e71543d1 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Connected to 172.16.0.220:3260 {{(pid=75165) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 00:30:43 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-05172142-7b5a-4c59-9a4a-d567e71543d1 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] HCTL ('35', '-', '-', 0) found on session 36 with lun 0 {{(pid=75165) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 00:30:43 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-05172142-7b5a-4c59-9a4a-d567e71543d1 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75165) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 00:30:43 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:30:43 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:30:43 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[d25c2df7-ad52-46f3-b340-12de8ca73817]: (4, ('- - 0', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:30:43 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-05172142-7b5a-4c59-9a4a-d567e71543d1 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Searching for a device in session 36 and hctl ['35', '*', '*', 0] yield: None {{(pid=75165) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 00:30:43 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:30:44 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-05172142-7b5a-4c59-9a4a-d567e71543d1 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Searching for a device in session 36 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75165) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 00:30:44 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-05172142-7b5a-4c59-9a4a-d567e71543d1 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:20bc9a02-2908-4429-8524-fcc9553f3a29', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'antKmxGH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75165) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 00:30:44 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-05172142-7b5a-4c59-9a4a-d567e71543d1 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.354s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:30:44 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-05172142-7b5a-4c59-9a4a-d567e71543d1 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] <== connect_volume: return (1355ms) {'type': 'block', 'scsi_wwn': '23735396135633562', 'path': '/dev/sdd'} {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:30:44 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05172142-7b5a-4c59-9a4a-d567e71543d1 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] [instance: bb77893d-263a-40a6-9acc-63fcd1481a38] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23735396135633562', 'path': '/dev/sdd'} {{(pid=75165) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 00:30:44 user nova-compute[75165]: DEBUG nova.objects.instance [None req-05172142-7b5a-4c59-9a4a-d567e71543d1 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Lazy-loading 'flavor' on Instance uuid bb77893d-263a-40a6-9acc-63fcd1481a38 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:30:44 user nova-compute[75165]: DEBUG nova.virt.libvirt.guest [None req-05172142-7b5a-4c59-9a4a-d567e71543d1 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 00:30:44 user nova-compute[75165]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 00:30:44 user nova-compute[75165]:   <source dev="/dev/sdd"/>
Oct 26 00:30:44 user nova-compute[75165]:   <target dev="vdb" bus="virtio"/>
Oct 26 00:30:44 user nova-compute[75165]:   <serial>20bc9a02-2908-4429-8524-fcc9553f3a29</serial>
Oct 26 00:30:44 user nova-compute[75165]: </disk>
Oct 26 00:30:44 user nova-compute[75165]:  {{(pid=75165) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 00:30:44 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-05172142-7b5a-4c59-9a4a-d567e71543d1 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] No BDM found with device name vda, not building metadata. {{(pid=75165) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 00:30:44 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-05172142-7b5a-4c59-9a4a-d567e71543d1 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75165) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 00:30:44 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-05172142-7b5a-4c59-9a4a-d567e71543d1 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] No VIF found with MAC fa:16:3e:82:0a:f8, not building metadata {{(pid=75165) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 00:30:45 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-05172142-7b5a-4c59-9a4a-d567e71543d1 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Lock "bb77893d-263a-40a6-9acc-63fcd1481a38" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.504s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:30:46 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:30:47 user nova-compute[75165]: DEBUG nova.compute.manager [req-b96e1596-3964-4ee1-bce2-376ebeda2ba3 req-cff1b934-28f7-46f2-a217-d9b14bf725c8 service nova] [instance: 250afc24-0c38-4959-a77c-d51365dd1c4e] Received event network-changed-0372e87f-5631-4444-bfe8-ae5af9f09a46 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:30:47 user nova-compute[75165]: DEBUG nova.compute.manager [req-b96e1596-3964-4ee1-bce2-376ebeda2ba3 req-cff1b934-28f7-46f2-a217-d9b14bf725c8 service nova] [instance: 250afc24-0c38-4959-a77c-d51365dd1c4e] Refreshing instance network info cache due to event network-changed-0372e87f-5631-4444-bfe8-ae5af9f09a46. {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 00:30:47 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-b96e1596-3964-4ee1-bce2-376ebeda2ba3 req-cff1b934-28f7-46f2-a217-d9b14bf725c8 service nova] Acquiring lock "refresh_cache-250afc24-0c38-4959-a77c-d51365dd1c4e" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:30:47 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-b96e1596-3964-4ee1-bce2-376ebeda2ba3 req-cff1b934-28f7-46f2-a217-d9b14bf725c8 service nova] Acquired lock "refresh_cache-250afc24-0c38-4959-a77c-d51365dd1c4e" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:30:47 user nova-compute[75165]: DEBUG nova.network.neutron [req-b96e1596-3964-4ee1-bce2-376ebeda2ba3 req-cff1b934-28f7-46f2-a217-d9b14bf725c8 service nova] [instance: 250afc24-0c38-4959-a77c-d51365dd1c4e] Refreshing network info cache for port 0372e87f-5631-4444-bfe8-ae5af9f09a46 {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 00:30:47 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-61d01e17-716c-4e6c-aa5d-81f7709db1ca tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Acquiring lock "fe2984ce-8958-4049-8af7-496b313b26c8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:30:47 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-61d01e17-716c-4e6c-aa5d-81f7709db1ca tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Lock "fe2984ce-8958-4049-8af7-496b313b26c8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:30:47 user nova-compute[75165]: DEBUG nova.objects.instance [None req-61d01e17-716c-4e6c-aa5d-81f7709db1ca tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Lazy-loading 'flavor' on Instance uuid fe2984ce-8958-4049-8af7-496b313b26c8 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:30:47 user nova-compute[75165]: DEBUG nova.network.neutron [req-b96e1596-3964-4ee1-bce2-376ebeda2ba3 req-cff1b934-28f7-46f2-a217-d9b14bf725c8 service nova] [instance: 250afc24-0c38-4959-a77c-d51365dd1c4e] Updated VIF entry in instance network info cache for port 0372e87f-5631-4444-bfe8-ae5af9f09a46. {{(pid=75165) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 00:30:47 user nova-compute[75165]: DEBUG nova.network.neutron [req-b96e1596-3964-4ee1-bce2-376ebeda2ba3 req-cff1b934-28f7-46f2-a217-d9b14bf725c8 service nova] [instance: 250afc24-0c38-4959-a77c-d51365dd1c4e] Updating instance_info_cache with network_info: [{"id": "0372e87f-5631-4444-bfe8-ae5af9f09a46", "address": "fa:16:3e:76:de:bf", "network": {"id": "3fa5f12d-c7f4-4f2f-8934-6fa94f598a4c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1095967566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf09714f89484ff5ad700a5528b8d7c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0372e87f-56", "ovs_interfaceid": "0372e87f-5631-4444-bfe8-ae5af9f09a46", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:30:47 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-61d01e17-716c-4e6c-aa5d-81f7709db1ca tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Lock "fe2984ce-8958-4049-8af7-496b313b26c8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.079s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:30:48 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-b96e1596-3964-4ee1-bce2-376ebeda2ba3 req-cff1b934-28f7-46f2-a217-d9b14bf725c8 service nova] Releasing lock "refresh_cache-250afc24-0c38-4959-a77c-d51365dd1c4e" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:30:48 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-61d01e17-716c-4e6c-aa5d-81f7709db1ca tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Acquiring lock "fe2984ce-8958-4049-8af7-496b313b26c8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:30:48 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-61d01e17-716c-4e6c-aa5d-81f7709db1ca tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Lock "fe2984ce-8958-4049-8af7-496b313b26c8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:30:48 user nova-compute[75165]: INFO nova.compute.manager [None req-61d01e17-716c-4e6c-aa5d-81f7709db1ca tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] [instance: fe2984ce-8958-4049-8af7-496b313b26c8] Attaching volume 30a04133-0b10-40a8-8289-5538571ff1fd to /dev/vdb
Oct 26 00:30:48 user nova-compute[75165]: DEBUG os_brick.utils [None req-61d01e17-716c-4e6c-aa5d-81f7709db1ca tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:30:48 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:30:48 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:30:48 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[2454989e-6d6a-4c20-87c6-9fa3afe3a069]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa94814ccb35\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:30:48 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:30:48 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:30:48 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[a09c680a-34d7-4a9c-be85-aec427187b2e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:30:48 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:30:48 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.027s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:30:48 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a3b34e2-ecf0-40be-847f-4c5da2dcb9f4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:30:48 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5eaabd4-5fa4-4814-ba2c-c390d03806f7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:30:48 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-61d01e17-716c-4e6c-aa5d-81f7709db1ca tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Running cmd (subprocess): nvme version {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:30:48 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-61d01e17-716c-4e6c-aa5d-81f7709db1ca tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] 'nvme version' failed. Not Retrying. {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 00:30:48 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.nvmeof [None req-61d01e17-716c-4e6c-aa5d-81f7709db1ca tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] nvme not present on system {{(pid=75165) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 00:30:48 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:30:48 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 00:30:48 user nova-compute[75165]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 00:30:48 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6cbaa67-e28c-438f-b164-9c864603ca0b]: (4, '') {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:30:48 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-61d01e17-716c-4e6c-aa5d-81f7709db1ca tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75165) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 00:30:48 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-61d01e17-716c-4e6c-aa5d-81f7709db1ca tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75165) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 00:30:48 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-61d01e17-716c-4e6c-aa5d-81f7709db1ca tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] LIGHTOS: no hostnqn found. {{(pid=75165) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 00:30:48 user nova-compute[75165]: DEBUG os_brick.utils [None req-61d01e17-716c-4e6c-aa5d-81f7709db1ca tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] <== get_connector_properties: return (154ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa94814ccb35', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:30:48 user nova-compute[75165]: DEBUG nova.virt.block_device [None req-61d01e17-716c-4e6c-aa5d-81f7709db1ca tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] [instance: fe2984ce-8958-4049-8af7-496b313b26c8] Updating existing volume attachment record: b463404f-bf62-4038-a1e7-c6ebeceb3a6c {{(pid=75165) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 00:30:48 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:30:49 user nova-compute[75165]: INFO nova.compute.manager [None req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] [instance: 250afc24-0c38-4959-a77c-d51365dd1c4e] Rebuilding instance
Oct 26 00:30:49 user nova-compute[75165]: DEBUG nova.compute.manager [None req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] [instance: 250afc24-0c38-4959-a77c-d51365dd1c4e] Checking state {{(pid=75165) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 00:30:49 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:30:49 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:30:49 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:30:49 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:30:49 user nova-compute[75165]: DEBUG nova.compute.manager [req-a531ae4b-b207-4b79-a653-07851d9a9a14 req-f4282b87-0b96-4d78-93a0-1e8dc3a335cc service nova] [instance: 250afc24-0c38-4959-a77c-d51365dd1c4e] Received event network-vif-unplugged-0372e87f-5631-4444-bfe8-ae5af9f09a46 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:30:49 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-a531ae4b-b207-4b79-a653-07851d9a9a14 req-f4282b87-0b96-4d78-93a0-1e8dc3a335cc service nova] Acquiring lock "250afc24-0c38-4959-a77c-d51365dd1c4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:30:49 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-a531ae4b-b207-4b79-a653-07851d9a9a14 req-f4282b87-0b96-4d78-93a0-1e8dc3a335cc service nova] Lock "250afc24-0c38-4959-a77c-d51365dd1c4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:30:49 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-a531ae4b-b207-4b79-a653-07851d9a9a14 req-f4282b87-0b96-4d78-93a0-1e8dc3a335cc service nova] Lock "250afc24-0c38-4959-a77c-d51365dd1c4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:30:49 user nova-compute[75165]: DEBUG nova.compute.manager [req-a531ae4b-b207-4b79-a653-07851d9a9a14 req-f4282b87-0b96-4d78-93a0-1e8dc3a335cc service nova] [instance: 250afc24-0c38-4959-a77c-d51365dd1c4e] No waiting events found dispatching network-vif-unplugged-0372e87f-5631-4444-bfe8-ae5af9f09a46 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:30:49 user nova-compute[75165]: WARNING nova.compute.manager [req-a531ae4b-b207-4b79-a653-07851d9a9a14 req-f4282b87-0b96-4d78-93a0-1e8dc3a335cc service nova] [instance: 250afc24-0c38-4959-a77c-d51365dd1c4e] Received unexpected event network-vif-unplugged-0372e87f-5631-4444-bfe8-ae5af9f09a46 for instance with vm_state active and task_state rebuilding.
Oct 26 00:30:50 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: 250afc24-0c38-4959-a77c-d51365dd1c4e] Instance destroyed successfully.
Oct 26 00:30:50 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: 250afc24-0c38-4959-a77c-d51365dd1c4e] Instance destroyed successfully.
Oct 26 00:30:50 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:28:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1619637514',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1212881648',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFEgAg/Q1sMeId7lJYLOcThhEJxasXz49LMiw6Ps6oE3Fcs9iqtrJ+O72pBFxY/rgxlAUWtLD4fFFfgvtCEdgpuiC+rAwqWmjPE8j/TwqxmovOpzhEUnuTgmVOvLZYE6qw==',key_name='tempest-keypair-1823122855',keypairs=<?>,launch_index=0,launched_at=2023-10-26T00:29:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='cf09714f89484ff5ad700a5528b8d7c8',ramdisk_id='',reservation_id='r-e88bj6ps',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1175798990',owner_user_name='tempest-ServerActionsV293TestJSON-1175798990-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T00:30:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2c471e2bc8dc4e5f93dd321369821a99',uuid=250afc24-0c38-4959-a77c-d51365dd1c4e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0372e87f-5631-4444-bfe8-ae5af9f09a46", "address": "fa:16:3e:76:de:bf", "network": {"id": "3fa5f12d-c7f4-4f2f-8934-6fa94f598a4c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1095967566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf09714f89484ff5ad700a5528b8d7c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0372e87f-56", "ovs_interfaceid": "0372e87f-5631-4444-bfe8-ae5af9f09a46", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 00:30:50 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Converting VIF {"id": "0372e87f-5631-4444-bfe8-ae5af9f09a46", "address": "fa:16:3e:76:de:bf", "network": {"id": "3fa5f12d-c7f4-4f2f-8934-6fa94f598a4c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1095967566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf09714f89484ff5ad700a5528b8d7c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0372e87f-56", "ovs_interfaceid": "0372e87f-5631-4444-bfe8-ae5af9f09a46", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:30:50 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:76:de:bf,bridge_name='br-int',has_traffic_filtering=True,id=0372e87f-5631-4444-bfe8-ae5af9f09a46,network=Network(3fa5f12d-c7f4-4f2f-8934-6fa94f598a4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0372e87f-56') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:30:50 user nova-compute[75165]: DEBUG os_vif [None req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:76:de:bf,bridge_name='br-int',has_traffic_filtering=True,id=0372e87f-5631-4444-bfe8-ae5af9f09a46,network=Network(3fa5f12d-c7f4-4f2f-8934-6fa94f598a4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0372e87f-56') {{(pid=75165) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 00:30:50 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:30:50 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0372e87f-56, bridge=br-int, if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:30:50 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:30:50 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:30:50 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:30:50 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4d9286e0-2fc2-48f8-8c7a-28ee7c8e7730) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:30:50 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:30:50 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:30:50 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:30:50 user nova-compute[75165]: INFO os_vif [None req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:76:de:bf,bridge_name='br-int',has_traffic_filtering=True,id=0372e87f-5631-4444-bfe8-ae5af9f09a46,network=Network(3fa5f12d-c7f4-4f2f-8934-6fa94f598a4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0372e87f-56')
Oct 26 00:30:50 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] [instance: 250afc24-0c38-4959-a77c-d51365dd1c4e] calling os-brick to detach iSCSI Volume {{(pid=75165) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 00:30:50 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8bf8160e50>, {'target_iqn': 'iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OQmglCFc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:30:50 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 26 00:30:50 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:30:50 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:30:50 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:30:50 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:30:50 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[15240989-f4c9-46a0-9b4e-0fdc64bae2d3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:20bc9a02-2908-4429-8524-fcc9553f3a29\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:30:50 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 00:30:50 user nova-compute[75165]: No targets found.
Oct 26 00:30:50 user nova-compute[75165]: iSNS:
Oct 26 00:30:50 user nova-compute[75165]: No targets found.
Oct 26 00:30:50 user nova-compute[75165]: STATIC:
Oct 26 00:30:50 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:20bc9a02-2908-4429-8524-fcc9553f3a29
Oct 26 00:30:50 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:30:50 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:30:50 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8
Oct 26 00:30:50 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:30:50 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:30:50 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7
Oct 26 00:30:50 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:30:50 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:30:50 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795
Oct 26 00:30:50 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:30:50 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:30:50 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0
Oct 26 00:30:50 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:30:50 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:30:50 user nova-compute[75165]: FIRMWARE:
Oct 26 00:30:50 user nova-compute[75165]: No targets found.
Oct 26 00:30:50 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:30:50 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 00:30:50 user nova-compute[75165]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 00:30:50 user nova-compute[75165]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75165) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 00:30:50 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0', 0)] {{(pid=75165) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 00:30:50 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:30:50 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:30:50 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[14da0b4f-f3d0-46dd-8167-ddc61c6141fe]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20bc9a02-2908-4429-8524-fcc9553f3a29\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:30:50 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:30:50 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:30:50 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[7659ab0b-ad68-43c8-a3bf-9dd54ee6b38b]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20bc9a02-2908-4429-8524-fcc9553f3a29 (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:30:50 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)
Oct 26 00:30:50 user nova-compute[75165]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0 (non-flash)
Oct 26 00:30:50 user nova-compute[75165]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7 (non-flash)
Oct 26 00:30:50 user nova-compute[75165]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8 (non-flash)
Oct 26 00:30:50 user nova-compute[75165]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20bc9a02-2908-4429-8524-fcc9553f3a29 (non-flash)
Oct 26 00:30:50 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:30:50 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)
Oct 26 00:30:50 user nova-compute[75165]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0 (non-flash)
Oct 26 00:30:50 user nova-compute[75165]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7 (non-flash)
Oct 26 00:30:50 user nova-compute[75165]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8 (non-flash)
Oct 26 00:30:50 user nova-compute[75165]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20bc9a02-2908-4429-8524-fcc9553f3a29 (non-flash)
Oct 26 00:30:50 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:30:50 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8bf8266d40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0'): ({'sde'}, set())}) {{(pid=75165) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 00:30:50 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Removing single pathed devices sde {{(pid=75165) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 00:30:50 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:30:50 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:30:50 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ddb57ef-c029-4d63-814e-f98ec9835d9e]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:30:50 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:30:50 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:30:50 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[a80afa89-d475-4303-b83a-e96bbb6af16e]: (4, ('ok\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:30:50 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Flushing IO for device /dev/sde {{(pid=75165) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 00:30:50 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:30:50 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.017s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:30:50 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7467d72-c763-4aee-9d1b-976d5744a96e]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:30:50 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75165) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 00:30:50 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:30:50 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.068s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:30:50 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d8c06aa-e411-4dcb-bd94-b96d2c78c46b]: (4, ('1', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:30:50 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75165) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 00:30:50 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] SCSI volumes sde have been removed. {{(pid=75165) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 00:30:50 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0')] {{(pid=75165) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 00:30:50 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:30:50 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:30:50 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbed969f-b98f-47fc-bb9b-c7e4739a8181]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:30:50 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:30:50 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0 -p 172.16.0.220:3260 --logout {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:30:50 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:30:50 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[f68d7c5f-32fc-4a39-af50-721d1ce958a1]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:30:50 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0, portal: 172.16.0.220,3260]
Oct 26 00:30:50 user nova-compute[75165]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0, portal: 172.16.0.220,3260] successful.
Oct 26 00:30:50 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:30:50 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0 -p 172.16.0.220:3260 --op delete {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:30:50 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:30:50 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1716251-667f-4c23-b0b2-f1310e7a0409]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:30:50 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:30:50 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.406s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:30:50 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] <== disconnect_volume: return (408ms) None {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:30:50 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] [instance: 250afc24-0c38-4959-a77c-d51365dd1c4e] Disconnected iSCSI Volume {{(pid=75165) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 00:30:50 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] [instance: 250afc24-0c38-4959-a77c-d51365dd1c4e] Deleting instance files /opt/stack/data/nova/instances/250afc24-0c38-4959-a77c-d51365dd1c4e_del
Oct 26 00:30:50 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] [instance: 250afc24-0c38-4959-a77c-d51365dd1c4e] Deletion of /opt/stack/data/nova/instances/250afc24-0c38-4959-a77c-d51365dd1c4e_del complete
Oct 26 00:30:50 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] [instance: 250afc24-0c38-4959-a77c-d51365dd1c4e] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 250afc24-0c38-4959-a77c-d51365dd1c4e could not be found.
Oct 26 00:30:50 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] [instance: 250afc24-0c38-4959-a77c-d51365dd1c4e] calling os-brick to detach iSCSI Volume {{(pid=75165) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 00:30:50 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8bf8160e50>, {'target_iqn': 'iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OQmglCFc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:30:50 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 26 00:30:50 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:30:50 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:30:50 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:30:50 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:30:50 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d1521cc-7509-4f1e-9335-3415b4d42a17]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:20bc9a02-2908-4429-8524-fcc9553f3a29\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:30:50 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 00:30:50 user nova-compute[75165]: No targets found.
Oct 26 00:30:50 user nova-compute[75165]: iSNS:
Oct 26 00:30:50 user nova-compute[75165]: No targets found.
Oct 26 00:30:50 user nova-compute[75165]: STATIC:
Oct 26 00:30:50 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:20bc9a02-2908-4429-8524-fcc9553f3a29
Oct 26 00:30:50 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:30:50 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:30:50 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8
Oct 26 00:30:50 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:30:50 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:30:50 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7
Oct 26 00:30:50 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:30:50 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:30:50 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795
Oct 26 00:30:50 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:30:50 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:30:50 user nova-compute[75165]: FIRMWARE:
Oct 26 00:30:50 user nova-compute[75165]: No targets found.
Oct 26 00:30:50 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:30:50 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 00:30:50 user nova-compute[75165]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 00:30:50 user nova-compute[75165]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75165) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 00:30:50 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0', 0)] {{(pid=75165) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 00:30:50 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:30:50 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:30:50 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[505257b3-37f2-429a-aff2-9b51b400a32f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20bc9a02-2908-4429-8524-fcc9553f3a29\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:30:50 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:30:50 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:30:50 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[36b505b0-327d-4f33-8350-2928d4238568]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20bc9a02-2908-4429-8524-fcc9553f3a29 (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:30:50 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)
Oct 26 00:30:50 user nova-compute[75165]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7 (non-flash)
Oct 26 00:30:50 user nova-compute[75165]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8 (non-flash)
Oct 26 00:30:50 user nova-compute[75165]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20bc9a02-2908-4429-8524-fcc9553f3a29 (non-flash)
Oct 26 00:30:50 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:30:50 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)
Oct 26 00:30:50 user nova-compute[75165]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7 (non-flash)
Oct 26 00:30:50 user nova-compute[75165]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8 (non-flash)
Oct 26 00:30:50 user nova-compute[75165]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20bc9a02-2908-4429-8524-fcc9553f3a29 (non-flash)
Oct 26 00:30:50 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:30:50 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8be04f2d40>, {}) {{(pid=75165) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 00:30:50 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Disconnecting from: [] {{(pid=75165) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 00:30:50 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.077s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:30:50 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] <== disconnect_volume: return (77ms) None {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:30:50 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] [instance: 250afc24-0c38-4959-a77c-d51365dd1c4e] Disconnected iSCSI Volume {{(pid=75165) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 00:30:51 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:30:51 user nova-compute[75165]: DEBUG nova.compute.manager [req-d61d7dfb-7a97-4746-8dc1-1a6647acc189 req-6be01c91-ffe3-4051-80a8-6dad38d2770d service nova] [instance: 250afc24-0c38-4959-a77c-d51365dd1c4e] Received event network-vif-plugged-0372e87f-5631-4444-bfe8-ae5af9f09a46 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:30:51 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-d61d7dfb-7a97-4746-8dc1-1a6647acc189 req-6be01c91-ffe3-4051-80a8-6dad38d2770d service nova] Acquiring lock "250afc24-0c38-4959-a77c-d51365dd1c4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:30:51 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-d61d7dfb-7a97-4746-8dc1-1a6647acc189 req-6be01c91-ffe3-4051-80a8-6dad38d2770d service nova] Lock "250afc24-0c38-4959-a77c-d51365dd1c4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:30:51 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-d61d7dfb-7a97-4746-8dc1-1a6647acc189 req-6be01c91-ffe3-4051-80a8-6dad38d2770d service nova] Lock "250afc24-0c38-4959-a77c-d51365dd1c4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:30:51 user nova-compute[75165]: DEBUG nova.compute.manager [req-d61d7dfb-7a97-4746-8dc1-1a6647acc189 req-6be01c91-ffe3-4051-80a8-6dad38d2770d service nova] [instance: 250afc24-0c38-4959-a77c-d51365dd1c4e] No waiting events found dispatching network-vif-plugged-0372e87f-5631-4444-bfe8-ae5af9f09a46 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:30:51 user nova-compute[75165]: WARNING nova.compute.manager [req-d61d7dfb-7a97-4746-8dc1-1a6647acc189 req-6be01c91-ffe3-4051-80a8-6dad38d2770d service nova] [instance: 250afc24-0c38-4959-a77c-d51365dd1c4e] Received unexpected event network-vif-plugged-0372e87f-5631-4444-bfe8-ae5af9f09a46 for instance with vm_state active and task_state rebuilding.
Oct 26 00:30:51 user nova-compute[75165]: DEBUG nova.compute.manager [None req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] [instance: 250afc24-0c38-4959-a77c-d51365dd1c4e] Preparing to wait for external event volume-reimaged-af851e79-3073-4793-929f-877775c91de0 {{(pid=75165) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Oct 26 00:30:51 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Acquiring lock "250afc24-0c38-4959-a77c-d51365dd1c4e-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:30:51 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Lock "250afc24-0c38-4959-a77c-d51365dd1c4e-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:30:51 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Lock "250afc24-0c38-4959-a77c-d51365dd1c4e-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:30:55 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:30:56 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:31:00 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:31:01 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:31:05 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:31:06 user nova-compute[75165]: DEBUG nova.compute.manager [req-5656626b-f8dc-4f92-bb98-b931959168c6 req-d67a2436-f93a-4160-83fd-d1cbd21a84a8 service nova] [instance: c396d555-70cf-4642-a0a0-485760cdf3fa] Received event network-changed-500c8c79-cf9c-46ef-a5d1-273f387e410a {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:31:06 user nova-compute[75165]: DEBUG nova.compute.manager [req-5656626b-f8dc-4f92-bb98-b931959168c6 req-d67a2436-f93a-4160-83fd-d1cbd21a84a8 service nova] [instance: c396d555-70cf-4642-a0a0-485760cdf3fa] Refreshing instance network info cache due to event network-changed-500c8c79-cf9c-46ef-a5d1-273f387e410a. {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 00:31:06 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-5656626b-f8dc-4f92-bb98-b931959168c6 req-d67a2436-f93a-4160-83fd-d1cbd21a84a8 service nova] Acquiring lock "refresh_cache-c396d555-70cf-4642-a0a0-485760cdf3fa" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:31:06 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-5656626b-f8dc-4f92-bb98-b931959168c6 req-d67a2436-f93a-4160-83fd-d1cbd21a84a8 service nova] Acquired lock "refresh_cache-c396d555-70cf-4642-a0a0-485760cdf3fa" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:31:06 user nova-compute[75165]: DEBUG nova.network.neutron [req-5656626b-f8dc-4f92-bb98-b931959168c6 req-d67a2436-f93a-4160-83fd-d1cbd21a84a8 service nova] [instance: c396d555-70cf-4642-a0a0-485760cdf3fa] Refreshing network info cache for port 500c8c79-cf9c-46ef-a5d1-273f387e410a {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 00:31:06 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:31:07 user nova-compute[75165]: DEBUG nova.network.neutron [req-5656626b-f8dc-4f92-bb98-b931959168c6 req-d67a2436-f93a-4160-83fd-d1cbd21a84a8 service nova] [instance: c396d555-70cf-4642-a0a0-485760cdf3fa] Updated VIF entry in instance network info cache for port 500c8c79-cf9c-46ef-a5d1-273f387e410a. {{(pid=75165) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 00:31:07 user nova-compute[75165]: DEBUG nova.network.neutron [req-5656626b-f8dc-4f92-bb98-b931959168c6 req-d67a2436-f93a-4160-83fd-d1cbd21a84a8 service nova] [instance: c396d555-70cf-4642-a0a0-485760cdf3fa] Updating instance_info_cache with network_info: [{"id": "500c8c79-cf9c-46ef-a5d1-273f387e410a", "address": "fa:16:3e:89:15:98", "network": {"id": "7f96025b-485f-4ba3-9f45-708c09822ffa", "bridge": "br-int", "label": "tempest-TestShelveInstance-363925751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f000be4e226e4e3db3c0832bbf04cd29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap500c8c79-cf", "ovs_interfaceid": "500c8c79-cf9c-46ef-a5d1-273f387e410a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:31:07 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-5656626b-f8dc-4f92-bb98-b931959168c6 req-d67a2436-f93a-4160-83fd-d1cbd21a84a8 service nova] Releasing lock "refresh_cache-c396d555-70cf-4642-a0a0-485760cdf3fa" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:31:07 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-7c7f730d-a30a-4e3b-a824-a30012323872 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Acquiring lock "c396d555-70cf-4642-a0a0-485760cdf3fa" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:31:07 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-7c7f730d-a30a-4e3b-a824-a30012323872 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Lock "c396d555-70cf-4642-a0a0-485760cdf3fa" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:31:07 user nova-compute[75165]: INFO nova.compute.manager [None req-7c7f730d-a30a-4e3b-a824-a30012323872 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] [instance: c396d555-70cf-4642-a0a0-485760cdf3fa] Shelve offloading
Oct 26 00:31:07 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:31:07 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:31:07 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:31:07 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:31:07 user nova-compute[75165]: DEBUG nova.compute.manager [req-d60abbeb-c0dc-48c9-af73-f1a165bb1cc1 req-947e61c1-4bfe-43f7-bcfd-dc93a08f8aad service nova] [instance: c396d555-70cf-4642-a0a0-485760cdf3fa] Received event network-vif-unplugged-500c8c79-cf9c-46ef-a5d1-273f387e410a {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:31:07 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-d60abbeb-c0dc-48c9-af73-f1a165bb1cc1 req-947e61c1-4bfe-43f7-bcfd-dc93a08f8aad service nova] Acquiring lock "c396d555-70cf-4642-a0a0-485760cdf3fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:31:07 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-d60abbeb-c0dc-48c9-af73-f1a165bb1cc1 req-947e61c1-4bfe-43f7-bcfd-dc93a08f8aad service nova] Lock "c396d555-70cf-4642-a0a0-485760cdf3fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:31:07 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-d60abbeb-c0dc-48c9-af73-f1a165bb1cc1 req-947e61c1-4bfe-43f7-bcfd-dc93a08f8aad service nova] Lock "c396d555-70cf-4642-a0a0-485760cdf3fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:31:07 user nova-compute[75165]: DEBUG nova.compute.manager [req-d60abbeb-c0dc-48c9-af73-f1a165bb1cc1 req-947e61c1-4bfe-43f7-bcfd-dc93a08f8aad service nova] [instance: c396d555-70cf-4642-a0a0-485760cdf3fa] No waiting events found dispatching network-vif-unplugged-500c8c79-cf9c-46ef-a5d1-273f387e410a {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:31:07 user nova-compute[75165]: WARNING nova.compute.manager [req-d60abbeb-c0dc-48c9-af73-f1a165bb1cc1 req-947e61c1-4bfe-43f7-bcfd-dc93a08f8aad service nova] [instance: c396d555-70cf-4642-a0a0-485760cdf3fa] Received unexpected event network-vif-unplugged-500c8c79-cf9c-46ef-a5d1-273f387e410a for instance with vm_state active and task_state shelving.
Oct 26 00:31:07 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61d01e17-716c-4e6c-aa5d-81f7709db1ca tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] [instance: fe2984ce-8958-4049-8af7-496b313b26c8] Calling os-brick to attach iSCSI Volume {{(pid=75165) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 00:31:07 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-61d01e17-716c-4e6c-aa5d-81f7709db1ca tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8bf8160e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:30a04133-0b10-40a8-8289-5538571ff1fd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QunRMHiT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:31:07 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-61d01e17-716c-4e6c-aa5d-81f7709db1ca tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:31:07 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-61d01e17-716c-4e6c-aa5d-81f7709db1ca tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:31:07 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-61d01e17-716c-4e6c-aa5d-81f7709db1ca tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:31:07 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-61d01e17-716c-4e6c-aa5d-81f7709db1ca tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:31:07 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-61d01e17-716c-4e6c-aa5d-81f7709db1ca tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:30a04133-0b10-40a8-8289-5538571ff1fd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:31:07 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-61d01e17-716c-4e6c-aa5d-81f7709db1ca tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:30a04133-0b10-40a8-8289-5538571ff1fd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:31:07 user nova-compute[75165]: INFO os_brick.initiator.connectors.iscsi [None req-61d01e17-716c-4e6c-aa5d-81f7709db1ca tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 00:31:07 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30a04133-0b10-40a8-8289-5538571ff1fd -p 172.16.0.220:3260 {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:31:07 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30a04133-0b10-40a8-8289-5538571ff1fd -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:31:07 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[db95cee2-4c80-469f-92fb-76b320bd03c5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:31:07 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-61d01e17-716c-4e6c-aa5d-81f7709db1ca tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 00:31:07 user nova-compute[75165]:  {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:31:07 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30a04133-0b10-40a8-8289-5538571ff1fd -p 172.16.0.220:3260 --interface default --op new {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:31:07 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30a04133-0b10-40a8-8289-5538571ff1fd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:31:07 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[a38caed2-465a-4d50-b7cb-94a9390753ae]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:30a04133-0b10-40a8-8289-5538571ff1fd] added\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:31:07 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-61d01e17-716c-4e6c-aa5d-81f7709db1ca tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:30a04133-0b10-40a8-8289-5538571ff1fd] added
Oct 26 00:31:07 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:31:07 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30a04133-0b10-40a8-8289-5538571ff1fd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:31:07 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30a04133-0b10-40a8-8289-5538571ff1fd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:31:07 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[530aa1a1-4ec7-444a-835e-0a576153ffdb]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:31:07 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-61d01e17-716c-4e6c-aa5d-81f7709db1ca tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:31:07 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30a04133-0b10-40a8-8289-5538571ff1fd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:31:07 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30a04133-0b10-40a8-8289-5538571ff1fd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:31:07 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[2932f23b-5c82-4ea9-b21e-1a01639b99c0]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:31:07 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-61d01e17-716c-4e6c-aa5d-81f7709db1ca tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:31:07 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30a04133-0b10-40a8-8289-5538571ff1fd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QunRMHiT {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:31:07 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30a04133-0b10-40a8-8289-5538571ff1fd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QunRMHiT" returned: 0 in 0.020s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:31:07 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee919087-a5ad-401c-9b7f-9d752a099079]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:31:07 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-61d01e17-716c-4e6c-aa5d-81f7709db1ca tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QunRMHiT'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:31:07 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30a04133-0b10-40a8-8289-5538571ff1fd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:31:07 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30a04133-0b10-40a8-8289-5538571ff1fd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:31:07 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[f218e8b8-5976-4c14-9323-91a9e6f7d53c]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:31:07 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-61d01e17-716c-4e6c-aa5d-81f7709db1ca tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:31:07 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:31:07 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:31:07 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2c75f14-6094-4a83-a743-06ab613e329f]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20bc9a02-2908-4429-8524-fcc9553f3a29 (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:31:07 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-61d01e17-716c-4e6c-aa5d-81f7709db1ca tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)
Oct 26 00:31:07 user nova-compute[75165]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7 (non-flash)
Oct 26 00:31:07 user nova-compute[75165]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8 (non-flash)
Oct 26 00:31:07 user nova-compute[75165]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20bc9a02-2908-4429-8524-fcc9553f3a29 (non-flash)
Oct 26 00:31:07 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:31:07 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-61d01e17-716c-4e6c-aa5d-81f7709db1ca tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)
Oct 26 00:31:07 user nova-compute[75165]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7 (non-flash)
Oct 26 00:31:07 user nova-compute[75165]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8 (non-flash)
Oct 26 00:31:07 user nova-compute[75165]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20bc9a02-2908-4429-8524-fcc9553f3a29 (non-flash)
Oct 26 00:31:07 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:31:07 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30a04133-0b10-40a8-8289-5538571ff1fd -p 172.16.0.220:3260 --login {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:31:08 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30a04133-0b10-40a8-8289-5538571ff1fd -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:31:08 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d97a30e-7470-48a4-b130-d21e065e6c8b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:30a04133-0b10-40a8-8289-5538571ff1fd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:30a04133-0b10-40a8-8289-5538571ff1fd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:31:08 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-61d01e17-716c-4e6c-aa5d-81f7709db1ca tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:30a04133-0b10-40a8-8289-5538571ff1fd, portal: 172.16.0.220,3260]
Oct 26 00:31:08 user nova-compute[75165]: Login to [iface: default, target: iqn.2010-10.org.openstack:30a04133-0b10-40a8-8289-5538571ff1fd, portal: 172.16.0.220,3260] successful.
Oct 26 00:31:08 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:31:08 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: c396d555-70cf-4642-a0a0-485760cdf3fa] Instance destroyed successfully.
Oct 26 00:31:08 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30a04133-0b10-40a8-8289-5538571ff1fd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:31:08 user nova-compute[75165]: DEBUG nova.compute.manager [None req-7c7f730d-a30a-4e3b-a824-a30012323872 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] [instance: c396d555-70cf-4642-a0a0-485760cdf3fa] Checking state {{(pid=75165) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 00:31:08 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-7c7f730d-a30a-4e3b-a824-a30012323872 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Acquiring lock "refresh_cache-c396d555-70cf-4642-a0a0-485760cdf3fa" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:31:08 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-7c7f730d-a30a-4e3b-a824-a30012323872 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Acquired lock "refresh_cache-c396d555-70cf-4642-a0a0-485760cdf3fa" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:31:08 user nova-compute[75165]: DEBUG nova.network.neutron [None req-7c7f730d-a30a-4e3b-a824-a30012323872 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] [instance: c396d555-70cf-4642-a0a0-485760cdf3fa] Building network info cache for instance {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 00:31:08 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30a04133-0b10-40a8-8289-5538571ff1fd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:31:08 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[645aa314-e8af-4753-a0dd-c16a2a116783]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:31:08 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-61d01e17-716c-4e6c-aa5d-81f7709db1ca tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:31:08 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:31:08 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:31:08 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8379078-f403-47ce-ae45-36896b747f0a]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20bc9a02-2908-4429-8524-fcc9553f3a29 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30a04133-0b10-40a8-8289-5538571ff1fd (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:31:08 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-61d01e17-716c-4e6c-aa5d-81f7709db1ca tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)
Oct 26 00:31:08 user nova-compute[75165]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7 (non-flash)
Oct 26 00:31:08 user nova-compute[75165]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8 (non-flash)
Oct 26 00:31:08 user nova-compute[75165]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20bc9a02-2908-4429-8524-fcc9553f3a29 (non-flash)
Oct 26 00:31:08 user nova-compute[75165]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30a04133-0b10-40a8-8289-5538571ff1fd (non-flash)
Oct 26 00:31:08 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:31:08 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-61d01e17-716c-4e6c-aa5d-81f7709db1ca tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)
Oct 26 00:31:08 user nova-compute[75165]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7 (non-flash)
Oct 26 00:31:08 user nova-compute[75165]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8 (non-flash)
Oct 26 00:31:08 user nova-compute[75165]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20bc9a02-2908-4429-8524-fcc9553f3a29 (non-flash)
Oct 26 00:31:08 user nova-compute[75165]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30a04133-0b10-40a8-8289-5538571ff1fd (non-flash)
Oct 26 00:31:08 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:31:08 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-61d01e17-716c-4e6c-aa5d-81f7709db1ca tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:30a04133-0b10-40a8-8289-5538571ff1fd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.304s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:31:08 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-61d01e17-716c-4e6c-aa5d-81f7709db1ca tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Connected to 172.16.0.220:3260 {{(pid=75165) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 00:31:08 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-61d01e17-716c-4e6c-aa5d-81f7709db1ca tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] HCTL ('36', '-', '-', 0) found on session 37 with lun 0 {{(pid=75165) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 00:31:08 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-61d01e17-716c-4e6c-aa5d-81f7709db1ca tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75165) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 00:31:08 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:31:08 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:31:08 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[410cb249-f3a2-4680-bb99-d57909151038]: (4, ('- - 0', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:31:08 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-61d01e17-716c-4e6c-aa5d-81f7709db1ca tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Searching for a device in session 37 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75165) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 00:31:08 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-61d01e17-716c-4e6c-aa5d-81f7709db1ca tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:30a04133-0b10-40a8-8289-5538571ff1fd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QunRMHiT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75165) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 00:31:08 user nova-compute[75165]: DEBUG nova.network.neutron [None req-7c7f730d-a30a-4e3b-a824-a30012323872 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] [instance: c396d555-70cf-4642-a0a0-485760cdf3fa] Updating instance_info_cache with network_info: [{"id": "500c8c79-cf9c-46ef-a5d1-273f387e410a", "address": "fa:16:3e:89:15:98", "network": {"id": "7f96025b-485f-4ba3-9f45-708c09822ffa", "bridge": "br-int", "label": "tempest-TestShelveInstance-363925751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f000be4e226e4e3db3c0832bbf04cd29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap500c8c79-cf", "ovs_interfaceid": "500c8c79-cf9c-46ef-a5d1-273f387e410a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:31:08 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-7c7f730d-a30a-4e3b-a824-a30012323872 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Releasing lock "refresh_cache-c396d555-70cf-4642-a0a0-485760cdf3fa" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:31:09 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-61d01e17-716c-4e6c-aa5d-81f7709db1ca tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.347s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:31:09 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-61d01e17-716c-4e6c-aa5d-81f7709db1ca tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] <== connect_volume: return (1350ms) {'type': 'block', 'scsi_wwn': '23632383864366630', 'path': '/dev/sde'} {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:31:09 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61d01e17-716c-4e6c-aa5d-81f7709db1ca tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] [instance: fe2984ce-8958-4049-8af7-496b313b26c8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23632383864366630', 'path': '/dev/sde'} {{(pid=75165) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 00:31:09 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:31:09 user nova-compute[75165]: DEBUG nova.objects.instance [None req-61d01e17-716c-4e6c-aa5d-81f7709db1ca tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Lazy-loading 'flavor' on Instance uuid fe2984ce-8958-4049-8af7-496b313b26c8 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:31:09 user nova-compute[75165]: DEBUG nova.virt.libvirt.guest [None req-61d01e17-716c-4e6c-aa5d-81f7709db1ca tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 00:31:09 user nova-compute[75165]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 00:31:09 user nova-compute[75165]:   <source dev="/dev/sde"/>
Oct 26 00:31:09 user nova-compute[75165]:   <target dev="vdb" bus="virtio"/>
Oct 26 00:31:09 user nova-compute[75165]:   <serial>30a04133-0b10-40a8-8289-5538571ff1fd</serial>
Oct 26 00:31:09 user nova-compute[75165]: </disk>
Oct 26 00:31:09 user nova-compute[75165]:  {{(pid=75165) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 00:31:09 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: c396d555-70cf-4642-a0a0-485760cdf3fa] Instance destroyed successfully.
Oct 26 00:31:09 user nova-compute[75165]: DEBUG nova.objects.instance [None req-7c7f730d-a30a-4e3b-a824-a30012323872 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Lazy-loading 'resources' on Instance uuid c396d555-70cf-4642-a0a0-485760cdf3fa {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:31:09 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-7c7f730d-a30a-4e3b-a824-a30012323872 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:29:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1147251319',display_name='tempest-TestShelveInstance-server-1147251319',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1147251319',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI1GphBq+tk5lRmbelpBK0KpqDkFZnosMfdxY4BqIo+7ZOlBcMsm+STwRow/vl0wWn7mhh5tvgBHLuRaIRxMFlso5lFS/bf8FEG/Q81BXIGG9aV/g3SgBEoP3RMfJ8OM0g==',key_name='tempest-TestShelveInstance-2132263804',keypairs=<?>,launch_index=0,launched_at=2023-10-26T00:29:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f000be4e226e4e3db3c0832bbf04cd29',ramdisk_id='',reservation_id='r-sg6zubxf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-323693311',owner_user_name='tempest-TestShelveInstance-323693311-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T00:29:40Z,user_data=None,user_id='2aa1bebf8931436d80d792651953a57b',uuid=c396d555-70cf-4642-a0a0-485760cdf3fa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "500c8c79-cf9c-46ef-a5d1-273f387e410a", "address": "fa:16:3e:89:15:98", "network": {"id": "7f96025b-485f-4ba3-9f45-708c09822ffa", "bridge": "br-int", "label": "tempest-TestShelveInstance-363925751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f000be4e226e4e3db3c0832bbf04cd29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap500c8c79-cf", "ovs_interfaceid": "500c8c79-cf9c-46ef-a5d1-273f387e410a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 00:31:09 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-7c7f730d-a30a-4e3b-a824-a30012323872 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Converting VIF {"id": "500c8c79-cf9c-46ef-a5d1-273f387e410a", "address": "fa:16:3e:89:15:98", "network": {"id": "7f96025b-485f-4ba3-9f45-708c09822ffa", "bridge": "br-int", "label": "tempest-TestShelveInstance-363925751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f000be4e226e4e3db3c0832bbf04cd29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap500c8c79-cf", "ovs_interfaceid": "500c8c79-cf9c-46ef-a5d1-273f387e410a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:31:09 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-7c7f730d-a30a-4e3b-a824-a30012323872 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:15:98,bridge_name='br-int',has_traffic_filtering=True,id=500c8c79-cf9c-46ef-a5d1-273f387e410a,network=Network(7f96025b-485f-4ba3-9f45-708c09822ffa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap500c8c79-cf') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:31:09 user nova-compute[75165]: DEBUG os_vif [None req-7c7f730d-a30a-4e3b-a824-a30012323872 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:15:98,bridge_name='br-int',has_traffic_filtering=True,id=500c8c79-cf9c-46ef-a5d1-273f387e410a,network=Network(7f96025b-485f-4ba3-9f45-708c09822ffa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap500c8c79-cf') {{(pid=75165) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 00:31:09 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:31:09 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap500c8c79-cf, bridge=br-int, if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:31:09 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:31:09 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:31:09 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:31:09 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2b3df231-7d38-4dd5-8b7e-359595c06173) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:31:09 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:31:09 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:31:09 user nova-compute[75165]: DEBUG nova.compute.manager [req-292aadb3-6e2e-49bd-8b77-3038722c8eed req-b5757ae1-c064-4810-99dc-01b5037f7179 service nova] [instance: c396d555-70cf-4642-a0a0-485760cdf3fa] Received event network-changed-500c8c79-cf9c-46ef-a5d1-273f387e410a {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:31:09 user nova-compute[75165]: DEBUG nova.compute.manager [req-292aadb3-6e2e-49bd-8b77-3038722c8eed req-b5757ae1-c064-4810-99dc-01b5037f7179 service nova] [instance: c396d555-70cf-4642-a0a0-485760cdf3fa] Refreshing instance network info cache due to event network-changed-500c8c79-cf9c-46ef-a5d1-273f387e410a. {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 00:31:09 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-292aadb3-6e2e-49bd-8b77-3038722c8eed req-b5757ae1-c064-4810-99dc-01b5037f7179 service nova] Acquiring lock "refresh_cache-c396d555-70cf-4642-a0a0-485760cdf3fa" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:31:09 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-292aadb3-6e2e-49bd-8b77-3038722c8eed req-b5757ae1-c064-4810-99dc-01b5037f7179 service nova] Acquired lock "refresh_cache-c396d555-70cf-4642-a0a0-485760cdf3fa" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:31:09 user nova-compute[75165]: DEBUG nova.network.neutron [req-292aadb3-6e2e-49bd-8b77-3038722c8eed req-b5757ae1-c064-4810-99dc-01b5037f7179 service nova] [instance: c396d555-70cf-4642-a0a0-485760cdf3fa] Refreshing network info cache for port 500c8c79-cf9c-46ef-a5d1-273f387e410a {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 00:31:09 user nova-compute[75165]: INFO os_vif [None req-7c7f730d-a30a-4e3b-a824-a30012323872 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:15:98,bridge_name='br-int',has_traffic_filtering=True,id=500c8c79-cf9c-46ef-a5d1-273f387e410a,network=Network(7f96025b-485f-4ba3-9f45-708c09822ffa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap500c8c79-cf')
Oct 26 00:31:09 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c7f730d-a30a-4e3b-a824-a30012323872 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] [instance: c396d555-70cf-4642-a0a0-485760cdf3fa] calling os-brick to detach iSCSI Volume {{(pid=75165) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 00:31:09 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c7f730d-a30a-4e3b-a824-a30012323872 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8bf8160e50>, {'target_iqn': 'iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LIXPagZW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:31:09 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-7c7f730d-a30a-4e3b-a824-a30012323872 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:31:09 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-7c7f730d-a30a-4e3b-a824-a30012323872 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:31:09 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-7c7f730d-a30a-4e3b-a824-a30012323872 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:31:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:31:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:31:09 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[70bbc4e1-0ce0-4781-aef1-8b07d2d1da91]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:30a04133-0b10-40a8-8289-5538571ff1fd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:20bc9a02-2908-4429-8524-fcc9553f3a29\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:31:09 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c7f730d-a30a-4e3b-a824-a30012323872 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 00:31:09 user nova-compute[75165]: No targets found.
Oct 26 00:31:09 user nova-compute[75165]: iSNS:
Oct 26 00:31:09 user nova-compute[75165]: No targets found.
Oct 26 00:31:09 user nova-compute[75165]: STATIC:
Oct 26 00:31:09 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:30a04133-0b10-40a8-8289-5538571ff1fd
Oct 26 00:31:09 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:31:09 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:31:09 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:20bc9a02-2908-4429-8524-fcc9553f3a29
Oct 26 00:31:09 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:31:09 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:31:09 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8
Oct 26 00:31:09 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:31:09 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:31:09 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7
Oct 26 00:31:09 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:31:09 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:31:09 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795
Oct 26 00:31:09 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:31:09 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:31:09 user nova-compute[75165]: FIRMWARE:
Oct 26 00:31:09 user nova-compute[75165]: No targets found.
Oct 26 00:31:09 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:31:09 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c7f730d-a30a-4e3b-a824-a30012323872 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 00:31:09 user nova-compute[75165]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 00:31:09 user nova-compute[75165]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75165) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 00:31:09 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c7f730d-a30a-4e3b-a824-a30012323872 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7', 0)] {{(pid=75165) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 00:31:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:31:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:31:09 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[8380b825-c28e-4f2a-8766-39ad25191e94]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20bc9a02-2908-4429-8524-fcc9553f3a29\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:30a04133-0b10-40a8-8289-5538571ff1fd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:31:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:31:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:31:09 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[872f447f-aa68-41db-9e65-17cce3dbfa57]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20bc9a02-2908-4429-8524-fcc9553f3a29 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30a04133-0b10-40a8-8289-5538571ff1fd (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:31:09 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c7f730d-a30a-4e3b-a824-a30012323872 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)
Oct 26 00:31:09 user nova-compute[75165]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7 (non-flash)
Oct 26 00:31:09 user nova-compute[75165]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8 (non-flash)
Oct 26 00:31:09 user nova-compute[75165]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20bc9a02-2908-4429-8524-fcc9553f3a29 (non-flash)
Oct 26 00:31:09 user nova-compute[75165]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30a04133-0b10-40a8-8289-5538571ff1fd (non-flash)
Oct 26 00:31:09 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:31:09 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c7f730d-a30a-4e3b-a824-a30012323872 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)
Oct 26 00:31:09 user nova-compute[75165]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7 (non-flash)
Oct 26 00:31:09 user nova-compute[75165]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8 (non-flash)
Oct 26 00:31:09 user nova-compute[75165]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20bc9a02-2908-4429-8524-fcc9553f3a29 (non-flash)
Oct 26 00:31:09 user nova-compute[75165]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30a04133-0b10-40a8-8289-5538571ff1fd (non-flash)
Oct 26 00:31:09 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:31:09 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c7f730d-a30a-4e3b-a824-a30012323872 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8c001ef250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7'): ({'sdf'}, set())}) {{(pid=75165) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 00:31:09 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-7c7f730d-a30a-4e3b-a824-a30012323872 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Removing single pathed devices sdf {{(pid=75165) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 00:31:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:31:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:31:09 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[db885ed6-3e79-4755-bc91-443bd7ec6844]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:31:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:31:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.025s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:31:09 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb083463-34f7-481c-8d96-92275b94eef0]: (4, ('ok\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:31:09 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-7c7f730d-a30a-4e3b-a824-a30012323872 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Flushing IO for device /dev/sdf {{(pid=75165) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 00:31:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:31:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:31:09 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[470f56a0-41f1-4b9d-bf69-3be3867f5f0a]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:31:09 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-7c7f730d-a30a-4e3b-a824-a30012323872 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75165) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 00:31:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:31:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.040s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:31:09 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fc4b120-6b7d-407e-a958-94b464ccb964]: (4, ('1', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:31:09 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-7c7f730d-a30a-4e3b-a824-a30012323872 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75165) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 00:31:09 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-7c7f730d-a30a-4e3b-a824-a30012323872 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] SCSI volumes sdf have been removed. {{(pid=75165) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 00:31:09 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c7f730d-a30a-4e3b-a824-a30012323872 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7')] {{(pid=75165) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 00:31:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:31:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:31:09 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[505c1a38-2b50-4210-a933-b7506e8a0366]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:31:09 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c7f730d-a30a-4e3b-a824-a30012323872 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:31:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7 -p 172.16.0.220:3260 --logout {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:31:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:31:09 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d5ea2a5-026e-4b0a-ada2-5de4ad994eb6]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:31:09 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c7f730d-a30a-4e3b-a824-a30012323872 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7, portal: 172.16.0.220,3260]
Oct 26 00:31:09 user nova-compute[75165]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7, portal: 172.16.0.220,3260] successful.
Oct 26 00:31:09 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:31:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7 -p 172.16.0.220:3260 --op delete {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:31:09 user nova-compute[75165]: DEBUG nova.compute.manager [req-1d820089-4f7d-4a48-9e9a-4cbad984132f req-e16edc07-d439-4433-83a1-531a97edc9a9 service nova] [instance: c396d555-70cf-4642-a0a0-485760cdf3fa] Received event network-vif-plugged-500c8c79-cf9c-46ef-a5d1-273f387e410a {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:31:09 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-1d820089-4f7d-4a48-9e9a-4cbad984132f req-e16edc07-d439-4433-83a1-531a97edc9a9 service nova] Acquiring lock "c396d555-70cf-4642-a0a0-485760cdf3fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:31:09 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-1d820089-4f7d-4a48-9e9a-4cbad984132f req-e16edc07-d439-4433-83a1-531a97edc9a9 service nova] Lock "c396d555-70cf-4642-a0a0-485760cdf3fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:31:09 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-1d820089-4f7d-4a48-9e9a-4cbad984132f req-e16edc07-d439-4433-83a1-531a97edc9a9 service nova] Lock "c396d555-70cf-4642-a0a0-485760cdf3fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:31:09 user nova-compute[75165]: DEBUG nova.compute.manager [req-1d820089-4f7d-4a48-9e9a-4cbad984132f req-e16edc07-d439-4433-83a1-531a97edc9a9 service nova] [instance: c396d555-70cf-4642-a0a0-485760cdf3fa] No waiting events found dispatching network-vif-plugged-500c8c79-cf9c-46ef-a5d1-273f387e410a {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:31:09 user nova-compute[75165]: WARNING nova.compute.manager [req-1d820089-4f7d-4a48-9e9a-4cbad984132f req-e16edc07-d439-4433-83a1-531a97edc9a9 service nova] [instance: c396d555-70cf-4642-a0a0-485760cdf3fa] Received unexpected event network-vif-plugged-500c8c79-cf9c-46ef-a5d1-273f387e410a for instance with vm_state active and task_state shelving.
Oct 26 00:31:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:31:09 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[b619dfd9-b385-4a22-9885-46ba54852610]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:31:09 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c7f730d-a30a-4e3b-a824-a30012323872 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:31:09 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-7c7f730d-a30a-4e3b-a824-a30012323872 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.348s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:31:09 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c7f730d-a30a-4e3b-a824-a30012323872 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] <== disconnect_volume: return (350ms) None {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:31:09 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c7f730d-a30a-4e3b-a824-a30012323872 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] [instance: c396d555-70cf-4642-a0a0-485760cdf3fa] Disconnected iSCSI Volume {{(pid=75165) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 00:31:09 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-7c7f730d-a30a-4e3b-a824-a30012323872 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] [instance: c396d555-70cf-4642-a0a0-485760cdf3fa] Deleting instance files /opt/stack/data/nova/instances/c396d555-70cf-4642-a0a0-485760cdf3fa_del
Oct 26 00:31:09 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-7c7f730d-a30a-4e3b-a824-a30012323872 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] [instance: c396d555-70cf-4642-a0a0-485760cdf3fa] Deletion of /opt/stack/data/nova/instances/c396d555-70cf-4642-a0a0-485760cdf3fa_del complete
Oct 26 00:31:09 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-61d01e17-716c-4e6c-aa5d-81f7709db1ca tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] No BDM found with device name vda, not building metadata. {{(pid=75165) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 00:31:09 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-61d01e17-716c-4e6c-aa5d-81f7709db1ca tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75165) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 00:31:09 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-61d01e17-716c-4e6c-aa5d-81f7709db1ca tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] No VIF found with MAC fa:16:3e:ca:36:c4, not building metadata {{(pid=75165) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 00:31:09 user nova-compute[75165]: DEBUG nova.network.neutron [req-292aadb3-6e2e-49bd-8b77-3038722c8eed req-b5757ae1-c064-4810-99dc-01b5037f7179 service nova] [instance: c396d555-70cf-4642-a0a0-485760cdf3fa] Updated VIF entry in instance network info cache for port 500c8c79-cf9c-46ef-a5d1-273f387e410a. {{(pid=75165) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 00:31:09 user nova-compute[75165]: DEBUG nova.network.neutron [req-292aadb3-6e2e-49bd-8b77-3038722c8eed req-b5757ae1-c064-4810-99dc-01b5037f7179 service nova] [instance: c396d555-70cf-4642-a0a0-485760cdf3fa] Updating instance_info_cache with network_info: [{"id": "500c8c79-cf9c-46ef-a5d1-273f387e410a", "address": "fa:16:3e:89:15:98", "network": {"id": "7f96025b-485f-4ba3-9f45-708c09822ffa", "bridge": null, "label": "tempest-TestShelveInstance-363925751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f000be4e226e4e3db3c0832bbf04cd29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap500c8c79-cf", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:31:09 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-292aadb3-6e2e-49bd-8b77-3038722c8eed req-b5757ae1-c064-4810-99dc-01b5037f7179 service nova] Releasing lock "refresh_cache-c396d555-70cf-4642-a0a0-485760cdf3fa" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:31:09 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-61d01e17-716c-4e6c-aa5d-81f7709db1ca tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Lock "fe2984ce-8958-4049-8af7-496b313b26c8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.592s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:31:10 user nova-compute[75165]: INFO nova.scheduler.client.report [None req-7c7f730d-a30a-4e3b-a824-a30012323872 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Deleted allocations for instance c396d555-70cf-4642-a0a0-485760cdf3fa
Oct 26 00:31:10 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-7c7f730d-a30a-4e3b-a824-a30012323872 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:31:10 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-7c7f730d-a30a-4e3b-a824-a30012323872 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:31:10 user nova-compute[75165]: DEBUG nova.objects.instance [None req-7c7f730d-a30a-4e3b-a824-a30012323872 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Lazy-loading 'numa_topology' on Instance uuid c396d555-70cf-4642-a0a0-485760cdf3fa {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:31:10 user nova-compute[75165]: DEBUG nova.objects.base [None req-7c7f730d-a30a-4e3b-a824-a30012323872 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Object Instance<c396d555-70cf-4642-a0a0-485760cdf3fa> lazy-loaded attributes: resources,numa_topology {{(pid=75165) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 00:31:11 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-7c7f730d-a30a-4e3b-a824-a30012323872 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:31:11 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-7c7f730d-a30a-4e3b-a824-a30012323872 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:31:11 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-7c7f730d-a30a-4e3b-a824-a30012323872 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.316s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:31:11 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-7c7f730d-a30a-4e3b-a824-a30012323872 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Lock "c396d555-70cf-4642-a0a0-485760cdf3fa" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 4.018s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:31:11 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:31:11 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-38c1827c-7972-4cd3-a5d0-c38280c37ba3 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Acquiring lock "ce058b47-d96f-4341-9104-1fa71ca2c997" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:31:11 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-38c1827c-7972-4cd3-a5d0-c38280c37ba3 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Lock "ce058b47-d96f-4341-9104-1fa71ca2c997" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:31:11 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-38c1827c-7972-4cd3-a5d0-c38280c37ba3 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Acquiring lock "ce058b47-d96f-4341-9104-1fa71ca2c997-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:31:11 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-38c1827c-7972-4cd3-a5d0-c38280c37ba3 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Lock "ce058b47-d96f-4341-9104-1fa71ca2c997-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:31:11 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-38c1827c-7972-4cd3-a5d0-c38280c37ba3 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Lock "ce058b47-d96f-4341-9104-1fa71ca2c997-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:31:11 user nova-compute[75165]: INFO nova.compute.manager [None req-38c1827c-7972-4cd3-a5d0-c38280c37ba3 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] [instance: ce058b47-d96f-4341-9104-1fa71ca2c997] Terminating instance
Oct 26 00:31:11 user nova-compute[75165]: DEBUG nova.compute.manager [None req-38c1827c-7972-4cd3-a5d0-c38280c37ba3 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] [instance: ce058b47-d96f-4341-9104-1fa71ca2c997] Start destroying the instance on the hypervisor. {{(pid=75165) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 00:31:11 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:31:11 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:31:11 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:31:11 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:31:12 user nova-compute[75165]: DEBUG nova.compute.manager [req-3a93a5b6-88eb-435b-963d-e87c9497e8b7 req-1dfdbaca-2e26-4e3a-a375-6694c1039c69 service nova] [instance: ce058b47-d96f-4341-9104-1fa71ca2c997] Received event network-vif-unplugged-7df0d91d-ff60-4008-823f-f951cbf505d3 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:31:12 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-3a93a5b6-88eb-435b-963d-e87c9497e8b7 req-1dfdbaca-2e26-4e3a-a375-6694c1039c69 service nova] Acquiring lock "ce058b47-d96f-4341-9104-1fa71ca2c997-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:31:12 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-3a93a5b6-88eb-435b-963d-e87c9497e8b7 req-1dfdbaca-2e26-4e3a-a375-6694c1039c69 service nova] Lock "ce058b47-d96f-4341-9104-1fa71ca2c997-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:31:12 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-3a93a5b6-88eb-435b-963d-e87c9497e8b7 req-1dfdbaca-2e26-4e3a-a375-6694c1039c69 service nova] Lock "ce058b47-d96f-4341-9104-1fa71ca2c997-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:31:12 user nova-compute[75165]: DEBUG nova.compute.manager [req-3a93a5b6-88eb-435b-963d-e87c9497e8b7 req-1dfdbaca-2e26-4e3a-a375-6694c1039c69 service nova] [instance: ce058b47-d96f-4341-9104-1fa71ca2c997] No waiting events found dispatching network-vif-unplugged-7df0d91d-ff60-4008-823f-f951cbf505d3 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:31:12 user nova-compute[75165]: DEBUG nova.compute.manager [req-3a93a5b6-88eb-435b-963d-e87c9497e8b7 req-1dfdbaca-2e26-4e3a-a375-6694c1039c69 service nova] [instance: ce058b47-d96f-4341-9104-1fa71ca2c997] Received event network-vif-unplugged-7df0d91d-ff60-4008-823f-f951cbf505d3 for instance with task_state deleting. {{(pid=75165) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 00:31:12 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:31:12 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:31:12 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: ce058b47-d96f-4341-9104-1fa71ca2c997] Instance destroyed successfully.
Oct 26 00:31:12 user nova-compute[75165]: DEBUG nova.objects.instance [None req-38c1827c-7972-4cd3-a5d0-c38280c37ba3 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Lazy-loading 'resources' on Instance uuid ce058b47-d96f-4341-9104-1fa71ca2c997 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:31:12 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-38c1827c-7972-4cd3-a5d0-c38280c37ba3 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:24:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1201622567',display_name='tempest-AttachVolumeTestJSON-server-1201622567',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1201622567',id=30,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAgcu5NKLgh2Gjw5hbaantiq3qG2SfzXf5AH2iL3fw+cZH/dlInnjj6/hN9asQd2ftgiOjxxB738NDKWw4BXmyFvNpbWuS7IGz0HZGpDTjUakksAvl+2z70TPMfzboBY2g==',key_name='tempest-keypair-1848999993',keypairs=<?>,launch_index=0,launched_at=2023-10-26T00:24:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3ffbf5c944914cafac7aba65fb7ca402',ramdisk_id='',reservation_id='r-l0ckr0qj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2130746724',owner_user_name='tempest-AttachVolumeTestJSON-2130746724-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T00:24:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='841b5be7c0b348de979920fc9ae223ed',uuid=ce058b47-d96f-4341-9104-1fa71ca2c997,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7df0d91d-ff60-4008-823f-f951cbf505d3", "address": "fa:16:3e:d8:e5:83", "network": {"id": "7e330392-6256-405b-ab37-0b8af0c4fd48", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-430326049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ffbf5c944914cafac7aba65fb7ca402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7df0d91d-ff", "ovs_interfaceid": "7df0d91d-ff60-4008-823f-f951cbf505d3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 00:31:12 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-38c1827c-7972-4cd3-a5d0-c38280c37ba3 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Converting VIF {"id": "7df0d91d-ff60-4008-823f-f951cbf505d3", "address": "fa:16:3e:d8:e5:83", "network": {"id": "7e330392-6256-405b-ab37-0b8af0c4fd48", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-430326049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ffbf5c944914cafac7aba65fb7ca402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7df0d91d-ff", "ovs_interfaceid": "7df0d91d-ff60-4008-823f-f951cbf505d3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:31:12 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-38c1827c-7972-4cd3-a5d0-c38280c37ba3 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d8:e5:83,bridge_name='br-int',has_traffic_filtering=True,id=7df0d91d-ff60-4008-823f-f951cbf505d3,network=Network(7e330392-6256-405b-ab37-0b8af0c4fd48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7df0d91d-ff') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:31:12 user nova-compute[75165]: DEBUG os_vif [None req-38c1827c-7972-4cd3-a5d0-c38280c37ba3 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d8:e5:83,bridge_name='br-int',has_traffic_filtering=True,id=7df0d91d-ff60-4008-823f-f951cbf505d3,network=Network(7e330392-6256-405b-ab37-0b8af0c4fd48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7df0d91d-ff') {{(pid=75165) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 00:31:12 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:31:12 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7df0d91d-ff, bridge=br-int, if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:31:12 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:31:12 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:31:12 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:31:12 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=28933e7a-1ab5-447d-8af2-f666a164dac2) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:31:12 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:31:12 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:31:12 user nova-compute[75165]: INFO os_vif [None req-38c1827c-7972-4cd3-a5d0-c38280c37ba3 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d8:e5:83,bridge_name='br-int',has_traffic_filtering=True,id=7df0d91d-ff60-4008-823f-f951cbf505d3,network=Network(7e330392-6256-405b-ab37-0b8af0c4fd48),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7df0d91d-ff')
Oct 26 00:31:12 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-38c1827c-7972-4cd3-a5d0-c38280c37ba3 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] [instance: ce058b47-d96f-4341-9104-1fa71ca2c997] Deleting instance files /opt/stack/data/nova/instances/ce058b47-d96f-4341-9104-1fa71ca2c997_del
Oct 26 00:31:12 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-38c1827c-7972-4cd3-a5d0-c38280c37ba3 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] [instance: ce058b47-d96f-4341-9104-1fa71ca2c997] Deletion of /opt/stack/data/nova/instances/ce058b47-d96f-4341-9104-1fa71ca2c997_del complete
Oct 26 00:31:12 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-e8729036-4399-4cc9-a1de-b635221cdfcc tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Acquiring lock "fe2984ce-8958-4049-8af7-496b313b26c8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:31:12 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-e8729036-4399-4cc9-a1de-b635221cdfcc tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Lock "fe2984ce-8958-4049-8af7-496b313b26c8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:31:12 user nova-compute[75165]: INFO nova.compute.manager [None req-e8729036-4399-4cc9-a1de-b635221cdfcc tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] [instance: fe2984ce-8958-4049-8af7-496b313b26c8] Detaching volume 30a04133-0b10-40a8-8289-5538571ff1fd
Oct 26 00:31:12 user nova-compute[75165]: INFO nova.compute.manager [None req-38c1827c-7972-4cd3-a5d0-c38280c37ba3 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] [instance: ce058b47-d96f-4341-9104-1fa71ca2c997] Took 1.17 seconds to destroy the instance on the hypervisor.
Oct 26 00:31:12 user nova-compute[75165]: DEBUG oslo.service.loopingcall [None req-38c1827c-7972-4cd3-a5d0-c38280c37ba3 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75165) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 00:31:12 user nova-compute[75165]: DEBUG nova.compute.manager [-] [instance: ce058b47-d96f-4341-9104-1fa71ca2c997] Deallocating network for instance {{(pid=75165) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 00:31:12 user nova-compute[75165]: DEBUG nova.network.neutron [-] [instance: ce058b47-d96f-4341-9104-1fa71ca2c997] deallocate_for_instance() {{(pid=75165) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 00:31:12 user nova-compute[75165]: INFO nova.virt.block_device [None req-e8729036-4399-4cc9-a1de-b635221cdfcc tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] [instance: fe2984ce-8958-4049-8af7-496b313b26c8] Attempting to driver detach volume 30a04133-0b10-40a8-8289-5538571ff1fd from mountpoint /dev/vdb
Oct 26 00:31:12 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-e8729036-4399-4cc9-a1de-b635221cdfcc tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Attempting to detach device vdb from instance fe2984ce-8958-4049-8af7-496b313b26c8 from the persistent domain config. {{(pid=75165) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 00:31:12 user nova-compute[75165]: DEBUG nova.virt.libvirt.guest [None req-e8729036-4399-4cc9-a1de-b635221cdfcc tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 00:31:12 user nova-compute[75165]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 00:31:12 user nova-compute[75165]:   <source dev="/dev/sde"/>
Oct 26 00:31:12 user nova-compute[75165]:   <target dev="vdb" bus="virtio"/>
Oct 26 00:31:12 user nova-compute[75165]:   <serial>30a04133-0b10-40a8-8289-5538571ff1fd</serial>
Oct 26 00:31:12 user nova-compute[75165]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 00:31:12 user nova-compute[75165]: </disk>
Oct 26 00:31:12 user nova-compute[75165]:  {{(pid=75165) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 00:31:12 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-e8729036-4399-4cc9-a1de-b635221cdfcc tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Successfully detached device vdb from instance fe2984ce-8958-4049-8af7-496b313b26c8 from the persistent domain config.
Oct 26 00:31:12 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-e8729036-4399-4cc9-a1de-b635221cdfcc tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fe2984ce-8958-4049-8af7-496b313b26c8 from the live domain config. {{(pid=75165) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 00:31:12 user nova-compute[75165]: DEBUG nova.virt.libvirt.guest [None req-e8729036-4399-4cc9-a1de-b635221cdfcc tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 00:31:12 user nova-compute[75165]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 00:31:12 user nova-compute[75165]:   <source dev="/dev/sde"/>
Oct 26 00:31:12 user nova-compute[75165]:   <target dev="vdb" bus="virtio"/>
Oct 26 00:31:12 user nova-compute[75165]:   <serial>30a04133-0b10-40a8-8289-5538571ff1fd</serial>
Oct 26 00:31:12 user nova-compute[75165]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 00:31:12 user nova-compute[75165]: </disk>
Oct 26 00:31:12 user nova-compute[75165]:  {{(pid=75165) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 00:31:13 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-e8729036-4399-4cc9-a1de-b635221cdfcc tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fe2984ce-8958-4049-8af7-496b313b26c8 {{(pid=75165) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 00:31:14 user nova-compute[75165]: DEBUG nova.compute.manager [req-f7e8d1f2-47d0-4901-9b69-e171f580e7f7 req-00d0fc67-ffa2-4271-aa2f-039af0e7b6db service nova] [instance: ce058b47-d96f-4341-9104-1fa71ca2c997] Received event network-vif-plugged-7df0d91d-ff60-4008-823f-f951cbf505d3 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:31:14 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-f7e8d1f2-47d0-4901-9b69-e171f580e7f7 req-00d0fc67-ffa2-4271-aa2f-039af0e7b6db service nova] Acquiring lock "ce058b47-d96f-4341-9104-1fa71ca2c997-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:31:14 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-f7e8d1f2-47d0-4901-9b69-e171f580e7f7 req-00d0fc67-ffa2-4271-aa2f-039af0e7b6db service nova] Lock "ce058b47-d96f-4341-9104-1fa71ca2c997-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:31:14 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-f7e8d1f2-47d0-4901-9b69-e171f580e7f7 req-00d0fc67-ffa2-4271-aa2f-039af0e7b6db service nova] Lock "ce058b47-d96f-4341-9104-1fa71ca2c997-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:31:14 user nova-compute[75165]: DEBUG nova.compute.manager [req-f7e8d1f2-47d0-4901-9b69-e171f580e7f7 req-00d0fc67-ffa2-4271-aa2f-039af0e7b6db service nova] [instance: ce058b47-d96f-4341-9104-1fa71ca2c997] No waiting events found dispatching network-vif-plugged-7df0d91d-ff60-4008-823f-f951cbf505d3 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:31:14 user nova-compute[75165]: WARNING nova.compute.manager [req-f7e8d1f2-47d0-4901-9b69-e171f580e7f7 req-00d0fc67-ffa2-4271-aa2f-039af0e7b6db service nova] [instance: ce058b47-d96f-4341-9104-1fa71ca2c997] Received unexpected event network-vif-plugged-7df0d91d-ff60-4008-823f-f951cbf505d3 for instance with vm_state active and task_state deleting.
Oct 26 00:31:14 user nova-compute[75165]: DEBUG nova.network.neutron [-] [instance: ce058b47-d96f-4341-9104-1fa71ca2c997] Updating instance_info_cache with network_info: [] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:31:14 user nova-compute[75165]: INFO nova.compute.manager [-] [instance: ce058b47-d96f-4341-9104-1fa71ca2c997] Took 1.42 seconds to deallocate network for instance.
Oct 26 00:31:14 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-38c1827c-7972-4cd3-a5d0-c38280c37ba3 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:31:14 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-38c1827c-7972-4cd3-a5d0-c38280c37ba3 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:31:14 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-38c1827c-7972-4cd3-a5d0-c38280c37ba3 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:31:14 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-38c1827c-7972-4cd3-a5d0-c38280c37ba3 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:31:14 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-38c1827c-7972-4cd3-a5d0-c38280c37ba3 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.270s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:31:14 user nova-compute[75165]: INFO nova.scheduler.client.report [None req-38c1827c-7972-4cd3-a5d0-c38280c37ba3 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Deleted allocations for instance ce058b47-d96f-4341-9104-1fa71ca2c997
Oct 26 00:31:14 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-38c1827c-7972-4cd3-a5d0-c38280c37ba3 tempest-AttachVolumeTestJSON-2130746724 tempest-AttachVolumeTestJSON-2130746724-project-member] Lock "ce058b47-d96f-4341-9104-1fa71ca2c997" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.056s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:31:16 user nova-compute[75165]: DEBUG nova.compute.manager [req-d99a2de1-2bd9-4e9b-aef8-6e1b286c1a55 req-ddd32451-d6e2-4d9d-94be-9601ef5d0ab8 service nova] [instance: ce058b47-d96f-4341-9104-1fa71ca2c997] Received event network-vif-deleted-7df0d91d-ff60-4008-823f-f951cbf505d3 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:31:16 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:31:17 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:31:18 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:31:18 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:31:18 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:31:18 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75165) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 00:31:19 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:31:19 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:31:19 user nova-compute[75165]: DEBUG nova.compute.manager [req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d req-cc93006c-e959-4308-a6b7-e4ee9c07f17e service nova] [instance: 250afc24-0c38-4959-a77c-d51365dd1c4e] Received event volume-reimaged-af851e79-3073-4793-929f-877775c91de0 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:31:19 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d req-cc93006c-e959-4308-a6b7-e4ee9c07f17e service nova] Acquiring lock "250afc24-0c38-4959-a77c-d51365dd1c4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:31:19 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d req-cc93006c-e959-4308-a6b7-e4ee9c07f17e service nova] Lock "250afc24-0c38-4959-a77c-d51365dd1c4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:31:19 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d req-cc93006c-e959-4308-a6b7-e4ee9c07f17e service nova] Lock "250afc24-0c38-4959-a77c-d51365dd1c4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:31:19 user nova-compute[75165]: DEBUG nova.compute.manager [req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d req-cc93006c-e959-4308-a6b7-e4ee9c07f17e service nova] [instance: 250afc24-0c38-4959-a77c-d51365dd1c4e] Processing event volume-reimaged-af851e79-3073-4793-929f-877775c91de0 {{(pid=75165) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10871}}
Oct 26 00:31:19 user nova-compute[75165]: DEBUG nova.compute.manager [None req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] [instance: 250afc24-0c38-4959-a77c-d51365dd1c4e] Instance event wait completed in 28 seconds for volume-reimaged {{(pid=75165) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 00:31:20 user nova-compute[75165]: INFO nova.virt.block_device [None req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] [instance: 250afc24-0c38-4959-a77c-d51365dd1c4e] Booting with volume af851e79-3073-4793-929f-877775c91de0 at /dev/vda
Oct 26 00:31:20 user nova-compute[75165]: DEBUG os_brick.utils [None req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:31:20 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:31:20 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:31:20 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bf93c4c-346f-450b-92a9-5b03f849d07f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa94814ccb35\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:31:20 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:31:20 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:31:20 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[91c36cd7-9a6c-4b25-a3a8-78a0c4b06e71]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:31:20 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:31:20 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:31:20 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[d71a78c2-802c-48f8-a182-598a22220620]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:31:20 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[93cd9231-9887-4076-a352-72550462f3c4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:31:20 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Running cmd (subprocess): nvme version {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:31:20 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] 'nvme version' failed. Not Retrying. {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 00:31:20 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] nvme not present on system {{(pid=75165) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 00:31:20 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:31:20 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 00:31:20 user nova-compute[75165]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 00:31:20 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[317173bb-2ee7-484d-bbfb-6268321473e5]: (4, '') {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:31:20 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75165) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 00:31:20 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75165) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 00:31:20 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] LIGHTOS: no hostnqn found. {{(pid=75165) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 00:31:20 user nova-compute[75165]: DEBUG os_brick.utils [None req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa94814ccb35', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:31:20 user nova-compute[75165]: DEBUG nova.virt.block_device [None req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] [instance: 250afc24-0c38-4959-a77c-d51365dd1c4e] Updating existing volume attachment record: 479929cf-06d5-41c4-9bef-d83d54588910 {{(pid=75165) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 00:31:20 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:31:20 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Starting heal instance info cache {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 00:31:20 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "refresh_cache-fe2984ce-8958-4049-8af7-496b313b26c8" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:31:20 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquired lock "refresh_cache-fe2984ce-8958-4049-8af7-496b313b26c8" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:31:20 user nova-compute[75165]: DEBUG nova.network.neutron [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: fe2984ce-8958-4049-8af7-496b313b26c8] Forcefully refreshing network info cache for instance {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 00:31:21 user nova-compute[75165]: DEBUG nova.network.neutron [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: fe2984ce-8958-4049-8af7-496b313b26c8] Updating instance_info_cache with network_info: [{"id": "5995df96-1576-4616-8834-45073add32a2", "address": "fa:16:3e:ca:36:c4", "network": {"id": "7c8ed206-c41f-4c32-837b-b50fb4ee5479", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1704810529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "567a90e8d8b24ca4b5e5da923d537134", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5995df96-15", "ovs_interfaceid": "5995df96-1576-4616-8834-45073add32a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:31:21 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Releasing lock "refresh_cache-fe2984ce-8958-4049-8af7-496b313b26c8" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:31:21 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: fe2984ce-8958-4049-8af7-496b313b26c8] Updated the network info_cache for instance {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 00:31:21 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:31:21 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:31:22 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:31:22 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:31:22 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:31:22 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:31:22 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:31:22 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:31:22 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75165) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 00:31:23 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75165) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 00:31:23 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75165) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 00:31:23 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97fb67a7-637d-456f-b4dd-0a271ed6cfc4/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:31:23 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97fb67a7-637d-456f-b4dd-0a271ed6cfc4/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:31:23 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97fb67a7-637d-456f-b4dd-0a271ed6cfc4/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:31:23 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97fb67a7-637d-456f-b4dd-0a271ed6cfc4/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:31:23 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb77893d-263a-40a6-9acc-63fcd1481a38/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:31:23 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb77893d-263a-40a6-9acc-63fcd1481a38/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:31:23 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb77893d-263a-40a6-9acc-63fcd1481a38/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:31:23 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb77893d-263a-40a6-9acc-63fcd1481a38/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:31:23 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75165) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 00:31:23 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3c87b07-5c16-4f45-b320-06d3503d23e6/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:31:24 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3c87b07-5c16-4f45-b320-06d3503d23e6/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:31:24 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3c87b07-5c16-4f45-b320-06d3503d23e6/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:31:24 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3c87b07-5c16-4f45-b320-06d3503d23e6/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:31:24 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe2984ce-8958-4049-8af7-496b313b26c8/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:31:24 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe2984ce-8958-4049-8af7-496b313b26c8/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:31:24 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe2984ce-8958-4049-8af7-496b313b26c8/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:31:24 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe2984ce-8958-4049-8af7-496b313b26c8/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:31:25 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:31:25 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:31:25 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Hypervisor/Node resource view: name=user free_ram=8273MB free_disk=24.809547424316406GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75165) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 00:31:25 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:31:25 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:31:25 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 97fb67a7-637d-456f-b4dd-0a271ed6cfc4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:31:25 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:31:25 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance fe2984ce-8958-4049-8af7-496b313b26c8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:31:25 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance b3c87b07-5c16-4f45-b320-06d3503d23e6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:31:25 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance bb77893d-263a-40a6-9acc-63fcd1481a38 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:31:25 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 250afc24-0c38-4959-a77c-d51365dd1c4e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:31:25 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance c7a55179-cde6-4fbd-a8b3-c3df149bc6f3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:31:25 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75165) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 00:31:25 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75165) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 00:31:25 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:31:25 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:31:25 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Compute_service record updated for user:user {{(pid=75165) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 00:31:25 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.391s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:31:26 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:31:27 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:31:32 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:31:33 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-e8729036-4399-4cc9-a1de-b635221cdfcc tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance fe2984ce-8958-4049-8af7-496b313b26c8 is timed out.
Oct 26 00:31:33 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-e8729036-4399-4cc9-a1de-b635221cdfcc tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Successfully detached device vdb from instance fe2984ce-8958-4049-8af7-496b313b26c8 from the live domain config.
Oct 26 00:31:33 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e8729036-4399-4cc9-a1de-b635221cdfcc tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] [instance: fe2984ce-8958-4049-8af7-496b313b26c8] calling os-brick to detach iSCSI Volume {{(pid=75165) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 00:31:33 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8729036-4399-4cc9-a1de-b635221cdfcc tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8bf8160e50>, {'target_iqn': 'iqn.2010-10.org.openstack:30a04133-0b10-40a8-8289-5538571ff1fd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QunRMHiT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:31:33 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-e8729036-4399-4cc9-a1de-b635221cdfcc tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:31:33 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-e8729036-4399-4cc9-a1de-b635221cdfcc tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:31:33 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-e8729036-4399-4cc9-a1de-b635221cdfcc tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:31:33 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:31:33 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:31:33 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[1babce14-7e2a-4ed7-bedf-9716ac9ac3f4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:30a04133-0b10-40a8-8289-5538571ff1fd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:20bc9a02-2908-4429-8524-fcc9553f3a29\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:31:33 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8729036-4399-4cc9-a1de-b635221cdfcc tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 00:31:33 user nova-compute[75165]: No targets found.
Oct 26 00:31:33 user nova-compute[75165]: iSNS:
Oct 26 00:31:33 user nova-compute[75165]: No targets found.
Oct 26 00:31:33 user nova-compute[75165]: STATIC:
Oct 26 00:31:33 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:30a04133-0b10-40a8-8289-5538571ff1fd
Oct 26 00:31:33 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:31:33 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:31:33 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:20bc9a02-2908-4429-8524-fcc9553f3a29
Oct 26 00:31:33 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:31:33 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:31:33 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8
Oct 26 00:31:33 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:31:33 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:31:33 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795
Oct 26 00:31:33 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:31:33 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:31:33 user nova-compute[75165]: FIRMWARE:
Oct 26 00:31:33 user nova-compute[75165]: No targets found.
Oct 26 00:31:33 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:31:33 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8729036-4399-4cc9-a1de-b635221cdfcc tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 00:31:33 user nova-compute[75165]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 00:31:33 user nova-compute[75165]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75165) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 00:31:33 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8729036-4399-4cc9-a1de-b635221cdfcc tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:30a04133-0b10-40a8-8289-5538571ff1fd', 0)] {{(pid=75165) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 00:31:33 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:31:33 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:31:33 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0049687-8c7c-4952-9da6-488553db4a91]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20bc9a02-2908-4429-8524-fcc9553f3a29\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:30a04133-0b10-40a8-8289-5538571ff1fd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:31:33 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:31:33 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:31:33 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[f73a435b-da42-447e-99a7-e4766c5d762b]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20bc9a02-2908-4429-8524-fcc9553f3a29 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30a04133-0b10-40a8-8289-5538571ff1fd (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:31:33 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8729036-4399-4cc9-a1de-b635221cdfcc tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)
Oct 26 00:31:33 user nova-compute[75165]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8 (non-flash)
Oct 26 00:31:33 user nova-compute[75165]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20bc9a02-2908-4429-8524-fcc9553f3a29 (non-flash)
Oct 26 00:31:33 user nova-compute[75165]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30a04133-0b10-40a8-8289-5538571ff1fd (non-flash)
Oct 26 00:31:33 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:31:33 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8729036-4399-4cc9-a1de-b635221cdfcc tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)
Oct 26 00:31:33 user nova-compute[75165]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8 (non-flash)
Oct 26 00:31:33 user nova-compute[75165]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20bc9a02-2908-4429-8524-fcc9553f3a29 (non-flash)
Oct 26 00:31:33 user nova-compute[75165]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30a04133-0b10-40a8-8289-5538571ff1fd (non-flash)
Oct 26 00:31:33 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:31:33 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8729036-4399-4cc9-a1de-b635221cdfcc tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8be04c8820>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:30a04133-0b10-40a8-8289-5538571ff1fd'): ({'sde'}, set())}) {{(pid=75165) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 00:31:33 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-e8729036-4399-4cc9-a1de-b635221cdfcc tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Removing single pathed devices sde {{(pid=75165) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 00:31:33 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:31:33 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:31:33 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0980eaf-b49e-43af-9cec-faadf1042cb2]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:31:33 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:31:33 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:31:33 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[51d17c56-65bc-496e-92c9-aa5d2f338e55]: (4, ('ok\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:31:33 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-e8729036-4399-4cc9-a1de-b635221cdfcc tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Flushing IO for device /dev/sde {{(pid=75165) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 00:31:33 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:31:33 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:31:33 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[0644c3f8-0d93-4459-8508-a5f72bc5f32e]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:31:33 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-e8729036-4399-4cc9-a1de-b635221cdfcc tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75165) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 00:31:33 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:31:33 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.063s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:31:33 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[e77a19ef-da6e-4442-a2b6-7261e801e4cc]: (4, ('1', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:31:33 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-e8729036-4399-4cc9-a1de-b635221cdfcc tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75165) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 00:31:33 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-e8729036-4399-4cc9-a1de-b635221cdfcc tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] SCSI volumes sde have been removed. {{(pid=75165) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 00:31:33 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8729036-4399-4cc9-a1de-b635221cdfcc tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:30a04133-0b10-40a8-8289-5538571ff1fd')] {{(pid=75165) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 00:31:33 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30a04133-0b10-40a8-8289-5538571ff1fd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:31:33 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30a04133-0b10-40a8-8289-5538571ff1fd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:31:33 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[35e4578a-bdb4-4e9e-8ecf-72c566c709b3]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:31:33 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8729036-4399-4cc9-a1de-b635221cdfcc tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:31:33 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30a04133-0b10-40a8-8289-5538571ff1fd -p 172.16.0.220:3260 --logout {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:31:33 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30a04133-0b10-40a8-8289-5538571ff1fd -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:31:33 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[41fba7a6-9aa8-48e6-b012-32f5dc87e4c4]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:30a04133-0b10-40a8-8289-5538571ff1fd, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:30a04133-0b10-40a8-8289-5538571ff1fd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:31:33 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8729036-4399-4cc9-a1de-b635221cdfcc tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:30a04133-0b10-40a8-8289-5538571ff1fd, portal: 172.16.0.220,3260]
Oct 26 00:31:33 user nova-compute[75165]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:30a04133-0b10-40a8-8289-5538571ff1fd, portal: 172.16.0.220,3260] successful.
Oct 26 00:31:33 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:31:33 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30a04133-0b10-40a8-8289-5538571ff1fd -p 172.16.0.220:3260 --op delete {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:31:33 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30a04133-0b10-40a8-8289-5538571ff1fd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:31:33 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[da703301-5cab-4396-852b-ae1eb9c6be4c]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:31:33 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8729036-4399-4cc9-a1de-b635221cdfcc tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:31:33 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-e8729036-4399-4cc9-a1de-b635221cdfcc tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.367s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:31:33 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8729036-4399-4cc9-a1de-b635221cdfcc tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] <== disconnect_volume: return (369ms) None {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:31:33 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e8729036-4399-4cc9-a1de-b635221cdfcc tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] [instance: fe2984ce-8958-4049-8af7-496b313b26c8] Disconnected iSCSI Volume {{(pid=75165) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 00:31:34 user nova-compute[75165]: DEBUG nova.objects.instance [None req-e8729036-4399-4cc9-a1de-b635221cdfcc tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Lazy-loading 'flavor' on Instance uuid fe2984ce-8958-4049-8af7-496b313b26c8 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:31:34 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-e8729036-4399-4cc9-a1de-b635221cdfcc tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Lock "fe2984ce-8958-4049-8af7-496b313b26c8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.014s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:31:36 user nova-compute[75165]: INFO nova.compute.manager [None req-6ea26b8c-509b-40fd-b4b5-3149e6502e41 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: c7a55179-cde6-4fbd-a8b3-c3df149bc6f3] Rescuing
Oct 26 00:31:36 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-6ea26b8c-509b-40fd-b4b5-3149e6502e41 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Acquiring lock "refresh_cache-c7a55179-cde6-4fbd-a8b3-c3df149bc6f3" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:31:36 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-6ea26b8c-509b-40fd-b4b5-3149e6502e41 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Acquired lock "refresh_cache-c7a55179-cde6-4fbd-a8b3-c3df149bc6f3" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:31:36 user nova-compute[75165]: DEBUG nova.network.neutron [None req-6ea26b8c-509b-40fd-b4b5-3149e6502e41 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: c7a55179-cde6-4fbd-a8b3-c3df149bc6f3] Building network info cache for instance {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 00:31:37 user nova-compute[75165]: DEBUG nova.network.neutron [None req-6ea26b8c-509b-40fd-b4b5-3149e6502e41 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: c7a55179-cde6-4fbd-a8b3-c3df149bc6f3] Updating instance_info_cache with network_info: [{"id": "70711118-68ee-4ea5-bfc2-df652ed0f3c1", "address": "fa:16:3e:91:b1:a6", "network": {"id": "eb55c0bc-cae5-4ba3-851a-e31a50b52c88", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1081223830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d616862c7c184de5b0ba3121552c5666", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70711118-68", "ovs_interfaceid": "70711118-68ee-4ea5-bfc2-df652ed0f3c1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:31:37 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-6ea26b8c-509b-40fd-b4b5-3149e6502e41 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Releasing lock "refresh_cache-c7a55179-cde6-4fbd-a8b3-c3df149bc6f3" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:31:37 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:31:37 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:31:37 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:31:37 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:31:37 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:31:37 user nova-compute[75165]: DEBUG nova.compute.manager [req-dd9ee8bf-29be-47fc-a888-28cb54293d2d req-9ac72f0b-ddfe-476f-ab2b-651874dfefcc service nova] [instance: c7a55179-cde6-4fbd-a8b3-c3df149bc6f3] Received event network-vif-unplugged-70711118-68ee-4ea5-bfc2-df652ed0f3c1 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:31:37 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-dd9ee8bf-29be-47fc-a888-28cb54293d2d req-9ac72f0b-ddfe-476f-ab2b-651874dfefcc service nova] Acquiring lock "c7a55179-cde6-4fbd-a8b3-c3df149bc6f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:31:37 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-dd9ee8bf-29be-47fc-a888-28cb54293d2d req-9ac72f0b-ddfe-476f-ab2b-651874dfefcc service nova] Lock "c7a55179-cde6-4fbd-a8b3-c3df149bc6f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:31:37 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-dd9ee8bf-29be-47fc-a888-28cb54293d2d req-9ac72f0b-ddfe-476f-ab2b-651874dfefcc service nova] Lock "c7a55179-cde6-4fbd-a8b3-c3df149bc6f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:31:37 user nova-compute[75165]: DEBUG nova.compute.manager [req-dd9ee8bf-29be-47fc-a888-28cb54293d2d req-9ac72f0b-ddfe-476f-ab2b-651874dfefcc service nova] [instance: c7a55179-cde6-4fbd-a8b3-c3df149bc6f3] No waiting events found dispatching network-vif-unplugged-70711118-68ee-4ea5-bfc2-df652ed0f3c1 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:31:37 user nova-compute[75165]: WARNING nova.compute.manager [req-dd9ee8bf-29be-47fc-a888-28cb54293d2d req-9ac72f0b-ddfe-476f-ab2b-651874dfefcc service nova] [instance: c7a55179-cde6-4fbd-a8b3-c3df149bc6f3] Received unexpected event network-vif-unplugged-70711118-68ee-4ea5-bfc2-df652ed0f3c1 for instance with vm_state active and task_state rescuing.
Oct 26 00:31:38 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-60550a93-9dcb-4c59-b633-d7fe37797a42 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Acquiring lock "bb77893d-263a-40a6-9acc-63fcd1481a38" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:31:38 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-60550a93-9dcb-4c59-b633-d7fe37797a42 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Lock "bb77893d-263a-40a6-9acc-63fcd1481a38" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:31:38 user nova-compute[75165]: INFO nova.compute.manager [None req-60550a93-9dcb-4c59-b633-d7fe37797a42 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] [instance: bb77893d-263a-40a6-9acc-63fcd1481a38] Detaching volume 20bc9a02-2908-4429-8524-fcc9553f3a29
Oct 26 00:31:38 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: c7a55179-cde6-4fbd-a8b3-c3df149bc6f3] Instance destroyed successfully.
Oct 26 00:31:38 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-6ea26b8c-509b-40fd-b4b5-3149e6502e41 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: c7a55179-cde6-4fbd-a8b3-c3df149bc6f3] Attempting a stable device rescue
Oct 26 00:31:38 user nova-compute[75165]: INFO nova.virt.block_device [None req-60550a93-9dcb-4c59-b633-d7fe37797a42 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] [instance: bb77893d-263a-40a6-9acc-63fcd1481a38] Attempting to driver detach volume 20bc9a02-2908-4429-8524-fcc9553f3a29 from mountpoint /dev/vdb
Oct 26 00:31:38 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-60550a93-9dcb-4c59-b633-d7fe37797a42 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Attempting to detach device vdb from instance bb77893d-263a-40a6-9acc-63fcd1481a38 from the persistent domain config. {{(pid=75165) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 00:31:38 user nova-compute[75165]: DEBUG nova.virt.libvirt.guest [None req-60550a93-9dcb-4c59-b633-d7fe37797a42 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 00:31:38 user nova-compute[75165]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 00:31:38 user nova-compute[75165]:   <source dev="/dev/sdd"/>
Oct 26 00:31:38 user nova-compute[75165]:   <target dev="vdb" bus="virtio"/>
Oct 26 00:31:38 user nova-compute[75165]:   <serial>20bc9a02-2908-4429-8524-fcc9553f3a29</serial>
Oct 26 00:31:38 user nova-compute[75165]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 00:31:38 user nova-compute[75165]: </disk>
Oct 26 00:31:38 user nova-compute[75165]:  {{(pid=75165) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 00:31:38 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-6ea26b8c-509b-40fd-b4b5-3149e6502e41 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75165) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 26 00:31:38 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-60550a93-9dcb-4c59-b633-d7fe37797a42 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Successfully detached device vdb from instance bb77893d-263a-40a6-9acc-63fcd1481a38 from the persistent domain config.
Oct 26 00:31:38 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-60550a93-9dcb-4c59-b633-d7fe37797a42 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance bb77893d-263a-40a6-9acc-63fcd1481a38 from the live domain config. {{(pid=75165) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 00:31:38 user nova-compute[75165]: DEBUG nova.virt.libvirt.guest [None req-60550a93-9dcb-4c59-b633-d7fe37797a42 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 00:31:38 user nova-compute[75165]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 00:31:38 user nova-compute[75165]:   <source dev="/dev/sdd"/>
Oct 26 00:31:38 user nova-compute[75165]:   <target dev="vdb" bus="virtio"/>
Oct 26 00:31:38 user nova-compute[75165]:   <serial>20bc9a02-2908-4429-8524-fcc9553f3a29</serial>
Oct 26 00:31:38 user nova-compute[75165]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 00:31:38 user nova-compute[75165]: </disk>
Oct 26 00:31:38 user nova-compute[75165]:  {{(pid=75165) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 00:31:38 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-6ea26b8c-509b-40fd-b4b5-3149e6502e41 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: c7a55179-cde6-4fbd-a8b3-c3df149bc6f3] Instance directory exists: not creating {{(pid=75165) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 26 00:31:38 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-6ea26b8c-509b-40fd-b4b5-3149e6502e41 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: c7a55179-cde6-4fbd-a8b3-c3df149bc6f3] Creating image(s)
Oct 26 00:31:38 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-6ea26b8c-509b-40fd-b4b5-3149e6502e41 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Acquiring lock "/opt/stack/data/nova/instances/c7a55179-cde6-4fbd-a8b3-c3df149bc6f3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:31:38 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-6ea26b8c-509b-40fd-b4b5-3149e6502e41 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Lock "/opt/stack/data/nova/instances/c7a55179-cde6-4fbd-a8b3-c3df149bc6f3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:31:38 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-6ea26b8c-509b-40fd-b4b5-3149e6502e41 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Lock "/opt/stack/data/nova/instances/c7a55179-cde6-4fbd-a8b3-c3df149bc6f3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:31:38 user nova-compute[75165]: DEBUG nova.objects.instance [None req-6ea26b8c-509b-40fd-b4b5-3149e6502e41 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Lazy-loading 'trusted_certs' on Instance uuid c7a55179-cde6-4fbd-a8b3-c3df149bc6f3 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:31:38 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-6ea26b8c-509b-40fd-b4b5-3149e6502e41 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Acquiring lock "ad66dd72abfd2d2e13a59983bf78e8afd78d0676" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:31:38 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-6ea26b8c-509b-40fd-b4b5-3149e6502e41 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Lock "ad66dd72abfd2d2e13a59983bf78e8afd78d0676" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:31:38 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-bac40c51-7db0-43ca-93bd-90088842e0d3 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Acquiring lock "bb77893d-263a-40a6-9acc-63fcd1481a38" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:31:39 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-6ea26b8c-509b-40fd-b4b5-3149e6502e41 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad66dd72abfd2d2e13a59983bf78e8afd78d0676.part --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:31:40 user nova-compute[75165]: DEBUG nova.compute.manager [req-72b4bb38-5760-4851-ae21-7983a8879e06 req-6e6ccbd4-e846-4fb1-bdce-6a4a1cd3ec08 service nova] [instance: c7a55179-cde6-4fbd-a8b3-c3df149bc6f3] Received event network-vif-plugged-70711118-68ee-4ea5-bfc2-df652ed0f3c1 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:31:40 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-72b4bb38-5760-4851-ae21-7983a8879e06 req-6e6ccbd4-e846-4fb1-bdce-6a4a1cd3ec08 service nova] Acquiring lock "c7a55179-cde6-4fbd-a8b3-c3df149bc6f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:31:40 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-72b4bb38-5760-4851-ae21-7983a8879e06 req-6e6ccbd4-e846-4fb1-bdce-6a4a1cd3ec08 service nova] Lock "c7a55179-cde6-4fbd-a8b3-c3df149bc6f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:31:40 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-72b4bb38-5760-4851-ae21-7983a8879e06 req-6e6ccbd4-e846-4fb1-bdce-6a4a1cd3ec08 service nova] Lock "c7a55179-cde6-4fbd-a8b3-c3df149bc6f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:31:40 user nova-compute[75165]: DEBUG nova.compute.manager [req-72b4bb38-5760-4851-ae21-7983a8879e06 req-6e6ccbd4-e846-4fb1-bdce-6a4a1cd3ec08 service nova] [instance: c7a55179-cde6-4fbd-a8b3-c3df149bc6f3] No waiting events found dispatching network-vif-plugged-70711118-68ee-4ea5-bfc2-df652ed0f3c1 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:31:40 user nova-compute[75165]: WARNING nova.compute.manager [req-72b4bb38-5760-4851-ae21-7983a8879e06 req-6e6ccbd4-e846-4fb1-bdce-6a4a1cd3ec08 service nova] [instance: c7a55179-cde6-4fbd-a8b3-c3df149bc6f3] Received unexpected event network-vif-plugged-70711118-68ee-4ea5-bfc2-df652ed0f3c1 for instance with vm_state active and task_state rescuing.
Oct 26 00:31:40 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-60550a93-9dcb-4c59-b633-d7fe37797a42 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance bb77893d-263a-40a6-9acc-63fcd1481a38 {{(pid=75165) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 00:31:40 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-73316ea5-9517-41aa-be76-989a0fab9892 tempest-VolumesNegativeTest-1416627237 tempest-VolumesNegativeTest-1416627237-project-member] Acquiring lock "00c0e0e2-4c40-45a3-829a-b6b73482e311" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:31:40 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-73316ea5-9517-41aa-be76-989a0fab9892 tempest-VolumesNegativeTest-1416627237 tempest-VolumesNegativeTest-1416627237-project-member] Lock "00c0e0e2-4c40-45a3-829a-b6b73482e311" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:31:40 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-6ea26b8c-509b-40fd-b4b5-3149e6502e41 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad66dd72abfd2d2e13a59983bf78e8afd78d0676.part --force-share --output=json" returned: 0 in 0.218s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:31:40 user nova-compute[75165]: DEBUG nova.virt.images [None req-6ea26b8c-509b-40fd-b4b5-3149e6502e41 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] af3918b0-ca43-4f6c-8789-b8d88fd0be00 was qcow2, converting to raw {{(pid=75165) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 26 00:31:40 user nova-compute[75165]: DEBUG nova.privsep.utils [None req-6ea26b8c-509b-40fd-b4b5-3149e6502e41 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75165) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 26 00:31:40 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-6ea26b8c-509b-40fd-b4b5-3149e6502e41 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ad66dd72abfd2d2e13a59983bf78e8afd78d0676.part /opt/stack/data/nova/instances/_base/ad66dd72abfd2d2e13a59983bf78e8afd78d0676.converted {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:31:40 user nova-compute[75165]: DEBUG nova.compute.manager [None req-73316ea5-9517-41aa-be76-989a0fab9892 tempest-VolumesNegativeTest-1416627237 tempest-VolumesNegativeTest-1416627237-project-member] [instance: 00c0e0e2-4c40-45a3-829a-b6b73482e311] Starting instance... {{(pid=75165) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 00:31:40 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-73316ea5-9517-41aa-be76-989a0fab9892 tempest-VolumesNegativeTest-1416627237 tempest-VolumesNegativeTest-1416627237-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:31:40 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-73316ea5-9517-41aa-be76-989a0fab9892 tempest-VolumesNegativeTest-1416627237 tempest-VolumesNegativeTest-1416627237-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:31:40 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-73316ea5-9517-41aa-be76-989a0fab9892 tempest-VolumesNegativeTest-1416627237 tempest-VolumesNegativeTest-1416627237-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75165) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 00:31:40 user nova-compute[75165]: INFO nova.compute.claims [None req-73316ea5-9517-41aa-be76-989a0fab9892 tempest-VolumesNegativeTest-1416627237 tempest-VolumesNegativeTest-1416627237-project-member] [instance: 00c0e0e2-4c40-45a3-829a-b6b73482e311] Claim successful on node user
Oct 26 00:31:40 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-6ea26b8c-509b-40fd-b4b5-3149e6502e41 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ad66dd72abfd2d2e13a59983bf78e8afd78d0676.part /opt/stack/data/nova/instances/_base/ad66dd72abfd2d2e13a59983bf78e8afd78d0676.converted" returned: 0 in 0.239s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:31:40 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-6ea26b8c-509b-40fd-b4b5-3149e6502e41 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad66dd72abfd2d2e13a59983bf78e8afd78d0676.converted --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:31:40 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] [instance: 250afc24-0c38-4959-a77c-d51365dd1c4e] Creating instance directory {{(pid=75165) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 00:31:40 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] [instance: 250afc24-0c38-4959-a77c-d51365dd1c4e] Creating image(s)
Oct 26 00:31:40 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] [instance: 250afc24-0c38-4959-a77c-d51365dd1c4e] Did not create local disks {{(pid=75165) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 26 00:31:40 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] [instance: 250afc24-0c38-4959-a77c-d51365dd1c4e] Ensure instance console log exists: /opt/stack/data/nova/instances/250afc24-0c38-4959-a77c-d51365dd1c4e/console.log {{(pid=75165) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 00:31:40 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:31:40 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:31:40 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:31:40 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] [instance: 250afc24-0c38-4959-a77c-d51365dd1c4e] Start _get_guest_xml network_info=[{"id": "0372e87f-5631-4444-bfe8-ae5af9f09a46", "address": "fa:16:3e:76:de:bf", "network": {"id": "3fa5f12d-c7f4-4f2f-8934-6fa94f598a4c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1095967566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf09714f89484ff5ad700a5528b8d7c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0372e87f-56", "ovs_interfaceid": "0372e87f-5631-4444-bfe8-ae5af9f09a46", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T00:03:24Z,direct_url=<?>,disk_format='qcow2',id=bff0d8a1-739e-4c4d-9efa-b73ba7b76d01,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e56bbf444fd34c348475c73673611447',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T00:03:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OQmglCFc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '250afc24-0c38-4959-a77c-d51365dd1c4e', 'attached_at': '', 'detached_at': '', 'volume_id': 'af851e79-3073-4793-929f-877775c91de0', 'serial': 'af851e79-3073-4793-929f-877775c91de0'}, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'attachment_id': '479929cf-06d5-41c4-9bef-d83d54588910', 'delete_on_termination': True, 'volume_type': None} {{(pid=75165) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 00:31:40 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Oct 26 00:31:40 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Oct 26 00:31:40 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75165) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 00:31:40 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] CPU controller missing on host. {{(pid=75165) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 00:31:40 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75165) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 00:31:40 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] CPU controller found on host. {{(pid=75165) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 00:31:40 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75165) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 00:31:40 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T00:03:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T00:03:24Z,direct_url=<?>,disk_format='qcow2',id=bff0d8a1-739e-4c4d-9efa-b73ba7b76d01,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e56bbf444fd34c348475c73673611447',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T00:03:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 00:31:40 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Flavor limits 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 00:31:40 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Image limits 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 00:31:40 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Flavor pref 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 00:31:40 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Image pref 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 00:31:40 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 00:31:40 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 00:31:40 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75165) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 00:31:40 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Got 1 possible topologies {{(pid=75165) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 00:31:40 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 00:31:40 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 00:31:40 user nova-compute[75165]: DEBUG nova.objects.instance [None req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Lazy-loading 'vcpu_model' on Instance uuid 250afc24-0c38-4959-a77c-d51365dd1c4e {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:31:40 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] [instance: 250afc24-0c38-4959-a77c-d51365dd1c4e] Calling os-brick to attach iSCSI Volume {{(pid=75165) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 00:31:40 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8bf8160e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OQmglCFc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:31:40 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 26 00:31:40 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:31:40 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:31:40 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 26 00:31:40 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:31:40 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:31:40 user nova-compute[75165]: INFO os_brick.initiator.connectors.iscsi [None req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 00:31:40 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0 -p 172.16.0.220:3260 {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:31:40 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:31:40 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f1fd75c-ffc2-4cf8-9f13-c187390f0382]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:31:40 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 00:31:40 user nova-compute[75165]:  {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:31:40 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0 -p 172.16.0.220:3260 --interface default --op new {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:31:40 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-6ea26b8c-509b-40fd-b4b5-3149e6502e41 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad66dd72abfd2d2e13a59983bf78e8afd78d0676.converted --force-share --output=json" returned: 0 in 0.181s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:31:40 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-6ea26b8c-509b-40fd-b4b5-3149e6502e41 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Lock "ad66dd72abfd2d2e13a59983bf78e8afd78d0676" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.280s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:31:40 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-6ea26b8c-509b-40fd-b4b5-3149e6502e41 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Acquiring lock "ad66dd72abfd2d2e13a59983bf78e8afd78d0676" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:31:40 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-6ea26b8c-509b-40fd-b4b5-3149e6502e41 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Lock "ad66dd72abfd2d2e13a59983bf78e8afd78d0676" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:31:40 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-6ea26b8c-509b-40fd-b4b5-3149e6502e41 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad66dd72abfd2d2e13a59983bf78e8afd78d0676 --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:31:40 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:31:40 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[3af129ae-3dbc-4ef0-a682-e15551c487cf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0] added\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:31:40 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0] added
Oct 26 00:31:40 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:31:40 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:31:40 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:31:40 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eb2f9ab-0350-4c3e-b092-ccce56161e90]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:31:40 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:31:40 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:31:40 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:31:40 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad114be9-34a8-4699-a0a8-887ea846f673]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:31:40 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:31:40 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OQmglCFc {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:31:40 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OQmglCFc" returned: 0 in 0.019s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:31:40 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6c02004-3b89-40a3-a605-22e8bf2dc373]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:31:40 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OQmglCFc'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:31:40 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:31:40 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:31:40 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[8211201d-da15-46cf-8186-9c2008f56c86]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:31:40 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:31:40 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:31:40 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-73316ea5-9517-41aa-be76-989a0fab9892 tempest-VolumesNegativeTest-1416627237 tempest-VolumesNegativeTest-1416627237-project-member] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:31:40 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:31:40 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e2de2bc-9fc0-4f13-b274-e04dc1ad0206]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20bc9a02-2908-4429-8524-fcc9553f3a29 (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:31:40 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)
Oct 26 00:31:40 user nova-compute[75165]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8 (non-flash)
Oct 26 00:31:40 user nova-compute[75165]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20bc9a02-2908-4429-8524-fcc9553f3a29 (non-flash)
Oct 26 00:31:40 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:31:40 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)
Oct 26 00:31:40 user nova-compute[75165]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8 (non-flash)
Oct 26 00:31:40 user nova-compute[75165]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20bc9a02-2908-4429-8524-fcc9553f3a29 (non-flash)
Oct 26 00:31:40 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:31:40 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-6ea26b8c-509b-40fd-b4b5-3149e6502e41 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad66dd72abfd2d2e13a59983bf78e8afd78d0676 --force-share --output=json" returned: 0 in 0.179s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:31:40 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-6ea26b8c-509b-40fd-b4b5-3149e6502e41 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad66dd72abfd2d2e13a59983bf78e8afd78d0676,backing_fmt=raw /opt/stack/data/nova/instances/c7a55179-cde6-4fbd-a8b3-c3df149bc6f3/disk.rescue {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:31:40 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0 -p 172.16.0.220:3260 --login {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:31:40 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-73316ea5-9517-41aa-be76-989a0fab9892 tempest-VolumesNegativeTest-1416627237 tempest-VolumesNegativeTest-1416627237-project-member] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:31:40 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:31:40 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4f258b8-8f7c-41e1-8654-1f631db11aac]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:31:40 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0, portal: 172.16.0.220,3260]
Oct 26 00:31:40 user nova-compute[75165]: Login to [iface: default, target: iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0, portal: 172.16.0.220,3260] successful.
Oct 26 00:31:40 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:31:40 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-6ea26b8c-509b-40fd-b4b5-3149e6502e41 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad66dd72abfd2d2e13a59983bf78e8afd78d0676,backing_fmt=raw /opt/stack/data/nova/instances/c7a55179-cde6-4fbd-a8b3-c3df149bc6f3/disk.rescue" returned: 0 in 0.064s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:31:40 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-6ea26b8c-509b-40fd-b4b5-3149e6502e41 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Lock "ad66dd72abfd2d2e13a59983bf78e8afd78d0676" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:31:40 user nova-compute[75165]: DEBUG nova.objects.instance [None req-6ea26b8c-509b-40fd-b4b5-3149e6502e41 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Lazy-loading 'migration_context' on Instance uuid c7a55179-cde6-4fbd-a8b3-c3df149bc6f3 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:31:40 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:31:40 user nova-compute[75165]: DEBUG nova.objects.base [None req-6ea26b8c-509b-40fd-b4b5-3149e6502e41 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Object Instance<c7a55179-cde6-4fbd-a8b3-c3df149bc6f3> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75165) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 00:31:40 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-6ea26b8c-509b-40fd-b4b5-3149e6502e41 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: c7a55179-cde6-4fbd-a8b3-c3df149bc6f3] Created local disks {{(pid=75165) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 00:31:40 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-6ea26b8c-509b-40fd-b4b5-3149e6502e41 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: c7a55179-cde6-4fbd-a8b3-c3df149bc6f3] Start _get_guest_xml network_info=[{"id": "70711118-68ee-4ea5-bfc2-df652ed0f3c1", "address": "fa:16:3e:91:b1:a6", "network": {"id": "eb55c0bc-cae5-4ba3-851a-e31a50b52c88", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1081223830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1081223830-network", "vif_mac": "fa:16:3e:91:b1:a6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d616862c7c184de5b0ba3121552c5666", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70711118-68", "ovs_interfaceid": "70711118-68ee-4ea5-bfc2-df652ed0f3c1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T00:03:24Z,direct_url=<?>,disk_format='qcow2',id=bff0d8a1-739e-4c4d-9efa-b73ba7b76d01,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e56bbf444fd34c348475c73673611447',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T00:03:26Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'af3918b0-ca43-4f6c-8789-b8d88fd0be00', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nWaNcYSH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'c7a55179-cde6-4fbd-a8b3-c3df149bc6f3', 'attached_at': '', 'detached_at': '', 'volume_id': 'd249e808-e145-4ed5-a1a6-a550f7c6b3b8', 'serial': 'd249e808-e145-4ed5-a1a6-a550f7c6b3b8'}, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'attachment_id': '35974d6f-b38c-499b-bfee-122434ec2778', 'delete_on_termination': False, 'volume_type': None} {{(pid=75165) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 00:31:40 user nova-compute[75165]: DEBUG nova.objects.instance [None req-6ea26b8c-509b-40fd-b4b5-3149e6502e41 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Lazy-loading 'resources' on Instance uuid c7a55179-cde6-4fbd-a8b3-c3df149bc6f3 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:31:40 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:31:40 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c1b14b9-36b8-4b19-aa20-a514529a1207]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:31:40 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-73316ea5-9517-41aa-be76-989a0fab9892 tempest-VolumesNegativeTest-1416627237 tempest-VolumesNegativeTest-1416627237-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.530s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:31:40 user nova-compute[75165]: DEBUG nova.compute.manager [None req-73316ea5-9517-41aa-be76-989a0fab9892 tempest-VolumesNegativeTest-1416627237 tempest-VolumesNegativeTest-1416627237-project-member] [instance: 00c0e0e2-4c40-45a3-829a-b6b73482e311] Start building networks asynchronously for instance. {{(pid=75165) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 00:31:40 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:31:40 user nova-compute[75165]: DEBUG nova.objects.base [None req-6ea26b8c-509b-40fd-b4b5-3149e6502e41 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Object Instance<c7a55179-cde6-4fbd-a8b3-c3df149bc6f3> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75165) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 00:31:40 user nova-compute[75165]: DEBUG nova.objects.instance [None req-6ea26b8c-509b-40fd-b4b5-3149e6502e41 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Lazy-loading 'numa_topology' on Instance uuid c7a55179-cde6-4fbd-a8b3-c3df149bc6f3 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:31:40 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:31:40 user nova-compute[75165]: DEBUG nova.objects.base [None req-6ea26b8c-509b-40fd-b4b5-3149e6502e41 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Object Instance<c7a55179-cde6-4fbd-a8b3-c3df149bc6f3> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75165) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 00:31:40 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-6ea26b8c-509b-40fd-b4b5-3149e6502e41 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:31:40 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-6ea26b8c-509b-40fd-b4b5-3149e6502e41 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:31:40 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:31:40 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c94ea89-d5d8-475e-b729-b6b6e9e1c33e]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20bc9a02-2908-4429-8524-fcc9553f3a29 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0 (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:31:40 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)
Oct 26 00:31:40 user nova-compute[75165]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8 (non-flash)
Oct 26 00:31:40 user nova-compute[75165]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20bc9a02-2908-4429-8524-fcc9553f3a29 (non-flash)
Oct 26 00:31:40 user nova-compute[75165]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0 (non-flash)
Oct 26 00:31:40 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:31:40 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)
Oct 26 00:31:40 user nova-compute[75165]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8 (non-flash)
Oct 26 00:31:40 user nova-compute[75165]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20bc9a02-2908-4429-8524-fcc9553f3a29 (non-flash)
Oct 26 00:31:40 user nova-compute[75165]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0 (non-flash)
Oct 26 00:31:40 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:31:40 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.348s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:31:40 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Connected to 172.16.0.220:3260 {{(pid=75165) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 00:31:40 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] HCTL ('36', '-', '-', 0) found on session 39 with lun 0 {{(pid=75165) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 00:31:40 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75165) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 00:31:40 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-6ea26b8c-509b-40fd-b4b5-3149e6502e41 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75165) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 00:31:40 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-6ea26b8c-509b-40fd-b4b5-3149e6502e41 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] CPU controller missing on host. {{(pid=75165) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 00:31:40 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:31:40 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-6ea26b8c-509b-40fd-b4b5-3149e6502e41 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75165) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 00:31:40 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-6ea26b8c-509b-40fd-b4b5-3149e6502e41 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] CPU controller found on host. {{(pid=75165) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 00:31:40 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-6ea26b8c-509b-40fd-b4b5-3149e6502e41 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75165) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 00:31:40 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-6ea26b8c-509b-40fd-b4b5-3149e6502e41 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T00:03:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T00:03:24Z,direct_url=<?>,disk_format='qcow2',id=bff0d8a1-739e-4c4d-9efa-b73ba7b76d01,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e56bbf444fd34c348475c73673611447',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T00:03:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 00:31:40 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-6ea26b8c-509b-40fd-b4b5-3149e6502e41 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Flavor limits 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 00:31:40 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-6ea26b8c-509b-40fd-b4b5-3149e6502e41 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Image limits 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 00:31:40 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-6ea26b8c-509b-40fd-b4b5-3149e6502e41 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Flavor pref 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 00:31:40 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-6ea26b8c-509b-40fd-b4b5-3149e6502e41 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Image pref 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 00:31:40 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-6ea26b8c-509b-40fd-b4b5-3149e6502e41 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 00:31:40 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-6ea26b8c-509b-40fd-b4b5-3149e6502e41 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 00:31:40 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-6ea26b8c-509b-40fd-b4b5-3149e6502e41 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75165) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 00:31:40 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-6ea26b8c-509b-40fd-b4b5-3149e6502e41 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Got 1 possible topologies {{(pid=75165) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 00:31:40 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-6ea26b8c-509b-40fd-b4b5-3149e6502e41 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 00:31:40 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-6ea26b8c-509b-40fd-b4b5-3149e6502e41 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 00:31:40 user nova-compute[75165]: DEBUG nova.objects.instance [None req-6ea26b8c-509b-40fd-b4b5-3149e6502e41 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Lazy-loading 'vcpu_model' on Instance uuid c7a55179-cde6-4fbd-a8b3-c3df149bc6f3 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:31:40 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:31:40 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[1263be7a-a7a3-4cf7-9fb9-e0693694588c]: (4, ('- - 0', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:31:40 user nova-compute[75165]: DEBUG nova.compute.manager [None req-73316ea5-9517-41aa-be76-989a0fab9892 tempest-VolumesNegativeTest-1416627237 tempest-VolumesNegativeTest-1416627237-project-member] [instance: 00c0e0e2-4c40-45a3-829a-b6b73482e311] Allocating IP information in the background. {{(pid=75165) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 00:31:40 user nova-compute[75165]: DEBUG nova.network.neutron [None req-73316ea5-9517-41aa-be76-989a0fab9892 tempest-VolumesNegativeTest-1416627237 tempest-VolumesNegativeTest-1416627237-project-member] [instance: 00c0e0e2-4c40-45a3-829a-b6b73482e311] allocate_for_instance() {{(pid=75165) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 00:31:40 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Searching for a device in session 39 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75165) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 00:31:40 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OQmglCFc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75165) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 00:31:40 user nova-compute[75165]: DEBUG nova.objects.base [None req-6ea26b8c-509b-40fd-b4b5-3149e6502e41 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Object Instance<c7a55179-cde6-4fbd-a8b3-c3df149bc6f3> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75165) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 00:31:41 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ea26b8c-509b-40fd-b4b5-3149e6502e41 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: c7a55179-cde6-4fbd-a8b3-c3df149bc6f3] Calling os-brick to attach iSCSI Volume {{(pid=75165) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 00:31:41 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ea26b8c-509b-40fd-b4b5-3149e6502e41 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8bf8160e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nWaNcYSH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:31:41 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-6ea26b8c-509b-40fd-b4b5-3149e6502e41 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:31:41 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-6ea26b8c-509b-40fd-b4b5-3149e6502e41 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:31:41 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-73316ea5-9517-41aa-be76-989a0fab9892 tempest-VolumesNegativeTest-1416627237 tempest-VolumesNegativeTest-1416627237-project-member] [instance: 00c0e0e2-4c40-45a3-829a-b6b73482e311] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 00:31:41 user nova-compute[75165]: DEBUG nova.compute.manager [None req-73316ea5-9517-41aa-be76-989a0fab9892 tempest-VolumesNegativeTest-1416627237 tempest-VolumesNegativeTest-1416627237-project-member] [instance: 00c0e0e2-4c40-45a3-829a-b6b73482e311] Start building block device mappings for instance. {{(pid=75165) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 00:31:41 user nova-compute[75165]: DEBUG nova.compute.manager [None req-73316ea5-9517-41aa-be76-989a0fab9892 tempest-VolumesNegativeTest-1416627237 tempest-VolumesNegativeTest-1416627237-project-member] [instance: 00c0e0e2-4c40-45a3-829a-b6b73482e311] Start spawning the instance on the hypervisor. {{(pid=75165) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 00:31:41 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-73316ea5-9517-41aa-be76-989a0fab9892 tempest-VolumesNegativeTest-1416627237 tempest-VolumesNegativeTest-1416627237-project-member] [instance: 00c0e0e2-4c40-45a3-829a-b6b73482e311] Creating instance directory {{(pid=75165) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 00:31:41 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-73316ea5-9517-41aa-be76-989a0fab9892 tempest-VolumesNegativeTest-1416627237 tempest-VolumesNegativeTest-1416627237-project-member] [instance: 00c0e0e2-4c40-45a3-829a-b6b73482e311] Creating image(s)
Oct 26 00:31:41 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-73316ea5-9517-41aa-be76-989a0fab9892 tempest-VolumesNegativeTest-1416627237 tempest-VolumesNegativeTest-1416627237-project-member] Acquiring lock "/opt/stack/data/nova/instances/00c0e0e2-4c40-45a3-829a-b6b73482e311/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:31:41 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-73316ea5-9517-41aa-be76-989a0fab9892 tempest-VolumesNegativeTest-1416627237 tempest-VolumesNegativeTest-1416627237-project-member] Lock "/opt/stack/data/nova/instances/00c0e0e2-4c40-45a3-829a-b6b73482e311/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:31:41 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-73316ea5-9517-41aa-be76-989a0fab9892 tempest-VolumesNegativeTest-1416627237 tempest-VolumesNegativeTest-1416627237-project-member] Lock "/opt/stack/data/nova/instances/00c0e0e2-4c40-45a3-829a-b6b73482e311/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:31:41 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-73316ea5-9517-41aa-be76-989a0fab9892 tempest-VolumesNegativeTest-1416627237 tempest-VolumesNegativeTest-1416627237-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:31:41 user nova-compute[75165]: DEBUG nova.policy [None req-73316ea5-9517-41aa-be76-989a0fab9892 tempest-VolumesNegativeTest-1416627237 tempest-VolumesNegativeTest-1416627237-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '251d5d7c57f147c68f9739e9889d08a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd728263a73f94098b89833123a36704b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75165) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 00:31:41 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-73316ea5-9517-41aa-be76-989a0fab9892 tempest-VolumesNegativeTest-1416627237 tempest-VolumesNegativeTest-1416627237-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json" returned: 0 in 0.180s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:31:41 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-73316ea5-9517-41aa-be76-989a0fab9892 tempest-VolumesNegativeTest-1416627237 tempest-VolumesNegativeTest-1416627237-project-member] Acquiring lock "7d3243421cf3fdc288b758f687a93103b7b95466" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:31:41 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-73316ea5-9517-41aa-be76-989a0fab9892 tempest-VolumesNegativeTest-1416627237 tempest-VolumesNegativeTest-1416627237-project-member] Lock "7d3243421cf3fdc288b758f687a93103b7b95466" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:31:41 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-73316ea5-9517-41aa-be76-989a0fab9892 tempest-VolumesNegativeTest-1416627237 tempest-VolumesNegativeTest-1416627237-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:31:41 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-73316ea5-9517-41aa-be76-989a0fab9892 tempest-VolumesNegativeTest-1416627237 tempest-VolumesNegativeTest-1416627237-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json" returned: 0 in 0.176s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:31:41 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-73316ea5-9517-41aa-be76-989a0fab9892 tempest-VolumesNegativeTest-1416627237 tempest-VolumesNegativeTest-1416627237-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466,backing_fmt=raw /opt/stack/data/nova/instances/00c0e0e2-4c40-45a3-829a-b6b73482e311/disk 1073741824 {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:31:41 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-73316ea5-9517-41aa-be76-989a0fab9892 tempest-VolumesNegativeTest-1416627237 tempest-VolumesNegativeTest-1416627237-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466,backing_fmt=raw /opt/stack/data/nova/instances/00c0e0e2-4c40-45a3-829a-b6b73482e311/disk 1073741824" returned: 0 in 0.057s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:31:41 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-73316ea5-9517-41aa-be76-989a0fab9892 tempest-VolumesNegativeTest-1416627237 tempest-VolumesNegativeTest-1416627237-project-member] Lock "7d3243421cf3fdc288b758f687a93103b7b95466" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:31:41 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-73316ea5-9517-41aa-be76-989a0fab9892 tempest-VolumesNegativeTest-1416627237 tempest-VolumesNegativeTest-1416627237-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:31:41 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:31:41 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-73316ea5-9517-41aa-be76-989a0fab9892 tempest-VolumesNegativeTest-1416627237 tempest-VolumesNegativeTest-1416627237-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json" returned: 0 in 0.180s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:31:41 user nova-compute[75165]: DEBUG nova.virt.disk.api [None req-73316ea5-9517-41aa-be76-989a0fab9892 tempest-VolumesNegativeTest-1416627237 tempest-VolumesNegativeTest-1416627237-project-member] Checking if we can resize image /opt/stack/data/nova/instances/00c0e0e2-4c40-45a3-829a-b6b73482e311/disk. size=1073741824 {{(pid=75165) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 00:31:41 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-73316ea5-9517-41aa-be76-989a0fab9892 tempest-VolumesNegativeTest-1416627237 tempest-VolumesNegativeTest-1416627237-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c0e0e2-4c40-45a3-829a-b6b73482e311/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:31:41 user nova-compute[75165]: DEBUG nova.network.neutron [None req-73316ea5-9517-41aa-be76-989a0fab9892 tempest-VolumesNegativeTest-1416627237 tempest-VolumesNegativeTest-1416627237-project-member] [instance: 00c0e0e2-4c40-45a3-829a-b6b73482e311] Successfully created port: 09cc2701-0337-4975-9589-a8aa29038342 {{(pid=75165) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 00:31:41 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-73316ea5-9517-41aa-be76-989a0fab9892 tempest-VolumesNegativeTest-1416627237 tempest-VolumesNegativeTest-1416627237-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c0e0e2-4c40-45a3-829a-b6b73482e311/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:31:41 user nova-compute[75165]: DEBUG nova.virt.disk.api [None req-73316ea5-9517-41aa-be76-989a0fab9892 tempest-VolumesNegativeTest-1416627237 tempest-VolumesNegativeTest-1416627237-project-member] Cannot resize image /opt/stack/data/nova/instances/00c0e0e2-4c40-45a3-829a-b6b73482e311/disk to a smaller size. {{(pid=75165) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 00:31:41 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-73316ea5-9517-41aa-be76-989a0fab9892 tempest-VolumesNegativeTest-1416627237 tempest-VolumesNegativeTest-1416627237-project-member] [instance: 00c0e0e2-4c40-45a3-829a-b6b73482e311] Created local disks {{(pid=75165) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 00:31:41 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-73316ea5-9517-41aa-be76-989a0fab9892 tempest-VolumesNegativeTest-1416627237 tempest-VolumesNegativeTest-1416627237-project-member] [instance: 00c0e0e2-4c40-45a3-829a-b6b73482e311] Ensure instance console log exists: /opt/stack/data/nova/instances/00c0e0e2-4c40-45a3-829a-b6b73482e311/console.log {{(pid=75165) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 00:31:41 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-73316ea5-9517-41aa-be76-989a0fab9892 tempest-VolumesNegativeTest-1416627237 tempest-VolumesNegativeTest-1416627237-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:31:41 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-73316ea5-9517-41aa-be76-989a0fab9892 tempest-VolumesNegativeTest-1416627237 tempest-VolumesNegativeTest-1416627237-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:31:41 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-73316ea5-9517-41aa-be76-989a0fab9892 tempest-VolumesNegativeTest-1416627237 tempest-VolumesNegativeTest-1416627237-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:31:41 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.396s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:31:41 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] <== connect_volume: return (1397ms) {'type': 'block', 'scsi_wwn': '23565326264353065', 'path': '/dev/sde'} {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:31:41 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] [instance: 250afc24-0c38-4959-a77c-d51365dd1c4e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23565326264353065', 'path': '/dev/sde'} {{(pid=75165) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 00:31:41 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-6ea26b8c-509b-40fd-b4b5-3149e6502e41 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.978s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:31:41 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-6ea26b8c-509b-40fd-b4b5-3149e6502e41 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:31:41 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-6ea26b8c-509b-40fd-b4b5-3149e6502e41 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:31:41 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-6ea26b8c-509b-40fd-b4b5-3149e6502e41 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:31:41 user nova-compute[75165]: INFO os_brick.initiator.connectors.iscsi [None req-6ea26b8c-509b-40fd-b4b5-3149e6502e41 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 00:31:41 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8 -p 172.16.0.220:3260 {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:31:42 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8 -p 172.16.0.220:3260" returned: 0 in 0.020s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:31:42 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[c095394e-8703-4b19-8583-879f82846be7]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = nWaNcYSH\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:31:42 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ea26b8c-509b-40fd-b4b5-3149e6502e41 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Oct 26 00:31:42 user nova-compute[75165]: node.name = iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8
Oct 26 00:31:42 user nova-compute[75165]: node.tpgt = -1
Oct 26 00:31:42 user nova-compute[75165]: node.startup = automatic
Oct 26 00:31:42 user nova-compute[75165]: node.leading_login = No
Oct 26 00:31:42 user nova-compute[75165]: iface.iscsi_ifacename = default
Oct 26 00:31:42 user nova-compute[75165]: iface.net_ifacename = <empty>
Oct 26 00:31:42 user nova-compute[75165]: iface.ipaddress = <empty>
Oct 26 00:31:42 user nova-compute[75165]: iface.prefix_len = 0
Oct 26 00:31:42 user nova-compute[75165]: iface.hwaddress = <empty>
Oct 26 00:31:42 user nova-compute[75165]: iface.transport_name = tcp
Oct 26 00:31:42 user nova-compute[75165]: iface.initiatorname = <empty>
Oct 26 00:31:42 user nova-compute[75165]: iface.state = <empty>
Oct 26 00:31:42 user nova-compute[75165]: iface.vlan_id = 0
Oct 26 00:31:42 user nova-compute[75165]: iface.vlan_priority = 0
Oct 26 00:31:42 user nova-compute[75165]: iface.vlan_state = <empty>
Oct 26 00:31:42 user nova-compute[75165]: iface.iface_num = 0
Oct 26 00:31:42 user nova-compute[75165]: iface.mtu = 0
Oct 26 00:31:42 user nova-compute[75165]: iface.port = 0
Oct 26 00:31:42 user nova-compute[75165]: iface.bootproto = <empty>
Oct 26 00:31:42 user nova-compute[75165]: iface.subnet_mask = <empty>
Oct 26 00:31:42 user nova-compute[75165]: iface.gateway = <empty>
Oct 26 00:31:42 user nova-compute[75165]: iface.dhcp_alt_client_id_state = <empty>
Oct 26 00:31:42 user nova-compute[75165]: iface.dhcp_alt_client_id = <empty>
Oct 26 00:31:42 user nova-compute[75165]: iface.dhcp_dns = <empty>
Oct 26 00:31:42 user nova-compute[75165]: iface.dhcp_learn_iqn = <empty>
Oct 26 00:31:42 user nova-compute[75165]: iface.dhcp_req_vendor_id_state = <empty>
Oct 26 00:31:42 user nova-compute[75165]: iface.dhcp_vendor_id_state = <empty>
Oct 26 00:31:42 user nova-compute[75165]: iface.dhcp_vendor_id = <empty>
Oct 26 00:31:42 user nova-compute[75165]: iface.dhcp_slp_da = <empty>
Oct 26 00:31:42 user nova-compute[75165]: iface.fragmentation = <empty>
Oct 26 00:31:42 user nova-compute[75165]: iface.gratuitous_arp = <empty>
Oct 26 00:31:42 user nova-compute[75165]: iface.incoming_forwarding = <empty>
Oct 26 00:31:42 user nova-compute[75165]: iface.tos_state = <empty>
Oct 26 00:31:42 user nova-compute[75165]: iface.tos = 0
Oct 26 00:31:42 user nova-compute[75165]: iface.ttl = 0
Oct 26 00:31:42 user nova-compute[75165]: iface.delayed_ack = <empty>
Oct 26 00:31:42 user nova-compute[75165]: iface.tcp_nagle = <empty>
Oct 26 00:31:42 user nova-compute[75165]: iface.tcp_wsf_state = <empty>
Oct 26 00:31:42 user nova-compute[75165]: iface.tcp_wsf = 0
Oct 26 00:31:42 user nova-compute[75165]: iface.tcp_timer_scale = 0
Oct 26 00:31:42 user nova-compute[75165]: iface.tcp_timestamp = <empty>
Oct 26 00:31:42 user nova-compute[75165]: iface.redirect = <empty>
Oct 26 00:31:42 user nova-compute[75165]: iface.def_task_mgmt_timeout = 0
Oct 26 00:31:42 user nova-compute[75165]: iface.header_digest = <empty>
Oct 26 00:31:42 user nova-compute[75165]: iface.data_digest = <empty>
Oct 26 00:31:42 user nova-compute[75165]: iface.immediate_data = <empty>
Oct 26 00:31:42 user nova-compute[75165]: iface.initial_r2t = <empty>
Oct 26 00:31:42 user nova-compute[75165]: iface.data_seq_inorder = <empty>
Oct 26 00:31:42 user nova-compute[75165]: iface.data_pdu_inorder = <empty>
Oct 26 00:31:42 user nova-compute[75165]: iface.erl = 0
Oct 26 00:31:42 user nova-compute[75165]: iface.max_receive_data_len = 0
Oct 26 00:31:42 user nova-compute[75165]: iface.first_burst_len = 0
Oct 26 00:31:42 user nova-compute[75165]: iface.max_outstanding_r2t = 0
Oct 26 00:31:42 user nova-compute[75165]: iface.max_burst_len = 0
Oct 26 00:31:42 user nova-compute[75165]: iface.chap_auth = <empty>
Oct 26 00:31:42 user nova-compute[75165]: iface.bidi_chap = <empty>
Oct 26 00:31:42 user nova-compute[75165]: iface.strict_login_compliance = <empty>
Oct 26 00:31:42 user nova-compute[75165]: iface.discovery_auth = <empty>
Oct 26 00:31:42 user nova-compute[75165]: iface.discovery_logout = <empty>
Oct 26 00:31:42 user nova-compute[75165]: node.discovery_address = <empty>
Oct 26 00:31:42 user nova-compute[75165]: node.discovery_port = 0
Oct 26 00:31:42 user nova-compute[75165]: node.discovery_type = static
Oct 26 00:31:42 user nova-compute[75165]: node.session.initial_cmdsn = 0
Oct 26 00:31:42 user nova-compute[75165]: node.session.initial_login_retry_max = 8
Oct 26 00:31:42 user nova-compute[75165]: node.session.xmit_thread_priority = -20
Oct 26 00:31:42 user nova-compute[75165]: node.session.cmds_max = 128
Oct 26 00:31:42 user nova-compute[75165]: node.session.queue_depth = 32
Oct 26 00:31:42 user nova-compute[75165]: node.session.nr_sessions = 1
Oct 26 00:31:42 user nova-compute[75165]: node.session.auth.authmethod = CHAP
Oct 26 00:31:42 user nova-compute[75165]: node.session.auth.username = nWaNcYSH
Oct 26 00:31:42 user nova-compute[75165]: node.session.auth.password = ***
Oct 26 00:31:42 user nova-compute[75165]: node.session.auth.username_in = <empty>
Oct 26 00:31:42 user nova-compute[75165]: node.session.auth.password_in = <empty>
Oct 26 00:31:42 user nova-compute[75165]: node.session.auth.chap_algs = MD5
Oct 26 00:31:42 user nova-compute[75165]: node.session.timeo.replacement_timeout = 120
Oct 26 00:31:42 user nova-compute[75165]: node.session.err_timeo.abort_timeout = 15
Oct 26 00:31:42 user nova-compute[75165]: node.session.err_timeo.lu_reset_timeout = 30
Oct 26 00:31:42 user nova-compute[75165]: node.session.err_timeo.tgt_reset_timeout = 30
Oct 26 00:31:42 user nova-compute[75165]: node.session.err_timeo.host_reset_timeout = 60
Oct 26 00:31:42 user nova-compute[75165]: node.session.iscsi.FastAbort = Yes
Oct 26 00:31:42 user nova-compute[75165]: node.session.iscsi.InitialR2T = No
Oct 26 00:31:42 user nova-compute[75165]: node.session.iscsi.ImmediateData = Yes
Oct 26 00:31:42 user nova-compute[75165]: node.session.iscsi.FirstBurstLength = 262144
Oct 26 00:31:42 user nova-compute[75165]: node.session.iscsi.MaxBurstLength = 16776192
Oct 26 00:31:42 user nova-compute[75165]: node.session.iscsi.DefaultTime2Retain = 0
Oct 26 00:31:42 user nova-compute[75165]: node.session.iscsi.DefaultTime2Wait = 2
Oct 26 00:31:42 user nova-compute[75165]: node.session.iscsi.MaxConnections = 1
Oct 26 00:31:42 user nova-compute[75165]: node.session.iscsi.MaxOutstandingR2T = 1
Oct 26 00:31:42 user nova-compute[75165]: node.session.iscsi.ERL = 0
Oct 26 00:31:42 user nova-compute[75165]: node.session.scan = manual
Oct 26 00:31:42 user nova-compute[75165]: node.session.reopen_max = 0
Oct 26 00:31:42 user nova-compute[75165]: node.conn[0].address = 172.16.0.220
Oct 26 00:31:42 user nova-compute[75165]: node.conn[0].port = 3260
Oct 26 00:31:42 user nova-compute[75165]: node.conn[0].startup = manual
Oct 26 00:31:42 user nova-compute[75165]: node.conn[0].tcp.window_size = 524288
Oct 26 00:31:42 user nova-compute[75165]: node.conn[0].tcp.type_of_service = 0
Oct 26 00:31:42 user nova-compute[75165]: node.conn[0].timeo.logout_timeout = 15
Oct 26 00:31:42 user nova-compute[75165]: node.conn[0].timeo.login_timeout = 15
Oct 26 00:31:42 user nova-compute[75165]: node.conn[0].timeo.auth_timeout = 45
Oct 26 00:31:42 user nova-compute[75165]: node.conn[0].timeo.noop_out_interval = 5
Oct 26 00:31:42 user nova-compute[75165]: node.conn[0].timeo.noop_out_timeout = 5
Oct 26 00:31:42 user nova-compute[75165]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Oct 26 00:31:42 user nova-compute[75165]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Oct 26 00:31:42 user nova-compute[75165]: node.conn[0].iscsi.HeaderDigest = None
Oct 26 00:31:42 user nova-compute[75165]: node.conn[0].iscsi.DataDigest = None
Oct 26 00:31:42 user nova-compute[75165]: node.conn[0].iscsi.IFMarker = No
Oct 26 00:31:42 user nova-compute[75165]: node.conn[0].iscsi.OFMarker = No
Oct 26 00:31:42 user nova-compute[75165]: # END RECORD
Oct 26 00:31:42 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:31:42 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-26T00:28:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1619637514',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1212881648',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFEgAg/Q1sMeId7lJYLOcThhEJxasXz49LMiw6Ps6oE3Fcs9iqtrJ+O72pBFxY/rgxlAUWtLD4fFFfgvtCEdgpuiC+rAwqWmjPE8j/TwqxmovOpzhEUnuTgmVOvLZYE6qw==',key_name='tempest-keypair-1823122855',keypairs=<?>,launch_index=0,launched_at=2023-10-26T00:29:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='cf09714f89484ff5ad700a5528b8d7c8',ramdisk_id='',reservation_id='r-e88bj6ps',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1175798990',owner_user_name='tempest-ServerActionsV293TestJSON-1175798990-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T00:31:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2c471e2bc8dc4e5f93dd321369821a99',uuid=250afc24-0c38-4959-a77c-d51365dd1c4e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0372e87f-5631-4444-bfe8-ae5af9f09a46", "address": "fa:16:3e:76:de:bf", "network": {"id": "3fa5f12d-c7f4-4f2f-8934-6fa94f598a4c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1095967566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf09714f89484ff5ad700a5528b8d7c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0372e87f-56", "ovs_interfaceid": "0372e87f-5631-4444-bfe8-ae5af9f09a46", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75165) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 00:31:42 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Converting VIF {"id": "0372e87f-5631-4444-bfe8-ae5af9f09a46", "address": "fa:16:3e:76:de:bf", "network": {"id": "3fa5f12d-c7f4-4f2f-8934-6fa94f598a4c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1095967566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf09714f89484ff5ad700a5528b8d7c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0372e87f-56", "ovs_interfaceid": "0372e87f-5631-4444-bfe8-ae5af9f09a46", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:31:42 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:76:de:bf,bridge_name='br-int',has_traffic_filtering=True,id=0372e87f-5631-4444-bfe8-ae5af9f09a46,network=Network(3fa5f12d-c7f4-4f2f-8934-6fa94f598a4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0372e87f-56') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:31:42 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] [instance: 250afc24-0c38-4959-a77c-d51365dd1c4e] End _get_guest_xml xml=<domain type="kvm">
Oct 26 00:31:42 user nova-compute[75165]:   <uuid>250afc24-0c38-4959-a77c-d51365dd1c4e</uuid>
Oct 26 00:31:42 user nova-compute[75165]:   <name>instance-00000022</name>
Oct 26 00:31:42 user nova-compute[75165]:   <memory>524288</memory>
Oct 26 00:31:42 user nova-compute[75165]:   <vcpu>1</vcpu>
Oct 26 00:31:42 user nova-compute[75165]:   <metadata>
Oct 26 00:31:42 user nova-compute[75165]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 00:31:42 user nova-compute[75165]:       <nova:package version="0.0.0"/>
Oct 26 00:31:42 user nova-compute[75165]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1619637514</nova:name>
Oct 26 00:31:42 user nova-compute[75165]:       <nova:creationTime>2023-10-26 00:31:40</nova:creationTime>
Oct 26 00:31:42 user nova-compute[75165]:       <nova:flavor name="m1.tiny">
Oct 26 00:31:42 user nova-compute[75165]:         <nova:memory>512</nova:memory>
Oct 26 00:31:42 user nova-compute[75165]:         <nova:disk>1</nova:disk>
Oct 26 00:31:42 user nova-compute[75165]:         <nova:swap>0</nova:swap>
Oct 26 00:31:42 user nova-compute[75165]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 00:31:42 user nova-compute[75165]:         <nova:vcpus>1</nova:vcpus>
Oct 26 00:31:42 user nova-compute[75165]:       </nova:flavor>
Oct 26 00:31:42 user nova-compute[75165]:       <nova:owner>
Oct 26 00:31:42 user nova-compute[75165]:         <nova:user uuid="2c471e2bc8dc4e5f93dd321369821a99">tempest-ServerActionsV293TestJSON-1175798990-project-member</nova:user>
Oct 26 00:31:42 user nova-compute[75165]:         <nova:project uuid="cf09714f89484ff5ad700a5528b8d7c8">tempest-ServerActionsV293TestJSON-1175798990</nova:project>
Oct 26 00:31:42 user nova-compute[75165]:       </nova:owner>
Oct 26 00:31:42 user nova-compute[75165]:       <nova:ports>
Oct 26 00:31:42 user nova-compute[75165]:         <nova:port uuid="0372e87f-5631-4444-bfe8-ae5af9f09a46">
Oct 26 00:31:42 user nova-compute[75165]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 26 00:31:42 user nova-compute[75165]:         </nova:port>
Oct 26 00:31:42 user nova-compute[75165]:       </nova:ports>
Oct 26 00:31:42 user nova-compute[75165]:     </nova:instance>
Oct 26 00:31:42 user nova-compute[75165]:   </metadata>
Oct 26 00:31:42 user nova-compute[75165]:   <sysinfo type="smbios">
Oct 26 00:31:42 user nova-compute[75165]:     <system>
Oct 26 00:31:42 user nova-compute[75165]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 00:31:42 user nova-compute[75165]:       <entry name="product">OpenStack Nova</entry>
Oct 26 00:31:42 user nova-compute[75165]:       <entry name="version">0.0.0</entry>
Oct 26 00:31:42 user nova-compute[75165]:       <entry name="serial">250afc24-0c38-4959-a77c-d51365dd1c4e</entry>
Oct 26 00:31:42 user nova-compute[75165]:       <entry name="uuid">250afc24-0c38-4959-a77c-d51365dd1c4e</entry>
Oct 26 00:31:42 user nova-compute[75165]:       <entry name="family">Virtual Machine</entry>
Oct 26 00:31:42 user nova-compute[75165]:     </system>
Oct 26 00:31:42 user nova-compute[75165]:   </sysinfo>
Oct 26 00:31:42 user nova-compute[75165]:   <os>
Oct 26 00:31:42 user nova-compute[75165]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 00:31:42 user nova-compute[75165]:     <boot dev="hd"/>
Oct 26 00:31:42 user nova-compute[75165]:     <smbios mode="sysinfo"/>
Oct 26 00:31:42 user nova-compute[75165]:   </os>
Oct 26 00:31:42 user nova-compute[75165]:   <features>
Oct 26 00:31:42 user nova-compute[75165]:     <acpi/>
Oct 26 00:31:42 user nova-compute[75165]:     <apic/>
Oct 26 00:31:42 user nova-compute[75165]:     <vmcoreinfo/>
Oct 26 00:31:42 user nova-compute[75165]:   </features>
Oct 26 00:31:42 user nova-compute[75165]:   <clock offset="utc">
Oct 26 00:31:42 user nova-compute[75165]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 00:31:42 user nova-compute[75165]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 00:31:42 user nova-compute[75165]:     <timer name="hpet" present="no"/>
Oct 26 00:31:42 user nova-compute[75165]:   </clock>
Oct 26 00:31:42 user nova-compute[75165]:   <cpu mode="custom" match="exact">
Oct 26 00:31:42 user nova-compute[75165]:     <model>Nehalem</model>
Oct 26 00:31:42 user nova-compute[75165]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 00:31:42 user nova-compute[75165]:   </cpu>
Oct 26 00:31:42 user nova-compute[75165]:   <devices>
Oct 26 00:31:42 user nova-compute[75165]:     <disk type="block" device="disk">
Oct 26 00:31:42 user nova-compute[75165]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 00:31:42 user nova-compute[75165]:       <source dev="/dev/sde"/>
Oct 26 00:31:42 user nova-compute[75165]:       <target dev="vda" bus="virtio"/>
Oct 26 00:31:42 user nova-compute[75165]:       <serial>af851e79-3073-4793-929f-877775c91de0</serial>
Oct 26 00:31:42 user nova-compute[75165]:     </disk>
Oct 26 00:31:42 user nova-compute[75165]:     <interface type="ethernet">
Oct 26 00:31:42 user nova-compute[75165]:       <mac address="fa:16:3e:76:de:bf"/>
Oct 26 00:31:42 user nova-compute[75165]:       <model type="virtio"/>
Oct 26 00:31:42 user nova-compute[75165]:       <mtu size="1442"/>
Oct 26 00:31:42 user nova-compute[75165]:       <target dev="tap0372e87f-56"/>
Oct 26 00:31:42 user nova-compute[75165]:     </interface>
Oct 26 00:31:42 user nova-compute[75165]:     <serial type="pty">
Oct 26 00:31:42 user nova-compute[75165]:       <log file="/opt/stack/data/nova/instances/250afc24-0c38-4959-a77c-d51365dd1c4e/console.log" append="off"/>
Oct 26 00:31:42 user nova-compute[75165]:     </serial>
Oct 26 00:31:42 user nova-compute[75165]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 00:31:42 user nova-compute[75165]:     <video>
Oct 26 00:31:42 user nova-compute[75165]:       <model type="virtio"/>
Oct 26 00:31:42 user nova-compute[75165]:     </video>
Oct 26 00:31:42 user nova-compute[75165]:     <rng model="virtio">
Oct 26 00:31:42 user nova-compute[75165]:       <backend model="random">/dev/urandom</backend>
Oct 26 00:31:42 user nova-compute[75165]:     </rng>
Oct 26 00:31:42 user nova-compute[75165]:     <controller type="usb" index="0" model="none"/>
Oct 26 00:31:42 user nova-compute[75165]:     <memballoon model="virtio">
Oct 26 00:31:42 user nova-compute[75165]:       <stats period="10"/>
Oct 26 00:31:42 user nova-compute[75165]:     </memballoon>
Oct 26 00:31:42 user nova-compute[75165]:   </devices>
Oct 26 00:31:42 user nova-compute[75165]: </domain>
Oct 26 00:31:42 user nova-compute[75165]:  {{(pid=75165) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 00:31:42 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-26T00:28:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1619637514',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1212881648',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFEgAg/Q1sMeId7lJYLOcThhEJxasXz49LMiw6Ps6oE3Fcs9iqtrJ+O72pBFxY/rgxlAUWtLD4fFFfgvtCEdgpuiC+rAwqWmjPE8j/TwqxmovOpzhEUnuTgmVOvLZYE6qw==',key_name='tempest-keypair-1823122855',keypairs=<?>,launch_index=0,launched_at=2023-10-26T00:29:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='cf09714f89484ff5ad700a5528b8d7c8',ramdisk_id='',reservation_id='r-e88bj6ps',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1175798990',owner_user_name='tempest-ServerActionsV293TestJSON-1175798990-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T00:31:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2c471e2bc8dc4e5f93dd321369821a99',uuid=250afc24-0c38-4959-a77c-d51365dd1c4e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0372e87f-5631-4444-bfe8-ae5af9f09a46", "address": "fa:16:3e:76:de:bf", "network": {"id": "3fa5f12d-c7f4-4f2f-8934-6fa94f598a4c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1095967566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf09714f89484ff5ad700a5528b8d7c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0372e87f-56", "ovs_interfaceid": "0372e87f-5631-4444-bfe8-ae5af9f09a46", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 00:31:42 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Converting VIF {"id": "0372e87f-5631-4444-bfe8-ae5af9f09a46", "address": "fa:16:3e:76:de:bf", "network": {"id": "3fa5f12d-c7f4-4f2f-8934-6fa94f598a4c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1095967566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf09714f89484ff5ad700a5528b8d7c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0372e87f-56", "ovs_interfaceid": "0372e87f-5631-4444-bfe8-ae5af9f09a46", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:31:42 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:76:de:bf,bridge_name='br-int',has_traffic_filtering=True,id=0372e87f-5631-4444-bfe8-ae5af9f09a46,network=Network(3fa5f12d-c7f4-4f2f-8934-6fa94f598a4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0372e87f-56') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:31:42 user nova-compute[75165]: DEBUG os_vif [None req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:76:de:bf,bridge_name='br-int',has_traffic_filtering=True,id=0372e87f-5631-4444-bfe8-ae5af9f09a46,network=Network(3fa5f12d-c7f4-4f2f-8934-6fa94f598a4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0372e87f-56') {{(pid=75165) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 00:31:42 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:31:42 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:31:42 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:31:42 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 00:31:42 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:31:42 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a229fe34-d625-5d83-bf77-90778562b637', '_type': 'linux-noop'}}, row=False) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:31:42 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:31:42 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:31:42 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.048s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:31:42 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[50a2b568-e134-40f2-97c4-138ad3fab779]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:31:42 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ea26b8c-509b-40fd-b4b5-3149e6502e41 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:31:42 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:31:42 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:31:42 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:31:42 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0372e87f-56, may_exist=True, interface_attrs={}) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:31:42 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0372e87f-56, col_values=(('qos', UUID('2e355d67-f6d7-4540-8e4a-47634817aae2')),), if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:31:42 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0372e87f-56, col_values=(('external_ids', {'iface-id': '0372e87f-5631-4444-bfe8-ae5af9f09a46', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:76:de:bf', 'vm-uuid': '250afc24-0c38-4959-a77c-d51365dd1c4e'}),), if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:31:42 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:31:42 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:31:42 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:31:42 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[799a5525-3221-4a43-9b12-50b68898f840]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:31:42 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ea26b8c-509b-40fd-b4b5-3149e6502e41 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:31:42 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nWaNcYSH {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:31:42 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:31:42 user nova-compute[75165]: INFO os_vif [None req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:76:de:bf,bridge_name='br-int',has_traffic_filtering=True,id=0372e87f-5631-4444-bfe8-ae5af9f09a46,network=Network(3fa5f12d-c7f4-4f2f-8934-6fa94f598a4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0372e87f-56')
Oct 26 00:31:42 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nWaNcYSH" returned: 0 in 0.020s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:31:42 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e118a7a-ac5d-4173-86cc-7d93c32e895c]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:31:42 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ea26b8c-509b-40fd-b4b5-3149e6502e41 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nWaNcYSH'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:31:42 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:31:42 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:31:42 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[facb0f8b-5bf1-48b5-b0e6-ce7c64a6baac]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:31:42 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ea26b8c-509b-40fd-b4b5-3149e6502e41 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:31:42 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:31:42 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:31:42 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[31de85f5-9ceb-4fdc-9c48-554dc385087d]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20bc9a02-2908-4429-8524-fcc9553f3a29 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0 (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:31:42 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ea26b8c-509b-40fd-b4b5-3149e6502e41 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)
Oct 26 00:31:42 user nova-compute[75165]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8 (non-flash)
Oct 26 00:31:42 user nova-compute[75165]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20bc9a02-2908-4429-8524-fcc9553f3a29 (non-flash)
Oct 26 00:31:42 user nova-compute[75165]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0 (non-flash)
Oct 26 00:31:42 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:31:42 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ea26b8c-509b-40fd-b4b5-3149e6502e41 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)
Oct 26 00:31:42 user nova-compute[75165]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8 (non-flash)
Oct 26 00:31:42 user nova-compute[75165]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20bc9a02-2908-4429-8524-fcc9553f3a29 (non-flash)
Oct 26 00:31:42 user nova-compute[75165]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0 (non-flash)
Oct 26 00:31:42 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:31:42 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-6ea26b8c-509b-40fd-b4b5-3149e6502e41 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.181s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:31:42 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ea26b8c-509b-40fd-b4b5-3149e6502e41 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Connected to 172.16.0.220:3260 {{(pid=75165) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 00:31:42 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-6ea26b8c-509b-40fd-b4b5-3149e6502e41 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] HCTL ('34', '0', '0', 0) found on session 35 with lun 0 {{(pid=75165) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 00:31:42 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-6ea26b8c-509b-40fd-b4b5-3149e6502e41 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=75165) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 00:31:42 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:31:42 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] No BDM found with device name vda, not building metadata. {{(pid=75165) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 00:31:42 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] No VIF found with MAC fa:16:3e:76:de:bf, not building metadata {{(pid=75165) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 00:31:42 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.014s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:31:42 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e7d8fc9-0053-4c60-9f4b-a45fd279cf0c]: (4, ('0 0 0', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:31:42 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-6ea26b8c-509b-40fd-b4b5-3149e6502e41 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Searching for a device in session 35 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=75165) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 00:31:42 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ea26b8c-509b-40fd-b4b5-3149e6502e41 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nWaNcYSH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75165) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 00:31:42 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-6ea26b8c-509b-40fd-b4b5-3149e6502e41 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.206s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:31:42 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ea26b8c-509b-40fd-b4b5-3149e6502e41 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] <== connect_volume: return (1184ms) {'type': 'block', 'scsi_wwn': '26333323866393330', 'path': '/dev/sdc'} {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:31:42 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ea26b8c-509b-40fd-b4b5-3149e6502e41 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: c7a55179-cde6-4fbd-a8b3-c3df149bc6f3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26333323866393330', 'path': '/dev/sdc'} {{(pid=75165) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 00:31:42 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-6ea26b8c-509b-40fd-b4b5-3149e6502e41 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:29:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1904019446',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1904019446',id=36,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-26T00:30:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d616862c7c184de5b0ba3121552c5666',ramdisk_id='',reservation_id='r-jr45148e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-638746030',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T00:30:28Z,user_data=None,user_id='dbe0d52293264f33ae86de41dabeefcf',uuid=c7a55179-cde6-4fbd-a8b3-c3df149bc6f3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "70711118-68ee-4ea5-bfc2-df652ed0f3c1", "address": "fa:16:3e:91:b1:a6", "network": {"id": "eb55c0bc-cae5-4ba3-851a-e31a50b52c88", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1081223830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1081223830-network", "vif_mac": "fa:16:3e:91:b1:a6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d616862c7c184de5b0ba3121552c5666", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70711118-68", "ovs_interfaceid": "70711118-68ee-4ea5-bfc2-df652ed0f3c1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75165) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 00:31:42 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-6ea26b8c-509b-40fd-b4b5-3149e6502e41 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Converting VIF {"id": "70711118-68ee-4ea5-bfc2-df652ed0f3c1", "address": "fa:16:3e:91:b1:a6", "network": {"id": "eb55c0bc-cae5-4ba3-851a-e31a50b52c88", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1081223830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1081223830-network", "vif_mac": "fa:16:3e:91:b1:a6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d616862c7c184de5b0ba3121552c5666", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70711118-68", "ovs_interfaceid": "70711118-68ee-4ea5-bfc2-df652ed0f3c1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:31:42 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-6ea26b8c-509b-40fd-b4b5-3149e6502e41 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:91:b1:a6,bridge_name='br-int',has_traffic_filtering=True,id=70711118-68ee-4ea5-bfc2-df652ed0f3c1,network=Network(eb55c0bc-cae5-4ba3-851a-e31a50b52c88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70711118-68') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:31:42 user nova-compute[75165]: DEBUG nova.objects.instance [None req-6ea26b8c-509b-40fd-b4b5-3149e6502e41 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Lazy-loading 'pci_devices' on Instance uuid c7a55179-cde6-4fbd-a8b3-c3df149bc6f3 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:31:42 user nova-compute[75165]: DEBUG nova.objects.base [None req-6ea26b8c-509b-40fd-b4b5-3149e6502e41 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Object Instance<c7a55179-cde6-4fbd-a8b3-c3df149bc6f3> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75165) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 00:31:42 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-6ea26b8c-509b-40fd-b4b5-3149e6502e41 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: c7a55179-cde6-4fbd-a8b3-c3df149bc6f3] End _get_guest_xml xml=<domain type="kvm">
Oct 26 00:31:42 user nova-compute[75165]:   <uuid>c7a55179-cde6-4fbd-a8b3-c3df149bc6f3</uuid>
Oct 26 00:31:42 user nova-compute[75165]:   <name>instance-00000024</name>
Oct 26 00:31:42 user nova-compute[75165]:   <memory>524288</memory>
Oct 26 00:31:42 user nova-compute[75165]:   <vcpu>1</vcpu>
Oct 26 00:31:42 user nova-compute[75165]:   <metadata>
Oct 26 00:31:42 user nova-compute[75165]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 00:31:42 user nova-compute[75165]:       <nova:package version="0.0.0"/>
Oct 26 00:31:42 user nova-compute[75165]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1904019446</nova:name>
Oct 26 00:31:42 user nova-compute[75165]:       <nova:creationTime>2023-10-26 00:31:40</nova:creationTime>
Oct 26 00:31:42 user nova-compute[75165]:       <nova:flavor name="m1.tiny">
Oct 26 00:31:42 user nova-compute[75165]:         <nova:memory>512</nova:memory>
Oct 26 00:31:42 user nova-compute[75165]:         <nova:disk>1</nova:disk>
Oct 26 00:31:42 user nova-compute[75165]:         <nova:swap>0</nova:swap>
Oct 26 00:31:42 user nova-compute[75165]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 00:31:42 user nova-compute[75165]:         <nova:vcpus>1</nova:vcpus>
Oct 26 00:31:42 user nova-compute[75165]:       </nova:flavor>
Oct 26 00:31:42 user nova-compute[75165]:       <nova:owner>
Oct 26 00:31:42 user nova-compute[75165]:         <nova:user uuid="dbe0d52293264f33ae86de41dabeefcf">tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member</nova:user>
Oct 26 00:31:42 user nova-compute[75165]:         <nova:project uuid="d616862c7c184de5b0ba3121552c5666">tempest-ServerBootFromVolumeStableRescueTest-638746030</nova:project>
Oct 26 00:31:42 user nova-compute[75165]:       </nova:owner>
Oct 26 00:31:42 user nova-compute[75165]:       <nova:root type="image" uuid="bff0d8a1-739e-4c4d-9efa-b73ba7b76d01"/>
Oct 26 00:31:42 user nova-compute[75165]:       <nova:ports>
Oct 26 00:31:42 user nova-compute[75165]:         <nova:port uuid="70711118-68ee-4ea5-bfc2-df652ed0f3c1">
Oct 26 00:31:42 user nova-compute[75165]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 26 00:31:42 user nova-compute[75165]:         </nova:port>
Oct 26 00:31:42 user nova-compute[75165]:       </nova:ports>
Oct 26 00:31:42 user nova-compute[75165]:     </nova:instance>
Oct 26 00:31:42 user nova-compute[75165]:   </metadata>
Oct 26 00:31:42 user nova-compute[75165]:   <sysinfo type="smbios">
Oct 26 00:31:42 user nova-compute[75165]:     <system>
Oct 26 00:31:42 user nova-compute[75165]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 00:31:42 user nova-compute[75165]:       <entry name="product">OpenStack Nova</entry>
Oct 26 00:31:42 user nova-compute[75165]:       <entry name="version">0.0.0</entry>
Oct 26 00:31:42 user nova-compute[75165]:       <entry name="serial">c7a55179-cde6-4fbd-a8b3-c3df149bc6f3</entry>
Oct 26 00:31:42 user nova-compute[75165]:       <entry name="uuid">c7a55179-cde6-4fbd-a8b3-c3df149bc6f3</entry>
Oct 26 00:31:42 user nova-compute[75165]:       <entry name="family">Virtual Machine</entry>
Oct 26 00:31:42 user nova-compute[75165]:     </system>
Oct 26 00:31:42 user nova-compute[75165]:   </sysinfo>
Oct 26 00:31:42 user nova-compute[75165]:   <os>
Oct 26 00:31:42 user nova-compute[75165]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 00:31:42 user nova-compute[75165]:     <smbios mode="sysinfo"/>
Oct 26 00:31:42 user nova-compute[75165]:   </os>
Oct 26 00:31:42 user nova-compute[75165]:   <features>
Oct 26 00:31:42 user nova-compute[75165]:     <acpi/>
Oct 26 00:31:42 user nova-compute[75165]:     <apic/>
Oct 26 00:31:42 user nova-compute[75165]:     <vmcoreinfo/>
Oct 26 00:31:42 user nova-compute[75165]:   </features>
Oct 26 00:31:42 user nova-compute[75165]:   <clock offset="utc">
Oct 26 00:31:42 user nova-compute[75165]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 00:31:42 user nova-compute[75165]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 00:31:42 user nova-compute[75165]:     <timer name="hpet" present="no"/>
Oct 26 00:31:42 user nova-compute[75165]:   </clock>
Oct 26 00:31:42 user nova-compute[75165]:   <cpu mode="custom" match="exact">
Oct 26 00:31:42 user nova-compute[75165]:     <model>Nehalem</model>
Oct 26 00:31:42 user nova-compute[75165]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 00:31:42 user nova-compute[75165]:   </cpu>
Oct 26 00:31:42 user nova-compute[75165]:   <devices>
Oct 26 00:31:42 user nova-compute[75165]:     <disk type="block" device="disk">
Oct 26 00:31:42 user nova-compute[75165]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 00:31:42 user nova-compute[75165]:       <source dev="/dev/sdc"/>
Oct 26 00:31:42 user nova-compute[75165]:       <target dev="vda" bus="virtio"/>
Oct 26 00:31:42 user nova-compute[75165]:       <serial>d249e808-e145-4ed5-a1a6-a550f7c6b3b8</serial>
Oct 26 00:31:42 user nova-compute[75165]:     </disk>
Oct 26 00:31:42 user nova-compute[75165]:     <disk type="file" device="disk">
Oct 26 00:31:42 user nova-compute[75165]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 00:31:42 user nova-compute[75165]:       <source file="/opt/stack/data/nova/instances/c7a55179-cde6-4fbd-a8b3-c3df149bc6f3/disk.rescue"/>
Oct 26 00:31:42 user nova-compute[75165]:       <target dev="vdb" bus="virtio"/>
Oct 26 00:31:42 user nova-compute[75165]:       <boot order="1"/>
Oct 26 00:31:42 user nova-compute[75165]:     </disk>
Oct 26 00:31:42 user nova-compute[75165]:     <interface type="ethernet">
Oct 26 00:31:42 user nova-compute[75165]:       <mac address="fa:16:3e:91:b1:a6"/>
Oct 26 00:31:42 user nova-compute[75165]:       <model type="virtio"/>
Oct 26 00:31:42 user nova-compute[75165]:       <mtu size="1442"/>
Oct 26 00:31:42 user nova-compute[75165]:       <target dev="tap70711118-68"/>
Oct 26 00:31:42 user nova-compute[75165]:     </interface>
Oct 26 00:31:42 user nova-compute[75165]:     <serial type="pty">
Oct 26 00:31:42 user nova-compute[75165]:       <log file="/opt/stack/data/nova/instances/c7a55179-cde6-4fbd-a8b3-c3df149bc6f3/console.log" append="off"/>
Oct 26 00:31:42 user nova-compute[75165]:     </serial>
Oct 26 00:31:42 user nova-compute[75165]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 00:31:42 user nova-compute[75165]:     <video>
Oct 26 00:31:42 user nova-compute[75165]:       <model type="virtio"/>
Oct 26 00:31:42 user nova-compute[75165]:     </video>
Oct 26 00:31:42 user nova-compute[75165]:     <rng model="virtio">
Oct 26 00:31:42 user nova-compute[75165]:       <backend model="random">/dev/urandom</backend>
Oct 26 00:31:42 user nova-compute[75165]:     </rng>
Oct 26 00:31:42 user nova-compute[75165]:     <controller type="usb" index="0" model="none"/>
Oct 26 00:31:42 user nova-compute[75165]:     <memballoon model="virtio">
Oct 26 00:31:42 user nova-compute[75165]:       <stats period="10"/>
Oct 26 00:31:42 user nova-compute[75165]:     </memballoon>
Oct 26 00:31:42 user nova-compute[75165]:   </devices>
Oct 26 00:31:42 user nova-compute[75165]: </domain>
Oct 26 00:31:42 user nova-compute[75165]:  {{(pid=75165) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 00:31:42 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: c7a55179-cde6-4fbd-a8b3-c3df149bc6f3] Instance destroyed successfully.
Oct 26 00:31:42 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-6ea26b8c-509b-40fd-b4b5-3149e6502e41 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] No BDM found with device name vda, not building metadata. {{(pid=75165) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 00:31:42 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-6ea26b8c-509b-40fd-b4b5-3149e6502e41 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75165) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 00:31:42 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-6ea26b8c-509b-40fd-b4b5-3149e6502e41 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] No VIF found with MAC fa:16:3e:91:b1:a6, not building metadata {{(pid=75165) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 00:31:42 user nova-compute[75165]: DEBUG nova.network.neutron [None req-73316ea5-9517-41aa-be76-989a0fab9892 tempest-VolumesNegativeTest-1416627237 tempest-VolumesNegativeTest-1416627237-project-member] [instance: 00c0e0e2-4c40-45a3-829a-b6b73482e311] Successfully updated port: 09cc2701-0337-4975-9589-a8aa29038342 {{(pid=75165) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 00:31:42 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-73316ea5-9517-41aa-be76-989a0fab9892 tempest-VolumesNegativeTest-1416627237 tempest-VolumesNegativeTest-1416627237-project-member] Acquiring lock "refresh_cache-00c0e0e2-4c40-45a3-829a-b6b73482e311" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:31:42 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-73316ea5-9517-41aa-be76-989a0fab9892 tempest-VolumesNegativeTest-1416627237 tempest-VolumesNegativeTest-1416627237-project-member] Acquired lock "refresh_cache-00c0e0e2-4c40-45a3-829a-b6b73482e311" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:31:42 user nova-compute[75165]: DEBUG nova.network.neutron [None req-73316ea5-9517-41aa-be76-989a0fab9892 tempest-VolumesNegativeTest-1416627237 tempest-VolumesNegativeTest-1416627237-project-member] [instance: 00c0e0e2-4c40-45a3-829a-b6b73482e311] Building network info cache for instance {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 00:31:42 user nova-compute[75165]: DEBUG nova.compute.manager [req-41951b71-37da-4d24-91ae-4be3687ff769 req-7bdf6cfc-b118-4c76-9879-9043ebdbe7e2 service nova] [instance: 00c0e0e2-4c40-45a3-829a-b6b73482e311] Received event network-changed-09cc2701-0337-4975-9589-a8aa29038342 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:31:42 user nova-compute[75165]: DEBUG nova.compute.manager [req-41951b71-37da-4d24-91ae-4be3687ff769 req-7bdf6cfc-b118-4c76-9879-9043ebdbe7e2 service nova] [instance: 00c0e0e2-4c40-45a3-829a-b6b73482e311] Refreshing instance network info cache due to event network-changed-09cc2701-0337-4975-9589-a8aa29038342. {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 00:31:42 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-41951b71-37da-4d24-91ae-4be3687ff769 req-7bdf6cfc-b118-4c76-9879-9043ebdbe7e2 service nova] Acquiring lock "refresh_cache-00c0e0e2-4c40-45a3-829a-b6b73482e311" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:31:42 user nova-compute[75165]: DEBUG nova.network.neutron [None req-73316ea5-9517-41aa-be76-989a0fab9892 tempest-VolumesNegativeTest-1416627237 tempest-VolumesNegativeTest-1416627237-project-member] [instance: 00c0e0e2-4c40-45a3-829a-b6b73482e311] Instance cache missing network info. {{(pid=75165) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 00:31:42 user nova-compute[75165]: DEBUG nova.network.neutron [None req-73316ea5-9517-41aa-be76-989a0fab9892 tempest-VolumesNegativeTest-1416627237 tempest-VolumesNegativeTest-1416627237-project-member] [instance: 00c0e0e2-4c40-45a3-829a-b6b73482e311] Updating instance_info_cache with network_info: [{"id": "09cc2701-0337-4975-9589-a8aa29038342", "address": "fa:16:3e:85:78:5e", "network": {"id": "54ea856c-9fdd-4e10-a446-1bd35fd6d7bc", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.92", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e56bbf444fd34c348475c73673611447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09cc2701-03", "ovs_interfaceid": "09cc2701-0337-4975-9589-a8aa29038342", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:31:42 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-73316ea5-9517-41aa-be76-989a0fab9892 tempest-VolumesNegativeTest-1416627237 tempest-VolumesNegativeTest-1416627237-project-member] Releasing lock "refresh_cache-00c0e0e2-4c40-45a3-829a-b6b73482e311" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:31:42 user nova-compute[75165]: DEBUG nova.compute.manager [None req-73316ea5-9517-41aa-be76-989a0fab9892 tempest-VolumesNegativeTest-1416627237 tempest-VolumesNegativeTest-1416627237-project-member] [instance: 00c0e0e2-4c40-45a3-829a-b6b73482e311] Instance network_info: |[{"id": "09cc2701-0337-4975-9589-a8aa29038342", "address": "fa:16:3e:85:78:5e", "network": {"id": "54ea856c-9fdd-4e10-a446-1bd35fd6d7bc", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.92", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e56bbf444fd34c348475c73673611447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09cc2701-03", "ovs_interfaceid": "09cc2701-0337-4975-9589-a8aa29038342", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75165) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 00:31:42 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-41951b71-37da-4d24-91ae-4be3687ff769 req-7bdf6cfc-b118-4c76-9879-9043ebdbe7e2 service nova] Acquired lock "refresh_cache-00c0e0e2-4c40-45a3-829a-b6b73482e311" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:31:42 user nova-compute[75165]: DEBUG nova.network.neutron [req-41951b71-37da-4d24-91ae-4be3687ff769 req-7bdf6cfc-b118-4c76-9879-9043ebdbe7e2 service nova] [instance: 00c0e0e2-4c40-45a3-829a-b6b73482e311] Refreshing network info cache for port 09cc2701-0337-4975-9589-a8aa29038342 {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 00:31:42 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-73316ea5-9517-41aa-be76-989a0fab9892 tempest-VolumesNegativeTest-1416627237 tempest-VolumesNegativeTest-1416627237-project-member] [instance: 00c0e0e2-4c40-45a3-829a-b6b73482e311] Start _get_guest_xml network_info=[{"id": "09cc2701-0337-4975-9589-a8aa29038342", "address": "fa:16:3e:85:78:5e", "network": {"id": "54ea856c-9fdd-4e10-a446-1bd35fd6d7bc", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.92", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e56bbf444fd34c348475c73673611447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09cc2701-03", "ovs_interfaceid": "09cc2701-0337-4975-9589-a8aa29038342", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T00:03:24Z,direct_url=<?>,disk_format='qcow2',id=bff0d8a1-739e-4c4d-9efa-b73ba7b76d01,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e56bbf444fd34c348475c73673611447',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T00:03:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'size': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': 'bff0d8a1-739e-4c4d-9efa-b73ba7b76d01'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75165) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 00:31:42 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-73316ea5-9517-41aa-be76-989a0fab9892 tempest-VolumesNegativeTest-1416627237 tempest-VolumesNegativeTest-1416627237-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:31:42 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-73316ea5-9517-41aa-be76-989a0fab9892 tempest-VolumesNegativeTest-1416627237 tempest-VolumesNegativeTest-1416627237-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:31:42 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-73316ea5-9517-41aa-be76-989a0fab9892 tempest-VolumesNegativeTest-1416627237 tempest-VolumesNegativeTest-1416627237-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75165) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 00:31:42 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-73316ea5-9517-41aa-be76-989a0fab9892 tempest-VolumesNegativeTest-1416627237 tempest-VolumesNegativeTest-1416627237-project-member] CPU controller missing on host. {{(pid=75165) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 00:31:42 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-73316ea5-9517-41aa-be76-989a0fab9892 tempest-VolumesNegativeTest-1416627237 tempest-VolumesNegativeTest-1416627237-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75165) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 00:31:42 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-73316ea5-9517-41aa-be76-989a0fab9892 tempest-VolumesNegativeTest-1416627237 tempest-VolumesNegativeTest-1416627237-project-member] CPU controller found on host. {{(pid=75165) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 00:31:42 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-73316ea5-9517-41aa-be76-989a0fab9892 tempest-VolumesNegativeTest-1416627237 tempest-VolumesNegativeTest-1416627237-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75165) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 00:31:42 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-73316ea5-9517-41aa-be76-989a0fab9892 tempest-VolumesNegativeTest-1416627237 tempest-VolumesNegativeTest-1416627237-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T00:03:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T00:03:24Z,direct_url=<?>,disk_format='qcow2',id=bff0d8a1-739e-4c4d-9efa-b73ba7b76d01,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e56bbf444fd34c348475c73673611447',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T00:03:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 00:31:42 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-73316ea5-9517-41aa-be76-989a0fab9892 tempest-VolumesNegativeTest-1416627237 tempest-VolumesNegativeTest-1416627237-project-member] Flavor limits 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 00:31:42 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-73316ea5-9517-41aa-be76-989a0fab9892 tempest-VolumesNegativeTest-1416627237 tempest-VolumesNegativeTest-1416627237-project-member] Image limits 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 00:31:42 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-73316ea5-9517-41aa-be76-989a0fab9892 tempest-VolumesNegativeTest-1416627237 tempest-VolumesNegativeTest-1416627237-project-member] Flavor pref 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 00:31:42 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-73316ea5-9517-41aa-be76-989a0fab9892 tempest-VolumesNegativeTest-1416627237 tempest-VolumesNegativeTest-1416627237-project-member] Image pref 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 00:31:42 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-73316ea5-9517-41aa-be76-989a0fab9892 tempest-VolumesNegativeTest-1416627237 tempest-VolumesNegativeTest-1416627237-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 00:31:42 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-73316ea5-9517-41aa-be76-989a0fab9892 tempest-VolumesNegativeTest-1416627237 tempest-VolumesNegativeTest-1416627237-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 00:31:42 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-73316ea5-9517-41aa-be76-989a0fab9892 tempest-VolumesNegativeTest-1416627237 tempest-VolumesNegativeTest-1416627237-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75165) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 00:31:42 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-73316ea5-9517-41aa-be76-989a0fab9892 tempest-VolumesNegativeTest-1416627237 tempest-VolumesNegativeTest-1416627237-project-member] Got 1 possible topologies {{(pid=75165) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 00:31:42 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-73316ea5-9517-41aa-be76-989a0fab9892 tempest-VolumesNegativeTest-1416627237 tempest-VolumesNegativeTest-1416627237-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 00:31:42 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-73316ea5-9517-41aa-be76-989a0fab9892 tempest-VolumesNegativeTest-1416627237 tempest-VolumesNegativeTest-1416627237-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 00:31:42 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-73316ea5-9517-41aa-be76-989a0fab9892 tempest-VolumesNegativeTest-1416627237 tempest-VolumesNegativeTest-1416627237-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:31:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1704764482',display_name='tempest-VolumesNegativeTest-instance-1704764482',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1704764482',id=37,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d728263a73f94098b89833123a36704b',ramdisk_id='',reservation_id='r-pfexl582',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1416627237',owner_user_name='tempest-VolumesNegativeTest-1416627237-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T00:31:41Z,user_data=None,user_id='251d5d7c57f147c68f9739e9889d08a9',uuid=00c0e0e2-4c40-45a3-829a-b6b73482e311,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "09cc2701-0337-4975-9589-a8aa29038342", "address": "fa:16:3e:85:78:5e", "network": {"id": "54ea856c-9fdd-4e10-a446-1bd35fd6d7bc", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.92", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e56bbf444fd34c348475c73673611447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09cc2701-03", "ovs_interfaceid": "09cc2701-0337-4975-9589-a8aa29038342", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75165) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 00:31:42 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-73316ea5-9517-41aa-be76-989a0fab9892 tempest-VolumesNegativeTest-1416627237 tempest-VolumesNegativeTest-1416627237-project-member] Converting VIF {"id": "09cc2701-0337-4975-9589-a8aa29038342", "address": "fa:16:3e:85:78:5e", "network": {"id": "54ea856c-9fdd-4e10-a446-1bd35fd6d7bc", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.92", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e56bbf444fd34c348475c73673611447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09cc2701-03", "ovs_interfaceid": "09cc2701-0337-4975-9589-a8aa29038342", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:31:42 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-73316ea5-9517-41aa-be76-989a0fab9892 tempest-VolumesNegativeTest-1416627237 tempest-VolumesNegativeTest-1416627237-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:78:5e,bridge_name='br-int',has_traffic_filtering=True,id=09cc2701-0337-4975-9589-a8aa29038342,network=Network(54ea856c-9fdd-4e10-a446-1bd35fd6d7bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09cc2701-03') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:31:42 user nova-compute[75165]: DEBUG nova.objects.instance [None req-73316ea5-9517-41aa-be76-989a0fab9892 tempest-VolumesNegativeTest-1416627237 tempest-VolumesNegativeTest-1416627237-project-member] Lazy-loading 'pci_devices' on Instance uuid 00c0e0e2-4c40-45a3-829a-b6b73482e311 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:31:42 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-73316ea5-9517-41aa-be76-989a0fab9892 tempest-VolumesNegativeTest-1416627237 tempest-VolumesNegativeTest-1416627237-project-member] [instance: 00c0e0e2-4c40-45a3-829a-b6b73482e311] End _get_guest_xml xml=<domain type="kvm">
Oct 26 00:31:42 user nova-compute[75165]:   <uuid>00c0e0e2-4c40-45a3-829a-b6b73482e311</uuid>
Oct 26 00:31:42 user nova-compute[75165]:   <name>instance-00000025</name>
Oct 26 00:31:42 user nova-compute[75165]:   <memory>524288</memory>
Oct 26 00:31:42 user nova-compute[75165]:   <vcpu>1</vcpu>
Oct 26 00:31:42 user nova-compute[75165]:   <metadata>
Oct 26 00:31:42 user nova-compute[75165]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 00:31:42 user nova-compute[75165]:       <nova:package version="0.0.0"/>
Oct 26 00:31:42 user nova-compute[75165]:       <nova:name>tempest-VolumesNegativeTest-instance-1704764482</nova:name>
Oct 26 00:31:42 user nova-compute[75165]:       <nova:creationTime>2023-10-26 00:31:42</nova:creationTime>
Oct 26 00:31:42 user nova-compute[75165]:       <nova:flavor name="m1.tiny">
Oct 26 00:31:42 user nova-compute[75165]:         <nova:memory>512</nova:memory>
Oct 26 00:31:42 user nova-compute[75165]:         <nova:disk>1</nova:disk>
Oct 26 00:31:42 user nova-compute[75165]:         <nova:swap>0</nova:swap>
Oct 26 00:31:42 user nova-compute[75165]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 00:31:42 user nova-compute[75165]:         <nova:vcpus>1</nova:vcpus>
Oct 26 00:31:42 user nova-compute[75165]:       </nova:flavor>
Oct 26 00:31:42 user nova-compute[75165]:       <nova:owner>
Oct 26 00:31:42 user nova-compute[75165]:         <nova:user uuid="251d5d7c57f147c68f9739e9889d08a9">tempest-VolumesNegativeTest-1416627237-project-member</nova:user>
Oct 26 00:31:42 user nova-compute[75165]:         <nova:project uuid="d728263a73f94098b89833123a36704b">tempest-VolumesNegativeTest-1416627237</nova:project>
Oct 26 00:31:42 user nova-compute[75165]:       </nova:owner>
Oct 26 00:31:42 user nova-compute[75165]:       <nova:root type="image" uuid="bff0d8a1-739e-4c4d-9efa-b73ba7b76d01"/>
Oct 26 00:31:42 user nova-compute[75165]:       <nova:ports>
Oct 26 00:31:42 user nova-compute[75165]:         <nova:port uuid="09cc2701-0337-4975-9589-a8aa29038342">
Oct 26 00:31:42 user nova-compute[75165]:           <nova:ip type="fixed" address="192.168.233.92" ipVersion="4"/>
Oct 26 00:31:42 user nova-compute[75165]:         </nova:port>
Oct 26 00:31:42 user nova-compute[75165]:       </nova:ports>
Oct 26 00:31:42 user nova-compute[75165]:     </nova:instance>
Oct 26 00:31:42 user nova-compute[75165]:   </metadata>
Oct 26 00:31:42 user nova-compute[75165]:   <sysinfo type="smbios">
Oct 26 00:31:42 user nova-compute[75165]:     <system>
Oct 26 00:31:42 user nova-compute[75165]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 00:31:42 user nova-compute[75165]:       <entry name="product">OpenStack Nova</entry>
Oct 26 00:31:42 user nova-compute[75165]:       <entry name="version">0.0.0</entry>
Oct 26 00:31:42 user nova-compute[75165]:       <entry name="serial">00c0e0e2-4c40-45a3-829a-b6b73482e311</entry>
Oct 26 00:31:42 user nova-compute[75165]:       <entry name="uuid">00c0e0e2-4c40-45a3-829a-b6b73482e311</entry>
Oct 26 00:31:42 user nova-compute[75165]:       <entry name="family">Virtual Machine</entry>
Oct 26 00:31:42 user nova-compute[75165]:     </system>
Oct 26 00:31:42 user nova-compute[75165]:   </sysinfo>
Oct 26 00:31:42 user nova-compute[75165]:   <os>
Oct 26 00:31:42 user nova-compute[75165]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 00:31:42 user nova-compute[75165]:     <boot dev="hd"/>
Oct 26 00:31:42 user nova-compute[75165]:     <smbios mode="sysinfo"/>
Oct 26 00:31:42 user nova-compute[75165]:   </os>
Oct 26 00:31:42 user nova-compute[75165]:   <features>
Oct 26 00:31:42 user nova-compute[75165]:     <acpi/>
Oct 26 00:31:42 user nova-compute[75165]:     <apic/>
Oct 26 00:31:42 user nova-compute[75165]:     <vmcoreinfo/>
Oct 26 00:31:42 user nova-compute[75165]:   </features>
Oct 26 00:31:42 user nova-compute[75165]:   <clock offset="utc">
Oct 26 00:31:42 user nova-compute[75165]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 00:31:42 user nova-compute[75165]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 00:31:42 user nova-compute[75165]:     <timer name="hpet" present="no"/>
Oct 26 00:31:42 user nova-compute[75165]:   </clock>
Oct 26 00:31:42 user nova-compute[75165]:   <cpu mode="custom" match="exact">
Oct 26 00:31:42 user nova-compute[75165]:     <model>Nehalem</model>
Oct 26 00:31:42 user nova-compute[75165]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 00:31:42 user nova-compute[75165]:   </cpu>
Oct 26 00:31:42 user nova-compute[75165]:   <devices>
Oct 26 00:31:42 user nova-compute[75165]:     <disk type="file" device="disk">
Oct 26 00:31:42 user nova-compute[75165]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 00:31:42 user nova-compute[75165]:       <source file="/opt/stack/data/nova/instances/00c0e0e2-4c40-45a3-829a-b6b73482e311/disk"/>
Oct 26 00:31:42 user nova-compute[75165]:       <target dev="vda" bus="virtio"/>
Oct 26 00:31:42 user nova-compute[75165]:     </disk>
Oct 26 00:31:42 user nova-compute[75165]:     <interface type="ethernet">
Oct 26 00:31:42 user nova-compute[75165]:       <mac address="fa:16:3e:85:78:5e"/>
Oct 26 00:31:42 user nova-compute[75165]:       <model type="virtio"/>
Oct 26 00:31:42 user nova-compute[75165]:       <mtu size="1442"/>
Oct 26 00:31:42 user nova-compute[75165]:       <target dev="tap09cc2701-03"/>
Oct 26 00:31:42 user nova-compute[75165]:     </interface>
Oct 26 00:31:42 user nova-compute[75165]:     <serial type="pty">
Oct 26 00:31:42 user nova-compute[75165]:       <log file="/opt/stack/data/nova/instances/00c0e0e2-4c40-45a3-829a-b6b73482e311/console.log" append="off"/>
Oct 26 00:31:42 user nova-compute[75165]:     </serial>
Oct 26 00:31:42 user nova-compute[75165]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 00:31:42 user nova-compute[75165]:     <video>
Oct 26 00:31:42 user nova-compute[75165]:       <model type="virtio"/>
Oct 26 00:31:42 user nova-compute[75165]:     </video>
Oct 26 00:31:42 user nova-compute[75165]:     <rng model="virtio">
Oct 26 00:31:42 user nova-compute[75165]:       <backend model="random">/dev/urandom</backend>
Oct 26 00:31:42 user nova-compute[75165]:     </rng>
Oct 26 00:31:42 user nova-compute[75165]:     <controller type="usb" index="0" model="none"/>
Oct 26 00:31:42 user nova-compute[75165]:     <memballoon model="virtio">
Oct 26 00:31:42 user nova-compute[75165]:       <stats period="10"/>
Oct 26 00:31:42 user nova-compute[75165]:     </memballoon>
Oct 26 00:31:42 user nova-compute[75165]:   </devices>
Oct 26 00:31:42 user nova-compute[75165]: </domain>
Oct 26 00:31:42 user nova-compute[75165]:  {{(pid=75165) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 00:31:42 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-73316ea5-9517-41aa-be76-989a0fab9892 tempest-VolumesNegativeTest-1416627237 tempest-VolumesNegativeTest-1416627237-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:31:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1704764482',display_name='tempest-VolumesNegativeTest-instance-1704764482',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1704764482',id=37,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d728263a73f94098b89833123a36704b',ramdisk_id='',reservation_id='r-pfexl582',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1416627237',owner_user_name='tempest-VolumesNegativeTest-1416627237-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T00:31:41Z,user_data=None,user_id='251d5d7c57f147c68f9739e9889d08a9',uuid=00c0e0e2-4c40-45a3-829a-b6b73482e311,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "09cc2701-0337-4975-9589-a8aa29038342", "address": "fa:16:3e:85:78:5e", "network": {"id": "54ea856c-9fdd-4e10-a446-1bd35fd6d7bc", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.92", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e56bbf444fd34c348475c73673611447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09cc2701-03", "ovs_interfaceid": "09cc2701-0337-4975-9589-a8aa29038342", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 00:31:42 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-73316ea5-9517-41aa-be76-989a0fab9892 tempest-VolumesNegativeTest-1416627237 tempest-VolumesNegativeTest-1416627237-project-member] Converting VIF {"id": "09cc2701-0337-4975-9589-a8aa29038342", "address": "fa:16:3e:85:78:5e", "network": {"id": "54ea856c-9fdd-4e10-a446-1bd35fd6d7bc", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.92", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e56bbf444fd34c348475c73673611447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09cc2701-03", "ovs_interfaceid": "09cc2701-0337-4975-9589-a8aa29038342", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:31:42 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-73316ea5-9517-41aa-be76-989a0fab9892 tempest-VolumesNegativeTest-1416627237 tempest-VolumesNegativeTest-1416627237-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:78:5e,bridge_name='br-int',has_traffic_filtering=True,id=09cc2701-0337-4975-9589-a8aa29038342,network=Network(54ea856c-9fdd-4e10-a446-1bd35fd6d7bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09cc2701-03') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:31:42 user nova-compute[75165]: DEBUG os_vif [None req-73316ea5-9517-41aa-be76-989a0fab9892 tempest-VolumesNegativeTest-1416627237 tempest-VolumesNegativeTest-1416627237-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:78:5e,bridge_name='br-int',has_traffic_filtering=True,id=09cc2701-0337-4975-9589-a8aa29038342,network=Network(54ea856c-9fdd-4e10-a446-1bd35fd6d7bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09cc2701-03') {{(pid=75165) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 00:31:42 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:31:42 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:31:42 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 00:31:42 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:31:42 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6473b1e2-0cb2-5b39-9e86-a5536d573b83', '_type': 'linux-noop'}}, row=False) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:31:42 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:31:42 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:31:42 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:31:42 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:31:42 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap09cc2701-03, may_exist=True, interface_attrs={}) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:31:42 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap09cc2701-03, col_values=(('qos', UUID('5762bfe0-46e2-4371-ae83-d45c0a2da6a9')),), if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:31:42 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap09cc2701-03, col_values=(('external_ids', {'iface-id': '09cc2701-0337-4975-9589-a8aa29038342', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:85:78:5e', 'vm-uuid': '00c0e0e2-4c40-45a3-829a-b6b73482e311'}),), if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:31:42 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:31:42 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:31:42 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:31:42 user nova-compute[75165]: INFO os_vif [None req-73316ea5-9517-41aa-be76-989a0fab9892 tempest-VolumesNegativeTest-1416627237 tempest-VolumesNegativeTest-1416627237-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:78:5e,bridge_name='br-int',has_traffic_filtering=True,id=09cc2701-0337-4975-9589-a8aa29038342,network=Network(54ea856c-9fdd-4e10-a446-1bd35fd6d7bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09cc2701-03')
Oct 26 00:31:42 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-73316ea5-9517-41aa-be76-989a0fab9892 tempest-VolumesNegativeTest-1416627237 tempest-VolumesNegativeTest-1416627237-project-member] No BDM found with device name vda, not building metadata. {{(pid=75165) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 00:31:42 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-73316ea5-9517-41aa-be76-989a0fab9892 tempest-VolumesNegativeTest-1416627237 tempest-VolumesNegativeTest-1416627237-project-member] No VIF found with MAC fa:16:3e:85:78:5e, not building metadata {{(pid=75165) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 00:31:43 user nova-compute[75165]: DEBUG nova.network.neutron [req-41951b71-37da-4d24-91ae-4be3687ff769 req-7bdf6cfc-b118-4c76-9879-9043ebdbe7e2 service nova] [instance: 00c0e0e2-4c40-45a3-829a-b6b73482e311] Updated VIF entry in instance network info cache for port 09cc2701-0337-4975-9589-a8aa29038342. {{(pid=75165) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 00:31:43 user nova-compute[75165]: DEBUG nova.network.neutron [req-41951b71-37da-4d24-91ae-4be3687ff769 req-7bdf6cfc-b118-4c76-9879-9043ebdbe7e2 service nova] [instance: 00c0e0e2-4c40-45a3-829a-b6b73482e311] Updating instance_info_cache with network_info: [{"id": "09cc2701-0337-4975-9589-a8aa29038342", "address": "fa:16:3e:85:78:5e", "network": {"id": "54ea856c-9fdd-4e10-a446-1bd35fd6d7bc", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.92", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e56bbf444fd34c348475c73673611447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09cc2701-03", "ovs_interfaceid": "09cc2701-0337-4975-9589-a8aa29038342", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:31:43 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-41951b71-37da-4d24-91ae-4be3687ff769 req-7bdf6cfc-b118-4c76-9879-9043ebdbe7e2 service nova] Releasing lock "refresh_cache-00c0e0e2-4c40-45a3-829a-b6b73482e311" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:31:44 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:31:45 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:31:45 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:31:45 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:31:45 user nova-compute[75165]: DEBUG nova.compute.manager [req-eab69193-2ae4-4071-bba3-3e24ca3c3106 req-9731a410-a7f8-48cb-ad2c-95044c0a339d service nova] [instance: 250afc24-0c38-4959-a77c-d51365dd1c4e] Received event network-vif-plugged-0372e87f-5631-4444-bfe8-ae5af9f09a46 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:31:45 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-eab69193-2ae4-4071-bba3-3e24ca3c3106 req-9731a410-a7f8-48cb-ad2c-95044c0a339d service nova] Acquiring lock "250afc24-0c38-4959-a77c-d51365dd1c4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:31:45 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-eab69193-2ae4-4071-bba3-3e24ca3c3106 req-9731a410-a7f8-48cb-ad2c-95044c0a339d service nova] Lock "250afc24-0c38-4959-a77c-d51365dd1c4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:31:45 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-eab69193-2ae4-4071-bba3-3e24ca3c3106 req-9731a410-a7f8-48cb-ad2c-95044c0a339d service nova] Lock "250afc24-0c38-4959-a77c-d51365dd1c4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:31:45 user nova-compute[75165]: DEBUG nova.compute.manager [req-eab69193-2ae4-4071-bba3-3e24ca3c3106 req-9731a410-a7f8-48cb-ad2c-95044c0a339d service nova] [instance: 250afc24-0c38-4959-a77c-d51365dd1c4e] No waiting events found dispatching network-vif-plugged-0372e87f-5631-4444-bfe8-ae5af9f09a46 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:31:45 user nova-compute[75165]: WARNING nova.compute.manager [req-eab69193-2ae4-4071-bba3-3e24ca3c3106 req-9731a410-a7f8-48cb-ad2c-95044c0a339d service nova] [instance: 250afc24-0c38-4959-a77c-d51365dd1c4e] Received unexpected event network-vif-plugged-0372e87f-5631-4444-bfe8-ae5af9f09a46 for instance with vm_state active and task_state rebuild_spawning.
Oct 26 00:31:45 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:31:45 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:31:45 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:31:45 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:31:45 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:31:46 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:31:46 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:31:46 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:31:46 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:31:46 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:31:46 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:31:46 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:31:46 user nova-compute[75165]: DEBUG nova.compute.manager [req-fd766b44-f247-4cd5-bae0-ec153b5f52b5 req-16005f19-5cec-4799-a4b6-caec5c2bf5cd service nova] [instance: c7a55179-cde6-4fbd-a8b3-c3df149bc6f3] Received event network-vif-plugged-70711118-68ee-4ea5-bfc2-df652ed0f3c1 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:31:46 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-fd766b44-f247-4cd5-bae0-ec153b5f52b5 req-16005f19-5cec-4799-a4b6-caec5c2bf5cd service nova] Acquiring lock "c7a55179-cde6-4fbd-a8b3-c3df149bc6f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:31:46 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-fd766b44-f247-4cd5-bae0-ec153b5f52b5 req-16005f19-5cec-4799-a4b6-caec5c2bf5cd service nova] Lock "c7a55179-cde6-4fbd-a8b3-c3df149bc6f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:31:46 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-fd766b44-f247-4cd5-bae0-ec153b5f52b5 req-16005f19-5cec-4799-a4b6-caec5c2bf5cd service nova] Lock "c7a55179-cde6-4fbd-a8b3-c3df149bc6f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:31:46 user nova-compute[75165]: DEBUG nova.compute.manager [req-fd766b44-f247-4cd5-bae0-ec153b5f52b5 req-16005f19-5cec-4799-a4b6-caec5c2bf5cd service nova] [instance: c7a55179-cde6-4fbd-a8b3-c3df149bc6f3] No waiting events found dispatching network-vif-plugged-70711118-68ee-4ea5-bfc2-df652ed0f3c1 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:31:46 user nova-compute[75165]: WARNING nova.compute.manager [req-fd766b44-f247-4cd5-bae0-ec153b5f52b5 req-16005f19-5cec-4799-a4b6-caec5c2bf5cd service nova] [instance: c7a55179-cde6-4fbd-a8b3-c3df149bc6f3] Received unexpected event network-vif-plugged-70711118-68ee-4ea5-bfc2-df652ed0f3c1 for instance with vm_state active and task_state rescuing.
Oct 26 00:31:46 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:31:46 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:31:46 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:31:46 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:31:46 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:31:46 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:31:47 user nova-compute[75165]: DEBUG nova.compute.manager [req-f5837a0d-947a-4f66-b2dd-529f0218d5fe req-c600a2a0-d012-40a2-9246-875aa0fd5838 service nova] [instance: 250afc24-0c38-4959-a77c-d51365dd1c4e] Received event network-vif-plugged-0372e87f-5631-4444-bfe8-ae5af9f09a46 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:31:47 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-f5837a0d-947a-4f66-b2dd-529f0218d5fe req-c600a2a0-d012-40a2-9246-875aa0fd5838 service nova] Acquiring lock "250afc24-0c38-4959-a77c-d51365dd1c4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:31:47 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-f5837a0d-947a-4f66-b2dd-529f0218d5fe req-c600a2a0-d012-40a2-9246-875aa0fd5838 service nova] Lock "250afc24-0c38-4959-a77c-d51365dd1c4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:31:47 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-f5837a0d-947a-4f66-b2dd-529f0218d5fe req-c600a2a0-d012-40a2-9246-875aa0fd5838 service nova] Lock "250afc24-0c38-4959-a77c-d51365dd1c4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:31:47 user nova-compute[75165]: DEBUG nova.compute.manager [req-f5837a0d-947a-4f66-b2dd-529f0218d5fe req-c600a2a0-d012-40a2-9246-875aa0fd5838 service nova] [instance: 250afc24-0c38-4959-a77c-d51365dd1c4e] No waiting events found dispatching network-vif-plugged-0372e87f-5631-4444-bfe8-ae5af9f09a46 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:31:47 user nova-compute[75165]: WARNING nova.compute.manager [req-f5837a0d-947a-4f66-b2dd-529f0218d5fe req-c600a2a0-d012-40a2-9246-875aa0fd5838 service nova] [instance: 250afc24-0c38-4959-a77c-d51365dd1c4e] Received unexpected event network-vif-plugged-0372e87f-5631-4444-bfe8-ae5af9f09a46 for instance with vm_state active and task_state rebuild_spawning.
Oct 26 00:31:47 user nova-compute[75165]: DEBUG nova.compute.manager [req-f5837a0d-947a-4f66-b2dd-529f0218d5fe req-c600a2a0-d012-40a2-9246-875aa0fd5838 service nova] [instance: 00c0e0e2-4c40-45a3-829a-b6b73482e311] Received event network-vif-plugged-09cc2701-0337-4975-9589-a8aa29038342 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:31:47 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-f5837a0d-947a-4f66-b2dd-529f0218d5fe req-c600a2a0-d012-40a2-9246-875aa0fd5838 service nova] Acquiring lock "00c0e0e2-4c40-45a3-829a-b6b73482e311-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:31:47 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-f5837a0d-947a-4f66-b2dd-529f0218d5fe req-c600a2a0-d012-40a2-9246-875aa0fd5838 service nova] Lock "00c0e0e2-4c40-45a3-829a-b6b73482e311-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:31:47 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-f5837a0d-947a-4f66-b2dd-529f0218d5fe req-c600a2a0-d012-40a2-9246-875aa0fd5838 service nova] Lock "00c0e0e2-4c40-45a3-829a-b6b73482e311-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:31:47 user nova-compute[75165]: DEBUG nova.compute.manager [req-f5837a0d-947a-4f66-b2dd-529f0218d5fe req-c600a2a0-d012-40a2-9246-875aa0fd5838 service nova] [instance: 00c0e0e2-4c40-45a3-829a-b6b73482e311] No waiting events found dispatching network-vif-plugged-09cc2701-0337-4975-9589-a8aa29038342 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:31:47 user nova-compute[75165]: WARNING nova.compute.manager [req-f5837a0d-947a-4f66-b2dd-529f0218d5fe req-c600a2a0-d012-40a2-9246-875aa0fd5838 service nova] [instance: 00c0e0e2-4c40-45a3-829a-b6b73482e311] Received unexpected event network-vif-plugged-09cc2701-0337-4975-9589-a8aa29038342 for instance with vm_state building and task_state spawning.
Oct 26 00:31:47 user nova-compute[75165]: DEBUG nova.compute.manager [req-f5837a0d-947a-4f66-b2dd-529f0218d5fe req-c600a2a0-d012-40a2-9246-875aa0fd5838 service nova] [instance: 00c0e0e2-4c40-45a3-829a-b6b73482e311] Received event network-vif-plugged-09cc2701-0337-4975-9589-a8aa29038342 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:31:47 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-f5837a0d-947a-4f66-b2dd-529f0218d5fe req-c600a2a0-d012-40a2-9246-875aa0fd5838 service nova] Acquiring lock "00c0e0e2-4c40-45a3-829a-b6b73482e311-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:31:47 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-f5837a0d-947a-4f66-b2dd-529f0218d5fe req-c600a2a0-d012-40a2-9246-875aa0fd5838 service nova] Lock "00c0e0e2-4c40-45a3-829a-b6b73482e311-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:31:47 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-f5837a0d-947a-4f66-b2dd-529f0218d5fe req-c600a2a0-d012-40a2-9246-875aa0fd5838 service nova] Lock "00c0e0e2-4c40-45a3-829a-b6b73482e311-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:31:47 user nova-compute[75165]: DEBUG nova.compute.manager [req-f5837a0d-947a-4f66-b2dd-529f0218d5fe req-c600a2a0-d012-40a2-9246-875aa0fd5838 service nova] [instance: 00c0e0e2-4c40-45a3-829a-b6b73482e311] No waiting events found dispatching network-vif-plugged-09cc2701-0337-4975-9589-a8aa29038342 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:31:47 user nova-compute[75165]: WARNING nova.compute.manager [req-f5837a0d-947a-4f66-b2dd-529f0218d5fe req-c600a2a0-d012-40a2-9246-875aa0fd5838 service nova] [instance: 00c0e0e2-4c40-45a3-829a-b6b73482e311] Received unexpected event network-vif-plugged-09cc2701-0337-4975-9589-a8aa29038342 for instance with vm_state building and task_state spawning.
Oct 26 00:31:47 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:31:48 user nova-compute[75165]: DEBUG nova.compute.manager [req-e0a62e06-2f2f-486d-822c-acb2099fcbb9 req-88f9a19f-566b-49d3-b633-b82f03dfb6ac service nova] [instance: c7a55179-cde6-4fbd-a8b3-c3df149bc6f3] Received event network-vif-plugged-70711118-68ee-4ea5-bfc2-df652ed0f3c1 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:31:48 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-e0a62e06-2f2f-486d-822c-acb2099fcbb9 req-88f9a19f-566b-49d3-b633-b82f03dfb6ac service nova] Acquiring lock "c7a55179-cde6-4fbd-a8b3-c3df149bc6f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:31:48 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-e0a62e06-2f2f-486d-822c-acb2099fcbb9 req-88f9a19f-566b-49d3-b633-b82f03dfb6ac service nova] Lock "c7a55179-cde6-4fbd-a8b3-c3df149bc6f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:31:48 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-e0a62e06-2f2f-486d-822c-acb2099fcbb9 req-88f9a19f-566b-49d3-b633-b82f03dfb6ac service nova] Lock "c7a55179-cde6-4fbd-a8b3-c3df149bc6f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:31:48 user nova-compute[75165]: DEBUG nova.compute.manager [req-e0a62e06-2f2f-486d-822c-acb2099fcbb9 req-88f9a19f-566b-49d3-b633-b82f03dfb6ac service nova] [instance: c7a55179-cde6-4fbd-a8b3-c3df149bc6f3] No waiting events found dispatching network-vif-plugged-70711118-68ee-4ea5-bfc2-df652ed0f3c1 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:31:48 user nova-compute[75165]: WARNING nova.compute.manager [req-e0a62e06-2f2f-486d-822c-acb2099fcbb9 req-88f9a19f-566b-49d3-b633-b82f03dfb6ac service nova] [instance: c7a55179-cde6-4fbd-a8b3-c3df149bc6f3] Received unexpected event network-vif-plugged-70711118-68ee-4ea5-bfc2-df652ed0f3c1 for instance with vm_state active and task_state rescuing.
Oct 26 00:31:48 user nova-compute[75165]: DEBUG nova.compute.manager [None req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] [instance: 250afc24-0c38-4959-a77c-d51365dd1c4e] Instance event wait completed in 0 seconds for  {{(pid=75165) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 00:31:48 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] [instance: 250afc24-0c38-4959-a77c-d51365dd1c4e] Guest created on hypervisor {{(pid=75165) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 00:31:48 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: 250afc24-0c38-4959-a77c-d51365dd1c4e] Instance spawned successfully.
Oct 26 00:31:48 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] [instance: 250afc24-0c38-4959-a77c-d51365dd1c4e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 00:31:48 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] [instance: 250afc24-0c38-4959-a77c-d51365dd1c4e] Found default for hw_cdrom_bus of ide {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:31:48 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] [instance: 250afc24-0c38-4959-a77c-d51365dd1c4e] Found default for hw_disk_bus of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:31:48 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] [instance: 250afc24-0c38-4959-a77c-d51365dd1c4e] Found default for hw_input_bus of None {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:31:48 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] [instance: 250afc24-0c38-4959-a77c-d51365dd1c4e] Found default for hw_pointer_model of None {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:31:48 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] [instance: 250afc24-0c38-4959-a77c-d51365dd1c4e] Found default for hw_video_model of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:31:48 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] [instance: 250afc24-0c38-4959-a77c-d51365dd1c4e] Found default for hw_vif_model of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:31:48 user nova-compute[75165]: DEBUG nova.compute.manager [None req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] [instance: 250afc24-0c38-4959-a77c-d51365dd1c4e] Checking state {{(pid=75165) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 00:31:49 user nova-compute[75165]: DEBUG nova.compute.manager [None req-73316ea5-9517-41aa-be76-989a0fab9892 tempest-VolumesNegativeTest-1416627237 tempest-VolumesNegativeTest-1416627237-project-member] [instance: 00c0e0e2-4c40-45a3-829a-b6b73482e311] Instance event wait completed in 0 seconds for  {{(pid=75165) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 00:31:49 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-73316ea5-9517-41aa-be76-989a0fab9892 tempest-VolumesNegativeTest-1416627237 tempest-VolumesNegativeTest-1416627237-project-member] [instance: 00c0e0e2-4c40-45a3-829a-b6b73482e311] Guest created on hypervisor {{(pid=75165) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 00:31:49 user nova-compute[75165]: DEBUG nova.compute.manager [None req-6ea26b8c-509b-40fd-b4b5-3149e6502e41 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: c7a55179-cde6-4fbd-a8b3-c3df149bc6f3] Checking state {{(pid=75165) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 00:31:49 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: 00c0e0e2-4c40-45a3-829a-b6b73482e311] Instance spawned successfully.
Oct 26 00:31:49 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-73316ea5-9517-41aa-be76-989a0fab9892 tempest-VolumesNegativeTest-1416627237 tempest-VolumesNegativeTest-1416627237-project-member] [instance: 00c0e0e2-4c40-45a3-829a-b6b73482e311] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 00:31:49 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:31:49 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:31:49 user nova-compute[75165]: DEBUG nova.objects.instance [None req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] [instance: 250afc24-0c38-4959-a77c-d51365dd1c4e] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75165) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1078}}
Oct 26 00:31:49 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-73316ea5-9517-41aa-be76-989a0fab9892 tempest-VolumesNegativeTest-1416627237 tempest-VolumesNegativeTest-1416627237-project-member] [instance: 00c0e0e2-4c40-45a3-829a-b6b73482e311] Found default for hw_cdrom_bus of ide {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:31:49 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-73316ea5-9517-41aa-be76-989a0fab9892 tempest-VolumesNegativeTest-1416627237 tempest-VolumesNegativeTest-1416627237-project-member] [instance: 00c0e0e2-4c40-45a3-829a-b6b73482e311] Found default for hw_disk_bus of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:31:49 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-73316ea5-9517-41aa-be76-989a0fab9892 tempest-VolumesNegativeTest-1416627237 tempest-VolumesNegativeTest-1416627237-project-member] [instance: 00c0e0e2-4c40-45a3-829a-b6b73482e311] Found default for hw_input_bus of None {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:31:49 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-73316ea5-9517-41aa-be76-989a0fab9892 tempest-VolumesNegativeTest-1416627237 tempest-VolumesNegativeTest-1416627237-project-member] [instance: 00c0e0e2-4c40-45a3-829a-b6b73482e311] Found default for hw_pointer_model of None {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:31:49 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-73316ea5-9517-41aa-be76-989a0fab9892 tempest-VolumesNegativeTest-1416627237 tempest-VolumesNegativeTest-1416627237-project-member] [instance: 00c0e0e2-4c40-45a3-829a-b6b73482e311] Found default for hw_video_model of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:31:49 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-73316ea5-9517-41aa-be76-989a0fab9892 tempest-VolumesNegativeTest-1416627237 tempest-VolumesNegativeTest-1416627237-project-member] [instance: 00c0e0e2-4c40-45a3-829a-b6b73482e311] Found default for hw_vif_model of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:31:49 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-d3346b7b-7242-4a48-af36-bd5a66c7ff1d tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.110s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:31:49 user nova-compute[75165]: INFO nova.compute.manager [None req-73316ea5-9517-41aa-be76-989a0fab9892 tempest-VolumesNegativeTest-1416627237 tempest-VolumesNegativeTest-1416627237-project-member] [instance: 00c0e0e2-4c40-45a3-829a-b6b73482e311] Took 8.07 seconds to spawn the instance on the hypervisor.
Oct 26 00:31:49 user nova-compute[75165]: DEBUG nova.compute.manager [None req-73316ea5-9517-41aa-be76-989a0fab9892 tempest-VolumesNegativeTest-1416627237 tempest-VolumesNegativeTest-1416627237-project-member] [instance: 00c0e0e2-4c40-45a3-829a-b6b73482e311] Checking state {{(pid=75165) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 00:31:49 user nova-compute[75165]: INFO nova.compute.manager [None req-73316ea5-9517-41aa-be76-989a0fab9892 tempest-VolumesNegativeTest-1416627237 tempest-VolumesNegativeTest-1416627237-project-member] [instance: 00c0e0e2-4c40-45a3-829a-b6b73482e311] Took 8.97 seconds to build instance.
Oct 26 00:31:49 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-73316ea5-9517-41aa-be76-989a0fab9892 tempest-VolumesNegativeTest-1416627237 tempest-VolumesNegativeTest-1416627237-project-member] Lock "00c0e0e2-4c40-45a3-829a-b6b73482e311" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.323s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:31:51 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:31:52 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:31:57 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:32:00 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-60550a93-9dcb-4c59-b633-d7fe37797a42 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance bb77893d-263a-40a6-9acc-63fcd1481a38 is timed out.
Oct 26 00:32:00 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-60550a93-9dcb-4c59-b633-d7fe37797a42 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Successfully detached device vdb from instance bb77893d-263a-40a6-9acc-63fcd1481a38 from the live domain config.
Oct 26 00:32:00 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60550a93-9dcb-4c59-b633-d7fe37797a42 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] [instance: bb77893d-263a-40a6-9acc-63fcd1481a38] calling os-brick to detach iSCSI Volume {{(pid=75165) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 00:32:00 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-60550a93-9dcb-4c59-b633-d7fe37797a42 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8bf8160e50>, {'target_iqn': 'iqn.2010-10.org.openstack:20bc9a02-2908-4429-8524-fcc9553f3a29', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'antKmxGH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:32:00 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-60550a93-9dcb-4c59-b633-d7fe37797a42 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:32:00 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-60550a93-9dcb-4c59-b633-d7fe37797a42 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:32:00 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-60550a93-9dcb-4c59-b633-d7fe37797a42 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:32:00 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:32:00 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:32:00 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[219add10-9f8a-484f-830f-e2e39669ea0f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:20bc9a02-2908-4429-8524-fcc9553f3a29\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:32:00 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-60550a93-9dcb-4c59-b633-d7fe37797a42 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 00:32:00 user nova-compute[75165]: No targets found.
Oct 26 00:32:00 user nova-compute[75165]: iSNS:
Oct 26 00:32:00 user nova-compute[75165]: No targets found.
Oct 26 00:32:00 user nova-compute[75165]: STATIC:
Oct 26 00:32:00 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:20bc9a02-2908-4429-8524-fcc9553f3a29
Oct 26 00:32:00 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:32:00 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:32:00 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8
Oct 26 00:32:00 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:32:00 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:32:00 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795
Oct 26 00:32:00 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:32:00 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:32:00 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0
Oct 26 00:32:00 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:32:00 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:32:00 user nova-compute[75165]: FIRMWARE:
Oct 26 00:32:00 user nova-compute[75165]: No targets found.
Oct 26 00:32:00 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:32:00 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-60550a93-9dcb-4c59-b633-d7fe37797a42 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 00:32:00 user nova-compute[75165]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 00:32:00 user nova-compute[75165]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75165) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 00:32:00 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-60550a93-9dcb-4c59-b633-d7fe37797a42 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:20bc9a02-2908-4429-8524-fcc9553f3a29', 0)] {{(pid=75165) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 00:32:00 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:32:00 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:32:00 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[a176dede-d369-4316-aabc-38693fbd772c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20bc9a02-2908-4429-8524-fcc9553f3a29\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:32:00 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:32:00 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:32:00 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[202d3d93-e00e-41b2-b6d2-f298cb937708]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20bc9a02-2908-4429-8524-fcc9553f3a29 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0 (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:32:00 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-60550a93-9dcb-4c59-b633-d7fe37797a42 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)
Oct 26 00:32:00 user nova-compute[75165]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8 (non-flash)
Oct 26 00:32:00 user nova-compute[75165]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20bc9a02-2908-4429-8524-fcc9553f3a29 (non-flash)
Oct 26 00:32:00 user nova-compute[75165]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0 (non-flash)
Oct 26 00:32:00 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:32:00 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-60550a93-9dcb-4c59-b633-d7fe37797a42 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)
Oct 26 00:32:00 user nova-compute[75165]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8 (non-flash)
Oct 26 00:32:00 user nova-compute[75165]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20bc9a02-2908-4429-8524-fcc9553f3a29 (non-flash)
Oct 26 00:32:00 user nova-compute[75165]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0 (non-flash)
Oct 26 00:32:00 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:32:00 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-60550a93-9dcb-4c59-b633-d7fe37797a42 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8c00137250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:20bc9a02-2908-4429-8524-fcc9553f3a29'): ({'sdd'}, set())}) {{(pid=75165) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 00:32:00 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-60550a93-9dcb-4c59-b633-d7fe37797a42 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Removing single pathed devices sdd {{(pid=75165) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 00:32:00 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:32:00 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:32:00 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[68329107-fce8-4e0c-863c-47e35938636e]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:32:00 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:32:00 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:32:00 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[63421636-9ef4-43b5-acfd-c27791b39956]: (4, ('ok\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:32:00 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-60550a93-9dcb-4c59-b633-d7fe37797a42 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Flushing IO for device /dev/sdd {{(pid=75165) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 00:32:00 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:32:00 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:32:00 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[45470ec3-33f4-4a83-ab84-9b79e9432c60]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:32:00 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-60550a93-9dcb-4c59-b633-d7fe37797a42 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75165) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 00:32:00 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:32:00 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.045s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:32:00 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1c67e48-b64c-4017-a954-531470468f25]: (4, ('1', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:32:00 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-60550a93-9dcb-4c59-b633-d7fe37797a42 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75165) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 00:32:00 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-60550a93-9dcb-4c59-b633-d7fe37797a42 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] SCSI volumes sdd have been removed. {{(pid=75165) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 00:32:00 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-60550a93-9dcb-4c59-b633-d7fe37797a42 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:20bc9a02-2908-4429-8524-fcc9553f3a29')] {{(pid=75165) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 00:32:00 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20bc9a02-2908-4429-8524-fcc9553f3a29 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:32:00 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20bc9a02-2908-4429-8524-fcc9553f3a29 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:32:00 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[6be58d93-a21b-414c-9d4a-f2a73f6993bc]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:32:00 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-60550a93-9dcb-4c59-b633-d7fe37797a42 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:32:00 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20bc9a02-2908-4429-8524-fcc9553f3a29 -p 172.16.0.220:3260 --logout {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:32:00 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20bc9a02-2908-4429-8524-fcc9553f3a29 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:32:00 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcd2450c-3574-43ae-9cfe-b7d488ad3c87]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:20bc9a02-2908-4429-8524-fcc9553f3a29, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:20bc9a02-2908-4429-8524-fcc9553f3a29, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:32:00 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-60550a93-9dcb-4c59-b633-d7fe37797a42 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:20bc9a02-2908-4429-8524-fcc9553f3a29, portal: 172.16.0.220,3260]
Oct 26 00:32:00 user nova-compute[75165]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:20bc9a02-2908-4429-8524-fcc9553f3a29, portal: 172.16.0.220,3260] successful.
Oct 26 00:32:00 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:32:00 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20bc9a02-2908-4429-8524-fcc9553f3a29 -p 172.16.0.220:3260 --op delete {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:32:00 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20bc9a02-2908-4429-8524-fcc9553f3a29 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:32:00 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b638d61-4303-4f80-8e61-63808fd771f7]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:32:00 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-60550a93-9dcb-4c59-b633-d7fe37797a42 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:32:00 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-60550a93-9dcb-4c59-b633-d7fe37797a42 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.338s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:32:00 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-60550a93-9dcb-4c59-b633-d7fe37797a42 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] <== disconnect_volume: return (340ms) None {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:32:00 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60550a93-9dcb-4c59-b633-d7fe37797a42 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] [instance: bb77893d-263a-40a6-9acc-63fcd1481a38] Disconnected iSCSI Volume {{(pid=75165) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 00:32:01 user nova-compute[75165]: DEBUG nova.objects.instance [None req-60550a93-9dcb-4c59-b633-d7fe37797a42 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Lazy-loading 'flavor' on Instance uuid bb77893d-263a-40a6-9acc-63fcd1481a38 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:32:01 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-60550a93-9dcb-4c59-b633-d7fe37797a42 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Lock "bb77893d-263a-40a6-9acc-63fcd1481a38" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.084s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:32:01 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-bac40c51-7db0-43ca-93bd-90088842e0d3 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Lock "bb77893d-263a-40a6-9acc-63fcd1481a38" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 22.829s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:32:01 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-bac40c51-7db0-43ca-93bd-90088842e0d3 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Acquiring lock "bb77893d-263a-40a6-9acc-63fcd1481a38-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:32:01 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-bac40c51-7db0-43ca-93bd-90088842e0d3 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Lock "bb77893d-263a-40a6-9acc-63fcd1481a38-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:32:01 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-bac40c51-7db0-43ca-93bd-90088842e0d3 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Lock "bb77893d-263a-40a6-9acc-63fcd1481a38-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:32:01 user nova-compute[75165]: INFO nova.compute.manager [None req-bac40c51-7db0-43ca-93bd-90088842e0d3 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] [instance: bb77893d-263a-40a6-9acc-63fcd1481a38] Terminating instance
Oct 26 00:32:01 user nova-compute[75165]: DEBUG nova.compute.manager [None req-bac40c51-7db0-43ca-93bd-90088842e0d3 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] [instance: bb77893d-263a-40a6-9acc-63fcd1481a38] Start destroying the instance on the hypervisor. {{(pid=75165) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 00:32:01 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:32:01 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:32:01 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:32:01 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:32:01 user nova-compute[75165]: DEBUG nova.compute.manager [req-576f5fb3-8dee-4519-af74-9da54ee6c1fc req-51e7f5b5-2855-42e7-adba-327aa72642ad service nova] [instance: bb77893d-263a-40a6-9acc-63fcd1481a38] Received event network-vif-unplugged-f6053f89-f617-42db-8747-b5cc98ee387d {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:32:01 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-576f5fb3-8dee-4519-af74-9da54ee6c1fc req-51e7f5b5-2855-42e7-adba-327aa72642ad service nova] Acquiring lock "bb77893d-263a-40a6-9acc-63fcd1481a38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:32:01 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-576f5fb3-8dee-4519-af74-9da54ee6c1fc req-51e7f5b5-2855-42e7-adba-327aa72642ad service nova] Lock "bb77893d-263a-40a6-9acc-63fcd1481a38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:32:01 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-576f5fb3-8dee-4519-af74-9da54ee6c1fc req-51e7f5b5-2855-42e7-adba-327aa72642ad service nova] Lock "bb77893d-263a-40a6-9acc-63fcd1481a38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:32:01 user nova-compute[75165]: DEBUG nova.compute.manager [req-576f5fb3-8dee-4519-af74-9da54ee6c1fc req-51e7f5b5-2855-42e7-adba-327aa72642ad service nova] [instance: bb77893d-263a-40a6-9acc-63fcd1481a38] No waiting events found dispatching network-vif-unplugged-f6053f89-f617-42db-8747-b5cc98ee387d {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:32:01 user nova-compute[75165]: DEBUG nova.compute.manager [req-576f5fb3-8dee-4519-af74-9da54ee6c1fc req-51e7f5b5-2855-42e7-adba-327aa72642ad service nova] [instance: bb77893d-263a-40a6-9acc-63fcd1481a38] Received event network-vif-unplugged-f6053f89-f617-42db-8747-b5cc98ee387d for instance with task_state deleting. {{(pid=75165) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 00:32:01 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: bb77893d-263a-40a6-9acc-63fcd1481a38] Instance destroyed successfully.
Oct 26 00:32:01 user nova-compute[75165]: DEBUG nova.objects.instance [None req-bac40c51-7db0-43ca-93bd-90088842e0d3 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Lazy-loading 'resources' on Instance uuid bb77893d-263a-40a6-9acc-63fcd1481a38 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:32:01 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-bac40c51-7db0-43ca-93bd-90088842e0d3 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:28:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-470954302',display_name='tempest-VolumesSnapshotTestJSON-instance-470954302',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-470954302',id=33,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNBXS5sHvrV8NXVlX5KinYRSSLGTTHGvsBzLJMinsINdK3DpdP5tm/H/Mopc7zIaTi4qqsdizO1fW5e6IW0tvJ6RSVAqRbNJVBIPPb+EelO0XiWfg7DcO+hprC0/WazIaQ==',key_name='tempest-keypair-2122161877',keypairs=<?>,launch_index=0,launched_at=2023-10-26T00:28:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9eed16e1778f4ffb93afcc1ddbfe3d72',ramdisk_id='',reservation_id='r-mlm0l7qb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1190581483',owner_user_name='tempest-VolumesSnapshotTestJSON-1190581483-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T00:28:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7cd8b7fb014340bcb4efbe7a0063cdc7',uuid=bb77893d-263a-40a6-9acc-63fcd1481a38,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f6053f89-f617-42db-8747-b5cc98ee387d", "address": "fa:16:3e:82:0a:f8", "network": {"id": "6b000f11-7be2-4a26-ba67-b10f275e8560", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1605988141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eed16e1778f4ffb93afcc1ddbfe3d72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6053f89-f6", "ovs_interfaceid": "f6053f89-f617-42db-8747-b5cc98ee387d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 00:32:02 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-bac40c51-7db0-43ca-93bd-90088842e0d3 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Converting VIF {"id": "f6053f89-f617-42db-8747-b5cc98ee387d", "address": "fa:16:3e:82:0a:f8", "network": {"id": "6b000f11-7be2-4a26-ba67-b10f275e8560", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1605988141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9eed16e1778f4ffb93afcc1ddbfe3d72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6053f89-f6", "ovs_interfaceid": "f6053f89-f617-42db-8747-b5cc98ee387d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:32:02 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-bac40c51-7db0-43ca-93bd-90088842e0d3 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:82:0a:f8,bridge_name='br-int',has_traffic_filtering=True,id=f6053f89-f617-42db-8747-b5cc98ee387d,network=Network(6b000f11-7be2-4a26-ba67-b10f275e8560),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6053f89-f6') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:32:02 user nova-compute[75165]: DEBUG os_vif [None req-bac40c51-7db0-43ca-93bd-90088842e0d3 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:82:0a:f8,bridge_name='br-int',has_traffic_filtering=True,id=f6053f89-f617-42db-8747-b5cc98ee387d,network=Network(6b000f11-7be2-4a26-ba67-b10f275e8560),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6053f89-f6') {{(pid=75165) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 00:32:02 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:32:02 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf6053f89-f6, bridge=br-int, if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:32:02 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:32:02 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:32:02 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:32:02 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:32:02 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3a4afe40-7222-4697-8630-713d12060a30) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:32:02 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:32:02 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:32:02 user nova-compute[75165]: INFO os_vif [None req-bac40c51-7db0-43ca-93bd-90088842e0d3 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:82:0a:f8,bridge_name='br-int',has_traffic_filtering=True,id=f6053f89-f617-42db-8747-b5cc98ee387d,network=Network(6b000f11-7be2-4a26-ba67-b10f275e8560),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6053f89-f6')
Oct 26 00:32:02 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bac40c51-7db0-43ca-93bd-90088842e0d3 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] [instance: bb77893d-263a-40a6-9acc-63fcd1481a38] calling os-brick to detach iSCSI Volume {{(pid=75165) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 00:32:02 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-bac40c51-7db0-43ca-93bd-90088842e0d3 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8bf8160e50>, {'target_iqn': 'iqn.2010-10.org.openstack:20bc9a02-2908-4429-8524-fcc9553f3a29', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'antKmxGH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:32:02 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-bac40c51-7db0-43ca-93bd-90088842e0d3 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:32:02 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-bac40c51-7db0-43ca-93bd-90088842e0d3 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:32:02 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-bac40c51-7db0-43ca-93bd-90088842e0d3 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:32:02 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:32:02 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:32:02 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[e66b7f45-e07d-4d46-b6cd-f4210ea0253d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:32:02 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-bac40c51-7db0-43ca-93bd-90088842e0d3 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 00:32:02 user nova-compute[75165]: No targets found.
Oct 26 00:32:02 user nova-compute[75165]: iSNS:
Oct 26 00:32:02 user nova-compute[75165]: No targets found.
Oct 26 00:32:02 user nova-compute[75165]: STATIC:
Oct 26 00:32:02 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8
Oct 26 00:32:02 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:32:02 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:32:02 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795
Oct 26 00:32:02 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:32:02 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:32:02 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0
Oct 26 00:32:02 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:32:02 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:32:02 user nova-compute[75165]: FIRMWARE:
Oct 26 00:32:02 user nova-compute[75165]: No targets found.
Oct 26 00:32:02 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:32:02 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-bac40c51-7db0-43ca-93bd-90088842e0d3 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 00:32:02 user nova-compute[75165]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 00:32:02 user nova-compute[75165]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75165) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 00:32:02 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-bac40c51-7db0-43ca-93bd-90088842e0d3 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:20bc9a02-2908-4429-8524-fcc9553f3a29', 0)] {{(pid=75165) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 00:32:02 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:32:02 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:32:02 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[4db22a67-2d98-4b9b-865c-3a3661a4bb4f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:32:02 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:32:02 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:32:02 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[301969f0-9783-467d-b976-5d8e55a46d93]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0 (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:32:02 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-bac40c51-7db0-43ca-93bd-90088842e0d3 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)
Oct 26 00:32:02 user nova-compute[75165]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8 (non-flash)
Oct 26 00:32:02 user nova-compute[75165]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0 (non-flash)
Oct 26 00:32:02 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:32:02 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-bac40c51-7db0-43ca-93bd-90088842e0d3 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)
Oct 26 00:32:02 user nova-compute[75165]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8 (non-flash)
Oct 26 00:32:02 user nova-compute[75165]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0 (non-flash)
Oct 26 00:32:02 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:32:02 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-bac40c51-7db0-43ca-93bd-90088842e0d3 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8c00137400>, {}) {{(pid=75165) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 00:32:02 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-bac40c51-7db0-43ca-93bd-90088842e0d3 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Disconnecting from: [] {{(pid=75165) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 00:32:02 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-bac40c51-7db0-43ca-93bd-90088842e0d3 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.085s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:32:02 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-bac40c51-7db0-43ca-93bd-90088842e0d3 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] <== disconnect_volume: return (86ms) None {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:32:02 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bac40c51-7db0-43ca-93bd-90088842e0d3 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] [instance: bb77893d-263a-40a6-9acc-63fcd1481a38] Disconnected iSCSI Volume {{(pid=75165) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 00:32:02 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-bac40c51-7db0-43ca-93bd-90088842e0d3 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] [instance: bb77893d-263a-40a6-9acc-63fcd1481a38] Deleting instance files /opt/stack/data/nova/instances/bb77893d-263a-40a6-9acc-63fcd1481a38_del
Oct 26 00:32:02 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-bac40c51-7db0-43ca-93bd-90088842e0d3 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] [instance: bb77893d-263a-40a6-9acc-63fcd1481a38] Deletion of /opt/stack/data/nova/instances/bb77893d-263a-40a6-9acc-63fcd1481a38_del complete
Oct 26 00:32:02 user nova-compute[75165]: INFO nova.compute.manager [None req-bac40c51-7db0-43ca-93bd-90088842e0d3 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] [instance: bb77893d-263a-40a6-9acc-63fcd1481a38] Took 0.98 seconds to destroy the instance on the hypervisor.
Oct 26 00:32:02 user nova-compute[75165]: DEBUG oslo.service.loopingcall [None req-bac40c51-7db0-43ca-93bd-90088842e0d3 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75165) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 00:32:02 user nova-compute[75165]: DEBUG nova.compute.manager [-] [instance: bb77893d-263a-40a6-9acc-63fcd1481a38] Deallocating network for instance {{(pid=75165) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 00:32:02 user nova-compute[75165]: DEBUG nova.network.neutron [-] [instance: bb77893d-263a-40a6-9acc-63fcd1481a38] deallocate_for_instance() {{(pid=75165) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 00:32:02 user nova-compute[75165]: DEBUG nova.network.neutron [-] [instance: bb77893d-263a-40a6-9acc-63fcd1481a38] Updating instance_info_cache with network_info: [] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:32:02 user nova-compute[75165]: INFO nova.compute.manager [-] [instance: bb77893d-263a-40a6-9acc-63fcd1481a38] Took 0.77 seconds to deallocate network for instance.
Oct 26 00:32:02 user nova-compute[75165]: DEBUG nova.compute.manager [req-14f3e818-c4a3-4f9e-ad81-623e92a6e10a req-4283d854-2044-4400-8d61-a42a7e214676 service nova] [instance: bb77893d-263a-40a6-9acc-63fcd1481a38] Received event network-vif-deleted-f6053f89-f617-42db-8747-b5cc98ee387d {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:32:02 user nova-compute[75165]: INFO nova.compute.manager [req-14f3e818-c4a3-4f9e-ad81-623e92a6e10a req-4283d854-2044-4400-8d61-a42a7e214676 service nova] [instance: bb77893d-263a-40a6-9acc-63fcd1481a38] Neutron deleted interface f6053f89-f617-42db-8747-b5cc98ee387d; detaching it from the instance and deleting it from the info cache
Oct 26 00:32:02 user nova-compute[75165]: DEBUG nova.network.neutron [req-14f3e818-c4a3-4f9e-ad81-623e92a6e10a req-4283d854-2044-4400-8d61-a42a7e214676 service nova] [instance: bb77893d-263a-40a6-9acc-63fcd1481a38] Updating instance_info_cache with network_info: [] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:32:03 user nova-compute[75165]: DEBUG nova.compute.manager [req-14f3e818-c4a3-4f9e-ad81-623e92a6e10a req-4283d854-2044-4400-8d61-a42a7e214676 service nova] [instance: bb77893d-263a-40a6-9acc-63fcd1481a38] Detach interface failed, port_id=f6053f89-f617-42db-8747-b5cc98ee387d, reason: Instance bb77893d-263a-40a6-9acc-63fcd1481a38 could not be found. {{(pid=75165) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 26 00:32:03 user nova-compute[75165]: WARNING nova.volume.cinder [None req-bac40c51-7db0-43ca-93bd-90088842e0d3 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Attachment 6012cb3a-cbe8-4798-b1e3-61db1869a3ef does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 6012cb3a-cbe8-4798-b1e3-61db1869a3ef. (HTTP 404) (Request-ID: req-ae42c6c1-8f0a-4210-8619-326e52235150)
Oct 26 00:32:03 user nova-compute[75165]: INFO nova.compute.manager [None req-bac40c51-7db0-43ca-93bd-90088842e0d3 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] [instance: bb77893d-263a-40a6-9acc-63fcd1481a38] Took 0.04 seconds to detach 1 volumes for instance.
Oct 26 00:32:03 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:32:03 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-bac40c51-7db0-43ca-93bd-90088842e0d3 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:32:03 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-bac40c51-7db0-43ca-93bd-90088842e0d3 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:32:03 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-bac40c51-7db0-43ca-93bd-90088842e0d3 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:32:03 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-bac40c51-7db0-43ca-93bd-90088842e0d3 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:32:03 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-bac40c51-7db0-43ca-93bd-90088842e0d3 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.348s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:32:03 user nova-compute[75165]: INFO nova.scheduler.client.report [None req-bac40c51-7db0-43ca-93bd-90088842e0d3 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Deleted allocations for instance bb77893d-263a-40a6-9acc-63fcd1481a38
Oct 26 00:32:03 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-bac40c51-7db0-43ca-93bd-90088842e0d3 tempest-VolumesSnapshotTestJSON-1190581483 tempest-VolumesSnapshotTestJSON-1190581483-project-member] Lock "bb77893d-263a-40a6-9acc-63fcd1481a38" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.387s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:32:03 user nova-compute[75165]: DEBUG nova.compute.manager [req-c52bf8ea-031e-4828-ae26-f83e6e209124 req-c213bd10-5d82-4d84-9381-2dd6f4d3d0e3 service nova] [instance: bb77893d-263a-40a6-9acc-63fcd1481a38] Received event network-vif-plugged-f6053f89-f617-42db-8747-b5cc98ee387d {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:32:03 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-c52bf8ea-031e-4828-ae26-f83e6e209124 req-c213bd10-5d82-4d84-9381-2dd6f4d3d0e3 service nova] Acquiring lock "bb77893d-263a-40a6-9acc-63fcd1481a38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:32:03 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-c52bf8ea-031e-4828-ae26-f83e6e209124 req-c213bd10-5d82-4d84-9381-2dd6f4d3d0e3 service nova] Lock "bb77893d-263a-40a6-9acc-63fcd1481a38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:32:03 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-c52bf8ea-031e-4828-ae26-f83e6e209124 req-c213bd10-5d82-4d84-9381-2dd6f4d3d0e3 service nova] Lock "bb77893d-263a-40a6-9acc-63fcd1481a38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:32:03 user nova-compute[75165]: DEBUG nova.compute.manager [req-c52bf8ea-031e-4828-ae26-f83e6e209124 req-c213bd10-5d82-4d84-9381-2dd6f4d3d0e3 service nova] [instance: bb77893d-263a-40a6-9acc-63fcd1481a38] No waiting events found dispatching network-vif-plugged-f6053f89-f617-42db-8747-b5cc98ee387d {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:32:03 user nova-compute[75165]: WARNING nova.compute.manager [req-c52bf8ea-031e-4828-ae26-f83e6e209124 req-c213bd10-5d82-4d84-9381-2dd6f4d3d0e3 service nova] [instance: bb77893d-263a-40a6-9acc-63fcd1481a38] Received unexpected event network-vif-plugged-f6053f89-f617-42db-8747-b5cc98ee387d for instance with vm_state deleted and task_state None.
Oct 26 00:32:06 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:32:07 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:32:11 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:32:12 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:32:13 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:32:13 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75165) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 00:32:16 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:32:17 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:32:17 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-e8425556-43c0-4089-bb36-9f2278ae9f73 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Acquiring lock "fe2984ce-8958-4049-8af7-496b313b26c8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:32:17 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-e8425556-43c0-4089-bb36-9f2278ae9f73 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Lock "fe2984ce-8958-4049-8af7-496b313b26c8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:32:17 user nova-compute[75165]: DEBUG nova.objects.instance [None req-e8425556-43c0-4089-bb36-9f2278ae9f73 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Lazy-loading 'flavor' on Instance uuid fe2984ce-8958-4049-8af7-496b313b26c8 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:32:17 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-e8425556-43c0-4089-bb36-9f2278ae9f73 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Lock "fe2984ce-8958-4049-8af7-496b313b26c8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:32:18 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-e8425556-43c0-4089-bb36-9f2278ae9f73 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Acquiring lock "fe2984ce-8958-4049-8af7-496b313b26c8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:32:18 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-e8425556-43c0-4089-bb36-9f2278ae9f73 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Lock "fe2984ce-8958-4049-8af7-496b313b26c8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:32:18 user nova-compute[75165]: INFO nova.compute.manager [None req-e8425556-43c0-4089-bb36-9f2278ae9f73 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] [instance: fe2984ce-8958-4049-8af7-496b313b26c8] Attaching volume 4183c46e-4834-4152-b647-c5a7cf3e29f8 to /dev/vdb
Oct 26 00:32:18 user nova-compute[75165]: DEBUG os_brick.utils [None req-e8425556-43c0-4089-bb36-9f2278ae9f73 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:32:18 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:32:18 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:32:18 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[644d47c7-ee0c-4016-86e3-0c68d1f2cd54]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa94814ccb35\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:32:18 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:32:18 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:32:18 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b67d69f-47b0-4725-9c89-a958a8dd2314]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:32:18 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:32:18 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:32:18 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab9367b4-f2c4-44fd-86e5-d67d71521c25]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:32:18 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a35f4f3-9e59-4080-9030-50e2b9d5804c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:32:18 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-e8425556-43c0-4089-bb36-9f2278ae9f73 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Running cmd (subprocess): nvme version {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:32:18 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-e8425556-43c0-4089-bb36-9f2278ae9f73 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] 'nvme version' failed. Not Retrying. {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 00:32:18 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e8425556-43c0-4089-bb36-9f2278ae9f73 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] nvme not present on system {{(pid=75165) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 00:32:18 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:32:18 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 00:32:18 user nova-compute[75165]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 00:32:18 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea116c91-8926-4f1e-a5c5-5c7f14946640]: (4, '') {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:32:18 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-e8425556-43c0-4089-bb36-9f2278ae9f73 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75165) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 00:32:18 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-e8425556-43c0-4089-bb36-9f2278ae9f73 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75165) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 00:32:18 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-e8425556-43c0-4089-bb36-9f2278ae9f73 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] LIGHTOS: no hostnqn found. {{(pid=75165) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 00:32:18 user nova-compute[75165]: DEBUG os_brick.utils [None req-e8425556-43c0-4089-bb36-9f2278ae9f73 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa94814ccb35', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:32:18 user nova-compute[75165]: DEBUG nova.virt.block_device [None req-e8425556-43c0-4089-bb36-9f2278ae9f73 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] [instance: fe2984ce-8958-4049-8af7-496b313b26c8] Updating existing volume attachment record: bd4e7e1a-fc4a-4fe9-86ba-f2bae3a746cd {{(pid=75165) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 00:32:18 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:32:19 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:32:20 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:32:21 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:32:21 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:32:21 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Starting heal instance info cache {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 00:32:21 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "refresh_cache-b3c87b07-5c16-4f45-b320-06d3503d23e6" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:32:21 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquired lock "refresh_cache-b3c87b07-5c16-4f45-b320-06d3503d23e6" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:32:21 user nova-compute[75165]: DEBUG nova.network.neutron [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: b3c87b07-5c16-4f45-b320-06d3503d23e6] Forcefully refreshing network info cache for instance {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 00:32:22 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:32:22 user nova-compute[75165]: DEBUG nova.network.neutron [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: b3c87b07-5c16-4f45-b320-06d3503d23e6] Updating instance_info_cache with network_info: [{"id": "eec50cb9-592b-4b34-ac42-37a92ebb2a27", "address": "fa:16:3e:dc:68:1d", "network": {"id": "eb55c0bc-cae5-4ba3-851a-e31a50b52c88", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1081223830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d616862c7c184de5b0ba3121552c5666", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeec50cb9-59", "ovs_interfaceid": "eec50cb9-592b-4b34-ac42-37a92ebb2a27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:32:22 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Releasing lock "refresh_cache-b3c87b07-5c16-4f45-b320-06d3503d23e6" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:32:22 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: b3c87b07-5c16-4f45-b320-06d3503d23e6] Updated the network info_cache for instance {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 00:32:22 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:32:23 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:32:24 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:32:24 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:32:24 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:32:24 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:32:24 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:32:24 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75165) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 00:32:25 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75165) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 00:32:25 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75165) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 00:32:25 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7a55179-cde6-4fbd-a8b3-c3df149bc6f3/disk.rescue --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:32:25 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7a55179-cde6-4fbd-a8b3-c3df149bc6f3/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:32:25 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7a55179-cde6-4fbd-a8b3-c3df149bc6f3/disk.rescue --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:32:25 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7a55179-cde6-4fbd-a8b3-c3df149bc6f3/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:32:25 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97fb67a7-637d-456f-b4dd-0a271ed6cfc4/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:32:25 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97fb67a7-637d-456f-b4dd-0a271ed6cfc4/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:32:25 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97fb67a7-637d-456f-b4dd-0a271ed6cfc4/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:32:25 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97fb67a7-637d-456f-b4dd-0a271ed6cfc4/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:32:25 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c0e0e2-4c40-45a3-829a-b6b73482e311/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:32:26 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c0e0e2-4c40-45a3-829a-b6b73482e311/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:32:26 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c0e0e2-4c40-45a3-829a-b6b73482e311/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:32:26 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c0e0e2-4c40-45a3-829a-b6b73482e311/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:32:26 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75165) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 00:32:26 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3c87b07-5c16-4f45-b320-06d3503d23e6/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:32:26 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3c87b07-5c16-4f45-b320-06d3503d23e6/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:32:26 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3c87b07-5c16-4f45-b320-06d3503d23e6/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:32:26 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3c87b07-5c16-4f45-b320-06d3503d23e6/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:32:26 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe2984ce-8958-4049-8af7-496b313b26c8/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:32:26 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:32:26 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe2984ce-8958-4049-8af7-496b313b26c8/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:32:26 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe2984ce-8958-4049-8af7-496b313b26c8/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:32:27 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe2984ce-8958-4049-8af7-496b313b26c8/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:32:27 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:32:27 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:32:27 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:32:27 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Hypervisor/Node resource view: name=user free_ram=8006MB free_disk=24.700580596923828GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75165) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 00:32:27 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:32:27 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:32:27 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 97fb67a7-637d-456f-b4dd-0a271ed6cfc4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:32:27 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:32:27 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance fe2984ce-8958-4049-8af7-496b313b26c8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:32:27 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance b3c87b07-5c16-4f45-b320-06d3503d23e6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:32:27 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 250afc24-0c38-4959-a77c-d51365dd1c4e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:32:27 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance c7a55179-cde6-4fbd-a8b3-c3df149bc6f3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:32:27 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 00c0e0e2-4c40-45a3-829a-b6b73482e311 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:32:27 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75165) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 00:32:27 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75165) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 00:32:27 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:32:27 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:32:27 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Compute_service record updated for user:user {{(pid=75165) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 00:32:27 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.402s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:32:31 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:32:32 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:32:37 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:32:42 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:32:47 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:32:52 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:32:52 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e8425556-43c0-4089-bb36-9f2278ae9f73 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] [instance: fe2984ce-8958-4049-8af7-496b313b26c8] Calling os-brick to attach iSCSI Volume {{(pid=75165) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 00:32:52 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8425556-43c0-4089-bb36-9f2278ae9f73 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8bf8160e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4183c46e-4834-4152-b647-c5a7cf3e29f8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'URMukBaK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:32:52 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-e8425556-43c0-4089-bb36-9f2278ae9f73 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:32:52 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-e8425556-43c0-4089-bb36-9f2278ae9f73 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:32:52 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-e8425556-43c0-4089-bb36-9f2278ae9f73 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:32:52 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-e8425556-43c0-4089-bb36-9f2278ae9f73 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:32:52 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-e8425556-43c0-4089-bb36-9f2278ae9f73 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4183c46e-4834-4152-b647-c5a7cf3e29f8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:32:52 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-e8425556-43c0-4089-bb36-9f2278ae9f73 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4183c46e-4834-4152-b647-c5a7cf3e29f8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:32:52 user nova-compute[75165]: INFO os_brick.initiator.connectors.iscsi [None req-e8425556-43c0-4089-bb36-9f2278ae9f73 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 00:32:52 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4183c46e-4834-4152-b647-c5a7cf3e29f8 -p 172.16.0.220:3260 {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:32:52 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4183c46e-4834-4152-b647-c5a7cf3e29f8 -p 172.16.0.220:3260" returned: 21 in 0.034s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:32:52 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[35663b2b-788c-4ffe-8959-764fd26afda1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:32:52 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8425556-43c0-4089-bb36-9f2278ae9f73 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 00:32:52 user nova-compute[75165]:  {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:32:52 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4183c46e-4834-4152-b647-c5a7cf3e29f8 -p 172.16.0.220:3260 --interface default --op new {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:32:52 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4183c46e-4834-4152-b647-c5a7cf3e29f8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:32:52 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5f581dd-454a-40b4-a98d-bde5329632eb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4183c46e-4834-4152-b647-c5a7cf3e29f8] added\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:32:52 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8425556-43c0-4089-bb36-9f2278ae9f73 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4183c46e-4834-4152-b647-c5a7cf3e29f8] added
Oct 26 00:32:52 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:32:52 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4183c46e-4834-4152-b647-c5a7cf3e29f8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:32:52 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4183c46e-4834-4152-b647-c5a7cf3e29f8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.111s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:32:52 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[48ac2c03-45b8-4905-bad9-e9af523531f3]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:32:52 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8425556-43c0-4089-bb36-9f2278ae9f73 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:32:52 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4183c46e-4834-4152-b647-c5a7cf3e29f8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:32:52 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4183c46e-4834-4152-b647-c5a7cf3e29f8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:32:52 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f0cfe49-fcc7-470f-bc82-f4bf351e4f56]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:32:52 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8425556-43c0-4089-bb36-9f2278ae9f73 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:32:52 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4183c46e-4834-4152-b647-c5a7cf3e29f8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v URMukBaK {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:32:52 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4183c46e-4834-4152-b647-c5a7cf3e29f8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v URMukBaK" returned: 0 in 0.024s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:32:52 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e7db33d-d45d-457d-961e-524305ffa5e0]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:32:52 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8425556-43c0-4089-bb36-9f2278ae9f73 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'URMukBaK'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:32:52 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4183c46e-4834-4152-b647-c5a7cf3e29f8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:32:52 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4183c46e-4834-4152-b647-c5a7cf3e29f8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:32:52 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[b47e5703-ecc4-4c61-b77d-a83dc4729a1a]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:32:52 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8425556-43c0-4089-bb36-9f2278ae9f73 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:32:52 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:32:53 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:32:53 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[f83d1c23-049b-4091-ba0d-ec1156c2774f]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0 (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:32:53 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8425556-43c0-4089-bb36-9f2278ae9f73 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)
Oct 26 00:32:53 user nova-compute[75165]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8 (non-flash)
Oct 26 00:32:53 user nova-compute[75165]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0 (non-flash)
Oct 26 00:32:53 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:32:53 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8425556-43c0-4089-bb36-9f2278ae9f73 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)
Oct 26 00:32:53 user nova-compute[75165]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8 (non-flash)
Oct 26 00:32:53 user nova-compute[75165]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0 (non-flash)
Oct 26 00:32:53 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:32:53 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4183c46e-4834-4152-b647-c5a7cf3e29f8 -p 172.16.0.220:3260 --login {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:32:53 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4183c46e-4834-4152-b647-c5a7cf3e29f8 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:32:53 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[8831c618-cdc8-4911-bf0c-97cb4eb8cf32]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4183c46e-4834-4152-b647-c5a7cf3e29f8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4183c46e-4834-4152-b647-c5a7cf3e29f8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:32:53 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8425556-43c0-4089-bb36-9f2278ae9f73 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4183c46e-4834-4152-b647-c5a7cf3e29f8, portal: 172.16.0.220,3260]
Oct 26 00:32:53 user nova-compute[75165]: Login to [iface: default, target: iqn.2010-10.org.openstack:4183c46e-4834-4152-b647-c5a7cf3e29f8, portal: 172.16.0.220,3260] successful.
Oct 26 00:32:53 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:32:53 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4183c46e-4834-4152-b647-c5a7cf3e29f8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:32:53 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4183c46e-4834-4152-b647-c5a7cf3e29f8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:32:53 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca0b5d08-fb76-4696-8c08-0183c64aee4e]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:32:53 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8425556-43c0-4089-bb36-9f2278ae9f73 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:32:53 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:32:53 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:32:53 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[bea793d0-a4ed-47e0-921d-9684ca3f0ec4]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4183c46e-4834-4152-b647-c5a7cf3e29f8 (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:32:53 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8425556-43c0-4089-bb36-9f2278ae9f73 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)
Oct 26 00:32:53 user nova-compute[75165]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8 (non-flash)
Oct 26 00:32:53 user nova-compute[75165]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0 (non-flash)
Oct 26 00:32:53 user nova-compute[75165]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4183c46e-4834-4152-b647-c5a7cf3e29f8 (non-flash)
Oct 26 00:32:53 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:32:53 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8425556-43c0-4089-bb36-9f2278ae9f73 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)
Oct 26 00:32:53 user nova-compute[75165]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8 (non-flash)
Oct 26 00:32:53 user nova-compute[75165]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0 (non-flash)
Oct 26 00:32:53 user nova-compute[75165]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4183c46e-4834-4152-b647-c5a7cf3e29f8 (non-flash)
Oct 26 00:32:53 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:32:53 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-e8425556-43c0-4089-bb36-9f2278ae9f73 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4183c46e-4834-4152-b647-c5a7cf3e29f8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.435s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:32:53 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8425556-43c0-4089-bb36-9f2278ae9f73 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Connected to 172.16.0.220:3260 {{(pid=75165) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 00:32:53 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-e8425556-43c0-4089-bb36-9f2278ae9f73 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] HCTL ('35', '-', '-', 0) found on session 40 with lun 0 {{(pid=75165) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 00:32:53 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-e8425556-43c0-4089-bb36-9f2278ae9f73 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75165) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 00:32:53 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:32:53 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:32:53 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[294df14b-8d5f-4965-a3b7-7363f2a0f654]: (4, ('- - 0', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:32:53 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-e8425556-43c0-4089-bb36-9f2278ae9f73 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Searching for a device in session 40 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75165) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 00:32:53 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8425556-43c0-4089-bb36-9f2278ae9f73 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:4183c46e-4834-4152-b647-c5a7cf3e29f8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'URMukBaK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75165) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 00:32:54 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-e8425556-43c0-4089-bb36-9f2278ae9f73 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.473s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:32:54 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8425556-43c0-4089-bb36-9f2278ae9f73 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] <== connect_volume: return (1475ms) {'type': 'block', 'scsi_wwn': '26332393734343538', 'path': '/dev/sdd'} {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:32:54 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e8425556-43c0-4089-bb36-9f2278ae9f73 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] [instance: fe2984ce-8958-4049-8af7-496b313b26c8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26332393734343538', 'path': '/dev/sdd'} {{(pid=75165) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 00:32:54 user nova-compute[75165]: DEBUG nova.objects.instance [None req-e8425556-43c0-4089-bb36-9f2278ae9f73 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Lazy-loading 'flavor' on Instance uuid fe2984ce-8958-4049-8af7-496b313b26c8 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:32:54 user nova-compute[75165]: DEBUG nova.virt.libvirt.guest [None req-e8425556-43c0-4089-bb36-9f2278ae9f73 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 00:32:54 user nova-compute[75165]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 00:32:54 user nova-compute[75165]:   <source dev="/dev/sdd"/>
Oct 26 00:32:54 user nova-compute[75165]:   <target dev="vdb" bus="virtio"/>
Oct 26 00:32:54 user nova-compute[75165]:   <serial>4183c46e-4834-4152-b647-c5a7cf3e29f8</serial>
Oct 26 00:32:54 user nova-compute[75165]: </disk>
Oct 26 00:32:54 user nova-compute[75165]:  {{(pid=75165) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 00:32:54 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:32:54 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-e8425556-43c0-4089-bb36-9f2278ae9f73 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] No BDM found with device name vda, not building metadata. {{(pid=75165) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 00:32:54 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-e8425556-43c0-4089-bb36-9f2278ae9f73 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75165) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 00:32:54 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-e8425556-43c0-4089-bb36-9f2278ae9f73 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] No VIF found with MAC fa:16:3e:ca:36:c4, not building metadata {{(pid=75165) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 00:32:54 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-e8425556-43c0-4089-bb36-9f2278ae9f73 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Lock "fe2984ce-8958-4049-8af7-496b313b26c8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 36.786s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:32:56 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:32:56 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:32:57 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:32:57 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-837f5fc7-f0cd-473b-986b-e2f16430cde2 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Acquiring lock "fe2984ce-8958-4049-8af7-496b313b26c8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:32:57 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-837f5fc7-f0cd-473b-986b-e2f16430cde2 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Lock "fe2984ce-8958-4049-8af7-496b313b26c8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:32:57 user nova-compute[75165]: INFO nova.compute.manager [None req-837f5fc7-f0cd-473b-986b-e2f16430cde2 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] [instance: fe2984ce-8958-4049-8af7-496b313b26c8] Detaching volume 4183c46e-4834-4152-b647-c5a7cf3e29f8
Oct 26 00:32:57 user nova-compute[75165]: INFO nova.virt.block_device [None req-837f5fc7-f0cd-473b-986b-e2f16430cde2 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] [instance: fe2984ce-8958-4049-8af7-496b313b26c8] Attempting to driver detach volume 4183c46e-4834-4152-b647-c5a7cf3e29f8 from mountpoint /dev/vdb
Oct 26 00:32:57 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-837f5fc7-f0cd-473b-986b-e2f16430cde2 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Attempting to detach device vdb from instance fe2984ce-8958-4049-8af7-496b313b26c8 from the persistent domain config. {{(pid=75165) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 00:32:57 user nova-compute[75165]: DEBUG nova.virt.libvirt.guest [None req-837f5fc7-f0cd-473b-986b-e2f16430cde2 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 00:32:57 user nova-compute[75165]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 00:32:57 user nova-compute[75165]:   <source dev="/dev/sdd"/>
Oct 26 00:32:57 user nova-compute[75165]:   <target dev="vdb" bus="virtio"/>
Oct 26 00:32:57 user nova-compute[75165]:   <serial>4183c46e-4834-4152-b647-c5a7cf3e29f8</serial>
Oct 26 00:32:57 user nova-compute[75165]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 00:32:57 user nova-compute[75165]: </disk>
Oct 26 00:32:57 user nova-compute[75165]:  {{(pid=75165) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 00:32:57 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-837f5fc7-f0cd-473b-986b-e2f16430cde2 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Successfully detached device vdb from instance fe2984ce-8958-4049-8af7-496b313b26c8 from the persistent domain config.
Oct 26 00:32:57 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-837f5fc7-f0cd-473b-986b-e2f16430cde2 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fe2984ce-8958-4049-8af7-496b313b26c8 from the live domain config. {{(pid=75165) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 00:32:57 user nova-compute[75165]: DEBUG nova.virt.libvirt.guest [None req-837f5fc7-f0cd-473b-986b-e2f16430cde2 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 00:32:57 user nova-compute[75165]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 00:32:57 user nova-compute[75165]:   <source dev="/dev/sdd"/>
Oct 26 00:32:57 user nova-compute[75165]:   <target dev="vdb" bus="virtio"/>
Oct 26 00:32:57 user nova-compute[75165]:   <serial>4183c46e-4834-4152-b647-c5a7cf3e29f8</serial>
Oct 26 00:32:57 user nova-compute[75165]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 00:32:57 user nova-compute[75165]: </disk>
Oct 26 00:32:57 user nova-compute[75165]:  {{(pid=75165) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 00:32:57 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-837f5fc7-f0cd-473b-986b-e2f16430cde2 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fe2984ce-8958-4049-8af7-496b313b26c8 {{(pid=75165) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 00:32:59 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-93a4a9f0-c0a7-43bf-9ec1-bde6691683e1 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Acquiring lock "c396d555-70cf-4642-a0a0-485760cdf3fa" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:32:59 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-93a4a9f0-c0a7-43bf-9ec1-bde6691683e1 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Lock "c396d555-70cf-4642-a0a0-485760cdf3fa" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:32:59 user nova-compute[75165]: INFO nova.compute.manager [None req-93a4a9f0-c0a7-43bf-9ec1-bde6691683e1 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] [instance: c396d555-70cf-4642-a0a0-485760cdf3fa] Unshelving
Oct 26 00:32:59 user nova-compute[75165]: INFO nova.virt.block_device [None req-93a4a9f0-c0a7-43bf-9ec1-bde6691683e1 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] [instance: c396d555-70cf-4642-a0a0-485760cdf3fa] Booting with volume 9894622e-4af8-47e2-82c6-3f4e301caeb7 at /dev/vda
Oct 26 00:32:59 user nova-compute[75165]: DEBUG os_brick.utils [None req-93a4a9f0-c0a7-43bf-9ec1-bde6691683e1 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:32:59 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:32:59 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:32:59 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e63d248-5904-43bf-ba62-cb60b772b9e4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa94814ccb35\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:32:59 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:32:59 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:32:59 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[7386e39e-58cd-4b0d-886b-ad4eb286e428]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:32:59 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:32:59 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:32:59 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[36c7a44a-d64b-479e-b2a6-5b7cb1d446ad]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:32:59 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[3918b830-57e5-4307-be9c-25f0d19f3769]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:32:59 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-93a4a9f0-c0a7-43bf-9ec1-bde6691683e1 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Running cmd (subprocess): nvme version {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:32:59 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-93a4a9f0-c0a7-43bf-9ec1-bde6691683e1 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] 'nvme version' failed. Not Retrying. {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 00:32:59 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.nvmeof [None req-93a4a9f0-c0a7-43bf-9ec1-bde6691683e1 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] nvme not present on system {{(pid=75165) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 00:32:59 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:32:59 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 00:32:59 user nova-compute[75165]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 00:32:59 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[0447465a-a926-4e5e-b457-a3f6c8b9db68]: (4, '') {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:32:59 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-93a4a9f0-c0a7-43bf-9ec1-bde6691683e1 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75165) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 00:32:59 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-93a4a9f0-c0a7-43bf-9ec1-bde6691683e1 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75165) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 00:32:59 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-93a4a9f0-c0a7-43bf-9ec1-bde6691683e1 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] LIGHTOS: no hostnqn found. {{(pid=75165) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 00:32:59 user nova-compute[75165]: DEBUG os_brick.utils [None req-93a4a9f0-c0a7-43bf-9ec1-bde6691683e1 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa94814ccb35', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:32:59 user nova-compute[75165]: DEBUG nova.virt.block_device [None req-93a4a9f0-c0a7-43bf-9ec1-bde6691683e1 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] [instance: c396d555-70cf-4642-a0a0-485760cdf3fa] Updating existing volume attachment record: 553a4868-4b49-49a0-9b9a-b43e57273693 {{(pid=75165) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 00:33:01 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:33:02 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:33:07 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:33:12 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:33:15 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:33:15 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75165) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 00:33:15 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:33:17 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:33:17 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-93a4a9f0-c0a7-43bf-9ec1-bde6691683e1 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:33:17 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-93a4a9f0-c0a7-43bf-9ec1-bde6691683e1 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:33:17 user nova-compute[75165]: DEBUG nova.objects.instance [None req-93a4a9f0-c0a7-43bf-9ec1-bde6691683e1 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Lazy-loading 'pci_requests' on Instance uuid c396d555-70cf-4642-a0a0-485760cdf3fa {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:33:17 user nova-compute[75165]: DEBUG nova.objects.instance [None req-93a4a9f0-c0a7-43bf-9ec1-bde6691683e1 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Lazy-loading 'numa_topology' on Instance uuid c396d555-70cf-4642-a0a0-485760cdf3fa {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:33:17 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-93a4a9f0-c0a7-43bf-9ec1-bde6691683e1 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75165) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 00:33:17 user nova-compute[75165]: INFO nova.compute.claims [None req-93a4a9f0-c0a7-43bf-9ec1-bde6691683e1 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] [instance: c396d555-70cf-4642-a0a0-485760cdf3fa] Claim successful on node user
Oct 26 00:33:17 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-837f5fc7-f0cd-473b-986b-e2f16430cde2 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance fe2984ce-8958-4049-8af7-496b313b26c8 is timed out.
Oct 26 00:33:17 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-837f5fc7-f0cd-473b-986b-e2f16430cde2 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Successfully detached device vdb from instance fe2984ce-8958-4049-8af7-496b313b26c8 from the live domain config.
Oct 26 00:33:17 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-837f5fc7-f0cd-473b-986b-e2f16430cde2 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] [instance: fe2984ce-8958-4049-8af7-496b313b26c8] calling os-brick to detach iSCSI Volume {{(pid=75165) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 00:33:17 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-837f5fc7-f0cd-473b-986b-e2f16430cde2 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8bf8160e50>, {'target_iqn': 'iqn.2010-10.org.openstack:4183c46e-4834-4152-b647-c5a7cf3e29f8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'URMukBaK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:33:17 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-837f5fc7-f0cd-473b-986b-e2f16430cde2 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:33:17 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-837f5fc7-f0cd-473b-986b-e2f16430cde2 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:33:17 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-837f5fc7-f0cd-473b-986b-e2f16430cde2 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:33:17 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:33:17 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:33:17 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[d44b526c-f93c-48ce-b4d7-ffeff9de2b7f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4183c46e-4834-4152-b647-c5a7cf3e29f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:33:17 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-837f5fc7-f0cd-473b-986b-e2f16430cde2 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 00:33:17 user nova-compute[75165]: No targets found.
Oct 26 00:33:17 user nova-compute[75165]: iSNS:
Oct 26 00:33:17 user nova-compute[75165]: No targets found.
Oct 26 00:33:17 user nova-compute[75165]: STATIC:
Oct 26 00:33:17 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8
Oct 26 00:33:17 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:33:17 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:33:17 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795
Oct 26 00:33:17 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:33:17 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:33:17 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:4183c46e-4834-4152-b647-c5a7cf3e29f8
Oct 26 00:33:17 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:33:17 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:33:17 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0
Oct 26 00:33:17 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:33:17 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:33:17 user nova-compute[75165]: FIRMWARE:
Oct 26 00:33:17 user nova-compute[75165]: No targets found.
Oct 26 00:33:17 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:33:17 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-837f5fc7-f0cd-473b-986b-e2f16430cde2 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 00:33:17 user nova-compute[75165]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 00:33:17 user nova-compute[75165]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75165) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 00:33:17 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-837f5fc7-f0cd-473b-986b-e2f16430cde2 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4183c46e-4834-4152-b647-c5a7cf3e29f8', 0)] {{(pid=75165) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 00:33:17 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:33:17 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:33:17 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[55217184-16f4-48f3-aaea-d33916e2fa3d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4183c46e-4834-4152-b647-c5a7cf3e29f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:33:17 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:33:17 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:33:17 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe35ee01-2a3f-4dd2-b98b-393423fdadac]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4183c46e-4834-4152-b647-c5a7cf3e29f8 (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:33:17 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-837f5fc7-f0cd-473b-986b-e2f16430cde2 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)
Oct 26 00:33:17 user nova-compute[75165]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8 (non-flash)
Oct 26 00:33:17 user nova-compute[75165]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0 (non-flash)
Oct 26 00:33:17 user nova-compute[75165]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4183c46e-4834-4152-b647-c5a7cf3e29f8 (non-flash)
Oct 26 00:33:17 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:33:17 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-837f5fc7-f0cd-473b-986b-e2f16430cde2 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)
Oct 26 00:33:17 user nova-compute[75165]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8 (non-flash)
Oct 26 00:33:17 user nova-compute[75165]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0 (non-flash)
Oct 26 00:33:17 user nova-compute[75165]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4183c46e-4834-4152-b647-c5a7cf3e29f8 (non-flash)
Oct 26 00:33:17 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:33:17 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-837f5fc7-f0cd-473b-986b-e2f16430cde2 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8be04c9e10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4183c46e-4834-4152-b647-c5a7cf3e29f8'): ({'sdd'}, set())}) {{(pid=75165) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 00:33:17 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-837f5fc7-f0cd-473b-986b-e2f16430cde2 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Removing single pathed devices sdd {{(pid=75165) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 00:33:17 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:33:17 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:33:17 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4baaf0b-04ce-49e1-9b3d-1cc296b14021]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:33:17 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:33:17 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:33:17 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[0690f18e-c063-4f63-810a-363a18a80191]: (4, ('ok\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:33:17 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-837f5fc7-f0cd-473b-986b-e2f16430cde2 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Flushing IO for device /dev/sdd {{(pid=75165) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 00:33:17 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:33:17 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:33:17 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9e1ee76-903d-473d-9458-ad101606de7d]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:33:17 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-837f5fc7-f0cd-473b-986b-e2f16430cde2 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75165) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 00:33:17 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:33:18 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.054s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:33:18 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fd6d44b-d845-4bc0-b2b4-323dd321dcd7]: (4, ('1', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:33:18 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-837f5fc7-f0cd-473b-986b-e2f16430cde2 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75165) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 00:33:18 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-837f5fc7-f0cd-473b-986b-e2f16430cde2 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] SCSI volumes sdd have been removed. {{(pid=75165) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 00:33:18 user nova-compute[75165]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_ac71aaf3', '/dev/disk/by-id/scsi-1SCST_BIOac71aaf3-c2974458531f7c89', '/dev/disk/by-id/scsi-26332393734343538') {{(pid=86976) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 26 00:33:18 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2519393-c01b-4c4b-9a21-6195b7f930d8]: (4, None) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:33:18 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-837f5fc7-f0cd-473b-986b-e2f16430cde2 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4183c46e-4834-4152-b647-c5a7cf3e29f8')] {{(pid=75165) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 00:33:18 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4183c46e-4834-4152-b647-c5a7cf3e29f8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:33:18 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-93a4a9f0-c0a7-43bf-9ec1-bde6691683e1 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:33:18 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-93a4a9f0-c0a7-43bf-9ec1-bde6691683e1 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:33:18 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4183c46e-4834-4152-b647-c5a7cf3e29f8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:33:18 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[a126a17e-3128-498c-9e8d-2a743710a16e]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:33:18 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-837f5fc7-f0cd-473b-986b-e2f16430cde2 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:33:18 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4183c46e-4834-4152-b647-c5a7cf3e29f8 -p 172.16.0.220:3260 --logout {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:33:18 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-93a4a9f0-c0a7-43bf-9ec1-bde6691683e1 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.420s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:33:18 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4183c46e-4834-4152-b647-c5a7cf3e29f8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:33:18 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[a67947fb-ea9a-4cfe-b9ef-d7988e1e2ab0]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:4183c46e-4834-4152-b647-c5a7cf3e29f8, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:4183c46e-4834-4152-b647-c5a7cf3e29f8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:33:18 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-837f5fc7-f0cd-473b-986b-e2f16430cde2 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:4183c46e-4834-4152-b647-c5a7cf3e29f8, portal: 172.16.0.220,3260]
Oct 26 00:33:18 user nova-compute[75165]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:4183c46e-4834-4152-b647-c5a7cf3e29f8, portal: 172.16.0.220,3260] successful.
Oct 26 00:33:18 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:33:18 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4183c46e-4834-4152-b647-c5a7cf3e29f8 -p 172.16.0.220:3260 --op delete {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:33:18 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4183c46e-4834-4152-b647-c5a7cf3e29f8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:33:18 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[04d410ce-7e4e-4ea4-9613-9ed03ed62d43]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:33:18 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-837f5fc7-f0cd-473b-986b-e2f16430cde2 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:33:18 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-837f5fc7-f0cd-473b-986b-e2f16430cde2 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.343s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:33:18 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-837f5fc7-f0cd-473b-986b-e2f16430cde2 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] <== disconnect_volume: return (344ms) None {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:33:18 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-837f5fc7-f0cd-473b-986b-e2f16430cde2 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] [instance: fe2984ce-8958-4049-8af7-496b313b26c8] Disconnected iSCSI Volume {{(pid=75165) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 00:33:18 user nova-compute[75165]: INFO nova.network.neutron [None req-93a4a9f0-c0a7-43bf-9ec1-bde6691683e1 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] [instance: c396d555-70cf-4642-a0a0-485760cdf3fa] Updating port 500c8c79-cf9c-46ef-a5d1-273f387e410a with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Oct 26 00:33:18 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-93a4a9f0-c0a7-43bf-9ec1-bde6691683e1 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Acquiring lock "refresh_cache-c396d555-70cf-4642-a0a0-485760cdf3fa" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:33:18 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-93a4a9f0-c0a7-43bf-9ec1-bde6691683e1 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Acquired lock "refresh_cache-c396d555-70cf-4642-a0a0-485760cdf3fa" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:33:18 user nova-compute[75165]: DEBUG nova.network.neutron [None req-93a4a9f0-c0a7-43bf-9ec1-bde6691683e1 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] [instance: c396d555-70cf-4642-a0a0-485760cdf3fa] Building network info cache for instance {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 00:33:18 user nova-compute[75165]: DEBUG nova.compute.manager [req-0c5f26ff-5203-42d1-a355-35debe80f71e req-d3a5e53a-49ca-4fad-95a4-e2e861647d1d service nova] [instance: c396d555-70cf-4642-a0a0-485760cdf3fa] Received event network-changed-500c8c79-cf9c-46ef-a5d1-273f387e410a {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:33:18 user nova-compute[75165]: DEBUG nova.compute.manager [req-0c5f26ff-5203-42d1-a355-35debe80f71e req-d3a5e53a-49ca-4fad-95a4-e2e861647d1d service nova] [instance: c396d555-70cf-4642-a0a0-485760cdf3fa] Refreshing instance network info cache due to event network-changed-500c8c79-cf9c-46ef-a5d1-273f387e410a. {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 00:33:18 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-0c5f26ff-5203-42d1-a355-35debe80f71e req-d3a5e53a-49ca-4fad-95a4-e2e861647d1d service nova] Acquiring lock "refresh_cache-c396d555-70cf-4642-a0a0-485760cdf3fa" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:33:19 user nova-compute[75165]: DEBUG nova.objects.instance [None req-837f5fc7-f0cd-473b-986b-e2f16430cde2 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Lazy-loading 'flavor' on Instance uuid fe2984ce-8958-4049-8af7-496b313b26c8 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:33:19 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-837f5fc7-f0cd-473b-986b-e2f16430cde2 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Lock "fe2984ce-8958-4049-8af7-496b313b26c8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.960s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:33:19 user nova-compute[75165]: DEBUG nova.network.neutron [None req-93a4a9f0-c0a7-43bf-9ec1-bde6691683e1 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] [instance: c396d555-70cf-4642-a0a0-485760cdf3fa] Updating instance_info_cache with network_info: [{"id": "500c8c79-cf9c-46ef-a5d1-273f387e410a", "address": "fa:16:3e:89:15:98", "network": {"id": "7f96025b-485f-4ba3-9f45-708c09822ffa", "bridge": "br-int", "label": "tempest-TestShelveInstance-363925751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f000be4e226e4e3db3c0832bbf04cd29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap500c8c79-cf", "ovs_interfaceid": "500c8c79-cf9c-46ef-a5d1-273f387e410a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:33:19 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-93a4a9f0-c0a7-43bf-9ec1-bde6691683e1 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Releasing lock "refresh_cache-c396d555-70cf-4642-a0a0-485760cdf3fa" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:33:19 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-93a4a9f0-c0a7-43bf-9ec1-bde6691683e1 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] [instance: c396d555-70cf-4642-a0a0-485760cdf3fa] Creating instance directory {{(pid=75165) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 00:33:19 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-93a4a9f0-c0a7-43bf-9ec1-bde6691683e1 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] [instance: c396d555-70cf-4642-a0a0-485760cdf3fa] Creating image(s)
Oct 26 00:33:19 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-93a4a9f0-c0a7-43bf-9ec1-bde6691683e1 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] [instance: c396d555-70cf-4642-a0a0-485760cdf3fa] Did not create local disks {{(pid=75165) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 26 00:33:19 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-93a4a9f0-c0a7-43bf-9ec1-bde6691683e1 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] [instance: c396d555-70cf-4642-a0a0-485760cdf3fa] Ensure instance console log exists: /opt/stack/data/nova/instances/c396d555-70cf-4642-a0a0-485760cdf3fa/console.log {{(pid=75165) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 00:33:19 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-93a4a9f0-c0a7-43bf-9ec1-bde6691683e1 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:33:19 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-93a4a9f0-c0a7-43bf-9ec1-bde6691683e1 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:33:19 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-93a4a9f0-c0a7-43bf-9ec1-bde6691683e1 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:33:19 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-93a4a9f0-c0a7-43bf-9ec1-bde6691683e1 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] [instance: c396d555-70cf-4642-a0a0-485760cdf3fa] Start _get_guest_xml network_info=[{"id": "500c8c79-cf9c-46ef-a5d1-273f387e410a", "address": "fa:16:3e:89:15:98", "network": {"id": "7f96025b-485f-4ba3-9f45-708c09822ffa", "bridge": "br-int", "label": "tempest-TestShelveInstance-363925751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f000be4e226e4e3db3c0832bbf04cd29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap500c8c79-cf", "ovs_interfaceid": "500c8c79-cf9c-46ef-a5d1-273f387e410a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LIXPagZW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c396d555-70cf-4642-a0a0-485760cdf3fa', 'attached_at': '', 'detached_at': '', 'volume_id': '9894622e-4af8-47e2-82c6-3f4e301caeb7', 'serial': '9894622e-4af8-47e2-82c6-3f4e301caeb7'}, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'attachment_id': '553a4868-4b49-49a0-9b9a-b43e57273693', 'delete_on_termination': True, 'volume_type': None} {{(pid=75165) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 00:33:19 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-0c5f26ff-5203-42d1-a355-35debe80f71e req-d3a5e53a-49ca-4fad-95a4-e2e861647d1d service nova] Acquired lock "refresh_cache-c396d555-70cf-4642-a0a0-485760cdf3fa" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:33:19 user nova-compute[75165]: DEBUG nova.network.neutron [req-0c5f26ff-5203-42d1-a355-35debe80f71e req-d3a5e53a-49ca-4fad-95a4-e2e861647d1d service nova] [instance: c396d555-70cf-4642-a0a0-485760cdf3fa] Refreshing network info cache for port 500c8c79-cf9c-46ef-a5d1-273f387e410a {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 00:33:19 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-93a4a9f0-c0a7-43bf-9ec1-bde6691683e1 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:33:19 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-93a4a9f0-c0a7-43bf-9ec1-bde6691683e1 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:33:19 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-93a4a9f0-c0a7-43bf-9ec1-bde6691683e1 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75165) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 00:33:19 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-93a4a9f0-c0a7-43bf-9ec1-bde6691683e1 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] CPU controller missing on host. {{(pid=75165) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 00:33:19 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-93a4a9f0-c0a7-43bf-9ec1-bde6691683e1 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75165) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 00:33:19 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-93a4a9f0-c0a7-43bf-9ec1-bde6691683e1 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] CPU controller found on host. {{(pid=75165) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 00:33:19 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-93a4a9f0-c0a7-43bf-9ec1-bde6691683e1 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75165) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 00:33:19 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-93a4a9f0-c0a7-43bf-9ec1-bde6691683e1 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T00:03:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 00:33:19 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-93a4a9f0-c0a7-43bf-9ec1-bde6691683e1 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Flavor limits 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 00:33:19 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-93a4a9f0-c0a7-43bf-9ec1-bde6691683e1 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Image limits 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 00:33:19 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-93a4a9f0-c0a7-43bf-9ec1-bde6691683e1 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Flavor pref 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 00:33:19 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-93a4a9f0-c0a7-43bf-9ec1-bde6691683e1 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Image pref 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 00:33:19 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-93a4a9f0-c0a7-43bf-9ec1-bde6691683e1 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 00:33:19 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-93a4a9f0-c0a7-43bf-9ec1-bde6691683e1 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 00:33:19 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-93a4a9f0-c0a7-43bf-9ec1-bde6691683e1 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75165) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 00:33:19 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-93a4a9f0-c0a7-43bf-9ec1-bde6691683e1 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Got 1 possible topologies {{(pid=75165) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 00:33:19 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-93a4a9f0-c0a7-43bf-9ec1-bde6691683e1 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 00:33:19 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-93a4a9f0-c0a7-43bf-9ec1-bde6691683e1 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 00:33:19 user nova-compute[75165]: DEBUG nova.objects.instance [None req-93a4a9f0-c0a7-43bf-9ec1-bde6691683e1 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Lazy-loading 'vcpu_model' on Instance uuid c396d555-70cf-4642-a0a0-485760cdf3fa {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:33:19 user nova-compute[75165]: DEBUG nova.objects.base [None req-93a4a9f0-c0a7-43bf-9ec1-bde6691683e1 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Object Instance<c396d555-70cf-4642-a0a0-485760cdf3fa> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=75165) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 00:33:19 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-93a4a9f0-c0a7-43bf-9ec1-bde6691683e1 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] [instance: c396d555-70cf-4642-a0a0-485760cdf3fa] Calling os-brick to attach iSCSI Volume {{(pid=75165) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 00:33:19 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-93a4a9f0-c0a7-43bf-9ec1-bde6691683e1 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8bf8160e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LIXPagZW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:33:19 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-93a4a9f0-c0a7-43bf-9ec1-bde6691683e1 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:33:19 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-93a4a9f0-c0a7-43bf-9ec1-bde6691683e1 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:33:19 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-93a4a9f0-c0a7-43bf-9ec1-bde6691683e1 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:33:19 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-93a4a9f0-c0a7-43bf-9ec1-bde6691683e1 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:33:19 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-93a4a9f0-c0a7-43bf-9ec1-bde6691683e1 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:33:19 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-93a4a9f0-c0a7-43bf-9ec1-bde6691683e1 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:33:19 user nova-compute[75165]: INFO os_brick.initiator.connectors.iscsi [None req-93a4a9f0-c0a7-43bf-9ec1-bde6691683e1 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 00:33:19 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7 -p 172.16.0.220:3260 {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:33:19 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:33:19 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5f340b2-bb04-4f5a-8857-556628bd7f17]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:33:19 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-93a4a9f0-c0a7-43bf-9ec1-bde6691683e1 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 00:33:19 user nova-compute[75165]:  {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:33:19 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7 -p 172.16.0.220:3260 --interface default --op new {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:33:19 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:33:19 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[7def9d95-bff8-4d1b-b308-80dab38451d0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7] added\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:33:19 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-93a4a9f0-c0a7-43bf-9ec1-bde6691683e1 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7] added
Oct 26 00:33:19 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:33:19 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:33:19 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:33:19 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9f1e0dd-61a4-40e8-93fc-24ca93fbc90c]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:33:19 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-93a4a9f0-c0a7-43bf-9ec1-bde6691683e1 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:33:19 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:33:19 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:33:19 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[9247c5b3-bddf-4de4-b745-1b873dee06e4]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:33:19 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-93a4a9f0-c0a7-43bf-9ec1-bde6691683e1 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:33:19 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LIXPagZW {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:33:19 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LIXPagZW" returned: 0 in 0.018s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:33:19 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[627ed8c0-3e44-46b1-a893-d60d563d2712]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:33:19 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-93a4a9f0-c0a7-43bf-9ec1-bde6691683e1 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LIXPagZW'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:33:19 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:33:19 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:33:19 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[d576668a-fd0c-4e39-b5c5-b4698627ee0f]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:33:19 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-93a4a9f0-c0a7-43bf-9ec1-bde6691683e1 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:33:19 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:33:19 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:33:19 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[949fbdba-1082-4e6e-a472-bf65a02ca75f]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0 (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:33:19 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-93a4a9f0-c0a7-43bf-9ec1-bde6691683e1 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)
Oct 26 00:33:19 user nova-compute[75165]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8 (non-flash)
Oct 26 00:33:19 user nova-compute[75165]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0 (non-flash)
Oct 26 00:33:19 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:33:19 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-93a4a9f0-c0a7-43bf-9ec1-bde6691683e1 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)
Oct 26 00:33:19 user nova-compute[75165]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8 (non-flash)
Oct 26 00:33:19 user nova-compute[75165]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0 (non-flash)
Oct 26 00:33:19 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:33:19 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7 -p 172.16.0.220:3260 --login {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:33:19 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:33:19 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a377bb1-fe3f-4aa5-8810-9eb7879e278e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:33:19 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-93a4a9f0-c0a7-43bf-9ec1-bde6691683e1 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7, portal: 172.16.0.220,3260]
Oct 26 00:33:19 user nova-compute[75165]: Login to [iface: default, target: iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7, portal: 172.16.0.220,3260] successful.
Oct 26 00:33:19 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:33:19 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:33:19 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:33:19 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4ee59b3-9dca-41b7-9419-ee834cc3a568]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:33:19 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-93a4a9f0-c0a7-43bf-9ec1-bde6691683e1 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:33:19 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:33:19 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:33:19 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[017c8a2c-f010-44c5-a3f0-7b82eeac6c8b]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7 (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:33:19 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-93a4a9f0-c0a7-43bf-9ec1-bde6691683e1 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)
Oct 26 00:33:19 user nova-compute[75165]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8 (non-flash)
Oct 26 00:33:19 user nova-compute[75165]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0 (non-flash)
Oct 26 00:33:19 user nova-compute[75165]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7 (non-flash)
Oct 26 00:33:19 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:33:19 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-93a4a9f0-c0a7-43bf-9ec1-bde6691683e1 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)
Oct 26 00:33:19 user nova-compute[75165]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8 (non-flash)
Oct 26 00:33:19 user nova-compute[75165]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0 (non-flash)
Oct 26 00:33:19 user nova-compute[75165]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7 (non-flash)
Oct 26 00:33:19 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:33:19 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-93a4a9f0-c0a7-43bf-9ec1-bde6691683e1 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.282s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:33:19 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-93a4a9f0-c0a7-43bf-9ec1-bde6691683e1 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Connected to 172.16.0.220:3260 {{(pid=75165) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 00:33:19 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-93a4a9f0-c0a7-43bf-9ec1-bde6691683e1 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] HCTL ('35', '-', '-', 0) found on session 41 with lun 0 {{(pid=75165) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 00:33:19 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-93a4a9f0-c0a7-43bf-9ec1-bde6691683e1 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75165) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 00:33:19 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:33:19 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:33:19 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2cecb39-4f5e-4b4a-8acd-63a8d4c5d013]: (4, ('- - 0', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:33:19 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-93a4a9f0-c0a7-43bf-9ec1-bde6691683e1 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Searching for a device in session 41 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75165) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 00:33:19 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-93a4a9f0-c0a7-43bf-9ec1-bde6691683e1 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LIXPagZW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75165) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 00:33:19 user nova-compute[75165]: DEBUG nova.network.neutron [req-0c5f26ff-5203-42d1-a355-35debe80f71e req-d3a5e53a-49ca-4fad-95a4-e2e861647d1d service nova] [instance: c396d555-70cf-4642-a0a0-485760cdf3fa] Updated VIF entry in instance network info cache for port 500c8c79-cf9c-46ef-a5d1-273f387e410a. {{(pid=75165) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 00:33:19 user nova-compute[75165]: DEBUG nova.network.neutron [req-0c5f26ff-5203-42d1-a355-35debe80f71e req-d3a5e53a-49ca-4fad-95a4-e2e861647d1d service nova] [instance: c396d555-70cf-4642-a0a0-485760cdf3fa] Updating instance_info_cache with network_info: [{"id": "500c8c79-cf9c-46ef-a5d1-273f387e410a", "address": "fa:16:3e:89:15:98", "network": {"id": "7f96025b-485f-4ba3-9f45-708c09822ffa", "bridge": "br-int", "label": "tempest-TestShelveInstance-363925751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f000be4e226e4e3db3c0832bbf04cd29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap500c8c79-cf", "ovs_interfaceid": "500c8c79-cf9c-46ef-a5d1-273f387e410a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:33:19 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-0c5f26ff-5203-42d1-a355-35debe80f71e req-d3a5e53a-49ca-4fad-95a4-e2e861647d1d service nova] Releasing lock "refresh_cache-c396d555-70cf-4642-a0a0-485760cdf3fa" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:33:20 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:33:20 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:33:20 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-93a4a9f0-c0a7-43bf-9ec1-bde6691683e1 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:33:20 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-93a4a9f0-c0a7-43bf-9ec1-bde6691683e1 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '23731306436633339', 'path': '/dev/sdd'} {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:33:20 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-93a4a9f0-c0a7-43bf-9ec1-bde6691683e1 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] [instance: c396d555-70cf-4642-a0a0-485760cdf3fa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23731306436633339', 'path': '/dev/sdd'} {{(pid=75165) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 00:33:20 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-93a4a9f0-c0a7-43bf-9ec1-bde6691683e1 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-26T00:29:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1147251319',display_name='tempest-TestShelveInstance-server-1147251319',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1147251319',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-2132263804',keypairs=<?>,launch_index=0,launched_at=2023-10-26T00:29:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='f000be4e226e4e3db3c0832bbf04cd29',ramdisk_id='',reservation_id='r-sg6zubxf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-323693311',owner_user_name='tempest-TestShelveInstance-323693311-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T00:32:59Z,user_data=None,user_id='2aa1bebf8931436d80d792651953a57b',uuid=c396d555-70cf-4642-a0a0-485760cdf3fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "500c8c79-cf9c-46ef-a5d1-273f387e410a", "address": "fa:16:3e:89:15:98", "network": {"id": "7f96025b-485f-4ba3-9f45-708c09822ffa", "bridge": "br-int", "label": "tempest-TestShelveInstance-363925751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f000be4e226e4e3db3c0832bbf04cd29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap500c8c79-cf", "ovs_interfaceid": "500c8c79-cf9c-46ef-a5d1-273f387e410a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75165) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 00:33:20 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-93a4a9f0-c0a7-43bf-9ec1-bde6691683e1 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Converting VIF {"id": "500c8c79-cf9c-46ef-a5d1-273f387e410a", "address": "fa:16:3e:89:15:98", "network": {"id": "7f96025b-485f-4ba3-9f45-708c09822ffa", "bridge": "br-int", "label": "tempest-TestShelveInstance-363925751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f000be4e226e4e3db3c0832bbf04cd29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap500c8c79-cf", "ovs_interfaceid": "500c8c79-cf9c-46ef-a5d1-273f387e410a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:33:20 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-93a4a9f0-c0a7-43bf-9ec1-bde6691683e1 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:15:98,bridge_name='br-int',has_traffic_filtering=True,id=500c8c79-cf9c-46ef-a5d1-273f387e410a,network=Network(7f96025b-485f-4ba3-9f45-708c09822ffa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap500c8c79-cf') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:33:20 user nova-compute[75165]: DEBUG nova.objects.instance [None req-93a4a9f0-c0a7-43bf-9ec1-bde6691683e1 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Lazy-loading 'pci_devices' on Instance uuid c396d555-70cf-4642-a0a0-485760cdf3fa {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:33:20 user nova-compute[75165]: DEBUG nova.objects.base [None req-93a4a9f0-c0a7-43bf-9ec1-bde6691683e1 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Object Instance<c396d555-70cf-4642-a0a0-485760cdf3fa> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=75165) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 00:33:20 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-93a4a9f0-c0a7-43bf-9ec1-bde6691683e1 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] [instance: c396d555-70cf-4642-a0a0-485760cdf3fa] End _get_guest_xml xml=<domain type="kvm">
Oct 26 00:33:20 user nova-compute[75165]:   <uuid>c396d555-70cf-4642-a0a0-485760cdf3fa</uuid>
Oct 26 00:33:20 user nova-compute[75165]:   <name>instance-00000023</name>
Oct 26 00:33:20 user nova-compute[75165]:   <memory>524288</memory>
Oct 26 00:33:20 user nova-compute[75165]:   <vcpu>1</vcpu>
Oct 26 00:33:20 user nova-compute[75165]:   <metadata>
Oct 26 00:33:20 user nova-compute[75165]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 00:33:20 user nova-compute[75165]:       <nova:package version="0.0.0"/>
Oct 26 00:33:20 user nova-compute[75165]:       <nova:name>tempest-TestShelveInstance-server-1147251319</nova:name>
Oct 26 00:33:20 user nova-compute[75165]:       <nova:creationTime>2023-10-26 00:33:19</nova:creationTime>
Oct 26 00:33:20 user nova-compute[75165]:       <nova:flavor name="m1.tiny">
Oct 26 00:33:20 user nova-compute[75165]:         <nova:memory>512</nova:memory>
Oct 26 00:33:20 user nova-compute[75165]:         <nova:disk>1</nova:disk>
Oct 26 00:33:20 user nova-compute[75165]:         <nova:swap>0</nova:swap>
Oct 26 00:33:20 user nova-compute[75165]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 00:33:20 user nova-compute[75165]:         <nova:vcpus>1</nova:vcpus>
Oct 26 00:33:20 user nova-compute[75165]:       </nova:flavor>
Oct 26 00:33:20 user nova-compute[75165]:       <nova:owner>
Oct 26 00:33:20 user nova-compute[75165]:         <nova:user uuid="2aa1bebf8931436d80d792651953a57b">tempest-TestShelveInstance-323693311-project-member</nova:user>
Oct 26 00:33:20 user nova-compute[75165]:         <nova:project uuid="f000be4e226e4e3db3c0832bbf04cd29">tempest-TestShelveInstance-323693311</nova:project>
Oct 26 00:33:20 user nova-compute[75165]:       </nova:owner>
Oct 26 00:33:20 user nova-compute[75165]:       <nova:ports>
Oct 26 00:33:20 user nova-compute[75165]:         <nova:port uuid="500c8c79-cf9c-46ef-a5d1-273f387e410a">
Oct 26 00:33:20 user nova-compute[75165]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 26 00:33:20 user nova-compute[75165]:         </nova:port>
Oct 26 00:33:20 user nova-compute[75165]:       </nova:ports>
Oct 26 00:33:20 user nova-compute[75165]:     </nova:instance>
Oct 26 00:33:20 user nova-compute[75165]:   </metadata>
Oct 26 00:33:20 user nova-compute[75165]:   <sysinfo type="smbios">
Oct 26 00:33:20 user nova-compute[75165]:     <system>
Oct 26 00:33:20 user nova-compute[75165]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 00:33:20 user nova-compute[75165]:       <entry name="product">OpenStack Nova</entry>
Oct 26 00:33:20 user nova-compute[75165]:       <entry name="version">0.0.0</entry>
Oct 26 00:33:20 user nova-compute[75165]:       <entry name="serial">c396d555-70cf-4642-a0a0-485760cdf3fa</entry>
Oct 26 00:33:20 user nova-compute[75165]:       <entry name="uuid">c396d555-70cf-4642-a0a0-485760cdf3fa</entry>
Oct 26 00:33:20 user nova-compute[75165]:       <entry name="family">Virtual Machine</entry>
Oct 26 00:33:20 user nova-compute[75165]:     </system>
Oct 26 00:33:20 user nova-compute[75165]:   </sysinfo>
Oct 26 00:33:20 user nova-compute[75165]:   <os>
Oct 26 00:33:20 user nova-compute[75165]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 00:33:20 user nova-compute[75165]:     <boot dev="hd"/>
Oct 26 00:33:20 user nova-compute[75165]:     <smbios mode="sysinfo"/>
Oct 26 00:33:20 user nova-compute[75165]:   </os>
Oct 26 00:33:20 user nova-compute[75165]:   <features>
Oct 26 00:33:20 user nova-compute[75165]:     <acpi/>
Oct 26 00:33:20 user nova-compute[75165]:     <apic/>
Oct 26 00:33:20 user nova-compute[75165]:     <vmcoreinfo/>
Oct 26 00:33:20 user nova-compute[75165]:   </features>
Oct 26 00:33:20 user nova-compute[75165]:   <clock offset="utc">
Oct 26 00:33:20 user nova-compute[75165]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 00:33:20 user nova-compute[75165]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 00:33:20 user nova-compute[75165]:     <timer name="hpet" present="no"/>
Oct 26 00:33:20 user nova-compute[75165]:   </clock>
Oct 26 00:33:20 user nova-compute[75165]:   <cpu mode="custom" match="exact">
Oct 26 00:33:20 user nova-compute[75165]:     <model>Nehalem</model>
Oct 26 00:33:20 user nova-compute[75165]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 00:33:20 user nova-compute[75165]:   </cpu>
Oct 26 00:33:20 user nova-compute[75165]:   <devices>
Oct 26 00:33:20 user nova-compute[75165]:     <disk type="block" device="disk">
Oct 26 00:33:20 user nova-compute[75165]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 00:33:20 user nova-compute[75165]:       <source dev="/dev/sdd"/>
Oct 26 00:33:20 user nova-compute[75165]:       <target dev="vda" bus="virtio"/>
Oct 26 00:33:20 user nova-compute[75165]:       <serial>9894622e-4af8-47e2-82c6-3f4e301caeb7</serial>
Oct 26 00:33:20 user nova-compute[75165]:     </disk>
Oct 26 00:33:20 user nova-compute[75165]:     <interface type="ethernet">
Oct 26 00:33:20 user nova-compute[75165]:       <mac address="fa:16:3e:89:15:98"/>
Oct 26 00:33:20 user nova-compute[75165]:       <model type="virtio"/>
Oct 26 00:33:20 user nova-compute[75165]:       <mtu size="1442"/>
Oct 26 00:33:20 user nova-compute[75165]:       <target dev="tap500c8c79-cf"/>
Oct 26 00:33:20 user nova-compute[75165]:     </interface>
Oct 26 00:33:20 user nova-compute[75165]:     <serial type="pty">
Oct 26 00:33:20 user nova-compute[75165]:       <log file="/opt/stack/data/nova/instances/c396d555-70cf-4642-a0a0-485760cdf3fa/console.log" append="off"/>
Oct 26 00:33:20 user nova-compute[75165]:     </serial>
Oct 26 00:33:20 user nova-compute[75165]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 00:33:20 user nova-compute[75165]:     <video>
Oct 26 00:33:20 user nova-compute[75165]:       <model type="virtio"/>
Oct 26 00:33:20 user nova-compute[75165]:     </video>
Oct 26 00:33:20 user nova-compute[75165]:     <rng model="virtio">
Oct 26 00:33:20 user nova-compute[75165]:       <backend model="random">/dev/urandom</backend>
Oct 26 00:33:20 user nova-compute[75165]:     </rng>
Oct 26 00:33:20 user nova-compute[75165]:     <controller type="usb" index="0" model="none"/>
Oct 26 00:33:20 user nova-compute[75165]:     <memballoon model="virtio">
Oct 26 00:33:20 user nova-compute[75165]:       <stats period="10"/>
Oct 26 00:33:20 user nova-compute[75165]:     </memballoon>
Oct 26 00:33:20 user nova-compute[75165]:   </devices>
Oct 26 00:33:20 user nova-compute[75165]: </domain>
Oct 26 00:33:20 user nova-compute[75165]:  {{(pid=75165) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 00:33:20 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-93a4a9f0-c0a7-43bf-9ec1-bde6691683e1 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-26T00:29:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1147251319',display_name='tempest-TestShelveInstance-server-1147251319',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1147251319',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-2132263804',keypairs=<?>,launch_index=0,launched_at=2023-10-26T00:29:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='f000be4e226e4e3db3c0832bbf04cd29',ramdisk_id='',reservation_id='r-sg6zubxf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-323693311',owner_user_name='tempest-TestShelveInstance-323693311-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T00:32:59Z,user_data=None,user_id='2aa1bebf8931436d80d792651953a57b',uuid=c396d555-70cf-4642-a0a0-485760cdf3fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "500c8c79-cf9c-46ef-a5d1-273f387e410a", "address": "fa:16:3e:89:15:98", "network": {"id": "7f96025b-485f-4ba3-9f45-708c09822ffa", "bridge": "br-int", "label": "tempest-TestShelveInstance-363925751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f000be4e226e4e3db3c0832bbf04cd29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap500c8c79-cf", "ovs_interfaceid": "500c8c79-cf9c-46ef-a5d1-273f387e410a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 00:33:20 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-93a4a9f0-c0a7-43bf-9ec1-bde6691683e1 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Converting VIF {"id": "500c8c79-cf9c-46ef-a5d1-273f387e410a", "address": "fa:16:3e:89:15:98", "network": {"id": "7f96025b-485f-4ba3-9f45-708c09822ffa", "bridge": "br-int", "label": "tempest-TestShelveInstance-363925751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f000be4e226e4e3db3c0832bbf04cd29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap500c8c79-cf", "ovs_interfaceid": "500c8c79-cf9c-46ef-a5d1-273f387e410a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:33:20 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-93a4a9f0-c0a7-43bf-9ec1-bde6691683e1 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:15:98,bridge_name='br-int',has_traffic_filtering=True,id=500c8c79-cf9c-46ef-a5d1-273f387e410a,network=Network(7f96025b-485f-4ba3-9f45-708c09822ffa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap500c8c79-cf') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:33:20 user nova-compute[75165]: DEBUG os_vif [None req-93a4a9f0-c0a7-43bf-9ec1-bde6691683e1 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:15:98,bridge_name='br-int',has_traffic_filtering=True,id=500c8c79-cf9c-46ef-a5d1-273f387e410a,network=Network(7f96025b-485f-4ba3-9f45-708c09822ffa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap500c8c79-cf') {{(pid=75165) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 00:33:20 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:33:20 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:33:20 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 00:33:20 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:33:20 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cdb8f78b-f21d-580a-b9a2-13c17945c802', '_type': 'linux-noop'}}, row=False) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:33:20 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:33:20 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:33:20 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:33:20 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap500c8c79-cf, may_exist=True, interface_attrs={}) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:33:20 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap500c8c79-cf, col_values=(('qos', UUID('65397097-1806-4e90-94f9-23bc48a1c1c4')),), if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:33:20 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap500c8c79-cf, col_values=(('external_ids', {'iface-id': '500c8c79-cf9c-46ef-a5d1-273f387e410a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:89:15:98', 'vm-uuid': 'c396d555-70cf-4642-a0a0-485760cdf3fa'}),), if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:33:20 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:33:20 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:33:20 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:33:20 user nova-compute[75165]: INFO os_vif [None req-93a4a9f0-c0a7-43bf-9ec1-bde6691683e1 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:15:98,bridge_name='br-int',has_traffic_filtering=True,id=500c8c79-cf9c-46ef-a5d1-273f387e410a,network=Network(7f96025b-485f-4ba3-9f45-708c09822ffa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap500c8c79-cf')
Oct 26 00:33:21 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-93a4a9f0-c0a7-43bf-9ec1-bde6691683e1 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] No BDM found with device name vda, not building metadata. {{(pid=75165) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 00:33:21 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-93a4a9f0-c0a7-43bf-9ec1-bde6691683e1 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] No VIF found with MAC fa:16:3e:89:15:98, not building metadata {{(pid=75165) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 00:33:22 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:33:22 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:33:22 user nova-compute[75165]: DEBUG nova.compute.manager [req-018ff36a-9e62-4154-9a1a-1d2e27d2befb req-2dfda63b-4449-42da-a31c-e5f8fda32961 service nova] [instance: c396d555-70cf-4642-a0a0-485760cdf3fa] Received event network-vif-plugged-500c8c79-cf9c-46ef-a5d1-273f387e410a {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:33:22 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-018ff36a-9e62-4154-9a1a-1d2e27d2befb req-2dfda63b-4449-42da-a31c-e5f8fda32961 service nova] Acquiring lock "c396d555-70cf-4642-a0a0-485760cdf3fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:33:22 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-018ff36a-9e62-4154-9a1a-1d2e27d2befb req-2dfda63b-4449-42da-a31c-e5f8fda32961 service nova] Lock "c396d555-70cf-4642-a0a0-485760cdf3fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:33:22 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-018ff36a-9e62-4154-9a1a-1d2e27d2befb req-2dfda63b-4449-42da-a31c-e5f8fda32961 service nova] Lock "c396d555-70cf-4642-a0a0-485760cdf3fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:33:22 user nova-compute[75165]: DEBUG nova.compute.manager [req-018ff36a-9e62-4154-9a1a-1d2e27d2befb req-2dfda63b-4449-42da-a31c-e5f8fda32961 service nova] [instance: c396d555-70cf-4642-a0a0-485760cdf3fa] No waiting events found dispatching network-vif-plugged-500c8c79-cf9c-46ef-a5d1-273f387e410a {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:33:22 user nova-compute[75165]: WARNING nova.compute.manager [req-018ff36a-9e62-4154-9a1a-1d2e27d2befb req-2dfda63b-4449-42da-a31c-e5f8fda32961 service nova] [instance: c396d555-70cf-4642-a0a0-485760cdf3fa] Received unexpected event network-vif-plugged-500c8c79-cf9c-46ef-a5d1-273f387e410a for instance with vm_state shelved_offloaded and task_state spawning.
Oct 26 00:33:22 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:33:22 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:33:22 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:33:22 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:33:23 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:33:23 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Starting heal instance info cache {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 00:33:23 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Rebuilding the list of instances to heal {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 00:33:23 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "refresh_cache-97fb67a7-637d-456f-b4dd-0a271ed6cfc4" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:33:23 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquired lock "refresh_cache-97fb67a7-637d-456f-b4dd-0a271ed6cfc4" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:33:23 user nova-compute[75165]: DEBUG nova.network.neutron [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: 97fb67a7-637d-456f-b4dd-0a271ed6cfc4] Forcefully refreshing network info cache for instance {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 00:33:23 user nova-compute[75165]: DEBUG nova.objects.instance [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lazy-loading 'info_cache' on Instance uuid 97fb67a7-637d-456f-b4dd-0a271ed6cfc4 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:33:24 user nova-compute[75165]: DEBUG nova.network.neutron [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: 97fb67a7-637d-456f-b4dd-0a271ed6cfc4] Updating instance_info_cache with network_info: [{"id": "254ea53c-6da9-46d5-a139-7926008cdf8b", "address": "fa:16:3e:08:21:2a", "network": {"id": "eb55c0bc-cae5-4ba3-851a-e31a50b52c88", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1081223830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d616862c7c184de5b0ba3121552c5666", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap254ea53c-6d", "ovs_interfaceid": "254ea53c-6da9-46d5-a139-7926008cdf8b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:33:24 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Releasing lock "refresh_cache-97fb67a7-637d-456f-b4dd-0a271ed6cfc4" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:33:24 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: 97fb67a7-637d-456f-b4dd-0a271ed6cfc4] Updated the network info_cache for instance {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 00:33:24 user nova-compute[75165]: DEBUG nova.compute.manager [None req-93a4a9f0-c0a7-43bf-9ec1-bde6691683e1 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] [instance: c396d555-70cf-4642-a0a0-485760cdf3fa] Instance event wait completed in 0 seconds for  {{(pid=75165) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 00:33:24 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-93a4a9f0-c0a7-43bf-9ec1-bde6691683e1 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] [instance: c396d555-70cf-4642-a0a0-485760cdf3fa] Guest created on hypervisor {{(pid=75165) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 00:33:24 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: c396d555-70cf-4642-a0a0-485760cdf3fa] Instance spawned successfully.
Oct 26 00:33:24 user nova-compute[75165]: DEBUG nova.compute.manager [None req-93a4a9f0-c0a7-43bf-9ec1-bde6691683e1 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] [instance: c396d555-70cf-4642-a0a0-485760cdf3fa] Checking state {{(pid=75165) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 00:33:24 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-93a4a9f0-c0a7-43bf-9ec1-bde6691683e1 tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Lock "c396d555-70cf-4642-a0a0-485760cdf3fa" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 25.403s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:33:24 user nova-compute[75165]: DEBUG nova.compute.manager [req-5c6ec806-fb33-47c6-8d01-7c8c12f1c368 req-fd7c021a-9775-4d25-a81c-a9393490510d service nova] [instance: c396d555-70cf-4642-a0a0-485760cdf3fa] Received event network-vif-plugged-500c8c79-cf9c-46ef-a5d1-273f387e410a {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:33:24 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-5c6ec806-fb33-47c6-8d01-7c8c12f1c368 req-fd7c021a-9775-4d25-a81c-a9393490510d service nova] Acquiring lock "c396d555-70cf-4642-a0a0-485760cdf3fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:33:24 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-5c6ec806-fb33-47c6-8d01-7c8c12f1c368 req-fd7c021a-9775-4d25-a81c-a9393490510d service nova] Lock "c396d555-70cf-4642-a0a0-485760cdf3fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:33:24 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-5c6ec806-fb33-47c6-8d01-7c8c12f1c368 req-fd7c021a-9775-4d25-a81c-a9393490510d service nova] Lock "c396d555-70cf-4642-a0a0-485760cdf3fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:33:24 user nova-compute[75165]: DEBUG nova.compute.manager [req-5c6ec806-fb33-47c6-8d01-7c8c12f1c368 req-fd7c021a-9775-4d25-a81c-a9393490510d service nova] [instance: c396d555-70cf-4642-a0a0-485760cdf3fa] No waiting events found dispatching network-vif-plugged-500c8c79-cf9c-46ef-a5d1-273f387e410a {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:33:24 user nova-compute[75165]: WARNING nova.compute.manager [req-5c6ec806-fb33-47c6-8d01-7c8c12f1c368 req-fd7c021a-9775-4d25-a81c-a9393490510d service nova] [instance: c396d555-70cf-4642-a0a0-485760cdf3fa] Received unexpected event network-vif-plugged-500c8c79-cf9c-46ef-a5d1-273f387e410a for instance with vm_state active and task_state None.
Oct 26 00:33:24 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:33:24 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:33:24 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:33:25 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:33:25 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:33:25 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:33:25 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:33:25 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75165) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 00:33:25 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:33:26 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75165) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 00:33:26 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75165) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 00:33:26 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7a55179-cde6-4fbd-a8b3-c3df149bc6f3/disk.rescue --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:33:26 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7a55179-cde6-4fbd-a8b3-c3df149bc6f3/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:33:26 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7a55179-cde6-4fbd-a8b3-c3df149bc6f3/disk.rescue --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:33:26 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c7a55179-cde6-4fbd-a8b3-c3df149bc6f3/disk.rescue --force-share --output=json" returned: 0 in 0.199s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:33:26 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97fb67a7-637d-456f-b4dd-0a271ed6cfc4/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:33:26 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97fb67a7-637d-456f-b4dd-0a271ed6cfc4/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:33:26 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97fb67a7-637d-456f-b4dd-0a271ed6cfc4/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:33:26 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:33:26 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97fb67a7-637d-456f-b4dd-0a271ed6cfc4/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:33:26 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c0e0e2-4c40-45a3-829a-b6b73482e311/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:33:27 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c0e0e2-4c40-45a3-829a-b6b73482e311/disk --force-share --output=json" returned: 0 in 0.330s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:33:27 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c0e0e2-4c40-45a3-829a-b6b73482e311/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:33:27 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00c0e0e2-4c40-45a3-829a-b6b73482e311/disk --force-share --output=json" returned: 0 in 0.401s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:33:27 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75165) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 00:33:27 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3c87b07-5c16-4f45-b320-06d3503d23e6/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:33:27 user nova-compute[75165]: INFO nova.compute.manager [None req-d3c0049e-800c-46c6-8575-66ee598afdde tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: c7a55179-cde6-4fbd-a8b3-c3df149bc6f3] Unrescuing
Oct 26 00:33:27 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-d3c0049e-800c-46c6-8575-66ee598afdde tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Acquiring lock "refresh_cache-c7a55179-cde6-4fbd-a8b3-c3df149bc6f3" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:33:27 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-d3c0049e-800c-46c6-8575-66ee598afdde tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Acquired lock "refresh_cache-c7a55179-cde6-4fbd-a8b3-c3df149bc6f3" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:33:27 user nova-compute[75165]: DEBUG nova.network.neutron [None req-d3c0049e-800c-46c6-8575-66ee598afdde tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: c7a55179-cde6-4fbd-a8b3-c3df149bc6f3] Building network info cache for instance {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 00:33:27 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3c87b07-5c16-4f45-b320-06d3503d23e6/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:33:27 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3c87b07-5c16-4f45-b320-06d3503d23e6/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:33:28 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3c87b07-5c16-4f45-b320-06d3503d23e6/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:33:28 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75165) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 00:33:28 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe2984ce-8958-4049-8af7-496b313b26c8/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:33:28 user nova-compute[75165]: DEBUG nova.network.neutron [None req-d3c0049e-800c-46c6-8575-66ee598afdde tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: c7a55179-cde6-4fbd-a8b3-c3df149bc6f3] Updating instance_info_cache with network_info: [{"id": "70711118-68ee-4ea5-bfc2-df652ed0f3c1", "address": "fa:16:3e:91:b1:a6", "network": {"id": "eb55c0bc-cae5-4ba3-851a-e31a50b52c88", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1081223830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d616862c7c184de5b0ba3121552c5666", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70711118-68", "ovs_interfaceid": "70711118-68ee-4ea5-bfc2-df652ed0f3c1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:33:28 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-d3c0049e-800c-46c6-8575-66ee598afdde tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Releasing lock "refresh_cache-c7a55179-cde6-4fbd-a8b3-c3df149bc6f3" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:33:28 user nova-compute[75165]: DEBUG nova.objects.instance [None req-d3c0049e-800c-46c6-8575-66ee598afdde tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Lazy-loading 'flavor' on Instance uuid c7a55179-cde6-4fbd-a8b3-c3df149bc6f3 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:33:28 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe2984ce-8958-4049-8af7-496b313b26c8/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:33:28 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe2984ce-8958-4049-8af7-496b313b26c8/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:33:28 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:33:28 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:33:28 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe2984ce-8958-4049-8af7-496b313b26c8/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:33:28 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:33:29 user nova-compute[75165]: DEBUG nova.compute.manager [req-60323b1b-e8f5-4995-be7f-8c0072e85111 req-5aa4d4f3-211b-4ddf-8ca9-123ffe4c13d2 service nova] [instance: c7a55179-cde6-4fbd-a8b3-c3df149bc6f3] Received event network-vif-unplugged-70711118-68ee-4ea5-bfc2-df652ed0f3c1 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:33:29 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-60323b1b-e8f5-4995-be7f-8c0072e85111 req-5aa4d4f3-211b-4ddf-8ca9-123ffe4c13d2 service nova] Acquiring lock "c7a55179-cde6-4fbd-a8b3-c3df149bc6f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:33:29 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-60323b1b-e8f5-4995-be7f-8c0072e85111 req-5aa4d4f3-211b-4ddf-8ca9-123ffe4c13d2 service nova] Lock "c7a55179-cde6-4fbd-a8b3-c3df149bc6f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:33:29 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-60323b1b-e8f5-4995-be7f-8c0072e85111 req-5aa4d4f3-211b-4ddf-8ca9-123ffe4c13d2 service nova] Lock "c7a55179-cde6-4fbd-a8b3-c3df149bc6f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:33:29 user nova-compute[75165]: DEBUG nova.compute.manager [req-60323b1b-e8f5-4995-be7f-8c0072e85111 req-5aa4d4f3-211b-4ddf-8ca9-123ffe4c13d2 service nova] [instance: c7a55179-cde6-4fbd-a8b3-c3df149bc6f3] No waiting events found dispatching network-vif-unplugged-70711118-68ee-4ea5-bfc2-df652ed0f3c1 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:33:29 user nova-compute[75165]: WARNING nova.compute.manager [req-60323b1b-e8f5-4995-be7f-8c0072e85111 req-5aa4d4f3-211b-4ddf-8ca9-123ffe4c13d2 service nova] [instance: c7a55179-cde6-4fbd-a8b3-c3df149bc6f3] Received unexpected event network-vif-unplugged-70711118-68ee-4ea5-bfc2-df652ed0f3c1 for instance with vm_state rescued and task_state unrescuing.
Oct 26 00:33:29 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:33:29 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:33:29 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Hypervisor/Node resource view: name=user free_ram=8128MB free_disk=24.696422576904297GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75165) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 00:33:29 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:33:29 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:33:29 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: c7a55179-cde6-4fbd-a8b3-c3df149bc6f3] Instance destroyed successfully.
Oct 26 00:33:29 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-45c04bec-4766-4f50-9287-0904054d52c5 tempest-VolumesNegativeTest-1416627237 tempest-VolumesNegativeTest-1416627237-project-member] Acquiring lock "00c0e0e2-4c40-45a3-829a-b6b73482e311" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:33:29 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-45c04bec-4766-4f50-9287-0904054d52c5 tempest-VolumesNegativeTest-1416627237 tempest-VolumesNegativeTest-1416627237-project-member] Lock "00c0e0e2-4c40-45a3-829a-b6b73482e311" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:33:29 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-45c04bec-4766-4f50-9287-0904054d52c5 tempest-VolumesNegativeTest-1416627237 tempest-VolumesNegativeTest-1416627237-project-member] Acquiring lock "00c0e0e2-4c40-45a3-829a-b6b73482e311-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:33:29 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-45c04bec-4766-4f50-9287-0904054d52c5 tempest-VolumesNegativeTest-1416627237 tempest-VolumesNegativeTest-1416627237-project-member] Lock "00c0e0e2-4c40-45a3-829a-b6b73482e311-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:33:29 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-45c04bec-4766-4f50-9287-0904054d52c5 tempest-VolumesNegativeTest-1416627237 tempest-VolumesNegativeTest-1416627237-project-member] Lock "00c0e0e2-4c40-45a3-829a-b6b73482e311-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:33:29 user nova-compute[75165]: INFO nova.compute.manager [None req-45c04bec-4766-4f50-9287-0904054d52c5 tempest-VolumesNegativeTest-1416627237 tempest-VolumesNegativeTest-1416627237-project-member] [instance: 00c0e0e2-4c40-45a3-829a-b6b73482e311] Terminating instance
Oct 26 00:33:29 user nova-compute[75165]: DEBUG nova.compute.manager [None req-45c04bec-4766-4f50-9287-0904054d52c5 tempest-VolumesNegativeTest-1416627237 tempest-VolumesNegativeTest-1416627237-project-member] [instance: 00c0e0e2-4c40-45a3-829a-b6b73482e311] Start destroying the instance on the hypervisor. {{(pid=75165) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 00:33:29 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:33:29 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:33:29 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:33:29 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:33:29 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 97fb67a7-637d-456f-b4dd-0a271ed6cfc4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:33:29 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:33:29 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance fe2984ce-8958-4049-8af7-496b313b26c8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:33:29 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance b3c87b07-5c16-4f45-b320-06d3503d23e6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:33:29 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 250afc24-0c38-4959-a77c-d51365dd1c4e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:33:29 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance c7a55179-cde6-4fbd-a8b3-c3df149bc6f3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:33:29 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 00c0e0e2-4c40-45a3-829a-b6b73482e311 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:33:29 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance c396d555-70cf-4642-a0a0-485760cdf3fa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:33:29 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75165) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 00:33:29 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75165) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 00:33:29 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Refreshing inventories for resource provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 26 00:33:29 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Updating ProviderTree inventory for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 26 00:33:29 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Updating inventory in ProviderTree for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 26 00:33:29 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Refreshing aggregate associations for resource provider 03214fd5-21d1-46ec-b6b0-6449b77ba230, aggregates: None {{(pid=75165) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 26 00:33:29 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Refreshing trait associations for resource provider 03214fd5-21d1-46ec-b6b0-6449b77ba230, traits: COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NODE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_TRUSTED_CERTS,COMPUTE_DEVICE_TAGGING,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO {{(pid=75165) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 26 00:33:29 user nova-compute[75165]: DEBUG nova.compute.manager [req-8f9a1fec-f1ae-499b-9440-74a0e2475d2c req-4526b256-bf50-4953-ad95-0da94c0284e0 service nova] [instance: 00c0e0e2-4c40-45a3-829a-b6b73482e311] Received event network-vif-unplugged-09cc2701-0337-4975-9589-a8aa29038342 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:33:29 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-8f9a1fec-f1ae-499b-9440-74a0e2475d2c req-4526b256-bf50-4953-ad95-0da94c0284e0 service nova] Acquiring lock "00c0e0e2-4c40-45a3-829a-b6b73482e311-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:33:29 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-8f9a1fec-f1ae-499b-9440-74a0e2475d2c req-4526b256-bf50-4953-ad95-0da94c0284e0 service nova] Lock "00c0e0e2-4c40-45a3-829a-b6b73482e311-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:33:29 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-8f9a1fec-f1ae-499b-9440-74a0e2475d2c req-4526b256-bf50-4953-ad95-0da94c0284e0 service nova] Lock "00c0e0e2-4c40-45a3-829a-b6b73482e311-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:33:29 user nova-compute[75165]: DEBUG nova.compute.manager [req-8f9a1fec-f1ae-499b-9440-74a0e2475d2c req-4526b256-bf50-4953-ad95-0da94c0284e0 service nova] [instance: 00c0e0e2-4c40-45a3-829a-b6b73482e311] No waiting events found dispatching network-vif-unplugged-09cc2701-0337-4975-9589-a8aa29038342 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:33:29 user nova-compute[75165]: DEBUG nova.compute.manager [req-8f9a1fec-f1ae-499b-9440-74a0e2475d2c req-4526b256-bf50-4953-ad95-0da94c0284e0 service nova] [instance: 00c0e0e2-4c40-45a3-829a-b6b73482e311] Received event network-vif-unplugged-09cc2701-0337-4975-9589-a8aa29038342 for instance with task_state deleting. {{(pid=75165) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 00:33:30 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:33:30 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:33:30 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Compute_service record updated for user:user {{(pid=75165) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 00:33:30 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.074s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:33:30 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:33:30 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: 00c0e0e2-4c40-45a3-829a-b6b73482e311] Instance destroyed successfully.
Oct 26 00:33:30 user nova-compute[75165]: DEBUG nova.objects.instance [None req-45c04bec-4766-4f50-9287-0904054d52c5 tempest-VolumesNegativeTest-1416627237 tempest-VolumesNegativeTest-1416627237-project-member] Lazy-loading 'resources' on Instance uuid 00c0e0e2-4c40-45a3-829a-b6b73482e311 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:33:30 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-45c04bec-4766-4f50-9287-0904054d52c5 tempest-VolumesNegativeTest-1416627237 tempest-VolumesNegativeTest-1416627237-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:31:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1704764482',display_name='tempest-VolumesNegativeTest-instance-1704764482',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1704764482',id=37,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-26T00:31:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d728263a73f94098b89833123a36704b',ramdisk_id='',reservation_id='r-pfexl582',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1416627237',owner_user_name='tempest-VolumesNegativeTest-1416627237-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T00:31:49Z,user_data=None,user_id='251d5d7c57f147c68f9739e9889d08a9',uuid=00c0e0e2-4c40-45a3-829a-b6b73482e311,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "09cc2701-0337-4975-9589-a8aa29038342", "address": "fa:16:3e:85:78:5e", "network": {"id": "54ea856c-9fdd-4e10-a446-1bd35fd6d7bc", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.92", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e56bbf444fd34c348475c73673611447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09cc2701-03", "ovs_interfaceid": "09cc2701-0337-4975-9589-a8aa29038342", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 00:33:30 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-45c04bec-4766-4f50-9287-0904054d52c5 tempest-VolumesNegativeTest-1416627237 tempest-VolumesNegativeTest-1416627237-project-member] Converting VIF {"id": "09cc2701-0337-4975-9589-a8aa29038342", "address": "fa:16:3e:85:78:5e", "network": {"id": "54ea856c-9fdd-4e10-a446-1bd35fd6d7bc", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.92", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e56bbf444fd34c348475c73673611447", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09cc2701-03", "ovs_interfaceid": "09cc2701-0337-4975-9589-a8aa29038342", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:33:30 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-45c04bec-4766-4f50-9287-0904054d52c5 tempest-VolumesNegativeTest-1416627237 tempest-VolumesNegativeTest-1416627237-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:78:5e,bridge_name='br-int',has_traffic_filtering=True,id=09cc2701-0337-4975-9589-a8aa29038342,network=Network(54ea856c-9fdd-4e10-a446-1bd35fd6d7bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09cc2701-03') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:33:30 user nova-compute[75165]: DEBUG os_vif [None req-45c04bec-4766-4f50-9287-0904054d52c5 tempest-VolumesNegativeTest-1416627237 tempest-VolumesNegativeTest-1416627237-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:78:5e,bridge_name='br-int',has_traffic_filtering=True,id=09cc2701-0337-4975-9589-a8aa29038342,network=Network(54ea856c-9fdd-4e10-a446-1bd35fd6d7bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09cc2701-03') {{(pid=75165) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 00:33:30 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:33:30 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap09cc2701-03, bridge=br-int, if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:33:30 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:33:30 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:33:30 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:33:30 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:33:30 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5762bfe0-46e2-4371-ae83-d45c0a2da6a9) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:33:30 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:33:30 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:33:30 user nova-compute[75165]: INFO os_vif [None req-45c04bec-4766-4f50-9287-0904054d52c5 tempest-VolumesNegativeTest-1416627237 tempest-VolumesNegativeTest-1416627237-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:78:5e,bridge_name='br-int',has_traffic_filtering=True,id=09cc2701-0337-4975-9589-a8aa29038342,network=Network(54ea856c-9fdd-4e10-a446-1bd35fd6d7bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09cc2701-03')
Oct 26 00:33:30 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-45c04bec-4766-4f50-9287-0904054d52c5 tempest-VolumesNegativeTest-1416627237 tempest-VolumesNegativeTest-1416627237-project-member] [instance: 00c0e0e2-4c40-45a3-829a-b6b73482e311] Deleting instance files /opt/stack/data/nova/instances/00c0e0e2-4c40-45a3-829a-b6b73482e311_del
Oct 26 00:33:30 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-45c04bec-4766-4f50-9287-0904054d52c5 tempest-VolumesNegativeTest-1416627237 tempest-VolumesNegativeTest-1416627237-project-member] [instance: 00c0e0e2-4c40-45a3-829a-b6b73482e311] Deletion of /opt/stack/data/nova/instances/00c0e0e2-4c40-45a3-829a-b6b73482e311_del complete
Oct 26 00:33:30 user nova-compute[75165]: INFO nova.compute.manager [None req-45c04bec-4766-4f50-9287-0904054d52c5 tempest-VolumesNegativeTest-1416627237 tempest-VolumesNegativeTest-1416627237-project-member] [instance: 00c0e0e2-4c40-45a3-829a-b6b73482e311] Took 1.11 seconds to destroy the instance on the hypervisor.
Oct 26 00:33:30 user nova-compute[75165]: DEBUG oslo.service.loopingcall [None req-45c04bec-4766-4f50-9287-0904054d52c5 tempest-VolumesNegativeTest-1416627237 tempest-VolumesNegativeTest-1416627237-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75165) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 00:33:30 user nova-compute[75165]: DEBUG nova.compute.manager [-] [instance: 00c0e0e2-4c40-45a3-829a-b6b73482e311] Deallocating network for instance {{(pid=75165) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 00:33:30 user nova-compute[75165]: DEBUG nova.network.neutron [-] [instance: 00c0e0e2-4c40-45a3-829a-b6b73482e311] deallocate_for_instance() {{(pid=75165) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 00:33:30 user nova-compute[75165]: DEBUG nova.compute.manager [req-1c05eaa1-ded6-4813-a163-d2efc8e31c5b req-917177d5-0b3d-45b2-900a-df860702d997 service nova] [instance: c7a55179-cde6-4fbd-a8b3-c3df149bc6f3] Received event network-vif-plugged-70711118-68ee-4ea5-bfc2-df652ed0f3c1 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:33:30 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-1c05eaa1-ded6-4813-a163-d2efc8e31c5b req-917177d5-0b3d-45b2-900a-df860702d997 service nova] Acquiring lock "c7a55179-cde6-4fbd-a8b3-c3df149bc6f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:33:30 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-1c05eaa1-ded6-4813-a163-d2efc8e31c5b req-917177d5-0b3d-45b2-900a-df860702d997 service nova] Lock "c7a55179-cde6-4fbd-a8b3-c3df149bc6f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:33:30 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-1c05eaa1-ded6-4813-a163-d2efc8e31c5b req-917177d5-0b3d-45b2-900a-df860702d997 service nova] Lock "c7a55179-cde6-4fbd-a8b3-c3df149bc6f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:33:30 user nova-compute[75165]: DEBUG nova.compute.manager [req-1c05eaa1-ded6-4813-a163-d2efc8e31c5b req-917177d5-0b3d-45b2-900a-df860702d997 service nova] [instance: c7a55179-cde6-4fbd-a8b3-c3df149bc6f3] No waiting events found dispatching network-vif-plugged-70711118-68ee-4ea5-bfc2-df652ed0f3c1 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:33:30 user nova-compute[75165]: WARNING nova.compute.manager [req-1c05eaa1-ded6-4813-a163-d2efc8e31c5b req-917177d5-0b3d-45b2-900a-df860702d997 service nova] [instance: c7a55179-cde6-4fbd-a8b3-c3df149bc6f3] Received unexpected event network-vif-plugged-70711118-68ee-4ea5-bfc2-df652ed0f3c1 for instance with vm_state rescued and task_state unrescuing.
Oct 26 00:33:30 user nova-compute[75165]: DEBUG nova.network.neutron [-] [instance: 00c0e0e2-4c40-45a3-829a-b6b73482e311] Updating instance_info_cache with network_info: [] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:33:30 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:33:30 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:33:30 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:33:30 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:33:30 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:33:30 user nova-compute[75165]: INFO nova.compute.manager [-] [instance: 00c0e0e2-4c40-45a3-829a-b6b73482e311] Took 0.56 seconds to deallocate network for instance.
Oct 26 00:33:30 user nova-compute[75165]: DEBUG nova.compute.manager [req-3ee7cc65-7496-4e3f-973b-35230efcfbd0 req-75d53cc1-ffba-4ef1-99be-8c738de95dda service nova] [instance: 00c0e0e2-4c40-45a3-829a-b6b73482e311] Received event network-vif-deleted-09cc2701-0337-4975-9589-a8aa29038342 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:33:30 user nova-compute[75165]: INFO nova.compute.manager [req-3ee7cc65-7496-4e3f-973b-35230efcfbd0 req-75d53cc1-ffba-4ef1-99be-8c738de95dda service nova] [instance: 00c0e0e2-4c40-45a3-829a-b6b73482e311] Neutron deleted interface 09cc2701-0337-4975-9589-a8aa29038342; detaching it from the instance and deleting it from the info cache
Oct 26 00:33:30 user nova-compute[75165]: DEBUG nova.network.neutron [req-3ee7cc65-7496-4e3f-973b-35230efcfbd0 req-75d53cc1-ffba-4ef1-99be-8c738de95dda service nova] [instance: 00c0e0e2-4c40-45a3-829a-b6b73482e311] Updating instance_info_cache with network_info: [] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:33:30 user nova-compute[75165]: DEBUG nova.compute.manager [req-3ee7cc65-7496-4e3f-973b-35230efcfbd0 req-75d53cc1-ffba-4ef1-99be-8c738de95dda service nova] [instance: 00c0e0e2-4c40-45a3-829a-b6b73482e311] Detach interface failed, port_id=09cc2701-0337-4975-9589-a8aa29038342, reason: Instance 00c0e0e2-4c40-45a3-829a-b6b73482e311 could not be found. {{(pid=75165) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 26 00:33:30 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-45c04bec-4766-4f50-9287-0904054d52c5 tempest-VolumesNegativeTest-1416627237 tempest-VolumesNegativeTest-1416627237-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:33:30 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-45c04bec-4766-4f50-9287-0904054d52c5 tempest-VolumesNegativeTest-1416627237 tempest-VolumesNegativeTest-1416627237-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:33:31 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:33:31 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-45c04bec-4766-4f50-9287-0904054d52c5 tempest-VolumesNegativeTest-1416627237 tempest-VolumesNegativeTest-1416627237-project-member] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:33:31 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-45c04bec-4766-4f50-9287-0904054d52c5 tempest-VolumesNegativeTest-1416627237 tempest-VolumesNegativeTest-1416627237-project-member] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:33:31 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-45c04bec-4766-4f50-9287-0904054d52c5 tempest-VolumesNegativeTest-1416627237 tempest-VolumesNegativeTest-1416627237-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.403s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:33:31 user nova-compute[75165]: INFO nova.scheduler.client.report [None req-45c04bec-4766-4f50-9287-0904054d52c5 tempest-VolumesNegativeTest-1416627237 tempest-VolumesNegativeTest-1416627237-project-member] Deleted allocations for instance 00c0e0e2-4c40-45a3-829a-b6b73482e311
Oct 26 00:33:31 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-45c04bec-4766-4f50-9287-0904054d52c5 tempest-VolumesNegativeTest-1416627237 tempest-VolumesNegativeTest-1416627237-project-member] Lock "00c0e0e2-4c40-45a3-829a-b6b73482e311" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.314s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:33:31 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:33:31 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-9e080971-6e9b-42b1-96ad-51d189dc727e tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Acquiring lock "250afc24-0c38-4959-a77c-d51365dd1c4e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:33:31 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-9e080971-6e9b-42b1-96ad-51d189dc727e tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Lock "250afc24-0c38-4959-a77c-d51365dd1c4e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:33:31 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-9e080971-6e9b-42b1-96ad-51d189dc727e tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Acquiring lock "250afc24-0c38-4959-a77c-d51365dd1c4e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:33:31 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-9e080971-6e9b-42b1-96ad-51d189dc727e tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Lock "250afc24-0c38-4959-a77c-d51365dd1c4e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:33:31 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-9e080971-6e9b-42b1-96ad-51d189dc727e tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Lock "250afc24-0c38-4959-a77c-d51365dd1c4e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:33:31 user nova-compute[75165]: INFO nova.compute.manager [None req-9e080971-6e9b-42b1-96ad-51d189dc727e tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] [instance: 250afc24-0c38-4959-a77c-d51365dd1c4e] Terminating instance
Oct 26 00:33:31 user nova-compute[75165]: DEBUG nova.compute.manager [None req-9e080971-6e9b-42b1-96ad-51d189dc727e tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] [instance: 250afc24-0c38-4959-a77c-d51365dd1c4e] Start destroying the instance on the hypervisor. {{(pid=75165) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 00:33:31 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:33:31 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:33:31 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:33:31 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:33:32 user nova-compute[75165]: DEBUG nova.compute.manager [req-226e8e4c-f56d-4a45-9241-f67fd634f1a9 req-ae45fbde-6209-4aa5-a0a9-38e4d99634e4 service nova] [instance: 00c0e0e2-4c40-45a3-829a-b6b73482e311] Received event network-vif-plugged-09cc2701-0337-4975-9589-a8aa29038342 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:33:32 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-226e8e4c-f56d-4a45-9241-f67fd634f1a9 req-ae45fbde-6209-4aa5-a0a9-38e4d99634e4 service nova] Acquiring lock "00c0e0e2-4c40-45a3-829a-b6b73482e311-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:33:32 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-226e8e4c-f56d-4a45-9241-f67fd634f1a9 req-ae45fbde-6209-4aa5-a0a9-38e4d99634e4 service nova] Lock "00c0e0e2-4c40-45a3-829a-b6b73482e311-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:33:32 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-226e8e4c-f56d-4a45-9241-f67fd634f1a9 req-ae45fbde-6209-4aa5-a0a9-38e4d99634e4 service nova] Lock "00c0e0e2-4c40-45a3-829a-b6b73482e311-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:33:32 user nova-compute[75165]: DEBUG nova.compute.manager [req-226e8e4c-f56d-4a45-9241-f67fd634f1a9 req-ae45fbde-6209-4aa5-a0a9-38e4d99634e4 service nova] [instance: 00c0e0e2-4c40-45a3-829a-b6b73482e311] No waiting events found dispatching network-vif-plugged-09cc2701-0337-4975-9589-a8aa29038342 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:33:32 user nova-compute[75165]: WARNING nova.compute.manager [req-226e8e4c-f56d-4a45-9241-f67fd634f1a9 req-ae45fbde-6209-4aa5-a0a9-38e4d99634e4 service nova] [instance: 00c0e0e2-4c40-45a3-829a-b6b73482e311] Received unexpected event network-vif-plugged-09cc2701-0337-4975-9589-a8aa29038342 for instance with vm_state deleted and task_state None.
Oct 26 00:33:32 user nova-compute[75165]: DEBUG nova.compute.manager [req-226e8e4c-f56d-4a45-9241-f67fd634f1a9 req-ae45fbde-6209-4aa5-a0a9-38e4d99634e4 service nova] [instance: 250afc24-0c38-4959-a77c-d51365dd1c4e] Received event network-vif-unplugged-0372e87f-5631-4444-bfe8-ae5af9f09a46 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:33:32 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-226e8e4c-f56d-4a45-9241-f67fd634f1a9 req-ae45fbde-6209-4aa5-a0a9-38e4d99634e4 service nova] Acquiring lock "250afc24-0c38-4959-a77c-d51365dd1c4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:33:32 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-226e8e4c-f56d-4a45-9241-f67fd634f1a9 req-ae45fbde-6209-4aa5-a0a9-38e4d99634e4 service nova] Lock "250afc24-0c38-4959-a77c-d51365dd1c4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:33:32 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-226e8e4c-f56d-4a45-9241-f67fd634f1a9 req-ae45fbde-6209-4aa5-a0a9-38e4d99634e4 service nova] Lock "250afc24-0c38-4959-a77c-d51365dd1c4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:33:32 user nova-compute[75165]: DEBUG nova.compute.manager [req-226e8e4c-f56d-4a45-9241-f67fd634f1a9 req-ae45fbde-6209-4aa5-a0a9-38e4d99634e4 service nova] [instance: 250afc24-0c38-4959-a77c-d51365dd1c4e] No waiting events found dispatching network-vif-unplugged-0372e87f-5631-4444-bfe8-ae5af9f09a46 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:33:32 user nova-compute[75165]: DEBUG nova.compute.manager [req-226e8e4c-f56d-4a45-9241-f67fd634f1a9 req-ae45fbde-6209-4aa5-a0a9-38e4d99634e4 service nova] [instance: 250afc24-0c38-4959-a77c-d51365dd1c4e] Received event network-vif-unplugged-0372e87f-5631-4444-bfe8-ae5af9f09a46 for instance with task_state deleting. {{(pid=75165) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 00:33:32 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: 250afc24-0c38-4959-a77c-d51365dd1c4e] Instance destroyed successfully.
Oct 26 00:33:32 user nova-compute[75165]: DEBUG nova.objects.instance [None req-9e080971-6e9b-42b1-96ad-51d189dc727e tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Lazy-loading 'resources' on Instance uuid 250afc24-0c38-4959-a77c-d51365dd1c4e {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:33:32 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-9e080971-6e9b-42b1-96ad-51d189dc727e tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-26T00:28:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1619637514',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1212881648',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFEgAg/Q1sMeId7lJYLOcThhEJxasXz49LMiw6Ps6oE3Fcs9iqtrJ+O72pBFxY/rgxlAUWtLD4fFFfgvtCEdgpuiC+rAwqWmjPE8j/TwqxmovOpzhEUnuTgmVOvLZYE6qw==',key_name='tempest-keypair-1823122855',keypairs=<?>,launch_index=0,launched_at=2023-10-26T00:31:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cf09714f89484ff5ad700a5528b8d7c8',ramdisk_id='',reservation_id='r-e88bj6ps',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1175798990',owner_user_name='tempest-ServerActionsV293TestJSON-1175798990-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T00:31:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2c471e2bc8dc4e5f93dd321369821a99',uuid=250afc24-0c38-4959-a77c-d51365dd1c4e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0372e87f-5631-4444-bfe8-ae5af9f09a46", "address": "fa:16:3e:76:de:bf", "network": {"id": "3fa5f12d-c7f4-4f2f-8934-6fa94f598a4c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1095967566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf09714f89484ff5ad700a5528b8d7c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0372e87f-56", "ovs_interfaceid": "0372e87f-5631-4444-bfe8-ae5af9f09a46", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 00:33:32 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-9e080971-6e9b-42b1-96ad-51d189dc727e tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Converting VIF {"id": "0372e87f-5631-4444-bfe8-ae5af9f09a46", "address": "fa:16:3e:76:de:bf", "network": {"id": "3fa5f12d-c7f4-4f2f-8934-6fa94f598a4c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1095967566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cf09714f89484ff5ad700a5528b8d7c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0372e87f-56", "ovs_interfaceid": "0372e87f-5631-4444-bfe8-ae5af9f09a46", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:33:32 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-9e080971-6e9b-42b1-96ad-51d189dc727e tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:76:de:bf,bridge_name='br-int',has_traffic_filtering=True,id=0372e87f-5631-4444-bfe8-ae5af9f09a46,network=Network(3fa5f12d-c7f4-4f2f-8934-6fa94f598a4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0372e87f-56') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:33:32 user nova-compute[75165]: DEBUG os_vif [None req-9e080971-6e9b-42b1-96ad-51d189dc727e tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:76:de:bf,bridge_name='br-int',has_traffic_filtering=True,id=0372e87f-5631-4444-bfe8-ae5af9f09a46,network=Network(3fa5f12d-c7f4-4f2f-8934-6fa94f598a4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0372e87f-56') {{(pid=75165) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 00:33:32 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:33:32 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0372e87f-56, bridge=br-int, if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:33:32 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:33:32 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:33:32 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:33:32 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2e355d67-f6d7-4540-8e4a-47634817aae2) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:33:32 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:33:32 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:33:32 user nova-compute[75165]: INFO os_vif [None req-9e080971-6e9b-42b1-96ad-51d189dc727e tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:76:de:bf,bridge_name='br-int',has_traffic_filtering=True,id=0372e87f-5631-4444-bfe8-ae5af9f09a46,network=Network(3fa5f12d-c7f4-4f2f-8934-6fa94f598a4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0372e87f-56')
Oct 26 00:33:32 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e080971-6e9b-42b1-96ad-51d189dc727e tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] [instance: 250afc24-0c38-4959-a77c-d51365dd1c4e] calling os-brick to detach iSCSI Volume {{(pid=75165) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 00:33:32 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e080971-6e9b-42b1-96ad-51d189dc727e tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8bf8160e50>, {'target_iqn': 'iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OQmglCFc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:33:32 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-9e080971-6e9b-42b1-96ad-51d189dc727e tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:33:32 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-9e080971-6e9b-42b1-96ad-51d189dc727e tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:33:32 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-9e080971-6e9b-42b1-96ad-51d189dc727e tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:33:32 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:33:32 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:33:32 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[a105b6d9-bdd5-4330-8c97-e19b13ff05b1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:33:32 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e080971-6e9b-42b1-96ad-51d189dc727e tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 00:33:32 user nova-compute[75165]: No targets found.
Oct 26 00:33:32 user nova-compute[75165]: iSNS:
Oct 26 00:33:32 user nova-compute[75165]: No targets found.
Oct 26 00:33:32 user nova-compute[75165]: STATIC:
Oct 26 00:33:32 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8
Oct 26 00:33:32 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:33:32 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:33:32 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7
Oct 26 00:33:32 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:33:32 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:33:32 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795
Oct 26 00:33:32 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:33:32 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:33:32 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0
Oct 26 00:33:32 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:33:32 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:33:32 user nova-compute[75165]: FIRMWARE:
Oct 26 00:33:32 user nova-compute[75165]: No targets found.
Oct 26 00:33:32 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:33:32 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e080971-6e9b-42b1-96ad-51d189dc727e tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 00:33:32 user nova-compute[75165]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 00:33:32 user nova-compute[75165]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75165) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 00:33:32 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e080971-6e9b-42b1-96ad-51d189dc727e tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0', 0)] {{(pid=75165) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 00:33:32 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:33:32 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:33:32 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[e293263e-77d4-43e3-a1f6-ec0e1fb2970b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:33:32 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:33:32 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:33:32 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[a237b09b-adfa-4965-a8fd-458217dd4e86]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7 (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:33:32 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e080971-6e9b-42b1-96ad-51d189dc727e tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)
Oct 26 00:33:32 user nova-compute[75165]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8 (non-flash)
Oct 26 00:33:32 user nova-compute[75165]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0 (non-flash)
Oct 26 00:33:32 user nova-compute[75165]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7 (non-flash)
Oct 26 00:33:32 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:33:32 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e080971-6e9b-42b1-96ad-51d189dc727e tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)
Oct 26 00:33:32 user nova-compute[75165]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8 (non-flash)
Oct 26 00:33:32 user nova-compute[75165]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0 (non-flash)
Oct 26 00:33:32 user nova-compute[75165]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7 (non-flash)
Oct 26 00:33:32 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:33:32 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e080971-6e9b-42b1-96ad-51d189dc727e tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8be02ca950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0'): ({'sde'}, set())}) {{(pid=75165) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 00:33:32 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-9e080971-6e9b-42b1-96ad-51d189dc727e tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Removing single pathed devices sde {{(pid=75165) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 00:33:32 user nova-compute[75165]: DEBUG nova.compute.manager [req-cd7c5e26-7332-417d-a823-71939a75b4ed req-acdc5cb3-1434-4c9f-8673-7977faec1565 service nova] [instance: c7a55179-cde6-4fbd-a8b3-c3df149bc6f3] Received event network-vif-plugged-70711118-68ee-4ea5-bfc2-df652ed0f3c1 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:33:32 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-cd7c5e26-7332-417d-a823-71939a75b4ed req-acdc5cb3-1434-4c9f-8673-7977faec1565 service nova] Acquiring lock "c7a55179-cde6-4fbd-a8b3-c3df149bc6f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:33:32 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-cd7c5e26-7332-417d-a823-71939a75b4ed req-acdc5cb3-1434-4c9f-8673-7977faec1565 service nova] Lock "c7a55179-cde6-4fbd-a8b3-c3df149bc6f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:33:32 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-cd7c5e26-7332-417d-a823-71939a75b4ed req-acdc5cb3-1434-4c9f-8673-7977faec1565 service nova] Lock "c7a55179-cde6-4fbd-a8b3-c3df149bc6f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:33:32 user nova-compute[75165]: DEBUG nova.compute.manager [req-cd7c5e26-7332-417d-a823-71939a75b4ed req-acdc5cb3-1434-4c9f-8673-7977faec1565 service nova] [instance: c7a55179-cde6-4fbd-a8b3-c3df149bc6f3] No waiting events found dispatching network-vif-plugged-70711118-68ee-4ea5-bfc2-df652ed0f3c1 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:33:32 user nova-compute[75165]: WARNING nova.compute.manager [req-cd7c5e26-7332-417d-a823-71939a75b4ed req-acdc5cb3-1434-4c9f-8673-7977faec1565 service nova] [instance: c7a55179-cde6-4fbd-a8b3-c3df149bc6f3] Received unexpected event network-vif-plugged-70711118-68ee-4ea5-bfc2-df652ed0f3c1 for instance with vm_state rescued and task_state unrescuing.
Oct 26 00:33:32 user nova-compute[75165]: DEBUG nova.compute.manager [req-cd7c5e26-7332-417d-a823-71939a75b4ed req-acdc5cb3-1434-4c9f-8673-7977faec1565 service nova] [instance: c7a55179-cde6-4fbd-a8b3-c3df149bc6f3] Received event network-vif-plugged-70711118-68ee-4ea5-bfc2-df652ed0f3c1 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:33:32 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-cd7c5e26-7332-417d-a823-71939a75b4ed req-acdc5cb3-1434-4c9f-8673-7977faec1565 service nova] Acquiring lock "c7a55179-cde6-4fbd-a8b3-c3df149bc6f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:33:32 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-cd7c5e26-7332-417d-a823-71939a75b4ed req-acdc5cb3-1434-4c9f-8673-7977faec1565 service nova] Lock "c7a55179-cde6-4fbd-a8b3-c3df149bc6f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:33:32 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-cd7c5e26-7332-417d-a823-71939a75b4ed req-acdc5cb3-1434-4c9f-8673-7977faec1565 service nova] Lock "c7a55179-cde6-4fbd-a8b3-c3df149bc6f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:33:32 user nova-compute[75165]: DEBUG nova.compute.manager [req-cd7c5e26-7332-417d-a823-71939a75b4ed req-acdc5cb3-1434-4c9f-8673-7977faec1565 service nova] [instance: c7a55179-cde6-4fbd-a8b3-c3df149bc6f3] No waiting events found dispatching network-vif-plugged-70711118-68ee-4ea5-bfc2-df652ed0f3c1 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:33:32 user nova-compute[75165]: WARNING nova.compute.manager [req-cd7c5e26-7332-417d-a823-71939a75b4ed req-acdc5cb3-1434-4c9f-8673-7977faec1565 service nova] [instance: c7a55179-cde6-4fbd-a8b3-c3df149bc6f3] Received unexpected event network-vif-plugged-70711118-68ee-4ea5-bfc2-df652ed0f3c1 for instance with vm_state rescued and task_state unrescuing.
Oct 26 00:33:32 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:33:32 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:33:32 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[45640063-2b80-450d-888a-51bb7a386d41]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:33:32 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:33:32 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:33:32 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bb1b3ae-ba9c-41f5-9761-7b52a6995b92]: (4, ('ok\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:33:32 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-9e080971-6e9b-42b1-96ad-51d189dc727e tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Flushing IO for device /dev/sde {{(pid=75165) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 00:33:32 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:33:32 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:33:32 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[024fd8d4-88b9-4516-8678-4ee4344a4f57]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:33:32 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-9e080971-6e9b-42b1-96ad-51d189dc727e tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75165) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 00:33:32 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:33:32 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.053s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:33:32 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[78a29de2-ec42-49ae-9283-52dc93acdb74]: (4, ('1', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:33:32 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-9e080971-6e9b-42b1-96ad-51d189dc727e tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75165) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 00:33:32 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-9e080971-6e9b-42b1-96ad-51d189dc727e tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] SCSI volumes sde have been removed. {{(pid=75165) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 00:33:32 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e080971-6e9b-42b1-96ad-51d189dc727e tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0')] {{(pid=75165) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 00:33:32 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:33:32 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:33:32 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[7942eb0e-c2d1-41fc-9c6a-dfdb8705c754]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:33:32 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e080971-6e9b-42b1-96ad-51d189dc727e tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:33:32 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0 -p 172.16.0.220:3260 --logout {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:33:32 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:33:32 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd4ed72e-7977-47c1-99d8-1b1da78c7ec5]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:33:32 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e080971-6e9b-42b1-96ad-51d189dc727e tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0, portal: 172.16.0.220,3260]
Oct 26 00:33:32 user nova-compute[75165]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0, portal: 172.16.0.220,3260] successful.
Oct 26 00:33:32 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:33:32 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0 -p 172.16.0.220:3260 --op delete {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:33:32 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af851e79-3073-4793-929f-877775c91de0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:33:32 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[455c25a7-03a3-4aa4-990b-9ce7d7622167]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:33:32 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e080971-6e9b-42b1-96ad-51d189dc727e tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:33:32 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-9e080971-6e9b-42b1-96ad-51d189dc727e tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.341s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:33:32 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e080971-6e9b-42b1-96ad-51d189dc727e tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] <== disconnect_volume: return (342ms) None {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:33:32 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e080971-6e9b-42b1-96ad-51d189dc727e tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] [instance: 250afc24-0c38-4959-a77c-d51365dd1c4e] Disconnected iSCSI Volume {{(pid=75165) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 00:33:32 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-9e080971-6e9b-42b1-96ad-51d189dc727e tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] [instance: 250afc24-0c38-4959-a77c-d51365dd1c4e] Deleting instance files /opt/stack/data/nova/instances/250afc24-0c38-4959-a77c-d51365dd1c4e_del
Oct 26 00:33:32 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-9e080971-6e9b-42b1-96ad-51d189dc727e tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] [instance: 250afc24-0c38-4959-a77c-d51365dd1c4e] Deletion of /opt/stack/data/nova/instances/250afc24-0c38-4959-a77c-d51365dd1c4e_del complete
Oct 26 00:33:33 user nova-compute[75165]: INFO nova.compute.manager [None req-9e080971-6e9b-42b1-96ad-51d189dc727e tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] [instance: 250afc24-0c38-4959-a77c-d51365dd1c4e] Took 1.28 seconds to destroy the instance on the hypervisor.
Oct 26 00:33:33 user nova-compute[75165]: DEBUG oslo.service.loopingcall [None req-9e080971-6e9b-42b1-96ad-51d189dc727e tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75165) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 00:33:33 user nova-compute[75165]: DEBUG nova.compute.manager [-] [instance: 250afc24-0c38-4959-a77c-d51365dd1c4e] Deallocating network for instance {{(pid=75165) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 00:33:33 user nova-compute[75165]: DEBUG nova.network.neutron [-] [instance: 250afc24-0c38-4959-a77c-d51365dd1c4e] deallocate_for_instance() {{(pid=75165) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 00:33:33 user nova-compute[75165]: DEBUG nova.compute.manager [None req-d3c0049e-800c-46c6-8575-66ee598afdde tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: c7a55179-cde6-4fbd-a8b3-c3df149bc6f3] Checking state {{(pid=75165) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 00:33:34 user nova-compute[75165]: DEBUG nova.network.neutron [-] [instance: 250afc24-0c38-4959-a77c-d51365dd1c4e] Updating instance_info_cache with network_info: [] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:33:34 user nova-compute[75165]: DEBUG nova.compute.manager [req-64ab4dc2-746b-4d08-ab24-5b02782ebba4 req-61d397c0-9c01-4087-acb6-545a6542bf50 service nova] [instance: 250afc24-0c38-4959-a77c-d51365dd1c4e] Received event network-vif-deleted-0372e87f-5631-4444-bfe8-ae5af9f09a46 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:33:34 user nova-compute[75165]: INFO nova.compute.manager [req-64ab4dc2-746b-4d08-ab24-5b02782ebba4 req-61d397c0-9c01-4087-acb6-545a6542bf50 service nova] [instance: 250afc24-0c38-4959-a77c-d51365dd1c4e] Neutron deleted interface 0372e87f-5631-4444-bfe8-ae5af9f09a46; detaching it from the instance and deleting it from the info cache
Oct 26 00:33:34 user nova-compute[75165]: DEBUG nova.network.neutron [req-64ab4dc2-746b-4d08-ab24-5b02782ebba4 req-61d397c0-9c01-4087-acb6-545a6542bf50 service nova] [instance: 250afc24-0c38-4959-a77c-d51365dd1c4e] Updating instance_info_cache with network_info: [] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:33:34 user nova-compute[75165]: INFO nova.compute.manager [-] [instance: 250afc24-0c38-4959-a77c-d51365dd1c4e] Took 1.02 seconds to deallocate network for instance.
Oct 26 00:33:34 user nova-compute[75165]: DEBUG nova.compute.manager [req-4c85955f-a8f5-4ad1-a68c-d33580816386 req-3964f27f-63ce-4ff7-a79c-1d668f44c36f service nova] [instance: 250afc24-0c38-4959-a77c-d51365dd1c4e] Received event network-vif-plugged-0372e87f-5631-4444-bfe8-ae5af9f09a46 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:33:34 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-4c85955f-a8f5-4ad1-a68c-d33580816386 req-3964f27f-63ce-4ff7-a79c-1d668f44c36f service nova] Acquiring lock "250afc24-0c38-4959-a77c-d51365dd1c4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:33:34 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-4c85955f-a8f5-4ad1-a68c-d33580816386 req-3964f27f-63ce-4ff7-a79c-1d668f44c36f service nova] Lock "250afc24-0c38-4959-a77c-d51365dd1c4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:33:34 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-4c85955f-a8f5-4ad1-a68c-d33580816386 req-3964f27f-63ce-4ff7-a79c-1d668f44c36f service nova] Lock "250afc24-0c38-4959-a77c-d51365dd1c4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:33:34 user nova-compute[75165]: DEBUG nova.compute.manager [req-4c85955f-a8f5-4ad1-a68c-d33580816386 req-3964f27f-63ce-4ff7-a79c-1d668f44c36f service nova] [instance: 250afc24-0c38-4959-a77c-d51365dd1c4e] No waiting events found dispatching network-vif-plugged-0372e87f-5631-4444-bfe8-ae5af9f09a46 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:33:34 user nova-compute[75165]: WARNING nova.compute.manager [req-4c85955f-a8f5-4ad1-a68c-d33580816386 req-3964f27f-63ce-4ff7-a79c-1d668f44c36f service nova] [instance: 250afc24-0c38-4959-a77c-d51365dd1c4e] Received unexpected event network-vif-plugged-0372e87f-5631-4444-bfe8-ae5af9f09a46 for instance with vm_state active and task_state deleting.
Oct 26 00:33:34 user nova-compute[75165]: DEBUG nova.compute.manager [req-64ab4dc2-746b-4d08-ab24-5b02782ebba4 req-61d397c0-9c01-4087-acb6-545a6542bf50 service nova] [instance: 250afc24-0c38-4959-a77c-d51365dd1c4e] Detach interface failed, port_id=0372e87f-5631-4444-bfe8-ae5af9f09a46, reason: Instance 250afc24-0c38-4959-a77c-d51365dd1c4e could not be found. {{(pid=75165) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 26 00:33:35 user nova-compute[75165]: INFO nova.compute.manager [None req-9e080971-6e9b-42b1-96ad-51d189dc727e tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] [instance: 250afc24-0c38-4959-a77c-d51365dd1c4e] Took 0.96 seconds to detach 1 volumes for instance.
Oct 26 00:33:35 user nova-compute[75165]: DEBUG nova.compute.manager [None req-9e080971-6e9b-42b1-96ad-51d189dc727e tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] [instance: 250afc24-0c38-4959-a77c-d51365dd1c4e] Deleting volume: af851e79-3073-4793-929f-877775c91de0 {{(pid=75165) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 26 00:33:35 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-9e080971-6e9b-42b1-96ad-51d189dc727e tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:33:35 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-9e080971-6e9b-42b1-96ad-51d189dc727e tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:33:35 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-9e080971-6e9b-42b1-96ad-51d189dc727e tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:33:35 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-9e080971-6e9b-42b1-96ad-51d189dc727e tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:33:35 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-9e080971-6e9b-42b1-96ad-51d189dc727e tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.394s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:33:35 user nova-compute[75165]: INFO nova.scheduler.client.report [None req-9e080971-6e9b-42b1-96ad-51d189dc727e tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Deleted allocations for instance 250afc24-0c38-4959-a77c-d51365dd1c4e
Oct 26 00:33:35 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-9e080971-6e9b-42b1-96ad-51d189dc727e tempest-ServerActionsV293TestJSON-1175798990 tempest-ServerActionsV293TestJSON-1175798990-project-member] Lock "250afc24-0c38-4959-a77c-d51365dd1c4e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.970s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:33:36 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:33:36 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:33:36 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Cleaning up deleted instances {{(pid=75165) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 26 00:33:36 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] There are 0 instances to clean {{(pid=75165) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 26 00:33:37 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:33:37 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:33:37 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75165) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 26 00:33:41 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:33:42 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:33:46 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:33:47 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:33:51 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:33:52 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:33:56 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:33:57 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:33:57 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:33:59 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:33:59 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Triggering sync for uuid 97fb67a7-637d-456f-b4dd-0a271ed6cfc4 {{(pid=75165) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 00:33:59 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Triggering sync for uuid a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb {{(pid=75165) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 00:33:59 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Triggering sync for uuid fe2984ce-8958-4049-8af7-496b313b26c8 {{(pid=75165) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 00:33:59 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Triggering sync for uuid b3c87b07-5c16-4f45-b320-06d3503d23e6 {{(pid=75165) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 00:33:59 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Triggering sync for uuid c7a55179-cde6-4fbd-a8b3-c3df149bc6f3 {{(pid=75165) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 00:33:59 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Triggering sync for uuid c396d555-70cf-4642-a0a0-485760cdf3fa {{(pid=75165) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 00:33:59 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "97fb67a7-637d-456f-b4dd-0a271ed6cfc4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:33:59 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "97fb67a7-637d-456f-b4dd-0a271ed6cfc4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:33:59 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:33:59 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:33:59 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "fe2984ce-8958-4049-8af7-496b313b26c8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:33:59 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "fe2984ce-8958-4049-8af7-496b313b26c8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:33:59 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "b3c87b07-5c16-4f45-b320-06d3503d23e6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:33:59 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "b3c87b07-5c16-4f45-b320-06d3503d23e6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:33:59 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "c7a55179-cde6-4fbd-a8b3-c3df149bc6f3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:33:59 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "c7a55179-cde6-4fbd-a8b3-c3df149bc6f3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:33:59 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "c396d555-70cf-4642-a0a0-485760cdf3fa" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:33:59 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "c396d555-70cf-4642-a0a0-485760cdf3fa" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:33:59 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.037s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:33:59 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "97fb67a7-637d-456f-b4dd-0a271ed6cfc4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.044s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:33:59 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "b3c87b07-5c16-4f45-b320-06d3503d23e6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.058s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:33:59 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "c7a55179-cde6-4fbd-a8b3-c3df149bc6f3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.064s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:33:59 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "fe2984ce-8958-4049-8af7-496b313b26c8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.078s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:33:59 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "c396d555-70cf-4642-a0a0-485760cdf3fa" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.081s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:34:01 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:34:02 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:34:03 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-6e6c3793-14fc-4489-905c-996386a20578 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Acquiring lock "fe2984ce-8958-4049-8af7-496b313b26c8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:34:03 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-6e6c3793-14fc-4489-905c-996386a20578 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Lock "fe2984ce-8958-4049-8af7-496b313b26c8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:34:03 user nova-compute[75165]: DEBUG nova.objects.instance [None req-6e6c3793-14fc-4489-905c-996386a20578 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Lazy-loading 'flavor' on Instance uuid fe2984ce-8958-4049-8af7-496b313b26c8 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:34:03 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-6e6c3793-14fc-4489-905c-996386a20578 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Lock "fe2984ce-8958-4049-8af7-496b313b26c8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:34:03 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-6e6c3793-14fc-4489-905c-996386a20578 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Acquiring lock "fe2984ce-8958-4049-8af7-496b313b26c8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:34:03 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-6e6c3793-14fc-4489-905c-996386a20578 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Lock "fe2984ce-8958-4049-8af7-496b313b26c8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:34:03 user nova-compute[75165]: INFO nova.compute.manager [None req-6e6c3793-14fc-4489-905c-996386a20578 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] [instance: fe2984ce-8958-4049-8af7-496b313b26c8] Attaching volume 00b01051-74e4-43e2-aee1-42f2e5f94fe5 to /dev/vdb
Oct 26 00:34:03 user nova-compute[75165]: DEBUG os_brick.utils [None req-6e6c3793-14fc-4489-905c-996386a20578 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:34:03 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:34:03 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:34:03 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f0ab241-4cd7-4284-8794-fd28cef9918e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa94814ccb35\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:34:03 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:34:03 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:34:03 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[a689770e-ec7c-4ae5-816f-003170dc732d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:34:03 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:34:03 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:34:03 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[d87f5a10-162e-4331-8bc9-46498d5d3891]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:34:03 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ddc1e91-ac60-49a3-aa89-48292ccdc4ed]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:34:03 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-6e6c3793-14fc-4489-905c-996386a20578 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Running cmd (subprocess): nvme version {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:34:03 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-6e6c3793-14fc-4489-905c-996386a20578 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] 'nvme version' failed. Not Retrying. {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 00:34:03 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6e6c3793-14fc-4489-905c-996386a20578 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] nvme not present on system {{(pid=75165) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 00:34:03 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:34:03 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 00:34:03 user nova-compute[75165]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 00:34:03 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[75a12360-3ebf-46c6-bc1a-d2c37812c1d9]: (4, '') {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:34:03 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-6e6c3793-14fc-4489-905c-996386a20578 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75165) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 00:34:03 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-6e6c3793-14fc-4489-905c-996386a20578 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75165) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 00:34:03 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-6e6c3793-14fc-4489-905c-996386a20578 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] LIGHTOS: no hostnqn found. {{(pid=75165) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 00:34:03 user nova-compute[75165]: DEBUG os_brick.utils [None req-6e6c3793-14fc-4489-905c-996386a20578 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa94814ccb35', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:34:03 user nova-compute[75165]: DEBUG nova.virt.block_device [None req-6e6c3793-14fc-4489-905c-996386a20578 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] [instance: fe2984ce-8958-4049-8af7-496b313b26c8] Updating existing volume attachment record: 27ce811b-2802-4fe8-9845-1bdfc4f00bc7 {{(pid=75165) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 00:34:06 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:34:07 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:34:12 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:34:15 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:34:15 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75165) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 00:34:17 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:34:20 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:34:20 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:34:22 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:34:22 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:34:24 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:34:24 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:34:25 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:34:25 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Starting heal instance info cache {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 00:34:26 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "refresh_cache-a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:34:26 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquired lock "refresh_cache-a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:34:26 user nova-compute[75165]: DEBUG nova.network.neutron [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb] Forcefully refreshing network info cache for instance {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 00:34:26 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:34:26 user nova-compute[75165]: DEBUG nova.network.neutron [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb] Updating instance_info_cache with network_info: [{"id": "e2143e91-9f8c-4670-9f92-c2c00827a619", "address": "fa:16:3e:6c:b7:14", "network": {"id": "eb55c0bc-cae5-4ba3-851a-e31a50b52c88", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1081223830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d616862c7c184de5b0ba3121552c5666", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2143e91-9f", "ovs_interfaceid": "e2143e91-9f8c-4670-9f92-c2c00827a619", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:34:26 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Releasing lock "refresh_cache-a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:34:26 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb] Updated the network info_cache for instance {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 00:34:27 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:34:27 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:34:27 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:34:27 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:34:27 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:34:27 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:34:27 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75165) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 00:34:28 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75165) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 00:34:28 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75165) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 00:34:28 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97fb67a7-637d-456f-b4dd-0a271ed6cfc4/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:34:28 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97fb67a7-637d-456f-b4dd-0a271ed6cfc4/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:34:28 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97fb67a7-637d-456f-b4dd-0a271ed6cfc4/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:34:28 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97fb67a7-637d-456f-b4dd-0a271ed6cfc4/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:34:28 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3c87b07-5c16-4f45-b320-06d3503d23e6/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:34:28 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3c87b07-5c16-4f45-b320-06d3503d23e6/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:34:28 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3c87b07-5c16-4f45-b320-06d3503d23e6/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:34:28 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3c87b07-5c16-4f45-b320-06d3503d23e6/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:34:28 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75165) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 00:34:28 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe2984ce-8958-4049-8af7-496b313b26c8/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:34:29 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe2984ce-8958-4049-8af7-496b313b26c8/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:34:29 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe2984ce-8958-4049-8af7-496b313b26c8/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:34:29 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe2984ce-8958-4049-8af7-496b313b26c8/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:34:29 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:34:29 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:34:29 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Hypervisor/Node resource view: name=user free_ram=8337MB free_disk=24.705257415771484GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75165) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 00:34:29 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:34:29 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:34:29 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 97fb67a7-637d-456f-b4dd-0a271ed6cfc4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:34:29 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:34:29 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance fe2984ce-8958-4049-8af7-496b313b26c8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:34:29 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance b3c87b07-5c16-4f45-b320-06d3503d23e6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:34:29 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance c7a55179-cde6-4fbd-a8b3-c3df149bc6f3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:34:29 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance c396d555-70cf-4642-a0a0-485760cdf3fa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:34:29 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75165) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 00:34:29 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75165) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 00:34:30 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:34:30 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:34:30 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Compute_service record updated for user:user {{(pid=75165) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 00:34:30 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.445s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:34:32 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:34:32 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:34:33 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:34:35 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e6c3793-14fc-4489-905c-996386a20578 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] [instance: fe2984ce-8958-4049-8af7-496b313b26c8] Calling os-brick to attach iSCSI Volume {{(pid=75165) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 00:34:35 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e6c3793-14fc-4489-905c-996386a20578 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8bf8160e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:00b01051-74e4-43e2-aee1-42f2e5f94fe5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AebPfyzU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:34:35 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-6e6c3793-14fc-4489-905c-996386a20578 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:34:35 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-6e6c3793-14fc-4489-905c-996386a20578 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:34:35 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-6e6c3793-14fc-4489-905c-996386a20578 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:34:35 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-6e6c3793-14fc-4489-905c-996386a20578 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:34:35 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-6e6c3793-14fc-4489-905c-996386a20578 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:00b01051-74e4-43e2-aee1-42f2e5f94fe5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:34:35 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-6e6c3793-14fc-4489-905c-996386a20578 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:00b01051-74e4-43e2-aee1-42f2e5f94fe5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:34:35 user nova-compute[75165]: INFO os_brick.initiator.connectors.iscsi [None req-6e6c3793-14fc-4489-905c-996386a20578 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 00:34:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00b01051-74e4-43e2-aee1-42f2e5f94fe5 -p 172.16.0.220:3260 {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:34:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00b01051-74e4-43e2-aee1-42f2e5f94fe5 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:34:35 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[e243b8c3-0eb5-456c-85d6-b6a716c46904]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:34:35 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e6c3793-14fc-4489-905c-996386a20578 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 00:34:35 user nova-compute[75165]:  {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:34:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00b01051-74e4-43e2-aee1-42f2e5f94fe5 -p 172.16.0.220:3260 --interface default --op new {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:34:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00b01051-74e4-43e2-aee1-42f2e5f94fe5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:34:35 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4126e33-d99c-4dec-9c4d-8439fd123c06]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:00b01051-74e4-43e2-aee1-42f2e5f94fe5] added\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:34:35 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e6c3793-14fc-4489-905c-996386a20578 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:00b01051-74e4-43e2-aee1-42f2e5f94fe5] added
Oct 26 00:34:35 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:34:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00b01051-74e4-43e2-aee1-42f2e5f94fe5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:34:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00b01051-74e4-43e2-aee1-42f2e5f94fe5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.032s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:34:35 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fd56ab3-9157-4e38-8428-99d3e675c38b]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:34:35 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e6c3793-14fc-4489-905c-996386a20578 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:34:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00b01051-74e4-43e2-aee1-42f2e5f94fe5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:34:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00b01051-74e4-43e2-aee1-42f2e5f94fe5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:34:35 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[f73ed18a-5746-4582-bc5e-61437539cc57]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:34:35 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e6c3793-14fc-4489-905c-996386a20578 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:34:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00b01051-74e4-43e2-aee1-42f2e5f94fe5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AebPfyzU {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:34:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00b01051-74e4-43e2-aee1-42f2e5f94fe5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AebPfyzU" returned: 0 in 0.024s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:34:35 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbf21301-e25b-4194-8ff9-c56aa9b28480]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:34:35 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e6c3793-14fc-4489-905c-996386a20578 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AebPfyzU'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:34:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00b01051-74e4-43e2-aee1-42f2e5f94fe5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:34:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00b01051-74e4-43e2-aee1-42f2e5f94fe5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:34:35 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bc98338-a053-4fc2-858f-d0cbf9221a51]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:34:35 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e6c3793-14fc-4489-905c-996386a20578 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:34:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:34:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:34:35 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8a8d3f5-7fe7-481e-9f51-365b16780ad4]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7 (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:34:35 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e6c3793-14fc-4489-905c-996386a20578 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)
Oct 26 00:34:35 user nova-compute[75165]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8 (non-flash)
Oct 26 00:34:35 user nova-compute[75165]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7 (non-flash)
Oct 26 00:34:35 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:34:35 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e6c3793-14fc-4489-905c-996386a20578 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)
Oct 26 00:34:35 user nova-compute[75165]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8 (non-flash)
Oct 26 00:34:35 user nova-compute[75165]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7 (non-flash)
Oct 26 00:34:35 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:34:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00b01051-74e4-43e2-aee1-42f2e5f94fe5 -p 172.16.0.220:3260 --login {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:34:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00b01051-74e4-43e2-aee1-42f2e5f94fe5 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:34:35 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[56b367dd-1b0a-4f8e-951d-63e96b4a45af]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:00b01051-74e4-43e2-aee1-42f2e5f94fe5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:00b01051-74e4-43e2-aee1-42f2e5f94fe5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:34:35 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e6c3793-14fc-4489-905c-996386a20578 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:00b01051-74e4-43e2-aee1-42f2e5f94fe5, portal: 172.16.0.220,3260]
Oct 26 00:34:35 user nova-compute[75165]: Login to [iface: default, target: iqn.2010-10.org.openstack:00b01051-74e4-43e2-aee1-42f2e5f94fe5, portal: 172.16.0.220,3260] successful.
Oct 26 00:34:35 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:34:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00b01051-74e4-43e2-aee1-42f2e5f94fe5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:34:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00b01051-74e4-43e2-aee1-42f2e5f94fe5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:34:35 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9b112cd-5551-4615-a7fd-5363c04a17da]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:34:35 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e6c3793-14fc-4489-905c-996386a20578 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:34:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:34:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:34:35 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0f9cd00-7a07-4b32-acaf-3e95f99a5316]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00b01051-74e4-43e2-aee1-42f2e5f94fe5 (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:34:35 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e6c3793-14fc-4489-905c-996386a20578 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)
Oct 26 00:34:35 user nova-compute[75165]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8 (non-flash)
Oct 26 00:34:35 user nova-compute[75165]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7 (non-flash)
Oct 26 00:34:35 user nova-compute[75165]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00b01051-74e4-43e2-aee1-42f2e5f94fe5 (non-flash)
Oct 26 00:34:35 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:34:35 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e6c3793-14fc-4489-905c-996386a20578 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)
Oct 26 00:34:35 user nova-compute[75165]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8 (non-flash)
Oct 26 00:34:35 user nova-compute[75165]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7 (non-flash)
Oct 26 00:34:35 user nova-compute[75165]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00b01051-74e4-43e2-aee1-42f2e5f94fe5 (non-flash)
Oct 26 00:34:35 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:34:35 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-6e6c3793-14fc-4489-905c-996386a20578 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:00b01051-74e4-43e2-aee1-42f2e5f94fe5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.329s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:34:35 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e6c3793-14fc-4489-905c-996386a20578 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Connected to 172.16.0.220:3260 {{(pid=75165) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 00:34:35 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-6e6c3793-14fc-4489-905c-996386a20578 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] HCTL ('36', '-', '-', 0) found on session 42 with lun 0 {{(pid=75165) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 00:34:35 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-6e6c3793-14fc-4489-905c-996386a20578 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75165) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 00:34:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:34:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.021s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:34:35 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[82bf2c39-df91-47a6-8e3d-dd22f31786ab]: (4, ('- - 0', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:34:35 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-6e6c3793-14fc-4489-905c-996386a20578 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Searching for a device in session 42 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75165) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 00:34:35 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e6c3793-14fc-4489-905c-996386a20578 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:00b01051-74e4-43e2-aee1-42f2e5f94fe5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AebPfyzU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75165) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 00:34:36 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-6e6c3793-14fc-4489-905c-996386a20578 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.371s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:34:36 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e6c3793-14fc-4489-905c-996386a20578 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] <== connect_volume: return (1373ms) {'type': 'block', 'scsi_wwn': '26361346562376131', 'path': '/dev/sde'} {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:34:36 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e6c3793-14fc-4489-905c-996386a20578 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] [instance: fe2984ce-8958-4049-8af7-496b313b26c8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26361346562376131', 'path': '/dev/sde'} {{(pid=75165) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 00:34:36 user nova-compute[75165]: DEBUG nova.objects.instance [None req-6e6c3793-14fc-4489-905c-996386a20578 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Lazy-loading 'flavor' on Instance uuid fe2984ce-8958-4049-8af7-496b313b26c8 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:34:36 user nova-compute[75165]: DEBUG nova.virt.libvirt.guest [None req-6e6c3793-14fc-4489-905c-996386a20578 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 00:34:36 user nova-compute[75165]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 00:34:36 user nova-compute[75165]:   <source dev="/dev/sde"/>
Oct 26 00:34:36 user nova-compute[75165]:   <target dev="vdb" bus="virtio"/>
Oct 26 00:34:36 user nova-compute[75165]:   <serial>00b01051-74e4-43e2-aee1-42f2e5f94fe5</serial>
Oct 26 00:34:36 user nova-compute[75165]: </disk>
Oct 26 00:34:36 user nova-compute[75165]:  {{(pid=75165) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 00:34:36 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-3e81f28f-487b-4cbc-9cea-f025a53c4302 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Acquiring lock "7e534595-7eaf-49f4-b457-9f37bc59012b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:34:36 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-3e81f28f-487b-4cbc-9cea-f025a53c4302 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Lock "7e534595-7eaf-49f4-b457-9f37bc59012b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:34:36 user nova-compute[75165]: DEBUG nova.compute.manager [None req-3e81f28f-487b-4cbc-9cea-f025a53c4302 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 7e534595-7eaf-49f4-b457-9f37bc59012b] Starting instance... {{(pid=75165) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 00:34:36 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-3e81f28f-487b-4cbc-9cea-f025a53c4302 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:34:36 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-3e81f28f-487b-4cbc-9cea-f025a53c4302 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:34:36 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:34:36 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-3e81f28f-487b-4cbc-9cea-f025a53c4302 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75165) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 00:34:36 user nova-compute[75165]: INFO nova.compute.claims [None req-3e81f28f-487b-4cbc-9cea-f025a53c4302 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 7e534595-7eaf-49f4-b457-9f37bc59012b] Claim successful on node user
Oct 26 00:34:36 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-6e6c3793-14fc-4489-905c-996386a20578 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] No BDM found with device name vda, not building metadata. {{(pid=75165) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 00:34:36 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-6e6c3793-14fc-4489-905c-996386a20578 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75165) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 00:34:36 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-6e6c3793-14fc-4489-905c-996386a20578 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] No VIF found with MAC fa:16:3e:ca:36:c4, not building metadata {{(pid=75165) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 00:34:37 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-6e6c3793-14fc-4489-905c-996386a20578 tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Lock "fe2984ce-8958-4049-8af7-496b313b26c8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 33.723s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:34:37 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-3e81f28f-487b-4cbc-9cea-f025a53c4302 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:34:37 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-3e81f28f-487b-4cbc-9cea-f025a53c4302 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:34:37 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-3e81f28f-487b-4cbc-9cea-f025a53c4302 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.376s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:34:37 user nova-compute[75165]: DEBUG nova.compute.manager [None req-3e81f28f-487b-4cbc-9cea-f025a53c4302 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 7e534595-7eaf-49f4-b457-9f37bc59012b] Start building networks asynchronously for instance. {{(pid=75165) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 00:34:37 user nova-compute[75165]: DEBUG nova.compute.manager [None req-3e81f28f-487b-4cbc-9cea-f025a53c4302 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 7e534595-7eaf-49f4-b457-9f37bc59012b] Allocating IP information in the background. {{(pid=75165) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 00:34:37 user nova-compute[75165]: DEBUG nova.network.neutron [None req-3e81f28f-487b-4cbc-9cea-f025a53c4302 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 7e534595-7eaf-49f4-b457-9f37bc59012b] allocate_for_instance() {{(pid=75165) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 00:34:37 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-3e81f28f-487b-4cbc-9cea-f025a53c4302 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 7e534595-7eaf-49f4-b457-9f37bc59012b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 00:34:37 user nova-compute[75165]: DEBUG nova.compute.manager [None req-3e81f28f-487b-4cbc-9cea-f025a53c4302 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 7e534595-7eaf-49f4-b457-9f37bc59012b] Start building block device mappings for instance. {{(pid=75165) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 00:34:37 user nova-compute[75165]: DEBUG nova.policy [None req-3e81f28f-487b-4cbc-9cea-f025a53c4302 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '041ebe2732c341129d6813549653cab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62572ce8ae524b55950532fd89729b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75165) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 00:34:37 user nova-compute[75165]: DEBUG nova.compute.manager [None req-3e81f28f-487b-4cbc-9cea-f025a53c4302 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 7e534595-7eaf-49f4-b457-9f37bc59012b] Start spawning the instance on the hypervisor. {{(pid=75165) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 00:34:37 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-3e81f28f-487b-4cbc-9cea-f025a53c4302 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 7e534595-7eaf-49f4-b457-9f37bc59012b] Creating instance directory {{(pid=75165) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 00:34:37 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-3e81f28f-487b-4cbc-9cea-f025a53c4302 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 7e534595-7eaf-49f4-b457-9f37bc59012b] Creating image(s)
Oct 26 00:34:37 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-3e81f28f-487b-4cbc-9cea-f025a53c4302 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Acquiring lock "/opt/stack/data/nova/instances/7e534595-7eaf-49f4-b457-9f37bc59012b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:34:37 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-3e81f28f-487b-4cbc-9cea-f025a53c4302 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Lock "/opt/stack/data/nova/instances/7e534595-7eaf-49f4-b457-9f37bc59012b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:34:37 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-3e81f28f-487b-4cbc-9cea-f025a53c4302 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Lock "/opt/stack/data/nova/instances/7e534595-7eaf-49f4-b457-9f37bc59012b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:34:37 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-3e81f28f-487b-4cbc-9cea-f025a53c4302 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:34:37 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-3e81f28f-487b-4cbc-9cea-f025a53c4302 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json" returned: 0 in 0.191s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:34:37 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-3e81f28f-487b-4cbc-9cea-f025a53c4302 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Acquiring lock "7d3243421cf3fdc288b758f687a93103b7b95466" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:34:37 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-3e81f28f-487b-4cbc-9cea-f025a53c4302 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Lock "7d3243421cf3fdc288b758f687a93103b7b95466" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:34:37 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-3e81f28f-487b-4cbc-9cea-f025a53c4302 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:34:37 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:34:37 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-3e81f28f-487b-4cbc-9cea-f025a53c4302 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json" returned: 0 in 0.184s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:34:37 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-3e81f28f-487b-4cbc-9cea-f025a53c4302 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466,backing_fmt=raw /opt/stack/data/nova/instances/7e534595-7eaf-49f4-b457-9f37bc59012b/disk 1073741824 {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:34:37 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-3e81f28f-487b-4cbc-9cea-f025a53c4302 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466,backing_fmt=raw /opt/stack/data/nova/instances/7e534595-7eaf-49f4-b457-9f37bc59012b/disk 1073741824" returned: 0 in 0.052s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:34:37 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-3e81f28f-487b-4cbc-9cea-f025a53c4302 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Lock "7d3243421cf3fdc288b758f687a93103b7b95466" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:34:37 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-3e81f28f-487b-4cbc-9cea-f025a53c4302 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:34:37 user nova-compute[75165]: DEBUG nova.network.neutron [None req-3e81f28f-487b-4cbc-9cea-f025a53c4302 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 7e534595-7eaf-49f4-b457-9f37bc59012b] Successfully created port: d4d7b894-8aba-454c-b803-ec2bf8b28f06 {{(pid=75165) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 00:34:38 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-3e81f28f-487b-4cbc-9cea-f025a53c4302 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json" returned: 0 in 0.182s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:34:38 user nova-compute[75165]: DEBUG nova.virt.disk.api [None req-3e81f28f-487b-4cbc-9cea-f025a53c4302 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7e534595-7eaf-49f4-b457-9f37bc59012b/disk. size=1073741824 {{(pid=75165) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 00:34:38 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-3e81f28f-487b-4cbc-9cea-f025a53c4302 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e534595-7eaf-49f4-b457-9f37bc59012b/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:34:38 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-3e81f28f-487b-4cbc-9cea-f025a53c4302 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e534595-7eaf-49f4-b457-9f37bc59012b/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:34:38 user nova-compute[75165]: DEBUG nova.virt.disk.api [None req-3e81f28f-487b-4cbc-9cea-f025a53c4302 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Cannot resize image /opt/stack/data/nova/instances/7e534595-7eaf-49f4-b457-9f37bc59012b/disk to a smaller size. {{(pid=75165) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 00:34:38 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-3e81f28f-487b-4cbc-9cea-f025a53c4302 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 7e534595-7eaf-49f4-b457-9f37bc59012b] Created local disks {{(pid=75165) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 00:34:38 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-3e81f28f-487b-4cbc-9cea-f025a53c4302 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 7e534595-7eaf-49f4-b457-9f37bc59012b] Ensure instance console log exists: /opt/stack/data/nova/instances/7e534595-7eaf-49f4-b457-9f37bc59012b/console.log {{(pid=75165) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 00:34:38 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-3e81f28f-487b-4cbc-9cea-f025a53c4302 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:34:38 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-3e81f28f-487b-4cbc-9cea-f025a53c4302 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:34:38 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-3e81f28f-487b-4cbc-9cea-f025a53c4302 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:34:38 user nova-compute[75165]: DEBUG nova.network.neutron [None req-3e81f28f-487b-4cbc-9cea-f025a53c4302 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 7e534595-7eaf-49f4-b457-9f37bc59012b] Successfully updated port: d4d7b894-8aba-454c-b803-ec2bf8b28f06 {{(pid=75165) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 00:34:38 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-3e81f28f-487b-4cbc-9cea-f025a53c4302 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Acquiring lock "refresh_cache-7e534595-7eaf-49f4-b457-9f37bc59012b" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:34:38 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-3e81f28f-487b-4cbc-9cea-f025a53c4302 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Acquired lock "refresh_cache-7e534595-7eaf-49f4-b457-9f37bc59012b" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:34:38 user nova-compute[75165]: DEBUG nova.network.neutron [None req-3e81f28f-487b-4cbc-9cea-f025a53c4302 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 7e534595-7eaf-49f4-b457-9f37bc59012b] Building network info cache for instance {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 00:34:38 user nova-compute[75165]: DEBUG nova.network.neutron [None req-3e81f28f-487b-4cbc-9cea-f025a53c4302 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 7e534595-7eaf-49f4-b457-9f37bc59012b] Instance cache missing network info. {{(pid=75165) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 00:34:38 user nova-compute[75165]: DEBUG nova.compute.manager [req-d55dd933-5da9-4c68-bcf8-4a66021d164a req-7cf9a4cd-a491-405d-9fc4-9d5aad99a78d service nova] [instance: 7e534595-7eaf-49f4-b457-9f37bc59012b] Received event network-changed-d4d7b894-8aba-454c-b803-ec2bf8b28f06 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:34:38 user nova-compute[75165]: DEBUG nova.compute.manager [req-d55dd933-5da9-4c68-bcf8-4a66021d164a req-7cf9a4cd-a491-405d-9fc4-9d5aad99a78d service nova] [instance: 7e534595-7eaf-49f4-b457-9f37bc59012b] Refreshing instance network info cache due to event network-changed-d4d7b894-8aba-454c-b803-ec2bf8b28f06. {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 00:34:38 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-d55dd933-5da9-4c68-bcf8-4a66021d164a req-7cf9a4cd-a491-405d-9fc4-9d5aad99a78d service nova] Acquiring lock "refresh_cache-7e534595-7eaf-49f4-b457-9f37bc59012b" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:34:39 user nova-compute[75165]: DEBUG nova.network.neutron [None req-3e81f28f-487b-4cbc-9cea-f025a53c4302 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 7e534595-7eaf-49f4-b457-9f37bc59012b] Updating instance_info_cache with network_info: [{"id": "d4d7b894-8aba-454c-b803-ec2bf8b28f06", "address": "fa:16:3e:60:42:1c", "network": {"id": "1801db1c-315e-4bdf-b73b-132a38bf41b8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1254756052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62572ce8ae524b55950532fd89729b71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4d7b894-8a", "ovs_interfaceid": "d4d7b894-8aba-454c-b803-ec2bf8b28f06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:34:39 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-3e81f28f-487b-4cbc-9cea-f025a53c4302 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Releasing lock "refresh_cache-7e534595-7eaf-49f4-b457-9f37bc59012b" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:34:39 user nova-compute[75165]: DEBUG nova.compute.manager [None req-3e81f28f-487b-4cbc-9cea-f025a53c4302 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 7e534595-7eaf-49f4-b457-9f37bc59012b] Instance network_info: |[{"id": "d4d7b894-8aba-454c-b803-ec2bf8b28f06", "address": "fa:16:3e:60:42:1c", "network": {"id": "1801db1c-315e-4bdf-b73b-132a38bf41b8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1254756052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62572ce8ae524b55950532fd89729b71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4d7b894-8a", "ovs_interfaceid": "d4d7b894-8aba-454c-b803-ec2bf8b28f06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75165) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 00:34:39 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-d55dd933-5da9-4c68-bcf8-4a66021d164a req-7cf9a4cd-a491-405d-9fc4-9d5aad99a78d service nova] Acquired lock "refresh_cache-7e534595-7eaf-49f4-b457-9f37bc59012b" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:34:39 user nova-compute[75165]: DEBUG nova.network.neutron [req-d55dd933-5da9-4c68-bcf8-4a66021d164a req-7cf9a4cd-a491-405d-9fc4-9d5aad99a78d service nova] [instance: 7e534595-7eaf-49f4-b457-9f37bc59012b] Refreshing network info cache for port d4d7b894-8aba-454c-b803-ec2bf8b28f06 {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 00:34:39 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-3e81f28f-487b-4cbc-9cea-f025a53c4302 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 7e534595-7eaf-49f4-b457-9f37bc59012b] Start _get_guest_xml network_info=[{"id": "d4d7b894-8aba-454c-b803-ec2bf8b28f06", "address": "fa:16:3e:60:42:1c", "network": {"id": "1801db1c-315e-4bdf-b73b-132a38bf41b8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1254756052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62572ce8ae524b55950532fd89729b71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4d7b894-8a", "ovs_interfaceid": "d4d7b894-8aba-454c-b803-ec2bf8b28f06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T00:03:24Z,direct_url=<?>,disk_format='qcow2',id=bff0d8a1-739e-4c4d-9efa-b73ba7b76d01,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e56bbf444fd34c348475c73673611447',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T00:03:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'size': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': 'bff0d8a1-739e-4c4d-9efa-b73ba7b76d01'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75165) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 00:34:39 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-3e81f28f-487b-4cbc-9cea-f025a53c4302 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:34:39 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-3e81f28f-487b-4cbc-9cea-f025a53c4302 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:34:39 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-3e81f28f-487b-4cbc-9cea-f025a53c4302 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75165) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 00:34:39 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-3e81f28f-487b-4cbc-9cea-f025a53c4302 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] CPU controller missing on host. {{(pid=75165) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 00:34:39 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-3e81f28f-487b-4cbc-9cea-f025a53c4302 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75165) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 00:34:39 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-3e81f28f-487b-4cbc-9cea-f025a53c4302 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] CPU controller found on host. {{(pid=75165) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 00:34:39 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-3e81f28f-487b-4cbc-9cea-f025a53c4302 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75165) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 00:34:39 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-3e81f28f-487b-4cbc-9cea-f025a53c4302 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T00:03:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T00:03:24Z,direct_url=<?>,disk_format='qcow2',id=bff0d8a1-739e-4c4d-9efa-b73ba7b76d01,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e56bbf444fd34c348475c73673611447',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T00:03:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 00:34:39 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-3e81f28f-487b-4cbc-9cea-f025a53c4302 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Flavor limits 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 00:34:39 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-3e81f28f-487b-4cbc-9cea-f025a53c4302 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Image limits 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 00:34:39 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-3e81f28f-487b-4cbc-9cea-f025a53c4302 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Flavor pref 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 00:34:39 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-3e81f28f-487b-4cbc-9cea-f025a53c4302 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Image pref 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 00:34:39 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-3e81f28f-487b-4cbc-9cea-f025a53c4302 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 00:34:39 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-3e81f28f-487b-4cbc-9cea-f025a53c4302 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 00:34:39 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-3e81f28f-487b-4cbc-9cea-f025a53c4302 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75165) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 00:34:39 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-3e81f28f-487b-4cbc-9cea-f025a53c4302 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Got 1 possible topologies {{(pid=75165) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 00:34:39 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-3e81f28f-487b-4cbc-9cea-f025a53c4302 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 00:34:39 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-3e81f28f-487b-4cbc-9cea-f025a53c4302 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 00:34:39 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-3e81f28f-487b-4cbc-9cea-f025a53c4302 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:34:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-784452706',display_name='tempest-AttachVolumeNegativeTest-server-784452706',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-784452706',id=38,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKtMw824Z7EgDd4R1W552g/7i/rLghgv6DuwexHTNlW2g4XWzRvcvbEZvkCl7fiGz0Ti1+2adb9TRidk5JnBlnk3pSHNw97muv+HqsgJx/YFZrIJFKFjgXF2fJtC9akVoA==',key_name='tempest-keypair-1045016299',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='62572ce8ae524b55950532fd89729b71',ramdisk_id='',reservation_id='r-xl0z7ws5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-988376295',owner_user_name='tempest-AttachVolumeNegativeTest-988376295-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T00:34:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='041ebe2732c341129d6813549653cab3',uuid=7e534595-7eaf-49f4-b457-9f37bc59012b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d4d7b894-8aba-454c-b803-ec2bf8b28f06", "address": "fa:16:3e:60:42:1c", "network": {"id": "1801db1c-315e-4bdf-b73b-132a38bf41b8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1254756052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62572ce8ae524b55950532fd89729b71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4d7b894-8a", "ovs_interfaceid": "d4d7b894-8aba-454c-b803-ec2bf8b28f06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75165) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 00:34:39 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-3e81f28f-487b-4cbc-9cea-f025a53c4302 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Converting VIF {"id": "d4d7b894-8aba-454c-b803-ec2bf8b28f06", "address": "fa:16:3e:60:42:1c", "network": {"id": "1801db1c-315e-4bdf-b73b-132a38bf41b8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1254756052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62572ce8ae524b55950532fd89729b71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4d7b894-8a", "ovs_interfaceid": "d4d7b894-8aba-454c-b803-ec2bf8b28f06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:34:39 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-3e81f28f-487b-4cbc-9cea-f025a53c4302 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:42:1c,bridge_name='br-int',has_traffic_filtering=True,id=d4d7b894-8aba-454c-b803-ec2bf8b28f06,network=Network(1801db1c-315e-4bdf-b73b-132a38bf41b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4d7b894-8a') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:34:39 user nova-compute[75165]: DEBUG nova.objects.instance [None req-3e81f28f-487b-4cbc-9cea-f025a53c4302 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Lazy-loading 'pci_devices' on Instance uuid 7e534595-7eaf-49f4-b457-9f37bc59012b {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:34:39 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-3e81f28f-487b-4cbc-9cea-f025a53c4302 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 7e534595-7eaf-49f4-b457-9f37bc59012b] End _get_guest_xml xml=<domain type="kvm">
Oct 26 00:34:39 user nova-compute[75165]:   <uuid>7e534595-7eaf-49f4-b457-9f37bc59012b</uuid>
Oct 26 00:34:39 user nova-compute[75165]:   <name>instance-00000026</name>
Oct 26 00:34:39 user nova-compute[75165]:   <memory>524288</memory>
Oct 26 00:34:39 user nova-compute[75165]:   <vcpu>1</vcpu>
Oct 26 00:34:39 user nova-compute[75165]:   <metadata>
Oct 26 00:34:39 user nova-compute[75165]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 00:34:39 user nova-compute[75165]:       <nova:package version="0.0.0"/>
Oct 26 00:34:39 user nova-compute[75165]:       <nova:name>tempest-AttachVolumeNegativeTest-server-784452706</nova:name>
Oct 26 00:34:39 user nova-compute[75165]:       <nova:creationTime>2023-10-26 00:34:39</nova:creationTime>
Oct 26 00:34:39 user nova-compute[75165]:       <nova:flavor name="m1.tiny">
Oct 26 00:34:39 user nova-compute[75165]:         <nova:memory>512</nova:memory>
Oct 26 00:34:39 user nova-compute[75165]:         <nova:disk>1</nova:disk>
Oct 26 00:34:39 user nova-compute[75165]:         <nova:swap>0</nova:swap>
Oct 26 00:34:39 user nova-compute[75165]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 00:34:39 user nova-compute[75165]:         <nova:vcpus>1</nova:vcpus>
Oct 26 00:34:39 user nova-compute[75165]:       </nova:flavor>
Oct 26 00:34:39 user nova-compute[75165]:       <nova:owner>
Oct 26 00:34:39 user nova-compute[75165]:         <nova:user uuid="041ebe2732c341129d6813549653cab3">tempest-AttachVolumeNegativeTest-988376295-project-member</nova:user>
Oct 26 00:34:39 user nova-compute[75165]:         <nova:project uuid="62572ce8ae524b55950532fd89729b71">tempest-AttachVolumeNegativeTest-988376295</nova:project>
Oct 26 00:34:39 user nova-compute[75165]:       </nova:owner>
Oct 26 00:34:39 user nova-compute[75165]:       <nova:root type="image" uuid="bff0d8a1-739e-4c4d-9efa-b73ba7b76d01"/>
Oct 26 00:34:39 user nova-compute[75165]:       <nova:ports>
Oct 26 00:34:39 user nova-compute[75165]:         <nova:port uuid="d4d7b894-8aba-454c-b803-ec2bf8b28f06">
Oct 26 00:34:39 user nova-compute[75165]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 26 00:34:39 user nova-compute[75165]:         </nova:port>
Oct 26 00:34:39 user nova-compute[75165]:       </nova:ports>
Oct 26 00:34:39 user nova-compute[75165]:     </nova:instance>
Oct 26 00:34:39 user nova-compute[75165]:   </metadata>
Oct 26 00:34:39 user nova-compute[75165]:   <sysinfo type="smbios">
Oct 26 00:34:39 user nova-compute[75165]:     <system>
Oct 26 00:34:39 user nova-compute[75165]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 00:34:39 user nova-compute[75165]:       <entry name="product">OpenStack Nova</entry>
Oct 26 00:34:39 user nova-compute[75165]:       <entry name="version">0.0.0</entry>
Oct 26 00:34:39 user nova-compute[75165]:       <entry name="serial">7e534595-7eaf-49f4-b457-9f37bc59012b</entry>
Oct 26 00:34:39 user nova-compute[75165]:       <entry name="uuid">7e534595-7eaf-49f4-b457-9f37bc59012b</entry>
Oct 26 00:34:39 user nova-compute[75165]:       <entry name="family">Virtual Machine</entry>
Oct 26 00:34:39 user nova-compute[75165]:     </system>
Oct 26 00:34:39 user nova-compute[75165]:   </sysinfo>
Oct 26 00:34:39 user nova-compute[75165]:   <os>
Oct 26 00:34:39 user nova-compute[75165]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 00:34:39 user nova-compute[75165]:     <boot dev="hd"/>
Oct 26 00:34:39 user nova-compute[75165]:     <smbios mode="sysinfo"/>
Oct 26 00:34:39 user nova-compute[75165]:   </os>
Oct 26 00:34:39 user nova-compute[75165]:   <features>
Oct 26 00:34:39 user nova-compute[75165]:     <acpi/>
Oct 26 00:34:39 user nova-compute[75165]:     <apic/>
Oct 26 00:34:39 user nova-compute[75165]:     <vmcoreinfo/>
Oct 26 00:34:39 user nova-compute[75165]:   </features>
Oct 26 00:34:39 user nova-compute[75165]:   <clock offset="utc">
Oct 26 00:34:39 user nova-compute[75165]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 00:34:39 user nova-compute[75165]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 00:34:39 user nova-compute[75165]:     <timer name="hpet" present="no"/>
Oct 26 00:34:39 user nova-compute[75165]:   </clock>
Oct 26 00:34:39 user nova-compute[75165]:   <cpu mode="custom" match="exact">
Oct 26 00:34:39 user nova-compute[75165]:     <model>Nehalem</model>
Oct 26 00:34:39 user nova-compute[75165]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 00:34:39 user nova-compute[75165]:   </cpu>
Oct 26 00:34:39 user nova-compute[75165]:   <devices>
Oct 26 00:34:39 user nova-compute[75165]:     <disk type="file" device="disk">
Oct 26 00:34:39 user nova-compute[75165]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 00:34:39 user nova-compute[75165]:       <source file="/opt/stack/data/nova/instances/7e534595-7eaf-49f4-b457-9f37bc59012b/disk"/>
Oct 26 00:34:39 user nova-compute[75165]:       <target dev="vda" bus="virtio"/>
Oct 26 00:34:39 user nova-compute[75165]:     </disk>
Oct 26 00:34:39 user nova-compute[75165]:     <interface type="ethernet">
Oct 26 00:34:39 user nova-compute[75165]:       <mac address="fa:16:3e:60:42:1c"/>
Oct 26 00:34:39 user nova-compute[75165]:       <model type="virtio"/>
Oct 26 00:34:39 user nova-compute[75165]:       <mtu size="1442"/>
Oct 26 00:34:39 user nova-compute[75165]:       <target dev="tapd4d7b894-8a"/>
Oct 26 00:34:39 user nova-compute[75165]:     </interface>
Oct 26 00:34:39 user nova-compute[75165]:     <serial type="pty">
Oct 26 00:34:39 user nova-compute[75165]:       <log file="/opt/stack/data/nova/instances/7e534595-7eaf-49f4-b457-9f37bc59012b/console.log" append="off"/>
Oct 26 00:34:39 user nova-compute[75165]:     </serial>
Oct 26 00:34:39 user nova-compute[75165]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 00:34:39 user nova-compute[75165]:     <video>
Oct 26 00:34:39 user nova-compute[75165]:       <model type="virtio"/>
Oct 26 00:34:39 user nova-compute[75165]:     </video>
Oct 26 00:34:39 user nova-compute[75165]:     <rng model="virtio">
Oct 26 00:34:39 user nova-compute[75165]:       <backend model="random">/dev/urandom</backend>
Oct 26 00:34:39 user nova-compute[75165]:     </rng>
Oct 26 00:34:39 user nova-compute[75165]:     <controller type="usb" index="0" model="none"/>
Oct 26 00:34:39 user nova-compute[75165]:     <memballoon model="virtio">
Oct 26 00:34:39 user nova-compute[75165]:       <stats period="10"/>
Oct 26 00:34:39 user nova-compute[75165]:     </memballoon>
Oct 26 00:34:39 user nova-compute[75165]:   </devices>
Oct 26 00:34:39 user nova-compute[75165]: </domain>
Oct 26 00:34:39 user nova-compute[75165]:  {{(pid=75165) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 00:34:39 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-3e81f28f-487b-4cbc-9cea-f025a53c4302 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:34:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-784452706',display_name='tempest-AttachVolumeNegativeTest-server-784452706',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-784452706',id=38,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKtMw824Z7EgDd4R1W552g/7i/rLghgv6DuwexHTNlW2g4XWzRvcvbEZvkCl7fiGz0Ti1+2adb9TRidk5JnBlnk3pSHNw97muv+HqsgJx/YFZrIJFKFjgXF2fJtC9akVoA==',key_name='tempest-keypair-1045016299',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='62572ce8ae524b55950532fd89729b71',ramdisk_id='',reservation_id='r-xl0z7ws5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-988376295',owner_user_name='tempest-AttachVolumeNegativeTest-988376295-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T00:34:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='041ebe2732c341129d6813549653cab3',uuid=7e534595-7eaf-49f4-b457-9f37bc59012b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d4d7b894-8aba-454c-b803-ec2bf8b28f06", "address": "fa:16:3e:60:42:1c", "network": {"id": "1801db1c-315e-4bdf-b73b-132a38bf41b8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1254756052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62572ce8ae524b55950532fd89729b71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4d7b894-8a", "ovs_interfaceid": "d4d7b894-8aba-454c-b803-ec2bf8b28f06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 00:34:39 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-3e81f28f-487b-4cbc-9cea-f025a53c4302 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Converting VIF {"id": "d4d7b894-8aba-454c-b803-ec2bf8b28f06", "address": "fa:16:3e:60:42:1c", "network": {"id": "1801db1c-315e-4bdf-b73b-132a38bf41b8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1254756052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62572ce8ae524b55950532fd89729b71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4d7b894-8a", "ovs_interfaceid": "d4d7b894-8aba-454c-b803-ec2bf8b28f06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:34:39 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-3e81f28f-487b-4cbc-9cea-f025a53c4302 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:42:1c,bridge_name='br-int',has_traffic_filtering=True,id=d4d7b894-8aba-454c-b803-ec2bf8b28f06,network=Network(1801db1c-315e-4bdf-b73b-132a38bf41b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4d7b894-8a') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:34:39 user nova-compute[75165]: DEBUG os_vif [None req-3e81f28f-487b-4cbc-9cea-f025a53c4302 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:42:1c,bridge_name='br-int',has_traffic_filtering=True,id=d4d7b894-8aba-454c-b803-ec2bf8b28f06,network=Network(1801db1c-315e-4bdf-b73b-132a38bf41b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4d7b894-8a') {{(pid=75165) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 00:34:39 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:34:39 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:34:39 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 00:34:39 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:34:39 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b10707da-8927-54a0-8aee-7cc33ddd1ee5', '_type': 'linux-noop'}}, row=False) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:34:39 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:34:39 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:34:39 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:34:39 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd4d7b894-8a, may_exist=True, interface_attrs={}) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:34:39 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd4d7b894-8a, col_values=(('qos', UUID('ab0e12fd-4072-4182-a0f4-defc1542e640')),), if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:34:39 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd4d7b894-8a, col_values=(('external_ids', {'iface-id': 'd4d7b894-8aba-454c-b803-ec2bf8b28f06', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:60:42:1c', 'vm-uuid': '7e534595-7eaf-49f4-b457-9f37bc59012b'}),), if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:34:39 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:34:39 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:34:39 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:34:39 user nova-compute[75165]: INFO os_vif [None req-3e81f28f-487b-4cbc-9cea-f025a53c4302 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:42:1c,bridge_name='br-int',has_traffic_filtering=True,id=d4d7b894-8aba-454c-b803-ec2bf8b28f06,network=Network(1801db1c-315e-4bdf-b73b-132a38bf41b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4d7b894-8a')
Oct 26 00:34:39 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-3e81f28f-487b-4cbc-9cea-f025a53c4302 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] No BDM found with device name vda, not building metadata. {{(pid=75165) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 00:34:39 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-3e81f28f-487b-4cbc-9cea-f025a53c4302 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] No VIF found with MAC fa:16:3e:60:42:1c, not building metadata {{(pid=75165) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 00:34:39 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-9189150f-b8f0-410b-9d87-39e10c32c56d tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Acquiring lock "fe2984ce-8958-4049-8af7-496b313b26c8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:34:39 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-9189150f-b8f0-410b-9d87-39e10c32c56d tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Lock "fe2984ce-8958-4049-8af7-496b313b26c8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:34:39 user nova-compute[75165]: INFO nova.compute.manager [None req-9189150f-b8f0-410b-9d87-39e10c32c56d tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] [instance: fe2984ce-8958-4049-8af7-496b313b26c8] Detaching volume 00b01051-74e4-43e2-aee1-42f2e5f94fe5
Oct 26 00:34:39 user nova-compute[75165]: INFO nova.virt.block_device [None req-9189150f-b8f0-410b-9d87-39e10c32c56d tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] [instance: fe2984ce-8958-4049-8af7-496b313b26c8] Attempting to driver detach volume 00b01051-74e4-43e2-aee1-42f2e5f94fe5 from mountpoint /dev/vdb
Oct 26 00:34:39 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-9189150f-b8f0-410b-9d87-39e10c32c56d tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Attempting to detach device vdb from instance fe2984ce-8958-4049-8af7-496b313b26c8 from the persistent domain config. {{(pid=75165) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 00:34:39 user nova-compute[75165]: DEBUG nova.virt.libvirt.guest [None req-9189150f-b8f0-410b-9d87-39e10c32c56d tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 00:34:39 user nova-compute[75165]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 00:34:39 user nova-compute[75165]:   <source dev="/dev/sde"/>
Oct 26 00:34:39 user nova-compute[75165]:   <target dev="vdb" bus="virtio"/>
Oct 26 00:34:39 user nova-compute[75165]:   <serial>00b01051-74e4-43e2-aee1-42f2e5f94fe5</serial>
Oct 26 00:34:39 user nova-compute[75165]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 00:34:39 user nova-compute[75165]: </disk>
Oct 26 00:34:39 user nova-compute[75165]:  {{(pid=75165) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 00:34:39 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-9189150f-b8f0-410b-9d87-39e10c32c56d tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Successfully detached device vdb from instance fe2984ce-8958-4049-8af7-496b313b26c8 from the persistent domain config.
Oct 26 00:34:39 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-9189150f-b8f0-410b-9d87-39e10c32c56d tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fe2984ce-8958-4049-8af7-496b313b26c8 from the live domain config. {{(pid=75165) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 00:34:39 user nova-compute[75165]: DEBUG nova.virt.libvirt.guest [None req-9189150f-b8f0-410b-9d87-39e10c32c56d tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 00:34:39 user nova-compute[75165]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 00:34:39 user nova-compute[75165]:   <source dev="/dev/sde"/>
Oct 26 00:34:39 user nova-compute[75165]:   <target dev="vdb" bus="virtio"/>
Oct 26 00:34:39 user nova-compute[75165]:   <serial>00b01051-74e4-43e2-aee1-42f2e5f94fe5</serial>
Oct 26 00:34:39 user nova-compute[75165]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 00:34:39 user nova-compute[75165]: </disk>
Oct 26 00:34:39 user nova-compute[75165]:  {{(pid=75165) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 00:34:39 user nova-compute[75165]: DEBUG nova.network.neutron [req-d55dd933-5da9-4c68-bcf8-4a66021d164a req-7cf9a4cd-a491-405d-9fc4-9d5aad99a78d service nova] [instance: 7e534595-7eaf-49f4-b457-9f37bc59012b] Updated VIF entry in instance network info cache for port d4d7b894-8aba-454c-b803-ec2bf8b28f06. {{(pid=75165) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 00:34:39 user nova-compute[75165]: DEBUG nova.network.neutron [req-d55dd933-5da9-4c68-bcf8-4a66021d164a req-7cf9a4cd-a491-405d-9fc4-9d5aad99a78d service nova] [instance: 7e534595-7eaf-49f4-b457-9f37bc59012b] Updating instance_info_cache with network_info: [{"id": "d4d7b894-8aba-454c-b803-ec2bf8b28f06", "address": "fa:16:3e:60:42:1c", "network": {"id": "1801db1c-315e-4bdf-b73b-132a38bf41b8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1254756052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62572ce8ae524b55950532fd89729b71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4d7b894-8a", "ovs_interfaceid": "d4d7b894-8aba-454c-b803-ec2bf8b28f06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:34:39 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-d55dd933-5da9-4c68-bcf8-4a66021d164a req-7cf9a4cd-a491-405d-9fc4-9d5aad99a78d service nova] Releasing lock "refresh_cache-7e534595-7eaf-49f4-b457-9f37bc59012b" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:34:39 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-9189150f-b8f0-410b-9d87-39e10c32c56d tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fe2984ce-8958-4049-8af7-496b313b26c8 {{(pid=75165) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 00:34:40 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:34:41 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:34:41 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:34:41 user nova-compute[75165]: DEBUG nova.compute.manager [req-2a63fc5d-8aae-4bfc-a1fb-4e7cc6a39aab req-c97dbe41-50b9-420f-92dd-dca13fe12f5f service nova] [instance: 7e534595-7eaf-49f4-b457-9f37bc59012b] Received event network-vif-plugged-d4d7b894-8aba-454c-b803-ec2bf8b28f06 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:34:41 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-2a63fc5d-8aae-4bfc-a1fb-4e7cc6a39aab req-c97dbe41-50b9-420f-92dd-dca13fe12f5f service nova] Acquiring lock "7e534595-7eaf-49f4-b457-9f37bc59012b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:34:41 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-2a63fc5d-8aae-4bfc-a1fb-4e7cc6a39aab req-c97dbe41-50b9-420f-92dd-dca13fe12f5f service nova] Lock "7e534595-7eaf-49f4-b457-9f37bc59012b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:34:41 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-2a63fc5d-8aae-4bfc-a1fb-4e7cc6a39aab req-c97dbe41-50b9-420f-92dd-dca13fe12f5f service nova] Lock "7e534595-7eaf-49f4-b457-9f37bc59012b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:34:41 user nova-compute[75165]: DEBUG nova.compute.manager [req-2a63fc5d-8aae-4bfc-a1fb-4e7cc6a39aab req-c97dbe41-50b9-420f-92dd-dca13fe12f5f service nova] [instance: 7e534595-7eaf-49f4-b457-9f37bc59012b] No waiting events found dispatching network-vif-plugged-d4d7b894-8aba-454c-b803-ec2bf8b28f06 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:34:41 user nova-compute[75165]: WARNING nova.compute.manager [req-2a63fc5d-8aae-4bfc-a1fb-4e7cc6a39aab req-c97dbe41-50b9-420f-92dd-dca13fe12f5f service nova] [instance: 7e534595-7eaf-49f4-b457-9f37bc59012b] Received unexpected event network-vif-plugged-d4d7b894-8aba-454c-b803-ec2bf8b28f06 for instance with vm_state building and task_state spawning.
Oct 26 00:34:41 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:34:41 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:34:41 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:34:41 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:34:43 user nova-compute[75165]: DEBUG nova.compute.manager [None req-3e81f28f-487b-4cbc-9cea-f025a53c4302 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 7e534595-7eaf-49f4-b457-9f37bc59012b] Instance event wait completed in 0 seconds for  {{(pid=75165) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 00:34:43 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-3e81f28f-487b-4cbc-9cea-f025a53c4302 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 7e534595-7eaf-49f4-b457-9f37bc59012b] Guest created on hypervisor {{(pid=75165) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 00:34:43 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: 7e534595-7eaf-49f4-b457-9f37bc59012b] Instance spawned successfully.
Oct 26 00:34:43 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-3e81f28f-487b-4cbc-9cea-f025a53c4302 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 7e534595-7eaf-49f4-b457-9f37bc59012b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 00:34:43 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-3e81f28f-487b-4cbc-9cea-f025a53c4302 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 7e534595-7eaf-49f4-b457-9f37bc59012b] Found default for hw_cdrom_bus of ide {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:34:43 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-3e81f28f-487b-4cbc-9cea-f025a53c4302 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 7e534595-7eaf-49f4-b457-9f37bc59012b] Found default for hw_disk_bus of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:34:43 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-3e81f28f-487b-4cbc-9cea-f025a53c4302 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 7e534595-7eaf-49f4-b457-9f37bc59012b] Found default for hw_input_bus of None {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:34:43 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-3e81f28f-487b-4cbc-9cea-f025a53c4302 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 7e534595-7eaf-49f4-b457-9f37bc59012b] Found default for hw_pointer_model of None {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:34:43 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-3e81f28f-487b-4cbc-9cea-f025a53c4302 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 7e534595-7eaf-49f4-b457-9f37bc59012b] Found default for hw_video_model of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:34:43 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-3e81f28f-487b-4cbc-9cea-f025a53c4302 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 7e534595-7eaf-49f4-b457-9f37bc59012b] Found default for hw_vif_model of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:34:43 user nova-compute[75165]: INFO nova.compute.manager [None req-3e81f28f-487b-4cbc-9cea-f025a53c4302 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 7e534595-7eaf-49f4-b457-9f37bc59012b] Took 5.99 seconds to spawn the instance on the hypervisor.
Oct 26 00:34:43 user nova-compute[75165]: DEBUG nova.compute.manager [None req-3e81f28f-487b-4cbc-9cea-f025a53c4302 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 7e534595-7eaf-49f4-b457-9f37bc59012b] Checking state {{(pid=75165) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 00:34:43 user nova-compute[75165]: DEBUG nova.compute.manager [req-503255d5-e6b2-4719-8630-c1a7b2681bb4 req-2e324393-e53b-477e-a68c-0ccda2748d30 service nova] [instance: 7e534595-7eaf-49f4-b457-9f37bc59012b] Received event network-vif-plugged-d4d7b894-8aba-454c-b803-ec2bf8b28f06 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:34:43 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-503255d5-e6b2-4719-8630-c1a7b2681bb4 req-2e324393-e53b-477e-a68c-0ccda2748d30 service nova] Acquiring lock "7e534595-7eaf-49f4-b457-9f37bc59012b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:34:43 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-503255d5-e6b2-4719-8630-c1a7b2681bb4 req-2e324393-e53b-477e-a68c-0ccda2748d30 service nova] Lock "7e534595-7eaf-49f4-b457-9f37bc59012b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:34:43 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-503255d5-e6b2-4719-8630-c1a7b2681bb4 req-2e324393-e53b-477e-a68c-0ccda2748d30 service nova] Lock "7e534595-7eaf-49f4-b457-9f37bc59012b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:34:43 user nova-compute[75165]: DEBUG nova.compute.manager [req-503255d5-e6b2-4719-8630-c1a7b2681bb4 req-2e324393-e53b-477e-a68c-0ccda2748d30 service nova] [instance: 7e534595-7eaf-49f4-b457-9f37bc59012b] No waiting events found dispatching network-vif-plugged-d4d7b894-8aba-454c-b803-ec2bf8b28f06 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:34:43 user nova-compute[75165]: WARNING nova.compute.manager [req-503255d5-e6b2-4719-8630-c1a7b2681bb4 req-2e324393-e53b-477e-a68c-0ccda2748d30 service nova] [instance: 7e534595-7eaf-49f4-b457-9f37bc59012b] Received unexpected event network-vif-plugged-d4d7b894-8aba-454c-b803-ec2bf8b28f06 for instance with vm_state building and task_state spawning.
Oct 26 00:34:43 user nova-compute[75165]: INFO nova.compute.manager [None req-3e81f28f-487b-4cbc-9cea-f025a53c4302 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 7e534595-7eaf-49f4-b457-9f37bc59012b] Took 6.75 seconds to build instance.
Oct 26 00:34:43 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-3e81f28f-487b-4cbc-9cea-f025a53c4302 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Lock "7e534595-7eaf-49f4-b457-9f37bc59012b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.874s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:34:44 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:34:46 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:34:47 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:34:49 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:34:49 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:34:50 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-26b54eba-142b-4913-87e0-5b33effef73e tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Acquiring lock "c396d555-70cf-4642-a0a0-485760cdf3fa" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:34:50 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-26b54eba-142b-4913-87e0-5b33effef73e tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Lock "c396d555-70cf-4642-a0a0-485760cdf3fa" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:34:50 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-26b54eba-142b-4913-87e0-5b33effef73e tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Acquiring lock "c396d555-70cf-4642-a0a0-485760cdf3fa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:34:50 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-26b54eba-142b-4913-87e0-5b33effef73e tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Lock "c396d555-70cf-4642-a0a0-485760cdf3fa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:34:50 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-26b54eba-142b-4913-87e0-5b33effef73e tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Lock "c396d555-70cf-4642-a0a0-485760cdf3fa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:34:50 user nova-compute[75165]: INFO nova.compute.manager [None req-26b54eba-142b-4913-87e0-5b33effef73e tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] [instance: c396d555-70cf-4642-a0a0-485760cdf3fa] Terminating instance
Oct 26 00:34:50 user nova-compute[75165]: DEBUG nova.compute.manager [None req-26b54eba-142b-4913-87e0-5b33effef73e tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] [instance: c396d555-70cf-4642-a0a0-485760cdf3fa] Start destroying the instance on the hypervisor. {{(pid=75165) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 00:34:50 user nova-compute[75165]: DEBUG nova.compute.manager [req-f6727b5f-692b-432c-94a1-3cd46277f6d0 req-10f48fd2-e65d-4f72-bbd9-37f1be7b4465 service nova] [instance: c396d555-70cf-4642-a0a0-485760cdf3fa] Received event network-changed-500c8c79-cf9c-46ef-a5d1-273f387e410a {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:34:50 user nova-compute[75165]: DEBUG nova.compute.manager [req-f6727b5f-692b-432c-94a1-3cd46277f6d0 req-10f48fd2-e65d-4f72-bbd9-37f1be7b4465 service nova] [instance: c396d555-70cf-4642-a0a0-485760cdf3fa] Refreshing instance network info cache due to event network-changed-500c8c79-cf9c-46ef-a5d1-273f387e410a. {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 00:34:50 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-f6727b5f-692b-432c-94a1-3cd46277f6d0 req-10f48fd2-e65d-4f72-bbd9-37f1be7b4465 service nova] Acquiring lock "refresh_cache-c396d555-70cf-4642-a0a0-485760cdf3fa" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:34:50 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-f6727b5f-692b-432c-94a1-3cd46277f6d0 req-10f48fd2-e65d-4f72-bbd9-37f1be7b4465 service nova] Acquired lock "refresh_cache-c396d555-70cf-4642-a0a0-485760cdf3fa" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:34:50 user nova-compute[75165]: DEBUG nova.network.neutron [req-f6727b5f-692b-432c-94a1-3cd46277f6d0 req-10f48fd2-e65d-4f72-bbd9-37f1be7b4465 service nova] [instance: c396d555-70cf-4642-a0a0-485760cdf3fa] Refreshing network info cache for port 500c8c79-cf9c-46ef-a5d1-273f387e410a {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 00:34:50 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:34:50 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:34:50 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:34:50 user nova-compute[75165]: DEBUG nova.network.neutron [req-f6727b5f-692b-432c-94a1-3cd46277f6d0 req-10f48fd2-e65d-4f72-bbd9-37f1be7b4465 service nova] [instance: c396d555-70cf-4642-a0a0-485760cdf3fa] Updated VIF entry in instance network info cache for port 500c8c79-cf9c-46ef-a5d1-273f387e410a. {{(pid=75165) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 00:34:50 user nova-compute[75165]: DEBUG nova.network.neutron [req-f6727b5f-692b-432c-94a1-3cd46277f6d0 req-10f48fd2-e65d-4f72-bbd9-37f1be7b4465 service nova] [instance: c396d555-70cf-4642-a0a0-485760cdf3fa] Updating instance_info_cache with network_info: [{"id": "500c8c79-cf9c-46ef-a5d1-273f387e410a", "address": "fa:16:3e:89:15:98", "network": {"id": "7f96025b-485f-4ba3-9f45-708c09822ffa", "bridge": "br-int", "label": "tempest-TestShelveInstance-363925751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f000be4e226e4e3db3c0832bbf04cd29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap500c8c79-cf", "ovs_interfaceid": "500c8c79-cf9c-46ef-a5d1-273f387e410a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:34:50 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-f6727b5f-692b-432c-94a1-3cd46277f6d0 req-10f48fd2-e65d-4f72-bbd9-37f1be7b4465 service nova] Releasing lock "refresh_cache-c396d555-70cf-4642-a0a0-485760cdf3fa" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:34:50 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:34:50 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:34:51 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: c396d555-70cf-4642-a0a0-485760cdf3fa] Instance destroyed successfully.
Oct 26 00:34:51 user nova-compute[75165]: DEBUG nova.objects.instance [None req-26b54eba-142b-4913-87e0-5b33effef73e tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Lazy-loading 'resources' on Instance uuid c396d555-70cf-4642-a0a0-485760cdf3fa {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:34:51 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-26b54eba-142b-4913-87e0-5b33effef73e tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-26T00:29:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1147251319',display_name='tempest-TestShelveInstance-server-1147251319',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1147251319',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI1GphBq+tk5lRmbelpBK0KpqDkFZnosMfdxY4BqIo+7ZOlBcMsm+STwRow/vl0wWn7mhh5tvgBHLuRaIRxMFlso5lFS/bf8FEG/Q81BXIGG9aV/g3SgBEoP3RMfJ8OM0g==',key_name='tempest-TestShelveInstance-2132263804',keypairs=<?>,launch_index=0,launched_at=2023-10-26T00:33:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f000be4e226e4e3db3c0832bbf04cd29',ramdisk_id='',reservation_id='r-sg6zubxf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-323693311',owner_user_name='tempest-TestShelveInstance-323693311-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T00:33:24Z,user_data=None,user_id='2aa1bebf8931436d80d792651953a57b',uuid=c396d555-70cf-4642-a0a0-485760cdf3fa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "500c8c79-cf9c-46ef-a5d1-273f387e410a", "address": "fa:16:3e:89:15:98", "network": {"id": "7f96025b-485f-4ba3-9f45-708c09822ffa", "bridge": "br-int", "label": "tempest-TestShelveInstance-363925751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f000be4e226e4e3db3c0832bbf04cd29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap500c8c79-cf", "ovs_interfaceid": "500c8c79-cf9c-46ef-a5d1-273f387e410a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 00:34:51 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-26b54eba-142b-4913-87e0-5b33effef73e tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Converting VIF {"id": "500c8c79-cf9c-46ef-a5d1-273f387e410a", "address": "fa:16:3e:89:15:98", "network": {"id": "7f96025b-485f-4ba3-9f45-708c09822ffa", "bridge": "br-int", "label": "tempest-TestShelveInstance-363925751-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f000be4e226e4e3db3c0832bbf04cd29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap500c8c79-cf", "ovs_interfaceid": "500c8c79-cf9c-46ef-a5d1-273f387e410a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:34:51 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-26b54eba-142b-4913-87e0-5b33effef73e tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:15:98,bridge_name='br-int',has_traffic_filtering=True,id=500c8c79-cf9c-46ef-a5d1-273f387e410a,network=Network(7f96025b-485f-4ba3-9f45-708c09822ffa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap500c8c79-cf') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:34:51 user nova-compute[75165]: DEBUG os_vif [None req-26b54eba-142b-4913-87e0-5b33effef73e tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:15:98,bridge_name='br-int',has_traffic_filtering=True,id=500c8c79-cf9c-46ef-a5d1-273f387e410a,network=Network(7f96025b-485f-4ba3-9f45-708c09822ffa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap500c8c79-cf') {{(pid=75165) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 00:34:51 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:34:51 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap500c8c79-cf, bridge=br-int, if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:34:51 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:34:51 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:34:51 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:34:51 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=65397097-1806-4e90-94f9-23bc48a1c1c4) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:34:51 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:34:51 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:34:51 user nova-compute[75165]: INFO os_vif [None req-26b54eba-142b-4913-87e0-5b33effef73e tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:15:98,bridge_name='br-int',has_traffic_filtering=True,id=500c8c79-cf9c-46ef-a5d1-273f387e410a,network=Network(7f96025b-485f-4ba3-9f45-708c09822ffa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap500c8c79-cf')
Oct 26 00:34:51 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26b54eba-142b-4913-87e0-5b33effef73e tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] [instance: c396d555-70cf-4642-a0a0-485760cdf3fa] calling os-brick to detach iSCSI Volume {{(pid=75165) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 00:34:51 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-26b54eba-142b-4913-87e0-5b33effef73e tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8bf8160e50>, {'target_iqn': 'iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LIXPagZW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:34:51 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-26b54eba-142b-4913-87e0-5b33effef73e tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:34:51 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-26b54eba-142b-4913-87e0-5b33effef73e tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:34:51 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-26b54eba-142b-4913-87e0-5b33effef73e tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:34:51 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:34:51 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:34:51 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[41f75385-995c-46d9-ad84-450c5daabd49]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:00b01051-74e4-43e2-aee1-42f2e5f94fe5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:34:51 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-26b54eba-142b-4913-87e0-5b33effef73e tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 00:34:51 user nova-compute[75165]: No targets found.
Oct 26 00:34:51 user nova-compute[75165]: iSNS:
Oct 26 00:34:51 user nova-compute[75165]: No targets found.
Oct 26 00:34:51 user nova-compute[75165]: STATIC:
Oct 26 00:34:51 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8
Oct 26 00:34:51 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:34:51 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:34:51 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7
Oct 26 00:34:51 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:34:51 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:34:51 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:00b01051-74e4-43e2-aee1-42f2e5f94fe5
Oct 26 00:34:51 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:34:51 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:34:51 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795
Oct 26 00:34:51 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:34:51 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:34:51 user nova-compute[75165]: FIRMWARE:
Oct 26 00:34:51 user nova-compute[75165]: No targets found.
Oct 26 00:34:51 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:34:51 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-26b54eba-142b-4913-87e0-5b33effef73e tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 00:34:51 user nova-compute[75165]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 00:34:51 user nova-compute[75165]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75165) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 00:34:51 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-26b54eba-142b-4913-87e0-5b33effef73e tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7', 0)] {{(pid=75165) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 00:34:51 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:34:51 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:34:51 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fbf6629-029c-4c3d-8944-5588de4a1351]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00b01051-74e4-43e2-aee1-42f2e5f94fe5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:34:51 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:34:51 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:34:51 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[18907436-983d-4068-bfd0-f89ba1213247]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00b01051-74e4-43e2-aee1-42f2e5f94fe5 (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:34:51 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-26b54eba-142b-4913-87e0-5b33effef73e tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)
Oct 26 00:34:51 user nova-compute[75165]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8 (non-flash)
Oct 26 00:34:51 user nova-compute[75165]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7 (non-flash)
Oct 26 00:34:51 user nova-compute[75165]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00b01051-74e4-43e2-aee1-42f2e5f94fe5 (non-flash)
Oct 26 00:34:51 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:34:51 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-26b54eba-142b-4913-87e0-5b33effef73e tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)
Oct 26 00:34:51 user nova-compute[75165]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8 (non-flash)
Oct 26 00:34:51 user nova-compute[75165]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7 (non-flash)
Oct 26 00:34:51 user nova-compute[75165]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00b01051-74e4-43e2-aee1-42f2e5f94fe5 (non-flash)
Oct 26 00:34:51 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:34:51 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-26b54eba-142b-4913-87e0-5b33effef73e tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8be034bac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7'): ({'sdd'}, set())}) {{(pid=75165) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 00:34:51 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-26b54eba-142b-4913-87e0-5b33effef73e tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Removing single pathed devices sdd {{(pid=75165) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 00:34:51 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:34:51 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:34:51 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7cb208f-56f2-4c4f-a243-66547d71c916]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:34:51 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:34:51 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:34:51 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f0196bd-4f04-486b-99f3-ebcbbf1d8d08]: (4, ('ok\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:34:51 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-26b54eba-142b-4913-87e0-5b33effef73e tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Flushing IO for device /dev/sdd {{(pid=75165) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 00:34:51 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:34:51 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:34:51 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7c9c5e6-f804-4ed9-93ab-18f0472f8bd6]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:34:51 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-26b54eba-142b-4913-87e0-5b33effef73e tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75165) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 00:34:51 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:34:51 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.050s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:34:51 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dea42b4-8083-4567-a4b2-7485738a2279]: (4, ('1', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:34:51 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-26b54eba-142b-4913-87e0-5b33effef73e tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75165) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 00:34:51 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-26b54eba-142b-4913-87e0-5b33effef73e tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] SCSI volumes sdd have been removed. {{(pid=75165) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 00:34:51 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-26b54eba-142b-4913-87e0-5b33effef73e tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7')] {{(pid=75165) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 00:34:51 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:34:51 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:34:51 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdd94277-0d6f-47a5-b84f-6c912836d329]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:34:51 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-26b54eba-142b-4913-87e0-5b33effef73e tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:34:51 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7 -p 172.16.0.220:3260 --logout {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:34:51 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.107s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:34:51 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c183841-2283-4279-a23f-9cc1f9397166]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:34:51 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-26b54eba-142b-4913-87e0-5b33effef73e tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7, portal: 172.16.0.220,3260]
Oct 26 00:34:51 user nova-compute[75165]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7, portal: 172.16.0.220,3260] successful.
Oct 26 00:34:51 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:34:51 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7 -p 172.16.0.220:3260 --op delete {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:34:51 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9894622e-4af8-47e2-82c6-3f4e301caeb7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:34:51 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f8e8d0a-6b33-4e7d-87a6-0cdefb0595d1]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:34:51 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-26b54eba-142b-4913-87e0-5b33effef73e tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:34:51 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-26b54eba-142b-4913-87e0-5b33effef73e tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.418s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:34:51 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-26b54eba-142b-4913-87e0-5b33effef73e tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] <== disconnect_volume: return (421ms) None {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:34:51 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26b54eba-142b-4913-87e0-5b33effef73e tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] [instance: c396d555-70cf-4642-a0a0-485760cdf3fa] Disconnected iSCSI Volume {{(pid=75165) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 00:34:51 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-26b54eba-142b-4913-87e0-5b33effef73e tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] [instance: c396d555-70cf-4642-a0a0-485760cdf3fa] Deleting instance files /opt/stack/data/nova/instances/c396d555-70cf-4642-a0a0-485760cdf3fa_del
Oct 26 00:34:51 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-26b54eba-142b-4913-87e0-5b33effef73e tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] [instance: c396d555-70cf-4642-a0a0-485760cdf3fa] Deletion of /opt/stack/data/nova/instances/c396d555-70cf-4642-a0a0-485760cdf3fa_del complete
Oct 26 00:34:51 user nova-compute[75165]: INFO nova.compute.manager [None req-26b54eba-142b-4913-87e0-5b33effef73e tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] [instance: c396d555-70cf-4642-a0a0-485760cdf3fa] Took 1.38 seconds to destroy the instance on the hypervisor.
Oct 26 00:34:51 user nova-compute[75165]: DEBUG oslo.service.loopingcall [None req-26b54eba-142b-4913-87e0-5b33effef73e tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75165) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 00:34:51 user nova-compute[75165]: DEBUG nova.compute.manager [-] [instance: c396d555-70cf-4642-a0a0-485760cdf3fa] Deallocating network for instance {{(pid=75165) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 00:34:51 user nova-compute[75165]: DEBUG nova.network.neutron [-] [instance: c396d555-70cf-4642-a0a0-485760cdf3fa] deallocate_for_instance() {{(pid=75165) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 00:34:51 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:34:52 user nova-compute[75165]: DEBUG nova.network.neutron [-] [instance: c396d555-70cf-4642-a0a0-485760cdf3fa] Updating instance_info_cache with network_info: [] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:34:52 user nova-compute[75165]: INFO nova.compute.manager [-] [instance: c396d555-70cf-4642-a0a0-485760cdf3fa] Took 0.54 seconds to deallocate network for instance.
Oct 26 00:34:52 user nova-compute[75165]: DEBUG nova.compute.manager [req-aa3b73f7-433b-4c99-a440-1d7082c58f09 req-ffa588c2-33a5-437f-8641-80d13dc896c2 service nova] [instance: c396d555-70cf-4642-a0a0-485760cdf3fa] Received event network-vif-deleted-500c8c79-cf9c-46ef-a5d1-273f387e410a {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:34:52 user nova-compute[75165]: DEBUG nova.compute.manager [req-3aaed73e-5727-421b-8160-fde603cc6eea req-e4d329b5-66c1-4064-8aa5-79f7d17e9efa service nova] [instance: c396d555-70cf-4642-a0a0-485760cdf3fa] Received event network-vif-unplugged-500c8c79-cf9c-46ef-a5d1-273f387e410a {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:34:52 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-3aaed73e-5727-421b-8160-fde603cc6eea req-e4d329b5-66c1-4064-8aa5-79f7d17e9efa service nova] Acquiring lock "c396d555-70cf-4642-a0a0-485760cdf3fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:34:52 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-3aaed73e-5727-421b-8160-fde603cc6eea req-e4d329b5-66c1-4064-8aa5-79f7d17e9efa service nova] Lock "c396d555-70cf-4642-a0a0-485760cdf3fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:34:52 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-3aaed73e-5727-421b-8160-fde603cc6eea req-e4d329b5-66c1-4064-8aa5-79f7d17e9efa service nova] Lock "c396d555-70cf-4642-a0a0-485760cdf3fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:34:52 user nova-compute[75165]: DEBUG nova.compute.manager [req-3aaed73e-5727-421b-8160-fde603cc6eea req-e4d329b5-66c1-4064-8aa5-79f7d17e9efa service nova] [instance: c396d555-70cf-4642-a0a0-485760cdf3fa] No waiting events found dispatching network-vif-unplugged-500c8c79-cf9c-46ef-a5d1-273f387e410a {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:34:52 user nova-compute[75165]: DEBUG nova.compute.manager [req-3aaed73e-5727-421b-8160-fde603cc6eea req-e4d329b5-66c1-4064-8aa5-79f7d17e9efa service nova] [instance: c396d555-70cf-4642-a0a0-485760cdf3fa] Received event network-vif-unplugged-500c8c79-cf9c-46ef-a5d1-273f387e410a for instance with task_state deleting. {{(pid=75165) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 00:34:52 user nova-compute[75165]: DEBUG nova.compute.manager [req-3aaed73e-5727-421b-8160-fde603cc6eea req-e4d329b5-66c1-4064-8aa5-79f7d17e9efa service nova] [instance: c396d555-70cf-4642-a0a0-485760cdf3fa] Received event network-vif-plugged-500c8c79-cf9c-46ef-a5d1-273f387e410a {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:34:52 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-3aaed73e-5727-421b-8160-fde603cc6eea req-e4d329b5-66c1-4064-8aa5-79f7d17e9efa service nova] Acquiring lock "c396d555-70cf-4642-a0a0-485760cdf3fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:34:52 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-3aaed73e-5727-421b-8160-fde603cc6eea req-e4d329b5-66c1-4064-8aa5-79f7d17e9efa service nova] Lock "c396d555-70cf-4642-a0a0-485760cdf3fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:34:52 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-3aaed73e-5727-421b-8160-fde603cc6eea req-e4d329b5-66c1-4064-8aa5-79f7d17e9efa service nova] Lock "c396d555-70cf-4642-a0a0-485760cdf3fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:34:52 user nova-compute[75165]: DEBUG nova.compute.manager [req-3aaed73e-5727-421b-8160-fde603cc6eea req-e4d329b5-66c1-4064-8aa5-79f7d17e9efa service nova] [instance: c396d555-70cf-4642-a0a0-485760cdf3fa] No waiting events found dispatching network-vif-plugged-500c8c79-cf9c-46ef-a5d1-273f387e410a {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:34:52 user nova-compute[75165]: WARNING nova.compute.manager [req-3aaed73e-5727-421b-8160-fde603cc6eea req-e4d329b5-66c1-4064-8aa5-79f7d17e9efa service nova] [instance: c396d555-70cf-4642-a0a0-485760cdf3fa] Received unexpected event network-vif-plugged-500c8c79-cf9c-46ef-a5d1-273f387e410a for instance with vm_state active and task_state deleting.
Oct 26 00:34:53 user nova-compute[75165]: INFO nova.compute.manager [None req-26b54eba-142b-4913-87e0-5b33effef73e tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] [instance: c396d555-70cf-4642-a0a0-485760cdf3fa] Took 0.99 seconds to detach 1 volumes for instance.
Oct 26 00:34:53 user nova-compute[75165]: DEBUG nova.compute.manager [None req-26b54eba-142b-4913-87e0-5b33effef73e tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] [instance: c396d555-70cf-4642-a0a0-485760cdf3fa] Deleting volume: 9894622e-4af8-47e2-82c6-3f4e301caeb7 {{(pid=75165) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 26 00:34:53 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-26b54eba-142b-4913-87e0-5b33effef73e tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:34:53 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-26b54eba-142b-4913-87e0-5b33effef73e tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:34:53 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-26b54eba-142b-4913-87e0-5b33effef73e tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:34:53 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-26b54eba-142b-4913-87e0-5b33effef73e tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:34:53 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-26b54eba-142b-4913-87e0-5b33effef73e tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.361s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:34:53 user nova-compute[75165]: INFO nova.scheduler.client.report [None req-26b54eba-142b-4913-87e0-5b33effef73e tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Deleted allocations for instance c396d555-70cf-4642-a0a0-485760cdf3fa
Oct 26 00:34:53 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-26b54eba-142b-4913-87e0-5b33effef73e tempest-TestShelveInstance-323693311 tempest-TestShelveInstance-323693311-project-member] Lock "c396d555-70cf-4642-a0a0-485760cdf3fa" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.569s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:34:53 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:34:56 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:34:56 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:34:56 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:34:57 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:34:59 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-966fb094-f52e-4c67-a3f3-1d3be7cbcf9f tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Acquiring lock "6ae9fe6f-eb17-44f5-89e4-fff5e3451336" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:34:59 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-966fb094-f52e-4c67-a3f3-1d3be7cbcf9f tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Lock "6ae9fe6f-eb17-44f5-89e4-fff5e3451336" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:34:59 user nova-compute[75165]: DEBUG nova.compute.manager [None req-966fb094-f52e-4c67-a3f3-1d3be7cbcf9f tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] [instance: 6ae9fe6f-eb17-44f5-89e4-fff5e3451336] Starting instance... {{(pid=75165) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 00:34:59 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-966fb094-f52e-4c67-a3f3-1d3be7cbcf9f tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:34:59 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-966fb094-f52e-4c67-a3f3-1d3be7cbcf9f tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:34:59 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-966fb094-f52e-4c67-a3f3-1d3be7cbcf9f tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75165) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 00:34:59 user nova-compute[75165]: INFO nova.compute.claims [None req-966fb094-f52e-4c67-a3f3-1d3be7cbcf9f tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] [instance: 6ae9fe6f-eb17-44f5-89e4-fff5e3451336] Claim successful on node user
Oct 26 00:34:59 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-9189150f-b8f0-410b-9d87-39e10c32c56d tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance fe2984ce-8958-4049-8af7-496b313b26c8 is timed out.
Oct 26 00:34:59 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-9189150f-b8f0-410b-9d87-39e10c32c56d tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Successfully detached device vdb from instance fe2984ce-8958-4049-8af7-496b313b26c8 from the live domain config.
Oct 26 00:34:59 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9189150f-b8f0-410b-9d87-39e10c32c56d tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] [instance: fe2984ce-8958-4049-8af7-496b313b26c8] calling os-brick to detach iSCSI Volume {{(pid=75165) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 00:34:59 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-9189150f-b8f0-410b-9d87-39e10c32c56d tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8bf8160e50>, {'target_iqn': 'iqn.2010-10.org.openstack:00b01051-74e4-43e2-aee1-42f2e5f94fe5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AebPfyzU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:34:59 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-9189150f-b8f0-410b-9d87-39e10c32c56d tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:34:59 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-9189150f-b8f0-410b-9d87-39e10c32c56d tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:34:59 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-9189150f-b8f0-410b-9d87-39e10c32c56d tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:34:59 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:35:00 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:35:00 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[4af35d69-21b9-4541-89e2-9db3eaeabbeb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:00b01051-74e4-43e2-aee1-42f2e5f94fe5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:35:00 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-9189150f-b8f0-410b-9d87-39e10c32c56d tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 00:35:00 user nova-compute[75165]: No targets found.
Oct 26 00:35:00 user nova-compute[75165]: iSNS:
Oct 26 00:35:00 user nova-compute[75165]: No targets found.
Oct 26 00:35:00 user nova-compute[75165]: STATIC:
Oct 26 00:35:00 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8
Oct 26 00:35:00 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:35:00 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:35:00 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:00b01051-74e4-43e2-aee1-42f2e5f94fe5
Oct 26 00:35:00 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:35:00 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:35:00 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795
Oct 26 00:35:00 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:35:00 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:35:00 user nova-compute[75165]: FIRMWARE:
Oct 26 00:35:00 user nova-compute[75165]: No targets found.
Oct 26 00:35:00 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:35:00 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-9189150f-b8f0-410b-9d87-39e10c32c56d tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 00:35:00 user nova-compute[75165]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 00:35:00 user nova-compute[75165]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75165) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 00:35:00 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-9189150f-b8f0-410b-9d87-39e10c32c56d tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:00b01051-74e4-43e2-aee1-42f2e5f94fe5', 0)] {{(pid=75165) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 00:35:00 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:35:00 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:35:00 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[01f5b308-8543-4742-84f8-c44c67308efd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00b01051-74e4-43e2-aee1-42f2e5f94fe5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:35:00 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:35:00 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:35:00 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[d83f1cc5-a0b7-4026-80eb-2116bc976a16]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00b01051-74e4-43e2-aee1-42f2e5f94fe5 (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:35:00 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-9189150f-b8f0-410b-9d87-39e10c32c56d tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)
Oct 26 00:35:00 user nova-compute[75165]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8 (non-flash)
Oct 26 00:35:00 user nova-compute[75165]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00b01051-74e4-43e2-aee1-42f2e5f94fe5 (non-flash)
Oct 26 00:35:00 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:35:00 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-9189150f-b8f0-410b-9d87-39e10c32c56d tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)
Oct 26 00:35:00 user nova-compute[75165]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8 (non-flash)
Oct 26 00:35:00 user nova-compute[75165]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00b01051-74e4-43e2-aee1-42f2e5f94fe5 (non-flash)
Oct 26 00:35:00 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:35:00 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-9189150f-b8f0-410b-9d87-39e10c32c56d tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8bf839c280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:00b01051-74e4-43e2-aee1-42f2e5f94fe5'): ({'sde'}, set())}) {{(pid=75165) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 00:35:00 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-9189150f-b8f0-410b-9d87-39e10c32c56d tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Removing single pathed devices sde {{(pid=75165) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 00:35:00 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:35:00 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:35:00 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3279c7e-32c4-4b68-94a4-00e9c4598db8]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:35:00 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:35:00 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.025s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:35:00 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[94db8981-74b6-4a7e-9392-aa769110576d]: (4, ('ok\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:35:00 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-9189150f-b8f0-410b-9d87-39e10c32c56d tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Flushing IO for device /dev/sde {{(pid=75165) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 00:35:00 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:35:00 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:35:00 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[be84ed1e-f484-4920-832c-cc1886b6c5ab]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:35:00 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-9189150f-b8f0-410b-9d87-39e10c32c56d tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75165) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 00:35:00 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:35:00 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.052s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:35:00 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b97b2b0-a435-4f82-802a-9eabd37ec708]: (4, ('1', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:35:00 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-9189150f-b8f0-410b-9d87-39e10c32c56d tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75165) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 00:35:00 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-9189150f-b8f0-410b-9d87-39e10c32c56d tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] SCSI volumes sde have been removed. {{(pid=75165) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 00:35:00 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-9189150f-b8f0-410b-9d87-39e10c32c56d tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:00b01051-74e4-43e2-aee1-42f2e5f94fe5')] {{(pid=75165) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 00:35:00 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00b01051-74e4-43e2-aee1-42f2e5f94fe5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:35:00 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00b01051-74e4-43e2-aee1-42f2e5f94fe5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:35:00 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ad9574f-0311-4975-a4af-f3d1f5a1945f]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:35:00 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-9189150f-b8f0-410b-9d87-39e10c32c56d tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:35:00 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00b01051-74e4-43e2-aee1-42f2e5f94fe5 -p 172.16.0.220:3260 --logout {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:35:00 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-966fb094-f52e-4c67-a3f3-1d3be7cbcf9f tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:35:00 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-966fb094-f52e-4c67-a3f3-1d3be7cbcf9f tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:35:00 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00b01051-74e4-43e2-aee1-42f2e5f94fe5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:35:00 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a6435cb-e522-436b-b6ed-59421e84a80e]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:00b01051-74e4-43e2-aee1-42f2e5f94fe5, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:00b01051-74e4-43e2-aee1-42f2e5f94fe5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:35:00 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-9189150f-b8f0-410b-9d87-39e10c32c56d tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:00b01051-74e4-43e2-aee1-42f2e5f94fe5, portal: 172.16.0.220,3260]
Oct 26 00:35:00 user nova-compute[75165]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:00b01051-74e4-43e2-aee1-42f2e5f94fe5, portal: 172.16.0.220,3260] successful.
Oct 26 00:35:00 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:35:00 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00b01051-74e4-43e2-aee1-42f2e5f94fe5 -p 172.16.0.220:3260 --op delete {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:35:00 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00b01051-74e4-43e2-aee1-42f2e5f94fe5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:35:00 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aed96f6-a01f-4354-9161-969e833b15c3]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:35:00 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-9189150f-b8f0-410b-9d87-39e10c32c56d tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:35:00 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-9189150f-b8f0-410b-9d87-39e10c32c56d tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.374s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:35:00 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-9189150f-b8f0-410b-9d87-39e10c32c56d tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] <== disconnect_volume: return (375ms) None {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:35:00 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9189150f-b8f0-410b-9d87-39e10c32c56d tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] [instance: fe2984ce-8958-4049-8af7-496b313b26c8] Disconnected iSCSI Volume {{(pid=75165) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 00:35:00 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-966fb094-f52e-4c67-a3f3-1d3be7cbcf9f tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.631s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:35:00 user nova-compute[75165]: DEBUG nova.compute.manager [None req-966fb094-f52e-4c67-a3f3-1d3be7cbcf9f tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] [instance: 6ae9fe6f-eb17-44f5-89e4-fff5e3451336] Start building networks asynchronously for instance. {{(pid=75165) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 00:35:00 user nova-compute[75165]: DEBUG nova.compute.manager [None req-966fb094-f52e-4c67-a3f3-1d3be7cbcf9f tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] [instance: 6ae9fe6f-eb17-44f5-89e4-fff5e3451336] Allocating IP information in the background. {{(pid=75165) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 00:35:00 user nova-compute[75165]: DEBUG nova.network.neutron [None req-966fb094-f52e-4c67-a3f3-1d3be7cbcf9f tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] [instance: 6ae9fe6f-eb17-44f5-89e4-fff5e3451336] allocate_for_instance() {{(pid=75165) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 00:35:00 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-966fb094-f52e-4c67-a3f3-1d3be7cbcf9f tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] [instance: 6ae9fe6f-eb17-44f5-89e4-fff5e3451336] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 00:35:00 user nova-compute[75165]: DEBUG nova.compute.manager [None req-966fb094-f52e-4c67-a3f3-1d3be7cbcf9f tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] [instance: 6ae9fe6f-eb17-44f5-89e4-fff5e3451336] Start building block device mappings for instance. {{(pid=75165) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 00:35:00 user nova-compute[75165]: DEBUG nova.policy [None req-966fb094-f52e-4c67-a3f3-1d3be7cbcf9f tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a8b04771d6df477ebd9015c46345afc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11255eee7bb4b13962634a1cd13d186', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75165) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 00:35:00 user nova-compute[75165]: DEBUG nova.compute.manager [None req-966fb094-f52e-4c67-a3f3-1d3be7cbcf9f tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] [instance: 6ae9fe6f-eb17-44f5-89e4-fff5e3451336] Start spawning the instance on the hypervisor. {{(pid=75165) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 00:35:00 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-966fb094-f52e-4c67-a3f3-1d3be7cbcf9f tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] [instance: 6ae9fe6f-eb17-44f5-89e4-fff5e3451336] Creating instance directory {{(pid=75165) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 00:35:00 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-966fb094-f52e-4c67-a3f3-1d3be7cbcf9f tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] [instance: 6ae9fe6f-eb17-44f5-89e4-fff5e3451336] Creating image(s)
Oct 26 00:35:00 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-966fb094-f52e-4c67-a3f3-1d3be7cbcf9f tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Acquiring lock "/opt/stack/data/nova/instances/6ae9fe6f-eb17-44f5-89e4-fff5e3451336/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:35:00 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-966fb094-f52e-4c67-a3f3-1d3be7cbcf9f tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Lock "/opt/stack/data/nova/instances/6ae9fe6f-eb17-44f5-89e4-fff5e3451336/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:35:00 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-966fb094-f52e-4c67-a3f3-1d3be7cbcf9f tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Lock "/opt/stack/data/nova/instances/6ae9fe6f-eb17-44f5-89e4-fff5e3451336/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:35:00 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-966fb094-f52e-4c67-a3f3-1d3be7cbcf9f tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:35:01 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-966fb094-f52e-4c67-a3f3-1d3be7cbcf9f tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json" returned: 0 in 0.197s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:35:01 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-966fb094-f52e-4c67-a3f3-1d3be7cbcf9f tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Acquiring lock "7d3243421cf3fdc288b758f687a93103b7b95466" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:35:01 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-966fb094-f52e-4c67-a3f3-1d3be7cbcf9f tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Lock "7d3243421cf3fdc288b758f687a93103b7b95466" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:35:01 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-966fb094-f52e-4c67-a3f3-1d3be7cbcf9f tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:35:01 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:35:01 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-966fb094-f52e-4c67-a3f3-1d3be7cbcf9f tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json" returned: 0 in 0.189s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:35:01 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-966fb094-f52e-4c67-a3f3-1d3be7cbcf9f tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466,backing_fmt=raw /opt/stack/data/nova/instances/6ae9fe6f-eb17-44f5-89e4-fff5e3451336/disk 1073741824 {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:35:01 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-966fb094-f52e-4c67-a3f3-1d3be7cbcf9f tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466,backing_fmt=raw /opt/stack/data/nova/instances/6ae9fe6f-eb17-44f5-89e4-fff5e3451336/disk 1073741824" returned: 0 in 0.062s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:35:01 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-966fb094-f52e-4c67-a3f3-1d3be7cbcf9f tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Lock "7d3243421cf3fdc288b758f687a93103b7b95466" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.258s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:35:01 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-966fb094-f52e-4c67-a3f3-1d3be7cbcf9f tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:35:01 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-966fb094-f52e-4c67-a3f3-1d3be7cbcf9f tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json" returned: 0 in 0.212s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:35:01 user nova-compute[75165]: DEBUG nova.virt.disk.api [None req-966fb094-f52e-4c67-a3f3-1d3be7cbcf9f tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6ae9fe6f-eb17-44f5-89e4-fff5e3451336/disk. size=1073741824 {{(pid=75165) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 00:35:01 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-966fb094-f52e-4c67-a3f3-1d3be7cbcf9f tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae9fe6f-eb17-44f5-89e4-fff5e3451336/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:35:01 user nova-compute[75165]: DEBUG nova.network.neutron [None req-966fb094-f52e-4c67-a3f3-1d3be7cbcf9f tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] [instance: 6ae9fe6f-eb17-44f5-89e4-fff5e3451336] Successfully created port: 5057f477-2080-4285-86a0-8f50541c3361 {{(pid=75165) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 00:35:01 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-966fb094-f52e-4c67-a3f3-1d3be7cbcf9f tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae9fe6f-eb17-44f5-89e4-fff5e3451336/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:35:01 user nova-compute[75165]: DEBUG nova.virt.disk.api [None req-966fb094-f52e-4c67-a3f3-1d3be7cbcf9f tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Cannot resize image /opt/stack/data/nova/instances/6ae9fe6f-eb17-44f5-89e4-fff5e3451336/disk to a smaller size. {{(pid=75165) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 00:35:01 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-966fb094-f52e-4c67-a3f3-1d3be7cbcf9f tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] [instance: 6ae9fe6f-eb17-44f5-89e4-fff5e3451336] Created local disks {{(pid=75165) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 00:35:01 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-966fb094-f52e-4c67-a3f3-1d3be7cbcf9f tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] [instance: 6ae9fe6f-eb17-44f5-89e4-fff5e3451336] Ensure instance console log exists: /opt/stack/data/nova/instances/6ae9fe6f-eb17-44f5-89e4-fff5e3451336/console.log {{(pid=75165) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 00:35:01 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-966fb094-f52e-4c67-a3f3-1d3be7cbcf9f tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:35:01 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-966fb094-f52e-4c67-a3f3-1d3be7cbcf9f tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:35:01 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-966fb094-f52e-4c67-a3f3-1d3be7cbcf9f tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:35:01 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:35:02 user nova-compute[75165]: DEBUG nova.network.neutron [None req-966fb094-f52e-4c67-a3f3-1d3be7cbcf9f tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] [instance: 6ae9fe6f-eb17-44f5-89e4-fff5e3451336] Successfully updated port: 5057f477-2080-4285-86a0-8f50541c3361 {{(pid=75165) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 00:35:02 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-966fb094-f52e-4c67-a3f3-1d3be7cbcf9f tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Acquiring lock "refresh_cache-6ae9fe6f-eb17-44f5-89e4-fff5e3451336" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:35:02 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-966fb094-f52e-4c67-a3f3-1d3be7cbcf9f tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Acquired lock "refresh_cache-6ae9fe6f-eb17-44f5-89e4-fff5e3451336" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:35:02 user nova-compute[75165]: DEBUG nova.network.neutron [None req-966fb094-f52e-4c67-a3f3-1d3be7cbcf9f tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] [instance: 6ae9fe6f-eb17-44f5-89e4-fff5e3451336] Building network info cache for instance {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 00:35:02 user nova-compute[75165]: DEBUG nova.compute.manager [req-685b8538-f357-4888-8ac3-8fe40985e286 req-f5f365c9-05d8-4475-9f0e-341b7ce3e5f7 service nova] [instance: 6ae9fe6f-eb17-44f5-89e4-fff5e3451336] Received event network-changed-5057f477-2080-4285-86a0-8f50541c3361 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:35:02 user nova-compute[75165]: DEBUG nova.compute.manager [req-685b8538-f357-4888-8ac3-8fe40985e286 req-f5f365c9-05d8-4475-9f0e-341b7ce3e5f7 service nova] [instance: 6ae9fe6f-eb17-44f5-89e4-fff5e3451336] Refreshing instance network info cache due to event network-changed-5057f477-2080-4285-86a0-8f50541c3361. {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 00:35:02 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-685b8538-f357-4888-8ac3-8fe40985e286 req-f5f365c9-05d8-4475-9f0e-341b7ce3e5f7 service nova] Acquiring lock "refresh_cache-6ae9fe6f-eb17-44f5-89e4-fff5e3451336" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:35:02 user nova-compute[75165]: DEBUG nova.network.neutron [None req-966fb094-f52e-4c67-a3f3-1d3be7cbcf9f tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] [instance: 6ae9fe6f-eb17-44f5-89e4-fff5e3451336] Instance cache missing network info. {{(pid=75165) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 00:35:02 user nova-compute[75165]: DEBUG nova.network.neutron [None req-966fb094-f52e-4c67-a3f3-1d3be7cbcf9f tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] [instance: 6ae9fe6f-eb17-44f5-89e4-fff5e3451336] Updating instance_info_cache with network_info: [{"id": "5057f477-2080-4285-86a0-8f50541c3361", "address": "fa:16:3e:ca:e5:01", "network": {"id": "03d2b5cd-b214-4767-a406-098bd6857327", "bridge": "br-int", "label": "tempest-TestStampPattern-968415108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e11255eee7bb4b13962634a1cd13d186", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5057f477-20", "ovs_interfaceid": "5057f477-2080-4285-86a0-8f50541c3361", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:35:02 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-966fb094-f52e-4c67-a3f3-1d3be7cbcf9f tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Releasing lock "refresh_cache-6ae9fe6f-eb17-44f5-89e4-fff5e3451336" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:35:02 user nova-compute[75165]: DEBUG nova.compute.manager [None req-966fb094-f52e-4c67-a3f3-1d3be7cbcf9f tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] [instance: 6ae9fe6f-eb17-44f5-89e4-fff5e3451336] Instance network_info: |[{"id": "5057f477-2080-4285-86a0-8f50541c3361", "address": "fa:16:3e:ca:e5:01", "network": {"id": "03d2b5cd-b214-4767-a406-098bd6857327", "bridge": "br-int", "label": "tempest-TestStampPattern-968415108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e11255eee7bb4b13962634a1cd13d186", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5057f477-20", "ovs_interfaceid": "5057f477-2080-4285-86a0-8f50541c3361", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75165) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 00:35:02 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-685b8538-f357-4888-8ac3-8fe40985e286 req-f5f365c9-05d8-4475-9f0e-341b7ce3e5f7 service nova] Acquired lock "refresh_cache-6ae9fe6f-eb17-44f5-89e4-fff5e3451336" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:35:02 user nova-compute[75165]: DEBUG nova.network.neutron [req-685b8538-f357-4888-8ac3-8fe40985e286 req-f5f365c9-05d8-4475-9f0e-341b7ce3e5f7 service nova] [instance: 6ae9fe6f-eb17-44f5-89e4-fff5e3451336] Refreshing network info cache for port 5057f477-2080-4285-86a0-8f50541c3361 {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 00:35:02 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-966fb094-f52e-4c67-a3f3-1d3be7cbcf9f tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] [instance: 6ae9fe6f-eb17-44f5-89e4-fff5e3451336] Start _get_guest_xml network_info=[{"id": "5057f477-2080-4285-86a0-8f50541c3361", "address": "fa:16:3e:ca:e5:01", "network": {"id": "03d2b5cd-b214-4767-a406-098bd6857327", "bridge": "br-int", "label": "tempest-TestStampPattern-968415108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e11255eee7bb4b13962634a1cd13d186", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5057f477-20", "ovs_interfaceid": "5057f477-2080-4285-86a0-8f50541c3361", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T00:03:24Z,direct_url=<?>,disk_format='qcow2',id=bff0d8a1-739e-4c4d-9efa-b73ba7b76d01,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e56bbf444fd34c348475c73673611447',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T00:03:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'size': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': 'bff0d8a1-739e-4c4d-9efa-b73ba7b76d01'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75165) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 00:35:02 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-966fb094-f52e-4c67-a3f3-1d3be7cbcf9f tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:35:02 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-966fb094-f52e-4c67-a3f3-1d3be7cbcf9f tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:35:02 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-966fb094-f52e-4c67-a3f3-1d3be7cbcf9f tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75165) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 00:35:02 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-966fb094-f52e-4c67-a3f3-1d3be7cbcf9f tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] CPU controller missing on host. {{(pid=75165) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 00:35:02 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-966fb094-f52e-4c67-a3f3-1d3be7cbcf9f tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75165) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 00:35:02 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-966fb094-f52e-4c67-a3f3-1d3be7cbcf9f tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] CPU controller found on host. {{(pid=75165) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 00:35:02 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-966fb094-f52e-4c67-a3f3-1d3be7cbcf9f tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75165) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 00:35:02 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-966fb094-f52e-4c67-a3f3-1d3be7cbcf9f tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T00:03:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T00:03:24Z,direct_url=<?>,disk_format='qcow2',id=bff0d8a1-739e-4c4d-9efa-b73ba7b76d01,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e56bbf444fd34c348475c73673611447',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T00:03:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 00:35:02 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-966fb094-f52e-4c67-a3f3-1d3be7cbcf9f tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Flavor limits 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 00:35:02 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-966fb094-f52e-4c67-a3f3-1d3be7cbcf9f tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Image limits 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 00:35:02 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-966fb094-f52e-4c67-a3f3-1d3be7cbcf9f tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Flavor pref 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 00:35:02 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-966fb094-f52e-4c67-a3f3-1d3be7cbcf9f tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Image pref 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 00:35:02 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-966fb094-f52e-4c67-a3f3-1d3be7cbcf9f tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 00:35:02 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-966fb094-f52e-4c67-a3f3-1d3be7cbcf9f tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 00:35:02 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-966fb094-f52e-4c67-a3f3-1d3be7cbcf9f tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75165) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 00:35:02 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-966fb094-f52e-4c67-a3f3-1d3be7cbcf9f tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Got 1 possible topologies {{(pid=75165) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 00:35:02 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-966fb094-f52e-4c67-a3f3-1d3be7cbcf9f tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 00:35:02 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-966fb094-f52e-4c67-a3f3-1d3be7cbcf9f tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 00:35:02 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-966fb094-f52e-4c67-a3f3-1d3be7cbcf9f tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:34:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1831353658',display_name='tempest-TestStampPattern-server-1831353658',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1831353658',id=39,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGm2My4nRv1TQMRxx0ZQGbSskYL8JiBedzBd6yh8xGYOqpiWk+KOkgfodgvUeL5VIyIOd6LANvVscgBF9awfoT7/2vctuNc54C96HHUt5A78B63ZjhSiwIVLzywUgmpbdw==',key_name='tempest-TestStampPattern-1939697091',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e11255eee7bb4b13962634a1cd13d186',ramdisk_id='',reservation_id='r-imgjeznd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-153617260',owner_user_name='tempest-TestStampPattern-153617260-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T00:35:01Z,user_data=None,user_id='a8b04771d6df477ebd9015c46345afc5',uuid=6ae9fe6f-eb17-44f5-89e4-fff5e3451336,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5057f477-2080-4285-86a0-8f50541c3361", "address": "fa:16:3e:ca:e5:01", "network": {"id": "03d2b5cd-b214-4767-a406-098bd6857327", "bridge": "br-int", "label": "tempest-TestStampPattern-968415108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e11255eee7bb4b13962634a1cd13d186", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5057f477-20", "ovs_interfaceid": "5057f477-2080-4285-86a0-8f50541c3361", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75165) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 00:35:02 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-966fb094-f52e-4c67-a3f3-1d3be7cbcf9f tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Converting VIF {"id": "5057f477-2080-4285-86a0-8f50541c3361", "address": "fa:16:3e:ca:e5:01", "network": {"id": "03d2b5cd-b214-4767-a406-098bd6857327", "bridge": "br-int", "label": "tempest-TestStampPattern-968415108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e11255eee7bb4b13962634a1cd13d186", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5057f477-20", "ovs_interfaceid": "5057f477-2080-4285-86a0-8f50541c3361", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:35:02 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-966fb094-f52e-4c67-a3f3-1d3be7cbcf9f tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:e5:01,bridge_name='br-int',has_traffic_filtering=True,id=5057f477-2080-4285-86a0-8f50541c3361,network=Network(03d2b5cd-b214-4767-a406-098bd6857327),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5057f477-20') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:35:02 user nova-compute[75165]: DEBUG nova.objects.instance [None req-966fb094-f52e-4c67-a3f3-1d3be7cbcf9f tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Lazy-loading 'pci_devices' on Instance uuid 6ae9fe6f-eb17-44f5-89e4-fff5e3451336 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:35:02 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-966fb094-f52e-4c67-a3f3-1d3be7cbcf9f tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] [instance: 6ae9fe6f-eb17-44f5-89e4-fff5e3451336] End _get_guest_xml xml=<domain type="kvm">
Oct 26 00:35:02 user nova-compute[75165]:   <uuid>6ae9fe6f-eb17-44f5-89e4-fff5e3451336</uuid>
Oct 26 00:35:02 user nova-compute[75165]:   <name>instance-00000027</name>
Oct 26 00:35:02 user nova-compute[75165]:   <memory>524288</memory>
Oct 26 00:35:02 user nova-compute[75165]:   <vcpu>1</vcpu>
Oct 26 00:35:02 user nova-compute[75165]:   <metadata>
Oct 26 00:35:02 user nova-compute[75165]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 00:35:02 user nova-compute[75165]:       <nova:package version="0.0.0"/>
Oct 26 00:35:02 user nova-compute[75165]:       <nova:name>tempest-TestStampPattern-server-1831353658</nova:name>
Oct 26 00:35:02 user nova-compute[75165]:       <nova:creationTime>2023-10-26 00:35:02</nova:creationTime>
Oct 26 00:35:02 user nova-compute[75165]:       <nova:flavor name="m1.tiny">
Oct 26 00:35:02 user nova-compute[75165]:         <nova:memory>512</nova:memory>
Oct 26 00:35:02 user nova-compute[75165]:         <nova:disk>1</nova:disk>
Oct 26 00:35:02 user nova-compute[75165]:         <nova:swap>0</nova:swap>
Oct 26 00:35:02 user nova-compute[75165]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 00:35:02 user nova-compute[75165]:         <nova:vcpus>1</nova:vcpus>
Oct 26 00:35:02 user nova-compute[75165]:       </nova:flavor>
Oct 26 00:35:02 user nova-compute[75165]:       <nova:owner>
Oct 26 00:35:02 user nova-compute[75165]:         <nova:user uuid="a8b04771d6df477ebd9015c46345afc5">tempest-TestStampPattern-153617260-project-member</nova:user>
Oct 26 00:35:02 user nova-compute[75165]:         <nova:project uuid="e11255eee7bb4b13962634a1cd13d186">tempest-TestStampPattern-153617260</nova:project>
Oct 26 00:35:02 user nova-compute[75165]:       </nova:owner>
Oct 26 00:35:02 user nova-compute[75165]:       <nova:root type="image" uuid="bff0d8a1-739e-4c4d-9efa-b73ba7b76d01"/>
Oct 26 00:35:02 user nova-compute[75165]:       <nova:ports>
Oct 26 00:35:02 user nova-compute[75165]:         <nova:port uuid="5057f477-2080-4285-86a0-8f50541c3361">
Oct 26 00:35:02 user nova-compute[75165]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 26 00:35:02 user nova-compute[75165]:         </nova:port>
Oct 26 00:35:02 user nova-compute[75165]:       </nova:ports>
Oct 26 00:35:02 user nova-compute[75165]:     </nova:instance>
Oct 26 00:35:02 user nova-compute[75165]:   </metadata>
Oct 26 00:35:02 user nova-compute[75165]:   <sysinfo type="smbios">
Oct 26 00:35:02 user nova-compute[75165]:     <system>
Oct 26 00:35:02 user nova-compute[75165]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 00:35:02 user nova-compute[75165]:       <entry name="product">OpenStack Nova</entry>
Oct 26 00:35:02 user nova-compute[75165]:       <entry name="version">0.0.0</entry>
Oct 26 00:35:02 user nova-compute[75165]:       <entry name="serial">6ae9fe6f-eb17-44f5-89e4-fff5e3451336</entry>
Oct 26 00:35:02 user nova-compute[75165]:       <entry name="uuid">6ae9fe6f-eb17-44f5-89e4-fff5e3451336</entry>
Oct 26 00:35:02 user nova-compute[75165]:       <entry name="family">Virtual Machine</entry>
Oct 26 00:35:02 user nova-compute[75165]:     </system>
Oct 26 00:35:02 user nova-compute[75165]:   </sysinfo>
Oct 26 00:35:02 user nova-compute[75165]:   <os>
Oct 26 00:35:02 user nova-compute[75165]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 00:35:02 user nova-compute[75165]:     <boot dev="hd"/>
Oct 26 00:35:02 user nova-compute[75165]:     <smbios mode="sysinfo"/>
Oct 26 00:35:02 user nova-compute[75165]:   </os>
Oct 26 00:35:02 user nova-compute[75165]:   <features>
Oct 26 00:35:02 user nova-compute[75165]:     <acpi/>
Oct 26 00:35:02 user nova-compute[75165]:     <apic/>
Oct 26 00:35:02 user nova-compute[75165]:     <vmcoreinfo/>
Oct 26 00:35:02 user nova-compute[75165]:   </features>
Oct 26 00:35:02 user nova-compute[75165]:   <clock offset="utc">
Oct 26 00:35:02 user nova-compute[75165]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 00:35:02 user nova-compute[75165]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 00:35:02 user nova-compute[75165]:     <timer name="hpet" present="no"/>
Oct 26 00:35:02 user nova-compute[75165]:   </clock>
Oct 26 00:35:02 user nova-compute[75165]:   <cpu mode="custom" match="exact">
Oct 26 00:35:02 user nova-compute[75165]:     <model>Nehalem</model>
Oct 26 00:35:02 user nova-compute[75165]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 00:35:02 user nova-compute[75165]:   </cpu>
Oct 26 00:35:02 user nova-compute[75165]:   <devices>
Oct 26 00:35:02 user nova-compute[75165]:     <disk type="file" device="disk">
Oct 26 00:35:02 user nova-compute[75165]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 00:35:02 user nova-compute[75165]:       <source file="/opt/stack/data/nova/instances/6ae9fe6f-eb17-44f5-89e4-fff5e3451336/disk"/>
Oct 26 00:35:02 user nova-compute[75165]:       <target dev="vda" bus="virtio"/>
Oct 26 00:35:02 user nova-compute[75165]:     </disk>
Oct 26 00:35:02 user nova-compute[75165]:     <interface type="ethernet">
Oct 26 00:35:02 user nova-compute[75165]:       <mac address="fa:16:3e:ca:e5:01"/>
Oct 26 00:35:02 user nova-compute[75165]:       <model type="virtio"/>
Oct 26 00:35:02 user nova-compute[75165]:       <mtu size="1442"/>
Oct 26 00:35:02 user nova-compute[75165]:       <target dev="tap5057f477-20"/>
Oct 26 00:35:02 user nova-compute[75165]:     </interface>
Oct 26 00:35:02 user nova-compute[75165]:     <serial type="pty">
Oct 26 00:35:02 user nova-compute[75165]:       <log file="/opt/stack/data/nova/instances/6ae9fe6f-eb17-44f5-89e4-fff5e3451336/console.log" append="off"/>
Oct 26 00:35:02 user nova-compute[75165]:     </serial>
Oct 26 00:35:02 user nova-compute[75165]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 00:35:02 user nova-compute[75165]:     <video>
Oct 26 00:35:02 user nova-compute[75165]:       <model type="virtio"/>
Oct 26 00:35:02 user nova-compute[75165]:     </video>
Oct 26 00:35:02 user nova-compute[75165]:     <rng model="virtio">
Oct 26 00:35:02 user nova-compute[75165]:       <backend model="random">/dev/urandom</backend>
Oct 26 00:35:02 user nova-compute[75165]:     </rng>
Oct 26 00:35:02 user nova-compute[75165]:     <controller type="usb" index="0" model="none"/>
Oct 26 00:35:02 user nova-compute[75165]:     <memballoon model="virtio">
Oct 26 00:35:02 user nova-compute[75165]:       <stats period="10"/>
Oct 26 00:35:02 user nova-compute[75165]:     </memballoon>
Oct 26 00:35:02 user nova-compute[75165]:   </devices>
Oct 26 00:35:02 user nova-compute[75165]: </domain>
Oct 26 00:35:02 user nova-compute[75165]:  {{(pid=75165) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 00:35:02 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-966fb094-f52e-4c67-a3f3-1d3be7cbcf9f tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:34:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1831353658',display_name='tempest-TestStampPattern-server-1831353658',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1831353658',id=39,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGm2My4nRv1TQMRxx0ZQGbSskYL8JiBedzBd6yh8xGYOqpiWk+KOkgfodgvUeL5VIyIOd6LANvVscgBF9awfoT7/2vctuNc54C96HHUt5A78B63ZjhSiwIVLzywUgmpbdw==',key_name='tempest-TestStampPattern-1939697091',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e11255eee7bb4b13962634a1cd13d186',ramdisk_id='',reservation_id='r-imgjeznd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-153617260',owner_user_name='tempest-TestStampPattern-153617260-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T00:35:01Z,user_data=None,user_id='a8b04771d6df477ebd9015c46345afc5',uuid=6ae9fe6f-eb17-44f5-89e4-fff5e3451336,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5057f477-2080-4285-86a0-8f50541c3361", "address": "fa:16:3e:ca:e5:01", "network": {"id": "03d2b5cd-b214-4767-a406-098bd6857327", "bridge": "br-int", "label": "tempest-TestStampPattern-968415108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e11255eee7bb4b13962634a1cd13d186", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5057f477-20", "ovs_interfaceid": "5057f477-2080-4285-86a0-8f50541c3361", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 00:35:02 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-966fb094-f52e-4c67-a3f3-1d3be7cbcf9f tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Converting VIF {"id": "5057f477-2080-4285-86a0-8f50541c3361", "address": "fa:16:3e:ca:e5:01", "network": {"id": "03d2b5cd-b214-4767-a406-098bd6857327", "bridge": "br-int", "label": "tempest-TestStampPattern-968415108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e11255eee7bb4b13962634a1cd13d186", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5057f477-20", "ovs_interfaceid": "5057f477-2080-4285-86a0-8f50541c3361", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:35:02 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-966fb094-f52e-4c67-a3f3-1d3be7cbcf9f tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:e5:01,bridge_name='br-int',has_traffic_filtering=True,id=5057f477-2080-4285-86a0-8f50541c3361,network=Network(03d2b5cd-b214-4767-a406-098bd6857327),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5057f477-20') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:35:02 user nova-compute[75165]: DEBUG os_vif [None req-966fb094-f52e-4c67-a3f3-1d3be7cbcf9f tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:e5:01,bridge_name='br-int',has_traffic_filtering=True,id=5057f477-2080-4285-86a0-8f50541c3361,network=Network(03d2b5cd-b214-4767-a406-098bd6857327),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5057f477-20') {{(pid=75165) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 00:35:02 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:35:02 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:35:02 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 00:35:02 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:35:02 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0590db4a-fbdb-532b-b197-49d56d9ba670', '_type': 'linux-noop'}}, row=False) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:35:02 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:35:02 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:35:02 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:35:02 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5057f477-20, may_exist=True, interface_attrs={}) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:35:02 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5057f477-20, col_values=(('qos', UUID('cee3755f-0f73-435f-874b-3683729ce3d5')),), if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:35:02 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5057f477-20, col_values=(('external_ids', {'iface-id': '5057f477-2080-4285-86a0-8f50541c3361', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ca:e5:01', 'vm-uuid': '6ae9fe6f-eb17-44f5-89e4-fff5e3451336'}),), if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:35:02 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:35:02 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:35:02 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:35:02 user nova-compute[75165]: INFO os_vif [None req-966fb094-f52e-4c67-a3f3-1d3be7cbcf9f tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:e5:01,bridge_name='br-int',has_traffic_filtering=True,id=5057f477-2080-4285-86a0-8f50541c3361,network=Network(03d2b5cd-b214-4767-a406-098bd6857327),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5057f477-20')
Oct 26 00:35:02 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-966fb094-f52e-4c67-a3f3-1d3be7cbcf9f tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] No BDM found with device name vda, not building metadata. {{(pid=75165) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 00:35:02 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-966fb094-f52e-4c67-a3f3-1d3be7cbcf9f tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] No VIF found with MAC fa:16:3e:ca:e5:01, not building metadata {{(pid=75165) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 00:35:03 user nova-compute[75165]: DEBUG nova.network.neutron [req-685b8538-f357-4888-8ac3-8fe40985e286 req-f5f365c9-05d8-4475-9f0e-341b7ce3e5f7 service nova] [instance: 6ae9fe6f-eb17-44f5-89e4-fff5e3451336] Updated VIF entry in instance network info cache for port 5057f477-2080-4285-86a0-8f50541c3361. {{(pid=75165) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 00:35:03 user nova-compute[75165]: DEBUG nova.network.neutron [req-685b8538-f357-4888-8ac3-8fe40985e286 req-f5f365c9-05d8-4475-9f0e-341b7ce3e5f7 service nova] [instance: 6ae9fe6f-eb17-44f5-89e4-fff5e3451336] Updating instance_info_cache with network_info: [{"id": "5057f477-2080-4285-86a0-8f50541c3361", "address": "fa:16:3e:ca:e5:01", "network": {"id": "03d2b5cd-b214-4767-a406-098bd6857327", "bridge": "br-int", "label": "tempest-TestStampPattern-968415108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e11255eee7bb4b13962634a1cd13d186", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5057f477-20", "ovs_interfaceid": "5057f477-2080-4285-86a0-8f50541c3361", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:35:03 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-685b8538-f357-4888-8ac3-8fe40985e286 req-f5f365c9-05d8-4475-9f0e-341b7ce3e5f7 service nova] Releasing lock "refresh_cache-6ae9fe6f-eb17-44f5-89e4-fff5e3451336" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:35:03 user nova-compute[75165]: DEBUG nova.objects.instance [None req-9189150f-b8f0-410b-9d87-39e10c32c56d tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Lazy-loading 'flavor' on Instance uuid fe2984ce-8958-4049-8af7-496b313b26c8 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:35:03 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-9189150f-b8f0-410b-9d87-39e10c32c56d tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Lock "fe2984ce-8958-4049-8af7-496b313b26c8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 24.644s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:35:04 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:35:04 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:35:04 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:35:04 user nova-compute[75165]: DEBUG nova.compute.manager [req-4b7155b8-cbea-4092-b82c-69175b96c1b1 req-c8fbc9b3-81b0-4076-bc4a-ef001846e1ed service nova] [instance: 6ae9fe6f-eb17-44f5-89e4-fff5e3451336] Received event network-vif-plugged-5057f477-2080-4285-86a0-8f50541c3361 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:35:04 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-4b7155b8-cbea-4092-b82c-69175b96c1b1 req-c8fbc9b3-81b0-4076-bc4a-ef001846e1ed service nova] Acquiring lock "6ae9fe6f-eb17-44f5-89e4-fff5e3451336-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:35:04 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-4b7155b8-cbea-4092-b82c-69175b96c1b1 req-c8fbc9b3-81b0-4076-bc4a-ef001846e1ed service nova] Lock "6ae9fe6f-eb17-44f5-89e4-fff5e3451336-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:35:04 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-4b7155b8-cbea-4092-b82c-69175b96c1b1 req-c8fbc9b3-81b0-4076-bc4a-ef001846e1ed service nova] Lock "6ae9fe6f-eb17-44f5-89e4-fff5e3451336-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:35:04 user nova-compute[75165]: DEBUG nova.compute.manager [req-4b7155b8-cbea-4092-b82c-69175b96c1b1 req-c8fbc9b3-81b0-4076-bc4a-ef001846e1ed service nova] [instance: 6ae9fe6f-eb17-44f5-89e4-fff5e3451336] No waiting events found dispatching network-vif-plugged-5057f477-2080-4285-86a0-8f50541c3361 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:35:04 user nova-compute[75165]: WARNING nova.compute.manager [req-4b7155b8-cbea-4092-b82c-69175b96c1b1 req-c8fbc9b3-81b0-4076-bc4a-ef001846e1ed service nova] [instance: 6ae9fe6f-eb17-44f5-89e4-fff5e3451336] Received unexpected event network-vif-plugged-5057f477-2080-4285-86a0-8f50541c3361 for instance with vm_state building and task_state spawning.
Oct 26 00:35:04 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:35:04 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:35:04 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:35:06 user nova-compute[75165]: DEBUG nova.compute.manager [req-f638dded-9e24-493f-b7a5-106f27c1e97f req-45fcb8ea-cae5-4ef3-9a16-b5c36ecbf230 service nova] [instance: 6ae9fe6f-eb17-44f5-89e4-fff5e3451336] Received event network-vif-plugged-5057f477-2080-4285-86a0-8f50541c3361 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:35:06 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-f638dded-9e24-493f-b7a5-106f27c1e97f req-45fcb8ea-cae5-4ef3-9a16-b5c36ecbf230 service nova] Acquiring lock "6ae9fe6f-eb17-44f5-89e4-fff5e3451336-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:35:06 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-f638dded-9e24-493f-b7a5-106f27c1e97f req-45fcb8ea-cae5-4ef3-9a16-b5c36ecbf230 service nova] Lock "6ae9fe6f-eb17-44f5-89e4-fff5e3451336-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:35:06 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-f638dded-9e24-493f-b7a5-106f27c1e97f req-45fcb8ea-cae5-4ef3-9a16-b5c36ecbf230 service nova] Lock "6ae9fe6f-eb17-44f5-89e4-fff5e3451336-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:35:06 user nova-compute[75165]: DEBUG nova.compute.manager [req-f638dded-9e24-493f-b7a5-106f27c1e97f req-45fcb8ea-cae5-4ef3-9a16-b5c36ecbf230 service nova] [instance: 6ae9fe6f-eb17-44f5-89e4-fff5e3451336] No waiting events found dispatching network-vif-plugged-5057f477-2080-4285-86a0-8f50541c3361 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:35:06 user nova-compute[75165]: WARNING nova.compute.manager [req-f638dded-9e24-493f-b7a5-106f27c1e97f req-45fcb8ea-cae5-4ef3-9a16-b5c36ecbf230 service nova] [instance: 6ae9fe6f-eb17-44f5-89e4-fff5e3451336] Received unexpected event network-vif-plugged-5057f477-2080-4285-86a0-8f50541c3361 for instance with vm_state building and task_state spawning.
Oct 26 00:35:06 user nova-compute[75165]: DEBUG nova.compute.manager [None req-966fb094-f52e-4c67-a3f3-1d3be7cbcf9f tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] [instance: 6ae9fe6f-eb17-44f5-89e4-fff5e3451336] Instance event wait completed in 0 seconds for  {{(pid=75165) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 00:35:06 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-966fb094-f52e-4c67-a3f3-1d3be7cbcf9f tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] [instance: 6ae9fe6f-eb17-44f5-89e4-fff5e3451336] Guest created on hypervisor {{(pid=75165) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 00:35:06 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: 6ae9fe6f-eb17-44f5-89e4-fff5e3451336] Instance spawned successfully.
Oct 26 00:35:06 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-966fb094-f52e-4c67-a3f3-1d3be7cbcf9f tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] [instance: 6ae9fe6f-eb17-44f5-89e4-fff5e3451336] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 00:35:06 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-966fb094-f52e-4c67-a3f3-1d3be7cbcf9f tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] [instance: 6ae9fe6f-eb17-44f5-89e4-fff5e3451336] Found default for hw_cdrom_bus of ide {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:35:06 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-966fb094-f52e-4c67-a3f3-1d3be7cbcf9f tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] [instance: 6ae9fe6f-eb17-44f5-89e4-fff5e3451336] Found default for hw_disk_bus of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:35:06 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-966fb094-f52e-4c67-a3f3-1d3be7cbcf9f tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] [instance: 6ae9fe6f-eb17-44f5-89e4-fff5e3451336] Found default for hw_input_bus of None {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:35:06 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-966fb094-f52e-4c67-a3f3-1d3be7cbcf9f tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] [instance: 6ae9fe6f-eb17-44f5-89e4-fff5e3451336] Found default for hw_pointer_model of None {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:35:06 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-966fb094-f52e-4c67-a3f3-1d3be7cbcf9f tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] [instance: 6ae9fe6f-eb17-44f5-89e4-fff5e3451336] Found default for hw_video_model of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:35:06 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-966fb094-f52e-4c67-a3f3-1d3be7cbcf9f tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] [instance: 6ae9fe6f-eb17-44f5-89e4-fff5e3451336] Found default for hw_vif_model of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:35:06 user nova-compute[75165]: INFO nova.compute.manager [None req-966fb094-f52e-4c67-a3f3-1d3be7cbcf9f tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] [instance: 6ae9fe6f-eb17-44f5-89e4-fff5e3451336] Took 5.91 seconds to spawn the instance on the hypervisor.
Oct 26 00:35:06 user nova-compute[75165]: DEBUG nova.compute.manager [None req-966fb094-f52e-4c67-a3f3-1d3be7cbcf9f tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] [instance: 6ae9fe6f-eb17-44f5-89e4-fff5e3451336] Checking state {{(pid=75165) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 00:35:06 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:35:06 user nova-compute[75165]: INFO nova.compute.manager [None req-966fb094-f52e-4c67-a3f3-1d3be7cbcf9f tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] [instance: 6ae9fe6f-eb17-44f5-89e4-fff5e3451336] Took 6.99 seconds to build instance.
Oct 26 00:35:06 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-966fb094-f52e-4c67-a3f3-1d3be7cbcf9f tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Lock "6ae9fe6f-eb17-44f5-89e4-fff5e3451336" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.120s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:35:07 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:35:11 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:35:11 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:35:12 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:35:16 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:35:17 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:35:18 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-5c8764b7-5269-49b0-973b-14757e18f9a3 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Acquiring lock "c7a55179-cde6-4fbd-a8b3-c3df149bc6f3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:35:18 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-5c8764b7-5269-49b0-973b-14757e18f9a3 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Lock "c7a55179-cde6-4fbd-a8b3-c3df149bc6f3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:35:18 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-5c8764b7-5269-49b0-973b-14757e18f9a3 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Acquiring lock "c7a55179-cde6-4fbd-a8b3-c3df149bc6f3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:35:18 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-5c8764b7-5269-49b0-973b-14757e18f9a3 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Lock "c7a55179-cde6-4fbd-a8b3-c3df149bc6f3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:35:18 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-5c8764b7-5269-49b0-973b-14757e18f9a3 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Lock "c7a55179-cde6-4fbd-a8b3-c3df149bc6f3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:35:18 user nova-compute[75165]: INFO nova.compute.manager [None req-5c8764b7-5269-49b0-973b-14757e18f9a3 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: c7a55179-cde6-4fbd-a8b3-c3df149bc6f3] Terminating instance
Oct 26 00:35:18 user nova-compute[75165]: DEBUG nova.compute.manager [None req-5c8764b7-5269-49b0-973b-14757e18f9a3 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: c7a55179-cde6-4fbd-a8b3-c3df149bc6f3] Start destroying the instance on the hypervisor. {{(pid=75165) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 00:35:18 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:35:19 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:35:19 user nova-compute[75165]: DEBUG nova.compute.manager [req-4ff0bb29-a2b6-4eb4-98f6-64247456d1b3 req-591748c0-9a17-4192-a2c1-8db7c886915a service nova] [instance: c7a55179-cde6-4fbd-a8b3-c3df149bc6f3] Received event network-vif-unplugged-70711118-68ee-4ea5-bfc2-df652ed0f3c1 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:35:19 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-4ff0bb29-a2b6-4eb4-98f6-64247456d1b3 req-591748c0-9a17-4192-a2c1-8db7c886915a service nova] Acquiring lock "c7a55179-cde6-4fbd-a8b3-c3df149bc6f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:35:19 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-4ff0bb29-a2b6-4eb4-98f6-64247456d1b3 req-591748c0-9a17-4192-a2c1-8db7c886915a service nova] Lock "c7a55179-cde6-4fbd-a8b3-c3df149bc6f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:35:19 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-4ff0bb29-a2b6-4eb4-98f6-64247456d1b3 req-591748c0-9a17-4192-a2c1-8db7c886915a service nova] Lock "c7a55179-cde6-4fbd-a8b3-c3df149bc6f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:35:19 user nova-compute[75165]: DEBUG nova.compute.manager [req-4ff0bb29-a2b6-4eb4-98f6-64247456d1b3 req-591748c0-9a17-4192-a2c1-8db7c886915a service nova] [instance: c7a55179-cde6-4fbd-a8b3-c3df149bc6f3] No waiting events found dispatching network-vif-unplugged-70711118-68ee-4ea5-bfc2-df652ed0f3c1 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:35:19 user nova-compute[75165]: DEBUG nova.compute.manager [req-4ff0bb29-a2b6-4eb4-98f6-64247456d1b3 req-591748c0-9a17-4192-a2c1-8db7c886915a service nova] [instance: c7a55179-cde6-4fbd-a8b3-c3df149bc6f3] Received event network-vif-unplugged-70711118-68ee-4ea5-bfc2-df652ed0f3c1 for instance with task_state deleting. {{(pid=75165) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 00:35:19 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:35:19 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75165) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 00:35:19 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:35:19 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:35:19 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:35:19 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: c7a55179-cde6-4fbd-a8b3-c3df149bc6f3] Instance destroyed successfully.
Oct 26 00:35:19 user nova-compute[75165]: DEBUG nova.objects.instance [None req-5c8764b7-5269-49b0-973b-14757e18f9a3 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Lazy-loading 'resources' on Instance uuid c7a55179-cde6-4fbd-a8b3-c3df149bc6f3 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:35:19 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-5c8764b7-5269-49b0-973b-14757e18f9a3 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:29:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1904019446',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1904019446',id=36,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-26T00:31:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d616862c7c184de5b0ba3121552c5666',ramdisk_id='',reservation_id='r-jr45148e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-638746030',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T00:33:33Z,user_data=None,user_id='dbe0d52293264f33ae86de41dabeefcf',uuid=c7a55179-cde6-4fbd-a8b3-c3df149bc6f3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "70711118-68ee-4ea5-bfc2-df652ed0f3c1", "address": "fa:16:3e:91:b1:a6", "network": {"id": "eb55c0bc-cae5-4ba3-851a-e31a50b52c88", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1081223830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d616862c7c184de5b0ba3121552c5666", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70711118-68", "ovs_interfaceid": "70711118-68ee-4ea5-bfc2-df652ed0f3c1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 00:35:19 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-5c8764b7-5269-49b0-973b-14757e18f9a3 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Converting VIF {"id": "70711118-68ee-4ea5-bfc2-df652ed0f3c1", "address": "fa:16:3e:91:b1:a6", "network": {"id": "eb55c0bc-cae5-4ba3-851a-e31a50b52c88", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1081223830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d616862c7c184de5b0ba3121552c5666", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70711118-68", "ovs_interfaceid": "70711118-68ee-4ea5-bfc2-df652ed0f3c1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:35:19 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-5c8764b7-5269-49b0-973b-14757e18f9a3 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:91:b1:a6,bridge_name='br-int',has_traffic_filtering=True,id=70711118-68ee-4ea5-bfc2-df652ed0f3c1,network=Network(eb55c0bc-cae5-4ba3-851a-e31a50b52c88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70711118-68') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:35:19 user nova-compute[75165]: DEBUG os_vif [None req-5c8764b7-5269-49b0-973b-14757e18f9a3 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:91:b1:a6,bridge_name='br-int',has_traffic_filtering=True,id=70711118-68ee-4ea5-bfc2-df652ed0f3c1,network=Network(eb55c0bc-cae5-4ba3-851a-e31a50b52c88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70711118-68') {{(pid=75165) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 00:35:19 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:35:19 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap70711118-68, bridge=br-int, if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:35:19 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:35:19 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:35:19 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:35:19 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7ceee95b-28ab-4752-a905-4faa67b81dad) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:35:19 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:35:19 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:35:19 user nova-compute[75165]: INFO os_vif [None req-5c8764b7-5269-49b0-973b-14757e18f9a3 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:91:b1:a6,bridge_name='br-int',has_traffic_filtering=True,id=70711118-68ee-4ea5-bfc2-df652ed0f3c1,network=Network(eb55c0bc-cae5-4ba3-851a-e31a50b52c88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70711118-68')
Oct 26 00:35:19 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c8764b7-5269-49b0-973b-14757e18f9a3 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: c7a55179-cde6-4fbd-a8b3-c3df149bc6f3] calling os-brick to detach iSCSI Volume {{(pid=75165) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 00:35:19 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c8764b7-5269-49b0-973b-14757e18f9a3 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8bf8160e50>, {'target_iqn': 'iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nWaNcYSH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:35:19 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-5c8764b7-5269-49b0-973b-14757e18f9a3 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:35:19 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-5c8764b7-5269-49b0-973b-14757e18f9a3 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:35:19 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-5c8764b7-5269-49b0-973b-14757e18f9a3 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:35:19 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:35:19 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:35:19 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c42ab69-ec01-453d-91a7-543d5243609b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:35:19 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c8764b7-5269-49b0-973b-14757e18f9a3 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 00:35:19 user nova-compute[75165]: No targets found.
Oct 26 00:35:19 user nova-compute[75165]: iSNS:
Oct 26 00:35:19 user nova-compute[75165]: No targets found.
Oct 26 00:35:19 user nova-compute[75165]: STATIC:
Oct 26 00:35:19 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8
Oct 26 00:35:19 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:35:19 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:35:19 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795
Oct 26 00:35:19 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:35:19 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:35:19 user nova-compute[75165]: FIRMWARE:
Oct 26 00:35:19 user nova-compute[75165]: No targets found.
Oct 26 00:35:19 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:35:19 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c8764b7-5269-49b0-973b-14757e18f9a3 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 00:35:19 user nova-compute[75165]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 00:35:19 user nova-compute[75165]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75165) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 00:35:19 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c8764b7-5269-49b0-973b-14757e18f9a3 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8', 0)] {{(pid=75165) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 00:35:19 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:35:19 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:35:19 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eaed273-77ac-4513-8e89-8fb8e4368059]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:35:19 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:35:19 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:35:19 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc857dbf-5901-43a6-bf45-9afcc7b8282b]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8 (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:35:19 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c8764b7-5269-49b0-973b-14757e18f9a3 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)
Oct 26 00:35:19 user nova-compute[75165]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8 (non-flash)
Oct 26 00:35:19 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:35:19 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c8764b7-5269-49b0-973b-14757e18f9a3 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)
Oct 26 00:35:19 user nova-compute[75165]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8 (non-flash)
Oct 26 00:35:19 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:35:19 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c8764b7-5269-49b0-973b-14757e18f9a3 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8be04e52d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8'): ({'sdc'}, set())}) {{(pid=75165) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 00:35:19 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-5c8764b7-5269-49b0-973b-14757e18f9a3 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Removing single pathed devices sdc {{(pid=75165) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 00:35:19 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:35:19 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:35:19 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[0af4bd29-3db2-48d5-ba50-a3361b38415c]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:35:19 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:35:19 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.024s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:35:19 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6fe5ebe-d95a-4fad-8d60-e87ac6c8309c]: (4, ('ok\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:35:19 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-5c8764b7-5269-49b0-973b-14757e18f9a3 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Flushing IO for device /dev/sdc {{(pid=75165) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 00:35:19 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:35:19 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.022s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:35:19 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1bdbc77-6e95-4bd7-b248-cbabbacccd4d]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:35:19 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-5c8764b7-5269-49b0-973b-14757e18f9a3 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75165) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 00:35:19 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:35:19 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.039s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:35:19 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[9294d086-7c0c-4a5b-92b2-b6c6d4357b7d]: (4, ('1', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:35:19 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-5c8764b7-5269-49b0-973b-14757e18f9a3 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75165) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 00:35:19 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-5c8764b7-5269-49b0-973b-14757e18f9a3 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] SCSI volumes sdc have been removed. {{(pid=75165) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 00:35:19 user nova-compute[75165]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO5edf2708-c328f930da2a7922', '/dev/disk/by-id/scsi-26333323866393330', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_5edf2708') {{(pid=86976) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 26 00:35:19 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbc591af-541b-4677-8fde-379a5b845d04]: (4, None) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:35:19 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c8764b7-5269-49b0-973b-14757e18f9a3 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8')] {{(pid=75165) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 00:35:19 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:35:20 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:35:20 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[95948c17-62f9-4ef3-9e6c-9d6813503722]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:35:20 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c8764b7-5269-49b0-973b-14757e18f9a3 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:35:20 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8 -p 172.16.0.220:3260 --logout {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:35:20 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:35:20 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[db6a397e-46b1-4633-aabc-cd8ffd72c049]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:35:20 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c8764b7-5269-49b0-973b-14757e18f9a3 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8, portal: 172.16.0.220,3260]
Oct 26 00:35:20 user nova-compute[75165]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8, portal: 172.16.0.220,3260] successful.
Oct 26 00:35:20 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:35:20 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8 -p 172.16.0.220:3260 --op delete {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:35:20 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d249e808-e145-4ed5-a1a6-a550f7c6b3b8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:35:20 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb3e3517-4140-4000-be6c-72970a64bb57]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:35:20 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c8764b7-5269-49b0-973b-14757e18f9a3 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:35:20 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-5c8764b7-5269-49b0-973b-14757e18f9a3 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.353s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:35:20 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c8764b7-5269-49b0-973b-14757e18f9a3 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] <== disconnect_volume: return (354ms) None {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:35:20 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c8764b7-5269-49b0-973b-14757e18f9a3 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: c7a55179-cde6-4fbd-a8b3-c3df149bc6f3] Disconnected iSCSI Volume {{(pid=75165) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 00:35:20 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-5c8764b7-5269-49b0-973b-14757e18f9a3 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: c7a55179-cde6-4fbd-a8b3-c3df149bc6f3] Deleting instance files /opt/stack/data/nova/instances/c7a55179-cde6-4fbd-a8b3-c3df149bc6f3_del
Oct 26 00:35:20 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-5c8764b7-5269-49b0-973b-14757e18f9a3 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: c7a55179-cde6-4fbd-a8b3-c3df149bc6f3] Deletion of /opt/stack/data/nova/instances/c7a55179-cde6-4fbd-a8b3-c3df149bc6f3_del complete
Oct 26 00:35:20 user nova-compute[75165]: INFO nova.compute.manager [None req-5c8764b7-5269-49b0-973b-14757e18f9a3 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: c7a55179-cde6-4fbd-a8b3-c3df149bc6f3] Took 1.32 seconds to destroy the instance on the hypervisor.
Oct 26 00:35:20 user nova-compute[75165]: DEBUG oslo.service.loopingcall [None req-5c8764b7-5269-49b0-973b-14757e18f9a3 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75165) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 00:35:20 user nova-compute[75165]: DEBUG nova.compute.manager [-] [instance: c7a55179-cde6-4fbd-a8b3-c3df149bc6f3] Deallocating network for instance {{(pid=75165) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 00:35:20 user nova-compute[75165]: DEBUG nova.network.neutron [-] [instance: c7a55179-cde6-4fbd-a8b3-c3df149bc6f3] deallocate_for_instance() {{(pid=75165) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 00:35:20 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:35:20 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:35:21 user nova-compute[75165]: DEBUG nova.network.neutron [-] [instance: c7a55179-cde6-4fbd-a8b3-c3df149bc6f3] Updating instance_info_cache with network_info: [] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:35:21 user nova-compute[75165]: INFO nova.compute.manager [-] [instance: c7a55179-cde6-4fbd-a8b3-c3df149bc6f3] Took 0.80 seconds to deallocate network for instance.
Oct 26 00:35:21 user nova-compute[75165]: DEBUG nova.compute.manager [req-c2d1baa8-e06d-4bb3-a6ba-c28ac281ad37 req-e211234b-6d39-48d9-8aeb-eafa137df15c service nova] [instance: c7a55179-cde6-4fbd-a8b3-c3df149bc6f3] Received event network-vif-deleted-70711118-68ee-4ea5-bfc2-df652ed0f3c1 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:35:21 user nova-compute[75165]: DEBUG nova.compute.manager [req-bb64c389-9122-404d-af45-946975ab4ca0 req-0cb21287-fae3-453e-8738-c7a100e59339 service nova] [instance: c7a55179-cde6-4fbd-a8b3-c3df149bc6f3] Received event network-vif-plugged-70711118-68ee-4ea5-bfc2-df652ed0f3c1 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:35:21 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-bb64c389-9122-404d-af45-946975ab4ca0 req-0cb21287-fae3-453e-8738-c7a100e59339 service nova] Acquiring lock "c7a55179-cde6-4fbd-a8b3-c3df149bc6f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:35:21 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-bb64c389-9122-404d-af45-946975ab4ca0 req-0cb21287-fae3-453e-8738-c7a100e59339 service nova] Lock "c7a55179-cde6-4fbd-a8b3-c3df149bc6f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:35:21 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-bb64c389-9122-404d-af45-946975ab4ca0 req-0cb21287-fae3-453e-8738-c7a100e59339 service nova] Lock "c7a55179-cde6-4fbd-a8b3-c3df149bc6f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:35:21 user nova-compute[75165]: DEBUG nova.compute.manager [req-bb64c389-9122-404d-af45-946975ab4ca0 req-0cb21287-fae3-453e-8738-c7a100e59339 service nova] [instance: c7a55179-cde6-4fbd-a8b3-c3df149bc6f3] No waiting events found dispatching network-vif-plugged-70711118-68ee-4ea5-bfc2-df652ed0f3c1 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:35:21 user nova-compute[75165]: WARNING nova.compute.manager [req-bb64c389-9122-404d-af45-946975ab4ca0 req-0cb21287-fae3-453e-8738-c7a100e59339 service nova] [instance: c7a55179-cde6-4fbd-a8b3-c3df149bc6f3] Received unexpected event network-vif-plugged-70711118-68ee-4ea5-bfc2-df652ed0f3c1 for instance with vm_state active and task_state deleting.
Oct 26 00:35:21 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:35:22 user nova-compute[75165]: INFO nova.compute.manager [None req-5c8764b7-5269-49b0-973b-14757e18f9a3 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: c7a55179-cde6-4fbd-a8b3-c3df149bc6f3] Took 1.08 seconds to detach 1 volumes for instance.
Oct 26 00:35:22 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-5c8764b7-5269-49b0-973b-14757e18f9a3 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:35:22 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-5c8764b7-5269-49b0-973b-14757e18f9a3 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:35:22 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-5c8764b7-5269-49b0-973b-14757e18f9a3 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:35:22 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-5c8764b7-5269-49b0-973b-14757e18f9a3 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:35:22 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-5c8764b7-5269-49b0-973b-14757e18f9a3 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.290s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:35:22 user nova-compute[75165]: INFO nova.scheduler.client.report [None req-5c8764b7-5269-49b0-973b-14757e18f9a3 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Deleted allocations for instance c7a55179-cde6-4fbd-a8b3-c3df149bc6f3
Oct 26 00:35:22 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-5c8764b7-5269-49b0-973b-14757e18f9a3 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Lock "c7a55179-cde6-4fbd-a8b3-c3df149bc6f3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.673s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:35:23 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:35:23 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:35:24 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:35:24 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:35:24 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:35:24 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:35:25 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:35:25 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:35:25 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Starting heal instance info cache {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 00:35:26 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "refresh_cache-fe2984ce-8958-4049-8af7-496b313b26c8" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:35:26 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquired lock "refresh_cache-fe2984ce-8958-4049-8af7-496b313b26c8" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:35:26 user nova-compute[75165]: DEBUG nova.network.neutron [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: fe2984ce-8958-4049-8af7-496b313b26c8] Forcefully refreshing network info cache for instance {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 00:35:26 user nova-compute[75165]: DEBUG nova.network.neutron [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: fe2984ce-8958-4049-8af7-496b313b26c8] Updating instance_info_cache with network_info: [{"id": "5995df96-1576-4616-8834-45073add32a2", "address": "fa:16:3e:ca:36:c4", "network": {"id": "7c8ed206-c41f-4c32-837b-b50fb4ee5479", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1704810529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "567a90e8d8b24ca4b5e5da923d537134", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5995df96-15", "ovs_interfaceid": "5995df96-1576-4616-8834-45073add32a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:35:26 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Releasing lock "refresh_cache-fe2984ce-8958-4049-8af7-496b313b26c8" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:35:26 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: fe2984ce-8958-4049-8af7-496b313b26c8] Updated the network info_cache for instance {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 00:35:26 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:35:28 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:35:28 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:35:28 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:35:28 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:35:28 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:35:28 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75165) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 00:35:29 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75165) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 00:35:29 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97fb67a7-637d-456f-b4dd-0a271ed6cfc4/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:35:29 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97fb67a7-637d-456f-b4dd-0a271ed6cfc4/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:35:29 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97fb67a7-637d-456f-b4dd-0a271ed6cfc4/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:35:29 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97fb67a7-637d-456f-b4dd-0a271ed6cfc4/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:35:29 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e534595-7eaf-49f4-b457-9f37bc59012b/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:35:29 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e534595-7eaf-49f4-b457-9f37bc59012b/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:35:29 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e534595-7eaf-49f4-b457-9f37bc59012b/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:35:29 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:35:29 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e534595-7eaf-49f4-b457-9f37bc59012b/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:35:29 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3c87b07-5c16-4f45-b320-06d3503d23e6/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:35:30 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3c87b07-5c16-4f45-b320-06d3503d23e6/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:35:30 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3c87b07-5c16-4f45-b320-06d3503d23e6/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:35:30 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3c87b07-5c16-4f45-b320-06d3503d23e6/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:35:30 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae9fe6f-eb17-44f5-89e4-fff5e3451336/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:35:30 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae9fe6f-eb17-44f5-89e4-fff5e3451336/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:35:30 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae9fe6f-eb17-44f5-89e4-fff5e3451336/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:35:30 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae9fe6f-eb17-44f5-89e4-fff5e3451336/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:35:30 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe2984ce-8958-4049-8af7-496b313b26c8/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:35:30 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe2984ce-8958-4049-8af7-496b313b26c8/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:35:30 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe2984ce-8958-4049-8af7-496b313b26c8/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:35:31 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe2984ce-8958-4049-8af7-496b313b26c8/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:35:31 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:35:31 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:35:31 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Hypervisor/Node resource view: name=user free_ram=8196MB free_disk=24.62762451171875GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75165) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 00:35:31 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:35:31 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:35:31 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 97fb67a7-637d-456f-b4dd-0a271ed6cfc4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:35:31 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:35:31 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance fe2984ce-8958-4049-8af7-496b313b26c8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:35:31 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance b3c87b07-5c16-4f45-b320-06d3503d23e6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:35:31 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 7e534595-7eaf-49f4-b457-9f37bc59012b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:35:31 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 6ae9fe6f-eb17-44f5-89e4-fff5e3451336 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:35:31 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75165) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 00:35:31 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75165) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 00:35:31 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:35:31 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:35:32 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:35:32 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Compute_service record updated for user:user {{(pid=75165) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 00:35:32 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.433s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:35:34 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:35:36 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:35:39 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:35:41 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:35:43 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:35:44 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:35:44 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:35:46 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:35:49 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:35:51 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:35:53 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-e9f00c2a-5524-40eb-8edc-09805baa3250 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Acquiring lock "49f1d1d3-4f34-49b3-ae89-206672d86cf0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:35:53 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-e9f00c2a-5524-40eb-8edc-09805baa3250 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Lock "49f1d1d3-4f34-49b3-ae89-206672d86cf0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:35:53 user nova-compute[75165]: DEBUG nova.compute.manager [None req-e9f00c2a-5524-40eb-8edc-09805baa3250 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 49f1d1d3-4f34-49b3-ae89-206672d86cf0] Starting instance... {{(pid=75165) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 00:35:53 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-e9f00c2a-5524-40eb-8edc-09805baa3250 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:35:53 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-e9f00c2a-5524-40eb-8edc-09805baa3250 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:35:53 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-e9f00c2a-5524-40eb-8edc-09805baa3250 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75165) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 00:35:53 user nova-compute[75165]: INFO nova.compute.claims [None req-e9f00c2a-5524-40eb-8edc-09805baa3250 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 49f1d1d3-4f34-49b3-ae89-206672d86cf0] Claim successful on node user
Oct 26 00:35:53 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-e9f00c2a-5524-40eb-8edc-09805baa3250 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:35:53 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-e9f00c2a-5524-40eb-8edc-09805baa3250 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:35:53 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-e9f00c2a-5524-40eb-8edc-09805baa3250 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.363s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:35:53 user nova-compute[75165]: DEBUG nova.compute.manager [None req-e9f00c2a-5524-40eb-8edc-09805baa3250 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 49f1d1d3-4f34-49b3-ae89-206672d86cf0] Start building networks asynchronously for instance. {{(pid=75165) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 00:35:53 user nova-compute[75165]: DEBUG nova.compute.manager [None req-e9f00c2a-5524-40eb-8edc-09805baa3250 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 49f1d1d3-4f34-49b3-ae89-206672d86cf0] Allocating IP information in the background. {{(pid=75165) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 00:35:53 user nova-compute[75165]: DEBUG nova.network.neutron [None req-e9f00c2a-5524-40eb-8edc-09805baa3250 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 49f1d1d3-4f34-49b3-ae89-206672d86cf0] allocate_for_instance() {{(pid=75165) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 00:35:53 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-e9f00c2a-5524-40eb-8edc-09805baa3250 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 49f1d1d3-4f34-49b3-ae89-206672d86cf0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 00:35:53 user nova-compute[75165]: DEBUG nova.compute.manager [None req-e9f00c2a-5524-40eb-8edc-09805baa3250 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 49f1d1d3-4f34-49b3-ae89-206672d86cf0] Start building block device mappings for instance. {{(pid=75165) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 00:35:53 user nova-compute[75165]: INFO nova.virt.block_device [None req-e9f00c2a-5524-40eb-8edc-09805baa3250 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 49f1d1d3-4f34-49b3-ae89-206672d86cf0] Booting with volume snapshot c8ae8d82-5846-4630-9253-0408cfe07efc at /dev/vda
Oct 26 00:35:53 user nova-compute[75165]: DEBUG nova.policy [None req-e9f00c2a-5524-40eb-8edc-09805baa3250 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ae836eab78514cf3894e5e11240ff374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1051405ca054c4bb051fb842a5fb5a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75165) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 00:35:54 user nova-compute[75165]: DEBUG nova.network.neutron [None req-e9f00c2a-5524-40eb-8edc-09805baa3250 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 49f1d1d3-4f34-49b3-ae89-206672d86cf0] Successfully created port: f815091d-bc66-47a6-8251-127c3e8275a5 {{(pid=75165) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 00:35:54 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:35:55 user nova-compute[75165]: DEBUG nova.network.neutron [None req-e9f00c2a-5524-40eb-8edc-09805baa3250 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 49f1d1d3-4f34-49b3-ae89-206672d86cf0] Successfully updated port: f815091d-bc66-47a6-8251-127c3e8275a5 {{(pid=75165) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 00:35:55 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-e9f00c2a-5524-40eb-8edc-09805baa3250 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Acquiring lock "refresh_cache-49f1d1d3-4f34-49b3-ae89-206672d86cf0" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:35:55 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-e9f00c2a-5524-40eb-8edc-09805baa3250 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Acquired lock "refresh_cache-49f1d1d3-4f34-49b3-ae89-206672d86cf0" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:35:55 user nova-compute[75165]: DEBUG nova.network.neutron [None req-e9f00c2a-5524-40eb-8edc-09805baa3250 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 49f1d1d3-4f34-49b3-ae89-206672d86cf0] Building network info cache for instance {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 00:35:55 user nova-compute[75165]: DEBUG nova.compute.manager [req-1b048314-76d1-446b-9c17-99672d2776ff req-32342905-5207-4fb1-a455-50e152dbabdc service nova] [instance: 49f1d1d3-4f34-49b3-ae89-206672d86cf0] Received event network-changed-f815091d-bc66-47a6-8251-127c3e8275a5 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:35:55 user nova-compute[75165]: DEBUG nova.compute.manager [req-1b048314-76d1-446b-9c17-99672d2776ff req-32342905-5207-4fb1-a455-50e152dbabdc service nova] [instance: 49f1d1d3-4f34-49b3-ae89-206672d86cf0] Refreshing instance network info cache due to event network-changed-f815091d-bc66-47a6-8251-127c3e8275a5. {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 00:35:55 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-1b048314-76d1-446b-9c17-99672d2776ff req-32342905-5207-4fb1-a455-50e152dbabdc service nova] Acquiring lock "refresh_cache-49f1d1d3-4f34-49b3-ae89-206672d86cf0" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:35:55 user nova-compute[75165]: DEBUG nova.network.neutron [None req-e9f00c2a-5524-40eb-8edc-09805baa3250 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 49f1d1d3-4f34-49b3-ae89-206672d86cf0] Instance cache missing network info. {{(pid=75165) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 00:35:55 user nova-compute[75165]: DEBUG nova.network.neutron [None req-e9f00c2a-5524-40eb-8edc-09805baa3250 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 49f1d1d3-4f34-49b3-ae89-206672d86cf0] Updating instance_info_cache with network_info: [{"id": "f815091d-bc66-47a6-8251-127c3e8275a5", "address": "fa:16:3e:d4:33:22", "network": {"id": "dc50ae7b-d501-461f-aa0b-542514330ae8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1091857056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1051405ca054c4bb051fb842a5fb5a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf815091d-bc", "ovs_interfaceid": "f815091d-bc66-47a6-8251-127c3e8275a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:35:55 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-e9f00c2a-5524-40eb-8edc-09805baa3250 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Releasing lock "refresh_cache-49f1d1d3-4f34-49b3-ae89-206672d86cf0" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:35:55 user nova-compute[75165]: DEBUG nova.compute.manager [None req-e9f00c2a-5524-40eb-8edc-09805baa3250 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 49f1d1d3-4f34-49b3-ae89-206672d86cf0] Instance network_info: |[{"id": "f815091d-bc66-47a6-8251-127c3e8275a5", "address": "fa:16:3e:d4:33:22", "network": {"id": "dc50ae7b-d501-461f-aa0b-542514330ae8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1091857056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1051405ca054c4bb051fb842a5fb5a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf815091d-bc", "ovs_interfaceid": "f815091d-bc66-47a6-8251-127c3e8275a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75165) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 00:35:55 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-1b048314-76d1-446b-9c17-99672d2776ff req-32342905-5207-4fb1-a455-50e152dbabdc service nova] Acquired lock "refresh_cache-49f1d1d3-4f34-49b3-ae89-206672d86cf0" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:35:55 user nova-compute[75165]: DEBUG nova.network.neutron [req-1b048314-76d1-446b-9c17-99672d2776ff req-32342905-5207-4fb1-a455-50e152dbabdc service nova] [instance: 49f1d1d3-4f34-49b3-ae89-206672d86cf0] Refreshing network info cache for port f815091d-bc66-47a6-8251-127c3e8275a5 {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 00:35:56 user nova-compute[75165]: DEBUG nova.network.neutron [req-1b048314-76d1-446b-9c17-99672d2776ff req-32342905-5207-4fb1-a455-50e152dbabdc service nova] [instance: 49f1d1d3-4f34-49b3-ae89-206672d86cf0] Updated VIF entry in instance network info cache for port f815091d-bc66-47a6-8251-127c3e8275a5. {{(pid=75165) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 00:35:56 user nova-compute[75165]: DEBUG nova.network.neutron [req-1b048314-76d1-446b-9c17-99672d2776ff req-32342905-5207-4fb1-a455-50e152dbabdc service nova] [instance: 49f1d1d3-4f34-49b3-ae89-206672d86cf0] Updating instance_info_cache with network_info: [{"id": "f815091d-bc66-47a6-8251-127c3e8275a5", "address": "fa:16:3e:d4:33:22", "network": {"id": "dc50ae7b-d501-461f-aa0b-542514330ae8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1091857056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1051405ca054c4bb051fb842a5fb5a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf815091d-bc", "ovs_interfaceid": "f815091d-bc66-47a6-8251-127c3e8275a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:35:56 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-1b048314-76d1-446b-9c17-99672d2776ff req-32342905-5207-4fb1-a455-50e152dbabdc service nova] Releasing lock "refresh_cache-49f1d1d3-4f34-49b3-ae89-206672d86cf0" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:35:56 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:35:59 user nova-compute[75165]: DEBUG os_brick.utils [None req-e9f00c2a-5524-40eb-8edc-09805baa3250 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:35:59 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:35:59 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:35:59 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[43f2f385-5442-4fb6-8914-9195fa96c689]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa94814ccb35\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:35:59 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:35:59 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:35:59 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0f1f8ab-b390-452b-a553-b0825a91e15f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:35:59 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:35:59 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:35:59 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bac6331-c4c9-4521-a2fa-fcfa637a69eb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:35:59 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[d546c912-d127-4afc-8162-49a6b102b7e1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:35:59 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-e9f00c2a-5524-40eb-8edc-09805baa3250 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Running cmd (subprocess): nvme version {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:35:59 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-e9f00c2a-5524-40eb-8edc-09805baa3250 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] 'nvme version' failed. Not Retrying. {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 00:35:59 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e9f00c2a-5524-40eb-8edc-09805baa3250 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] nvme not present on system {{(pid=75165) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 00:35:59 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:35:59 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 00:35:59 user nova-compute[75165]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 00:35:59 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[da14efc6-fc5a-4ac2-8f46-a6d363166fa6]: (4, '') {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:35:59 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-e9f00c2a-5524-40eb-8edc-09805baa3250 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75165) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 00:35:59 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-e9f00c2a-5524-40eb-8edc-09805baa3250 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75165) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 00:35:59 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-e9f00c2a-5524-40eb-8edc-09805baa3250 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] LIGHTOS: no hostnqn found. {{(pid=75165) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 00:35:59 user nova-compute[75165]: DEBUG os_brick.utils [None req-e9f00c2a-5524-40eb-8edc-09805baa3250 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa94814ccb35', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:35:59 user nova-compute[75165]: DEBUG nova.virt.block_device [None req-e9f00c2a-5524-40eb-8edc-09805baa3250 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 49f1d1d3-4f34-49b3-ae89-206672d86cf0] Updating existing volume attachment record: e36bad5c-69f3-4523-ba0e-842d331e4c13 {{(pid=75165) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 00:35:59 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:36:04 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:36:09 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:36:09 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-7ea754a1-3223-4769-a5c8-f1b80532d63a tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Acquiring lock "b3c87b07-5c16-4f45-b320-06d3503d23e6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:36:09 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-7ea754a1-3223-4769-a5c8-f1b80532d63a tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Lock "b3c87b07-5c16-4f45-b320-06d3503d23e6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:36:09 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-7ea754a1-3223-4769-a5c8-f1b80532d63a tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Acquiring lock "b3c87b07-5c16-4f45-b320-06d3503d23e6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:36:09 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-7ea754a1-3223-4769-a5c8-f1b80532d63a tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Lock "b3c87b07-5c16-4f45-b320-06d3503d23e6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:36:09 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-7ea754a1-3223-4769-a5c8-f1b80532d63a tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Lock "b3c87b07-5c16-4f45-b320-06d3503d23e6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:36:09 user nova-compute[75165]: INFO nova.compute.manager [None req-7ea754a1-3223-4769-a5c8-f1b80532d63a tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: b3c87b07-5c16-4f45-b320-06d3503d23e6] Terminating instance
Oct 26 00:36:09 user nova-compute[75165]: DEBUG nova.compute.manager [None req-7ea754a1-3223-4769-a5c8-f1b80532d63a tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: b3c87b07-5c16-4f45-b320-06d3503d23e6] Start destroying the instance on the hypervisor. {{(pid=75165) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 00:36:10 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:36:10 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:36:10 user nova-compute[75165]: DEBUG nova.compute.manager [req-24b0ca98-61dd-4550-a851-44341aadfbe7 req-10fc9b73-8019-4f05-99d1-a48f56200779 service nova] [instance: b3c87b07-5c16-4f45-b320-06d3503d23e6] Received event network-vif-unplugged-eec50cb9-592b-4b34-ac42-37a92ebb2a27 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:36:10 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-24b0ca98-61dd-4550-a851-44341aadfbe7 req-10fc9b73-8019-4f05-99d1-a48f56200779 service nova] Acquiring lock "b3c87b07-5c16-4f45-b320-06d3503d23e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:36:10 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-24b0ca98-61dd-4550-a851-44341aadfbe7 req-10fc9b73-8019-4f05-99d1-a48f56200779 service nova] Lock "b3c87b07-5c16-4f45-b320-06d3503d23e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:36:10 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-24b0ca98-61dd-4550-a851-44341aadfbe7 req-10fc9b73-8019-4f05-99d1-a48f56200779 service nova] Lock "b3c87b07-5c16-4f45-b320-06d3503d23e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:36:10 user nova-compute[75165]: DEBUG nova.compute.manager [req-24b0ca98-61dd-4550-a851-44341aadfbe7 req-10fc9b73-8019-4f05-99d1-a48f56200779 service nova] [instance: b3c87b07-5c16-4f45-b320-06d3503d23e6] No waiting events found dispatching network-vif-unplugged-eec50cb9-592b-4b34-ac42-37a92ebb2a27 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:36:10 user nova-compute[75165]: DEBUG nova.compute.manager [req-24b0ca98-61dd-4550-a851-44341aadfbe7 req-10fc9b73-8019-4f05-99d1-a48f56200779 service nova] [instance: b3c87b07-5c16-4f45-b320-06d3503d23e6] Received event network-vif-unplugged-eec50cb9-592b-4b34-ac42-37a92ebb2a27 for instance with task_state deleting. {{(pid=75165) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 00:36:10 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:36:10 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:36:10 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: b3c87b07-5c16-4f45-b320-06d3503d23e6] Instance destroyed successfully.
Oct 26 00:36:10 user nova-compute[75165]: DEBUG nova.objects.instance [None req-7ea754a1-3223-4769-a5c8-f1b80532d63a tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Lazy-loading 'resources' on Instance uuid b3c87b07-5c16-4f45-b320-06d3503d23e6 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:36:10 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-7ea754a1-3223-4769-a5c8-f1b80532d63a tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:26:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1470044363',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1470044363',id=32,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-26T00:26:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d616862c7c184de5b0ba3121552c5666',ramdisk_id='',reservation_id='r-gx2s4vm9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-638746030',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T00:28:43Z,user_data=None,user_id='dbe0d52293264f33ae86de41dabeefcf',uuid=b3c87b07-5c16-4f45-b320-06d3503d23e6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eec50cb9-592b-4b34-ac42-37a92ebb2a27", "address": "fa:16:3e:dc:68:1d", "network": {"id": "eb55c0bc-cae5-4ba3-851a-e31a50b52c88", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1081223830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d616862c7c184de5b0ba3121552c5666", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeec50cb9-59", "ovs_interfaceid": "eec50cb9-592b-4b34-ac42-37a92ebb2a27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 00:36:10 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-7ea754a1-3223-4769-a5c8-f1b80532d63a tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Converting VIF {"id": "eec50cb9-592b-4b34-ac42-37a92ebb2a27", "address": "fa:16:3e:dc:68:1d", "network": {"id": "eb55c0bc-cae5-4ba3-851a-e31a50b52c88", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1081223830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d616862c7c184de5b0ba3121552c5666", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeec50cb9-59", "ovs_interfaceid": "eec50cb9-592b-4b34-ac42-37a92ebb2a27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:36:10 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-7ea754a1-3223-4769-a5c8-f1b80532d63a tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:dc:68:1d,bridge_name='br-int',has_traffic_filtering=True,id=eec50cb9-592b-4b34-ac42-37a92ebb2a27,network=Network(eb55c0bc-cae5-4ba3-851a-e31a50b52c88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeec50cb9-59') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:36:10 user nova-compute[75165]: DEBUG os_vif [None req-7ea754a1-3223-4769-a5c8-f1b80532d63a tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:dc:68:1d,bridge_name='br-int',has_traffic_filtering=True,id=eec50cb9-592b-4b34-ac42-37a92ebb2a27,network=Network(eb55c0bc-cae5-4ba3-851a-e31a50b52c88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeec50cb9-59') {{(pid=75165) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 00:36:10 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:36:10 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeec50cb9-59, bridge=br-int, if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:36:10 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:36:10 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:36:10 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:36:10 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d43707d1-3489-4c64-a515-4cd30be39fce) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:36:10 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:36:10 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:36:10 user nova-compute[75165]: INFO os_vif [None req-7ea754a1-3223-4769-a5c8-f1b80532d63a tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:dc:68:1d,bridge_name='br-int',has_traffic_filtering=True,id=eec50cb9-592b-4b34-ac42-37a92ebb2a27,network=Network(eb55c0bc-cae5-4ba3-851a-e31a50b52c88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeec50cb9-59')
Oct 26 00:36:10 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-7ea754a1-3223-4769-a5c8-f1b80532d63a tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: b3c87b07-5c16-4f45-b320-06d3503d23e6] Deleting instance files /opt/stack/data/nova/instances/b3c87b07-5c16-4f45-b320-06d3503d23e6_del
Oct 26 00:36:10 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-7ea754a1-3223-4769-a5c8-f1b80532d63a tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: b3c87b07-5c16-4f45-b320-06d3503d23e6] Deletion of /opt/stack/data/nova/instances/b3c87b07-5c16-4f45-b320-06d3503d23e6_del complete
Oct 26 00:36:10 user nova-compute[75165]: INFO nova.compute.manager [None req-7ea754a1-3223-4769-a5c8-f1b80532d63a tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: b3c87b07-5c16-4f45-b320-06d3503d23e6] Took 0.90 seconds to destroy the instance on the hypervisor.
Oct 26 00:36:10 user nova-compute[75165]: DEBUG oslo.service.loopingcall [None req-7ea754a1-3223-4769-a5c8-f1b80532d63a tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75165) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 00:36:10 user nova-compute[75165]: DEBUG nova.compute.manager [-] [instance: b3c87b07-5c16-4f45-b320-06d3503d23e6] Deallocating network for instance {{(pid=75165) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 00:36:10 user nova-compute[75165]: DEBUG nova.network.neutron [-] [instance: b3c87b07-5c16-4f45-b320-06d3503d23e6] deallocate_for_instance() {{(pid=75165) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 00:36:11 user nova-compute[75165]: DEBUG nova.network.neutron [-] [instance: b3c87b07-5c16-4f45-b320-06d3503d23e6] Updating instance_info_cache with network_info: [] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:36:11 user nova-compute[75165]: INFO nova.compute.manager [-] [instance: b3c87b07-5c16-4f45-b320-06d3503d23e6] Took 0.52 seconds to deallocate network for instance.
Oct 26 00:36:11 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-7ea754a1-3223-4769-a5c8-f1b80532d63a tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:36:11 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-7ea754a1-3223-4769-a5c8-f1b80532d63a tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:36:11 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-7ea754a1-3223-4769-a5c8-f1b80532d63a tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:36:11 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-7ea754a1-3223-4769-a5c8-f1b80532d63a tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:36:11 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-7ea754a1-3223-4769-a5c8-f1b80532d63a tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.276s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:36:11 user nova-compute[75165]: INFO nova.scheduler.client.report [None req-7ea754a1-3223-4769-a5c8-f1b80532d63a tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Deleted allocations for instance b3c87b07-5c16-4f45-b320-06d3503d23e6
Oct 26 00:36:11 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-7ea754a1-3223-4769-a5c8-f1b80532d63a tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Lock "b3c87b07-5c16-4f45-b320-06d3503d23e6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.883s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:36:12 user nova-compute[75165]: DEBUG nova.compute.manager [req-8aa12fe5-5ddb-4db0-8be2-bc06786716bf req-349bcd45-65a6-4f10-baf2-805aa72b198d service nova] [instance: b3c87b07-5c16-4f45-b320-06d3503d23e6] Received event network-vif-plugged-eec50cb9-592b-4b34-ac42-37a92ebb2a27 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:36:12 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-8aa12fe5-5ddb-4db0-8be2-bc06786716bf req-349bcd45-65a6-4f10-baf2-805aa72b198d service nova] Acquiring lock "b3c87b07-5c16-4f45-b320-06d3503d23e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:36:12 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-8aa12fe5-5ddb-4db0-8be2-bc06786716bf req-349bcd45-65a6-4f10-baf2-805aa72b198d service nova] Lock "b3c87b07-5c16-4f45-b320-06d3503d23e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:36:12 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-8aa12fe5-5ddb-4db0-8be2-bc06786716bf req-349bcd45-65a6-4f10-baf2-805aa72b198d service nova] Lock "b3c87b07-5c16-4f45-b320-06d3503d23e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:36:12 user nova-compute[75165]: DEBUG nova.compute.manager [req-8aa12fe5-5ddb-4db0-8be2-bc06786716bf req-349bcd45-65a6-4f10-baf2-805aa72b198d service nova] [instance: b3c87b07-5c16-4f45-b320-06d3503d23e6] No waiting events found dispatching network-vif-plugged-eec50cb9-592b-4b34-ac42-37a92ebb2a27 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:36:12 user nova-compute[75165]: WARNING nova.compute.manager [req-8aa12fe5-5ddb-4db0-8be2-bc06786716bf req-349bcd45-65a6-4f10-baf2-805aa72b198d service nova] [instance: b3c87b07-5c16-4f45-b320-06d3503d23e6] Received unexpected event network-vif-plugged-eec50cb9-592b-4b34-ac42-37a92ebb2a27 for instance with vm_state deleted and task_state None.
Oct 26 00:36:12 user nova-compute[75165]: DEBUG nova.compute.manager [req-8aa12fe5-5ddb-4db0-8be2-bc06786716bf req-349bcd45-65a6-4f10-baf2-805aa72b198d service nova] [instance: b3c87b07-5c16-4f45-b320-06d3503d23e6] Received event network-vif-deleted-eec50cb9-592b-4b34-ac42-37a92ebb2a27 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:36:15 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:36:17 user nova-compute[75165]: DEBUG nova.compute.manager [None req-e9f00c2a-5524-40eb-8edc-09805baa3250 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 49f1d1d3-4f34-49b3-ae89-206672d86cf0] Start spawning the instance on the hypervisor. {{(pid=75165) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 00:36:17 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-e9f00c2a-5524-40eb-8edc-09805baa3250 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 49f1d1d3-4f34-49b3-ae89-206672d86cf0] Creating instance directory {{(pid=75165) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 00:36:17 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-e9f00c2a-5524-40eb-8edc-09805baa3250 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 49f1d1d3-4f34-49b3-ae89-206672d86cf0] Creating image(s)
Oct 26 00:36:17 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-e9f00c2a-5524-40eb-8edc-09805baa3250 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 49f1d1d3-4f34-49b3-ae89-206672d86cf0] Did not create local disks {{(pid=75165) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 26 00:36:17 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-e9f00c2a-5524-40eb-8edc-09805baa3250 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 49f1d1d3-4f34-49b3-ae89-206672d86cf0] Ensure instance console log exists: /opt/stack/data/nova/instances/49f1d1d3-4f34-49b3-ae89-206672d86cf0/console.log {{(pid=75165) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 00:36:17 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-e9f00c2a-5524-40eb-8edc-09805baa3250 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:36:17 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-e9f00c2a-5524-40eb-8edc-09805baa3250 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:36:17 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-e9f00c2a-5524-40eb-8edc-09805baa3250 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:36:17 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-e9f00c2a-5524-40eb-8edc-09805baa3250 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 49f1d1d3-4f34-49b3-ae89-206672d86cf0] Start _get_guest_xml network_info=[{"id": "f815091d-bc66-47a6-8251-127c3e8275a5", "address": "fa:16:3e:d4:33:22", "network": {"id": "dc50ae7b-d501-461f-aa0b-542514330ae8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1091857056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1051405ca054c4bb051fb842a5fb5a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf815091d-bc", "ovs_interfaceid": "f815091d-bc66-47a6-8251-127c3e8275a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d2abefc2-1cb2-4993-a7e2-f043ee79ac56', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PzkgBEdr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '49f1d1d3-4f34-49b3-ae89-206672d86cf0', 'attached_at': '', 'detached_at': '', 'volume_id': 'd2abefc2-1cb2-4993-a7e2-f043ee79ac56', 'serial': 'd2abefc2-1cb2-4993-a7e2-f043ee79ac56'}, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'attachment_id': 'e36bad5c-69f3-4523-ba0e-842d331e4c13', 'delete_on_termination': True, 'volume_type': None} {{(pid=75165) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 00:36:17 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-e9f00c2a-5524-40eb-8edc-09805baa3250 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:36:17 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-e9f00c2a-5524-40eb-8edc-09805baa3250 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:36:17 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-e9f00c2a-5524-40eb-8edc-09805baa3250 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75165) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 00:36:17 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-e9f00c2a-5524-40eb-8edc-09805baa3250 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] CPU controller missing on host. {{(pid=75165) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 00:36:17 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-e9f00c2a-5524-40eb-8edc-09805baa3250 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75165) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 00:36:17 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-e9f00c2a-5524-40eb-8edc-09805baa3250 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] CPU controller found on host. {{(pid=75165) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 00:36:17 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-e9f00c2a-5524-40eb-8edc-09805baa3250 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75165) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 00:36:17 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-e9f00c2a-5524-40eb-8edc-09805baa3250 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T00:03:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 00:36:17 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-e9f00c2a-5524-40eb-8edc-09805baa3250 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Flavor limits 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 00:36:17 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-e9f00c2a-5524-40eb-8edc-09805baa3250 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Image limits 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 00:36:17 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-e9f00c2a-5524-40eb-8edc-09805baa3250 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Flavor pref 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 00:36:17 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-e9f00c2a-5524-40eb-8edc-09805baa3250 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Image pref 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 00:36:17 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-e9f00c2a-5524-40eb-8edc-09805baa3250 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 00:36:17 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-e9f00c2a-5524-40eb-8edc-09805baa3250 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 00:36:17 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-e9f00c2a-5524-40eb-8edc-09805baa3250 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75165) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 00:36:17 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-e9f00c2a-5524-40eb-8edc-09805baa3250 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Got 1 possible topologies {{(pid=75165) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 00:36:17 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-e9f00c2a-5524-40eb-8edc-09805baa3250 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 00:36:17 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-e9f00c2a-5524-40eb-8edc-09805baa3250 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 00:36:17 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9f00c2a-5524-40eb-8edc-09805baa3250 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 49f1d1d3-4f34-49b3-ae89-206672d86cf0] Calling os-brick to attach iSCSI Volume {{(pid=75165) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 00:36:17 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9f00c2a-5524-40eb-8edc-09805baa3250 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8bf8160e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d2abefc2-1cb2-4993-a7e2-f043ee79ac56', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PzkgBEdr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:36:17 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-e9f00c2a-5524-40eb-8edc-09805baa3250 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:36:17 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-e9f00c2a-5524-40eb-8edc-09805baa3250 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:36:17 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-e9f00c2a-5524-40eb-8edc-09805baa3250 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:36:17 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-e9f00c2a-5524-40eb-8edc-09805baa3250 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:36:17 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-e9f00c2a-5524-40eb-8edc-09805baa3250 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d2abefc2-1cb2-4993-a7e2-f043ee79ac56" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:36:17 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-e9f00c2a-5524-40eb-8edc-09805baa3250 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d2abefc2-1cb2-4993-a7e2-f043ee79ac56" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:36:17 user nova-compute[75165]: INFO os_brick.initiator.connectors.iscsi [None req-e9f00c2a-5524-40eb-8edc-09805baa3250 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 00:36:17 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2abefc2-1cb2-4993-a7e2-f043ee79ac56 -p 172.16.0.220:3260 {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:36:17 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2abefc2-1cb2-4993-a7e2-f043ee79ac56 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:36:17 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbe06e2c-9e11-47a7-86e3-36863ad96ab1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:36:17 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9f00c2a-5524-40eb-8edc-09805baa3250 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 00:36:17 user nova-compute[75165]:  {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:36:17 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2abefc2-1cb2-4993-a7e2-f043ee79ac56 -p 172.16.0.220:3260 --interface default --op new {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:36:17 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2abefc2-1cb2-4993-a7e2-f043ee79ac56 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:36:17 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[a31ce3f1-5da6-4719-9816-99ec8138ff5f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d2abefc2-1cb2-4993-a7e2-f043ee79ac56] added\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:36:17 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9f00c2a-5524-40eb-8edc-09805baa3250 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d2abefc2-1cb2-4993-a7e2-f043ee79ac56] added
Oct 26 00:36:17 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:36:17 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2abefc2-1cb2-4993-a7e2-f043ee79ac56 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:36:17 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2abefc2-1cb2-4993-a7e2-f043ee79ac56 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:36:17 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[748c7d6c-fb75-4b19-b617-d6a054c7729b]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:36:17 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9f00c2a-5524-40eb-8edc-09805baa3250 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:36:17 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2abefc2-1cb2-4993-a7e2-f043ee79ac56 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:36:17 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2abefc2-1cb2-4993-a7e2-f043ee79ac56 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:36:17 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bf48dfa-4707-462a-a7f4-ee54baf32a27]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:36:17 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9f00c2a-5524-40eb-8edc-09805baa3250 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:36:17 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2abefc2-1cb2-4993-a7e2-f043ee79ac56 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PzkgBEdr {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:36:17 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2abefc2-1cb2-4993-a7e2-f043ee79ac56 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PzkgBEdr" returned: 0 in 0.023s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:36:17 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[e96a4a27-0aeb-4d91-a84c-1867a9eeac14]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:36:17 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9f00c2a-5524-40eb-8edc-09805baa3250 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PzkgBEdr'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:36:17 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2abefc2-1cb2-4993-a7e2-f043ee79ac56 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:36:17 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2abefc2-1cb2-4993-a7e2-f043ee79ac56 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:36:17 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[be3ab4f4-fc1a-43c0-95e5-70e922923336]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:36:17 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9f00c2a-5524-40eb-8edc-09805baa3250 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:36:17 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:36:17 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:36:17 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a00ff84-0d3e-437d-b899-f0835efbc7cb]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:36:17 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9f00c2a-5524-40eb-8edc-09805baa3250 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)
Oct 26 00:36:17 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:36:17 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9f00c2a-5524-40eb-8edc-09805baa3250 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)
Oct 26 00:36:17 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:36:17 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2abefc2-1cb2-4993-a7e2-f043ee79ac56 -p 172.16.0.220:3260 --login {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:36:17 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2abefc2-1cb2-4993-a7e2-f043ee79ac56 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:36:17 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[44eeb1fa-1d74-4b87-9189-0f77bf0419a3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d2abefc2-1cb2-4993-a7e2-f043ee79ac56, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d2abefc2-1cb2-4993-a7e2-f043ee79ac56, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:36:17 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9f00c2a-5524-40eb-8edc-09805baa3250 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d2abefc2-1cb2-4993-a7e2-f043ee79ac56, portal: 172.16.0.220,3260]
Oct 26 00:36:17 user nova-compute[75165]: Login to [iface: default, target: iqn.2010-10.org.openstack:d2abefc2-1cb2-4993-a7e2-f043ee79ac56, portal: 172.16.0.220,3260] successful.
Oct 26 00:36:17 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:36:17 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2abefc2-1cb2-4993-a7e2-f043ee79ac56 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:36:17 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2abefc2-1cb2-4993-a7e2-f043ee79ac56 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:36:17 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[73ec818c-ed8a-4076-8f97-bd3920f72e12]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:36:17 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9f00c2a-5524-40eb-8edc-09805baa3250 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:36:17 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:36:17 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:36:17 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[768b6a2e-0777-4086-9e1b-e626c463a369]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2abefc2-1cb2-4993-a7e2-f043ee79ac56 (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:36:17 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9f00c2a-5524-40eb-8edc-09805baa3250 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)
Oct 26 00:36:17 user nova-compute[75165]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2abefc2-1cb2-4993-a7e2-f043ee79ac56 (non-flash)
Oct 26 00:36:17 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:36:17 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9f00c2a-5524-40eb-8edc-09805baa3250 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)
Oct 26 00:36:17 user nova-compute[75165]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2abefc2-1cb2-4993-a7e2-f043ee79ac56 (non-flash)
Oct 26 00:36:17 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:36:17 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-e9f00c2a-5524-40eb-8edc-09805baa3250 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d2abefc2-1cb2-4993-a7e2-f043ee79ac56" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.333s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:36:17 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9f00c2a-5524-40eb-8edc-09805baa3250 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Connected to 172.16.0.220:3260 {{(pid=75165) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 00:36:17 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-e9f00c2a-5524-40eb-8edc-09805baa3250 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] HCTL ('34', '-', '-', 0) found on session 43 with lun 0 {{(pid=75165) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 00:36:17 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-e9f00c2a-5524-40eb-8edc-09805baa3250 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75165) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 00:36:17 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:36:17 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:36:17 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[73f1d8c0-1c90-40ad-8f08-a2f8fac866c8]: (4, ('- - 0', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:36:17 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-e9f00c2a-5524-40eb-8edc-09805baa3250 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Searching for a device in session 43 and hctl ['34', '*', '*', 0] yield: None {{(pid=75165) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 00:36:18 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-e9f00c2a-5524-40eb-8edc-09805baa3250 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Searching for a device in session 43 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75165) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 00:36:18 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9f00c2a-5524-40eb-8edc-09805baa3250 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:d2abefc2-1cb2-4993-a7e2-f043ee79ac56', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PzkgBEdr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75165) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 00:36:18 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-e9f00c2a-5524-40eb-8edc-09805baa3250 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.361s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:36:18 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9f00c2a-5524-40eb-8edc-09805baa3250 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] <== connect_volume: return (1362ms) {'type': 'block', 'scsi_wwn': '23035636566643637', 'path': '/dev/sdc'} {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:36:18 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9f00c2a-5524-40eb-8edc-09805baa3250 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 49f1d1d3-4f34-49b3-ae89-206672d86cf0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23035636566643637', 'path': '/dev/sdc'} {{(pid=75165) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 00:36:18 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-e9f00c2a-5524-40eb-8edc-09805baa3250 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:35:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1367747267',display_name='tempest-TestVolumeBootPattern-server-1367747267',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1367747267',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d1051405ca054c4bb051fb842a5fb5a0',ramdisk_id='',reservation_id='r-t1a7000d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1215567595',owner_user_name='tempest-TestVolumeBootPattern-1215567595-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T00:35:54Z,user_data=None,user_id='ae836eab78514cf3894e5e11240ff374',uuid=49f1d1d3-4f34-49b3-ae89-206672d86cf0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f815091d-bc66-47a6-8251-127c3e8275a5", "address": "fa:16:3e:d4:33:22", "network": {"id": "dc50ae7b-d501-461f-aa0b-542514330ae8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1091857056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1051405ca054c4bb051fb842a5fb5a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf815091d-bc", "ovs_interfaceid": "f815091d-bc66-47a6-8251-127c3e8275a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75165) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 00:36:18 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-e9f00c2a-5524-40eb-8edc-09805baa3250 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Converting VIF {"id": "f815091d-bc66-47a6-8251-127c3e8275a5", "address": "fa:16:3e:d4:33:22", "network": {"id": "dc50ae7b-d501-461f-aa0b-542514330ae8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1091857056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1051405ca054c4bb051fb842a5fb5a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf815091d-bc", "ovs_interfaceid": "f815091d-bc66-47a6-8251-127c3e8275a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:36:18 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-e9f00c2a-5524-40eb-8edc-09805baa3250 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:33:22,bridge_name='br-int',has_traffic_filtering=True,id=f815091d-bc66-47a6-8251-127c3e8275a5,network=Network(dc50ae7b-d501-461f-aa0b-542514330ae8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf815091d-bc') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:36:18 user nova-compute[75165]: DEBUG nova.objects.instance [None req-e9f00c2a-5524-40eb-8edc-09805baa3250 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Lazy-loading 'pci_devices' on Instance uuid 49f1d1d3-4f34-49b3-ae89-206672d86cf0 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:36:18 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-e9f00c2a-5524-40eb-8edc-09805baa3250 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 49f1d1d3-4f34-49b3-ae89-206672d86cf0] End _get_guest_xml xml=<domain type="kvm">
Oct 26 00:36:18 user nova-compute[75165]:   <uuid>49f1d1d3-4f34-49b3-ae89-206672d86cf0</uuid>
Oct 26 00:36:18 user nova-compute[75165]:   <name>instance-00000028</name>
Oct 26 00:36:18 user nova-compute[75165]:   <memory>524288</memory>
Oct 26 00:36:18 user nova-compute[75165]:   <vcpu>1</vcpu>
Oct 26 00:36:18 user nova-compute[75165]:   <metadata>
Oct 26 00:36:18 user nova-compute[75165]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 00:36:18 user nova-compute[75165]:       <nova:package version="0.0.0"/>
Oct 26 00:36:18 user nova-compute[75165]:       <nova:name>tempest-TestVolumeBootPattern-server-1367747267</nova:name>
Oct 26 00:36:18 user nova-compute[75165]:       <nova:creationTime>2023-10-26 00:36:17</nova:creationTime>
Oct 26 00:36:18 user nova-compute[75165]:       <nova:flavor name="m1.tiny">
Oct 26 00:36:18 user nova-compute[75165]:         <nova:memory>512</nova:memory>
Oct 26 00:36:18 user nova-compute[75165]:         <nova:disk>1</nova:disk>
Oct 26 00:36:18 user nova-compute[75165]:         <nova:swap>0</nova:swap>
Oct 26 00:36:18 user nova-compute[75165]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 00:36:18 user nova-compute[75165]:         <nova:vcpus>1</nova:vcpus>
Oct 26 00:36:18 user nova-compute[75165]:       </nova:flavor>
Oct 26 00:36:18 user nova-compute[75165]:       <nova:owner>
Oct 26 00:36:18 user nova-compute[75165]:         <nova:user uuid="ae836eab78514cf3894e5e11240ff374">tempest-TestVolumeBootPattern-1215567595-project-member</nova:user>
Oct 26 00:36:18 user nova-compute[75165]:         <nova:project uuid="d1051405ca054c4bb051fb842a5fb5a0">tempest-TestVolumeBootPattern-1215567595</nova:project>
Oct 26 00:36:18 user nova-compute[75165]:       </nova:owner>
Oct 26 00:36:18 user nova-compute[75165]:       <nova:ports>
Oct 26 00:36:18 user nova-compute[75165]:         <nova:port uuid="f815091d-bc66-47a6-8251-127c3e8275a5">
Oct 26 00:36:18 user nova-compute[75165]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 26 00:36:18 user nova-compute[75165]:         </nova:port>
Oct 26 00:36:18 user nova-compute[75165]:       </nova:ports>
Oct 26 00:36:18 user nova-compute[75165]:     </nova:instance>
Oct 26 00:36:18 user nova-compute[75165]:   </metadata>
Oct 26 00:36:18 user nova-compute[75165]:   <sysinfo type="smbios">
Oct 26 00:36:18 user nova-compute[75165]:     <system>
Oct 26 00:36:18 user nova-compute[75165]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 00:36:18 user nova-compute[75165]:       <entry name="product">OpenStack Nova</entry>
Oct 26 00:36:18 user nova-compute[75165]:       <entry name="version">0.0.0</entry>
Oct 26 00:36:18 user nova-compute[75165]:       <entry name="serial">49f1d1d3-4f34-49b3-ae89-206672d86cf0</entry>
Oct 26 00:36:18 user nova-compute[75165]:       <entry name="uuid">49f1d1d3-4f34-49b3-ae89-206672d86cf0</entry>
Oct 26 00:36:18 user nova-compute[75165]:       <entry name="family">Virtual Machine</entry>
Oct 26 00:36:18 user nova-compute[75165]:     </system>
Oct 26 00:36:18 user nova-compute[75165]:   </sysinfo>
Oct 26 00:36:18 user nova-compute[75165]:   <os>
Oct 26 00:36:18 user nova-compute[75165]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 00:36:18 user nova-compute[75165]:     <boot dev="hd"/>
Oct 26 00:36:18 user nova-compute[75165]:     <smbios mode="sysinfo"/>
Oct 26 00:36:18 user nova-compute[75165]:   </os>
Oct 26 00:36:18 user nova-compute[75165]:   <features>
Oct 26 00:36:18 user nova-compute[75165]:     <acpi/>
Oct 26 00:36:18 user nova-compute[75165]:     <apic/>
Oct 26 00:36:18 user nova-compute[75165]:     <vmcoreinfo/>
Oct 26 00:36:18 user nova-compute[75165]:   </features>
Oct 26 00:36:18 user nova-compute[75165]:   <clock offset="utc">
Oct 26 00:36:18 user nova-compute[75165]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 00:36:18 user nova-compute[75165]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 00:36:18 user nova-compute[75165]:     <timer name="hpet" present="no"/>
Oct 26 00:36:18 user nova-compute[75165]:   </clock>
Oct 26 00:36:18 user nova-compute[75165]:   <cpu mode="custom" match="exact">
Oct 26 00:36:18 user nova-compute[75165]:     <model>Nehalem</model>
Oct 26 00:36:18 user nova-compute[75165]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 00:36:18 user nova-compute[75165]:   </cpu>
Oct 26 00:36:18 user nova-compute[75165]:   <devices>
Oct 26 00:36:18 user nova-compute[75165]:     <disk type="block" device="disk">
Oct 26 00:36:18 user nova-compute[75165]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 00:36:18 user nova-compute[75165]:       <source dev="/dev/sdc"/>
Oct 26 00:36:18 user nova-compute[75165]:       <target dev="vda" bus="virtio"/>
Oct 26 00:36:18 user nova-compute[75165]:       <serial>d2abefc2-1cb2-4993-a7e2-f043ee79ac56</serial>
Oct 26 00:36:18 user nova-compute[75165]:     </disk>
Oct 26 00:36:18 user nova-compute[75165]:     <interface type="ethernet">
Oct 26 00:36:18 user nova-compute[75165]:       <mac address="fa:16:3e:d4:33:22"/>
Oct 26 00:36:18 user nova-compute[75165]:       <model type="virtio"/>
Oct 26 00:36:18 user nova-compute[75165]:       <mtu size="1442"/>
Oct 26 00:36:18 user nova-compute[75165]:       <target dev="tapf815091d-bc"/>
Oct 26 00:36:18 user nova-compute[75165]:     </interface>
Oct 26 00:36:18 user nova-compute[75165]:     <serial type="pty">
Oct 26 00:36:18 user nova-compute[75165]:       <log file="/opt/stack/data/nova/instances/49f1d1d3-4f34-49b3-ae89-206672d86cf0/console.log" append="off"/>
Oct 26 00:36:18 user nova-compute[75165]:     </serial>
Oct 26 00:36:18 user nova-compute[75165]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 00:36:18 user nova-compute[75165]:     <video>
Oct 26 00:36:18 user nova-compute[75165]:       <model type="virtio"/>
Oct 26 00:36:18 user nova-compute[75165]:     </video>
Oct 26 00:36:18 user nova-compute[75165]:     <rng model="virtio">
Oct 26 00:36:18 user nova-compute[75165]:       <backend model="random">/dev/urandom</backend>
Oct 26 00:36:18 user nova-compute[75165]:     </rng>
Oct 26 00:36:18 user nova-compute[75165]:     <controller type="usb" index="0" model="none"/>
Oct 26 00:36:18 user nova-compute[75165]:     <memballoon model="virtio">
Oct 26 00:36:18 user nova-compute[75165]:       <stats period="10"/>
Oct 26 00:36:18 user nova-compute[75165]:     </memballoon>
Oct 26 00:36:18 user nova-compute[75165]:   </devices>
Oct 26 00:36:18 user nova-compute[75165]: </domain>
Oct 26 00:36:18 user nova-compute[75165]:  {{(pid=75165) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 00:36:18 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-e9f00c2a-5524-40eb-8edc-09805baa3250 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:35:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1367747267',display_name='tempest-TestVolumeBootPattern-server-1367747267',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1367747267',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d1051405ca054c4bb051fb842a5fb5a0',ramdisk_id='',reservation_id='r-t1a7000d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1215567595',owner_user_name='tempest-TestVolumeBootPattern-1215567595-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T00:35:54Z,user_data=None,user_id='ae836eab78514cf3894e5e11240ff374',uuid=49f1d1d3-4f34-49b3-ae89-206672d86cf0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f815091d-bc66-47a6-8251-127c3e8275a5", "address": "fa:16:3e:d4:33:22", "network": {"id": "dc50ae7b-d501-461f-aa0b-542514330ae8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1091857056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1051405ca054c4bb051fb842a5fb5a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf815091d-bc", "ovs_interfaceid": "f815091d-bc66-47a6-8251-127c3e8275a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 00:36:18 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-e9f00c2a-5524-40eb-8edc-09805baa3250 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Converting VIF {"id": "f815091d-bc66-47a6-8251-127c3e8275a5", "address": "fa:16:3e:d4:33:22", "network": {"id": "dc50ae7b-d501-461f-aa0b-542514330ae8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1091857056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1051405ca054c4bb051fb842a5fb5a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf815091d-bc", "ovs_interfaceid": "f815091d-bc66-47a6-8251-127c3e8275a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:36:18 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-e9f00c2a-5524-40eb-8edc-09805baa3250 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:33:22,bridge_name='br-int',has_traffic_filtering=True,id=f815091d-bc66-47a6-8251-127c3e8275a5,network=Network(dc50ae7b-d501-461f-aa0b-542514330ae8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf815091d-bc') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:36:18 user nova-compute[75165]: DEBUG os_vif [None req-e9f00c2a-5524-40eb-8edc-09805baa3250 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:33:22,bridge_name='br-int',has_traffic_filtering=True,id=f815091d-bc66-47a6-8251-127c3e8275a5,network=Network(dc50ae7b-d501-461f-aa0b-542514330ae8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf815091d-bc') {{(pid=75165) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 00:36:18 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:36:18 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:36:18 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 00:36:18 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:36:18 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '08256764-c48d-510d-a9fc-cd5d6cfe22a5', '_type': 'linux-noop'}}, row=False) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:36:18 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:36:18 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:36:18 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:36:18 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf815091d-bc, may_exist=True, interface_attrs={}) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:36:18 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf815091d-bc, col_values=(('qos', UUID('4224d5ce-104c-4497-89c8-1faa01cf8b62')),), if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:36:18 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf815091d-bc, col_values=(('external_ids', {'iface-id': 'f815091d-bc66-47a6-8251-127c3e8275a5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d4:33:22', 'vm-uuid': '49f1d1d3-4f34-49b3-ae89-206672d86cf0'}),), if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:36:18 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:36:18 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:36:18 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:36:18 user nova-compute[75165]: INFO os_vif [None req-e9f00c2a-5524-40eb-8edc-09805baa3250 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:33:22,bridge_name='br-int',has_traffic_filtering=True,id=f815091d-bc66-47a6-8251-127c3e8275a5,network=Network(dc50ae7b-d501-461f-aa0b-542514330ae8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf815091d-bc')
Oct 26 00:36:18 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-e9f00c2a-5524-40eb-8edc-09805baa3250 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] No BDM found with device name vda, not building metadata. {{(pid=75165) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 00:36:18 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-e9f00c2a-5524-40eb-8edc-09805baa3250 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] No VIF found with MAC fa:16:3e:d4:33:22, not building metadata {{(pid=75165) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 00:36:19 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:36:19 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:36:20 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:36:20 user nova-compute[75165]: DEBUG nova.compute.manager [req-97a99108-8bbf-4ec8-8a58-05909c20fea6 req-87d2a278-d52c-400a-97b1-b8157829c61b service nova] [instance: 49f1d1d3-4f34-49b3-ae89-206672d86cf0] Received event network-vif-plugged-f815091d-bc66-47a6-8251-127c3e8275a5 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:36:20 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-97a99108-8bbf-4ec8-8a58-05909c20fea6 req-87d2a278-d52c-400a-97b1-b8157829c61b service nova] Acquiring lock "49f1d1d3-4f34-49b3-ae89-206672d86cf0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:36:20 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-97a99108-8bbf-4ec8-8a58-05909c20fea6 req-87d2a278-d52c-400a-97b1-b8157829c61b service nova] Lock "49f1d1d3-4f34-49b3-ae89-206672d86cf0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:36:20 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-97a99108-8bbf-4ec8-8a58-05909c20fea6 req-87d2a278-d52c-400a-97b1-b8157829c61b service nova] Lock "49f1d1d3-4f34-49b3-ae89-206672d86cf0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:36:20 user nova-compute[75165]: DEBUG nova.compute.manager [req-97a99108-8bbf-4ec8-8a58-05909c20fea6 req-87d2a278-d52c-400a-97b1-b8157829c61b service nova] [instance: 49f1d1d3-4f34-49b3-ae89-206672d86cf0] No waiting events found dispatching network-vif-plugged-f815091d-bc66-47a6-8251-127c3e8275a5 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:36:20 user nova-compute[75165]: WARNING nova.compute.manager [req-97a99108-8bbf-4ec8-8a58-05909c20fea6 req-87d2a278-d52c-400a-97b1-b8157829c61b service nova] [instance: 49f1d1d3-4f34-49b3-ae89-206672d86cf0] Received unexpected event network-vif-plugged-f815091d-bc66-47a6-8251-127c3e8275a5 for instance with vm_state building and task_state spawning.
Oct 26 00:36:20 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:36:20 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:36:20 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:36:20 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:36:21 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:36:21 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75165) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 00:36:21 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:36:21 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:36:21 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:36:22 user nova-compute[75165]: DEBUG nova.compute.manager [None req-e9f00c2a-5524-40eb-8edc-09805baa3250 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 49f1d1d3-4f34-49b3-ae89-206672d86cf0] Instance event wait completed in 0 seconds for  {{(pid=75165) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 00:36:22 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-e9f00c2a-5524-40eb-8edc-09805baa3250 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 49f1d1d3-4f34-49b3-ae89-206672d86cf0] Guest created on hypervisor {{(pid=75165) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 00:36:22 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: 49f1d1d3-4f34-49b3-ae89-206672d86cf0] Instance spawned successfully.
Oct 26 00:36:22 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-e9f00c2a-5524-40eb-8edc-09805baa3250 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 49f1d1d3-4f34-49b3-ae89-206672d86cf0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 00:36:22 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-e9f00c2a-5524-40eb-8edc-09805baa3250 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 49f1d1d3-4f34-49b3-ae89-206672d86cf0] Found default for hw_cdrom_bus of ide {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:36:22 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-e9f00c2a-5524-40eb-8edc-09805baa3250 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 49f1d1d3-4f34-49b3-ae89-206672d86cf0] Found default for hw_disk_bus of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:36:22 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-e9f00c2a-5524-40eb-8edc-09805baa3250 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 49f1d1d3-4f34-49b3-ae89-206672d86cf0] Found default for hw_input_bus of None {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:36:22 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-e9f00c2a-5524-40eb-8edc-09805baa3250 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 49f1d1d3-4f34-49b3-ae89-206672d86cf0] Found default for hw_pointer_model of None {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:36:22 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-e9f00c2a-5524-40eb-8edc-09805baa3250 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 49f1d1d3-4f34-49b3-ae89-206672d86cf0] Found default for hw_video_model of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:36:22 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-e9f00c2a-5524-40eb-8edc-09805baa3250 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 49f1d1d3-4f34-49b3-ae89-206672d86cf0] Found default for hw_vif_model of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:36:22 user nova-compute[75165]: INFO nova.compute.manager [None req-e9f00c2a-5524-40eb-8edc-09805baa3250 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 49f1d1d3-4f34-49b3-ae89-206672d86cf0] Took 4.96 seconds to spawn the instance on the hypervisor.
Oct 26 00:36:22 user nova-compute[75165]: DEBUG nova.compute.manager [None req-e9f00c2a-5524-40eb-8edc-09805baa3250 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 49f1d1d3-4f34-49b3-ae89-206672d86cf0] Checking state {{(pid=75165) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 00:36:22 user nova-compute[75165]: INFO nova.compute.manager [None req-e9f00c2a-5524-40eb-8edc-09805baa3250 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 49f1d1d3-4f34-49b3-ae89-206672d86cf0] Took 29.10 seconds to build instance.
Oct 26 00:36:22 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-e9f00c2a-5524-40eb-8edc-09805baa3250 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Lock "49f1d1d3-4f34-49b3-ae89-206672d86cf0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 29.232s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:36:22 user nova-compute[75165]: DEBUG nova.compute.manager [req-9aada78b-2c1b-4423-9dd7-6d4950400e28 req-34f203ad-8de2-479a-a901-4bd329488bb9 service nova] [instance: 49f1d1d3-4f34-49b3-ae89-206672d86cf0] Received event network-vif-plugged-f815091d-bc66-47a6-8251-127c3e8275a5 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:36:22 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-9aada78b-2c1b-4423-9dd7-6d4950400e28 req-34f203ad-8de2-479a-a901-4bd329488bb9 service nova] Acquiring lock "49f1d1d3-4f34-49b3-ae89-206672d86cf0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:36:22 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-9aada78b-2c1b-4423-9dd7-6d4950400e28 req-34f203ad-8de2-479a-a901-4bd329488bb9 service nova] Lock "49f1d1d3-4f34-49b3-ae89-206672d86cf0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:36:22 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-9aada78b-2c1b-4423-9dd7-6d4950400e28 req-34f203ad-8de2-479a-a901-4bd329488bb9 service nova] Lock "49f1d1d3-4f34-49b3-ae89-206672d86cf0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:36:22 user nova-compute[75165]: DEBUG nova.compute.manager [req-9aada78b-2c1b-4423-9dd7-6d4950400e28 req-34f203ad-8de2-479a-a901-4bd329488bb9 service nova] [instance: 49f1d1d3-4f34-49b3-ae89-206672d86cf0] No waiting events found dispatching network-vif-plugged-f815091d-bc66-47a6-8251-127c3e8275a5 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:36:22 user nova-compute[75165]: WARNING nova.compute.manager [req-9aada78b-2c1b-4423-9dd7-6d4950400e28 req-34f203ad-8de2-479a-a901-4bd329488bb9 service nova] [instance: 49f1d1d3-4f34-49b3-ae89-206672d86cf0] Received unexpected event network-vif-plugged-f815091d-bc66-47a6-8251-127c3e8275a5 for instance with vm_state active and task_state None.
Oct 26 00:36:23 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:36:24 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:36:24 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:36:25 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:36:26 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:36:26 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Starting heal instance info cache {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 00:36:26 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Didn't find any instances for network info cache update. {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 26 00:36:27 user nova-compute[75165]: DEBUG nova.compute.manager [req-7774a5ee-54d4-4a9d-8fb0-10dc454d650f req-43665310-6adf-4ed2-94c4-77160d2293eb service nova] [instance: 7e534595-7eaf-49f4-b457-9f37bc59012b] Received event network-changed-d4d7b894-8aba-454c-b803-ec2bf8b28f06 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:36:27 user nova-compute[75165]: DEBUG nova.compute.manager [req-7774a5ee-54d4-4a9d-8fb0-10dc454d650f req-43665310-6adf-4ed2-94c4-77160d2293eb service nova] [instance: 7e534595-7eaf-49f4-b457-9f37bc59012b] Refreshing instance network info cache due to event network-changed-d4d7b894-8aba-454c-b803-ec2bf8b28f06. {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 00:36:27 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-7774a5ee-54d4-4a9d-8fb0-10dc454d650f req-43665310-6adf-4ed2-94c4-77160d2293eb service nova] Acquiring lock "refresh_cache-7e534595-7eaf-49f4-b457-9f37bc59012b" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:36:27 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-7774a5ee-54d4-4a9d-8fb0-10dc454d650f req-43665310-6adf-4ed2-94c4-77160d2293eb service nova] Acquired lock "refresh_cache-7e534595-7eaf-49f4-b457-9f37bc59012b" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:36:27 user nova-compute[75165]: DEBUG nova.network.neutron [req-7774a5ee-54d4-4a9d-8fb0-10dc454d650f req-43665310-6adf-4ed2-94c4-77160d2293eb service nova] [instance: 7e534595-7eaf-49f4-b457-9f37bc59012b] Refreshing network info cache for port d4d7b894-8aba-454c-b803-ec2bf8b28f06 {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 00:36:28 user nova-compute[75165]: DEBUG nova.network.neutron [req-7774a5ee-54d4-4a9d-8fb0-10dc454d650f req-43665310-6adf-4ed2-94c4-77160d2293eb service nova] [instance: 7e534595-7eaf-49f4-b457-9f37bc59012b] Updated VIF entry in instance network info cache for port d4d7b894-8aba-454c-b803-ec2bf8b28f06. {{(pid=75165) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 00:36:28 user nova-compute[75165]: DEBUG nova.network.neutron [req-7774a5ee-54d4-4a9d-8fb0-10dc454d650f req-43665310-6adf-4ed2-94c4-77160d2293eb service nova] [instance: 7e534595-7eaf-49f4-b457-9f37bc59012b] Updating instance_info_cache with network_info: [{"id": "d4d7b894-8aba-454c-b803-ec2bf8b28f06", "address": "fa:16:3e:60:42:1c", "network": {"id": "1801db1c-315e-4bdf-b73b-132a38bf41b8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1254756052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62572ce8ae524b55950532fd89729b71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4d7b894-8a", "ovs_interfaceid": "d4d7b894-8aba-454c-b803-ec2bf8b28f06", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:36:28 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-7774a5ee-54d4-4a9d-8fb0-10dc454d650f req-43665310-6adf-4ed2-94c4-77160d2293eb service nova] Releasing lock "refresh_cache-7e534595-7eaf-49f4-b457-9f37bc59012b" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:36:28 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:36:28 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:36:28 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75165) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 00:36:28 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75165) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 00:36:28 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75165) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 00:36:28 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:36:28 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:36:28 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:36:28 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:36:28 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:36:28 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:36:28 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75165) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 00:36:29 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75165) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 00:36:29 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75165) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 00:36:29 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97fb67a7-637d-456f-b4dd-0a271ed6cfc4/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:36:29 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97fb67a7-637d-456f-b4dd-0a271ed6cfc4/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:36:29 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97fb67a7-637d-456f-b4dd-0a271ed6cfc4/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:36:29 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97fb67a7-637d-456f-b4dd-0a271ed6cfc4/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:36:29 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e534595-7eaf-49f4-b457-9f37bc59012b/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:36:29 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e534595-7eaf-49f4-b457-9f37bc59012b/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:36:29 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e534595-7eaf-49f4-b457-9f37bc59012b/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:36:29 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e534595-7eaf-49f4-b457-9f37bc59012b/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:36:29 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae9fe6f-eb17-44f5-89e4-fff5e3451336/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:36:29 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae9fe6f-eb17-44f5-89e4-fff5e3451336/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:36:29 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae9fe6f-eb17-44f5-89e4-fff5e3451336/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:36:30 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae9fe6f-eb17-44f5-89e4-fff5e3451336/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:36:30 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe2984ce-8958-4049-8af7-496b313b26c8/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:36:30 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe2984ce-8958-4049-8af7-496b313b26c8/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:36:30 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe2984ce-8958-4049-8af7-496b313b26c8/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:36:30 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe2984ce-8958-4049-8af7-496b313b26c8/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:36:30 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:36:30 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:36:30 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Hypervisor/Node resource view: name=user free_ram=8366MB free_disk=24.74817657470703GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75165) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 00:36:30 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:36:30 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:36:31 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 97fb67a7-637d-456f-b4dd-0a271ed6cfc4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:36:31 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:36:31 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance fe2984ce-8958-4049-8af7-496b313b26c8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:36:31 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 7e534595-7eaf-49f4-b457-9f37bc59012b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:36:31 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 6ae9fe6f-eb17-44f5-89e4-fff5e3451336 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:36:31 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 49f1d1d3-4f34-49b3-ae89-206672d86cf0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:36:31 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75165) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 00:36:31 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75165) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 00:36:31 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:36:31 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:36:31 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Compute_service record updated for user:user {{(pid=75165) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 00:36:31 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.376s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:36:31 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:36:33 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-115a9b59-e2a1-47c0-a928-a17fa69066f0 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Acquiring lock "7e534595-7eaf-49f4-b457-9f37bc59012b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:36:33 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-115a9b59-e2a1-47c0-a928-a17fa69066f0 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Lock "7e534595-7eaf-49f4-b457-9f37bc59012b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:36:33 user nova-compute[75165]: DEBUG nova.objects.instance [None req-115a9b59-e2a1-47c0-a928-a17fa69066f0 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Lazy-loading 'flavor' on Instance uuid 7e534595-7eaf-49f4-b457-9f37bc59012b {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:36:33 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-115a9b59-e2a1-47c0-a928-a17fa69066f0 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Lock "7e534595-7eaf-49f4-b457-9f37bc59012b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:36:33 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:36:33 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-115a9b59-e2a1-47c0-a928-a17fa69066f0 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Acquiring lock "7e534595-7eaf-49f4-b457-9f37bc59012b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:36:33 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-115a9b59-e2a1-47c0-a928-a17fa69066f0 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Lock "7e534595-7eaf-49f4-b457-9f37bc59012b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:36:33 user nova-compute[75165]: INFO nova.compute.manager [None req-115a9b59-e2a1-47c0-a928-a17fa69066f0 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 7e534595-7eaf-49f4-b457-9f37bc59012b] Attaching volume 927d04d0-50f4-459c-8c3c-ed41d757d7ca to /dev/vdb
Oct 26 00:36:33 user nova-compute[75165]: DEBUG os_brick.utils [None req-115a9b59-e2a1-47c0-a928-a17fa69066f0 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:36:33 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:36:33 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:36:33 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[76639c4d-df56-49c8-b147-b9e63fdc6530]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa94814ccb35\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:36:33 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:36:33 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:36:33 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[d89c8ef1-3c4f-4125-bb05-a0e9d0e33f0c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:36:33 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:36:33 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:36:33 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c0c545d-10cf-4f2d-b8ae-3a8c3b28d27e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:36:33 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[fda9e796-ecfa-487b-9460-6274a59a4719]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:36:33 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-115a9b59-e2a1-47c0-a928-a17fa69066f0 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Running cmd (subprocess): nvme version {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:36:34 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-115a9b59-e2a1-47c0-a928-a17fa69066f0 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] 'nvme version' failed. Not Retrying. {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 00:36:34 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.nvmeof [None req-115a9b59-e2a1-47c0-a928-a17fa69066f0 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] nvme not present on system {{(pid=75165) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 00:36:34 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:36:34 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 00:36:34 user nova-compute[75165]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 00:36:34 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[855f3981-c832-44eb-85a9-85b8a8c058a9]: (4, '') {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:36:34 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-115a9b59-e2a1-47c0-a928-a17fa69066f0 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75165) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 00:36:34 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-115a9b59-e2a1-47c0-a928-a17fa69066f0 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75165) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 00:36:34 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-115a9b59-e2a1-47c0-a928-a17fa69066f0 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] LIGHTOS: no hostnqn found. {{(pid=75165) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 00:36:34 user nova-compute[75165]: DEBUG os_brick.utils [None req-115a9b59-e2a1-47c0-a928-a17fa69066f0 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa94814ccb35', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:36:34 user nova-compute[75165]: DEBUG nova.virt.block_device [None req-115a9b59-e2a1-47c0-a928-a17fa69066f0 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 7e534595-7eaf-49f4-b457-9f37bc59012b] Updating existing volume attachment record: 825da069-c413-4e76-ac7f-a9e2e092bbfa {{(pid=75165) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 00:36:36 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:36:38 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:36:41 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-fbdef5af-b92c-4bfc-9022-4b5e9664621c tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Acquiring lock "fe2984ce-8958-4049-8af7-496b313b26c8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:36:41 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-fbdef5af-b92c-4bfc-9022-4b5e9664621c tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Lock "fe2984ce-8958-4049-8af7-496b313b26c8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:36:41 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-fbdef5af-b92c-4bfc-9022-4b5e9664621c tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Acquiring lock "fe2984ce-8958-4049-8af7-496b313b26c8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:36:41 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-fbdef5af-b92c-4bfc-9022-4b5e9664621c tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Lock "fe2984ce-8958-4049-8af7-496b313b26c8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:36:41 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-fbdef5af-b92c-4bfc-9022-4b5e9664621c tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Lock "fe2984ce-8958-4049-8af7-496b313b26c8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:36:41 user nova-compute[75165]: INFO nova.compute.manager [None req-fbdef5af-b92c-4bfc-9022-4b5e9664621c tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] [instance: fe2984ce-8958-4049-8af7-496b313b26c8] Terminating instance
Oct 26 00:36:41 user nova-compute[75165]: DEBUG nova.compute.manager [None req-fbdef5af-b92c-4bfc-9022-4b5e9664621c tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] [instance: fe2984ce-8958-4049-8af7-496b313b26c8] Start destroying the instance on the hypervisor. {{(pid=75165) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 00:36:41 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:36:41 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:36:41 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:36:41 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:36:41 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:36:42 user nova-compute[75165]: DEBUG nova.compute.manager [req-ab04c986-3e3f-46d6-aead-7b0813937b2d req-6537d48c-0857-44e7-a0ce-21afdae3edad service nova] [instance: fe2984ce-8958-4049-8af7-496b313b26c8] Received event network-vif-unplugged-5995df96-1576-4616-8834-45073add32a2 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:36:42 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-ab04c986-3e3f-46d6-aead-7b0813937b2d req-6537d48c-0857-44e7-a0ce-21afdae3edad service nova] Acquiring lock "fe2984ce-8958-4049-8af7-496b313b26c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:36:42 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-ab04c986-3e3f-46d6-aead-7b0813937b2d req-6537d48c-0857-44e7-a0ce-21afdae3edad service nova] Lock "fe2984ce-8958-4049-8af7-496b313b26c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:36:42 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-ab04c986-3e3f-46d6-aead-7b0813937b2d req-6537d48c-0857-44e7-a0ce-21afdae3edad service nova] Lock "fe2984ce-8958-4049-8af7-496b313b26c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:36:42 user nova-compute[75165]: DEBUG nova.compute.manager [req-ab04c986-3e3f-46d6-aead-7b0813937b2d req-6537d48c-0857-44e7-a0ce-21afdae3edad service nova] [instance: fe2984ce-8958-4049-8af7-496b313b26c8] No waiting events found dispatching network-vif-unplugged-5995df96-1576-4616-8834-45073add32a2 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:36:42 user nova-compute[75165]: DEBUG nova.compute.manager [req-ab04c986-3e3f-46d6-aead-7b0813937b2d req-6537d48c-0857-44e7-a0ce-21afdae3edad service nova] [instance: fe2984ce-8958-4049-8af7-496b313b26c8] Received event network-vif-unplugged-5995df96-1576-4616-8834-45073add32a2 for instance with task_state deleting. {{(pid=75165) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 00:36:42 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: fe2984ce-8958-4049-8af7-496b313b26c8] Instance destroyed successfully.
Oct 26 00:36:42 user nova-compute[75165]: DEBUG nova.objects.instance [None req-fbdef5af-b92c-4bfc-9022-4b5e9664621c tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Lazy-loading 'resources' on Instance uuid fe2984ce-8958-4049-8af7-496b313b26c8 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:36:42 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-fbdef5af-b92c-4bfc-9022-4b5e9664621c tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:26:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1141467913',display_name='tempest-SnapshotDataIntegrityTests-server-1141467913',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1141467913',id=31,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI+vth0hk579pqQeeS/MKW3TKZMa4PnA2Of6MESYRXKuIbVYKn+mAkFyTNTrT5boIwixdOlrBzWNNZ0Q785iOnwKYc4gc8K1MskTqrgB8rSyYWLrcP1gI5xIT5S18XJYkg==',key_name='tempest-keypair-1679341335',keypairs=<?>,launch_index=0,launched_at=2023-10-26T00:26:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='567a90e8d8b24ca4b5e5da923d537134',ramdisk_id='',reservation_id='r-92wnx5jj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-2142389765',owner_user_name='tempest-SnapshotDataIntegrityTests-2142389765-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T00:26:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='45d43fd7499347cc88bee0319be12cde',uuid=fe2984ce-8958-4049-8af7-496b313b26c8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5995df96-1576-4616-8834-45073add32a2", "address": "fa:16:3e:ca:36:c4", "network": {"id": "7c8ed206-c41f-4c32-837b-b50fb4ee5479", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1704810529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "567a90e8d8b24ca4b5e5da923d537134", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5995df96-15", "ovs_interfaceid": "5995df96-1576-4616-8834-45073add32a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 00:36:42 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-fbdef5af-b92c-4bfc-9022-4b5e9664621c tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Converting VIF {"id": "5995df96-1576-4616-8834-45073add32a2", "address": "fa:16:3e:ca:36:c4", "network": {"id": "7c8ed206-c41f-4c32-837b-b50fb4ee5479", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1704810529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "567a90e8d8b24ca4b5e5da923d537134", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5995df96-15", "ovs_interfaceid": "5995df96-1576-4616-8834-45073add32a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:36:42 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-fbdef5af-b92c-4bfc-9022-4b5e9664621c tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ca:36:c4,bridge_name='br-int',has_traffic_filtering=True,id=5995df96-1576-4616-8834-45073add32a2,network=Network(7c8ed206-c41f-4c32-837b-b50fb4ee5479),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5995df96-15') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:36:42 user nova-compute[75165]: DEBUG os_vif [None req-fbdef5af-b92c-4bfc-9022-4b5e9664621c tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ca:36:c4,bridge_name='br-int',has_traffic_filtering=True,id=5995df96-1576-4616-8834-45073add32a2,network=Network(7c8ed206-c41f-4c32-837b-b50fb4ee5479),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5995df96-15') {{(pid=75165) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 00:36:42 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:36:42 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5995df96-15, bridge=br-int, if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:36:42 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:36:42 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:36:42 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:36:42 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8ca3ab80-c296-4487-8295-4e75786cf93b) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:36:42 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:36:42 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:36:42 user nova-compute[75165]: INFO os_vif [None req-fbdef5af-b92c-4bfc-9022-4b5e9664621c tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ca:36:c4,bridge_name='br-int',has_traffic_filtering=True,id=5995df96-1576-4616-8834-45073add32a2,network=Network(7c8ed206-c41f-4c32-837b-b50fb4ee5479),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5995df96-15')
Oct 26 00:36:42 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-fbdef5af-b92c-4bfc-9022-4b5e9664621c tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] [instance: fe2984ce-8958-4049-8af7-496b313b26c8] Deleting instance files /opt/stack/data/nova/instances/fe2984ce-8958-4049-8af7-496b313b26c8_del
Oct 26 00:36:42 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-fbdef5af-b92c-4bfc-9022-4b5e9664621c tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] [instance: fe2984ce-8958-4049-8af7-496b313b26c8] Deletion of /opt/stack/data/nova/instances/fe2984ce-8958-4049-8af7-496b313b26c8_del complete
Oct 26 00:36:42 user nova-compute[75165]: INFO nova.compute.manager [None req-fbdef5af-b92c-4bfc-9022-4b5e9664621c tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] [instance: fe2984ce-8958-4049-8af7-496b313b26c8] Took 0.92 seconds to destroy the instance on the hypervisor.
Oct 26 00:36:42 user nova-compute[75165]: DEBUG oslo.service.loopingcall [None req-fbdef5af-b92c-4bfc-9022-4b5e9664621c tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75165) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 00:36:42 user nova-compute[75165]: DEBUG nova.compute.manager [-] [instance: fe2984ce-8958-4049-8af7-496b313b26c8] Deallocating network for instance {{(pid=75165) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 00:36:42 user nova-compute[75165]: DEBUG nova.network.neutron [-] [instance: fe2984ce-8958-4049-8af7-496b313b26c8] deallocate_for_instance() {{(pid=75165) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 00:36:43 user nova-compute[75165]: DEBUG nova.network.neutron [-] [instance: fe2984ce-8958-4049-8af7-496b313b26c8] Updating instance_info_cache with network_info: [] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:36:43 user nova-compute[75165]: INFO nova.compute.manager [-] [instance: fe2984ce-8958-4049-8af7-496b313b26c8] Took 0.91 seconds to deallocate network for instance.
Oct 26 00:36:43 user nova-compute[75165]: DEBUG nova.compute.manager [req-3dc94552-459c-4ea4-a5f5-00b1ee4072e2 req-4704db34-5cf5-4011-b92f-6b525d6cc515 service nova] [instance: fe2984ce-8958-4049-8af7-496b313b26c8] Received event network-vif-deleted-5995df96-1576-4616-8834-45073add32a2 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:36:43 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-fbdef5af-b92c-4bfc-9022-4b5e9664621c tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:36:43 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-fbdef5af-b92c-4bfc-9022-4b5e9664621c tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:36:43 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-fbdef5af-b92c-4bfc-9022-4b5e9664621c tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:36:43 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-fbdef5af-b92c-4bfc-9022-4b5e9664621c tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:36:43 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-fbdef5af-b92c-4bfc-9022-4b5e9664621c tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.246s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:36:43 user nova-compute[75165]: INFO nova.scheduler.client.report [None req-fbdef5af-b92c-4bfc-9022-4b5e9664621c tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Deleted allocations for instance fe2984ce-8958-4049-8af7-496b313b26c8
Oct 26 00:36:43 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-fbdef5af-b92c-4bfc-9022-4b5e9664621c tempest-SnapshotDataIntegrityTests-2142389765 tempest-SnapshotDataIntegrityTests-2142389765-project-member] Lock "fe2984ce-8958-4049-8af7-496b313b26c8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.287s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:36:44 user nova-compute[75165]: DEBUG nova.compute.manager [req-cc24c0e8-8d3f-4b0e-b4a7-f238b0b57426 req-08b005e6-f9a5-4bb3-92d4-4b78615eb99b service nova] [instance: fe2984ce-8958-4049-8af7-496b313b26c8] Received event network-vif-plugged-5995df96-1576-4616-8834-45073add32a2 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:36:44 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-cc24c0e8-8d3f-4b0e-b4a7-f238b0b57426 req-08b005e6-f9a5-4bb3-92d4-4b78615eb99b service nova] Acquiring lock "fe2984ce-8958-4049-8af7-496b313b26c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:36:44 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-cc24c0e8-8d3f-4b0e-b4a7-f238b0b57426 req-08b005e6-f9a5-4bb3-92d4-4b78615eb99b service nova] Lock "fe2984ce-8958-4049-8af7-496b313b26c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:36:44 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-cc24c0e8-8d3f-4b0e-b4a7-f238b0b57426 req-08b005e6-f9a5-4bb3-92d4-4b78615eb99b service nova] Lock "fe2984ce-8958-4049-8af7-496b313b26c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:36:44 user nova-compute[75165]: DEBUG nova.compute.manager [req-cc24c0e8-8d3f-4b0e-b4a7-f238b0b57426 req-08b005e6-f9a5-4bb3-92d4-4b78615eb99b service nova] [instance: fe2984ce-8958-4049-8af7-496b313b26c8] No waiting events found dispatching network-vif-plugged-5995df96-1576-4616-8834-45073add32a2 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:36:44 user nova-compute[75165]: WARNING nova.compute.manager [req-cc24c0e8-8d3f-4b0e-b4a7-f238b0b57426 req-08b005e6-f9a5-4bb3-92d4-4b78615eb99b service nova] [instance: fe2984ce-8958-4049-8af7-496b313b26c8] Received unexpected event network-vif-plugged-5995df96-1576-4616-8834-45073add32a2 for instance with vm_state deleted and task_state None.
Oct 26 00:36:46 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:36:47 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:36:50 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:36:51 user nova-compute[75165]: DEBUG nova.compute.manager [req-e92186b0-b7c7-4d27-8b65-fe3a24bbf525 req-1d8e3ff3-58a9-47d0-9b5c-68a4f2f2e7a5 service nova] [instance: 6ae9fe6f-eb17-44f5-89e4-fff5e3451336] Received event network-changed-5057f477-2080-4285-86a0-8f50541c3361 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:36:51 user nova-compute[75165]: DEBUG nova.compute.manager [req-e92186b0-b7c7-4d27-8b65-fe3a24bbf525 req-1d8e3ff3-58a9-47d0-9b5c-68a4f2f2e7a5 service nova] [instance: 6ae9fe6f-eb17-44f5-89e4-fff5e3451336] Refreshing instance network info cache due to event network-changed-5057f477-2080-4285-86a0-8f50541c3361. {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 00:36:51 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-e92186b0-b7c7-4d27-8b65-fe3a24bbf525 req-1d8e3ff3-58a9-47d0-9b5c-68a4f2f2e7a5 service nova] Acquiring lock "refresh_cache-6ae9fe6f-eb17-44f5-89e4-fff5e3451336" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:36:51 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-e92186b0-b7c7-4d27-8b65-fe3a24bbf525 req-1d8e3ff3-58a9-47d0-9b5c-68a4f2f2e7a5 service nova] Acquired lock "refresh_cache-6ae9fe6f-eb17-44f5-89e4-fff5e3451336" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:36:51 user nova-compute[75165]: DEBUG nova.network.neutron [req-e92186b0-b7c7-4d27-8b65-fe3a24bbf525 req-1d8e3ff3-58a9-47d0-9b5c-68a4f2f2e7a5 service nova] [instance: 6ae9fe6f-eb17-44f5-89e4-fff5e3451336] Refreshing network info cache for port 5057f477-2080-4285-86a0-8f50541c3361 {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 00:36:51 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:36:51 user nova-compute[75165]: DEBUG nova.network.neutron [req-e92186b0-b7c7-4d27-8b65-fe3a24bbf525 req-1d8e3ff3-58a9-47d0-9b5c-68a4f2f2e7a5 service nova] [instance: 6ae9fe6f-eb17-44f5-89e4-fff5e3451336] Updated VIF entry in instance network info cache for port 5057f477-2080-4285-86a0-8f50541c3361. {{(pid=75165) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 00:36:51 user nova-compute[75165]: DEBUG nova.network.neutron [req-e92186b0-b7c7-4d27-8b65-fe3a24bbf525 req-1d8e3ff3-58a9-47d0-9b5c-68a4f2f2e7a5 service nova] [instance: 6ae9fe6f-eb17-44f5-89e4-fff5e3451336] Updating instance_info_cache with network_info: [{"id": "5057f477-2080-4285-86a0-8f50541c3361", "address": "fa:16:3e:ca:e5:01", "network": {"id": "03d2b5cd-b214-4767-a406-098bd6857327", "bridge": "br-int", "label": "tempest-TestStampPattern-968415108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e11255eee7bb4b13962634a1cd13d186", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5057f477-20", "ovs_interfaceid": "5057f477-2080-4285-86a0-8f50541c3361", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:36:52 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-e92186b0-b7c7-4d27-8b65-fe3a24bbf525 req-1d8e3ff3-58a9-47d0-9b5c-68a4f2f2e7a5 service nova] Releasing lock "refresh_cache-6ae9fe6f-eb17-44f5-89e4-fff5e3451336" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:36:52 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-2d2293d7-e2d7-4eb2-93c4-47c37ded98b3 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Acquiring lock "6ae9fe6f-eb17-44f5-89e4-fff5e3451336" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:36:52 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-2d2293d7-e2d7-4eb2-93c4-47c37ded98b3 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Lock "6ae9fe6f-eb17-44f5-89e4-fff5e3451336" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:36:52 user nova-compute[75165]: DEBUG nova.objects.instance [None req-2d2293d7-e2d7-4eb2-93c4-47c37ded98b3 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Lazy-loading 'flavor' on Instance uuid 6ae9fe6f-eb17-44f5-89e4-fff5e3451336 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:36:52 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-2d2293d7-e2d7-4eb2-93c4-47c37ded98b3 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Lock "6ae9fe6f-eb17-44f5-89e4-fff5e3451336" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:36:52 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-2d2293d7-e2d7-4eb2-93c4-47c37ded98b3 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Acquiring lock "6ae9fe6f-eb17-44f5-89e4-fff5e3451336" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:36:52 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-2d2293d7-e2d7-4eb2-93c4-47c37ded98b3 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Lock "6ae9fe6f-eb17-44f5-89e4-fff5e3451336" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:36:52 user nova-compute[75165]: INFO nova.compute.manager [None req-2d2293d7-e2d7-4eb2-93c4-47c37ded98b3 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] [instance: 6ae9fe6f-eb17-44f5-89e4-fff5e3451336] Attaching volume ddaee92e-ef36-449d-b19d-5166b0c23787 to /dev/vdb
Oct 26 00:36:52 user nova-compute[75165]: DEBUG os_brick.utils [None req-2d2293d7-e2d7-4eb2-93c4-47c37ded98b3 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:36:52 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:36:52 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:36:52 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dd6c883-877d-415f-b5bd-d235d39e49b9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa94814ccb35\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:36:52 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:36:52 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:36:52 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ec73588-7931-48fc-beeb-a981b68eb57c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:36:52 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:36:52 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:36:52 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:36:52 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[4700a6d6-6fd5-4e9f-af9c-be25b72b33ef]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:36:52 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[66541643-24ef-40ec-a370-f6f66710258b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:36:52 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-2d2293d7-e2d7-4eb2-93c4-47c37ded98b3 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Running cmd (subprocess): nvme version {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:36:52 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-2d2293d7-e2d7-4eb2-93c4-47c37ded98b3 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] 'nvme version' failed. Not Retrying. {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 00:36:52 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2d2293d7-e2d7-4eb2-93c4-47c37ded98b3 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] nvme not present on system {{(pid=75165) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 00:36:52 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:36:52 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 00:36:52 user nova-compute[75165]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 00:36:52 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b294bda-1c8a-47ec-b32f-9bee7b25ebbe]: (4, '') {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:36:52 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-2d2293d7-e2d7-4eb2-93c4-47c37ded98b3 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75165) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 00:36:52 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-2d2293d7-e2d7-4eb2-93c4-47c37ded98b3 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75165) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 00:36:52 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-2d2293d7-e2d7-4eb2-93c4-47c37ded98b3 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] LIGHTOS: no hostnqn found. {{(pid=75165) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 00:36:52 user nova-compute[75165]: DEBUG os_brick.utils [None req-2d2293d7-e2d7-4eb2-93c4-47c37ded98b3 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa94814ccb35', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:36:52 user nova-compute[75165]: DEBUG nova.virt.block_device [None req-2d2293d7-e2d7-4eb2-93c4-47c37ded98b3 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] [instance: 6ae9fe6f-eb17-44f5-89e4-fff5e3451336] Updating existing volume attachment record: b164580a-5a14-4667-849c-2f1fd946ff42 {{(pid=75165) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 00:36:52 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-115a9b59-e2a1-47c0-a928-a17fa69066f0 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 7e534595-7eaf-49f4-b457-9f37bc59012b] Calling os-brick to attach iSCSI Volume {{(pid=75165) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 00:36:52 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-115a9b59-e2a1-47c0-a928-a17fa69066f0 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8bf8160e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:927d04d0-50f4-459c-8c3c-ed41d757d7ca', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CSZyzdfg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:36:52 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-115a9b59-e2a1-47c0-a928-a17fa69066f0 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:36:52 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-115a9b59-e2a1-47c0-a928-a17fa69066f0 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:36:52 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-115a9b59-e2a1-47c0-a928-a17fa69066f0 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:36:52 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-115a9b59-e2a1-47c0-a928-a17fa69066f0 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:36:52 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-115a9b59-e2a1-47c0-a928-a17fa69066f0 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:927d04d0-50f4-459c-8c3c-ed41d757d7ca" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:36:52 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-115a9b59-e2a1-47c0-a928-a17fa69066f0 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:927d04d0-50f4-459c-8c3c-ed41d757d7ca" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:36:52 user nova-compute[75165]: INFO os_brick.initiator.connectors.iscsi [None req-115a9b59-e2a1-47c0-a928-a17fa69066f0 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 00:36:52 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:927d04d0-50f4-459c-8c3c-ed41d757d7ca -p 172.16.0.220:3260 {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:36:52 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:927d04d0-50f4-459c-8c3c-ed41d757d7ca -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:36:52 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[faf600c2-5a5b-4f87-bb98-0eb419f93298]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:36:52 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-115a9b59-e2a1-47c0-a928-a17fa69066f0 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 00:36:52 user nova-compute[75165]:  {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:36:52 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:927d04d0-50f4-459c-8c3c-ed41d757d7ca -p 172.16.0.220:3260 --interface default --op new {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:36:52 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:927d04d0-50f4-459c-8c3c-ed41d757d7ca -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:36:52 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d69de24-7ca9-4b68-9559-416326134b65]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:927d04d0-50f4-459c-8c3c-ed41d757d7ca] added\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:36:52 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-115a9b59-e2a1-47c0-a928-a17fa69066f0 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:927d04d0-50f4-459c-8c3c-ed41d757d7ca] added
Oct 26 00:36:52 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:36:52 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:927d04d0-50f4-459c-8c3c-ed41d757d7ca -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:36:52 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:927d04d0-50f4-459c-8c3c-ed41d757d7ca -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:36:52 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[4572b58b-4ee2-47b7-b063-66a10fb38fda]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:36:52 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-115a9b59-e2a1-47c0-a928-a17fa69066f0 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:36:52 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:927d04d0-50f4-459c-8c3c-ed41d757d7ca -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:36:53 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:927d04d0-50f4-459c-8c3c-ed41d757d7ca -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:36:53 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[112ad08f-46cc-4bc5-9725-78b9a1c1a772]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:36:53 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-115a9b59-e2a1-47c0-a928-a17fa69066f0 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:36:53 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:927d04d0-50f4-459c-8c3c-ed41d757d7ca -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CSZyzdfg {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:36:53 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:927d04d0-50f4-459c-8c3c-ed41d757d7ca -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CSZyzdfg" returned: 0 in 0.019s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:36:53 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[071ab351-4f82-4e8f-bd24-b12adfbcd121]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:36:53 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-115a9b59-e2a1-47c0-a928-a17fa69066f0 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CSZyzdfg'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:36:53 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:927d04d0-50f4-459c-8c3c-ed41d757d7ca -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:36:53 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:927d04d0-50f4-459c-8c3c-ed41d757d7ca -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:36:53 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9adda91-18d8-47e6-b831-965f5a4614ea]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:36:53 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-115a9b59-e2a1-47c0-a928-a17fa69066f0 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:36:53 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:36:53 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:36:53 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d66ef97-7753-4cd7-8082-952d4d4e93c9]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2abefc2-1cb2-4993-a7e2-f043ee79ac56 (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:36:53 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-115a9b59-e2a1-47c0-a928-a17fa69066f0 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)
Oct 26 00:36:53 user nova-compute[75165]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2abefc2-1cb2-4993-a7e2-f043ee79ac56 (non-flash)
Oct 26 00:36:53 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:36:53 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-115a9b59-e2a1-47c0-a928-a17fa69066f0 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)
Oct 26 00:36:53 user nova-compute[75165]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2abefc2-1cb2-4993-a7e2-f043ee79ac56 (non-flash)
Oct 26 00:36:53 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:36:53 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:927d04d0-50f4-459c-8c3c-ed41d757d7ca -p 172.16.0.220:3260 --login {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:36:53 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:927d04d0-50f4-459c-8c3c-ed41d757d7ca -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:36:53 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb191d0c-2a67-463f-b5f0-9d241896b853]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:927d04d0-50f4-459c-8c3c-ed41d757d7ca, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:927d04d0-50f4-459c-8c3c-ed41d757d7ca, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:36:53 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-115a9b59-e2a1-47c0-a928-a17fa69066f0 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:927d04d0-50f4-459c-8c3c-ed41d757d7ca, portal: 172.16.0.220,3260]
Oct 26 00:36:53 user nova-compute[75165]: Login to [iface: default, target: iqn.2010-10.org.openstack:927d04d0-50f4-459c-8c3c-ed41d757d7ca, portal: 172.16.0.220,3260] successful.
Oct 26 00:36:53 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:36:53 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:927d04d0-50f4-459c-8c3c-ed41d757d7ca -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:36:53 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:927d04d0-50f4-459c-8c3c-ed41d757d7ca -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.030s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:36:53 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[442a41d2-37c1-4147-9fd9-bbe132283b43]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:36:53 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-115a9b59-e2a1-47c0-a928-a17fa69066f0 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:36:53 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:36:53 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:36:53 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6b953de-3bd7-45f6-b9be-9f15c5c2c00e]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2abefc2-1cb2-4993-a7e2-f043ee79ac56 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:927d04d0-50f4-459c-8c3c-ed41d757d7ca (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:36:53 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-115a9b59-e2a1-47c0-a928-a17fa69066f0 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)
Oct 26 00:36:53 user nova-compute[75165]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2abefc2-1cb2-4993-a7e2-f043ee79ac56 (non-flash)
Oct 26 00:36:53 user nova-compute[75165]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:927d04d0-50f4-459c-8c3c-ed41d757d7ca (non-flash)
Oct 26 00:36:53 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:36:53 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-115a9b59-e2a1-47c0-a928-a17fa69066f0 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)
Oct 26 00:36:53 user nova-compute[75165]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2abefc2-1cb2-4993-a7e2-f043ee79ac56 (non-flash)
Oct 26 00:36:53 user nova-compute[75165]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:927d04d0-50f4-459c-8c3c-ed41d757d7ca (non-flash)
Oct 26 00:36:53 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:36:53 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-115a9b59-e2a1-47c0-a928-a17fa69066f0 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:927d04d0-50f4-459c-8c3c-ed41d757d7ca" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.312s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:36:53 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-115a9b59-e2a1-47c0-a928-a17fa69066f0 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Connected to 172.16.0.220:3260 {{(pid=75165) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 00:36:53 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-115a9b59-e2a1-47c0-a928-a17fa69066f0 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] HCTL ('35', '-', '-', 0) found on session 44 with lun 0 {{(pid=75165) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 00:36:53 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-115a9b59-e2a1-47c0-a928-a17fa69066f0 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75165) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 00:36:53 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:36:53 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:36:53 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f947427-b960-436a-a2e9-16b04100ff39]: (4, ('- - 0', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:36:53 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-115a9b59-e2a1-47c0-a928-a17fa69066f0 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Searching for a device in session 44 and hctl ['35', '*', '*', 0] yield: None {{(pid=75165) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 00:36:54 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-115a9b59-e2a1-47c0-a928-a17fa69066f0 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Searching for a device in session 44 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75165) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 00:36:54 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-115a9b59-e2a1-47c0-a928-a17fa69066f0 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:927d04d0-50f4-459c-8c3c-ed41d757d7ca', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CSZyzdfg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75165) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 00:36:54 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-115a9b59-e2a1-47c0-a928-a17fa69066f0 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.341s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:36:54 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-115a9b59-e2a1-47c0-a928-a17fa69066f0 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] <== connect_volume: return (1343ms) {'type': 'block', 'scsi_wwn': '23737653430323031', 'path': '/dev/sdd'} {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:36:54 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-115a9b59-e2a1-47c0-a928-a17fa69066f0 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 7e534595-7eaf-49f4-b457-9f37bc59012b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23737653430323031', 'path': '/dev/sdd'} {{(pid=75165) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 00:36:54 user nova-compute[75165]: DEBUG nova.objects.instance [None req-115a9b59-e2a1-47c0-a928-a17fa69066f0 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Lazy-loading 'flavor' on Instance uuid 7e534595-7eaf-49f4-b457-9f37bc59012b {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:36:54 user nova-compute[75165]: DEBUG nova.virt.libvirt.guest [None req-115a9b59-e2a1-47c0-a928-a17fa69066f0 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 00:36:54 user nova-compute[75165]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 00:36:54 user nova-compute[75165]:   <source dev="/dev/sdd"/>
Oct 26 00:36:54 user nova-compute[75165]:   <target dev="vdb" bus="virtio"/>
Oct 26 00:36:54 user nova-compute[75165]:   <serial>927d04d0-50f4-459c-8c3c-ed41d757d7ca</serial>
Oct 26 00:36:54 user nova-compute[75165]: </disk>
Oct 26 00:36:54 user nova-compute[75165]:  {{(pid=75165) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 00:36:54 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-115a9b59-e2a1-47c0-a928-a17fa69066f0 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] No BDM found with device name vda, not building metadata. {{(pid=75165) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 00:36:54 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-115a9b59-e2a1-47c0-a928-a17fa69066f0 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75165) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 00:36:54 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-115a9b59-e2a1-47c0-a928-a17fa69066f0 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] No VIF found with MAC fa:16:3e:60:42:1c, not building metadata {{(pid=75165) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 00:36:54 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-115a9b59-e2a1-47c0-a928-a17fa69066f0 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Lock "7e534595-7eaf-49f4-b457-9f37bc59012b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.959s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:36:56 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:36:57 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:36:57 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-9c3c86fe-cae3-4be0-a58f-537a5f7c2617 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Acquiring lock "454ce3d7-a631-418c-a446-b614eb0d6f28" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:36:57 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-9c3c86fe-cae3-4be0-a58f-537a5f7c2617 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Lock "454ce3d7-a631-418c-a446-b614eb0d6f28" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:36:57 user nova-compute[75165]: DEBUG nova.compute.manager [None req-9c3c86fe-cae3-4be0-a58f-537a5f7c2617 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 454ce3d7-a631-418c-a446-b614eb0d6f28] Starting instance... {{(pid=75165) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 00:36:58 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-9c3c86fe-cae3-4be0-a58f-537a5f7c2617 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:36:58 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-9c3c86fe-cae3-4be0-a58f-537a5f7c2617 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:36:58 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-9c3c86fe-cae3-4be0-a58f-537a5f7c2617 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75165) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 00:36:58 user nova-compute[75165]: INFO nova.compute.claims [None req-9c3c86fe-cae3-4be0-a58f-537a5f7c2617 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 454ce3d7-a631-418c-a446-b614eb0d6f28] Claim successful on node user
Oct 26 00:36:58 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-9c3c86fe-cae3-4be0-a58f-537a5f7c2617 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:36:58 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-9c3c86fe-cae3-4be0-a58f-537a5f7c2617 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:36:58 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-9c3c86fe-cae3-4be0-a58f-537a5f7c2617 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.334s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:36:58 user nova-compute[75165]: DEBUG nova.compute.manager [None req-9c3c86fe-cae3-4be0-a58f-537a5f7c2617 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 454ce3d7-a631-418c-a446-b614eb0d6f28] Start building networks asynchronously for instance. {{(pid=75165) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 00:36:58 user nova-compute[75165]: DEBUG nova.compute.manager [None req-9c3c86fe-cae3-4be0-a58f-537a5f7c2617 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 454ce3d7-a631-418c-a446-b614eb0d6f28] Allocating IP information in the background. {{(pid=75165) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 00:36:58 user nova-compute[75165]: DEBUG nova.network.neutron [None req-9c3c86fe-cae3-4be0-a58f-537a5f7c2617 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 454ce3d7-a631-418c-a446-b614eb0d6f28] allocate_for_instance() {{(pid=75165) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 00:36:58 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-9c3c86fe-cae3-4be0-a58f-537a5f7c2617 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 454ce3d7-a631-418c-a446-b614eb0d6f28] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 00:36:58 user nova-compute[75165]: DEBUG nova.compute.manager [None req-9c3c86fe-cae3-4be0-a58f-537a5f7c2617 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 454ce3d7-a631-418c-a446-b614eb0d6f28] Start building block device mappings for instance. {{(pid=75165) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 00:36:58 user nova-compute[75165]: DEBUG nova.policy [None req-9c3c86fe-cae3-4be0-a58f-537a5f7c2617 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '041ebe2732c341129d6813549653cab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62572ce8ae524b55950532fd89729b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75165) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 00:36:58 user nova-compute[75165]: DEBUG nova.compute.manager [None req-9c3c86fe-cae3-4be0-a58f-537a5f7c2617 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 454ce3d7-a631-418c-a446-b614eb0d6f28] Start spawning the instance on the hypervisor. {{(pid=75165) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 00:36:58 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-9c3c86fe-cae3-4be0-a58f-537a5f7c2617 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 454ce3d7-a631-418c-a446-b614eb0d6f28] Creating instance directory {{(pid=75165) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 00:36:58 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-9c3c86fe-cae3-4be0-a58f-537a5f7c2617 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 454ce3d7-a631-418c-a446-b614eb0d6f28] Creating image(s)
Oct 26 00:36:58 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-9c3c86fe-cae3-4be0-a58f-537a5f7c2617 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Acquiring lock "/opt/stack/data/nova/instances/454ce3d7-a631-418c-a446-b614eb0d6f28/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:36:58 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-9c3c86fe-cae3-4be0-a58f-537a5f7c2617 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Lock "/opt/stack/data/nova/instances/454ce3d7-a631-418c-a446-b614eb0d6f28/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:36:58 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-9c3c86fe-cae3-4be0-a58f-537a5f7c2617 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Lock "/opt/stack/data/nova/instances/454ce3d7-a631-418c-a446-b614eb0d6f28/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.013s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:36:58 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-9c3c86fe-cae3-4be0-a58f-537a5f7c2617 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:36:58 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-9c3c86fe-cae3-4be0-a58f-537a5f7c2617 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json" returned: 0 in 0.179s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:36:58 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-9c3c86fe-cae3-4be0-a58f-537a5f7c2617 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Acquiring lock "7d3243421cf3fdc288b758f687a93103b7b95466" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:36:58 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-9c3c86fe-cae3-4be0-a58f-537a5f7c2617 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Lock "7d3243421cf3fdc288b758f687a93103b7b95466" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:36:58 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-9c3c86fe-cae3-4be0-a58f-537a5f7c2617 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:36:58 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-9c3c86fe-cae3-4be0-a58f-537a5f7c2617 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json" returned: 0 in 0.170s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:36:58 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-9c3c86fe-cae3-4be0-a58f-537a5f7c2617 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466,backing_fmt=raw /opt/stack/data/nova/instances/454ce3d7-a631-418c-a446-b614eb0d6f28/disk 1073741824 {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:36:58 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-9c3c86fe-cae3-4be0-a58f-537a5f7c2617 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466,backing_fmt=raw /opt/stack/data/nova/instances/454ce3d7-a631-418c-a446-b614eb0d6f28/disk 1073741824" returned: 0 in 0.048s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:36:58 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-9c3c86fe-cae3-4be0-a58f-537a5f7c2617 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Lock "7d3243421cf3fdc288b758f687a93103b7b95466" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.225s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:36:58 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-9c3c86fe-cae3-4be0-a58f-537a5f7c2617 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:36:59 user nova-compute[75165]: DEBUG nova.network.neutron [None req-9c3c86fe-cae3-4be0-a58f-537a5f7c2617 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 454ce3d7-a631-418c-a446-b614eb0d6f28] Successfully created port: 53bac58f-e414-486a-8efc-4dbfb9ef8209 {{(pid=75165) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 00:36:59 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-9c3c86fe-cae3-4be0-a58f-537a5f7c2617 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json" returned: 0 in 0.227s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:36:59 user nova-compute[75165]: DEBUG nova.virt.disk.api [None req-9c3c86fe-cae3-4be0-a58f-537a5f7c2617 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Checking if we can resize image /opt/stack/data/nova/instances/454ce3d7-a631-418c-a446-b614eb0d6f28/disk. size=1073741824 {{(pid=75165) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 00:36:59 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-9c3c86fe-cae3-4be0-a58f-537a5f7c2617 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/454ce3d7-a631-418c-a446-b614eb0d6f28/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:36:59 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-9c3c86fe-cae3-4be0-a58f-537a5f7c2617 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/454ce3d7-a631-418c-a446-b614eb0d6f28/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:36:59 user nova-compute[75165]: DEBUG nova.virt.disk.api [None req-9c3c86fe-cae3-4be0-a58f-537a5f7c2617 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Cannot resize image /opt/stack/data/nova/instances/454ce3d7-a631-418c-a446-b614eb0d6f28/disk to a smaller size. {{(pid=75165) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 00:36:59 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-9c3c86fe-cae3-4be0-a58f-537a5f7c2617 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 454ce3d7-a631-418c-a446-b614eb0d6f28] Created local disks {{(pid=75165) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 00:36:59 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-9c3c86fe-cae3-4be0-a58f-537a5f7c2617 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 454ce3d7-a631-418c-a446-b614eb0d6f28] Ensure instance console log exists: /opt/stack/data/nova/instances/454ce3d7-a631-418c-a446-b614eb0d6f28/console.log {{(pid=75165) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 00:36:59 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-9c3c86fe-cae3-4be0-a58f-537a5f7c2617 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:36:59 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-9c3c86fe-cae3-4be0-a58f-537a5f7c2617 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:36:59 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-9c3c86fe-cae3-4be0-a58f-537a5f7c2617 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:37:00 user nova-compute[75165]: DEBUG nova.network.neutron [None req-9c3c86fe-cae3-4be0-a58f-537a5f7c2617 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 454ce3d7-a631-418c-a446-b614eb0d6f28] Successfully updated port: 53bac58f-e414-486a-8efc-4dbfb9ef8209 {{(pid=75165) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 00:37:00 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-9c3c86fe-cae3-4be0-a58f-537a5f7c2617 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Acquiring lock "refresh_cache-454ce3d7-a631-418c-a446-b614eb0d6f28" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:37:00 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-9c3c86fe-cae3-4be0-a58f-537a5f7c2617 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Acquired lock "refresh_cache-454ce3d7-a631-418c-a446-b614eb0d6f28" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:37:00 user nova-compute[75165]: DEBUG nova.network.neutron [None req-9c3c86fe-cae3-4be0-a58f-537a5f7c2617 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 454ce3d7-a631-418c-a446-b614eb0d6f28] Building network info cache for instance {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 00:37:00 user nova-compute[75165]: DEBUG nova.compute.manager [req-551d8981-5ad9-4c02-aa06-ea38eafb1bd1 req-334336fd-7bff-412a-87c1-94f8b5246408 service nova] [instance: 454ce3d7-a631-418c-a446-b614eb0d6f28] Received event network-changed-53bac58f-e414-486a-8efc-4dbfb9ef8209 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:37:00 user nova-compute[75165]: DEBUG nova.compute.manager [req-551d8981-5ad9-4c02-aa06-ea38eafb1bd1 req-334336fd-7bff-412a-87c1-94f8b5246408 service nova] [instance: 454ce3d7-a631-418c-a446-b614eb0d6f28] Refreshing instance network info cache due to event network-changed-53bac58f-e414-486a-8efc-4dbfb9ef8209. {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 00:37:00 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-551d8981-5ad9-4c02-aa06-ea38eafb1bd1 req-334336fd-7bff-412a-87c1-94f8b5246408 service nova] Acquiring lock "refresh_cache-454ce3d7-a631-418c-a446-b614eb0d6f28" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:37:00 user nova-compute[75165]: DEBUG nova.network.neutron [None req-9c3c86fe-cae3-4be0-a58f-537a5f7c2617 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 454ce3d7-a631-418c-a446-b614eb0d6f28] Instance cache missing network info. {{(pid=75165) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 00:37:00 user nova-compute[75165]: DEBUG nova.network.neutron [None req-9c3c86fe-cae3-4be0-a58f-537a5f7c2617 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 454ce3d7-a631-418c-a446-b614eb0d6f28] Updating instance_info_cache with network_info: [{"id": "53bac58f-e414-486a-8efc-4dbfb9ef8209", "address": "fa:16:3e:7e:24:b6", "network": {"id": "1801db1c-315e-4bdf-b73b-132a38bf41b8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1254756052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62572ce8ae524b55950532fd89729b71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53bac58f-e4", "ovs_interfaceid": "53bac58f-e414-486a-8efc-4dbfb9ef8209", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:37:00 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-9c3c86fe-cae3-4be0-a58f-537a5f7c2617 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Releasing lock "refresh_cache-454ce3d7-a631-418c-a446-b614eb0d6f28" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:37:00 user nova-compute[75165]: DEBUG nova.compute.manager [None req-9c3c86fe-cae3-4be0-a58f-537a5f7c2617 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 454ce3d7-a631-418c-a446-b614eb0d6f28] Instance network_info: |[{"id": "53bac58f-e414-486a-8efc-4dbfb9ef8209", "address": "fa:16:3e:7e:24:b6", "network": {"id": "1801db1c-315e-4bdf-b73b-132a38bf41b8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1254756052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62572ce8ae524b55950532fd89729b71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53bac58f-e4", "ovs_interfaceid": "53bac58f-e414-486a-8efc-4dbfb9ef8209", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75165) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 00:37:00 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-551d8981-5ad9-4c02-aa06-ea38eafb1bd1 req-334336fd-7bff-412a-87c1-94f8b5246408 service nova] Acquired lock "refresh_cache-454ce3d7-a631-418c-a446-b614eb0d6f28" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:37:00 user nova-compute[75165]: DEBUG nova.network.neutron [req-551d8981-5ad9-4c02-aa06-ea38eafb1bd1 req-334336fd-7bff-412a-87c1-94f8b5246408 service nova] [instance: 454ce3d7-a631-418c-a446-b614eb0d6f28] Refreshing network info cache for port 53bac58f-e414-486a-8efc-4dbfb9ef8209 {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 00:37:00 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-9c3c86fe-cae3-4be0-a58f-537a5f7c2617 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 454ce3d7-a631-418c-a446-b614eb0d6f28] Start _get_guest_xml network_info=[{"id": "53bac58f-e414-486a-8efc-4dbfb9ef8209", "address": "fa:16:3e:7e:24:b6", "network": {"id": "1801db1c-315e-4bdf-b73b-132a38bf41b8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1254756052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62572ce8ae524b55950532fd89729b71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53bac58f-e4", "ovs_interfaceid": "53bac58f-e414-486a-8efc-4dbfb9ef8209", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T00:03:24Z,direct_url=<?>,disk_format='qcow2',id=bff0d8a1-739e-4c4d-9efa-b73ba7b76d01,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e56bbf444fd34c348475c73673611447',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T00:03:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'size': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': 'bff0d8a1-739e-4c4d-9efa-b73ba7b76d01'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75165) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 00:37:00 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-9c3c86fe-cae3-4be0-a58f-537a5f7c2617 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:37:00 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-9c3c86fe-cae3-4be0-a58f-537a5f7c2617 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:37:00 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-9c3c86fe-cae3-4be0-a58f-537a5f7c2617 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75165) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 00:37:00 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-9c3c86fe-cae3-4be0-a58f-537a5f7c2617 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] CPU controller missing on host. {{(pid=75165) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 00:37:00 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-9c3c86fe-cae3-4be0-a58f-537a5f7c2617 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75165) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 00:37:00 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-9c3c86fe-cae3-4be0-a58f-537a5f7c2617 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] CPU controller found on host. {{(pid=75165) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 00:37:00 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-9c3c86fe-cae3-4be0-a58f-537a5f7c2617 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75165) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 00:37:00 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-9c3c86fe-cae3-4be0-a58f-537a5f7c2617 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T00:03:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T00:03:24Z,direct_url=<?>,disk_format='qcow2',id=bff0d8a1-739e-4c4d-9efa-b73ba7b76d01,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e56bbf444fd34c348475c73673611447',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T00:03:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 00:37:00 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-9c3c86fe-cae3-4be0-a58f-537a5f7c2617 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Flavor limits 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 00:37:00 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-9c3c86fe-cae3-4be0-a58f-537a5f7c2617 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Image limits 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 00:37:00 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-9c3c86fe-cae3-4be0-a58f-537a5f7c2617 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Flavor pref 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 00:37:00 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-9c3c86fe-cae3-4be0-a58f-537a5f7c2617 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Image pref 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 00:37:00 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-9c3c86fe-cae3-4be0-a58f-537a5f7c2617 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 00:37:00 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-9c3c86fe-cae3-4be0-a58f-537a5f7c2617 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 00:37:00 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-9c3c86fe-cae3-4be0-a58f-537a5f7c2617 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75165) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 00:37:00 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-9c3c86fe-cae3-4be0-a58f-537a5f7c2617 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Got 1 possible topologies {{(pid=75165) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 00:37:00 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-9c3c86fe-cae3-4be0-a58f-537a5f7c2617 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 00:37:00 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-9c3c86fe-cae3-4be0-a58f-537a5f7c2617 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 00:37:00 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-9c3c86fe-cae3-4be0-a58f-537a5f7c2617 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:36:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1532760107',display_name='tempest-AttachVolumeNegativeTest-server-1532760107',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1532760107',id=41,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHU0AnYILx7xJE9tSNnrFU5mbFm+GNup24EaRmVzf+F7CKgHNoA65vi5uXUOH/GGbnKQacPsNEGV/Ruh5Vt4jg5HVAI/2OeB9Bxr217Ig3pBsIQB5ylc/xwAXNakvXSWbg==',key_name='tempest-keypair-1355587032',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='62572ce8ae524b55950532fd89729b71',ramdisk_id='',reservation_id='r-y9446893',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-988376295',owner_user_name='tempest-AttachVolumeNegativeTest-988376295-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T00:36:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='041ebe2732c341129d6813549653cab3',uuid=454ce3d7-a631-418c-a446-b614eb0d6f28,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "53bac58f-e414-486a-8efc-4dbfb9ef8209", "address": "fa:16:3e:7e:24:b6", "network": {"id": "1801db1c-315e-4bdf-b73b-132a38bf41b8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1254756052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62572ce8ae524b55950532fd89729b71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53bac58f-e4", "ovs_interfaceid": "53bac58f-e414-486a-8efc-4dbfb9ef8209", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75165) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 00:37:00 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-9c3c86fe-cae3-4be0-a58f-537a5f7c2617 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Converting VIF {"id": "53bac58f-e414-486a-8efc-4dbfb9ef8209", "address": "fa:16:3e:7e:24:b6", "network": {"id": "1801db1c-315e-4bdf-b73b-132a38bf41b8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1254756052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62572ce8ae524b55950532fd89729b71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53bac58f-e4", "ovs_interfaceid": "53bac58f-e414-486a-8efc-4dbfb9ef8209", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:37:00 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-9c3c86fe-cae3-4be0-a58f-537a5f7c2617 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:24:b6,bridge_name='br-int',has_traffic_filtering=True,id=53bac58f-e414-486a-8efc-4dbfb9ef8209,network=Network(1801db1c-315e-4bdf-b73b-132a38bf41b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53bac58f-e4') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:37:00 user nova-compute[75165]: DEBUG nova.objects.instance [None req-9c3c86fe-cae3-4be0-a58f-537a5f7c2617 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Lazy-loading 'pci_devices' on Instance uuid 454ce3d7-a631-418c-a446-b614eb0d6f28 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:37:00 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-527754e3-8531-4e5c-a720-17cf4cb45a58 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Acquiring lock "a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:37:00 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-527754e3-8531-4e5c-a720-17cf4cb45a58 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Lock "a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:37:00 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-527754e3-8531-4e5c-a720-17cf4cb45a58 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Acquiring lock "a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:37:00 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-527754e3-8531-4e5c-a720-17cf4cb45a58 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Lock "a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:37:00 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-527754e3-8531-4e5c-a720-17cf4cb45a58 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Lock "a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:37:00 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-9c3c86fe-cae3-4be0-a58f-537a5f7c2617 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 454ce3d7-a631-418c-a446-b614eb0d6f28] End _get_guest_xml xml=<domain type="kvm">
Oct 26 00:37:00 user nova-compute[75165]:   <uuid>454ce3d7-a631-418c-a446-b614eb0d6f28</uuid>
Oct 26 00:37:00 user nova-compute[75165]:   <name>instance-00000029</name>
Oct 26 00:37:00 user nova-compute[75165]:   <memory>524288</memory>
Oct 26 00:37:00 user nova-compute[75165]:   <vcpu>1</vcpu>
Oct 26 00:37:00 user nova-compute[75165]:   <metadata>
Oct 26 00:37:00 user nova-compute[75165]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 00:37:00 user nova-compute[75165]:       <nova:package version="0.0.0"/>
Oct 26 00:37:00 user nova-compute[75165]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1532760107</nova:name>
Oct 26 00:37:00 user nova-compute[75165]:       <nova:creationTime>2023-10-26 00:37:00</nova:creationTime>
Oct 26 00:37:00 user nova-compute[75165]:       <nova:flavor name="m1.tiny">
Oct 26 00:37:00 user nova-compute[75165]:         <nova:memory>512</nova:memory>
Oct 26 00:37:00 user nova-compute[75165]:         <nova:disk>1</nova:disk>
Oct 26 00:37:00 user nova-compute[75165]:         <nova:swap>0</nova:swap>
Oct 26 00:37:00 user nova-compute[75165]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 00:37:00 user nova-compute[75165]:         <nova:vcpus>1</nova:vcpus>
Oct 26 00:37:00 user nova-compute[75165]:       </nova:flavor>
Oct 26 00:37:00 user nova-compute[75165]:       <nova:owner>
Oct 26 00:37:00 user nova-compute[75165]:         <nova:user uuid="041ebe2732c341129d6813549653cab3">tempest-AttachVolumeNegativeTest-988376295-project-member</nova:user>
Oct 26 00:37:00 user nova-compute[75165]:         <nova:project uuid="62572ce8ae524b55950532fd89729b71">tempest-AttachVolumeNegativeTest-988376295</nova:project>
Oct 26 00:37:00 user nova-compute[75165]:       </nova:owner>
Oct 26 00:37:00 user nova-compute[75165]:       <nova:root type="image" uuid="bff0d8a1-739e-4c4d-9efa-b73ba7b76d01"/>
Oct 26 00:37:00 user nova-compute[75165]:       <nova:ports>
Oct 26 00:37:00 user nova-compute[75165]:         <nova:port uuid="53bac58f-e414-486a-8efc-4dbfb9ef8209">
Oct 26 00:37:00 user nova-compute[75165]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 26 00:37:00 user nova-compute[75165]:         </nova:port>
Oct 26 00:37:00 user nova-compute[75165]:       </nova:ports>
Oct 26 00:37:00 user nova-compute[75165]:     </nova:instance>
Oct 26 00:37:00 user nova-compute[75165]:   </metadata>
Oct 26 00:37:00 user nova-compute[75165]:   <sysinfo type="smbios">
Oct 26 00:37:00 user nova-compute[75165]:     <system>
Oct 26 00:37:00 user nova-compute[75165]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 00:37:00 user nova-compute[75165]:       <entry name="product">OpenStack Nova</entry>
Oct 26 00:37:00 user nova-compute[75165]:       <entry name="version">0.0.0</entry>
Oct 26 00:37:00 user nova-compute[75165]:       <entry name="serial">454ce3d7-a631-418c-a446-b614eb0d6f28</entry>
Oct 26 00:37:00 user nova-compute[75165]:       <entry name="uuid">454ce3d7-a631-418c-a446-b614eb0d6f28</entry>
Oct 26 00:37:00 user nova-compute[75165]:       <entry name="family">Virtual Machine</entry>
Oct 26 00:37:00 user nova-compute[75165]:     </system>
Oct 26 00:37:00 user nova-compute[75165]:   </sysinfo>
Oct 26 00:37:00 user nova-compute[75165]:   <os>
Oct 26 00:37:00 user nova-compute[75165]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 00:37:00 user nova-compute[75165]:     <boot dev="hd"/>
Oct 26 00:37:00 user nova-compute[75165]:     <smbios mode="sysinfo"/>
Oct 26 00:37:00 user nova-compute[75165]:   </os>
Oct 26 00:37:00 user nova-compute[75165]:   <features>
Oct 26 00:37:00 user nova-compute[75165]:     <acpi/>
Oct 26 00:37:00 user nova-compute[75165]:     <apic/>
Oct 26 00:37:00 user nova-compute[75165]:     <vmcoreinfo/>
Oct 26 00:37:00 user nova-compute[75165]:   </features>
Oct 26 00:37:00 user nova-compute[75165]:   <clock offset="utc">
Oct 26 00:37:00 user nova-compute[75165]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 00:37:00 user nova-compute[75165]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 00:37:00 user nova-compute[75165]:     <timer name="hpet" present="no"/>
Oct 26 00:37:00 user nova-compute[75165]:   </clock>
Oct 26 00:37:00 user nova-compute[75165]:   <cpu mode="custom" match="exact">
Oct 26 00:37:00 user nova-compute[75165]:     <model>Nehalem</model>
Oct 26 00:37:00 user nova-compute[75165]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 00:37:00 user nova-compute[75165]:   </cpu>
Oct 26 00:37:00 user nova-compute[75165]:   <devices>
Oct 26 00:37:00 user nova-compute[75165]:     <disk type="file" device="disk">
Oct 26 00:37:00 user nova-compute[75165]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 00:37:00 user nova-compute[75165]:       <source file="/opt/stack/data/nova/instances/454ce3d7-a631-418c-a446-b614eb0d6f28/disk"/>
Oct 26 00:37:00 user nova-compute[75165]:       <target dev="vda" bus="virtio"/>
Oct 26 00:37:00 user nova-compute[75165]:     </disk>
Oct 26 00:37:00 user nova-compute[75165]:     <interface type="ethernet">
Oct 26 00:37:00 user nova-compute[75165]:       <mac address="fa:16:3e:7e:24:b6"/>
Oct 26 00:37:00 user nova-compute[75165]:       <model type="virtio"/>
Oct 26 00:37:00 user nova-compute[75165]:       <mtu size="1442"/>
Oct 26 00:37:00 user nova-compute[75165]:       <target dev="tap53bac58f-e4"/>
Oct 26 00:37:00 user nova-compute[75165]:     </interface>
Oct 26 00:37:00 user nova-compute[75165]:     <serial type="pty">
Oct 26 00:37:00 user nova-compute[75165]:       <log file="/opt/stack/data/nova/instances/454ce3d7-a631-418c-a446-b614eb0d6f28/console.log" append="off"/>
Oct 26 00:37:00 user nova-compute[75165]:     </serial>
Oct 26 00:37:00 user nova-compute[75165]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 00:37:00 user nova-compute[75165]:     <video>
Oct 26 00:37:00 user nova-compute[75165]:       <model type="virtio"/>
Oct 26 00:37:00 user nova-compute[75165]:     </video>
Oct 26 00:37:00 user nova-compute[75165]:     <rng model="virtio">
Oct 26 00:37:00 user nova-compute[75165]:       <backend model="random">/dev/urandom</backend>
Oct 26 00:37:00 user nova-compute[75165]:     </rng>
Oct 26 00:37:00 user nova-compute[75165]:     <controller type="usb" index="0" model="none"/>
Oct 26 00:37:00 user nova-compute[75165]:     <memballoon model="virtio">
Oct 26 00:37:00 user nova-compute[75165]:       <stats period="10"/>
Oct 26 00:37:00 user nova-compute[75165]:     </memballoon>
Oct 26 00:37:00 user nova-compute[75165]:   </devices>
Oct 26 00:37:00 user nova-compute[75165]: </domain>
Oct 26 00:37:00 user nova-compute[75165]:  {{(pid=75165) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 00:37:00 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-9c3c86fe-cae3-4be0-a58f-537a5f7c2617 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:36:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1532760107',display_name='tempest-AttachVolumeNegativeTest-server-1532760107',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1532760107',id=41,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHU0AnYILx7xJE9tSNnrFU5mbFm+GNup24EaRmVzf+F7CKgHNoA65vi5uXUOH/GGbnKQacPsNEGV/Ruh5Vt4jg5HVAI/2OeB9Bxr217Ig3pBsIQB5ylc/xwAXNakvXSWbg==',key_name='tempest-keypair-1355587032',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='62572ce8ae524b55950532fd89729b71',ramdisk_id='',reservation_id='r-y9446893',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-988376295',owner_user_name='tempest-AttachVolumeNegativeTest-988376295-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T00:36:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='041ebe2732c341129d6813549653cab3',uuid=454ce3d7-a631-418c-a446-b614eb0d6f28,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "53bac58f-e414-486a-8efc-4dbfb9ef8209", "address": "fa:16:3e:7e:24:b6", "network": {"id": "1801db1c-315e-4bdf-b73b-132a38bf41b8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1254756052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62572ce8ae524b55950532fd89729b71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53bac58f-e4", "ovs_interfaceid": "53bac58f-e414-486a-8efc-4dbfb9ef8209", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 00:37:00 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-9c3c86fe-cae3-4be0-a58f-537a5f7c2617 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Converting VIF {"id": "53bac58f-e414-486a-8efc-4dbfb9ef8209", "address": "fa:16:3e:7e:24:b6", "network": {"id": "1801db1c-315e-4bdf-b73b-132a38bf41b8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1254756052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62572ce8ae524b55950532fd89729b71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53bac58f-e4", "ovs_interfaceid": "53bac58f-e414-486a-8efc-4dbfb9ef8209", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:37:00 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-9c3c86fe-cae3-4be0-a58f-537a5f7c2617 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:24:b6,bridge_name='br-int',has_traffic_filtering=True,id=53bac58f-e414-486a-8efc-4dbfb9ef8209,network=Network(1801db1c-315e-4bdf-b73b-132a38bf41b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53bac58f-e4') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:37:00 user nova-compute[75165]: DEBUG os_vif [None req-9c3c86fe-cae3-4be0-a58f-537a5f7c2617 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:24:b6,bridge_name='br-int',has_traffic_filtering=True,id=53bac58f-e414-486a-8efc-4dbfb9ef8209,network=Network(1801db1c-315e-4bdf-b73b-132a38bf41b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53bac58f-e4') {{(pid=75165) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 00:37:00 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:37:00 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:37:00 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 00:37:00 user nova-compute[75165]: INFO nova.compute.manager [None req-527754e3-8531-4e5c-a720-17cf4cb45a58 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb] Terminating instance
Oct 26 00:37:00 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:37:00 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd0f3a4aa-8080-52f0-804b-2dac7a7b7e45', '_type': 'linux-noop'}}, row=False) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:37:00 user nova-compute[75165]: DEBUG nova.compute.manager [None req-527754e3-8531-4e5c-a720-17cf4cb45a58 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb] Start destroying the instance on the hypervisor. {{(pid=75165) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 00:37:00 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:37:00 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:37:00 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:37:00 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap53bac58f-e4, may_exist=True, interface_attrs={}) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:37:00 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap53bac58f-e4, col_values=(('qos', UUID('0f8dbfd0-8bca-4cea-91b5-8b22e4245799')),), if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:37:00 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap53bac58f-e4, col_values=(('external_ids', {'iface-id': '53bac58f-e414-486a-8efc-4dbfb9ef8209', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7e:24:b6', 'vm-uuid': '454ce3d7-a631-418c-a446-b614eb0d6f28'}),), if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:37:00 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:37:00 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:37:00 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:37:00 user nova-compute[75165]: INFO os_vif [None req-9c3c86fe-cae3-4be0-a58f-537a5f7c2617 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:24:b6,bridge_name='br-int',has_traffic_filtering=True,id=53bac58f-e414-486a-8efc-4dbfb9ef8209,network=Network(1801db1c-315e-4bdf-b73b-132a38bf41b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53bac58f-e4')
Oct 26 00:37:00 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:37:00 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-9c3c86fe-cae3-4be0-a58f-537a5f7c2617 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] No BDM found with device name vda, not building metadata. {{(pid=75165) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 00:37:00 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-9c3c86fe-cae3-4be0-a58f-537a5f7c2617 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] No VIF found with MAC fa:16:3e:7e:24:b6, not building metadata {{(pid=75165) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 00:37:00 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:37:00 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:37:00 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:37:01 user nova-compute[75165]: DEBUG nova.network.neutron [req-551d8981-5ad9-4c02-aa06-ea38eafb1bd1 req-334336fd-7bff-412a-87c1-94f8b5246408 service nova] [instance: 454ce3d7-a631-418c-a446-b614eb0d6f28] Updated VIF entry in instance network info cache for port 53bac58f-e414-486a-8efc-4dbfb9ef8209. {{(pid=75165) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 00:37:01 user nova-compute[75165]: DEBUG nova.network.neutron [req-551d8981-5ad9-4c02-aa06-ea38eafb1bd1 req-334336fd-7bff-412a-87c1-94f8b5246408 service nova] [instance: 454ce3d7-a631-418c-a446-b614eb0d6f28] Updating instance_info_cache with network_info: [{"id": "53bac58f-e414-486a-8efc-4dbfb9ef8209", "address": "fa:16:3e:7e:24:b6", "network": {"id": "1801db1c-315e-4bdf-b73b-132a38bf41b8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1254756052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62572ce8ae524b55950532fd89729b71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53bac58f-e4", "ovs_interfaceid": "53bac58f-e414-486a-8efc-4dbfb9ef8209", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:37:01 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-551d8981-5ad9-4c02-aa06-ea38eafb1bd1 req-334336fd-7bff-412a-87c1-94f8b5246408 service nova] Releasing lock "refresh_cache-454ce3d7-a631-418c-a446-b614eb0d6f28" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:37:01 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:37:01 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:37:01 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb] Instance destroyed successfully.
Oct 26 00:37:01 user nova-compute[75165]: DEBUG nova.objects.instance [None req-527754e3-8531-4e5c-a720-17cf4cb45a58 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Lazy-loading 'resources' on Instance uuid a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:37:01 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:37:01 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-527754e3-8531-4e5c-a720-17cf4cb45a58 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:21:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1103241586',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1103241586',id=28,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-26T00:23:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d616862c7c184de5b0ba3121552c5666',ramdisk_id='',reservation_id='r-ely1lsv4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-638746030',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T00:24:58Z,user_data=None,user_id='dbe0d52293264f33ae86de41dabeefcf',uuid=a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e2143e91-9f8c-4670-9f92-c2c00827a619", "address": "fa:16:3e:6c:b7:14", "network": {"id": "eb55c0bc-cae5-4ba3-851a-e31a50b52c88", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1081223830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d616862c7c184de5b0ba3121552c5666", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2143e91-9f", "ovs_interfaceid": "e2143e91-9f8c-4670-9f92-c2c00827a619", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 00:37:01 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-527754e3-8531-4e5c-a720-17cf4cb45a58 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Converting VIF {"id": "e2143e91-9f8c-4670-9f92-c2c00827a619", "address": "fa:16:3e:6c:b7:14", "network": {"id": "eb55c0bc-cae5-4ba3-851a-e31a50b52c88", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1081223830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d616862c7c184de5b0ba3121552c5666", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2143e91-9f", "ovs_interfaceid": "e2143e91-9f8c-4670-9f92-c2c00827a619", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:37:01 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-527754e3-8531-4e5c-a720-17cf4cb45a58 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6c:b7:14,bridge_name='br-int',has_traffic_filtering=True,id=e2143e91-9f8c-4670-9f92-c2c00827a619,network=Network(eb55c0bc-cae5-4ba3-851a-e31a50b52c88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2143e91-9f') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:37:01 user nova-compute[75165]: DEBUG os_vif [None req-527754e3-8531-4e5c-a720-17cf4cb45a58 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6c:b7:14,bridge_name='br-int',has_traffic_filtering=True,id=e2143e91-9f8c-4670-9f92-c2c00827a619,network=Network(eb55c0bc-cae5-4ba3-851a-e31a50b52c88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2143e91-9f') {{(pid=75165) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 00:37:01 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:37:01 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape2143e91-9f, bridge=br-int, if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:37:01 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:37:01 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:37:01 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:37:01 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:37:01 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c9aaf77f-728a-4864-8168-05bd438c1207) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:37:01 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:37:01 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:37:01 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:37:01 user nova-compute[75165]: INFO os_vif [None req-527754e3-8531-4e5c-a720-17cf4cb45a58 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6c:b7:14,bridge_name='br-int',has_traffic_filtering=True,id=e2143e91-9f8c-4670-9f92-c2c00827a619,network=Network(eb55c0bc-cae5-4ba3-851a-e31a50b52c88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2143e91-9f')
Oct 26 00:37:01 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-527754e3-8531-4e5c-a720-17cf4cb45a58 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb] calling os-brick to detach iSCSI Volume {{(pid=75165) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 00:37:01 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-527754e3-8531-4e5c-a720-17cf4cb45a58 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8bf8160e50>, {'target_iqn': 'iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cnlTHGmy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:37:01 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-527754e3-8531-4e5c-a720-17cf4cb45a58 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:37:01 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-527754e3-8531-4e5c-a720-17cf4cb45a58 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:37:01 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-527754e3-8531-4e5c-a720-17cf4cb45a58 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:37:01 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:37:01 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:37:01 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:37:01 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[763d97b5-18e2-4ad6-b7fd-5a5fe7025bcf]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d2abefc2-1cb2-4993-a7e2-f043ee79ac56\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:927d04d0-50f4-459c-8c3c-ed41d757d7ca\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:37:01 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-527754e3-8531-4e5c-a720-17cf4cb45a58 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 00:37:01 user nova-compute[75165]: No targets found.
Oct 26 00:37:01 user nova-compute[75165]: iSNS:
Oct 26 00:37:01 user nova-compute[75165]: No targets found.
Oct 26 00:37:01 user nova-compute[75165]: STATIC:
Oct 26 00:37:01 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:d2abefc2-1cb2-4993-a7e2-f043ee79ac56
Oct 26 00:37:01 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:37:01 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:37:01 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:927d04d0-50f4-459c-8c3c-ed41d757d7ca
Oct 26 00:37:01 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:37:01 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:37:01 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795
Oct 26 00:37:01 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:37:01 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:37:01 user nova-compute[75165]: FIRMWARE:
Oct 26 00:37:01 user nova-compute[75165]: No targets found.
Oct 26 00:37:01 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:37:01 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-527754e3-8531-4e5c-a720-17cf4cb45a58 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 00:37:01 user nova-compute[75165]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 00:37:01 user nova-compute[75165]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75165) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 00:37:01 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-527754e3-8531-4e5c-a720-17cf4cb45a58 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795', 0)] {{(pid=75165) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 00:37:01 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:37:01 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:37:01 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d8e86ab-bade-4637-812a-a589d2516153]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:927d04d0-50f4-459c-8c3c-ed41d757d7ca\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2abefc2-1cb2-4993-a7e2-f043ee79ac56\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:37:01 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:37:01 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:37:01 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[de80bbb8-bd13-4ed7-8037-aea3de43a19b]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2abefc2-1cb2-4993-a7e2-f043ee79ac56 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:927d04d0-50f4-459c-8c3c-ed41d757d7ca (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:37:01 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-527754e3-8531-4e5c-a720-17cf4cb45a58 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)
Oct 26 00:37:01 user nova-compute[75165]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2abefc2-1cb2-4993-a7e2-f043ee79ac56 (non-flash)
Oct 26 00:37:01 user nova-compute[75165]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:927d04d0-50f4-459c-8c3c-ed41d757d7ca (non-flash)
Oct 26 00:37:01 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:37:01 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-527754e3-8531-4e5c-a720-17cf4cb45a58 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 (non-flash)
Oct 26 00:37:01 user nova-compute[75165]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2abefc2-1cb2-4993-a7e2-f043ee79ac56 (non-flash)
Oct 26 00:37:01 user nova-compute[75165]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:927d04d0-50f4-459c-8c3c-ed41d757d7ca (non-flash)
Oct 26 00:37:01 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:37:01 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-527754e3-8531-4e5c-a720-17cf4cb45a58 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8be02cbd00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795'): ({'sdb'}, set())}) {{(pid=75165) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 00:37:01 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-527754e3-8531-4e5c-a720-17cf4cb45a58 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Removing single pathed devices sdb {{(pid=75165) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 00:37:01 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:37:01 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:37:01 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ebaa2b0-45bf-41c5-931f-05c4f36e6d9d]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:37:01 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:37:01 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:37:01 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:37:01 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdb09ab3-bfed-4093-b93c-eed3f91a0f6c]: (4, ('ok\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:37:01 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-527754e3-8531-4e5c-a720-17cf4cb45a58 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Flushing IO for device /dev/sdb {{(pid=75165) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 00:37:01 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:37:01 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:37:01 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:37:01 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1d374da-3996-48d7-998c-5940f439d2bf]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:37:01 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-527754e3-8531-4e5c-a720-17cf4cb45a58 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75165) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 00:37:01 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:37:01 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:37:01 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:37:01 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[986a273d-abdf-4b63-9183-f5ecf0a24214]: (4, ('1', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:37:01 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-527754e3-8531-4e5c-a720-17cf4cb45a58 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75165) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 00:37:01 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-527754e3-8531-4e5c-a720-17cf4cb45a58 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] SCSI volumes sdb have been removed. {{(pid=75165) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 00:37:01 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-527754e3-8531-4e5c-a720-17cf4cb45a58 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795')] {{(pid=75165) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 00:37:01 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:37:01 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:37:01 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd16154b-945d-4a8d-8d10-22975d0e8f31]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:37:01 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-527754e3-8531-4e5c-a720-17cf4cb45a58 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:37:01 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 -p 172.16.0.220:3260 --logout {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:37:01 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:37:01 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a0e2ffb-7788-4a7f-8b6d-ec2f7fb0856a]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:37:01 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-527754e3-8531-4e5c-a720-17cf4cb45a58 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795, portal: 172.16.0.220,3260]
Oct 26 00:37:01 user nova-compute[75165]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795, portal: 172.16.0.220,3260] successful.
Oct 26 00:37:01 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:37:01 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 -p 172.16.0.220:3260 --op delete {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:37:02 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9da1cf16-26d8-4277-823f-8ec488aa1795 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:37:02 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ea31149-8c92-41a6-8cb5-c34e50fce042]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:37:02 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-527754e3-8531-4e5c-a720-17cf4cb45a58 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:37:02 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-527754e3-8531-4e5c-a720-17cf4cb45a58 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.371s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:37:02 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-527754e3-8531-4e5c-a720-17cf4cb45a58 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] <== disconnect_volume: return (373ms) None {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:37:02 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-527754e3-8531-4e5c-a720-17cf4cb45a58 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb] Disconnected iSCSI Volume {{(pid=75165) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 00:37:02 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-527754e3-8531-4e5c-a720-17cf4cb45a58 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb] Deleting instance files /opt/stack/data/nova/instances/a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb_del
Oct 26 00:37:02 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-527754e3-8531-4e5c-a720-17cf4cb45a58 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb] Deletion of /opt/stack/data/nova/instances/a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb_del complete
Oct 26 00:37:02 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:37:02 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:37:02 user nova-compute[75165]: INFO nova.compute.manager [None req-527754e3-8531-4e5c-a720-17cf4cb45a58 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb] Took 1.57 seconds to destroy the instance on the hypervisor.
Oct 26 00:37:02 user nova-compute[75165]: DEBUG oslo.service.loopingcall [None req-527754e3-8531-4e5c-a720-17cf4cb45a58 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75165) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 00:37:02 user nova-compute[75165]: DEBUG nova.compute.manager [-] [instance: a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb] Deallocating network for instance {{(pid=75165) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 00:37:02 user nova-compute[75165]: DEBUG nova.network.neutron [-] [instance: a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb] deallocate_for_instance() {{(pid=75165) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 00:37:02 user nova-compute[75165]: DEBUG nova.compute.manager [req-0b81341b-3648-4eca-8319-8df612faba99 req-2d86601d-f052-4ea0-b4d2-120e989263c9 service nova] [instance: a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb] Received event network-vif-unplugged-e2143e91-9f8c-4670-9f92-c2c00827a619 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:37:02 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-0b81341b-3648-4eca-8319-8df612faba99 req-2d86601d-f052-4ea0-b4d2-120e989263c9 service nova] Acquiring lock "a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:37:02 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-0b81341b-3648-4eca-8319-8df612faba99 req-2d86601d-f052-4ea0-b4d2-120e989263c9 service nova] Lock "a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:37:02 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-0b81341b-3648-4eca-8319-8df612faba99 req-2d86601d-f052-4ea0-b4d2-120e989263c9 service nova] Lock "a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:37:02 user nova-compute[75165]: DEBUG nova.compute.manager [req-0b81341b-3648-4eca-8319-8df612faba99 req-2d86601d-f052-4ea0-b4d2-120e989263c9 service nova] [instance: a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb] No waiting events found dispatching network-vif-unplugged-e2143e91-9f8c-4670-9f92-c2c00827a619 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:37:02 user nova-compute[75165]: DEBUG nova.compute.manager [req-0b81341b-3648-4eca-8319-8df612faba99 req-2d86601d-f052-4ea0-b4d2-120e989263c9 service nova] [instance: a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb] Received event network-vif-unplugged-e2143e91-9f8c-4670-9f92-c2c00827a619 for instance with task_state deleting. {{(pid=75165) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 00:37:02 user nova-compute[75165]: DEBUG nova.compute.manager [req-0b81341b-3648-4eca-8319-8df612faba99 req-2d86601d-f052-4ea0-b4d2-120e989263c9 service nova] [instance: a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb] Received event network-vif-plugged-e2143e91-9f8c-4670-9f92-c2c00827a619 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:37:02 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-0b81341b-3648-4eca-8319-8df612faba99 req-2d86601d-f052-4ea0-b4d2-120e989263c9 service nova] Acquiring lock "a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:37:02 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-0b81341b-3648-4eca-8319-8df612faba99 req-2d86601d-f052-4ea0-b4d2-120e989263c9 service nova] Lock "a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:37:02 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-0b81341b-3648-4eca-8319-8df612faba99 req-2d86601d-f052-4ea0-b4d2-120e989263c9 service nova] Lock "a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:37:02 user nova-compute[75165]: DEBUG nova.compute.manager [req-0b81341b-3648-4eca-8319-8df612faba99 req-2d86601d-f052-4ea0-b4d2-120e989263c9 service nova] [instance: a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb] No waiting events found dispatching network-vif-plugged-e2143e91-9f8c-4670-9f92-c2c00827a619 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:37:02 user nova-compute[75165]: WARNING nova.compute.manager [req-0b81341b-3648-4eca-8319-8df612faba99 req-2d86601d-f052-4ea0-b4d2-120e989263c9 service nova] [instance: a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb] Received unexpected event network-vif-plugged-e2143e91-9f8c-4670-9f92-c2c00827a619 for instance with vm_state active and task_state deleting.
Oct 26 00:37:02 user nova-compute[75165]: DEBUG nova.compute.manager [req-0b81341b-3648-4eca-8319-8df612faba99 req-2d86601d-f052-4ea0-b4d2-120e989263c9 service nova] [instance: a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb] Received event network-vif-plugged-e2143e91-9f8c-4670-9f92-c2c00827a619 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:37:02 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-0b81341b-3648-4eca-8319-8df612faba99 req-2d86601d-f052-4ea0-b4d2-120e989263c9 service nova] Acquiring lock "a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:37:02 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-0b81341b-3648-4eca-8319-8df612faba99 req-2d86601d-f052-4ea0-b4d2-120e989263c9 service nova] Lock "a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:37:02 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-0b81341b-3648-4eca-8319-8df612faba99 req-2d86601d-f052-4ea0-b4d2-120e989263c9 service nova] Lock "a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:37:02 user nova-compute[75165]: DEBUG nova.compute.manager [req-0b81341b-3648-4eca-8319-8df612faba99 req-2d86601d-f052-4ea0-b4d2-120e989263c9 service nova] [instance: a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb] No waiting events found dispatching network-vif-plugged-e2143e91-9f8c-4670-9f92-c2c00827a619 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:37:02 user nova-compute[75165]: WARNING nova.compute.manager [req-0b81341b-3648-4eca-8319-8df612faba99 req-2d86601d-f052-4ea0-b4d2-120e989263c9 service nova] [instance: a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb] Received unexpected event network-vif-plugged-e2143e91-9f8c-4670-9f92-c2c00827a619 for instance with vm_state active and task_state deleting.
Oct 26 00:37:02 user nova-compute[75165]: DEBUG nova.compute.manager [req-0b81341b-3648-4eca-8319-8df612faba99 req-2d86601d-f052-4ea0-b4d2-120e989263c9 service nova] [instance: a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb] Received event network-vif-plugged-e2143e91-9f8c-4670-9f92-c2c00827a619 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:37:02 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-0b81341b-3648-4eca-8319-8df612faba99 req-2d86601d-f052-4ea0-b4d2-120e989263c9 service nova] Acquiring lock "a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:37:02 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-0b81341b-3648-4eca-8319-8df612faba99 req-2d86601d-f052-4ea0-b4d2-120e989263c9 service nova] Lock "a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:37:02 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-0b81341b-3648-4eca-8319-8df612faba99 req-2d86601d-f052-4ea0-b4d2-120e989263c9 service nova] Lock "a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:37:02 user nova-compute[75165]: DEBUG nova.compute.manager [req-0b81341b-3648-4eca-8319-8df612faba99 req-2d86601d-f052-4ea0-b4d2-120e989263c9 service nova] [instance: a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb] No waiting events found dispatching network-vif-plugged-e2143e91-9f8c-4670-9f92-c2c00827a619 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:37:02 user nova-compute[75165]: WARNING nova.compute.manager [req-0b81341b-3648-4eca-8319-8df612faba99 req-2d86601d-f052-4ea0-b4d2-120e989263c9 service nova] [instance: a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb] Received unexpected event network-vif-plugged-e2143e91-9f8c-4670-9f92-c2c00827a619 for instance with vm_state active and task_state deleting.
Oct 26 00:37:02 user nova-compute[75165]: DEBUG nova.compute.manager [req-0b81341b-3648-4eca-8319-8df612faba99 req-2d86601d-f052-4ea0-b4d2-120e989263c9 service nova] [instance: a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb] Received event network-vif-unplugged-e2143e91-9f8c-4670-9f92-c2c00827a619 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:37:02 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-0b81341b-3648-4eca-8319-8df612faba99 req-2d86601d-f052-4ea0-b4d2-120e989263c9 service nova] Acquiring lock "a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:37:02 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-0b81341b-3648-4eca-8319-8df612faba99 req-2d86601d-f052-4ea0-b4d2-120e989263c9 service nova] Lock "a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:37:02 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-0b81341b-3648-4eca-8319-8df612faba99 req-2d86601d-f052-4ea0-b4d2-120e989263c9 service nova] Lock "a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:37:02 user nova-compute[75165]: DEBUG nova.compute.manager [req-0b81341b-3648-4eca-8319-8df612faba99 req-2d86601d-f052-4ea0-b4d2-120e989263c9 service nova] [instance: a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb] No waiting events found dispatching network-vif-unplugged-e2143e91-9f8c-4670-9f92-c2c00827a619 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:37:02 user nova-compute[75165]: DEBUG nova.compute.manager [req-0b81341b-3648-4eca-8319-8df612faba99 req-2d86601d-f052-4ea0-b4d2-120e989263c9 service nova] [instance: a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb] Received event network-vif-unplugged-e2143e91-9f8c-4670-9f92-c2c00827a619 for instance with task_state deleting. {{(pid=75165) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 00:37:02 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:37:02 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:37:02 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:37:02 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:37:02 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:37:03 user nova-compute[75165]: DEBUG nova.network.neutron [-] [instance: a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb] Updating instance_info_cache with network_info: [] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:37:03 user nova-compute[75165]: INFO nova.compute.manager [-] [instance: a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb] Took 0.95 seconds to deallocate network for instance.
Oct 26 00:37:03 user nova-compute[75165]: INFO nova.compute.manager [None req-527754e3-8531-4e5c-a720-17cf4cb45a58 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb] Took 0.90 seconds to detach 1 volumes for instance.
Oct 26 00:37:04 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-527754e3-8531-4e5c-a720-17cf4cb45a58 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:37:04 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-527754e3-8531-4e5c-a720-17cf4cb45a58 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:37:04 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-527754e3-8531-4e5c-a720-17cf4cb45a58 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:37:04 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-527754e3-8531-4e5c-a720-17cf4cb45a58 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:37:04 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-527754e3-8531-4e5c-a720-17cf4cb45a58 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.230s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:37:04 user nova-compute[75165]: DEBUG nova.compute.manager [req-91b35085-98b1-4922-b349-193592eac449 req-50c57997-0e12-4bee-a272-3d6d8b1871d8 service nova] [instance: a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb] Received event network-vif-plugged-e2143e91-9f8c-4670-9f92-c2c00827a619 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:37:04 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-91b35085-98b1-4922-b349-193592eac449 req-50c57997-0e12-4bee-a272-3d6d8b1871d8 service nova] Acquiring lock "a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:37:04 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-91b35085-98b1-4922-b349-193592eac449 req-50c57997-0e12-4bee-a272-3d6d8b1871d8 service nova] Lock "a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:37:04 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-91b35085-98b1-4922-b349-193592eac449 req-50c57997-0e12-4bee-a272-3d6d8b1871d8 service nova] Lock "a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:37:04 user nova-compute[75165]: DEBUG nova.compute.manager [req-91b35085-98b1-4922-b349-193592eac449 req-50c57997-0e12-4bee-a272-3d6d8b1871d8 service nova] [instance: a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb] No waiting events found dispatching network-vif-plugged-e2143e91-9f8c-4670-9f92-c2c00827a619 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:37:04 user nova-compute[75165]: WARNING nova.compute.manager [req-91b35085-98b1-4922-b349-193592eac449 req-50c57997-0e12-4bee-a272-3d6d8b1871d8 service nova] [instance: a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb] Received unexpected event network-vif-plugged-e2143e91-9f8c-4670-9f92-c2c00827a619 for instance with vm_state deleted and task_state None.
Oct 26 00:37:04 user nova-compute[75165]: DEBUG nova.compute.manager [req-91b35085-98b1-4922-b349-193592eac449 req-50c57997-0e12-4bee-a272-3d6d8b1871d8 service nova] [instance: 454ce3d7-a631-418c-a446-b614eb0d6f28] Received event network-vif-plugged-53bac58f-e414-486a-8efc-4dbfb9ef8209 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:37:04 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-91b35085-98b1-4922-b349-193592eac449 req-50c57997-0e12-4bee-a272-3d6d8b1871d8 service nova] Acquiring lock "454ce3d7-a631-418c-a446-b614eb0d6f28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:37:04 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-91b35085-98b1-4922-b349-193592eac449 req-50c57997-0e12-4bee-a272-3d6d8b1871d8 service nova] Lock "454ce3d7-a631-418c-a446-b614eb0d6f28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:37:04 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-91b35085-98b1-4922-b349-193592eac449 req-50c57997-0e12-4bee-a272-3d6d8b1871d8 service nova] Lock "454ce3d7-a631-418c-a446-b614eb0d6f28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:37:04 user nova-compute[75165]: DEBUG nova.compute.manager [req-91b35085-98b1-4922-b349-193592eac449 req-50c57997-0e12-4bee-a272-3d6d8b1871d8 service nova] [instance: 454ce3d7-a631-418c-a446-b614eb0d6f28] No waiting events found dispatching network-vif-plugged-53bac58f-e414-486a-8efc-4dbfb9ef8209 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:37:04 user nova-compute[75165]: WARNING nova.compute.manager [req-91b35085-98b1-4922-b349-193592eac449 req-50c57997-0e12-4bee-a272-3d6d8b1871d8 service nova] [instance: 454ce3d7-a631-418c-a446-b614eb0d6f28] Received unexpected event network-vif-plugged-53bac58f-e414-486a-8efc-4dbfb9ef8209 for instance with vm_state building and task_state spawning.
Oct 26 00:37:04 user nova-compute[75165]: DEBUG nova.compute.manager [req-91b35085-98b1-4922-b349-193592eac449 req-50c57997-0e12-4bee-a272-3d6d8b1871d8 service nova] [instance: a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb] Received event network-vif-deleted-e2143e91-9f8c-4670-9f92-c2c00827a619 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:37:04 user nova-compute[75165]: DEBUG nova.compute.manager [req-91b35085-98b1-4922-b349-193592eac449 req-50c57997-0e12-4bee-a272-3d6d8b1871d8 service nova] [instance: 454ce3d7-a631-418c-a446-b614eb0d6f28] Received event network-vif-plugged-53bac58f-e414-486a-8efc-4dbfb9ef8209 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:37:04 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-91b35085-98b1-4922-b349-193592eac449 req-50c57997-0e12-4bee-a272-3d6d8b1871d8 service nova] Acquiring lock "454ce3d7-a631-418c-a446-b614eb0d6f28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:37:04 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-91b35085-98b1-4922-b349-193592eac449 req-50c57997-0e12-4bee-a272-3d6d8b1871d8 service nova] Lock "454ce3d7-a631-418c-a446-b614eb0d6f28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:37:04 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-91b35085-98b1-4922-b349-193592eac449 req-50c57997-0e12-4bee-a272-3d6d8b1871d8 service nova] Lock "454ce3d7-a631-418c-a446-b614eb0d6f28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:37:04 user nova-compute[75165]: DEBUG nova.compute.manager [req-91b35085-98b1-4922-b349-193592eac449 req-50c57997-0e12-4bee-a272-3d6d8b1871d8 service nova] [instance: 454ce3d7-a631-418c-a446-b614eb0d6f28] No waiting events found dispatching network-vif-plugged-53bac58f-e414-486a-8efc-4dbfb9ef8209 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:37:04 user nova-compute[75165]: WARNING nova.compute.manager [req-91b35085-98b1-4922-b349-193592eac449 req-50c57997-0e12-4bee-a272-3d6d8b1871d8 service nova] [instance: 454ce3d7-a631-418c-a446-b614eb0d6f28] Received unexpected event network-vif-plugged-53bac58f-e414-486a-8efc-4dbfb9ef8209 for instance with vm_state building and task_state spawning.
Oct 26 00:37:04 user nova-compute[75165]: INFO nova.scheduler.client.report [None req-527754e3-8531-4e5c-a720-17cf4cb45a58 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Deleted allocations for instance a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb
Oct 26 00:37:04 user nova-compute[75165]: DEBUG nova.compute.manager [None req-9c3c86fe-cae3-4be0-a58f-537a5f7c2617 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 454ce3d7-a631-418c-a446-b614eb0d6f28] Instance event wait completed in 0 seconds for  {{(pid=75165) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 00:37:04 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-9c3c86fe-cae3-4be0-a58f-537a5f7c2617 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 454ce3d7-a631-418c-a446-b614eb0d6f28] Guest created on hypervisor {{(pid=75165) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 00:37:04 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-527754e3-8531-4e5c-a720-17cf4cb45a58 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Lock "a33f3f9a-1eb2-4326-b5af-27d4ddd4f8fb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.878s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:37:04 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: 454ce3d7-a631-418c-a446-b614eb0d6f28] Instance spawned successfully.
Oct 26 00:37:04 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-9c3c86fe-cae3-4be0-a58f-537a5f7c2617 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 454ce3d7-a631-418c-a446-b614eb0d6f28] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 00:37:04 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-9c3c86fe-cae3-4be0-a58f-537a5f7c2617 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 454ce3d7-a631-418c-a446-b614eb0d6f28] Found default for hw_cdrom_bus of ide {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:37:04 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-9c3c86fe-cae3-4be0-a58f-537a5f7c2617 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 454ce3d7-a631-418c-a446-b614eb0d6f28] Found default for hw_disk_bus of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:37:04 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-9c3c86fe-cae3-4be0-a58f-537a5f7c2617 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 454ce3d7-a631-418c-a446-b614eb0d6f28] Found default for hw_input_bus of None {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:37:04 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-9c3c86fe-cae3-4be0-a58f-537a5f7c2617 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 454ce3d7-a631-418c-a446-b614eb0d6f28] Found default for hw_pointer_model of None {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:37:04 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-9c3c86fe-cae3-4be0-a58f-537a5f7c2617 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 454ce3d7-a631-418c-a446-b614eb0d6f28] Found default for hw_video_model of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:37:04 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-9c3c86fe-cae3-4be0-a58f-537a5f7c2617 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 454ce3d7-a631-418c-a446-b614eb0d6f28] Found default for hw_vif_model of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:37:04 user nova-compute[75165]: INFO nova.compute.manager [None req-9c3c86fe-cae3-4be0-a58f-537a5f7c2617 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 454ce3d7-a631-418c-a446-b614eb0d6f28] Took 5.93 seconds to spawn the instance on the hypervisor.
Oct 26 00:37:04 user nova-compute[75165]: DEBUG nova.compute.manager [None req-9c3c86fe-cae3-4be0-a58f-537a5f7c2617 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 454ce3d7-a631-418c-a446-b614eb0d6f28] Checking state {{(pid=75165) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 00:37:04 user nova-compute[75165]: INFO nova.compute.manager [None req-9c3c86fe-cae3-4be0-a58f-537a5f7c2617 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 454ce3d7-a631-418c-a446-b614eb0d6f28] Took 6.59 seconds to build instance.
Oct 26 00:37:04 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-9c3c86fe-cae3-4be0-a58f-537a5f7c2617 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Lock "454ce3d7-a631-418c-a446-b614eb0d6f28" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.690s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:37:06 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:37:06 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:37:11 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d2293d7-e2d7-4eb2-93c4-47c37ded98b3 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] [instance: 6ae9fe6f-eb17-44f5-89e4-fff5e3451336] Calling os-brick to attach iSCSI Volume {{(pid=75165) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 00:37:11 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d2293d7-e2d7-4eb2-93c4-47c37ded98b3 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8bf8160e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ddaee92e-ef36-449d-b19d-5166b0c23787', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BjMPQXhd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:37:11 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-2d2293d7-e2d7-4eb2-93c4-47c37ded98b3 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:37:11 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-2d2293d7-e2d7-4eb2-93c4-47c37ded98b3 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:37:11 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-2d2293d7-e2d7-4eb2-93c4-47c37ded98b3 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:37:11 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-2d2293d7-e2d7-4eb2-93c4-47c37ded98b3 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:37:11 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-2d2293d7-e2d7-4eb2-93c4-47c37ded98b3 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ddaee92e-ef36-449d-b19d-5166b0c23787" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:37:11 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-2d2293d7-e2d7-4eb2-93c4-47c37ded98b3 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ddaee92e-ef36-449d-b19d-5166b0c23787" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:37:11 user nova-compute[75165]: INFO os_brick.initiator.connectors.iscsi [None req-2d2293d7-e2d7-4eb2-93c4-47c37ded98b3 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 00:37:11 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddaee92e-ef36-449d-b19d-5166b0c23787 -p 172.16.0.220:3260 {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:37:11 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddaee92e-ef36-449d-b19d-5166b0c23787 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:37:11 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c074354-2659-4a1a-b0dd-6a529a8bea45]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:37:11 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d2293d7-e2d7-4eb2-93c4-47c37ded98b3 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 00:37:11 user nova-compute[75165]:  {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:37:11 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddaee92e-ef36-449d-b19d-5166b0c23787 -p 172.16.0.220:3260 --interface default --op new {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:37:11 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddaee92e-ef36-449d-b19d-5166b0c23787 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:37:11 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[09cd032e-3374-4cd6-9ebc-a6a8727d3ce4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ddaee92e-ef36-449d-b19d-5166b0c23787] added\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:37:11 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d2293d7-e2d7-4eb2-93c4-47c37ded98b3 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ddaee92e-ef36-449d-b19d-5166b0c23787] added
Oct 26 00:37:11 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:37:11 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddaee92e-ef36-449d-b19d-5166b0c23787 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:37:11 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddaee92e-ef36-449d-b19d-5166b0c23787 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:37:11 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea820676-25b7-4d84-bff2-7aa37a385dca]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:37:11 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d2293d7-e2d7-4eb2-93c4-47c37ded98b3 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:37:11 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddaee92e-ef36-449d-b19d-5166b0c23787 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:37:11 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddaee92e-ef36-449d-b19d-5166b0c23787 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:37:11 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b8f1348-a51d-4348-9db2-13602f706ed8]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:37:11 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d2293d7-e2d7-4eb2-93c4-47c37ded98b3 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:37:11 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddaee92e-ef36-449d-b19d-5166b0c23787 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BjMPQXhd {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:37:11 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddaee92e-ef36-449d-b19d-5166b0c23787 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BjMPQXhd" returned: 0 in 0.019s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:37:11 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca3851fb-eebe-4dc1-bfab-5892b216d17e]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:37:11 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d2293d7-e2d7-4eb2-93c4-47c37ded98b3 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BjMPQXhd'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:37:11 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddaee92e-ef36-449d-b19d-5166b0c23787 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:37:11 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddaee92e-ef36-449d-b19d-5166b0c23787 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:37:11 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[c52e7d20-bf59-4534-974d-bf41c0964268]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:37:11 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d2293d7-e2d7-4eb2-93c4-47c37ded98b3 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:37:11 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:37:11 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:37:11 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[554d7097-dc5e-4883-a909-c65ba402df47]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2abefc2-1cb2-4993-a7e2-f043ee79ac56 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:927d04d0-50f4-459c-8c3c-ed41d757d7ca (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:37:11 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d2293d7-e2d7-4eb2-93c4-47c37ded98b3 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2abefc2-1cb2-4993-a7e2-f043ee79ac56 (non-flash)
Oct 26 00:37:11 user nova-compute[75165]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:927d04d0-50f4-459c-8c3c-ed41d757d7ca (non-flash)
Oct 26 00:37:11 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:37:11 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d2293d7-e2d7-4eb2-93c4-47c37ded98b3 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2abefc2-1cb2-4993-a7e2-f043ee79ac56 (non-flash)
Oct 26 00:37:11 user nova-compute[75165]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:927d04d0-50f4-459c-8c3c-ed41d757d7ca (non-flash)
Oct 26 00:37:11 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:37:11 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddaee92e-ef36-449d-b19d-5166b0c23787 -p 172.16.0.220:3260 --login {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:37:11 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddaee92e-ef36-449d-b19d-5166b0c23787 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:37:11 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fa928a8-47b2-47fe-ac0d-108a5d15552e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ddaee92e-ef36-449d-b19d-5166b0c23787, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ddaee92e-ef36-449d-b19d-5166b0c23787, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:37:11 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d2293d7-e2d7-4eb2-93c4-47c37ded98b3 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ddaee92e-ef36-449d-b19d-5166b0c23787, portal: 172.16.0.220,3260]
Oct 26 00:37:11 user nova-compute[75165]: Login to [iface: default, target: iqn.2010-10.org.openstack:ddaee92e-ef36-449d-b19d-5166b0c23787, portal: 172.16.0.220,3260] successful.
Oct 26 00:37:11 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:37:11 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddaee92e-ef36-449d-b19d-5166b0c23787 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:37:11 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddaee92e-ef36-449d-b19d-5166b0c23787 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:37:11 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee411f6d-9c8b-42d0-bb40-ddd70f7a7dcc]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:37:11 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d2293d7-e2d7-4eb2-93c4-47c37ded98b3 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:37:11 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:37:11 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:37:11 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[8091b575-a0fa-40f0-a420-9bc4ef46e7d6]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2abefc2-1cb2-4993-a7e2-f043ee79ac56 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:927d04d0-50f4-459c-8c3c-ed41d757d7ca (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddaee92e-ef36-449d-b19d-5166b0c23787 (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:37:11 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d2293d7-e2d7-4eb2-93c4-47c37ded98b3 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2abefc2-1cb2-4993-a7e2-f043ee79ac56 (non-flash)
Oct 26 00:37:11 user nova-compute[75165]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:927d04d0-50f4-459c-8c3c-ed41d757d7ca (non-flash)
Oct 26 00:37:11 user nova-compute[75165]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddaee92e-ef36-449d-b19d-5166b0c23787 (non-flash)
Oct 26 00:37:11 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:37:11 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d2293d7-e2d7-4eb2-93c4-47c37ded98b3 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2abefc2-1cb2-4993-a7e2-f043ee79ac56 (non-flash)
Oct 26 00:37:11 user nova-compute[75165]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:927d04d0-50f4-459c-8c3c-ed41d757d7ca (non-flash)
Oct 26 00:37:11 user nova-compute[75165]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddaee92e-ef36-449d-b19d-5166b0c23787 (non-flash)
Oct 26 00:37:11 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:37:11 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-2d2293d7-e2d7-4eb2-93c4-47c37ded98b3 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ddaee92e-ef36-449d-b19d-5166b0c23787" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.266s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:37:11 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d2293d7-e2d7-4eb2-93c4-47c37ded98b3 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Connected to 172.16.0.220:3260 {{(pid=75165) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 00:37:11 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-2d2293d7-e2d7-4eb2-93c4-47c37ded98b3 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] HCTL ('33', '-', '-', 0) found on session 45 with lun 0 {{(pid=75165) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 00:37:11 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-2d2293d7-e2d7-4eb2-93c4-47c37ded98b3 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75165) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 00:37:11 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:37:11 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:37:11 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[48024f01-8fdf-4ed6-80ab-5e17e05ec58f]: (4, ('- - 0', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:37:11 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-2d2293d7-e2d7-4eb2-93c4-47c37ded98b3 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Searching for a device in session 45 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75165) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 00:37:11 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d2293d7-e2d7-4eb2-93c4-47c37ded98b3 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:ddaee92e-ef36-449d-b19d-5166b0c23787', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BjMPQXhd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75165) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 00:37:11 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:37:12 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-2d2293d7-e2d7-4eb2-93c4-47c37ded98b3 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.301s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:37:12 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d2293d7-e2d7-4eb2-93c4-47c37ded98b3 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] <== connect_volume: return (1303ms) {'type': 'block', 'scsi_wwn': '26338376236363962', 'path': '/dev/sdb'} {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:37:12 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d2293d7-e2d7-4eb2-93c4-47c37ded98b3 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] [instance: 6ae9fe6f-eb17-44f5-89e4-fff5e3451336] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26338376236363962', 'path': '/dev/sdb'} {{(pid=75165) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 00:37:12 user nova-compute[75165]: DEBUG nova.objects.instance [None req-2d2293d7-e2d7-4eb2-93c4-47c37ded98b3 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Lazy-loading 'flavor' on Instance uuid 6ae9fe6f-eb17-44f5-89e4-fff5e3451336 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:37:12 user nova-compute[75165]: DEBUG nova.virt.libvirt.guest [None req-2d2293d7-e2d7-4eb2-93c4-47c37ded98b3 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 00:37:12 user nova-compute[75165]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 00:37:12 user nova-compute[75165]:   <source dev="/dev/sdb"/>
Oct 26 00:37:12 user nova-compute[75165]:   <target dev="vdb" bus="virtio"/>
Oct 26 00:37:12 user nova-compute[75165]:   <serial>ddaee92e-ef36-449d-b19d-5166b0c23787</serial>
Oct 26 00:37:12 user nova-compute[75165]: </disk>
Oct 26 00:37:12 user nova-compute[75165]:  {{(pid=75165) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 00:37:12 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-2d2293d7-e2d7-4eb2-93c4-47c37ded98b3 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] No BDM found with device name vda, not building metadata. {{(pid=75165) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 00:37:12 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-2d2293d7-e2d7-4eb2-93c4-47c37ded98b3 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75165) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 00:37:12 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-2d2293d7-e2d7-4eb2-93c4-47c37ded98b3 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] No VIF found with MAC fa:16:3e:ca:e5:01, not building metadata {{(pid=75165) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 00:37:13 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-2d2293d7-e2d7-4eb2-93c4-47c37ded98b3 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Lock "6ae9fe6f-eb17-44f5-89e4-fff5e3451336" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.752s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:37:15 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-b939b936-47b4-411b-b777-457612d5389f tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Acquiring lock "6ae9fe6f-eb17-44f5-89e4-fff5e3451336" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:37:15 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-b939b936-47b4-411b-b777-457612d5389f tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Lock "6ae9fe6f-eb17-44f5-89e4-fff5e3451336" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:37:15 user nova-compute[75165]: INFO nova.compute.manager [None req-b939b936-47b4-411b-b777-457612d5389f tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] [instance: 6ae9fe6f-eb17-44f5-89e4-fff5e3451336] Detaching volume ddaee92e-ef36-449d-b19d-5166b0c23787
Oct 26 00:37:15 user nova-compute[75165]: INFO nova.virt.block_device [None req-b939b936-47b4-411b-b777-457612d5389f tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] [instance: 6ae9fe6f-eb17-44f5-89e4-fff5e3451336] Attempting to driver detach volume ddaee92e-ef36-449d-b19d-5166b0c23787 from mountpoint /dev/vdb
Oct 26 00:37:15 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-b939b936-47b4-411b-b777-457612d5389f tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Attempting to detach device vdb from instance 6ae9fe6f-eb17-44f5-89e4-fff5e3451336 from the persistent domain config. {{(pid=75165) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 00:37:15 user nova-compute[75165]: DEBUG nova.virt.libvirt.guest [None req-b939b936-47b4-411b-b777-457612d5389f tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 00:37:15 user nova-compute[75165]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 00:37:15 user nova-compute[75165]:   <source dev="/dev/sdb"/>
Oct 26 00:37:15 user nova-compute[75165]:   <target dev="vdb" bus="virtio"/>
Oct 26 00:37:15 user nova-compute[75165]:   <serial>ddaee92e-ef36-449d-b19d-5166b0c23787</serial>
Oct 26 00:37:15 user nova-compute[75165]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 00:37:15 user nova-compute[75165]: </disk>
Oct 26 00:37:15 user nova-compute[75165]:  {{(pid=75165) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 00:37:15 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-b939b936-47b4-411b-b777-457612d5389f tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Successfully detached device vdb from instance 6ae9fe6f-eb17-44f5-89e4-fff5e3451336 from the persistent domain config.
Oct 26 00:37:15 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-b939b936-47b4-411b-b777-457612d5389f tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6ae9fe6f-eb17-44f5-89e4-fff5e3451336 from the live domain config. {{(pid=75165) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 00:37:15 user nova-compute[75165]: DEBUG nova.virt.libvirt.guest [None req-b939b936-47b4-411b-b777-457612d5389f tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 00:37:15 user nova-compute[75165]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 00:37:15 user nova-compute[75165]:   <source dev="/dev/sdb"/>
Oct 26 00:37:15 user nova-compute[75165]:   <target dev="vdb" bus="virtio"/>
Oct 26 00:37:15 user nova-compute[75165]:   <serial>ddaee92e-ef36-449d-b19d-5166b0c23787</serial>
Oct 26 00:37:15 user nova-compute[75165]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 00:37:15 user nova-compute[75165]: </disk>
Oct 26 00:37:15 user nova-compute[75165]:  {{(pid=75165) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 00:37:16 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-b939b936-47b4-411b-b777-457612d5389f tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6ae9fe6f-eb17-44f5-89e4-fff5e3451336 {{(pid=75165) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 00:37:16 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:37:16 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:37:16 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75165) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 00:37:16 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75165) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 00:37:16 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75165) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 00:37:16 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:37:16 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:37:21 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:37:21 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75165) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 00:37:21 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:37:21 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:37:22 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:37:22 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:37:25 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:37:26 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:37:26 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:37:26 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:37:26 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:37:26 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:37:28 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:37:28 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Starting heal instance info cache {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 00:37:28 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Rebuilding the list of instances to heal {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 00:37:29 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "refresh_cache-97fb67a7-637d-456f-b4dd-0a271ed6cfc4" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:37:29 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquired lock "refresh_cache-97fb67a7-637d-456f-b4dd-0a271ed6cfc4" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:37:29 user nova-compute[75165]: DEBUG nova.network.neutron [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: 97fb67a7-637d-456f-b4dd-0a271ed6cfc4] Forcefully refreshing network info cache for instance {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 00:37:29 user nova-compute[75165]: DEBUG nova.objects.instance [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lazy-loading 'info_cache' on Instance uuid 97fb67a7-637d-456f-b4dd-0a271ed6cfc4 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:37:29 user nova-compute[75165]: DEBUG nova.network.neutron [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: 97fb67a7-637d-456f-b4dd-0a271ed6cfc4] Updating instance_info_cache with network_info: [{"id": "254ea53c-6da9-46d5-a139-7926008cdf8b", "address": "fa:16:3e:08:21:2a", "network": {"id": "eb55c0bc-cae5-4ba3-851a-e31a50b52c88", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1081223830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d616862c7c184de5b0ba3121552c5666", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap254ea53c-6d", "ovs_interfaceid": "254ea53c-6da9-46d5-a139-7926008cdf8b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:37:29 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Releasing lock "refresh_cache-97fb67a7-637d-456f-b4dd-0a271ed6cfc4" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:37:29 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: 97fb67a7-637d-456f-b4dd-0a271ed6cfc4] Updated the network info_cache for instance {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 00:37:29 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:37:29 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:37:29 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:37:29 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:37:29 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75165) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 00:37:29 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75165) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 00:37:29 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97fb67a7-637d-456f-b4dd-0a271ed6cfc4/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:37:30 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97fb67a7-637d-456f-b4dd-0a271ed6cfc4/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:37:30 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97fb67a7-637d-456f-b4dd-0a271ed6cfc4/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:37:30 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97fb67a7-637d-456f-b4dd-0a271ed6cfc4/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:37:30 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e534595-7eaf-49f4-b457-9f37bc59012b/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:37:30 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e534595-7eaf-49f4-b457-9f37bc59012b/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:37:30 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e534595-7eaf-49f4-b457-9f37bc59012b/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:37:30 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e534595-7eaf-49f4-b457-9f37bc59012b/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:37:30 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75165) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 00:37:30 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/454ce3d7-a631-418c-a446-b614eb0d6f28/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:37:30 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/454ce3d7-a631-418c-a446-b614eb0d6f28/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:37:30 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/454ce3d7-a631-418c-a446-b614eb0d6f28/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:37:31 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/454ce3d7-a631-418c-a446-b614eb0d6f28/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:37:31 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae9fe6f-eb17-44f5-89e4-fff5e3451336/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:37:31 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae9fe6f-eb17-44f5-89e4-fff5e3451336/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:37:31 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae9fe6f-eb17-44f5-89e4-fff5e3451336/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:37:31 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae9fe6f-eb17-44f5-89e4-fff5e3451336/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:37:31 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:37:31 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:37:31 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:37:31 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Hypervisor/Node resource view: name=user free_ram=8364MB free_disk=24.74539566040039GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75165) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 00:37:31 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:37:31 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:37:31 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:37:31 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 97fb67a7-637d-456f-b4dd-0a271ed6cfc4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:37:31 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 7e534595-7eaf-49f4-b457-9f37bc59012b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:37:31 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 6ae9fe6f-eb17-44f5-89e4-fff5e3451336 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:37:31 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 49f1d1d3-4f34-49b3-ae89-206672d86cf0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:37:31 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 454ce3d7-a631-418c-a446-b614eb0d6f28 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:37:31 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75165) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 00:37:31 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75165) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 00:37:32 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:37:32 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:37:32 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Compute_service record updated for user:user {{(pid=75165) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 00:37:32 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.300s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:37:32 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:37:33 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:37:35 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:37:36 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-b939b936-47b4-411b-b777-457612d5389f tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 6ae9fe6f-eb17-44f5-89e4-fff5e3451336 is timed out.
Oct 26 00:37:36 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-b939b936-47b4-411b-b777-457612d5389f tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Successfully detached device vdb from instance 6ae9fe6f-eb17-44f5-89e4-fff5e3451336 from the live domain config.
Oct 26 00:37:36 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b939b936-47b4-411b-b777-457612d5389f tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] [instance: 6ae9fe6f-eb17-44f5-89e4-fff5e3451336] calling os-brick to detach iSCSI Volume {{(pid=75165) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 00:37:36 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-b939b936-47b4-411b-b777-457612d5389f tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8bf8160e50>, {'target_iqn': 'iqn.2010-10.org.openstack:ddaee92e-ef36-449d-b19d-5166b0c23787', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BjMPQXhd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:37:36 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-b939b936-47b4-411b-b777-457612d5389f tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:37:36 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-b939b936-47b4-411b-b777-457612d5389f tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:37:36 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-b939b936-47b4-411b-b777-457612d5389f tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:37:36 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:37:36 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:37:36 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b942dfa-5377-486a-a359-c13a86a1fd21]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d2abefc2-1cb2-4993-a7e2-f043ee79ac56\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:927d04d0-50f4-459c-8c3c-ed41d757d7ca\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ddaee92e-ef36-449d-b19d-5166b0c23787\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:37:36 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-b939b936-47b4-411b-b777-457612d5389f tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 00:37:36 user nova-compute[75165]: No targets found.
Oct 26 00:37:36 user nova-compute[75165]: iSNS:
Oct 26 00:37:36 user nova-compute[75165]: No targets found.
Oct 26 00:37:36 user nova-compute[75165]: STATIC:
Oct 26 00:37:36 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:d2abefc2-1cb2-4993-a7e2-f043ee79ac56
Oct 26 00:37:36 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:37:36 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:37:36 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:927d04d0-50f4-459c-8c3c-ed41d757d7ca
Oct 26 00:37:36 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:37:36 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:37:36 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:ddaee92e-ef36-449d-b19d-5166b0c23787
Oct 26 00:37:36 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:37:36 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:37:36 user nova-compute[75165]: FIRMWARE:
Oct 26 00:37:36 user nova-compute[75165]: No targets found.
Oct 26 00:37:36 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:37:36 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-b939b936-47b4-411b-b777-457612d5389f tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 00:37:36 user nova-compute[75165]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 00:37:36 user nova-compute[75165]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75165) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 00:37:36 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-b939b936-47b4-411b-b777-457612d5389f tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ddaee92e-ef36-449d-b19d-5166b0c23787', 0)] {{(pid=75165) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 00:37:36 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:37:36 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:37:36 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[192ff48c-365f-44c2-97aa-51b60108de05]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:927d04d0-50f4-459c-8c3c-ed41d757d7ca\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2abefc2-1cb2-4993-a7e2-f043ee79ac56\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ddaee92e-ef36-449d-b19d-5166b0c23787\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:37:36 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:37:36 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:37:36 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[eec0d2a4-bee7-4678-81ee-9a734d69df25]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2abefc2-1cb2-4993-a7e2-f043ee79ac56 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:927d04d0-50f4-459c-8c3c-ed41d757d7ca (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddaee92e-ef36-449d-b19d-5166b0c23787 (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:37:36 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-b939b936-47b4-411b-b777-457612d5389f tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2abefc2-1cb2-4993-a7e2-f043ee79ac56 (non-flash)
Oct 26 00:37:36 user nova-compute[75165]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:927d04d0-50f4-459c-8c3c-ed41d757d7ca (non-flash)
Oct 26 00:37:36 user nova-compute[75165]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddaee92e-ef36-449d-b19d-5166b0c23787 (non-flash)
Oct 26 00:37:36 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:37:36 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-b939b936-47b4-411b-b777-457612d5389f tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2abefc2-1cb2-4993-a7e2-f043ee79ac56 (non-flash)
Oct 26 00:37:36 user nova-compute[75165]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:927d04d0-50f4-459c-8c3c-ed41d757d7ca (non-flash)
Oct 26 00:37:36 user nova-compute[75165]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddaee92e-ef36-449d-b19d-5166b0c23787 (non-flash)
Oct 26 00:37:36 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:37:36 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-b939b936-47b4-411b-b777-457612d5389f tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8c001ef490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ddaee92e-ef36-449d-b19d-5166b0c23787'): ({'sdb'}, set())}) {{(pid=75165) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 00:37:36 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-b939b936-47b4-411b-b777-457612d5389f tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Removing single pathed devices sdb {{(pid=75165) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 00:37:36 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:37:36 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:37:36 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6e42dd0-a78f-4d7e-9901-7e5b864cfb0f]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:37:36 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:37:36 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:37:36 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e13b032-ee09-413f-b236-87f395d24a05]: (4, ('ok\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:37:36 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-b939b936-47b4-411b-b777-457612d5389f tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Flushing IO for device /dev/sdb {{(pid=75165) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 00:37:36 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:37:36 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:37:36 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[9554d4fb-48be-4354-945e-4fa31854a5e8]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:37:36 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-b939b936-47b4-411b-b777-457612d5389f tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75165) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 00:37:36 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:37:36 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:37:36 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[b91068af-43b0-4934-84c0-be484f4aabd6]: (4, ('1', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:37:36 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-b939b936-47b4-411b-b777-457612d5389f tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75165) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 00:37:36 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-b939b936-47b4-411b-b777-457612d5389f tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] SCSI volumes sdb have been removed. {{(pid=75165) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 00:37:36 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-b939b936-47b4-411b-b777-457612d5389f tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ddaee92e-ef36-449d-b19d-5166b0c23787')] {{(pid=75165) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 00:37:36 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddaee92e-ef36-449d-b19d-5166b0c23787 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:37:36 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddaee92e-ef36-449d-b19d-5166b0c23787 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:37:36 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e24598a-42c0-4f2f-9724-4186ba762e48]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:37:36 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-b939b936-47b4-411b-b777-457612d5389f tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:37:36 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddaee92e-ef36-449d-b19d-5166b0c23787 -p 172.16.0.220:3260 --logout {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:37:36 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddaee92e-ef36-449d-b19d-5166b0c23787 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:37:36 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[09f5bf3d-134a-4080-865e-164cb351ceeb]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:ddaee92e-ef36-449d-b19d-5166b0c23787, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:ddaee92e-ef36-449d-b19d-5166b0c23787, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:37:36 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-b939b936-47b4-411b-b777-457612d5389f tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:ddaee92e-ef36-449d-b19d-5166b0c23787, portal: 172.16.0.220,3260]
Oct 26 00:37:36 user nova-compute[75165]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:ddaee92e-ef36-449d-b19d-5166b0c23787, portal: 172.16.0.220,3260] successful.
Oct 26 00:37:36 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:37:36 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddaee92e-ef36-449d-b19d-5166b0c23787 -p 172.16.0.220:3260 --op delete {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:37:36 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddaee92e-ef36-449d-b19d-5166b0c23787 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:37:36 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[fea98f28-93b6-48cf-8d63-c04635a1c765]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:37:36 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-b939b936-47b4-411b-b777-457612d5389f tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:37:36 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-b939b936-47b4-411b-b777-457612d5389f tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:37:36 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-b939b936-47b4-411b-b777-457612d5389f tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] <== disconnect_volume: return (310ms) None {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:37:36 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b939b936-47b4-411b-b777-457612d5389f tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] [instance: 6ae9fe6f-eb17-44f5-89e4-fff5e3451336] Disconnected iSCSI Volume {{(pid=75165) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 00:37:36 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:37:36 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:37:37 user nova-compute[75165]: DEBUG nova.objects.instance [None req-b939b936-47b4-411b-b777-457612d5389f tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Lazy-loading 'flavor' on Instance uuid 6ae9fe6f-eb17-44f5-89e4-fff5e3451336 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:37:37 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-b939b936-47b4-411b-b777-457612d5389f tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Lock "6ae9fe6f-eb17-44f5-89e4-fff5e3451336" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.772s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:37:38 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:37:41 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:37:43 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-524d40e7-6f28-4ba4-858a-625fcd3c6673 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Acquiring lock "49f1d1d3-4f34-49b3-ae89-206672d86cf0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:37:43 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-524d40e7-6f28-4ba4-858a-625fcd3c6673 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Lock "49f1d1d3-4f34-49b3-ae89-206672d86cf0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:37:43 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-524d40e7-6f28-4ba4-858a-625fcd3c6673 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Acquiring lock "49f1d1d3-4f34-49b3-ae89-206672d86cf0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:37:43 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-524d40e7-6f28-4ba4-858a-625fcd3c6673 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Lock "49f1d1d3-4f34-49b3-ae89-206672d86cf0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:37:43 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-524d40e7-6f28-4ba4-858a-625fcd3c6673 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Lock "49f1d1d3-4f34-49b3-ae89-206672d86cf0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:37:43 user nova-compute[75165]: INFO nova.compute.manager [None req-524d40e7-6f28-4ba4-858a-625fcd3c6673 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 49f1d1d3-4f34-49b3-ae89-206672d86cf0] Terminating instance
Oct 26 00:37:43 user nova-compute[75165]: DEBUG nova.compute.manager [None req-524d40e7-6f28-4ba4-858a-625fcd3c6673 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 49f1d1d3-4f34-49b3-ae89-206672d86cf0] Start destroying the instance on the hypervisor. {{(pid=75165) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 00:37:43 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:37:43 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:37:43 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:37:43 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:37:43 user nova-compute[75165]: DEBUG nova.compute.manager [req-70f7f7b5-8595-4d2d-b5af-50548e401836 req-d28f972e-cde0-4e17-9060-a650be4f17b7 service nova] [instance: 49f1d1d3-4f34-49b3-ae89-206672d86cf0] Received event network-vif-unplugged-f815091d-bc66-47a6-8251-127c3e8275a5 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:37:43 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-70f7f7b5-8595-4d2d-b5af-50548e401836 req-d28f972e-cde0-4e17-9060-a650be4f17b7 service nova] Acquiring lock "49f1d1d3-4f34-49b3-ae89-206672d86cf0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:37:43 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-70f7f7b5-8595-4d2d-b5af-50548e401836 req-d28f972e-cde0-4e17-9060-a650be4f17b7 service nova] Lock "49f1d1d3-4f34-49b3-ae89-206672d86cf0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:37:43 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-70f7f7b5-8595-4d2d-b5af-50548e401836 req-d28f972e-cde0-4e17-9060-a650be4f17b7 service nova] Lock "49f1d1d3-4f34-49b3-ae89-206672d86cf0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:37:43 user nova-compute[75165]: DEBUG nova.compute.manager [req-70f7f7b5-8595-4d2d-b5af-50548e401836 req-d28f972e-cde0-4e17-9060-a650be4f17b7 service nova] [instance: 49f1d1d3-4f34-49b3-ae89-206672d86cf0] No waiting events found dispatching network-vif-unplugged-f815091d-bc66-47a6-8251-127c3e8275a5 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:37:43 user nova-compute[75165]: DEBUG nova.compute.manager [req-70f7f7b5-8595-4d2d-b5af-50548e401836 req-d28f972e-cde0-4e17-9060-a650be4f17b7 service nova] [instance: 49f1d1d3-4f34-49b3-ae89-206672d86cf0] Received event network-vif-unplugged-f815091d-bc66-47a6-8251-127c3e8275a5 for instance with task_state deleting. {{(pid=75165) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 00:37:44 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: 49f1d1d3-4f34-49b3-ae89-206672d86cf0] Instance destroyed successfully.
Oct 26 00:37:44 user nova-compute[75165]: DEBUG nova.objects.instance [None req-524d40e7-6f28-4ba4-858a-625fcd3c6673 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Lazy-loading 'resources' on Instance uuid 49f1d1d3-4f34-49b3-ae89-206672d86cf0 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:37:44 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-524d40e7-6f28-4ba4-858a-625fcd3c6673 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:35:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1367747267',display_name='tempest-TestVolumeBootPattern-server-1367747267',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1367747267',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-26T00:36:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d1051405ca054c4bb051fb842a5fb5a0',ramdisk_id='',reservation_id='r-t1a7000d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1215567595',owner_user_name='tempest-TestVolumeBootPattern-1215567595-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T00:36:22Z,user_data=None,user_id='ae836eab78514cf3894e5e11240ff374',uuid=49f1d1d3-4f34-49b3-ae89-206672d86cf0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f815091d-bc66-47a6-8251-127c3e8275a5", "address": "fa:16:3e:d4:33:22", "network": {"id": "dc50ae7b-d501-461f-aa0b-542514330ae8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1091857056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1051405ca054c4bb051fb842a5fb5a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf815091d-bc", "ovs_interfaceid": "f815091d-bc66-47a6-8251-127c3e8275a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 00:37:44 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-524d40e7-6f28-4ba4-858a-625fcd3c6673 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Converting VIF {"id": "f815091d-bc66-47a6-8251-127c3e8275a5", "address": "fa:16:3e:d4:33:22", "network": {"id": "dc50ae7b-d501-461f-aa0b-542514330ae8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1091857056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1051405ca054c4bb051fb842a5fb5a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf815091d-bc", "ovs_interfaceid": "f815091d-bc66-47a6-8251-127c3e8275a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:37:44 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-524d40e7-6f28-4ba4-858a-625fcd3c6673 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:33:22,bridge_name='br-int',has_traffic_filtering=True,id=f815091d-bc66-47a6-8251-127c3e8275a5,network=Network(dc50ae7b-d501-461f-aa0b-542514330ae8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf815091d-bc') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:37:44 user nova-compute[75165]: DEBUG os_vif [None req-524d40e7-6f28-4ba4-858a-625fcd3c6673 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:33:22,bridge_name='br-int',has_traffic_filtering=True,id=f815091d-bc66-47a6-8251-127c3e8275a5,network=Network(dc50ae7b-d501-461f-aa0b-542514330ae8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf815091d-bc') {{(pid=75165) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 00:37:44 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:37:44 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf815091d-bc, bridge=br-int, if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:37:44 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:37:44 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:37:44 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:37:44 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4224d5ce-104c-4497-89c8-1faa01cf8b62) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:37:44 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:37:44 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:37:44 user nova-compute[75165]: INFO os_vif [None req-524d40e7-6f28-4ba4-858a-625fcd3c6673 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:33:22,bridge_name='br-int',has_traffic_filtering=True,id=f815091d-bc66-47a6-8251-127c3e8275a5,network=Network(dc50ae7b-d501-461f-aa0b-542514330ae8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf815091d-bc')
Oct 26 00:37:44 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-524d40e7-6f28-4ba4-858a-625fcd3c6673 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 49f1d1d3-4f34-49b3-ae89-206672d86cf0] calling os-brick to detach iSCSI Volume {{(pid=75165) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 00:37:44 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-524d40e7-6f28-4ba4-858a-625fcd3c6673 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8bf8160e50>, {'target_iqn': 'iqn.2010-10.org.openstack:d2abefc2-1cb2-4993-a7e2-f043ee79ac56', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PzkgBEdr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:37:44 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-524d40e7-6f28-4ba4-858a-625fcd3c6673 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:37:44 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-524d40e7-6f28-4ba4-858a-625fcd3c6673 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:37:44 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-524d40e7-6f28-4ba4-858a-625fcd3c6673 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:37:44 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:37:44 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:37:44 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cf825f6-fa18-4551-b803-47d3496da68d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d2abefc2-1cb2-4993-a7e2-f043ee79ac56\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:927d04d0-50f4-459c-8c3c-ed41d757d7ca\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:37:44 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-524d40e7-6f28-4ba4-858a-625fcd3c6673 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 00:37:44 user nova-compute[75165]: No targets found.
Oct 26 00:37:44 user nova-compute[75165]: iSNS:
Oct 26 00:37:44 user nova-compute[75165]: No targets found.
Oct 26 00:37:44 user nova-compute[75165]: STATIC:
Oct 26 00:37:44 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:d2abefc2-1cb2-4993-a7e2-f043ee79ac56
Oct 26 00:37:44 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:37:44 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:37:44 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:927d04d0-50f4-459c-8c3c-ed41d757d7ca
Oct 26 00:37:44 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:37:44 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:37:44 user nova-compute[75165]: FIRMWARE:
Oct 26 00:37:44 user nova-compute[75165]: No targets found.
Oct 26 00:37:44 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:37:44 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-524d40e7-6f28-4ba4-858a-625fcd3c6673 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 00:37:44 user nova-compute[75165]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 00:37:44 user nova-compute[75165]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75165) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 00:37:44 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-524d40e7-6f28-4ba4-858a-625fcd3c6673 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d2abefc2-1cb2-4993-a7e2-f043ee79ac56', 0)] {{(pid=75165) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 00:37:44 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:37:44 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:37:44 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[64b659f4-a703-4c32-8abc-5b6e11363588]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:927d04d0-50f4-459c-8c3c-ed41d757d7ca\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2abefc2-1cb2-4993-a7e2-f043ee79ac56\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:37:44 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:37:44 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:37:44 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[51641017-f9f0-4c33-bcc9-c5111fd09eb0]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2abefc2-1cb2-4993-a7e2-f043ee79ac56 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:927d04d0-50f4-459c-8c3c-ed41d757d7ca (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:37:44 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-524d40e7-6f28-4ba4-858a-625fcd3c6673 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2abefc2-1cb2-4993-a7e2-f043ee79ac56 (non-flash)
Oct 26 00:37:44 user nova-compute[75165]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:927d04d0-50f4-459c-8c3c-ed41d757d7ca (non-flash)
Oct 26 00:37:44 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:37:44 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-524d40e7-6f28-4ba4-858a-625fcd3c6673 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2abefc2-1cb2-4993-a7e2-f043ee79ac56 (non-flash)
Oct 26 00:37:44 user nova-compute[75165]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:927d04d0-50f4-459c-8c3c-ed41d757d7ca (non-flash)
Oct 26 00:37:44 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:37:44 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-524d40e7-6f28-4ba4-858a-625fcd3c6673 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8be01c1ea0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d2abefc2-1cb2-4993-a7e2-f043ee79ac56'): ({'sdc'}, set())}) {{(pid=75165) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 00:37:44 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-524d40e7-6f28-4ba4-858a-625fcd3c6673 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Removing single pathed devices sdc {{(pid=75165) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 00:37:44 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:37:44 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:37:44 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[610e5eb1-f1d9-4c3f-89f0-bb97fcc6112a]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:37:44 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:37:44 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:37:44 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ddbe679-f630-495e-82b3-5fb08bdc0409]: (4, ('ok\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:37:44 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-524d40e7-6f28-4ba4-858a-625fcd3c6673 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Flushing IO for device /dev/sdc {{(pid=75165) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 00:37:44 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:37:44 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:37:44 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[63f0f58f-634c-4370-8015-6e637cdbdc5b]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:37:44 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-524d40e7-6f28-4ba4-858a-625fcd3c6673 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75165) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 00:37:44 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:37:44 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.061s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:37:44 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4b0317f-a79c-4ce7-b6d0-68dec187ec34]: (4, ('1', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:37:44 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-524d40e7-6f28-4ba4-858a-625fcd3c6673 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75165) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 00:37:44 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-524d40e7-6f28-4ba4-858a-625fcd3c6673 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] SCSI volumes sdc have been removed. {{(pid=75165) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 00:37:44 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-524d40e7-6f28-4ba4-858a-625fcd3c6673 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d2abefc2-1cb2-4993-a7e2-f043ee79ac56')] {{(pid=75165) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 00:37:44 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2abefc2-1cb2-4993-a7e2-f043ee79ac56 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:37:44 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2abefc2-1cb2-4993-a7e2-f043ee79ac56 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:37:44 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[12eedaf7-6b5c-4f08-b3ee-8997de18b368]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:37:44 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-524d40e7-6f28-4ba4-858a-625fcd3c6673 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:37:44 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2abefc2-1cb2-4993-a7e2-f043ee79ac56 -p 172.16.0.220:3260 --logout {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:37:44 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2abefc2-1cb2-4993-a7e2-f043ee79ac56 -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:37:44 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[38191038-b6ff-456d-aa92-6655555420f1]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:d2abefc2-1cb2-4993-a7e2-f043ee79ac56, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:d2abefc2-1cb2-4993-a7e2-f043ee79ac56, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:37:44 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-524d40e7-6f28-4ba4-858a-625fcd3c6673 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:d2abefc2-1cb2-4993-a7e2-f043ee79ac56, portal: 172.16.0.220,3260]
Oct 26 00:37:44 user nova-compute[75165]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:d2abefc2-1cb2-4993-a7e2-f043ee79ac56, portal: 172.16.0.220,3260] successful.
Oct 26 00:37:44 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:37:44 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2abefc2-1cb2-4993-a7e2-f043ee79ac56 -p 172.16.0.220:3260 --op delete {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:37:44 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2abefc2-1cb2-4993-a7e2-f043ee79ac56 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:37:44 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab275c0c-c1a8-4594-96dd-ed20e2fec590]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:37:44 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-524d40e7-6f28-4ba4-858a-625fcd3c6673 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:37:44 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-524d40e7-6f28-4ba4-858a-625fcd3c6673 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:37:44 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-524d40e7-6f28-4ba4-858a-625fcd3c6673 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] <== disconnect_volume: return (315ms) None {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:37:44 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-524d40e7-6f28-4ba4-858a-625fcd3c6673 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 49f1d1d3-4f34-49b3-ae89-206672d86cf0] Disconnected iSCSI Volume {{(pid=75165) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 00:37:44 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-524d40e7-6f28-4ba4-858a-625fcd3c6673 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 49f1d1d3-4f34-49b3-ae89-206672d86cf0] Deleting instance files /opt/stack/data/nova/instances/49f1d1d3-4f34-49b3-ae89-206672d86cf0_del
Oct 26 00:37:44 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-524d40e7-6f28-4ba4-858a-625fcd3c6673 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 49f1d1d3-4f34-49b3-ae89-206672d86cf0] Deletion of /opt/stack/data/nova/instances/49f1d1d3-4f34-49b3-ae89-206672d86cf0_del complete
Oct 26 00:37:44 user nova-compute[75165]: INFO nova.compute.manager [None req-524d40e7-6f28-4ba4-858a-625fcd3c6673 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 49f1d1d3-4f34-49b3-ae89-206672d86cf0] Took 1.15 seconds to destroy the instance on the hypervisor.
Oct 26 00:37:44 user nova-compute[75165]: DEBUG oslo.service.loopingcall [None req-524d40e7-6f28-4ba4-858a-625fcd3c6673 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75165) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 00:37:44 user nova-compute[75165]: DEBUG nova.compute.manager [-] [instance: 49f1d1d3-4f34-49b3-ae89-206672d86cf0] Deallocating network for instance {{(pid=75165) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 00:37:44 user nova-compute[75165]: DEBUG nova.network.neutron [-] [instance: 49f1d1d3-4f34-49b3-ae89-206672d86cf0] deallocate_for_instance() {{(pid=75165) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 00:37:45 user nova-compute[75165]: DEBUG nova.network.neutron [-] [instance: 49f1d1d3-4f34-49b3-ae89-206672d86cf0] Updating instance_info_cache with network_info: [] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:37:45 user nova-compute[75165]: INFO nova.compute.manager [-] [instance: 49f1d1d3-4f34-49b3-ae89-206672d86cf0] Took 0.52 seconds to deallocate network for instance.
Oct 26 00:37:45 user nova-compute[75165]: DEBUG nova.compute.manager [req-6cbbbf70-d44a-4e23-a0e7-11fc925ab733 req-deb3ea33-4969-49fc-ad6d-f893b96ecb02 service nova] [instance: 49f1d1d3-4f34-49b3-ae89-206672d86cf0] Received event network-vif-plugged-f815091d-bc66-47a6-8251-127c3e8275a5 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:37:45 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-6cbbbf70-d44a-4e23-a0e7-11fc925ab733 req-deb3ea33-4969-49fc-ad6d-f893b96ecb02 service nova] Acquiring lock "49f1d1d3-4f34-49b3-ae89-206672d86cf0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:37:45 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-6cbbbf70-d44a-4e23-a0e7-11fc925ab733 req-deb3ea33-4969-49fc-ad6d-f893b96ecb02 service nova] Lock "49f1d1d3-4f34-49b3-ae89-206672d86cf0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:37:45 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-6cbbbf70-d44a-4e23-a0e7-11fc925ab733 req-deb3ea33-4969-49fc-ad6d-f893b96ecb02 service nova] Lock "49f1d1d3-4f34-49b3-ae89-206672d86cf0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:37:45 user nova-compute[75165]: DEBUG nova.compute.manager [req-6cbbbf70-d44a-4e23-a0e7-11fc925ab733 req-deb3ea33-4969-49fc-ad6d-f893b96ecb02 service nova] [instance: 49f1d1d3-4f34-49b3-ae89-206672d86cf0] No waiting events found dispatching network-vif-plugged-f815091d-bc66-47a6-8251-127c3e8275a5 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:37:45 user nova-compute[75165]: WARNING nova.compute.manager [req-6cbbbf70-d44a-4e23-a0e7-11fc925ab733 req-deb3ea33-4969-49fc-ad6d-f893b96ecb02 service nova] [instance: 49f1d1d3-4f34-49b3-ae89-206672d86cf0] Received unexpected event network-vif-plugged-f815091d-bc66-47a6-8251-127c3e8275a5 for instance with vm_state active and task_state deleting.
Oct 26 00:37:45 user nova-compute[75165]: DEBUG nova.compute.manager [req-6cbbbf70-d44a-4e23-a0e7-11fc925ab733 req-deb3ea33-4969-49fc-ad6d-f893b96ecb02 service nova] [instance: 49f1d1d3-4f34-49b3-ae89-206672d86cf0] Received event network-vif-deleted-f815091d-bc66-47a6-8251-127c3e8275a5 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:37:46 user nova-compute[75165]: INFO nova.compute.manager [None req-524d40e7-6f28-4ba4-858a-625fcd3c6673 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 49f1d1d3-4f34-49b3-ae89-206672d86cf0] Took 0.91 seconds to detach 1 volumes for instance.
Oct 26 00:37:46 user nova-compute[75165]: DEBUG nova.compute.manager [None req-524d40e7-6f28-4ba4-858a-625fcd3c6673 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 49f1d1d3-4f34-49b3-ae89-206672d86cf0] Deleting volume: d2abefc2-1cb2-4993-a7e2-f043ee79ac56 {{(pid=75165) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 26 00:37:46 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-524d40e7-6f28-4ba4-858a-625fcd3c6673 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:37:46 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-524d40e7-6f28-4ba4-858a-625fcd3c6673 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:37:46 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-524d40e7-6f28-4ba4-858a-625fcd3c6673 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:37:46 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-524d40e7-6f28-4ba4-858a-625fcd3c6673 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:37:46 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-524d40e7-6f28-4ba4-858a-625fcd3c6673 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.203s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:37:46 user nova-compute[75165]: INFO nova.scheduler.client.report [None req-524d40e7-6f28-4ba4-858a-625fcd3c6673 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Deleted allocations for instance 49f1d1d3-4f34-49b3-ae89-206672d86cf0
Oct 26 00:37:46 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-524d40e7-6f28-4ba4-858a-625fcd3c6673 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Lock "49f1d1d3-4f34-49b3-ae89-206672d86cf0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.038s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:37:49 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:37:51 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-0f166519-9654-4e93-978b-9f820604f393 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Acquiring lock "97fb67a7-637d-456f-b4dd-0a271ed6cfc4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:37:51 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-0f166519-9654-4e93-978b-9f820604f393 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Lock "97fb67a7-637d-456f-b4dd-0a271ed6cfc4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:37:51 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-0f166519-9654-4e93-978b-9f820604f393 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Acquiring lock "97fb67a7-637d-456f-b4dd-0a271ed6cfc4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:37:51 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-0f166519-9654-4e93-978b-9f820604f393 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Lock "97fb67a7-637d-456f-b4dd-0a271ed6cfc4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:37:51 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-0f166519-9654-4e93-978b-9f820604f393 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Lock "97fb67a7-637d-456f-b4dd-0a271ed6cfc4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:37:51 user nova-compute[75165]: INFO nova.compute.manager [None req-0f166519-9654-4e93-978b-9f820604f393 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: 97fb67a7-637d-456f-b4dd-0a271ed6cfc4] Terminating instance
Oct 26 00:37:51 user nova-compute[75165]: DEBUG nova.compute.manager [None req-0f166519-9654-4e93-978b-9f820604f393 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: 97fb67a7-637d-456f-b4dd-0a271ed6cfc4] Start destroying the instance on the hypervisor. {{(pid=75165) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 00:37:51 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:37:51 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:37:51 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:37:51 user nova-compute[75165]: DEBUG nova.compute.manager [req-e5847cdc-082b-4d7d-ab5c-f8f34428c831 req-40e249ec-5c38-4fe1-8bc0-1652181570c0 service nova] [instance: 97fb67a7-637d-456f-b4dd-0a271ed6cfc4] Received event network-vif-unplugged-254ea53c-6da9-46d5-a139-7926008cdf8b {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:37:51 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-e5847cdc-082b-4d7d-ab5c-f8f34428c831 req-40e249ec-5c38-4fe1-8bc0-1652181570c0 service nova] Acquiring lock "97fb67a7-637d-456f-b4dd-0a271ed6cfc4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:37:51 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-e5847cdc-082b-4d7d-ab5c-f8f34428c831 req-40e249ec-5c38-4fe1-8bc0-1652181570c0 service nova] Lock "97fb67a7-637d-456f-b4dd-0a271ed6cfc4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:37:51 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-e5847cdc-082b-4d7d-ab5c-f8f34428c831 req-40e249ec-5c38-4fe1-8bc0-1652181570c0 service nova] Lock "97fb67a7-637d-456f-b4dd-0a271ed6cfc4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:37:51 user nova-compute[75165]: DEBUG nova.compute.manager [req-e5847cdc-082b-4d7d-ab5c-f8f34428c831 req-40e249ec-5c38-4fe1-8bc0-1652181570c0 service nova] [instance: 97fb67a7-637d-456f-b4dd-0a271ed6cfc4] No waiting events found dispatching network-vif-unplugged-254ea53c-6da9-46d5-a139-7926008cdf8b {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:37:51 user nova-compute[75165]: DEBUG nova.compute.manager [req-e5847cdc-082b-4d7d-ab5c-f8f34428c831 req-40e249ec-5c38-4fe1-8bc0-1652181570c0 service nova] [instance: 97fb67a7-637d-456f-b4dd-0a271ed6cfc4] Received event network-vif-unplugged-254ea53c-6da9-46d5-a139-7926008cdf8b for instance with task_state deleting. {{(pid=75165) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 00:37:51 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: 97fb67a7-637d-456f-b4dd-0a271ed6cfc4] Instance destroyed successfully.
Oct 26 00:37:51 user nova-compute[75165]: DEBUG nova.objects.instance [None req-0f166519-9654-4e93-978b-9f820604f393 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Lazy-loading 'resources' on Instance uuid 97fb67a7-637d-456f-b4dd-0a271ed6cfc4 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:37:51 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-0f166519-9654-4e93-978b-9f820604f393 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:18:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-326837151',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-326837151',id=25,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-26T00:18:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d616862c7c184de5b0ba3121552c5666',ramdisk_id='',reservation_id='r-0cxh099s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-638746030',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T00:20:08Z,user_data=None,user_id='dbe0d52293264f33ae86de41dabeefcf',uuid=97fb67a7-637d-456f-b4dd-0a271ed6cfc4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "254ea53c-6da9-46d5-a139-7926008cdf8b", "address": "fa:16:3e:08:21:2a", "network": {"id": "eb55c0bc-cae5-4ba3-851a-e31a50b52c88", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1081223830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d616862c7c184de5b0ba3121552c5666", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap254ea53c-6d", "ovs_interfaceid": "254ea53c-6da9-46d5-a139-7926008cdf8b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 00:37:51 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-0f166519-9654-4e93-978b-9f820604f393 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Converting VIF {"id": "254ea53c-6da9-46d5-a139-7926008cdf8b", "address": "fa:16:3e:08:21:2a", "network": {"id": "eb55c0bc-cae5-4ba3-851a-e31a50b52c88", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1081223830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d616862c7c184de5b0ba3121552c5666", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap254ea53c-6d", "ovs_interfaceid": "254ea53c-6da9-46d5-a139-7926008cdf8b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:37:51 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-0f166519-9654-4e93-978b-9f820604f393 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:08:21:2a,bridge_name='br-int',has_traffic_filtering=True,id=254ea53c-6da9-46d5-a139-7926008cdf8b,network=Network(eb55c0bc-cae5-4ba3-851a-e31a50b52c88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap254ea53c-6d') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:37:51 user nova-compute[75165]: DEBUG os_vif [None req-0f166519-9654-4e93-978b-9f820604f393 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:08:21:2a,bridge_name='br-int',has_traffic_filtering=True,id=254ea53c-6da9-46d5-a139-7926008cdf8b,network=Network(eb55c0bc-cae5-4ba3-851a-e31a50b52c88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap254ea53c-6d') {{(pid=75165) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 00:37:51 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:37:51 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap254ea53c-6d, bridge=br-int, if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:37:51 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:37:51 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:37:51 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:37:51 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4f77dd52-16d3-4471-984e-d41de7edd093) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:37:51 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:37:51 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:37:51 user nova-compute[75165]: INFO os_vif [None req-0f166519-9654-4e93-978b-9f820604f393 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:08:21:2a,bridge_name='br-int',has_traffic_filtering=True,id=254ea53c-6da9-46d5-a139-7926008cdf8b,network=Network(eb55c0bc-cae5-4ba3-851a-e31a50b52c88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap254ea53c-6d')
Oct 26 00:37:51 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-0f166519-9654-4e93-978b-9f820604f393 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: 97fb67a7-637d-456f-b4dd-0a271ed6cfc4] Deleting instance files /opt/stack/data/nova/instances/97fb67a7-637d-456f-b4dd-0a271ed6cfc4_del
Oct 26 00:37:51 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-0f166519-9654-4e93-978b-9f820604f393 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: 97fb67a7-637d-456f-b4dd-0a271ed6cfc4] Deletion of /opt/stack/data/nova/instances/97fb67a7-637d-456f-b4dd-0a271ed6cfc4_del complete
Oct 26 00:37:52 user nova-compute[75165]: INFO nova.compute.manager [None req-0f166519-9654-4e93-978b-9f820604f393 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] [instance: 97fb67a7-637d-456f-b4dd-0a271ed6cfc4] Took 0.84 seconds to destroy the instance on the hypervisor.
Oct 26 00:37:52 user nova-compute[75165]: DEBUG oslo.service.loopingcall [None req-0f166519-9654-4e93-978b-9f820604f393 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75165) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 00:37:52 user nova-compute[75165]: DEBUG nova.compute.manager [-] [instance: 97fb67a7-637d-456f-b4dd-0a271ed6cfc4] Deallocating network for instance {{(pid=75165) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 00:37:52 user nova-compute[75165]: DEBUG nova.network.neutron [-] [instance: 97fb67a7-637d-456f-b4dd-0a271ed6cfc4] deallocate_for_instance() {{(pid=75165) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 00:37:52 user nova-compute[75165]: DEBUG nova.network.neutron [-] [instance: 97fb67a7-637d-456f-b4dd-0a271ed6cfc4] Updating instance_info_cache with network_info: [] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:37:52 user nova-compute[75165]: INFO nova.compute.manager [-] [instance: 97fb67a7-637d-456f-b4dd-0a271ed6cfc4] Took 0.52 seconds to deallocate network for instance.
Oct 26 00:37:52 user nova-compute[75165]: DEBUG nova.compute.manager [req-16b474a3-f8d5-4378-98ab-1ccb71cf4464 req-581ee882-0498-4d40-9c3f-4139aee2e344 service nova] [instance: 97fb67a7-637d-456f-b4dd-0a271ed6cfc4] Received event network-vif-deleted-254ea53c-6da9-46d5-a139-7926008cdf8b {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:37:52 user nova-compute[75165]: INFO nova.compute.manager [req-16b474a3-f8d5-4378-98ab-1ccb71cf4464 req-581ee882-0498-4d40-9c3f-4139aee2e344 service nova] [instance: 97fb67a7-637d-456f-b4dd-0a271ed6cfc4] Neutron deleted interface 254ea53c-6da9-46d5-a139-7926008cdf8b; detaching it from the instance and deleting it from the info cache
Oct 26 00:37:52 user nova-compute[75165]: DEBUG nova.network.neutron [req-16b474a3-f8d5-4378-98ab-1ccb71cf4464 req-581ee882-0498-4d40-9c3f-4139aee2e344 service nova] [instance: 97fb67a7-637d-456f-b4dd-0a271ed6cfc4] Updating instance_info_cache with network_info: [] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:37:52 user nova-compute[75165]: DEBUG nova.compute.manager [req-16b474a3-f8d5-4378-98ab-1ccb71cf4464 req-581ee882-0498-4d40-9c3f-4139aee2e344 service nova] [instance: 97fb67a7-637d-456f-b4dd-0a271ed6cfc4] Detach interface failed, port_id=254ea53c-6da9-46d5-a139-7926008cdf8b, reason: Instance 97fb67a7-637d-456f-b4dd-0a271ed6cfc4 could not be found. {{(pid=75165) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 26 00:37:52 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-0f166519-9654-4e93-978b-9f820604f393 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:37:52 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-0f166519-9654-4e93-978b-9f820604f393 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:37:52 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-0f166519-9654-4e93-978b-9f820604f393 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:37:52 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-0f166519-9654-4e93-978b-9f820604f393 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:37:52 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-0f166519-9654-4e93-978b-9f820604f393 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.167s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:37:52 user nova-compute[75165]: INFO nova.scheduler.client.report [None req-0f166519-9654-4e93-978b-9f820604f393 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Deleted allocations for instance 97fb67a7-637d-456f-b4dd-0a271ed6cfc4
Oct 26 00:37:52 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-0f166519-9654-4e93-978b-9f820604f393 tempest-ServerBootFromVolumeStableRescueTest-638746030 tempest-ServerBootFromVolumeStableRescueTest-638746030-project-member] Lock "97fb67a7-637d-456f-b4dd-0a271ed6cfc4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.706s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:37:53 user nova-compute[75165]: DEBUG nova.compute.manager [req-e44f0c66-f638-4cd7-9697-b32e1afce12f req-338f09cd-a680-48b3-9213-a72535bcccac service nova] [instance: 97fb67a7-637d-456f-b4dd-0a271ed6cfc4] Received event network-vif-plugged-254ea53c-6da9-46d5-a139-7926008cdf8b {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:37:53 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-e44f0c66-f638-4cd7-9697-b32e1afce12f req-338f09cd-a680-48b3-9213-a72535bcccac service nova] Acquiring lock "97fb67a7-637d-456f-b4dd-0a271ed6cfc4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:37:53 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-e44f0c66-f638-4cd7-9697-b32e1afce12f req-338f09cd-a680-48b3-9213-a72535bcccac service nova] Lock "97fb67a7-637d-456f-b4dd-0a271ed6cfc4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:37:53 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-e44f0c66-f638-4cd7-9697-b32e1afce12f req-338f09cd-a680-48b3-9213-a72535bcccac service nova] Lock "97fb67a7-637d-456f-b4dd-0a271ed6cfc4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:37:53 user nova-compute[75165]: DEBUG nova.compute.manager [req-e44f0c66-f638-4cd7-9697-b32e1afce12f req-338f09cd-a680-48b3-9213-a72535bcccac service nova] [instance: 97fb67a7-637d-456f-b4dd-0a271ed6cfc4] No waiting events found dispatching network-vif-plugged-254ea53c-6da9-46d5-a139-7926008cdf8b {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:37:53 user nova-compute[75165]: WARNING nova.compute.manager [req-e44f0c66-f638-4cd7-9697-b32e1afce12f req-338f09cd-a680-48b3-9213-a72535bcccac service nova] [instance: 97fb67a7-637d-456f-b4dd-0a271ed6cfc4] Received unexpected event network-vif-plugged-254ea53c-6da9-46d5-a139-7926008cdf8b for instance with vm_state deleted and task_state None.
Oct 26 00:37:56 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:38:01 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:38:01 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:38:01 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75165) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 00:38:01 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75165) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 00:38:01 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75165) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 00:38:01 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:38:06 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:38:11 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:38:16 user nova-compute[75165]: DEBUG nova.compute.manager [None req-f8ce778a-beff-4921-a703-8c1ef7901186 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] [instance: 6ae9fe6f-eb17-44f5-89e4-fff5e3451336] Checking state {{(pid=75165) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 00:38:16 user nova-compute[75165]: INFO nova.compute.manager [None req-f8ce778a-beff-4921-a703-8c1ef7901186 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] [instance: 6ae9fe6f-eb17-44f5-89e4-fff5e3451336] instance snapshotting
Oct 26 00:38:16 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-f8ce778a-beff-4921-a703-8c1ef7901186 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] [instance: 6ae9fe6f-eb17-44f5-89e4-fff5e3451336] Beginning live snapshot process
Oct 26 00:38:16 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-f8ce778a-beff-4921-a703-8c1ef7901186 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae9fe6f-eb17-44f5-89e4-fff5e3451336/disk --force-share --output=json -f qcow2 {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:38:16 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-f8ce778a-beff-4921-a703-8c1ef7901186 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae9fe6f-eb17-44f5-89e4-fff5e3451336/disk --force-share --output=json -f qcow2" returned: 0 in 0.176s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:38:16 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-f8ce778a-beff-4921-a703-8c1ef7901186 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae9fe6f-eb17-44f5-89e4-fff5e3451336/disk --force-share --output=json -f qcow2 {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:38:17 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:38:17 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-f8ce778a-beff-4921-a703-8c1ef7901186 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae9fe6f-eb17-44f5-89e4-fff5e3451336/disk --force-share --output=json -f qcow2" returned: 0 in 0.177s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:38:17 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-f8ce778a-beff-4921-a703-8c1ef7901186 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:38:17 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-f8ce778a-beff-4921-a703-8c1ef7901186 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json" returned: 0 in 0.170s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:38:17 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-f8ce778a-beff-4921-a703-8c1ef7901186 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpmajq2ofb/c4a0069d0f884c16877404d1807f0b97.delta 1073741824 {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:38:17 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-f8ce778a-beff-4921-a703-8c1ef7901186 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpmajq2ofb/c4a0069d0f884c16877404d1807f0b97.delta 1073741824" returned: 0 in 0.053s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:38:17 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-f8ce778a-beff-4921-a703-8c1ef7901186 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] [instance: 6ae9fe6f-eb17-44f5-89e4-fff5e3451336] Quiescing instance not available: QEMU guest agent is not enabled.
Oct 26 00:38:18 user nova-compute[75165]: DEBUG nova.virt.libvirt.guest [None req-f8ce778a-beff-4921-a703-8c1ef7901186 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=75165) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 26 00:38:18 user nova-compute[75165]: DEBUG nova.virt.libvirt.guest [None req-f8ce778a-beff-4921-a703-8c1ef7901186 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=75165) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 26 00:38:18 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-f8ce778a-beff-4921-a703-8c1ef7901186 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] [instance: 6ae9fe6f-eb17-44f5-89e4-fff5e3451336] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 26 00:38:18 user nova-compute[75165]: DEBUG nova.privsep.utils [None req-f8ce778a-beff-4921-a703-8c1ef7901186 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75165) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 26 00:38:18 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-f8ce778a-beff-4921-a703-8c1ef7901186 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpmajq2ofb/c4a0069d0f884c16877404d1807f0b97.delta /opt/stack/data/nova/instances/snapshots/tmpmajq2ofb/c4a0069d0f884c16877404d1807f0b97 {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:38:19 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-f8ce778a-beff-4921-a703-8c1ef7901186 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpmajq2ofb/c4a0069d0f884c16877404d1807f0b97.delta /opt/stack/data/nova/instances/snapshots/tmpmajq2ofb/c4a0069d0f884c16877404d1807f0b97" returned: 0 in 0.323s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:38:19 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-f8ce778a-beff-4921-a703-8c1ef7901186 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] [instance: 6ae9fe6f-eb17-44f5-89e4-fff5e3451336] Snapshot extracted, beginning image upload
Oct 26 00:38:20 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:38:20 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75165) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 00:38:21 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-f8ce778a-beff-4921-a703-8c1ef7901186 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] [instance: 6ae9fe6f-eb17-44f5-89e4-fff5e3451336] Snapshot image upload complete
Oct 26 00:38:21 user nova-compute[75165]: INFO nova.compute.manager [None req-f8ce778a-beff-4921-a703-8c1ef7901186 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] [instance: 6ae9fe6f-eb17-44f5-89e4-fff5e3451336] Took 4.78 seconds to snapshot the instance on the hypervisor.
Oct 26 00:38:22 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:38:22 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:38:22 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75165) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 00:38:22 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75165) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 00:38:22 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75165) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 00:38:22 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:38:22 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:38:23 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-fc3669fb-458d-403d-a72c-4c49e4842a5e tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Acquiring lock "65b637f1-baea-4e1c-8b25-e943125eed32" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:38:23 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-fc3669fb-458d-403d-a72c-4c49e4842a5e tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Lock "65b637f1-baea-4e1c-8b25-e943125eed32" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:38:23 user nova-compute[75165]: DEBUG nova.compute.manager [None req-fc3669fb-458d-403d-a72c-4c49e4842a5e tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] [instance: 65b637f1-baea-4e1c-8b25-e943125eed32] Starting instance... {{(pid=75165) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 00:38:23 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-fc3669fb-458d-403d-a72c-4c49e4842a5e tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:38:23 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-fc3669fb-458d-403d-a72c-4c49e4842a5e tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:38:23 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-fc3669fb-458d-403d-a72c-4c49e4842a5e tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75165) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 00:38:23 user nova-compute[75165]: INFO nova.compute.claims [None req-fc3669fb-458d-403d-a72c-4c49e4842a5e tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] [instance: 65b637f1-baea-4e1c-8b25-e943125eed32] Claim successful on node user
Oct 26 00:38:23 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-fc3669fb-458d-403d-a72c-4c49e4842a5e tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:38:23 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-fc3669fb-458d-403d-a72c-4c49e4842a5e tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:38:23 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-fc3669fb-458d-403d-a72c-4c49e4842a5e tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.267s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:38:23 user nova-compute[75165]: DEBUG nova.compute.manager [None req-fc3669fb-458d-403d-a72c-4c49e4842a5e tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] [instance: 65b637f1-baea-4e1c-8b25-e943125eed32] Start building networks asynchronously for instance. {{(pid=75165) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 00:38:23 user nova-compute[75165]: DEBUG nova.compute.manager [None req-fc3669fb-458d-403d-a72c-4c49e4842a5e tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] [instance: 65b637f1-baea-4e1c-8b25-e943125eed32] Allocating IP information in the background. {{(pid=75165) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 00:38:23 user nova-compute[75165]: DEBUG nova.network.neutron [None req-fc3669fb-458d-403d-a72c-4c49e4842a5e tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] [instance: 65b637f1-baea-4e1c-8b25-e943125eed32] allocate_for_instance() {{(pid=75165) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 00:38:23 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-fc3669fb-458d-403d-a72c-4c49e4842a5e tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] [instance: 65b637f1-baea-4e1c-8b25-e943125eed32] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 00:38:23 user nova-compute[75165]: DEBUG nova.compute.manager [None req-fc3669fb-458d-403d-a72c-4c49e4842a5e tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] [instance: 65b637f1-baea-4e1c-8b25-e943125eed32] Start building block device mappings for instance. {{(pid=75165) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 00:38:23 user nova-compute[75165]: DEBUG nova.policy [None req-fc3669fb-458d-403d-a72c-4c49e4842a5e tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a8b04771d6df477ebd9015c46345afc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11255eee7bb4b13962634a1cd13d186', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75165) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 00:38:23 user nova-compute[75165]: DEBUG nova.compute.manager [None req-fc3669fb-458d-403d-a72c-4c49e4842a5e tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] [instance: 65b637f1-baea-4e1c-8b25-e943125eed32] Start spawning the instance on the hypervisor. {{(pid=75165) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 00:38:23 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-fc3669fb-458d-403d-a72c-4c49e4842a5e tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] [instance: 65b637f1-baea-4e1c-8b25-e943125eed32] Creating instance directory {{(pid=75165) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 00:38:23 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-fc3669fb-458d-403d-a72c-4c49e4842a5e tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] [instance: 65b637f1-baea-4e1c-8b25-e943125eed32] Creating image(s)
Oct 26 00:38:23 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-fc3669fb-458d-403d-a72c-4c49e4842a5e tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Acquiring lock "/opt/stack/data/nova/instances/65b637f1-baea-4e1c-8b25-e943125eed32/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:38:23 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-fc3669fb-458d-403d-a72c-4c49e4842a5e tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Lock "/opt/stack/data/nova/instances/65b637f1-baea-4e1c-8b25-e943125eed32/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:38:23 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-fc3669fb-458d-403d-a72c-4c49e4842a5e tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Lock "/opt/stack/data/nova/instances/65b637f1-baea-4e1c-8b25-e943125eed32/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:38:23 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-fc3669fb-458d-403d-a72c-4c49e4842a5e tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Acquiring lock "1d7965afce21bb22e0162b1282b87b9bf8110a53" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:38:23 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-fc3669fb-458d-403d-a72c-4c49e4842a5e tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Lock "1d7965afce21bb22e0162b1282b87b9bf8110a53" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:38:24 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-fc3669fb-458d-403d-a72c-4c49e4842a5e tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1d7965afce21bb22e0162b1282b87b9bf8110a53.part --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:38:24 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:38:25 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-fc3669fb-458d-403d-a72c-4c49e4842a5e tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1d7965afce21bb22e0162b1282b87b9bf8110a53.part --force-share --output=json" returned: 0 in 0.173s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:38:25 user nova-compute[75165]: DEBUG nova.virt.images [None req-fc3669fb-458d-403d-a72c-4c49e4842a5e tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] 1f5737a7-4490-4f44-971e-42604d4c5eef was qcow2, converting to raw {{(pid=75165) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 26 00:38:25 user nova-compute[75165]: DEBUG nova.privsep.utils [None req-fc3669fb-458d-403d-a72c-4c49e4842a5e tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75165) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 26 00:38:25 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-fc3669fb-458d-403d-a72c-4c49e4842a5e tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1d7965afce21bb22e0162b1282b87b9bf8110a53.part /opt/stack/data/nova/instances/_base/1d7965afce21bb22e0162b1282b87b9bf8110a53.converted {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:38:25 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-fc3669fb-458d-403d-a72c-4c49e4842a5e tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1d7965afce21bb22e0162b1282b87b9bf8110a53.part /opt/stack/data/nova/instances/_base/1d7965afce21bb22e0162b1282b87b9bf8110a53.converted" returned: 0 in 0.394s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:38:25 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-fc3669fb-458d-403d-a72c-4c49e4842a5e tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1d7965afce21bb22e0162b1282b87b9bf8110a53.converted --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:38:25 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-fc3669fb-458d-403d-a72c-4c49e4842a5e tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1d7965afce21bb22e0162b1282b87b9bf8110a53.converted --force-share --output=json" returned: 0 in 0.181s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:38:25 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-fc3669fb-458d-403d-a72c-4c49e4842a5e tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Lock "1d7965afce21bb22e0162b1282b87b9bf8110a53" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.681s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:38:25 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-fc3669fb-458d-403d-a72c-4c49e4842a5e tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1d7965afce21bb22e0162b1282b87b9bf8110a53 --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:38:25 user nova-compute[75165]: DEBUG nova.network.neutron [None req-fc3669fb-458d-403d-a72c-4c49e4842a5e tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] [instance: 65b637f1-baea-4e1c-8b25-e943125eed32] Successfully created port: 29185859-2394-4d70-a21d-4a7723e80fcd {{(pid=75165) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 00:38:25 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-fc3669fb-458d-403d-a72c-4c49e4842a5e tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1d7965afce21bb22e0162b1282b87b9bf8110a53 --force-share --output=json" returned: 0 in 0.194s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:38:25 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-fc3669fb-458d-403d-a72c-4c49e4842a5e tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Acquiring lock "1d7965afce21bb22e0162b1282b87b9bf8110a53" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:38:25 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-fc3669fb-458d-403d-a72c-4c49e4842a5e tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Lock "1d7965afce21bb22e0162b1282b87b9bf8110a53" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:38:25 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-fc3669fb-458d-403d-a72c-4c49e4842a5e tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1d7965afce21bb22e0162b1282b87b9bf8110a53 --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:38:26 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-fc3669fb-458d-403d-a72c-4c49e4842a5e tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1d7965afce21bb22e0162b1282b87b9bf8110a53 --force-share --output=json" returned: 0 in 0.188s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:38:26 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-fc3669fb-458d-403d-a72c-4c49e4842a5e tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1d7965afce21bb22e0162b1282b87b9bf8110a53,backing_fmt=raw /opt/stack/data/nova/instances/65b637f1-baea-4e1c-8b25-e943125eed32/disk 1073741824 {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:38:26 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-fc3669fb-458d-403d-a72c-4c49e4842a5e tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1d7965afce21bb22e0162b1282b87b9bf8110a53,backing_fmt=raw /opt/stack/data/nova/instances/65b637f1-baea-4e1c-8b25-e943125eed32/disk 1073741824" returned: 0 in 0.052s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:38:26 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-fc3669fb-458d-403d-a72c-4c49e4842a5e tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Lock "1d7965afce21bb22e0162b1282b87b9bf8110a53" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.250s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:38:26 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-fc3669fb-458d-403d-a72c-4c49e4842a5e tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1d7965afce21bb22e0162b1282b87b9bf8110a53 --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:38:26 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-fc3669fb-458d-403d-a72c-4c49e4842a5e tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1d7965afce21bb22e0162b1282b87b9bf8110a53 --force-share --output=json" returned: 0 in 0.175s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:38:26 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-fc3669fb-458d-403d-a72c-4c49e4842a5e tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] [instance: 65b637f1-baea-4e1c-8b25-e943125eed32] Created local disks {{(pid=75165) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 00:38:26 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-fc3669fb-458d-403d-a72c-4c49e4842a5e tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] [instance: 65b637f1-baea-4e1c-8b25-e943125eed32] Ensure instance console log exists: /opt/stack/data/nova/instances/65b637f1-baea-4e1c-8b25-e943125eed32/console.log {{(pid=75165) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 00:38:26 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-fc3669fb-458d-403d-a72c-4c49e4842a5e tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:38:26 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-fc3669fb-458d-403d-a72c-4c49e4842a5e tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:38:26 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-fc3669fb-458d-403d-a72c-4c49e4842a5e tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:38:26 user nova-compute[75165]: DEBUG nova.network.neutron [None req-fc3669fb-458d-403d-a72c-4c49e4842a5e tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] [instance: 65b637f1-baea-4e1c-8b25-e943125eed32] Successfully updated port: 29185859-2394-4d70-a21d-4a7723e80fcd {{(pid=75165) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 00:38:26 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-fc3669fb-458d-403d-a72c-4c49e4842a5e tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Acquiring lock "refresh_cache-65b637f1-baea-4e1c-8b25-e943125eed32" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:38:26 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-fc3669fb-458d-403d-a72c-4c49e4842a5e tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Acquired lock "refresh_cache-65b637f1-baea-4e1c-8b25-e943125eed32" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:38:26 user nova-compute[75165]: DEBUG nova.network.neutron [None req-fc3669fb-458d-403d-a72c-4c49e4842a5e tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] [instance: 65b637f1-baea-4e1c-8b25-e943125eed32] Building network info cache for instance {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 00:38:26 user nova-compute[75165]: DEBUG nova.compute.manager [req-77f6c13a-af12-4897-bf6a-a452e480613e req-583bae5b-153d-4dd2-ad7a-bee346aa3b45 service nova] [instance: 65b637f1-baea-4e1c-8b25-e943125eed32] Received event network-changed-29185859-2394-4d70-a21d-4a7723e80fcd {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:38:26 user nova-compute[75165]: DEBUG nova.compute.manager [req-77f6c13a-af12-4897-bf6a-a452e480613e req-583bae5b-153d-4dd2-ad7a-bee346aa3b45 service nova] [instance: 65b637f1-baea-4e1c-8b25-e943125eed32] Refreshing instance network info cache due to event network-changed-29185859-2394-4d70-a21d-4a7723e80fcd. {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 00:38:26 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-77f6c13a-af12-4897-bf6a-a452e480613e req-583bae5b-153d-4dd2-ad7a-bee346aa3b45 service nova] Acquiring lock "refresh_cache-65b637f1-baea-4e1c-8b25-e943125eed32" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:38:26 user nova-compute[75165]: DEBUG nova.network.neutron [None req-fc3669fb-458d-403d-a72c-4c49e4842a5e tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] [instance: 65b637f1-baea-4e1c-8b25-e943125eed32] Instance cache missing network info. {{(pid=75165) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 00:38:26 user nova-compute[75165]: DEBUG nova.network.neutron [None req-fc3669fb-458d-403d-a72c-4c49e4842a5e tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] [instance: 65b637f1-baea-4e1c-8b25-e943125eed32] Updating instance_info_cache with network_info: [{"id": "29185859-2394-4d70-a21d-4a7723e80fcd", "address": "fa:16:3e:0f:8c:52", "network": {"id": "03d2b5cd-b214-4767-a406-098bd6857327", "bridge": "br-int", "label": "tempest-TestStampPattern-968415108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e11255eee7bb4b13962634a1cd13d186", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29185859-23", "ovs_interfaceid": "29185859-2394-4d70-a21d-4a7723e80fcd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:38:26 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-fc3669fb-458d-403d-a72c-4c49e4842a5e tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Releasing lock "refresh_cache-65b637f1-baea-4e1c-8b25-e943125eed32" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:38:26 user nova-compute[75165]: DEBUG nova.compute.manager [None req-fc3669fb-458d-403d-a72c-4c49e4842a5e tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] [instance: 65b637f1-baea-4e1c-8b25-e943125eed32] Instance network_info: |[{"id": "29185859-2394-4d70-a21d-4a7723e80fcd", "address": "fa:16:3e:0f:8c:52", "network": {"id": "03d2b5cd-b214-4767-a406-098bd6857327", "bridge": "br-int", "label": "tempest-TestStampPattern-968415108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e11255eee7bb4b13962634a1cd13d186", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29185859-23", "ovs_interfaceid": "29185859-2394-4d70-a21d-4a7723e80fcd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75165) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 00:38:26 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-77f6c13a-af12-4897-bf6a-a452e480613e req-583bae5b-153d-4dd2-ad7a-bee346aa3b45 service nova] Acquired lock "refresh_cache-65b637f1-baea-4e1c-8b25-e943125eed32" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:38:26 user nova-compute[75165]: DEBUG nova.network.neutron [req-77f6c13a-af12-4897-bf6a-a452e480613e req-583bae5b-153d-4dd2-ad7a-bee346aa3b45 service nova] [instance: 65b637f1-baea-4e1c-8b25-e943125eed32] Refreshing network info cache for port 29185859-2394-4d70-a21d-4a7723e80fcd {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 00:38:26 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-fc3669fb-458d-403d-a72c-4c49e4842a5e tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] [instance: 65b637f1-baea-4e1c-8b25-e943125eed32] Start _get_guest_xml network_info=[{"id": "29185859-2394-4d70-a21d-4a7723e80fcd", "address": "fa:16:3e:0f:8c:52", "network": {"id": "03d2b5cd-b214-4767-a406-098bd6857327", "bridge": "br-int", "label": "tempest-TestStampPattern-968415108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e11255eee7bb4b13962634a1cd13d186", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29185859-23", "ovs_interfaceid": "29185859-2394-4d70-a21d-4a7723e80fcd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d12c820833265cbddc53aee7c7430325',container_format='bare',created_at=2023-10-26T00:38:16Z,direct_url=<?>,disk_format='qcow2',id=1f5737a7-4490-4f44-971e-42604d4c5eef,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-236391398',owner='e11255eee7bb4b13962634a1cd13d186',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-26T00:38:21Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'size': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': '1f5737a7-4490-4f44-971e-42604d4c5eef'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75165) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 00:38:26 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-fc3669fb-458d-403d-a72c-4c49e4842a5e tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:38:26 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-fc3669fb-458d-403d-a72c-4c49e4842a5e tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:38:26 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-fc3669fb-458d-403d-a72c-4c49e4842a5e tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75165) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 00:38:26 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-fc3669fb-458d-403d-a72c-4c49e4842a5e tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] CPU controller missing on host. {{(pid=75165) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 00:38:26 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-fc3669fb-458d-403d-a72c-4c49e4842a5e tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75165) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 00:38:26 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-fc3669fb-458d-403d-a72c-4c49e4842a5e tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] CPU controller found on host. {{(pid=75165) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 00:38:26 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-fc3669fb-458d-403d-a72c-4c49e4842a5e tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75165) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 00:38:26 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-fc3669fb-458d-403d-a72c-4c49e4842a5e tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T00:03:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d12c820833265cbddc53aee7c7430325',container_format='bare',created_at=2023-10-26T00:38:16Z,direct_url=<?>,disk_format='qcow2',id=1f5737a7-4490-4f44-971e-42604d4c5eef,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-236391398',owner='e11255eee7bb4b13962634a1cd13d186',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-26T00:38:21Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 00:38:26 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-fc3669fb-458d-403d-a72c-4c49e4842a5e tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Flavor limits 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 00:38:26 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-fc3669fb-458d-403d-a72c-4c49e4842a5e tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Image limits 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 00:38:26 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-fc3669fb-458d-403d-a72c-4c49e4842a5e tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Flavor pref 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 00:38:26 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-fc3669fb-458d-403d-a72c-4c49e4842a5e tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Image pref 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 00:38:26 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-fc3669fb-458d-403d-a72c-4c49e4842a5e tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 00:38:26 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-fc3669fb-458d-403d-a72c-4c49e4842a5e tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 00:38:26 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-fc3669fb-458d-403d-a72c-4c49e4842a5e tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75165) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 00:38:26 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-fc3669fb-458d-403d-a72c-4c49e4842a5e tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Got 1 possible topologies {{(pid=75165) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 00:38:26 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-fc3669fb-458d-403d-a72c-4c49e4842a5e tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 00:38:26 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-fc3669fb-458d-403d-a72c-4c49e4842a5e tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 00:38:26 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-fc3669fb-458d-403d-a72c-4c49e4842a5e tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:38:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1255877134',display_name='tempest-TestStampPattern-server-1255877134',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1255877134',id=42,image_ref='1f5737a7-4490-4f44-971e-42604d4c5eef',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGm2My4nRv1TQMRxx0ZQGbSskYL8JiBedzBd6yh8xGYOqpiWk+KOkgfodgvUeL5VIyIOd6LANvVscgBF9awfoT7/2vctuNc54C96HHUt5A78B63ZjhSiwIVLzywUgmpbdw==',key_name='tempest-TestStampPattern-1939697091',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e11255eee7bb4b13962634a1cd13d186',ramdisk_id='',reservation_id='r-4jaje88m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='6ae9fe6f-eb17-44f5-89e4-fff5e3451336',image_min_disk='1',image_min_ram='0',image_owner_id='e11255eee7bb4b13962634a1cd13d186',image_owner_project_name='tempest-TestStampPattern-153617260',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-153617260-project-member',image_user_id='a8b04771d6df477ebd9015c46345afc5',network_allocated='True',owner_project_name='tempest-TestStampPattern-153617260',owner_user_name='tempest-TestStampPattern-153617260-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T00:38:24Z,user_data=None,user_id='a8b04771d6df477ebd9015c46345afc5',uuid=65b637f1-baea-4e1c-8b25-e943125eed32,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "29185859-2394-4d70-a21d-4a7723e80fcd", "address": "fa:16:3e:0f:8c:52", "network": {"id": "03d2b5cd-b214-4767-a406-098bd6857327", "bridge": "br-int", "label": "tempest-TestStampPattern-968415108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e11255eee7bb4b13962634a1cd13d186", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29185859-23", "ovs_interfaceid": "29185859-2394-4d70-a21d-4a7723e80fcd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75165) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 00:38:26 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-fc3669fb-458d-403d-a72c-4c49e4842a5e tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Converting VIF {"id": "29185859-2394-4d70-a21d-4a7723e80fcd", "address": "fa:16:3e:0f:8c:52", "network": {"id": "03d2b5cd-b214-4767-a406-098bd6857327", "bridge": "br-int", "label": "tempest-TestStampPattern-968415108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e11255eee7bb4b13962634a1cd13d186", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29185859-23", "ovs_interfaceid": "29185859-2394-4d70-a21d-4a7723e80fcd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:38:26 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-fc3669fb-458d-403d-a72c-4c49e4842a5e tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:8c:52,bridge_name='br-int',has_traffic_filtering=True,id=29185859-2394-4d70-a21d-4a7723e80fcd,network=Network(03d2b5cd-b214-4767-a406-098bd6857327),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29185859-23') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:38:26 user nova-compute[75165]: DEBUG nova.objects.instance [None req-fc3669fb-458d-403d-a72c-4c49e4842a5e tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Lazy-loading 'pci_devices' on Instance uuid 65b637f1-baea-4e1c-8b25-e943125eed32 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:38:26 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-fc3669fb-458d-403d-a72c-4c49e4842a5e tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] [instance: 65b637f1-baea-4e1c-8b25-e943125eed32] End _get_guest_xml xml=<domain type="kvm">
Oct 26 00:38:26 user nova-compute[75165]:   <uuid>65b637f1-baea-4e1c-8b25-e943125eed32</uuid>
Oct 26 00:38:26 user nova-compute[75165]:   <name>instance-0000002a</name>
Oct 26 00:38:26 user nova-compute[75165]:   <memory>524288</memory>
Oct 26 00:38:26 user nova-compute[75165]:   <vcpu>1</vcpu>
Oct 26 00:38:26 user nova-compute[75165]:   <metadata>
Oct 26 00:38:26 user nova-compute[75165]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 00:38:26 user nova-compute[75165]:       <nova:package version="0.0.0"/>
Oct 26 00:38:26 user nova-compute[75165]:       <nova:name>tempest-TestStampPattern-server-1255877134</nova:name>
Oct 26 00:38:26 user nova-compute[75165]:       <nova:creationTime>2023-10-26 00:38:26</nova:creationTime>
Oct 26 00:38:26 user nova-compute[75165]:       <nova:flavor name="m1.tiny">
Oct 26 00:38:26 user nova-compute[75165]:         <nova:memory>512</nova:memory>
Oct 26 00:38:26 user nova-compute[75165]:         <nova:disk>1</nova:disk>
Oct 26 00:38:26 user nova-compute[75165]:         <nova:swap>0</nova:swap>
Oct 26 00:38:26 user nova-compute[75165]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 00:38:26 user nova-compute[75165]:         <nova:vcpus>1</nova:vcpus>
Oct 26 00:38:26 user nova-compute[75165]:       </nova:flavor>
Oct 26 00:38:26 user nova-compute[75165]:       <nova:owner>
Oct 26 00:38:26 user nova-compute[75165]:         <nova:user uuid="a8b04771d6df477ebd9015c46345afc5">tempest-TestStampPattern-153617260-project-member</nova:user>
Oct 26 00:38:26 user nova-compute[75165]:         <nova:project uuid="e11255eee7bb4b13962634a1cd13d186">tempest-TestStampPattern-153617260</nova:project>
Oct 26 00:38:26 user nova-compute[75165]:       </nova:owner>
Oct 26 00:38:26 user nova-compute[75165]:       <nova:root type="image" uuid="1f5737a7-4490-4f44-971e-42604d4c5eef"/>
Oct 26 00:38:26 user nova-compute[75165]:       <nova:ports>
Oct 26 00:38:26 user nova-compute[75165]:         <nova:port uuid="29185859-2394-4d70-a21d-4a7723e80fcd">
Oct 26 00:38:26 user nova-compute[75165]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 26 00:38:26 user nova-compute[75165]:         </nova:port>
Oct 26 00:38:26 user nova-compute[75165]:       </nova:ports>
Oct 26 00:38:26 user nova-compute[75165]:     </nova:instance>
Oct 26 00:38:26 user nova-compute[75165]:   </metadata>
Oct 26 00:38:26 user nova-compute[75165]:   <sysinfo type="smbios">
Oct 26 00:38:26 user nova-compute[75165]:     <system>
Oct 26 00:38:26 user nova-compute[75165]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 00:38:26 user nova-compute[75165]:       <entry name="product">OpenStack Nova</entry>
Oct 26 00:38:26 user nova-compute[75165]:       <entry name="version">0.0.0</entry>
Oct 26 00:38:26 user nova-compute[75165]:       <entry name="serial">65b637f1-baea-4e1c-8b25-e943125eed32</entry>
Oct 26 00:38:26 user nova-compute[75165]:       <entry name="uuid">65b637f1-baea-4e1c-8b25-e943125eed32</entry>
Oct 26 00:38:26 user nova-compute[75165]:       <entry name="family">Virtual Machine</entry>
Oct 26 00:38:26 user nova-compute[75165]:     </system>
Oct 26 00:38:26 user nova-compute[75165]:   </sysinfo>
Oct 26 00:38:26 user nova-compute[75165]:   <os>
Oct 26 00:38:26 user nova-compute[75165]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 00:38:26 user nova-compute[75165]:     <boot dev="hd"/>
Oct 26 00:38:26 user nova-compute[75165]:     <smbios mode="sysinfo"/>
Oct 26 00:38:26 user nova-compute[75165]:   </os>
Oct 26 00:38:26 user nova-compute[75165]:   <features>
Oct 26 00:38:26 user nova-compute[75165]:     <acpi/>
Oct 26 00:38:26 user nova-compute[75165]:     <apic/>
Oct 26 00:38:26 user nova-compute[75165]:     <vmcoreinfo/>
Oct 26 00:38:26 user nova-compute[75165]:   </features>
Oct 26 00:38:26 user nova-compute[75165]:   <clock offset="utc">
Oct 26 00:38:26 user nova-compute[75165]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 00:38:26 user nova-compute[75165]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 00:38:26 user nova-compute[75165]:     <timer name="hpet" present="no"/>
Oct 26 00:38:26 user nova-compute[75165]:   </clock>
Oct 26 00:38:26 user nova-compute[75165]:   <cpu mode="custom" match="exact">
Oct 26 00:38:26 user nova-compute[75165]:     <model>Nehalem</model>
Oct 26 00:38:26 user nova-compute[75165]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 00:38:26 user nova-compute[75165]:   </cpu>
Oct 26 00:38:26 user nova-compute[75165]:   <devices>
Oct 26 00:38:26 user nova-compute[75165]:     <disk type="file" device="disk">
Oct 26 00:38:26 user nova-compute[75165]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 00:38:26 user nova-compute[75165]:       <source file="/opt/stack/data/nova/instances/65b637f1-baea-4e1c-8b25-e943125eed32/disk"/>
Oct 26 00:38:26 user nova-compute[75165]:       <target dev="vda" bus="virtio"/>
Oct 26 00:38:26 user nova-compute[75165]:     </disk>
Oct 26 00:38:26 user nova-compute[75165]:     <interface type="ethernet">
Oct 26 00:38:26 user nova-compute[75165]:       <mac address="fa:16:3e:0f:8c:52"/>
Oct 26 00:38:26 user nova-compute[75165]:       <model type="virtio"/>
Oct 26 00:38:26 user nova-compute[75165]:       <mtu size="1442"/>
Oct 26 00:38:26 user nova-compute[75165]:       <target dev="tap29185859-23"/>
Oct 26 00:38:26 user nova-compute[75165]:     </interface>
Oct 26 00:38:26 user nova-compute[75165]:     <serial type="pty">
Oct 26 00:38:26 user nova-compute[75165]:       <log file="/opt/stack/data/nova/instances/65b637f1-baea-4e1c-8b25-e943125eed32/console.log" append="off"/>
Oct 26 00:38:26 user nova-compute[75165]:     </serial>
Oct 26 00:38:26 user nova-compute[75165]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 00:38:26 user nova-compute[75165]:     <video>
Oct 26 00:38:26 user nova-compute[75165]:       <model type="virtio"/>
Oct 26 00:38:26 user nova-compute[75165]:     </video>
Oct 26 00:38:26 user nova-compute[75165]:     <rng model="virtio">
Oct 26 00:38:26 user nova-compute[75165]:       <backend model="random">/dev/urandom</backend>
Oct 26 00:38:26 user nova-compute[75165]:     </rng>
Oct 26 00:38:26 user nova-compute[75165]:     <controller type="usb" index="0" model="none"/>
Oct 26 00:38:26 user nova-compute[75165]:     <memballoon model="virtio">
Oct 26 00:38:26 user nova-compute[75165]:       <stats period="10"/>
Oct 26 00:38:26 user nova-compute[75165]:     </memballoon>
Oct 26 00:38:26 user nova-compute[75165]:   </devices>
Oct 26 00:38:26 user nova-compute[75165]: </domain>
Oct 26 00:38:26 user nova-compute[75165]:  {{(pid=75165) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 00:38:26 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-fc3669fb-458d-403d-a72c-4c49e4842a5e tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:38:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1255877134',display_name='tempest-TestStampPattern-server-1255877134',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1255877134',id=42,image_ref='1f5737a7-4490-4f44-971e-42604d4c5eef',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGm2My4nRv1TQMRxx0ZQGbSskYL8JiBedzBd6yh8xGYOqpiWk+KOkgfodgvUeL5VIyIOd6LANvVscgBF9awfoT7/2vctuNc54C96HHUt5A78B63ZjhSiwIVLzywUgmpbdw==',key_name='tempest-TestStampPattern-1939697091',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e11255eee7bb4b13962634a1cd13d186',ramdisk_id='',reservation_id='r-4jaje88m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='6ae9fe6f-eb17-44f5-89e4-fff5e3451336',image_min_disk='1',image_min_ram='0',image_owner_id='e11255eee7bb4b13962634a1cd13d186',image_owner_project_name='tempest-TestStampPattern-153617260',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-153617260-project-member',image_user_id='a8b04771d6df477ebd9015c46345afc5',network_allocated='True',owner_project_name='tempest-TestStampPattern-153617260',owner_user_name='tempest-TestStampPattern-153617260-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T00:38:24Z,user_data=None,user_id='a8b04771d6df477ebd9015c46345afc5',uuid=65b637f1-baea-4e1c-8b25-e943125eed32,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "29185859-2394-4d70-a21d-4a7723e80fcd", "address": "fa:16:3e:0f:8c:52", "network": {"id": "03d2b5cd-b214-4767-a406-098bd6857327", "bridge": "br-int", "label": "tempest-TestStampPattern-968415108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e11255eee7bb4b13962634a1cd13d186", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29185859-23", "ovs_interfaceid": "29185859-2394-4d70-a21d-4a7723e80fcd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 00:38:26 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-fc3669fb-458d-403d-a72c-4c49e4842a5e tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Converting VIF {"id": "29185859-2394-4d70-a21d-4a7723e80fcd", "address": "fa:16:3e:0f:8c:52", "network": {"id": "03d2b5cd-b214-4767-a406-098bd6857327", "bridge": "br-int", "label": "tempest-TestStampPattern-968415108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e11255eee7bb4b13962634a1cd13d186", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29185859-23", "ovs_interfaceid": "29185859-2394-4d70-a21d-4a7723e80fcd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:38:26 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-fc3669fb-458d-403d-a72c-4c49e4842a5e tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:8c:52,bridge_name='br-int',has_traffic_filtering=True,id=29185859-2394-4d70-a21d-4a7723e80fcd,network=Network(03d2b5cd-b214-4767-a406-098bd6857327),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29185859-23') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:38:26 user nova-compute[75165]: DEBUG os_vif [None req-fc3669fb-458d-403d-a72c-4c49e4842a5e tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:8c:52,bridge_name='br-int',has_traffic_filtering=True,id=29185859-2394-4d70-a21d-4a7723e80fcd,network=Network(03d2b5cd-b214-4767-a406-098bd6857327),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29185859-23') {{(pid=75165) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 00:38:26 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:38:26 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:38:26 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 00:38:26 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:38:26 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bf4dfc0b-dce8-569e-82af-1c3479485479', '_type': 'linux-noop'}}, row=False) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:38:26 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:38:26 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:38:26 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:38:26 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap29185859-23, may_exist=True, interface_attrs={}) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:38:26 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap29185859-23, col_values=(('qos', UUID('40143ae0-5e24-48c5-860b-3a12b5d0e048')),), if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:38:26 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap29185859-23, col_values=(('external_ids', {'iface-id': '29185859-2394-4d70-a21d-4a7723e80fcd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0f:8c:52', 'vm-uuid': '65b637f1-baea-4e1c-8b25-e943125eed32'}),), if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:38:26 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:38:26 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:38:26 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:38:26 user nova-compute[75165]: INFO os_vif [None req-fc3669fb-458d-403d-a72c-4c49e4842a5e tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:8c:52,bridge_name='br-int',has_traffic_filtering=True,id=29185859-2394-4d70-a21d-4a7723e80fcd,network=Network(03d2b5cd-b214-4767-a406-098bd6857327),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29185859-23')
Oct 26 00:38:27 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-fc3669fb-458d-403d-a72c-4c49e4842a5e tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] No BDM found with device name vda, not building metadata. {{(pid=75165) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 00:38:27 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-fc3669fb-458d-403d-a72c-4c49e4842a5e tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] No VIF found with MAC fa:16:3e:0f:8c:52, not building metadata {{(pid=75165) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 00:38:27 user nova-compute[75165]: DEBUG nova.network.neutron [req-77f6c13a-af12-4897-bf6a-a452e480613e req-583bae5b-153d-4dd2-ad7a-bee346aa3b45 service nova] [instance: 65b637f1-baea-4e1c-8b25-e943125eed32] Updated VIF entry in instance network info cache for port 29185859-2394-4d70-a21d-4a7723e80fcd. {{(pid=75165) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 00:38:27 user nova-compute[75165]: DEBUG nova.network.neutron [req-77f6c13a-af12-4897-bf6a-a452e480613e req-583bae5b-153d-4dd2-ad7a-bee346aa3b45 service nova] [instance: 65b637f1-baea-4e1c-8b25-e943125eed32] Updating instance_info_cache with network_info: [{"id": "29185859-2394-4d70-a21d-4a7723e80fcd", "address": "fa:16:3e:0f:8c:52", "network": {"id": "03d2b5cd-b214-4767-a406-098bd6857327", "bridge": "br-int", "label": "tempest-TestStampPattern-968415108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e11255eee7bb4b13962634a1cd13d186", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29185859-23", "ovs_interfaceid": "29185859-2394-4d70-a21d-4a7723e80fcd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:38:27 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-77f6c13a-af12-4897-bf6a-a452e480613e req-583bae5b-153d-4dd2-ad7a-bee346aa3b45 service nova] Releasing lock "refresh_cache-65b637f1-baea-4e1c-8b25-e943125eed32" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:38:27 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:38:27 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:38:27 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:38:28 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:38:28 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:38:28 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:38:28 user nova-compute[75165]: DEBUG nova.compute.manager [req-61d92c39-7244-4108-b433-fd4acda717d9 req-bc9a0e0c-f21b-4a01-b2c4-563290ac748a service nova] [instance: 65b637f1-baea-4e1c-8b25-e943125eed32] Received event network-vif-plugged-29185859-2394-4d70-a21d-4a7723e80fcd {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:38:28 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-61d92c39-7244-4108-b433-fd4acda717d9 req-bc9a0e0c-f21b-4a01-b2c4-563290ac748a service nova] Acquiring lock "65b637f1-baea-4e1c-8b25-e943125eed32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:38:28 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-61d92c39-7244-4108-b433-fd4acda717d9 req-bc9a0e0c-f21b-4a01-b2c4-563290ac748a service nova] Lock "65b637f1-baea-4e1c-8b25-e943125eed32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:38:28 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-61d92c39-7244-4108-b433-fd4acda717d9 req-bc9a0e0c-f21b-4a01-b2c4-563290ac748a service nova] Lock "65b637f1-baea-4e1c-8b25-e943125eed32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:38:28 user nova-compute[75165]: DEBUG nova.compute.manager [req-61d92c39-7244-4108-b433-fd4acda717d9 req-bc9a0e0c-f21b-4a01-b2c4-563290ac748a service nova] [instance: 65b637f1-baea-4e1c-8b25-e943125eed32] No waiting events found dispatching network-vif-plugged-29185859-2394-4d70-a21d-4a7723e80fcd {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:38:28 user nova-compute[75165]: WARNING nova.compute.manager [req-61d92c39-7244-4108-b433-fd4acda717d9 req-bc9a0e0c-f21b-4a01-b2c4-563290ac748a service nova] [instance: 65b637f1-baea-4e1c-8b25-e943125eed32] Received unexpected event network-vif-plugged-29185859-2394-4d70-a21d-4a7723e80fcd for instance with vm_state building and task_state spawning.
Oct 26 00:38:28 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:38:28 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:38:28 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:38:28 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Starting heal instance info cache {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 00:38:28 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "refresh_cache-7e534595-7eaf-49f4-b457-9f37bc59012b" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:38:28 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquired lock "refresh_cache-7e534595-7eaf-49f4-b457-9f37bc59012b" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:38:28 user nova-compute[75165]: DEBUG nova.network.neutron [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: 7e534595-7eaf-49f4-b457-9f37bc59012b] Forcefully refreshing network info cache for instance {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 00:38:29 user nova-compute[75165]: DEBUG nova.network.neutron [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: 7e534595-7eaf-49f4-b457-9f37bc59012b] Updating instance_info_cache with network_info: [{"id": "d4d7b894-8aba-454c-b803-ec2bf8b28f06", "address": "fa:16:3e:60:42:1c", "network": {"id": "1801db1c-315e-4bdf-b73b-132a38bf41b8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1254756052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62572ce8ae524b55950532fd89729b71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4d7b894-8a", "ovs_interfaceid": "d4d7b894-8aba-454c-b803-ec2bf8b28f06", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:38:29 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Releasing lock "refresh_cache-7e534595-7eaf-49f4-b457-9f37bc59012b" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:38:29 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: 7e534595-7eaf-49f4-b457-9f37bc59012b] Updated the network info_cache for instance {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 00:38:29 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:38:29 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:38:29 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:38:29 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:38:29 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:38:29 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75165) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 00:38:29 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e534595-7eaf-49f4-b457-9f37bc59012b/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:38:30 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e534595-7eaf-49f4-b457-9f37bc59012b/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:38:30 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e534595-7eaf-49f4-b457-9f37bc59012b/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:38:30 user nova-compute[75165]: DEBUG nova.compute.manager [None req-fc3669fb-458d-403d-a72c-4c49e4842a5e tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] [instance: 65b637f1-baea-4e1c-8b25-e943125eed32] Instance event wait completed in 0 seconds for  {{(pid=75165) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 00:38:30 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-fc3669fb-458d-403d-a72c-4c49e4842a5e tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] [instance: 65b637f1-baea-4e1c-8b25-e943125eed32] Guest created on hypervisor {{(pid=75165) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 00:38:30 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: 65b637f1-baea-4e1c-8b25-e943125eed32] Instance spawned successfully.
Oct 26 00:38:30 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-fc3669fb-458d-403d-a72c-4c49e4842a5e tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] [instance: 65b637f1-baea-4e1c-8b25-e943125eed32] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 00:38:30 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-fc3669fb-458d-403d-a72c-4c49e4842a5e tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] [instance: 65b637f1-baea-4e1c-8b25-e943125eed32] Found default for hw_input_bus of None {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:38:30 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-fc3669fb-458d-403d-a72c-4c49e4842a5e tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] [instance: 65b637f1-baea-4e1c-8b25-e943125eed32] Found default for hw_pointer_model of None {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:38:30 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e534595-7eaf-49f4-b457-9f37bc59012b/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:38:30 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75165) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 00:38:30 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b637f1-baea-4e1c-8b25-e943125eed32/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:38:30 user nova-compute[75165]: INFO nova.compute.manager [None req-fc3669fb-458d-403d-a72c-4c49e4842a5e tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] [instance: 65b637f1-baea-4e1c-8b25-e943125eed32] Took 6.46 seconds to spawn the instance on the hypervisor.
Oct 26 00:38:30 user nova-compute[75165]: DEBUG nova.compute.manager [None req-fc3669fb-458d-403d-a72c-4c49e4842a5e tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] [instance: 65b637f1-baea-4e1c-8b25-e943125eed32] Checking state {{(pid=75165) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 00:38:30 user nova-compute[75165]: INFO nova.compute.manager [None req-fc3669fb-458d-403d-a72c-4c49e4842a5e tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] [instance: 65b637f1-baea-4e1c-8b25-e943125eed32] Took 7.06 seconds to build instance.
Oct 26 00:38:30 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-fc3669fb-458d-403d-a72c-4c49e4842a5e tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Lock "65b637f1-baea-4e1c-8b25-e943125eed32" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.156s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:38:30 user nova-compute[75165]: DEBUG nova.compute.manager [req-d8f50731-f5ec-4cbe-acdc-02a91dd19457 req-f277eb38-e308-4da3-b142-ec1eec811ef1 service nova] [instance: 65b637f1-baea-4e1c-8b25-e943125eed32] Received event network-vif-plugged-29185859-2394-4d70-a21d-4a7723e80fcd {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:38:30 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-d8f50731-f5ec-4cbe-acdc-02a91dd19457 req-f277eb38-e308-4da3-b142-ec1eec811ef1 service nova] Acquiring lock "65b637f1-baea-4e1c-8b25-e943125eed32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:38:30 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-d8f50731-f5ec-4cbe-acdc-02a91dd19457 req-f277eb38-e308-4da3-b142-ec1eec811ef1 service nova] Lock "65b637f1-baea-4e1c-8b25-e943125eed32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:38:30 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-d8f50731-f5ec-4cbe-acdc-02a91dd19457 req-f277eb38-e308-4da3-b142-ec1eec811ef1 service nova] Lock "65b637f1-baea-4e1c-8b25-e943125eed32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:38:30 user nova-compute[75165]: DEBUG nova.compute.manager [req-d8f50731-f5ec-4cbe-acdc-02a91dd19457 req-f277eb38-e308-4da3-b142-ec1eec811ef1 service nova] [instance: 65b637f1-baea-4e1c-8b25-e943125eed32] No waiting events found dispatching network-vif-plugged-29185859-2394-4d70-a21d-4a7723e80fcd {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:38:30 user nova-compute[75165]: WARNING nova.compute.manager [req-d8f50731-f5ec-4cbe-acdc-02a91dd19457 req-f277eb38-e308-4da3-b142-ec1eec811ef1 service nova] [instance: 65b637f1-baea-4e1c-8b25-e943125eed32] Received unexpected event network-vif-plugged-29185859-2394-4d70-a21d-4a7723e80fcd for instance with vm_state active and task_state None.
Oct 26 00:38:30 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b637f1-baea-4e1c-8b25-e943125eed32/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:38:30 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b637f1-baea-4e1c-8b25-e943125eed32/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:38:30 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b637f1-baea-4e1c-8b25-e943125eed32/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:38:30 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/454ce3d7-a631-418c-a446-b614eb0d6f28/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:38:30 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/454ce3d7-a631-418c-a446-b614eb0d6f28/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:38:30 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/454ce3d7-a631-418c-a446-b614eb0d6f28/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:38:31 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/454ce3d7-a631-418c-a446-b614eb0d6f28/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:38:31 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae9fe6f-eb17-44f5-89e4-fff5e3451336/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:38:31 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae9fe6f-eb17-44f5-89e4-fff5e3451336/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:38:31 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae9fe6f-eb17-44f5-89e4-fff5e3451336/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:38:31 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae9fe6f-eb17-44f5-89e4-fff5e3451336/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:38:31 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:38:31 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:38:31 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Hypervisor/Node resource view: name=user free_ram=8719MB free_disk=24.716331481933594GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75165) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 00:38:31 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:38:31 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:38:31 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:38:31 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:38:32 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 7e534595-7eaf-49f4-b457-9f37bc59012b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:38:32 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 6ae9fe6f-eb17-44f5-89e4-fff5e3451336 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:38:32 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 454ce3d7-a631-418c-a446-b614eb0d6f28 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:38:32 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 65b637f1-baea-4e1c-8b25-e943125eed32 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:38:32 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75165) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 00:38:32 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75165) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 00:38:32 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Refreshing inventories for resource provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 26 00:38:32 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Updating ProviderTree inventory for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 26 00:38:32 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Updating inventory in ProviderTree for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 26 00:38:32 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Refreshing aggregate associations for resource provider 03214fd5-21d1-46ec-b6b0-6449b77ba230, aggregates: None {{(pid=75165) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 26 00:38:32 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Refreshing trait associations for resource provider 03214fd5-21d1-46ec-b6b0-6449b77ba230, traits: COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NODE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_TRUSTED_CERTS,COMPUTE_DEVICE_TAGGING,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO {{(pid=75165) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 26 00:38:32 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:38:32 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:38:32 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Compute_service record updated for user:user {{(pid=75165) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 00:38:32 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.560s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:38:35 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:38:36 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:38:36 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:38:36 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75165) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 00:38:36 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75165) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 00:38:36 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75165) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 00:38:36 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:38:39 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:38:39 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75165) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 26 00:38:41 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:38:41 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:38:41 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75165) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 00:38:41 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75165) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 00:38:41 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75165) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 00:38:41 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:38:42 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:38:43 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:38:46 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:38:46 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Cleaning up deleted instances {{(pid=75165) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 26 00:38:46 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] There are 0 instances to clean {{(pid=75165) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 26 00:38:46 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:38:46 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:38:49 user nova-compute[75165]: DEBUG nova.compute.manager [req-643fe3a5-5f67-4e19-9a31-f831b44ac697 req-9e07bd83-50c7-4f21-b663-ccdb22dabe44 service nova] [instance: 454ce3d7-a631-418c-a446-b614eb0d6f28] Received event network-changed-53bac58f-e414-486a-8efc-4dbfb9ef8209 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:38:49 user nova-compute[75165]: DEBUG nova.compute.manager [req-643fe3a5-5f67-4e19-9a31-f831b44ac697 req-9e07bd83-50c7-4f21-b663-ccdb22dabe44 service nova] [instance: 454ce3d7-a631-418c-a446-b614eb0d6f28] Refreshing instance network info cache due to event network-changed-53bac58f-e414-486a-8efc-4dbfb9ef8209. {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 00:38:49 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-643fe3a5-5f67-4e19-9a31-f831b44ac697 req-9e07bd83-50c7-4f21-b663-ccdb22dabe44 service nova] Acquiring lock "refresh_cache-454ce3d7-a631-418c-a446-b614eb0d6f28" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:38:49 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-643fe3a5-5f67-4e19-9a31-f831b44ac697 req-9e07bd83-50c7-4f21-b663-ccdb22dabe44 service nova] Acquired lock "refresh_cache-454ce3d7-a631-418c-a446-b614eb0d6f28" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:38:49 user nova-compute[75165]: DEBUG nova.network.neutron [req-643fe3a5-5f67-4e19-9a31-f831b44ac697 req-9e07bd83-50c7-4f21-b663-ccdb22dabe44 service nova] [instance: 454ce3d7-a631-418c-a446-b614eb0d6f28] Refreshing network info cache for port 53bac58f-e414-486a-8efc-4dbfb9ef8209 {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 00:38:49 user nova-compute[75165]: DEBUG nova.network.neutron [req-643fe3a5-5f67-4e19-9a31-f831b44ac697 req-9e07bd83-50c7-4f21-b663-ccdb22dabe44 service nova] [instance: 454ce3d7-a631-418c-a446-b614eb0d6f28] Updated VIF entry in instance network info cache for port 53bac58f-e414-486a-8efc-4dbfb9ef8209. {{(pid=75165) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 00:38:49 user nova-compute[75165]: DEBUG nova.network.neutron [req-643fe3a5-5f67-4e19-9a31-f831b44ac697 req-9e07bd83-50c7-4f21-b663-ccdb22dabe44 service nova] [instance: 454ce3d7-a631-418c-a446-b614eb0d6f28] Updating instance_info_cache with network_info: [{"id": "53bac58f-e414-486a-8efc-4dbfb9ef8209", "address": "fa:16:3e:7e:24:b6", "network": {"id": "1801db1c-315e-4bdf-b73b-132a38bf41b8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1254756052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62572ce8ae524b55950532fd89729b71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53bac58f-e4", "ovs_interfaceid": "53bac58f-e414-486a-8efc-4dbfb9ef8209", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:38:49 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-643fe3a5-5f67-4e19-9a31-f831b44ac697 req-9e07bd83-50c7-4f21-b663-ccdb22dabe44 service nova] Releasing lock "refresh_cache-454ce3d7-a631-418c-a446-b614eb0d6f28" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:38:50 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-d3e459b4-e033-4267-9676-8c7e19bab433 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Acquiring lock "454ce3d7-a631-418c-a446-b614eb0d6f28" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:38:50 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-d3e459b4-e033-4267-9676-8c7e19bab433 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Lock "454ce3d7-a631-418c-a446-b614eb0d6f28" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:38:50 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-d3e459b4-e033-4267-9676-8c7e19bab433 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Acquiring lock "454ce3d7-a631-418c-a446-b614eb0d6f28-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:38:50 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-d3e459b4-e033-4267-9676-8c7e19bab433 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Lock "454ce3d7-a631-418c-a446-b614eb0d6f28-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:38:50 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-d3e459b4-e033-4267-9676-8c7e19bab433 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Lock "454ce3d7-a631-418c-a446-b614eb0d6f28-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:38:50 user nova-compute[75165]: INFO nova.compute.manager [None req-d3e459b4-e033-4267-9676-8c7e19bab433 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 454ce3d7-a631-418c-a446-b614eb0d6f28] Terminating instance
Oct 26 00:38:50 user nova-compute[75165]: DEBUG nova.compute.manager [None req-d3e459b4-e033-4267-9676-8c7e19bab433 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 454ce3d7-a631-418c-a446-b614eb0d6f28] Start destroying the instance on the hypervisor. {{(pid=75165) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 00:38:50 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:38:50 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:38:50 user nova-compute[75165]: DEBUG nova.compute.manager [req-998a2491-2bc8-47c0-822e-1e9ed2467f8b req-44ac64c9-6bbd-4147-afd8-a4a5d953bcd7 service nova] [instance: 454ce3d7-a631-418c-a446-b614eb0d6f28] Received event network-vif-unplugged-53bac58f-e414-486a-8efc-4dbfb9ef8209 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:38:50 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-998a2491-2bc8-47c0-822e-1e9ed2467f8b req-44ac64c9-6bbd-4147-afd8-a4a5d953bcd7 service nova] Acquiring lock "454ce3d7-a631-418c-a446-b614eb0d6f28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:38:50 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-998a2491-2bc8-47c0-822e-1e9ed2467f8b req-44ac64c9-6bbd-4147-afd8-a4a5d953bcd7 service nova] Lock "454ce3d7-a631-418c-a446-b614eb0d6f28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:38:50 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-998a2491-2bc8-47c0-822e-1e9ed2467f8b req-44ac64c9-6bbd-4147-afd8-a4a5d953bcd7 service nova] Lock "454ce3d7-a631-418c-a446-b614eb0d6f28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:38:50 user nova-compute[75165]: DEBUG nova.compute.manager [req-998a2491-2bc8-47c0-822e-1e9ed2467f8b req-44ac64c9-6bbd-4147-afd8-a4a5d953bcd7 service nova] [instance: 454ce3d7-a631-418c-a446-b614eb0d6f28] No waiting events found dispatching network-vif-unplugged-53bac58f-e414-486a-8efc-4dbfb9ef8209 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:38:50 user nova-compute[75165]: DEBUG nova.compute.manager [req-998a2491-2bc8-47c0-822e-1e9ed2467f8b req-44ac64c9-6bbd-4147-afd8-a4a5d953bcd7 service nova] [instance: 454ce3d7-a631-418c-a446-b614eb0d6f28] Received event network-vif-unplugged-53bac58f-e414-486a-8efc-4dbfb9ef8209 for instance with task_state deleting. {{(pid=75165) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 00:38:50 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:38:50 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:38:51 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: 454ce3d7-a631-418c-a446-b614eb0d6f28] Instance destroyed successfully.
Oct 26 00:38:51 user nova-compute[75165]: DEBUG nova.objects.instance [None req-d3e459b4-e033-4267-9676-8c7e19bab433 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Lazy-loading 'resources' on Instance uuid 454ce3d7-a631-418c-a446-b614eb0d6f28 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:38:51 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-d3e459b4-e033-4267-9676-8c7e19bab433 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:36:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1532760107',display_name='tempest-AttachVolumeNegativeTest-server-1532760107',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1532760107',id=41,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHU0AnYILx7xJE9tSNnrFU5mbFm+GNup24EaRmVzf+F7CKgHNoA65vi5uXUOH/GGbnKQacPsNEGV/Ruh5Vt4jg5HVAI/2OeB9Bxr217Ig3pBsIQB5ylc/xwAXNakvXSWbg==',key_name='tempest-keypair-1355587032',keypairs=<?>,launch_index=0,launched_at=2023-10-26T00:37:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='62572ce8ae524b55950532fd89729b71',ramdisk_id='',reservation_id='r-y9446893',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-988376295',owner_user_name='tempest-AttachVolumeNegativeTest-988376295-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T00:37:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='041ebe2732c341129d6813549653cab3',uuid=454ce3d7-a631-418c-a446-b614eb0d6f28,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "53bac58f-e414-486a-8efc-4dbfb9ef8209", "address": "fa:16:3e:7e:24:b6", "network": {"id": "1801db1c-315e-4bdf-b73b-132a38bf41b8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1254756052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62572ce8ae524b55950532fd89729b71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53bac58f-e4", "ovs_interfaceid": "53bac58f-e414-486a-8efc-4dbfb9ef8209", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 00:38:51 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-d3e459b4-e033-4267-9676-8c7e19bab433 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Converting VIF {"id": "53bac58f-e414-486a-8efc-4dbfb9ef8209", "address": "fa:16:3e:7e:24:b6", "network": {"id": "1801db1c-315e-4bdf-b73b-132a38bf41b8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1254756052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62572ce8ae524b55950532fd89729b71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53bac58f-e4", "ovs_interfaceid": "53bac58f-e414-486a-8efc-4dbfb9ef8209", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:38:51 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-d3e459b4-e033-4267-9676-8c7e19bab433 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7e:24:b6,bridge_name='br-int',has_traffic_filtering=True,id=53bac58f-e414-486a-8efc-4dbfb9ef8209,network=Network(1801db1c-315e-4bdf-b73b-132a38bf41b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53bac58f-e4') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:38:51 user nova-compute[75165]: DEBUG os_vif [None req-d3e459b4-e033-4267-9676-8c7e19bab433 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7e:24:b6,bridge_name='br-int',has_traffic_filtering=True,id=53bac58f-e414-486a-8efc-4dbfb9ef8209,network=Network(1801db1c-315e-4bdf-b73b-132a38bf41b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53bac58f-e4') {{(pid=75165) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 00:38:51 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:38:51 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap53bac58f-e4, bridge=br-int, if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:38:51 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:38:51 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:38:51 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:38:51 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0f8dbfd0-8bca-4cea-91b5-8b22e4245799) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:38:51 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:38:51 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:38:51 user nova-compute[75165]: INFO os_vif [None req-d3e459b4-e033-4267-9676-8c7e19bab433 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7e:24:b6,bridge_name='br-int',has_traffic_filtering=True,id=53bac58f-e414-486a-8efc-4dbfb9ef8209,network=Network(1801db1c-315e-4bdf-b73b-132a38bf41b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53bac58f-e4')
Oct 26 00:38:51 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-d3e459b4-e033-4267-9676-8c7e19bab433 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 454ce3d7-a631-418c-a446-b614eb0d6f28] Deleting instance files /opt/stack/data/nova/instances/454ce3d7-a631-418c-a446-b614eb0d6f28_del
Oct 26 00:38:51 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-d3e459b4-e033-4267-9676-8c7e19bab433 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 454ce3d7-a631-418c-a446-b614eb0d6f28] Deletion of /opt/stack/data/nova/instances/454ce3d7-a631-418c-a446-b614eb0d6f28_del complete
Oct 26 00:38:51 user nova-compute[75165]: INFO nova.compute.manager [None req-d3e459b4-e033-4267-9676-8c7e19bab433 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 454ce3d7-a631-418c-a446-b614eb0d6f28] Took 0.71 seconds to destroy the instance on the hypervisor.
Oct 26 00:38:51 user nova-compute[75165]: DEBUG oslo.service.loopingcall [None req-d3e459b4-e033-4267-9676-8c7e19bab433 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75165) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 00:38:51 user nova-compute[75165]: DEBUG nova.compute.manager [-] [instance: 454ce3d7-a631-418c-a446-b614eb0d6f28] Deallocating network for instance {{(pid=75165) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 00:38:51 user nova-compute[75165]: DEBUG nova.network.neutron [-] [instance: 454ce3d7-a631-418c-a446-b614eb0d6f28] deallocate_for_instance() {{(pid=75165) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 00:38:51 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:38:52 user nova-compute[75165]: DEBUG nova.network.neutron [-] [instance: 454ce3d7-a631-418c-a446-b614eb0d6f28] Updating instance_info_cache with network_info: [] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:38:52 user nova-compute[75165]: INFO nova.compute.manager [-] [instance: 454ce3d7-a631-418c-a446-b614eb0d6f28] Took 0.86 seconds to deallocate network for instance.
Oct 26 00:38:52 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-d3e459b4-e033-4267-9676-8c7e19bab433 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:38:52 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-d3e459b4-e033-4267-9676-8c7e19bab433 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:38:52 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-d3e459b4-e033-4267-9676-8c7e19bab433 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:38:52 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-d3e459b4-e033-4267-9676-8c7e19bab433 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:38:52 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-d3e459b4-e033-4267-9676-8c7e19bab433 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.206s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:38:52 user nova-compute[75165]: INFO nova.scheduler.client.report [None req-d3e459b4-e033-4267-9676-8c7e19bab433 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Deleted allocations for instance 454ce3d7-a631-418c-a446-b614eb0d6f28
Oct 26 00:38:52 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-d3e459b4-e033-4267-9676-8c7e19bab433 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Lock "454ce3d7-a631-418c-a446-b614eb0d6f28" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.968s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:38:52 user nova-compute[75165]: DEBUG nova.compute.manager [req-5528c129-34f7-4cff-8a87-536d21421b1a req-5aa07bd9-a214-42fa-8d1d-cd8fa1191920 service nova] [instance: 454ce3d7-a631-418c-a446-b614eb0d6f28] Received event network-vif-plugged-53bac58f-e414-486a-8efc-4dbfb9ef8209 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:38:52 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-5528c129-34f7-4cff-8a87-536d21421b1a req-5aa07bd9-a214-42fa-8d1d-cd8fa1191920 service nova] Acquiring lock "454ce3d7-a631-418c-a446-b614eb0d6f28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:38:52 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-5528c129-34f7-4cff-8a87-536d21421b1a req-5aa07bd9-a214-42fa-8d1d-cd8fa1191920 service nova] Lock "454ce3d7-a631-418c-a446-b614eb0d6f28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:38:52 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-5528c129-34f7-4cff-8a87-536d21421b1a req-5aa07bd9-a214-42fa-8d1d-cd8fa1191920 service nova] Lock "454ce3d7-a631-418c-a446-b614eb0d6f28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:38:52 user nova-compute[75165]: DEBUG nova.compute.manager [req-5528c129-34f7-4cff-8a87-536d21421b1a req-5aa07bd9-a214-42fa-8d1d-cd8fa1191920 service nova] [instance: 454ce3d7-a631-418c-a446-b614eb0d6f28] No waiting events found dispatching network-vif-plugged-53bac58f-e414-486a-8efc-4dbfb9ef8209 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:38:52 user nova-compute[75165]: WARNING nova.compute.manager [req-5528c129-34f7-4cff-8a87-536d21421b1a req-5aa07bd9-a214-42fa-8d1d-cd8fa1191920 service nova] [instance: 454ce3d7-a631-418c-a446-b614eb0d6f28] Received unexpected event network-vif-plugged-53bac58f-e414-486a-8efc-4dbfb9ef8209 for instance with vm_state deleted and task_state None.
Oct 26 00:38:52 user nova-compute[75165]: DEBUG nova.compute.manager [req-5528c129-34f7-4cff-8a87-536d21421b1a req-5aa07bd9-a214-42fa-8d1d-cd8fa1191920 service nova] [instance: 454ce3d7-a631-418c-a446-b614eb0d6f28] Received event network-vif-deleted-53bac58f-e414-486a-8efc-4dbfb9ef8209 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:38:56 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:38:56 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:39:01 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:39:01 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:39:06 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:39:11 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:39:11 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-5d469fd3-9806-46cb-aac6-8c3c02c75788 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Acquiring lock "539bedc3-f788-4d5e-993b-3b168d027a57" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:39:11 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-5d469fd3-9806-46cb-aac6-8c3c02c75788 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Lock "539bedc3-f788-4d5e-993b-3b168d027a57" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:39:11 user nova-compute[75165]: DEBUG nova.compute.manager [None req-5d469fd3-9806-46cb-aac6-8c3c02c75788 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 539bedc3-f788-4d5e-993b-3b168d027a57] Starting instance... {{(pid=75165) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 00:39:11 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-5d469fd3-9806-46cb-aac6-8c3c02c75788 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:39:11 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-5d469fd3-9806-46cb-aac6-8c3c02c75788 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:39:11 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-5d469fd3-9806-46cb-aac6-8c3c02c75788 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75165) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 00:39:11 user nova-compute[75165]: INFO nova.compute.claims [None req-5d469fd3-9806-46cb-aac6-8c3c02c75788 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 539bedc3-f788-4d5e-993b-3b168d027a57] Claim successful on node user
Oct 26 00:39:11 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-5d469fd3-9806-46cb-aac6-8c3c02c75788 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:39:11 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-5d469fd3-9806-46cb-aac6-8c3c02c75788 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:39:11 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-5d469fd3-9806-46cb-aac6-8c3c02c75788 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.282s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:39:11 user nova-compute[75165]: DEBUG nova.compute.manager [None req-5d469fd3-9806-46cb-aac6-8c3c02c75788 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 539bedc3-f788-4d5e-993b-3b168d027a57] Start building networks asynchronously for instance. {{(pid=75165) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 00:39:11 user nova-compute[75165]: DEBUG nova.compute.manager [None req-5d469fd3-9806-46cb-aac6-8c3c02c75788 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 539bedc3-f788-4d5e-993b-3b168d027a57] Allocating IP information in the background. {{(pid=75165) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 00:39:11 user nova-compute[75165]: DEBUG nova.network.neutron [None req-5d469fd3-9806-46cb-aac6-8c3c02c75788 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 539bedc3-f788-4d5e-993b-3b168d027a57] allocate_for_instance() {{(pid=75165) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 00:39:11 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-5d469fd3-9806-46cb-aac6-8c3c02c75788 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 539bedc3-f788-4d5e-993b-3b168d027a57] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 00:39:11 user nova-compute[75165]: DEBUG nova.compute.manager [None req-5d469fd3-9806-46cb-aac6-8c3c02c75788 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 539bedc3-f788-4d5e-993b-3b168d027a57] Start building block device mappings for instance. {{(pid=75165) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 00:39:12 user nova-compute[75165]: DEBUG nova.policy [None req-5d469fd3-9806-46cb-aac6-8c3c02c75788 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ae836eab78514cf3894e5e11240ff374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1051405ca054c4bb051fb842a5fb5a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75165) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 00:39:12 user nova-compute[75165]: INFO nova.virt.block_device [None req-5d469fd3-9806-46cb-aac6-8c3c02c75788 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 539bedc3-f788-4d5e-993b-3b168d027a57] Booting with volume 67c880f5-c46a-4e45-b73a-a052fca3638c at /dev/vda
Oct 26 00:39:12 user nova-compute[75165]: DEBUG os_brick.utils [None req-5d469fd3-9806-46cb-aac6-8c3c02c75788 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:39:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:39:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:39:12 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[2616573e-72b8-401a-b04b-9df310c0e5ec]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa94814ccb35\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:39:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:39:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:39:12 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[75465147-3f43-4413-a03b-48da22565541]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:39:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:39:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:39:12 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c0bdf2a-f5ff-480a-9cb6-a77f2747297d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:39:12 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f860c98-e0d1-4518-be04-538e9a59f450]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:39:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-5d469fd3-9806-46cb-aac6-8c3c02c75788 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Running cmd (subprocess): nvme version {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:39:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-5d469fd3-9806-46cb-aac6-8c3c02c75788 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] 'nvme version' failed. Not Retrying. {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 00:39:12 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5d469fd3-9806-46cb-aac6-8c3c02c75788 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] nvme not present on system {{(pid=75165) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 00:39:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:39:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 00:39:12 user nova-compute[75165]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 00:39:12 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4a00039-0ebc-41e3-a692-e02cef8c8f28]: (4, '') {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:39:12 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-5d469fd3-9806-46cb-aac6-8c3c02c75788 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75165) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 00:39:12 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-5d469fd3-9806-46cb-aac6-8c3c02c75788 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75165) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 00:39:12 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-5d469fd3-9806-46cb-aac6-8c3c02c75788 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] LIGHTOS: no hostnqn found. {{(pid=75165) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 00:39:12 user nova-compute[75165]: DEBUG os_brick.utils [None req-5d469fd3-9806-46cb-aac6-8c3c02c75788 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa94814ccb35', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:39:12 user nova-compute[75165]: DEBUG nova.virt.block_device [None req-5d469fd3-9806-46cb-aac6-8c3c02c75788 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 539bedc3-f788-4d5e-993b-3b168d027a57] Updating existing volume attachment record: 34c25cf1-8346-494f-a6a6-7f989eadcd69 {{(pid=75165) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 00:39:12 user nova-compute[75165]: DEBUG nova.network.neutron [None req-5d469fd3-9806-46cb-aac6-8c3c02c75788 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 539bedc3-f788-4d5e-993b-3b168d027a57] Successfully created port: cf882314-eb1e-4555-b87d-4e010947f66f {{(pid=75165) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 00:39:13 user nova-compute[75165]: DEBUG nova.network.neutron [None req-5d469fd3-9806-46cb-aac6-8c3c02c75788 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 539bedc3-f788-4d5e-993b-3b168d027a57] Successfully updated port: cf882314-eb1e-4555-b87d-4e010947f66f {{(pid=75165) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 00:39:13 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-5d469fd3-9806-46cb-aac6-8c3c02c75788 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Acquiring lock "refresh_cache-539bedc3-f788-4d5e-993b-3b168d027a57" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:39:13 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-5d469fd3-9806-46cb-aac6-8c3c02c75788 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Acquired lock "refresh_cache-539bedc3-f788-4d5e-993b-3b168d027a57" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:39:13 user nova-compute[75165]: DEBUG nova.network.neutron [None req-5d469fd3-9806-46cb-aac6-8c3c02c75788 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 539bedc3-f788-4d5e-993b-3b168d027a57] Building network info cache for instance {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 00:39:13 user nova-compute[75165]: DEBUG nova.compute.manager [req-7b984eff-2a5a-44e9-a8be-ea2760a8af58 req-f72de380-2f93-4ac3-a7d2-b9bdf688427c service nova] [instance: 539bedc3-f788-4d5e-993b-3b168d027a57] Received event network-changed-cf882314-eb1e-4555-b87d-4e010947f66f {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:39:13 user nova-compute[75165]: DEBUG nova.compute.manager [req-7b984eff-2a5a-44e9-a8be-ea2760a8af58 req-f72de380-2f93-4ac3-a7d2-b9bdf688427c service nova] [instance: 539bedc3-f788-4d5e-993b-3b168d027a57] Refreshing instance network info cache due to event network-changed-cf882314-eb1e-4555-b87d-4e010947f66f. {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 00:39:13 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-7b984eff-2a5a-44e9-a8be-ea2760a8af58 req-f72de380-2f93-4ac3-a7d2-b9bdf688427c service nova] Acquiring lock "refresh_cache-539bedc3-f788-4d5e-993b-3b168d027a57" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:39:13 user nova-compute[75165]: DEBUG nova.network.neutron [None req-5d469fd3-9806-46cb-aac6-8c3c02c75788 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 539bedc3-f788-4d5e-993b-3b168d027a57] Instance cache missing network info. {{(pid=75165) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 00:39:13 user nova-compute[75165]: DEBUG nova.network.neutron [None req-5d469fd3-9806-46cb-aac6-8c3c02c75788 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 539bedc3-f788-4d5e-993b-3b168d027a57] Updating instance_info_cache with network_info: [{"id": "cf882314-eb1e-4555-b87d-4e010947f66f", "address": "fa:16:3e:dc:7e:ca", "network": {"id": "dc50ae7b-d501-461f-aa0b-542514330ae8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1091857056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1051405ca054c4bb051fb842a5fb5a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf882314-eb", "ovs_interfaceid": "cf882314-eb1e-4555-b87d-4e010947f66f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:39:13 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-5d469fd3-9806-46cb-aac6-8c3c02c75788 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Releasing lock "refresh_cache-539bedc3-f788-4d5e-993b-3b168d027a57" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:39:13 user nova-compute[75165]: DEBUG nova.compute.manager [None req-5d469fd3-9806-46cb-aac6-8c3c02c75788 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 539bedc3-f788-4d5e-993b-3b168d027a57] Instance network_info: |[{"id": "cf882314-eb1e-4555-b87d-4e010947f66f", "address": "fa:16:3e:dc:7e:ca", "network": {"id": "dc50ae7b-d501-461f-aa0b-542514330ae8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1091857056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1051405ca054c4bb051fb842a5fb5a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf882314-eb", "ovs_interfaceid": "cf882314-eb1e-4555-b87d-4e010947f66f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75165) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 00:39:13 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-7b984eff-2a5a-44e9-a8be-ea2760a8af58 req-f72de380-2f93-4ac3-a7d2-b9bdf688427c service nova] Acquired lock "refresh_cache-539bedc3-f788-4d5e-993b-3b168d027a57" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:39:13 user nova-compute[75165]: DEBUG nova.network.neutron [req-7b984eff-2a5a-44e9-a8be-ea2760a8af58 req-f72de380-2f93-4ac3-a7d2-b9bdf688427c service nova] [instance: 539bedc3-f788-4d5e-993b-3b168d027a57] Refreshing network info cache for port cf882314-eb1e-4555-b87d-4e010947f66f {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 00:39:14 user nova-compute[75165]: DEBUG nova.network.neutron [req-7b984eff-2a5a-44e9-a8be-ea2760a8af58 req-f72de380-2f93-4ac3-a7d2-b9bdf688427c service nova] [instance: 539bedc3-f788-4d5e-993b-3b168d027a57] Updated VIF entry in instance network info cache for port cf882314-eb1e-4555-b87d-4e010947f66f. {{(pid=75165) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 00:39:14 user nova-compute[75165]: DEBUG nova.network.neutron [req-7b984eff-2a5a-44e9-a8be-ea2760a8af58 req-f72de380-2f93-4ac3-a7d2-b9bdf688427c service nova] [instance: 539bedc3-f788-4d5e-993b-3b168d027a57] Updating instance_info_cache with network_info: [{"id": "cf882314-eb1e-4555-b87d-4e010947f66f", "address": "fa:16:3e:dc:7e:ca", "network": {"id": "dc50ae7b-d501-461f-aa0b-542514330ae8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1091857056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1051405ca054c4bb051fb842a5fb5a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf882314-eb", "ovs_interfaceid": "cf882314-eb1e-4555-b87d-4e010947f66f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:39:14 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-7b984eff-2a5a-44e9-a8be-ea2760a8af58 req-f72de380-2f93-4ac3-a7d2-b9bdf688427c service nova] Releasing lock "refresh_cache-539bedc3-f788-4d5e-993b-3b168d027a57" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:39:16 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:39:20 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:39:20 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75165) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 00:39:21 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:39:24 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:39:24 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:39:26 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:39:28 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:39:28 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Starting heal instance info cache {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 00:39:28 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "refresh_cache-6ae9fe6f-eb17-44f5-89e4-fff5e3451336" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:39:28 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquired lock "refresh_cache-6ae9fe6f-eb17-44f5-89e4-fff5e3451336" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:39:28 user nova-compute[75165]: DEBUG nova.network.neutron [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: 6ae9fe6f-eb17-44f5-89e4-fff5e3451336] Forcefully refreshing network info cache for instance {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 00:39:29 user nova-compute[75165]: DEBUG nova.network.neutron [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: 6ae9fe6f-eb17-44f5-89e4-fff5e3451336] Updating instance_info_cache with network_info: [{"id": "5057f477-2080-4285-86a0-8f50541c3361", "address": "fa:16:3e:ca:e5:01", "network": {"id": "03d2b5cd-b214-4767-a406-098bd6857327", "bridge": "br-int", "label": "tempest-TestStampPattern-968415108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e11255eee7bb4b13962634a1cd13d186", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5057f477-20", "ovs_interfaceid": "5057f477-2080-4285-86a0-8f50541c3361", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:39:29 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Releasing lock "refresh_cache-6ae9fe6f-eb17-44f5-89e4-fff5e3451336" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:39:29 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: 6ae9fe6f-eb17-44f5-89e4-fff5e3451336] Updated the network info_cache for instance {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 00:39:29 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:39:29 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:39:29 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:39:30 user nova-compute[75165]: DEBUG nova.compute.manager [None req-5d469fd3-9806-46cb-aac6-8c3c02c75788 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 539bedc3-f788-4d5e-993b-3b168d027a57] Start spawning the instance on the hypervisor. {{(pid=75165) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 00:39:30 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-5d469fd3-9806-46cb-aac6-8c3c02c75788 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 539bedc3-f788-4d5e-993b-3b168d027a57] Creating instance directory {{(pid=75165) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 00:39:30 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-5d469fd3-9806-46cb-aac6-8c3c02c75788 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 539bedc3-f788-4d5e-993b-3b168d027a57] Creating image(s)
Oct 26 00:39:30 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-5d469fd3-9806-46cb-aac6-8c3c02c75788 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 539bedc3-f788-4d5e-993b-3b168d027a57] Did not create local disks {{(pid=75165) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 26 00:39:30 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-5d469fd3-9806-46cb-aac6-8c3c02c75788 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 539bedc3-f788-4d5e-993b-3b168d027a57] Ensure instance console log exists: /opt/stack/data/nova/instances/539bedc3-f788-4d5e-993b-3b168d027a57/console.log {{(pid=75165) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 00:39:30 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-5d469fd3-9806-46cb-aac6-8c3c02c75788 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:39:30 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-5d469fd3-9806-46cb-aac6-8c3c02c75788 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:39:30 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-5d469fd3-9806-46cb-aac6-8c3c02c75788 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:39:30 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-5d469fd3-9806-46cb-aac6-8c3c02c75788 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 539bedc3-f788-4d5e-993b-3b168d027a57] Start _get_guest_xml network_info=[{"id": "cf882314-eb1e-4555-b87d-4e010947f66f", "address": "fa:16:3e:dc:7e:ca", "network": {"id": "dc50ae7b-d501-461f-aa0b-542514330ae8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1091857056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1051405ca054c4bb051fb842a5fb5a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf882314-eb", "ovs_interfaceid": "cf882314-eb1e-4555-b87d-4e010947f66f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:67c880f5-c46a-4e45-b73a-a052fca3638c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oNvdpCXD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '539bedc3-f788-4d5e-993b-3b168d027a57', 'attached_at': '', 'detached_at': '', 'volume_id': '67c880f5-c46a-4e45-b73a-a052fca3638c', 'serial': '67c880f5-c46a-4e45-b73a-a052fca3638c'}, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'attachment_id': '34c25cf1-8346-494f-a6a6-7f989eadcd69', 'delete_on_termination': True, 'volume_type': None} {{(pid=75165) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 00:39:30 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-5d469fd3-9806-46cb-aac6-8c3c02c75788 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:39:30 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-5d469fd3-9806-46cb-aac6-8c3c02c75788 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:39:30 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-5d469fd3-9806-46cb-aac6-8c3c02c75788 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75165) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 00:39:30 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-5d469fd3-9806-46cb-aac6-8c3c02c75788 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] CPU controller missing on host. {{(pid=75165) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 00:39:30 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-5d469fd3-9806-46cb-aac6-8c3c02c75788 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75165) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 00:39:30 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-5d469fd3-9806-46cb-aac6-8c3c02c75788 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] CPU controller found on host. {{(pid=75165) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 00:39:30 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-5d469fd3-9806-46cb-aac6-8c3c02c75788 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75165) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 00:39:30 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-5d469fd3-9806-46cb-aac6-8c3c02c75788 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T00:03:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 00:39:30 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-5d469fd3-9806-46cb-aac6-8c3c02c75788 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Flavor limits 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 00:39:30 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-5d469fd3-9806-46cb-aac6-8c3c02c75788 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Image limits 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 00:39:30 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-5d469fd3-9806-46cb-aac6-8c3c02c75788 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Flavor pref 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 00:39:30 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-5d469fd3-9806-46cb-aac6-8c3c02c75788 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Image pref 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 00:39:30 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-5d469fd3-9806-46cb-aac6-8c3c02c75788 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 00:39:30 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-5d469fd3-9806-46cb-aac6-8c3c02c75788 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 00:39:30 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-5d469fd3-9806-46cb-aac6-8c3c02c75788 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75165) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 00:39:30 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-5d469fd3-9806-46cb-aac6-8c3c02c75788 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Got 1 possible topologies {{(pid=75165) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 00:39:30 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-5d469fd3-9806-46cb-aac6-8c3c02c75788 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 00:39:30 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-5d469fd3-9806-46cb-aac6-8c3c02c75788 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 00:39:30 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d469fd3-9806-46cb-aac6-8c3c02c75788 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 539bedc3-f788-4d5e-993b-3b168d027a57] Calling os-brick to attach iSCSI Volume {{(pid=75165) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 00:39:30 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d469fd3-9806-46cb-aac6-8c3c02c75788 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8bf8160e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:67c880f5-c46a-4e45-b73a-a052fca3638c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oNvdpCXD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:39:30 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-5d469fd3-9806-46cb-aac6-8c3c02c75788 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:39:30 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-5d469fd3-9806-46cb-aac6-8c3c02c75788 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:39:30 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-5d469fd3-9806-46cb-aac6-8c3c02c75788 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:39:30 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-5d469fd3-9806-46cb-aac6-8c3c02c75788 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:39:30 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-5d469fd3-9806-46cb-aac6-8c3c02c75788 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:67c880f5-c46a-4e45-b73a-a052fca3638c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:39:30 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-5d469fd3-9806-46cb-aac6-8c3c02c75788 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:67c880f5-c46a-4e45-b73a-a052fca3638c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:39:30 user nova-compute[75165]: INFO os_brick.initiator.connectors.iscsi [None req-5d469fd3-9806-46cb-aac6-8c3c02c75788 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 00:39:30 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67c880f5-c46a-4e45-b73a-a052fca3638c -p 172.16.0.220:3260 {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:39:30 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67c880f5-c46a-4e45-b73a-a052fca3638c -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:39:30 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e304c0a-6beb-4b97-a014-197342408b1c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:39:30 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d469fd3-9806-46cb-aac6-8c3c02c75788 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 00:39:30 user nova-compute[75165]:  {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:39:30 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67c880f5-c46a-4e45-b73a-a052fca3638c -p 172.16.0.220:3260 --interface default --op new {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:39:30 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67c880f5-c46a-4e45-b73a-a052fca3638c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:39:30 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[72d830f9-c8b9-407d-98a3-53cfffa52d51]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:67c880f5-c46a-4e45-b73a-a052fca3638c] added\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:39:30 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d469fd3-9806-46cb-aac6-8c3c02c75788 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:67c880f5-c46a-4e45-b73a-a052fca3638c] added
Oct 26 00:39:30 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:39:30 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67c880f5-c46a-4e45-b73a-a052fca3638c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:39:30 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67c880f5-c46a-4e45-b73a-a052fca3638c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:39:30 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce92879f-5b3c-4d53-a830-aab910ebaae2]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:39:30 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d469fd3-9806-46cb-aac6-8c3c02c75788 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:39:30 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67c880f5-c46a-4e45-b73a-a052fca3638c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:39:30 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67c880f5-c46a-4e45-b73a-a052fca3638c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:39:30 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[f31c51df-7280-49fc-a70f-016658aaa157]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:39:30 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d469fd3-9806-46cb-aac6-8c3c02c75788 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:39:30 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67c880f5-c46a-4e45-b73a-a052fca3638c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oNvdpCXD {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:39:30 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67c880f5-c46a-4e45-b73a-a052fca3638c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oNvdpCXD" returned: 0 in 0.018s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:39:30 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[92d0befd-ccfe-40e3-9dc9-983859e4e43d]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:39:30 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d469fd3-9806-46cb-aac6-8c3c02c75788 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oNvdpCXD'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:39:30 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67c880f5-c46a-4e45-b73a-a052fca3638c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:39:30 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67c880f5-c46a-4e45-b73a-a052fca3638c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:39:30 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bd49d0b-822a-45dc-90c5-47d46205c40e]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:39:30 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d469fd3-9806-46cb-aac6-8c3c02c75788 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:39:30 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:39:30 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:39:30 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[71bb1cc1-e6ba-4412-9de0-d55c346c2d73]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:927d04d0-50f4-459c-8c3c-ed41d757d7ca (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:39:30 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d469fd3-9806-46cb-aac6-8c3c02c75788 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:927d04d0-50f4-459c-8c3c-ed41d757d7ca (non-flash)
Oct 26 00:39:30 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:39:30 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d469fd3-9806-46cb-aac6-8c3c02c75788 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:927d04d0-50f4-459c-8c3c-ed41d757d7ca (non-flash)
Oct 26 00:39:30 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:39:30 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67c880f5-c46a-4e45-b73a-a052fca3638c -p 172.16.0.220:3260 --login {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:39:30 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67c880f5-c46a-4e45-b73a-a052fca3638c -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:39:30 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ab2c7ce-f167-4020-8fe3-b3ab20b60345]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:67c880f5-c46a-4e45-b73a-a052fca3638c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:67c880f5-c46a-4e45-b73a-a052fca3638c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:39:30 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d469fd3-9806-46cb-aac6-8c3c02c75788 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:67c880f5-c46a-4e45-b73a-a052fca3638c, portal: 172.16.0.220,3260]
Oct 26 00:39:30 user nova-compute[75165]: Login to [iface: default, target: iqn.2010-10.org.openstack:67c880f5-c46a-4e45-b73a-a052fca3638c, portal: 172.16.0.220,3260] successful.
Oct 26 00:39:30 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:39:30 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67c880f5-c46a-4e45-b73a-a052fca3638c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:39:30 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67c880f5-c46a-4e45-b73a-a052fca3638c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:39:30 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc22b75d-a4e4-46ed-a4ca-671d96adff60]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:39:30 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d469fd3-9806-46cb-aac6-8c3c02c75788 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:39:30 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:39:30 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:39:30 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[361261b9-3254-4ce3-a601-2880c0fca2b7]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:927d04d0-50f4-459c-8c3c-ed41d757d7ca (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67c880f5-c46a-4e45-b73a-a052fca3638c (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:39:30 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d469fd3-9806-46cb-aac6-8c3c02c75788 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:927d04d0-50f4-459c-8c3c-ed41d757d7ca (non-flash)
Oct 26 00:39:30 user nova-compute[75165]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67c880f5-c46a-4e45-b73a-a052fca3638c (non-flash)
Oct 26 00:39:30 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:39:30 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d469fd3-9806-46cb-aac6-8c3c02c75788 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:927d04d0-50f4-459c-8c3c-ed41d757d7ca (non-flash)
Oct 26 00:39:30 user nova-compute[75165]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67c880f5-c46a-4e45-b73a-a052fca3638c (non-flash)
Oct 26 00:39:30 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:39:30 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-5d469fd3-9806-46cb-aac6-8c3c02c75788 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:67c880f5-c46a-4e45-b73a-a052fca3638c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.272s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:39:30 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d469fd3-9806-46cb-aac6-8c3c02c75788 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Connected to 172.16.0.220:3260 {{(pid=75165) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 00:39:30 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-5d469fd3-9806-46cb-aac6-8c3c02c75788 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] HCTL ('33', '-', '-', 0) found on session 46 with lun 0 {{(pid=75165) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 00:39:30 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-5d469fd3-9806-46cb-aac6-8c3c02c75788 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75165) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 00:39:30 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:39:30 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:39:30 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bef93a8-7e63-4cc6-9554-80b439185b0c]: (4, ('- - 0', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:39:30 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-5d469fd3-9806-46cb-aac6-8c3c02c75788 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Searching for a device in session 46 and hctl ['33', '*', '*', 0] yield: None {{(pid=75165) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 00:39:30 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:39:31 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:39:31 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-5d469fd3-9806-46cb-aac6-8c3c02c75788 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Searching for a device in session 46 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75165) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 00:39:31 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d469fd3-9806-46cb-aac6-8c3c02c75788 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:67c880f5-c46a-4e45-b73a-a052fca3638c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oNvdpCXD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75165) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 00:39:31 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-5d469fd3-9806-46cb-aac6-8c3c02c75788 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.302s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:39:31 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d469fd3-9806-46cb-aac6-8c3c02c75788 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] <== connect_volume: return (1303ms) {'type': 'block', 'scsi_wwn': '26664363336656137', 'path': '/dev/sdb'} {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:39:31 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d469fd3-9806-46cb-aac6-8c3c02c75788 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 539bedc3-f788-4d5e-993b-3b168d027a57] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26664363336656137', 'path': '/dev/sdb'} {{(pid=75165) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 00:39:31 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-5d469fd3-9806-46cb-aac6-8c3c02c75788 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:39:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-560048754',display_name='tempest-TestVolumeBootPattern-volume-backed-server-560048754',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-560048754',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK3hRO5dmVvdThykFEui8jxYF0sctEmyOEy5r4zhirhW+m1kAsS3Y0CIsOeE/NyKN9RypIuB44JCgaUDx36gQtEOMW4ZS6ZaVz+bBqnF+5FJO6+tz67ZfEJ4NkHjOlu2Pg==',key_name='tempest-keypair-1970846225',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d1051405ca054c4bb051fb842a5fb5a0',ramdisk_id='',reservation_id='r-v5nzdxoq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1215567595',owner_user_name='tempest-TestVolumeBootPattern-1215567595-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T00:39:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ae836eab78514cf3894e5e11240ff374',uuid=539bedc3-f788-4d5e-993b-3b168d027a57,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cf882314-eb1e-4555-b87d-4e010947f66f", "address": "fa:16:3e:dc:7e:ca", "network": {"id": "dc50ae7b-d501-461f-aa0b-542514330ae8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1091857056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1051405ca054c4bb051fb842a5fb5a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf882314-eb", "ovs_interfaceid": "cf882314-eb1e-4555-b87d-4e010947f66f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75165) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 00:39:31 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-5d469fd3-9806-46cb-aac6-8c3c02c75788 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Converting VIF {"id": "cf882314-eb1e-4555-b87d-4e010947f66f", "address": "fa:16:3e:dc:7e:ca", "network": {"id": "dc50ae7b-d501-461f-aa0b-542514330ae8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1091857056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1051405ca054c4bb051fb842a5fb5a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf882314-eb", "ovs_interfaceid": "cf882314-eb1e-4555-b87d-4e010947f66f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:39:31 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-5d469fd3-9806-46cb-aac6-8c3c02c75788 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:7e:ca,bridge_name='br-int',has_traffic_filtering=True,id=cf882314-eb1e-4555-b87d-4e010947f66f,network=Network(dc50ae7b-d501-461f-aa0b-542514330ae8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf882314-eb') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:39:31 user nova-compute[75165]: DEBUG nova.objects.instance [None req-5d469fd3-9806-46cb-aac6-8c3c02c75788 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Lazy-loading 'pci_devices' on Instance uuid 539bedc3-f788-4d5e-993b-3b168d027a57 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:39:31 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-5d469fd3-9806-46cb-aac6-8c3c02c75788 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 539bedc3-f788-4d5e-993b-3b168d027a57] End _get_guest_xml xml=<domain type="kvm">
Oct 26 00:39:31 user nova-compute[75165]:   <uuid>539bedc3-f788-4d5e-993b-3b168d027a57</uuid>
Oct 26 00:39:31 user nova-compute[75165]:   <name>instance-0000002b</name>
Oct 26 00:39:31 user nova-compute[75165]:   <memory>524288</memory>
Oct 26 00:39:31 user nova-compute[75165]:   <vcpu>1</vcpu>
Oct 26 00:39:31 user nova-compute[75165]:   <metadata>
Oct 26 00:39:31 user nova-compute[75165]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 00:39:31 user nova-compute[75165]:       <nova:package version="0.0.0"/>
Oct 26 00:39:31 user nova-compute[75165]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-560048754</nova:name>
Oct 26 00:39:31 user nova-compute[75165]:       <nova:creationTime>2023-10-26 00:39:30</nova:creationTime>
Oct 26 00:39:31 user nova-compute[75165]:       <nova:flavor name="m1.tiny">
Oct 26 00:39:31 user nova-compute[75165]:         <nova:memory>512</nova:memory>
Oct 26 00:39:31 user nova-compute[75165]:         <nova:disk>1</nova:disk>
Oct 26 00:39:31 user nova-compute[75165]:         <nova:swap>0</nova:swap>
Oct 26 00:39:31 user nova-compute[75165]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 00:39:31 user nova-compute[75165]:         <nova:vcpus>1</nova:vcpus>
Oct 26 00:39:31 user nova-compute[75165]:       </nova:flavor>
Oct 26 00:39:31 user nova-compute[75165]:       <nova:owner>
Oct 26 00:39:31 user nova-compute[75165]:         <nova:user uuid="ae836eab78514cf3894e5e11240ff374">tempest-TestVolumeBootPattern-1215567595-project-member</nova:user>
Oct 26 00:39:31 user nova-compute[75165]:         <nova:project uuid="d1051405ca054c4bb051fb842a5fb5a0">tempest-TestVolumeBootPattern-1215567595</nova:project>
Oct 26 00:39:31 user nova-compute[75165]:       </nova:owner>
Oct 26 00:39:31 user nova-compute[75165]:       <nova:ports>
Oct 26 00:39:31 user nova-compute[75165]:         <nova:port uuid="cf882314-eb1e-4555-b87d-4e010947f66f">
Oct 26 00:39:31 user nova-compute[75165]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 26 00:39:31 user nova-compute[75165]:         </nova:port>
Oct 26 00:39:31 user nova-compute[75165]:       </nova:ports>
Oct 26 00:39:31 user nova-compute[75165]:     </nova:instance>
Oct 26 00:39:31 user nova-compute[75165]:   </metadata>
Oct 26 00:39:31 user nova-compute[75165]:   <sysinfo type="smbios">
Oct 26 00:39:31 user nova-compute[75165]:     <system>
Oct 26 00:39:31 user nova-compute[75165]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 00:39:31 user nova-compute[75165]:       <entry name="product">OpenStack Nova</entry>
Oct 26 00:39:31 user nova-compute[75165]:       <entry name="version">0.0.0</entry>
Oct 26 00:39:31 user nova-compute[75165]:       <entry name="serial">539bedc3-f788-4d5e-993b-3b168d027a57</entry>
Oct 26 00:39:31 user nova-compute[75165]:       <entry name="uuid">539bedc3-f788-4d5e-993b-3b168d027a57</entry>
Oct 26 00:39:31 user nova-compute[75165]:       <entry name="family">Virtual Machine</entry>
Oct 26 00:39:31 user nova-compute[75165]:     </system>
Oct 26 00:39:31 user nova-compute[75165]:   </sysinfo>
Oct 26 00:39:31 user nova-compute[75165]:   <os>
Oct 26 00:39:31 user nova-compute[75165]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 00:39:31 user nova-compute[75165]:     <boot dev="hd"/>
Oct 26 00:39:31 user nova-compute[75165]:     <smbios mode="sysinfo"/>
Oct 26 00:39:31 user nova-compute[75165]:   </os>
Oct 26 00:39:31 user nova-compute[75165]:   <features>
Oct 26 00:39:31 user nova-compute[75165]:     <acpi/>
Oct 26 00:39:31 user nova-compute[75165]:     <apic/>
Oct 26 00:39:31 user nova-compute[75165]:     <vmcoreinfo/>
Oct 26 00:39:31 user nova-compute[75165]:   </features>
Oct 26 00:39:31 user nova-compute[75165]:   <clock offset="utc">
Oct 26 00:39:31 user nova-compute[75165]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 00:39:31 user nova-compute[75165]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 00:39:31 user nova-compute[75165]:     <timer name="hpet" present="no"/>
Oct 26 00:39:31 user nova-compute[75165]:   </clock>
Oct 26 00:39:31 user nova-compute[75165]:   <cpu mode="custom" match="exact">
Oct 26 00:39:31 user nova-compute[75165]:     <model>Nehalem</model>
Oct 26 00:39:31 user nova-compute[75165]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 00:39:31 user nova-compute[75165]:   </cpu>
Oct 26 00:39:31 user nova-compute[75165]:   <devices>
Oct 26 00:39:31 user nova-compute[75165]:     <disk type="block" device="disk">
Oct 26 00:39:31 user nova-compute[75165]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 00:39:31 user nova-compute[75165]:       <source dev="/dev/sdb"/>
Oct 26 00:39:31 user nova-compute[75165]:       <target dev="vda" bus="virtio"/>
Oct 26 00:39:31 user nova-compute[75165]:       <serial>67c880f5-c46a-4e45-b73a-a052fca3638c</serial>
Oct 26 00:39:31 user nova-compute[75165]:     </disk>
Oct 26 00:39:31 user nova-compute[75165]:     <interface type="ethernet">
Oct 26 00:39:31 user nova-compute[75165]:       <mac address="fa:16:3e:dc:7e:ca"/>
Oct 26 00:39:31 user nova-compute[75165]:       <model type="virtio"/>
Oct 26 00:39:31 user nova-compute[75165]:       <mtu size="1442"/>
Oct 26 00:39:31 user nova-compute[75165]:       <target dev="tapcf882314-eb"/>
Oct 26 00:39:31 user nova-compute[75165]:     </interface>
Oct 26 00:39:31 user nova-compute[75165]:     <serial type="pty">
Oct 26 00:39:31 user nova-compute[75165]:       <log file="/opt/stack/data/nova/instances/539bedc3-f788-4d5e-993b-3b168d027a57/console.log" append="off"/>
Oct 26 00:39:31 user nova-compute[75165]:     </serial>
Oct 26 00:39:31 user nova-compute[75165]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 00:39:31 user nova-compute[75165]:     <video>
Oct 26 00:39:31 user nova-compute[75165]:       <model type="virtio"/>
Oct 26 00:39:31 user nova-compute[75165]:     </video>
Oct 26 00:39:31 user nova-compute[75165]:     <rng model="virtio">
Oct 26 00:39:31 user nova-compute[75165]:       <backend model="random">/dev/urandom</backend>
Oct 26 00:39:31 user nova-compute[75165]:     </rng>
Oct 26 00:39:31 user nova-compute[75165]:     <controller type="usb" index="0" model="none"/>
Oct 26 00:39:31 user nova-compute[75165]:     <memballoon model="virtio">
Oct 26 00:39:31 user nova-compute[75165]:       <stats period="10"/>
Oct 26 00:39:31 user nova-compute[75165]:     </memballoon>
Oct 26 00:39:31 user nova-compute[75165]:   </devices>
Oct 26 00:39:31 user nova-compute[75165]: </domain>
Oct 26 00:39:31 user nova-compute[75165]:  {{(pid=75165) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 00:39:31 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-5d469fd3-9806-46cb-aac6-8c3c02c75788 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:39:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-560048754',display_name='tempest-TestVolumeBootPattern-volume-backed-server-560048754',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-560048754',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK3hRO5dmVvdThykFEui8jxYF0sctEmyOEy5r4zhirhW+m1kAsS3Y0CIsOeE/NyKN9RypIuB44JCgaUDx36gQtEOMW4ZS6ZaVz+bBqnF+5FJO6+tz67ZfEJ4NkHjOlu2Pg==',key_name='tempest-keypair-1970846225',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d1051405ca054c4bb051fb842a5fb5a0',ramdisk_id='',reservation_id='r-v5nzdxoq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1215567595',owner_user_name='tempest-TestVolumeBootPattern-1215567595-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T00:39:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ae836eab78514cf3894e5e11240ff374',uuid=539bedc3-f788-4d5e-993b-3b168d027a57,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cf882314-eb1e-4555-b87d-4e010947f66f", "address": "fa:16:3e:dc:7e:ca", "network": {"id": "dc50ae7b-d501-461f-aa0b-542514330ae8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1091857056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1051405ca054c4bb051fb842a5fb5a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf882314-eb", "ovs_interfaceid": "cf882314-eb1e-4555-b87d-4e010947f66f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 00:39:31 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-5d469fd3-9806-46cb-aac6-8c3c02c75788 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Converting VIF {"id": "cf882314-eb1e-4555-b87d-4e010947f66f", "address": "fa:16:3e:dc:7e:ca", "network": {"id": "dc50ae7b-d501-461f-aa0b-542514330ae8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1091857056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1051405ca054c4bb051fb842a5fb5a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf882314-eb", "ovs_interfaceid": "cf882314-eb1e-4555-b87d-4e010947f66f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:39:31 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-5d469fd3-9806-46cb-aac6-8c3c02c75788 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:7e:ca,bridge_name='br-int',has_traffic_filtering=True,id=cf882314-eb1e-4555-b87d-4e010947f66f,network=Network(dc50ae7b-d501-461f-aa0b-542514330ae8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf882314-eb') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:39:31 user nova-compute[75165]: DEBUG os_vif [None req-5d469fd3-9806-46cb-aac6-8c3c02c75788 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:7e:ca,bridge_name='br-int',has_traffic_filtering=True,id=cf882314-eb1e-4555-b87d-4e010947f66f,network=Network(dc50ae7b-d501-461f-aa0b-542514330ae8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf882314-eb') {{(pid=75165) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 00:39:31 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:39:31 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:39:31 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 00:39:31 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:39:31 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fdf4c143-87fc-528b-8fd6-5c127ea8de27', '_type': 'linux-noop'}}, row=False) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:39:31 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:39:31 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:39:31 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:39:31 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcf882314-eb, may_exist=True, interface_attrs={}) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:39:31 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcf882314-eb, col_values=(('qos', UUID('b249d9b1-81a2-4623-9f1b-6fe638ab337b')),), if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:39:31 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcf882314-eb, col_values=(('external_ids', {'iface-id': 'cf882314-eb1e-4555-b87d-4e010947f66f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dc:7e:ca', 'vm-uuid': '539bedc3-f788-4d5e-993b-3b168d027a57'}),), if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:39:31 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:39:31 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:39:31 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:39:31 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:39:31 user nova-compute[75165]: INFO os_vif [None req-5d469fd3-9806-46cb-aac6-8c3c02c75788 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:7e:ca,bridge_name='br-int',has_traffic_filtering=True,id=cf882314-eb1e-4555-b87d-4e010947f66f,network=Network(dc50ae7b-d501-461f-aa0b-542514330ae8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf882314-eb')
Oct 26 00:39:31 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:39:31 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:39:31 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:39:31 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75165) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 00:39:31 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-5d469fd3-9806-46cb-aac6-8c3c02c75788 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] No BDM found with device name vda, not building metadata. {{(pid=75165) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 00:39:31 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-5d469fd3-9806-46cb-aac6-8c3c02c75788 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] No VIF found with MAC fa:16:3e:dc:7e:ca, not building metadata {{(pid=75165) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 00:39:33 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:39:33 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:39:33 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:39:33 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:39:33 user nova-compute[75165]: DEBUG nova.compute.manager [req-ec533099-3e81-414d-99d2-73e7f3eede72 req-e485942b-da86-4abf-a009-b88b30350265 service nova] [instance: 539bedc3-f788-4d5e-993b-3b168d027a57] Received event network-vif-plugged-cf882314-eb1e-4555-b87d-4e010947f66f {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:39:33 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-ec533099-3e81-414d-99d2-73e7f3eede72 req-e485942b-da86-4abf-a009-b88b30350265 service nova] Acquiring lock "539bedc3-f788-4d5e-993b-3b168d027a57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:39:33 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-ec533099-3e81-414d-99d2-73e7f3eede72 req-e485942b-da86-4abf-a009-b88b30350265 service nova] Lock "539bedc3-f788-4d5e-993b-3b168d027a57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:39:33 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-ec533099-3e81-414d-99d2-73e7f3eede72 req-e485942b-da86-4abf-a009-b88b30350265 service nova] Lock "539bedc3-f788-4d5e-993b-3b168d027a57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:39:33 user nova-compute[75165]: DEBUG nova.compute.manager [req-ec533099-3e81-414d-99d2-73e7f3eede72 req-e485942b-da86-4abf-a009-b88b30350265 service nova] [instance: 539bedc3-f788-4d5e-993b-3b168d027a57] No waiting events found dispatching network-vif-plugged-cf882314-eb1e-4555-b87d-4e010947f66f {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:39:33 user nova-compute[75165]: WARNING nova.compute.manager [req-ec533099-3e81-414d-99d2-73e7f3eede72 req-e485942b-da86-4abf-a009-b88b30350265 service nova] [instance: 539bedc3-f788-4d5e-993b-3b168d027a57] Received unexpected event network-vif-plugged-cf882314-eb1e-4555-b87d-4e010947f66f for instance with vm_state building and task_state spawning.
Oct 26 00:39:33 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e534595-7eaf-49f4-b457-9f37bc59012b/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:39:33 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:39:33 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:39:33 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e534595-7eaf-49f4-b457-9f37bc59012b/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:39:33 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e534595-7eaf-49f4-b457-9f37bc59012b/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:39:34 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e534595-7eaf-49f4-b457-9f37bc59012b/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:39:34 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75165) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 00:39:34 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75165) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 00:39:34 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b637f1-baea-4e1c-8b25-e943125eed32/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:39:34 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b637f1-baea-4e1c-8b25-e943125eed32/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:39:34 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b637f1-baea-4e1c-8b25-e943125eed32/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:39:34 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b637f1-baea-4e1c-8b25-e943125eed32/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:39:34 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae9fe6f-eb17-44f5-89e4-fff5e3451336/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:39:34 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae9fe6f-eb17-44f5-89e4-fff5e3451336/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:39:34 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae9fe6f-eb17-44f5-89e4-fff5e3451336/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:39:34 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae9fe6f-eb17-44f5-89e4-fff5e3451336/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:39:35 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:39:35 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:39:35 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Hypervisor/Node resource view: name=user free_ram=8740MB free_disk=24.73242950439453GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75165) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 00:39:35 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:39:35 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:39:35 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 7e534595-7eaf-49f4-b457-9f37bc59012b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:39:35 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 6ae9fe6f-eb17-44f5-89e4-fff5e3451336 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:39:35 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 65b637f1-baea-4e1c-8b25-e943125eed32 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:39:35 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 539bedc3-f788-4d5e-993b-3b168d027a57 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:39:35 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75165) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 00:39:35 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75165) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 00:39:35 user nova-compute[75165]: DEBUG nova.compute.manager [None req-5d469fd3-9806-46cb-aac6-8c3c02c75788 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 539bedc3-f788-4d5e-993b-3b168d027a57] Instance event wait completed in 0 seconds for  {{(pid=75165) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 00:39:35 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-5d469fd3-9806-46cb-aac6-8c3c02c75788 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 539bedc3-f788-4d5e-993b-3b168d027a57] Guest created on hypervisor {{(pid=75165) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 00:39:35 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: 539bedc3-f788-4d5e-993b-3b168d027a57] Instance spawned successfully.
Oct 26 00:39:35 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-5d469fd3-9806-46cb-aac6-8c3c02c75788 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 539bedc3-f788-4d5e-993b-3b168d027a57] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 00:39:35 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-5d469fd3-9806-46cb-aac6-8c3c02c75788 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 539bedc3-f788-4d5e-993b-3b168d027a57] Found default for hw_cdrom_bus of ide {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:39:35 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-5d469fd3-9806-46cb-aac6-8c3c02c75788 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 539bedc3-f788-4d5e-993b-3b168d027a57] Found default for hw_disk_bus of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:39:35 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-5d469fd3-9806-46cb-aac6-8c3c02c75788 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 539bedc3-f788-4d5e-993b-3b168d027a57] Found default for hw_input_bus of None {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:39:35 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-5d469fd3-9806-46cb-aac6-8c3c02c75788 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 539bedc3-f788-4d5e-993b-3b168d027a57] Found default for hw_pointer_model of None {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:39:35 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-5d469fd3-9806-46cb-aac6-8c3c02c75788 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 539bedc3-f788-4d5e-993b-3b168d027a57] Found default for hw_video_model of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:39:35 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-5d469fd3-9806-46cb-aac6-8c3c02c75788 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 539bedc3-f788-4d5e-993b-3b168d027a57] Found default for hw_vif_model of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:39:35 user nova-compute[75165]: DEBUG nova.compute.manager [req-6d576196-7fdc-45fa-aed7-40f010ac4973 req-cb3afbb2-0f2e-4dd8-b6be-bd2fed77c387 service nova] [instance: 539bedc3-f788-4d5e-993b-3b168d027a57] Received event network-vif-plugged-cf882314-eb1e-4555-b87d-4e010947f66f {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:39:35 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-6d576196-7fdc-45fa-aed7-40f010ac4973 req-cb3afbb2-0f2e-4dd8-b6be-bd2fed77c387 service nova] Acquiring lock "539bedc3-f788-4d5e-993b-3b168d027a57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:39:35 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-6d576196-7fdc-45fa-aed7-40f010ac4973 req-cb3afbb2-0f2e-4dd8-b6be-bd2fed77c387 service nova] Lock "539bedc3-f788-4d5e-993b-3b168d027a57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:39:35 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-6d576196-7fdc-45fa-aed7-40f010ac4973 req-cb3afbb2-0f2e-4dd8-b6be-bd2fed77c387 service nova] Lock "539bedc3-f788-4d5e-993b-3b168d027a57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:39:35 user nova-compute[75165]: DEBUG nova.compute.manager [req-6d576196-7fdc-45fa-aed7-40f010ac4973 req-cb3afbb2-0f2e-4dd8-b6be-bd2fed77c387 service nova] [instance: 539bedc3-f788-4d5e-993b-3b168d027a57] No waiting events found dispatching network-vif-plugged-cf882314-eb1e-4555-b87d-4e010947f66f {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:39:35 user nova-compute[75165]: WARNING nova.compute.manager [req-6d576196-7fdc-45fa-aed7-40f010ac4973 req-cb3afbb2-0f2e-4dd8-b6be-bd2fed77c387 service nova] [instance: 539bedc3-f788-4d5e-993b-3b168d027a57] Received unexpected event network-vif-plugged-cf882314-eb1e-4555-b87d-4e010947f66f for instance with vm_state building and task_state spawning.
Oct 26 00:39:35 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:39:35 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:39:35 user nova-compute[75165]: INFO nova.compute.manager [None req-5d469fd3-9806-46cb-aac6-8c3c02c75788 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 539bedc3-f788-4d5e-993b-3b168d027a57] Took 5.11 seconds to spawn the instance on the hypervisor.
Oct 26 00:39:35 user nova-compute[75165]: DEBUG nova.compute.manager [None req-5d469fd3-9806-46cb-aac6-8c3c02c75788 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 539bedc3-f788-4d5e-993b-3b168d027a57] Checking state {{(pid=75165) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 00:39:35 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Compute_service record updated for user:user {{(pid=75165) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 00:39:35 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.339s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:39:35 user nova-compute[75165]: INFO nova.compute.manager [None req-5d469fd3-9806-46cb-aac6-8c3c02c75788 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 539bedc3-f788-4d5e-993b-3b168d027a57] Took 24.13 seconds to build instance.
Oct 26 00:39:35 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-5d469fd3-9806-46cb-aac6-8c3c02c75788 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Lock "539bedc3-f788-4d5e-993b-3b168d027a57" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 24.233s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:39:36 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:39:36 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:39:37 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:39:41 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:39:42 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-c0f13230-cb9b-4b85-8d43-7b5512e8a5a6 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Acquiring lock "7e534595-7eaf-49f4-b457-9f37bc59012b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:39:42 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-c0f13230-cb9b-4b85-8d43-7b5512e8a5a6 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Lock "7e534595-7eaf-49f4-b457-9f37bc59012b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:39:42 user nova-compute[75165]: INFO nova.compute.manager [None req-c0f13230-cb9b-4b85-8d43-7b5512e8a5a6 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 7e534595-7eaf-49f4-b457-9f37bc59012b] Detaching volume 927d04d0-50f4-459c-8c3c-ed41d757d7ca
Oct 26 00:39:42 user nova-compute[75165]: INFO nova.virt.block_device [None req-c0f13230-cb9b-4b85-8d43-7b5512e8a5a6 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 7e534595-7eaf-49f4-b457-9f37bc59012b] Attempting to driver detach volume 927d04d0-50f4-459c-8c3c-ed41d757d7ca from mountpoint /dev/vdb
Oct 26 00:39:42 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-c0f13230-cb9b-4b85-8d43-7b5512e8a5a6 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Attempting to detach device vdb from instance 7e534595-7eaf-49f4-b457-9f37bc59012b from the persistent domain config. {{(pid=75165) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 00:39:42 user nova-compute[75165]: DEBUG nova.virt.libvirt.guest [None req-c0f13230-cb9b-4b85-8d43-7b5512e8a5a6 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 00:39:42 user nova-compute[75165]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 00:39:42 user nova-compute[75165]:   <source dev="/dev/sdd"/>
Oct 26 00:39:42 user nova-compute[75165]:   <target dev="vdb" bus="virtio"/>
Oct 26 00:39:42 user nova-compute[75165]:   <serial>927d04d0-50f4-459c-8c3c-ed41d757d7ca</serial>
Oct 26 00:39:42 user nova-compute[75165]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 00:39:42 user nova-compute[75165]: </disk>
Oct 26 00:39:42 user nova-compute[75165]:  {{(pid=75165) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 00:39:42 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-c0f13230-cb9b-4b85-8d43-7b5512e8a5a6 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Successfully detached device vdb from instance 7e534595-7eaf-49f4-b457-9f37bc59012b from the persistent domain config.
Oct 26 00:39:42 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-c0f13230-cb9b-4b85-8d43-7b5512e8a5a6 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7e534595-7eaf-49f4-b457-9f37bc59012b from the live domain config. {{(pid=75165) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 00:39:42 user nova-compute[75165]: DEBUG nova.virt.libvirt.guest [None req-c0f13230-cb9b-4b85-8d43-7b5512e8a5a6 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 00:39:42 user nova-compute[75165]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 00:39:42 user nova-compute[75165]:   <source dev="/dev/sdd"/>
Oct 26 00:39:42 user nova-compute[75165]:   <target dev="vdb" bus="virtio"/>
Oct 26 00:39:42 user nova-compute[75165]:   <serial>927d04d0-50f4-459c-8c3c-ed41d757d7ca</serial>
Oct 26 00:39:42 user nova-compute[75165]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 00:39:42 user nova-compute[75165]: </disk>
Oct 26 00:39:42 user nova-compute[75165]:  {{(pid=75165) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 00:39:42 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-c0f13230-cb9b-4b85-8d43-7b5512e8a5a6 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7e534595-7eaf-49f4-b457-9f37bc59012b {{(pid=75165) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 00:39:46 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:39:46 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:39:46 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75165) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 00:39:46 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75165) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 00:39:46 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75165) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 00:39:46 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:39:51 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:39:51 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:39:55 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:39:56 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:39:56 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:40:01 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:40:01 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:40:02 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-c0f13230-cb9b-4b85-8d43-7b5512e8a5a6 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 7e534595-7eaf-49f4-b457-9f37bc59012b is timed out.
Oct 26 00:40:02 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-c0f13230-cb9b-4b85-8d43-7b5512e8a5a6 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Successfully detached device vdb from instance 7e534595-7eaf-49f4-b457-9f37bc59012b from the live domain config.
Oct 26 00:40:02 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0f13230-cb9b-4b85-8d43-7b5512e8a5a6 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 7e534595-7eaf-49f4-b457-9f37bc59012b] calling os-brick to detach iSCSI Volume {{(pid=75165) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 00:40:02 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f13230-cb9b-4b85-8d43-7b5512e8a5a6 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8bf8160e50>, {'target_iqn': 'iqn.2010-10.org.openstack:927d04d0-50f4-459c-8c3c-ed41d757d7ca', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CSZyzdfg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:40:02 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-c0f13230-cb9b-4b85-8d43-7b5512e8a5a6 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:40:02 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-c0f13230-cb9b-4b85-8d43-7b5512e8a5a6 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:40:02 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-c0f13230-cb9b-4b85-8d43-7b5512e8a5a6 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:40:02 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:40:02 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:40:02 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[612a08d7-57f3-44dc-898a-a9a09d05a0e4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:67c880f5-c46a-4e45-b73a-a052fca3638c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:927d04d0-50f4-459c-8c3c-ed41d757d7ca\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:40:02 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f13230-cb9b-4b85-8d43-7b5512e8a5a6 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 00:40:02 user nova-compute[75165]: No targets found.
Oct 26 00:40:02 user nova-compute[75165]: iSNS:
Oct 26 00:40:02 user nova-compute[75165]: No targets found.
Oct 26 00:40:02 user nova-compute[75165]: STATIC:
Oct 26 00:40:02 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:67c880f5-c46a-4e45-b73a-a052fca3638c
Oct 26 00:40:02 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:40:02 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:40:02 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:927d04d0-50f4-459c-8c3c-ed41d757d7ca
Oct 26 00:40:02 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:40:02 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:40:02 user nova-compute[75165]: FIRMWARE:
Oct 26 00:40:02 user nova-compute[75165]: No targets found.
Oct 26 00:40:02 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:40:02 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f13230-cb9b-4b85-8d43-7b5512e8a5a6 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 00:40:02 user nova-compute[75165]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 00:40:02 user nova-compute[75165]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75165) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 00:40:02 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f13230-cb9b-4b85-8d43-7b5512e8a5a6 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:927d04d0-50f4-459c-8c3c-ed41d757d7ca', 0)] {{(pid=75165) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 00:40:02 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:40:02 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:40:02 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[547ff6a0-74e6-4c60-b9fc-d0849ac316b7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:67c880f5-c46a-4e45-b73a-a052fca3638c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:927d04d0-50f4-459c-8c3c-ed41d757d7ca\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:40:02 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:40:02 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:40:02 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfd9c73c-879e-481e-8530-a21975e4279f]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:927d04d0-50f4-459c-8c3c-ed41d757d7ca (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67c880f5-c46a-4e45-b73a-a052fca3638c (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:40:02 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f13230-cb9b-4b85-8d43-7b5512e8a5a6 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:927d04d0-50f4-459c-8c3c-ed41d757d7ca (non-flash)
Oct 26 00:40:02 user nova-compute[75165]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67c880f5-c46a-4e45-b73a-a052fca3638c (non-flash)
Oct 26 00:40:02 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:40:02 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f13230-cb9b-4b85-8d43-7b5512e8a5a6 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:927d04d0-50f4-459c-8c3c-ed41d757d7ca (non-flash)
Oct 26 00:40:02 user nova-compute[75165]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67c880f5-c46a-4e45-b73a-a052fca3638c (non-flash)
Oct 26 00:40:02 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:40:02 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f13230-cb9b-4b85-8d43-7b5512e8a5a6 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8c0150f370>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:927d04d0-50f4-459c-8c3c-ed41d757d7ca'): ({'sdd'}, set())}) {{(pid=75165) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 00:40:02 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-c0f13230-cb9b-4b85-8d43-7b5512e8a5a6 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Removing single pathed devices sdd {{(pid=75165) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 00:40:02 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:40:02 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:40:02 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[050fc5a2-16c1-4935-a274-676ce794dba8]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:40:02 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:40:03 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:40:03 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[55d1523d-89a5-42fe-a468-a1896597d9a4]: (4, ('ok\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:40:03 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-c0f13230-cb9b-4b85-8d43-7b5512e8a5a6 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Flushing IO for device /dev/sdd {{(pid=75165) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 00:40:03 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:40:03 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:40:03 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[75c3b8b7-f103-481f-aa43-470d19b1a481]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:40:03 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-c0f13230-cb9b-4b85-8d43-7b5512e8a5a6 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75165) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 00:40:03 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:40:03 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.031s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:40:03 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[2609daaf-cd5f-4830-b655-998132211fb7]: (4, ('1', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:40:03 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-c0f13230-cb9b-4b85-8d43-7b5512e8a5a6 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75165) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 00:40:03 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-c0f13230-cb9b-4b85-8d43-7b5512e8a5a6 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] SCSI volumes sdd have been removed. {{(pid=75165) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 00:40:03 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f13230-cb9b-4b85-8d43-7b5512e8a5a6 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:927d04d0-50f4-459c-8c3c-ed41d757d7ca')] {{(pid=75165) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 00:40:03 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:927d04d0-50f4-459c-8c3c-ed41d757d7ca -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:40:03 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:927d04d0-50f4-459c-8c3c-ed41d757d7ca -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:40:03 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4d2ca74-0378-487a-b46d-94d76471d5ee]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:40:03 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f13230-cb9b-4b85-8d43-7b5512e8a5a6 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:40:03 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:927d04d0-50f4-459c-8c3c-ed41d757d7ca -p 172.16.0.220:3260 --logout {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:40:03 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:927d04d0-50f4-459c-8c3c-ed41d757d7ca -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:40:03 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eef3458-6175-45bc-bda9-f0eb7abe370a]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:927d04d0-50f4-459c-8c3c-ed41d757d7ca, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:927d04d0-50f4-459c-8c3c-ed41d757d7ca, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:40:03 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f13230-cb9b-4b85-8d43-7b5512e8a5a6 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:927d04d0-50f4-459c-8c3c-ed41d757d7ca, portal: 172.16.0.220,3260]
Oct 26 00:40:03 user nova-compute[75165]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:927d04d0-50f4-459c-8c3c-ed41d757d7ca, portal: 172.16.0.220,3260] successful.
Oct 26 00:40:03 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:40:03 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:927d04d0-50f4-459c-8c3c-ed41d757d7ca -p 172.16.0.220:3260 --op delete {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:40:03 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:927d04d0-50f4-459c-8c3c-ed41d757d7ca -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:40:03 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[35a64468-ff33-4cf4-a288-8361f70ffe65]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:40:03 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f13230-cb9b-4b85-8d43-7b5512e8a5a6 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:40:03 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-c0f13230-cb9b-4b85-8d43-7b5512e8a5a6 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:40:03 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f13230-cb9b-4b85-8d43-7b5512e8a5a6 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] <== disconnect_volume: return (291ms) None {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:40:03 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0f13230-cb9b-4b85-8d43-7b5512e8a5a6 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 7e534595-7eaf-49f4-b457-9f37bc59012b] Disconnected iSCSI Volume {{(pid=75165) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 00:40:04 user nova-compute[75165]: DEBUG nova.objects.instance [None req-c0f13230-cb9b-4b85-8d43-7b5512e8a5a6 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Lazy-loading 'flavor' on Instance uuid 7e534595-7eaf-49f4-b457-9f37bc59012b {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:40:04 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-c0f13230-cb9b-4b85-8d43-7b5512e8a5a6 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Lock "7e534595-7eaf-49f4-b457-9f37bc59012b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.863s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:40:06 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:40:06 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:40:11 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:40:15 user nova-compute[75165]: DEBUG nova.compute.manager [req-42bdbfa6-30e6-49cc-a4df-35015bd4f558 req-0c977557-8af2-4c8f-be38-edea96745fcc service nova] [instance: 65b637f1-baea-4e1c-8b25-e943125eed32] Received event network-changed-29185859-2394-4d70-a21d-4a7723e80fcd {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:40:15 user nova-compute[75165]: DEBUG nova.compute.manager [req-42bdbfa6-30e6-49cc-a4df-35015bd4f558 req-0c977557-8af2-4c8f-be38-edea96745fcc service nova] [instance: 65b637f1-baea-4e1c-8b25-e943125eed32] Refreshing instance network info cache due to event network-changed-29185859-2394-4d70-a21d-4a7723e80fcd. {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 00:40:15 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-42bdbfa6-30e6-49cc-a4df-35015bd4f558 req-0c977557-8af2-4c8f-be38-edea96745fcc service nova] Acquiring lock "refresh_cache-65b637f1-baea-4e1c-8b25-e943125eed32" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:40:15 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-42bdbfa6-30e6-49cc-a4df-35015bd4f558 req-0c977557-8af2-4c8f-be38-edea96745fcc service nova] Acquired lock "refresh_cache-65b637f1-baea-4e1c-8b25-e943125eed32" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:40:15 user nova-compute[75165]: DEBUG nova.network.neutron [req-42bdbfa6-30e6-49cc-a4df-35015bd4f558 req-0c977557-8af2-4c8f-be38-edea96745fcc service nova] [instance: 65b637f1-baea-4e1c-8b25-e943125eed32] Refreshing network info cache for port 29185859-2394-4d70-a21d-4a7723e80fcd {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 00:40:16 user nova-compute[75165]: DEBUG nova.network.neutron [req-42bdbfa6-30e6-49cc-a4df-35015bd4f558 req-0c977557-8af2-4c8f-be38-edea96745fcc service nova] [instance: 65b637f1-baea-4e1c-8b25-e943125eed32] Updated VIF entry in instance network info cache for port 29185859-2394-4d70-a21d-4a7723e80fcd. {{(pid=75165) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 00:40:16 user nova-compute[75165]: DEBUG nova.network.neutron [req-42bdbfa6-30e6-49cc-a4df-35015bd4f558 req-0c977557-8af2-4c8f-be38-edea96745fcc service nova] [instance: 65b637f1-baea-4e1c-8b25-e943125eed32] Updating instance_info_cache with network_info: [{"id": "29185859-2394-4d70-a21d-4a7723e80fcd", "address": "fa:16:3e:0f:8c:52", "network": {"id": "03d2b5cd-b214-4767-a406-098bd6857327", "bridge": "br-int", "label": "tempest-TestStampPattern-968415108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e11255eee7bb4b13962634a1cd13d186", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29185859-23", "ovs_interfaceid": "29185859-2394-4d70-a21d-4a7723e80fcd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:40:16 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-42bdbfa6-30e6-49cc-a4df-35015bd4f558 req-0c977557-8af2-4c8f-be38-edea96745fcc service nova] Releasing lock "refresh_cache-65b637f1-baea-4e1c-8b25-e943125eed32" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:40:16 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:40:16 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:40:16 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75165) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 00:40:16 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75165) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 00:40:16 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75165) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 00:40:16 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:40:16 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:40:17 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-6148531b-8a24-4206-807a-d7b34b44d621 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Acquiring lock "65b637f1-baea-4e1c-8b25-e943125eed32" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:40:17 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-6148531b-8a24-4206-807a-d7b34b44d621 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Lock "65b637f1-baea-4e1c-8b25-e943125eed32" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:40:17 user nova-compute[75165]: DEBUG nova.objects.instance [None req-6148531b-8a24-4206-807a-d7b34b44d621 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Lazy-loading 'flavor' on Instance uuid 65b637f1-baea-4e1c-8b25-e943125eed32 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:40:17 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-6148531b-8a24-4206-807a-d7b34b44d621 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Lock "65b637f1-baea-4e1c-8b25-e943125eed32" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:40:17 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-6148531b-8a24-4206-807a-d7b34b44d621 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Acquiring lock "65b637f1-baea-4e1c-8b25-e943125eed32" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:40:17 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-6148531b-8a24-4206-807a-d7b34b44d621 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Lock "65b637f1-baea-4e1c-8b25-e943125eed32" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:40:17 user nova-compute[75165]: INFO nova.compute.manager [None req-6148531b-8a24-4206-807a-d7b34b44d621 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] [instance: 65b637f1-baea-4e1c-8b25-e943125eed32] Attaching volume e39ce2d3-cc48-4a4f-b33e-d24f718049e4 to /dev/vdb
Oct 26 00:40:17 user nova-compute[75165]: DEBUG os_brick.utils [None req-6148531b-8a24-4206-807a-d7b34b44d621 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:40:17 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:40:17 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:40:17 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7932562-73ad-44d0-8d95-79a023b43da0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa94814ccb35\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:40:17 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:40:17 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:40:17 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb0a3d37-52d0-4932-9698-0bfa40a06ec9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:40:17 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:40:17 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:40:17 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[670cf1fa-fa58-4ef4-a1a3-6b0cfff04201]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:40:17 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2e75e20-ec70-4e99-9742-8b07541f378c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:40:17 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-6148531b-8a24-4206-807a-d7b34b44d621 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Running cmd (subprocess): nvme version {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:40:17 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-6148531b-8a24-4206-807a-d7b34b44d621 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] 'nvme version' failed. Not Retrying. {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 00:40:17 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6148531b-8a24-4206-807a-d7b34b44d621 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] nvme not present on system {{(pid=75165) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 00:40:17 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:40:17 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 00:40:17 user nova-compute[75165]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 00:40:17 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[69186e0b-6146-42f8-93fd-0a2f97ebcd7b]: (4, '') {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:40:17 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-6148531b-8a24-4206-807a-d7b34b44d621 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75165) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 00:40:17 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-6148531b-8a24-4206-807a-d7b34b44d621 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75165) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 00:40:17 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-6148531b-8a24-4206-807a-d7b34b44d621 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] LIGHTOS: no hostnqn found. {{(pid=75165) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 00:40:17 user nova-compute[75165]: DEBUG os_brick.utils [None req-6148531b-8a24-4206-807a-d7b34b44d621 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa94814ccb35', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:40:17 user nova-compute[75165]: DEBUG nova.virt.block_device [None req-6148531b-8a24-4206-807a-d7b34b44d621 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] [instance: 65b637f1-baea-4e1c-8b25-e943125eed32] Updating existing volume attachment record: 8a0edaf8-f7eb-4065-9860-5a7c242dc7e9 {{(pid=75165) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 00:40:21 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:40:21 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75165) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 00:40:21 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:40:21 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:40:24 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:40:25 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:40:26 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:40:26 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:40:30 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:40:30 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Starting heal instance info cache {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 00:40:30 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Didn't find any instances for network info cache update. {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 26 00:40:30 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:40:30 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:40:31 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:40:31 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:40:31 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:40:32 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-eb5d7bb3-f331-452f-b76a-7f7803e6adb0 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Acquiring lock "7e534595-7eaf-49f4-b457-9f37bc59012b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:40:32 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-eb5d7bb3-f331-452f-b76a-7f7803e6adb0 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Lock "7e534595-7eaf-49f4-b457-9f37bc59012b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:40:32 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-eb5d7bb3-f331-452f-b76a-7f7803e6adb0 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Acquiring lock "7e534595-7eaf-49f4-b457-9f37bc59012b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:40:32 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-eb5d7bb3-f331-452f-b76a-7f7803e6adb0 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Lock "7e534595-7eaf-49f4-b457-9f37bc59012b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:40:32 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-eb5d7bb3-f331-452f-b76a-7f7803e6adb0 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Lock "7e534595-7eaf-49f4-b457-9f37bc59012b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:40:32 user nova-compute[75165]: INFO nova.compute.manager [None req-eb5d7bb3-f331-452f-b76a-7f7803e6adb0 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 7e534595-7eaf-49f4-b457-9f37bc59012b] Terminating instance
Oct 26 00:40:32 user nova-compute[75165]: DEBUG nova.compute.manager [None req-eb5d7bb3-f331-452f-b76a-7f7803e6adb0 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 7e534595-7eaf-49f4-b457-9f37bc59012b] Start destroying the instance on the hypervisor. {{(pid=75165) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 00:40:32 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:40:32 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:40:32 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:40:32 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:40:33 user nova-compute[75165]: DEBUG nova.compute.manager [req-178e0086-47b5-4084-97e6-cbe6de0d978c req-b66a5b67-bc2f-4572-b7bc-1630ddad2c93 service nova] [instance: 7e534595-7eaf-49f4-b457-9f37bc59012b] Received event network-vif-unplugged-d4d7b894-8aba-454c-b803-ec2bf8b28f06 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:40:33 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-178e0086-47b5-4084-97e6-cbe6de0d978c req-b66a5b67-bc2f-4572-b7bc-1630ddad2c93 service nova] Acquiring lock "7e534595-7eaf-49f4-b457-9f37bc59012b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:40:33 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-178e0086-47b5-4084-97e6-cbe6de0d978c req-b66a5b67-bc2f-4572-b7bc-1630ddad2c93 service nova] Lock "7e534595-7eaf-49f4-b457-9f37bc59012b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:40:33 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-178e0086-47b5-4084-97e6-cbe6de0d978c req-b66a5b67-bc2f-4572-b7bc-1630ddad2c93 service nova] Lock "7e534595-7eaf-49f4-b457-9f37bc59012b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:40:33 user nova-compute[75165]: DEBUG nova.compute.manager [req-178e0086-47b5-4084-97e6-cbe6de0d978c req-b66a5b67-bc2f-4572-b7bc-1630ddad2c93 service nova] [instance: 7e534595-7eaf-49f4-b457-9f37bc59012b] No waiting events found dispatching network-vif-unplugged-d4d7b894-8aba-454c-b803-ec2bf8b28f06 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:40:33 user nova-compute[75165]: DEBUG nova.compute.manager [req-178e0086-47b5-4084-97e6-cbe6de0d978c req-b66a5b67-bc2f-4572-b7bc-1630ddad2c93 service nova] [instance: 7e534595-7eaf-49f4-b457-9f37bc59012b] Received event network-vif-unplugged-d4d7b894-8aba-454c-b803-ec2bf8b28f06 for instance with task_state deleting. {{(pid=75165) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 00:40:33 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: 7e534595-7eaf-49f4-b457-9f37bc59012b] Instance destroyed successfully.
Oct 26 00:40:33 user nova-compute[75165]: DEBUG nova.objects.instance [None req-eb5d7bb3-f331-452f-b76a-7f7803e6adb0 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Lazy-loading 'resources' on Instance uuid 7e534595-7eaf-49f4-b457-9f37bc59012b {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:40:33 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-eb5d7bb3-f331-452f-b76a-7f7803e6adb0 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:34:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-784452706',display_name='tempest-AttachVolumeNegativeTest-server-784452706',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-784452706',id=38,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKtMw824Z7EgDd4R1W552g/7i/rLghgv6DuwexHTNlW2g4XWzRvcvbEZvkCl7fiGz0Ti1+2adb9TRidk5JnBlnk3pSHNw97muv+HqsgJx/YFZrIJFKFjgXF2fJtC9akVoA==',key_name='tempest-keypair-1045016299',keypairs=<?>,launch_index=0,launched_at=2023-10-26T00:34:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='62572ce8ae524b55950532fd89729b71',ramdisk_id='',reservation_id='r-xl0z7ws5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-988376295',owner_user_name='tempest-AttachVolumeNegativeTest-988376295-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T00:34:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='041ebe2732c341129d6813549653cab3',uuid=7e534595-7eaf-49f4-b457-9f37bc59012b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d4d7b894-8aba-454c-b803-ec2bf8b28f06", "address": "fa:16:3e:60:42:1c", "network": {"id": "1801db1c-315e-4bdf-b73b-132a38bf41b8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1254756052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62572ce8ae524b55950532fd89729b71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4d7b894-8a", "ovs_interfaceid": "d4d7b894-8aba-454c-b803-ec2bf8b28f06", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 00:40:33 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-eb5d7bb3-f331-452f-b76a-7f7803e6adb0 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Converting VIF {"id": "d4d7b894-8aba-454c-b803-ec2bf8b28f06", "address": "fa:16:3e:60:42:1c", "network": {"id": "1801db1c-315e-4bdf-b73b-132a38bf41b8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1254756052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62572ce8ae524b55950532fd89729b71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4d7b894-8a", "ovs_interfaceid": "d4d7b894-8aba-454c-b803-ec2bf8b28f06", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:40:33 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-eb5d7bb3-f331-452f-b76a-7f7803e6adb0 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:60:42:1c,bridge_name='br-int',has_traffic_filtering=True,id=d4d7b894-8aba-454c-b803-ec2bf8b28f06,network=Network(1801db1c-315e-4bdf-b73b-132a38bf41b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4d7b894-8a') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:40:33 user nova-compute[75165]: DEBUG os_vif [None req-eb5d7bb3-f331-452f-b76a-7f7803e6adb0 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:60:42:1c,bridge_name='br-int',has_traffic_filtering=True,id=d4d7b894-8aba-454c-b803-ec2bf8b28f06,network=Network(1801db1c-315e-4bdf-b73b-132a38bf41b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4d7b894-8a') {{(pid=75165) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 00:40:33 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:40:33 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd4d7b894-8a, bridge=br-int, if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:40:33 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:40:33 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:40:33 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:40:33 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ab0e12fd-4072-4182-a0f4-defc1542e640) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:40:33 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:40:33 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:40:33 user nova-compute[75165]: INFO os_vif [None req-eb5d7bb3-f331-452f-b76a-7f7803e6adb0 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:60:42:1c,bridge_name='br-int',has_traffic_filtering=True,id=d4d7b894-8aba-454c-b803-ec2bf8b28f06,network=Network(1801db1c-315e-4bdf-b73b-132a38bf41b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4d7b894-8a')
Oct 26 00:40:33 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-eb5d7bb3-f331-452f-b76a-7f7803e6adb0 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 7e534595-7eaf-49f4-b457-9f37bc59012b] Deleting instance files /opt/stack/data/nova/instances/7e534595-7eaf-49f4-b457-9f37bc59012b_del
Oct 26 00:40:33 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-eb5d7bb3-f331-452f-b76a-7f7803e6adb0 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 7e534595-7eaf-49f4-b457-9f37bc59012b] Deletion of /opt/stack/data/nova/instances/7e534595-7eaf-49f4-b457-9f37bc59012b_del complete
Oct 26 00:40:33 user nova-compute[75165]: INFO nova.compute.manager [None req-eb5d7bb3-f331-452f-b76a-7f7803e6adb0 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 7e534595-7eaf-49f4-b457-9f37bc59012b] Took 0.91 seconds to destroy the instance on the hypervisor.
Oct 26 00:40:33 user nova-compute[75165]: DEBUG oslo.service.loopingcall [None req-eb5d7bb3-f331-452f-b76a-7f7803e6adb0 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75165) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 00:40:33 user nova-compute[75165]: DEBUG nova.compute.manager [-] [instance: 7e534595-7eaf-49f4-b457-9f37bc59012b] Deallocating network for instance {{(pid=75165) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 00:40:33 user nova-compute[75165]: DEBUG nova.network.neutron [-] [instance: 7e534595-7eaf-49f4-b457-9f37bc59012b] deallocate_for_instance() {{(pid=75165) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 00:40:33 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:40:33 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:40:33 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:40:33 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:40:33 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75165) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 00:40:33 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75165) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 00:40:34 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b637f1-baea-4e1c-8b25-e943125eed32/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:40:34 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b637f1-baea-4e1c-8b25-e943125eed32/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:40:34 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b637f1-baea-4e1c-8b25-e943125eed32/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:40:34 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65b637f1-baea-4e1c-8b25-e943125eed32/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:40:34 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae9fe6f-eb17-44f5-89e4-fff5e3451336/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:40:34 user nova-compute[75165]: DEBUG nova.network.neutron [-] [instance: 7e534595-7eaf-49f4-b457-9f37bc59012b] Updating instance_info_cache with network_info: [] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:40:34 user nova-compute[75165]: INFO nova.compute.manager [-] [instance: 7e534595-7eaf-49f4-b457-9f37bc59012b] Took 0.89 seconds to deallocate network for instance.
Oct 26 00:40:34 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-eb5d7bb3-f331-452f-b76a-7f7803e6adb0 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:40:34 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-eb5d7bb3-f331-452f-b76a-7f7803e6adb0 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:40:34 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae9fe6f-eb17-44f5-89e4-fff5e3451336/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:40:34 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae9fe6f-eb17-44f5-89e4-fff5e3451336/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:40:34 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-eb5d7bb3-f331-452f-b76a-7f7803e6adb0 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:40:34 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-eb5d7bb3-f331-452f-b76a-7f7803e6adb0 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:40:34 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae9fe6f-eb17-44f5-89e4-fff5e3451336/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:40:34 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-eb5d7bb3-f331-452f-b76a-7f7803e6adb0 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.262s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:40:35 user nova-compute[75165]: INFO nova.scheduler.client.report [None req-eb5d7bb3-f331-452f-b76a-7f7803e6adb0 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Deleted allocations for instance 7e534595-7eaf-49f4-b457-9f37bc59012b
Oct 26 00:40:35 user nova-compute[75165]: DEBUG nova.compute.manager [req-a0108cf2-f272-4a4e-853e-e66b95f521b5 req-0247ac2e-8d6a-433e-8085-6933c4de1349 service nova] [instance: 7e534595-7eaf-49f4-b457-9f37bc59012b] Received event network-vif-plugged-d4d7b894-8aba-454c-b803-ec2bf8b28f06 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:40:35 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-a0108cf2-f272-4a4e-853e-e66b95f521b5 req-0247ac2e-8d6a-433e-8085-6933c4de1349 service nova] Acquiring lock "7e534595-7eaf-49f4-b457-9f37bc59012b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:40:35 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-a0108cf2-f272-4a4e-853e-e66b95f521b5 req-0247ac2e-8d6a-433e-8085-6933c4de1349 service nova] Lock "7e534595-7eaf-49f4-b457-9f37bc59012b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:40:35 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-a0108cf2-f272-4a4e-853e-e66b95f521b5 req-0247ac2e-8d6a-433e-8085-6933c4de1349 service nova] Lock "7e534595-7eaf-49f4-b457-9f37bc59012b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:40:35 user nova-compute[75165]: DEBUG nova.compute.manager [req-a0108cf2-f272-4a4e-853e-e66b95f521b5 req-0247ac2e-8d6a-433e-8085-6933c4de1349 service nova] [instance: 7e534595-7eaf-49f4-b457-9f37bc59012b] No waiting events found dispatching network-vif-plugged-d4d7b894-8aba-454c-b803-ec2bf8b28f06 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:40:35 user nova-compute[75165]: WARNING nova.compute.manager [req-a0108cf2-f272-4a4e-853e-e66b95f521b5 req-0247ac2e-8d6a-433e-8085-6933c4de1349 service nova] [instance: 7e534595-7eaf-49f4-b457-9f37bc59012b] Received unexpected event network-vif-plugged-d4d7b894-8aba-454c-b803-ec2bf8b28f06 for instance with vm_state deleted and task_state None.
Oct 26 00:40:35 user nova-compute[75165]: DEBUG nova.compute.manager [req-a0108cf2-f272-4a4e-853e-e66b95f521b5 req-0247ac2e-8d6a-433e-8085-6933c4de1349 service nova] [instance: 7e534595-7eaf-49f4-b457-9f37bc59012b] Received event network-vif-deleted-d4d7b894-8aba-454c-b803-ec2bf8b28f06 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:40:35 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:40:35 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:40:35 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Hypervisor/Node resource view: name=user free_ram=8696MB free_disk=24.757598876953125GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75165) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 00:40:35 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:40:35 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:40:35 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-eb5d7bb3-f331-452f-b76a-7f7803e6adb0 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Lock "7e534595-7eaf-49f4-b457-9f37bc59012b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.652s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:40:35 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 6ae9fe6f-eb17-44f5-89e4-fff5e3451336 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:40:35 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 65b637f1-baea-4e1c-8b25-e943125eed32 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:40:35 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 539bedc3-f788-4d5e-993b-3b168d027a57 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:40:35 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75165) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 00:40:35 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75165) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 00:40:35 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:40:35 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:40:35 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6148531b-8a24-4206-807a-d7b34b44d621 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] [instance: 65b637f1-baea-4e1c-8b25-e943125eed32] Calling os-brick to attach iSCSI Volume {{(pid=75165) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 00:40:35 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-6148531b-8a24-4206-807a-d7b34b44d621 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8bf8160e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e39ce2d3-cc48-4a4f-b33e-d24f718049e4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pkyOhjHg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:40:35 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-6148531b-8a24-4206-807a-d7b34b44d621 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:40:35 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-6148531b-8a24-4206-807a-d7b34b44d621 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:40:35 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-6148531b-8a24-4206-807a-d7b34b44d621 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:40:35 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-6148531b-8a24-4206-807a-d7b34b44d621 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:40:35 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-6148531b-8a24-4206-807a-d7b34b44d621 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e39ce2d3-cc48-4a4f-b33e-d24f718049e4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:40:35 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-6148531b-8a24-4206-807a-d7b34b44d621 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e39ce2d3-cc48-4a4f-b33e-d24f718049e4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:40:35 user nova-compute[75165]: INFO os_brick.initiator.connectors.iscsi [None req-6148531b-8a24-4206-807a-d7b34b44d621 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 00:40:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e39ce2d3-cc48-4a4f-b33e-d24f718049e4 -p 172.16.0.220:3260 {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:40:35 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Compute_service record updated for user:user {{(pid=75165) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 00:40:35 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.318s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:40:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e39ce2d3-cc48-4a4f-b33e-d24f718049e4 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:40:35 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee725954-85d2-4e51-b65b-faf1e509f035]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:40:35 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-6148531b-8a24-4206-807a-d7b34b44d621 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 00:40:35 user nova-compute[75165]:  {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:40:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e39ce2d3-cc48-4a4f-b33e-d24f718049e4 -p 172.16.0.220:3260 --interface default --op new {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:40:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e39ce2d3-cc48-4a4f-b33e-d24f718049e4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:40:35 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[99c262d3-f5dc-46b1-a20a-5d8f1795d2a1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e39ce2d3-cc48-4a4f-b33e-d24f718049e4] added\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:40:35 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-6148531b-8a24-4206-807a-d7b34b44d621 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e39ce2d3-cc48-4a4f-b33e-d24f718049e4] added
Oct 26 00:40:35 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:40:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e39ce2d3-cc48-4a4f-b33e-d24f718049e4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:40:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e39ce2d3-cc48-4a4f-b33e-d24f718049e4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:40:35 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[511454e3-9845-4153-8651-5fc6042c8310]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:40:35 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-6148531b-8a24-4206-807a-d7b34b44d621 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:40:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e39ce2d3-cc48-4a4f-b33e-d24f718049e4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:40:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e39ce2d3-cc48-4a4f-b33e-d24f718049e4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:40:35 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7e555f2-a7b0-4532-b7f5-67b9e217eb5f]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:40:35 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-6148531b-8a24-4206-807a-d7b34b44d621 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:40:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e39ce2d3-cc48-4a4f-b33e-d24f718049e4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pkyOhjHg {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:40:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e39ce2d3-cc48-4a4f-b33e-d24f718049e4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pkyOhjHg" returned: 0 in 0.027s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:40:35 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[a345e1c3-8357-4331-9bfe-79dc7e140bec]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:40:35 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-6148531b-8a24-4206-807a-d7b34b44d621 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pkyOhjHg'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:40:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e39ce2d3-cc48-4a4f-b33e-d24f718049e4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:40:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e39ce2d3-cc48-4a4f-b33e-d24f718049e4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:40:35 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb60856a-bc80-4ae9-b15b-9da5b38b0503]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:40:35 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-6148531b-8a24-4206-807a-d7b34b44d621 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:40:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:40:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:40:35 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[496c7a42-cfd5-49a8-be79-41ecdd272d91]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67c880f5-c46a-4e45-b73a-a052fca3638c (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:40:35 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-6148531b-8a24-4206-807a-d7b34b44d621 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67c880f5-c46a-4e45-b73a-a052fca3638c (non-flash)
Oct 26 00:40:35 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:40:35 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-6148531b-8a24-4206-807a-d7b34b44d621 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67c880f5-c46a-4e45-b73a-a052fca3638c (non-flash)
Oct 26 00:40:35 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:40:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e39ce2d3-cc48-4a4f-b33e-d24f718049e4 -p 172.16.0.220:3260 --login {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:40:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e39ce2d3-cc48-4a4f-b33e-d24f718049e4 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:40:35 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[b04124f9-195d-4571-86ff-26805a4ac20b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e39ce2d3-cc48-4a4f-b33e-d24f718049e4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e39ce2d3-cc48-4a4f-b33e-d24f718049e4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:40:35 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-6148531b-8a24-4206-807a-d7b34b44d621 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e39ce2d3-cc48-4a4f-b33e-d24f718049e4, portal: 172.16.0.220,3260]
Oct 26 00:40:35 user nova-compute[75165]: Login to [iface: default, target: iqn.2010-10.org.openstack:e39ce2d3-cc48-4a4f-b33e-d24f718049e4, portal: 172.16.0.220,3260] successful.
Oct 26 00:40:35 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:40:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e39ce2d3-cc48-4a4f-b33e-d24f718049e4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:40:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e39ce2d3-cc48-4a4f-b33e-d24f718049e4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:40:35 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[18cd6dfb-e883-4101-a6c0-632a8b0a0768]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:40:35 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-6148531b-8a24-4206-807a-d7b34b44d621 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:40:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:40:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:40:35 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec8f2952-ebbf-4ad6-9013-37d4d949c5ab]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67c880f5-c46a-4e45-b73a-a052fca3638c (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e39ce2d3-cc48-4a4f-b33e-d24f718049e4 (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:40:35 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-6148531b-8a24-4206-807a-d7b34b44d621 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67c880f5-c46a-4e45-b73a-a052fca3638c (non-flash)
Oct 26 00:40:35 user nova-compute[75165]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e39ce2d3-cc48-4a4f-b33e-d24f718049e4 (non-flash)
Oct 26 00:40:35 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:40:35 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-6148531b-8a24-4206-807a-d7b34b44d621 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67c880f5-c46a-4e45-b73a-a052fca3638c (non-flash)
Oct 26 00:40:35 user nova-compute[75165]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e39ce2d3-cc48-4a4f-b33e-d24f718049e4 (non-flash)
Oct 26 00:40:35 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:40:35 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-6148531b-8a24-4206-807a-d7b34b44d621 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e39ce2d3-cc48-4a4f-b33e-d24f718049e4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:40:35 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-6148531b-8a24-4206-807a-d7b34b44d621 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Connected to 172.16.0.220:3260 {{(pid=75165) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 00:40:35 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-6148531b-8a24-4206-807a-d7b34b44d621 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] HCTL ('34', '-', '-', 0) found on session 47 with lun 0 {{(pid=75165) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 00:40:35 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-6148531b-8a24-4206-807a-d7b34b44d621 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75165) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 00:40:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:40:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:40:35 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aba6852-cfcb-4401-a65a-3b53a1af6197]: (4, ('- - 0', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:40:35 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-6148531b-8a24-4206-807a-d7b34b44d621 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Searching for a device in session 47 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75165) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 00:40:35 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-6148531b-8a24-4206-807a-d7b34b44d621 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:e39ce2d3-cc48-4a4f-b33e-d24f718049e4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pkyOhjHg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75165) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 00:40:36 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-6148531b-8a24-4206-807a-d7b34b44d621 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.319s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:40:36 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-6148531b-8a24-4206-807a-d7b34b44d621 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] <== connect_volume: return (1322ms) {'type': 'block', 'scsi_wwn': '26431383162396161', 'path': '/dev/sdc'} {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:40:36 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6148531b-8a24-4206-807a-d7b34b44d621 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] [instance: 65b637f1-baea-4e1c-8b25-e943125eed32] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26431383162396161', 'path': '/dev/sdc'} {{(pid=75165) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 00:40:36 user nova-compute[75165]: DEBUG nova.objects.instance [None req-6148531b-8a24-4206-807a-d7b34b44d621 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Lazy-loading 'flavor' on Instance uuid 65b637f1-baea-4e1c-8b25-e943125eed32 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:40:36 user nova-compute[75165]: DEBUG nova.virt.libvirt.guest [None req-6148531b-8a24-4206-807a-d7b34b44d621 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 00:40:36 user nova-compute[75165]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 00:40:36 user nova-compute[75165]:   <source dev="/dev/sdc"/>
Oct 26 00:40:36 user nova-compute[75165]:   <target dev="vdb" bus="virtio"/>
Oct 26 00:40:36 user nova-compute[75165]:   <serial>e39ce2d3-cc48-4a4f-b33e-d24f718049e4</serial>
Oct 26 00:40:36 user nova-compute[75165]: </disk>
Oct 26 00:40:36 user nova-compute[75165]:  {{(pid=75165) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 00:40:37 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-6148531b-8a24-4206-807a-d7b34b44d621 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] No BDM found with device name vda, not building metadata. {{(pid=75165) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 00:40:37 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-6148531b-8a24-4206-807a-d7b34b44d621 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75165) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 00:40:37 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-6148531b-8a24-4206-807a-d7b34b44d621 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] No VIF found with MAC fa:16:3e:0f:8c:52, not building metadata {{(pid=75165) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 00:40:37 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-6148531b-8a24-4206-807a-d7b34b44d621 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Lock "65b637f1-baea-4e1c-8b25-e943125eed32" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.812s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:40:37 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:40:38 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:40:39 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-f32c580b-ea05-4396-8d6e-e5418a9d9392 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Acquiring lock "65b637f1-baea-4e1c-8b25-e943125eed32" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:40:39 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-f32c580b-ea05-4396-8d6e-e5418a9d9392 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Lock "65b637f1-baea-4e1c-8b25-e943125eed32" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:40:39 user nova-compute[75165]: INFO nova.compute.manager [None req-f32c580b-ea05-4396-8d6e-e5418a9d9392 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] [instance: 65b637f1-baea-4e1c-8b25-e943125eed32] Detaching volume e39ce2d3-cc48-4a4f-b33e-d24f718049e4
Oct 26 00:40:39 user nova-compute[75165]: INFO nova.virt.block_device [None req-f32c580b-ea05-4396-8d6e-e5418a9d9392 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] [instance: 65b637f1-baea-4e1c-8b25-e943125eed32] Attempting to driver detach volume e39ce2d3-cc48-4a4f-b33e-d24f718049e4 from mountpoint /dev/vdb
Oct 26 00:40:39 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-f32c580b-ea05-4396-8d6e-e5418a9d9392 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Attempting to detach device vdb from instance 65b637f1-baea-4e1c-8b25-e943125eed32 from the persistent domain config. {{(pid=75165) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 00:40:39 user nova-compute[75165]: DEBUG nova.virt.libvirt.guest [None req-f32c580b-ea05-4396-8d6e-e5418a9d9392 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 00:40:39 user nova-compute[75165]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 00:40:39 user nova-compute[75165]:   <source dev="/dev/sdc"/>
Oct 26 00:40:39 user nova-compute[75165]:   <target dev="vdb" bus="virtio"/>
Oct 26 00:40:39 user nova-compute[75165]:   <serial>e39ce2d3-cc48-4a4f-b33e-d24f718049e4</serial>
Oct 26 00:40:39 user nova-compute[75165]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 00:40:39 user nova-compute[75165]: </disk>
Oct 26 00:40:39 user nova-compute[75165]:  {{(pid=75165) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 00:40:39 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-f32c580b-ea05-4396-8d6e-e5418a9d9392 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Successfully detached device vdb from instance 65b637f1-baea-4e1c-8b25-e943125eed32 from the persistent domain config.
Oct 26 00:40:39 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-f32c580b-ea05-4396-8d6e-e5418a9d9392 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 65b637f1-baea-4e1c-8b25-e943125eed32 from the live domain config. {{(pid=75165) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 00:40:39 user nova-compute[75165]: DEBUG nova.virt.libvirt.guest [None req-f32c580b-ea05-4396-8d6e-e5418a9d9392 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 00:40:39 user nova-compute[75165]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 00:40:39 user nova-compute[75165]:   <source dev="/dev/sdc"/>
Oct 26 00:40:39 user nova-compute[75165]:   <target dev="vdb" bus="virtio"/>
Oct 26 00:40:39 user nova-compute[75165]:   <serial>e39ce2d3-cc48-4a4f-b33e-d24f718049e4</serial>
Oct 26 00:40:39 user nova-compute[75165]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 00:40:39 user nova-compute[75165]: </disk>
Oct 26 00:40:39 user nova-compute[75165]:  {{(pid=75165) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 00:40:39 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-f32c580b-ea05-4396-8d6e-e5418a9d9392 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 65b637f1-baea-4e1c-8b25-e943125eed32 {{(pid=75165) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 00:40:41 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:40:43 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:40:46 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:40:48 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:40:53 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:40:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:40:59 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-f32c580b-ea05-4396-8d6e-e5418a9d9392 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 65b637f1-baea-4e1c-8b25-e943125eed32 is timed out.
Oct 26 00:40:59 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-f32c580b-ea05-4396-8d6e-e5418a9d9392 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Successfully detached device vdb from instance 65b637f1-baea-4e1c-8b25-e943125eed32 from the live domain config.
Oct 26 00:40:59 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f32c580b-ea05-4396-8d6e-e5418a9d9392 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] [instance: 65b637f1-baea-4e1c-8b25-e943125eed32] calling os-brick to detach iSCSI Volume {{(pid=75165) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 00:40:59 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-f32c580b-ea05-4396-8d6e-e5418a9d9392 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8bf8160e50>, {'target_iqn': 'iqn.2010-10.org.openstack:e39ce2d3-cc48-4a4f-b33e-d24f718049e4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pkyOhjHg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:40:59 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-f32c580b-ea05-4396-8d6e-e5418a9d9392 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:40:59 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-f32c580b-ea05-4396-8d6e-e5418a9d9392 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:40:59 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-f32c580b-ea05-4396-8d6e-e5418a9d9392 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:40:59 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:40:59 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:40:59 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5a5e64c-02d9-41e6-87ca-20d3e6d5a46f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:67c880f5-c46a-4e45-b73a-a052fca3638c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e39ce2d3-cc48-4a4f-b33e-d24f718049e4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:40:59 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-f32c580b-ea05-4396-8d6e-e5418a9d9392 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 00:40:59 user nova-compute[75165]: No targets found.
Oct 26 00:40:59 user nova-compute[75165]: iSNS:
Oct 26 00:40:59 user nova-compute[75165]: No targets found.
Oct 26 00:40:59 user nova-compute[75165]: STATIC:
Oct 26 00:40:59 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:67c880f5-c46a-4e45-b73a-a052fca3638c
Oct 26 00:40:59 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:40:59 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:40:59 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:e39ce2d3-cc48-4a4f-b33e-d24f718049e4
Oct 26 00:40:59 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:40:59 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:40:59 user nova-compute[75165]: FIRMWARE:
Oct 26 00:40:59 user nova-compute[75165]: No targets found.
Oct 26 00:40:59 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:40:59 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-f32c580b-ea05-4396-8d6e-e5418a9d9392 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 00:40:59 user nova-compute[75165]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 00:40:59 user nova-compute[75165]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75165) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 00:40:59 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-f32c580b-ea05-4396-8d6e-e5418a9d9392 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e39ce2d3-cc48-4a4f-b33e-d24f718049e4', 0)] {{(pid=75165) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 00:40:59 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:40:59 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:40:59 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bcd50fc-7401-4d2c-a96d-37e254dee7e5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:67c880f5-c46a-4e45-b73a-a052fca3638c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e39ce2d3-cc48-4a4f-b33e-d24f718049e4\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:40:59 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:40:59 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:40:59 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e9fd7ae-6534-49a9-bba2-42e2b627a2d7]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67c880f5-c46a-4e45-b73a-a052fca3638c (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e39ce2d3-cc48-4a4f-b33e-d24f718049e4 (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:40:59 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-f32c580b-ea05-4396-8d6e-e5418a9d9392 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67c880f5-c46a-4e45-b73a-a052fca3638c (non-flash)
Oct 26 00:40:59 user nova-compute[75165]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e39ce2d3-cc48-4a4f-b33e-d24f718049e4 (non-flash)
Oct 26 00:40:59 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:40:59 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-f32c580b-ea05-4396-8d6e-e5418a9d9392 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67c880f5-c46a-4e45-b73a-a052fca3638c (non-flash)
Oct 26 00:40:59 user nova-compute[75165]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e39ce2d3-cc48-4a4f-b33e-d24f718049e4 (non-flash)
Oct 26 00:40:59 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:40:59 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-f32c580b-ea05-4396-8d6e-e5418a9d9392 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8be02c8310>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e39ce2d3-cc48-4a4f-b33e-d24f718049e4'): ({'sdc'}, set())}) {{(pid=75165) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 00:40:59 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-f32c580b-ea05-4396-8d6e-e5418a9d9392 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Removing single pathed devices sdc {{(pid=75165) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 00:40:59 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:40:59 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:40:59 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d54e53e-1fc5-4f98-8df6-f78c0be27561]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:40:59 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:40:59 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:40:59 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[97be71a8-7b74-4bce-8d68-62527d8acba9]: (4, ('ok\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:40:59 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-f32c580b-ea05-4396-8d6e-e5418a9d9392 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Flushing IO for device /dev/sdc {{(pid=75165) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 00:40:59 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:40:59 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:40:59 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[17c0c4f8-2063-4354-abeb-d26b7cf205d8]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:40:59 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-f32c580b-ea05-4396-8d6e-e5418a9d9392 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75165) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 00:40:59 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:41:00 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:41:00 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[40c45bd1-84d4-43a6-a4e2-f5d016798d4c]: (4, ('1', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:41:00 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-f32c580b-ea05-4396-8d6e-e5418a9d9392 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75165) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 00:41:00 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-f32c580b-ea05-4396-8d6e-e5418a9d9392 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] SCSI volumes sdc have been removed. {{(pid=75165) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 00:41:00 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-f32c580b-ea05-4396-8d6e-e5418a9d9392 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e39ce2d3-cc48-4a4f-b33e-d24f718049e4')] {{(pid=75165) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 00:41:00 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e39ce2d3-cc48-4a4f-b33e-d24f718049e4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:41:00 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e39ce2d3-cc48-4a4f-b33e-d24f718049e4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:41:00 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c990e0f-f6df-4d2b-8fd4-a7f3ffa8794c]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:41:00 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-f32c580b-ea05-4396-8d6e-e5418a9d9392 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:41:00 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e39ce2d3-cc48-4a4f-b33e-d24f718049e4 -p 172.16.0.220:3260 --logout {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:41:00 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e39ce2d3-cc48-4a4f-b33e-d24f718049e4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:41:00 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[8015a5a6-b236-448a-b1f8-b070afa4b4b4]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:e39ce2d3-cc48-4a4f-b33e-d24f718049e4, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:e39ce2d3-cc48-4a4f-b33e-d24f718049e4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:41:00 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-f32c580b-ea05-4396-8d6e-e5418a9d9392 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:e39ce2d3-cc48-4a4f-b33e-d24f718049e4, portal: 172.16.0.220,3260]
Oct 26 00:41:00 user nova-compute[75165]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:e39ce2d3-cc48-4a4f-b33e-d24f718049e4, portal: 172.16.0.220,3260] successful.
Oct 26 00:41:00 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:41:00 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e39ce2d3-cc48-4a4f-b33e-d24f718049e4 -p 172.16.0.220:3260 --op delete {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:41:00 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e39ce2d3-cc48-4a4f-b33e-d24f718049e4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:41:00 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce7b8d38-6eff-4d5a-87e0-27dca1cf2c75]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:41:00 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-f32c580b-ea05-4396-8d6e-e5418a9d9392 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:41:00 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-f32c580b-ea05-4396-8d6e-e5418a9d9392 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.295s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:41:00 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-f32c580b-ea05-4396-8d6e-e5418a9d9392 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] <== disconnect_volume: return (296ms) None {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:41:00 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f32c580b-ea05-4396-8d6e-e5418a9d9392 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] [instance: 65b637f1-baea-4e1c-8b25-e943125eed32] Disconnected iSCSI Volume {{(pid=75165) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 00:41:00 user nova-compute[75165]: DEBUG nova.objects.instance [None req-f32c580b-ea05-4396-8d6e-e5418a9d9392 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Lazy-loading 'flavor' on Instance uuid 65b637f1-baea-4e1c-8b25-e943125eed32 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:41:01 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-f32c580b-ea05-4396-8d6e-e5418a9d9392 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Lock "65b637f1-baea-4e1c-8b25-e943125eed32" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.733s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:41:02 user nova-compute[75165]: DEBUG nova.compute.manager [req-dd6208ac-0acc-47a1-a3ac-2151b08cdaea req-b8334123-ae54-4b80-b14b-a798a6651a17 service nova] [instance: 539bedc3-f788-4d5e-993b-3b168d027a57] Received event network-changed-cf882314-eb1e-4555-b87d-4e010947f66f {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:41:02 user nova-compute[75165]: DEBUG nova.compute.manager [req-dd6208ac-0acc-47a1-a3ac-2151b08cdaea req-b8334123-ae54-4b80-b14b-a798a6651a17 service nova] [instance: 539bedc3-f788-4d5e-993b-3b168d027a57] Refreshing instance network info cache due to event network-changed-cf882314-eb1e-4555-b87d-4e010947f66f. {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 00:41:02 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-dd6208ac-0acc-47a1-a3ac-2151b08cdaea req-b8334123-ae54-4b80-b14b-a798a6651a17 service nova] Acquiring lock "refresh_cache-539bedc3-f788-4d5e-993b-3b168d027a57" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:41:02 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-dd6208ac-0acc-47a1-a3ac-2151b08cdaea req-b8334123-ae54-4b80-b14b-a798a6651a17 service nova] Acquired lock "refresh_cache-539bedc3-f788-4d5e-993b-3b168d027a57" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:41:02 user nova-compute[75165]: DEBUG nova.network.neutron [req-dd6208ac-0acc-47a1-a3ac-2151b08cdaea req-b8334123-ae54-4b80-b14b-a798a6651a17 service nova] [instance: 539bedc3-f788-4d5e-993b-3b168d027a57] Refreshing network info cache for port cf882314-eb1e-4555-b87d-4e010947f66f {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 00:41:02 user nova-compute[75165]: DEBUG nova.network.neutron [req-dd6208ac-0acc-47a1-a3ac-2151b08cdaea req-b8334123-ae54-4b80-b14b-a798a6651a17 service nova] [instance: 539bedc3-f788-4d5e-993b-3b168d027a57] Updated VIF entry in instance network info cache for port cf882314-eb1e-4555-b87d-4e010947f66f. {{(pid=75165) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 00:41:02 user nova-compute[75165]: DEBUG nova.network.neutron [req-dd6208ac-0acc-47a1-a3ac-2151b08cdaea req-b8334123-ae54-4b80-b14b-a798a6651a17 service nova] [instance: 539bedc3-f788-4d5e-993b-3b168d027a57] Updating instance_info_cache with network_info: [{"id": "cf882314-eb1e-4555-b87d-4e010947f66f", "address": "fa:16:3e:dc:7e:ca", "network": {"id": "dc50ae7b-d501-461f-aa0b-542514330ae8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1091857056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1051405ca054c4bb051fb842a5fb5a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf882314-eb", "ovs_interfaceid": "cf882314-eb1e-4555-b87d-4e010947f66f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:41:02 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-dd6208ac-0acc-47a1-a3ac-2151b08cdaea req-b8334123-ae54-4b80-b14b-a798a6651a17 service nova] Releasing lock "refresh_cache-539bedc3-f788-4d5e-993b-3b168d027a57" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:41:03 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:41:06 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:41:08 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:41:08 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:41:11 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:41:13 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:41:13 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:41:15 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:41:16 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:41:17 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-4d3018c1-54ca-4516-910a-d16a44f42685 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Acquiring lock "bbb1769b-f252-4a6a-9932-a2e962595926" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:41:17 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-4d3018c1-54ca-4516-910a-d16a44f42685 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Lock "bbb1769b-f252-4a6a-9932-a2e962595926" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:41:17 user nova-compute[75165]: DEBUG nova.compute.manager [None req-4d3018c1-54ca-4516-910a-d16a44f42685 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: bbb1769b-f252-4a6a-9932-a2e962595926] Starting instance... {{(pid=75165) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 00:41:17 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-4d3018c1-54ca-4516-910a-d16a44f42685 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:41:17 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-4d3018c1-54ca-4516-910a-d16a44f42685 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:41:17 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-4d3018c1-54ca-4516-910a-d16a44f42685 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75165) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 00:41:17 user nova-compute[75165]: INFO nova.compute.claims [None req-4d3018c1-54ca-4516-910a-d16a44f42685 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: bbb1769b-f252-4a6a-9932-a2e962595926] Claim successful on node user
Oct 26 00:41:17 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-4d3018c1-54ca-4516-910a-d16a44f42685 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:41:17 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-4d3018c1-54ca-4516-910a-d16a44f42685 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:41:17 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-4d3018c1-54ca-4516-910a-d16a44f42685 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.261s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:41:17 user nova-compute[75165]: DEBUG nova.compute.manager [None req-4d3018c1-54ca-4516-910a-d16a44f42685 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: bbb1769b-f252-4a6a-9932-a2e962595926] Start building networks asynchronously for instance. {{(pid=75165) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 00:41:18 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-4d3018c1-54ca-4516-910a-d16a44f42685 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: bbb1769b-f252-4a6a-9932-a2e962595926] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 00:41:18 user nova-compute[75165]: DEBUG nova.compute.manager [None req-4d3018c1-54ca-4516-910a-d16a44f42685 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: bbb1769b-f252-4a6a-9932-a2e962595926] Allocating IP information in the background. {{(pid=75165) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 00:41:18 user nova-compute[75165]: DEBUG nova.network.neutron [None req-4d3018c1-54ca-4516-910a-d16a44f42685 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: bbb1769b-f252-4a6a-9932-a2e962595926] allocate_for_instance() {{(pid=75165) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 00:41:18 user nova-compute[75165]: DEBUG nova.compute.manager [None req-4d3018c1-54ca-4516-910a-d16a44f42685 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: bbb1769b-f252-4a6a-9932-a2e962595926] Start building block device mappings for instance. {{(pid=75165) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 00:41:18 user nova-compute[75165]: INFO nova.virt.block_device [None req-4d3018c1-54ca-4516-910a-d16a44f42685 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: bbb1769b-f252-4a6a-9932-a2e962595926] Booting with volume snapshot d5844236-ce81-4893-85a1-b643d6c192f0 at /dev/vda
Oct 26 00:41:18 user nova-compute[75165]: DEBUG nova.policy [None req-4d3018c1-54ca-4516-910a-d16a44f42685 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ae836eab78514cf3894e5e11240ff374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1051405ca054c4bb051fb842a5fb5a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75165) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 00:41:18 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:41:19 user nova-compute[75165]: DEBUG nova.network.neutron [None req-4d3018c1-54ca-4516-910a-d16a44f42685 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: bbb1769b-f252-4a6a-9932-a2e962595926] Successfully created port: c45711bb-b4a3-4471-853d-88ef000a2e63 {{(pid=75165) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 00:41:20 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:41:20 user nova-compute[75165]: DEBUG nova.network.neutron [None req-4d3018c1-54ca-4516-910a-d16a44f42685 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: bbb1769b-f252-4a6a-9932-a2e962595926] Successfully updated port: c45711bb-b4a3-4471-853d-88ef000a2e63 {{(pid=75165) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 00:41:20 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-4d3018c1-54ca-4516-910a-d16a44f42685 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Acquiring lock "refresh_cache-bbb1769b-f252-4a6a-9932-a2e962595926" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:41:20 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-4d3018c1-54ca-4516-910a-d16a44f42685 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Acquired lock "refresh_cache-bbb1769b-f252-4a6a-9932-a2e962595926" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:41:20 user nova-compute[75165]: DEBUG nova.network.neutron [None req-4d3018c1-54ca-4516-910a-d16a44f42685 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: bbb1769b-f252-4a6a-9932-a2e962595926] Building network info cache for instance {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 00:41:20 user nova-compute[75165]: DEBUG nova.compute.manager [req-a128c61f-0c11-4b9e-bd03-2331750207c7 req-4ccf217b-3ae5-459e-b7ec-8ffdf78c3fad service nova] [instance: bbb1769b-f252-4a6a-9932-a2e962595926] Received event network-changed-c45711bb-b4a3-4471-853d-88ef000a2e63 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:41:20 user nova-compute[75165]: DEBUG nova.compute.manager [req-a128c61f-0c11-4b9e-bd03-2331750207c7 req-4ccf217b-3ae5-459e-b7ec-8ffdf78c3fad service nova] [instance: bbb1769b-f252-4a6a-9932-a2e962595926] Refreshing instance network info cache due to event network-changed-c45711bb-b4a3-4471-853d-88ef000a2e63. {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 00:41:20 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-a128c61f-0c11-4b9e-bd03-2331750207c7 req-4ccf217b-3ae5-459e-b7ec-8ffdf78c3fad service nova] Acquiring lock "refresh_cache-bbb1769b-f252-4a6a-9932-a2e962595926" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:41:20 user nova-compute[75165]: DEBUG nova.network.neutron [None req-4d3018c1-54ca-4516-910a-d16a44f42685 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: bbb1769b-f252-4a6a-9932-a2e962595926] Instance cache missing network info. {{(pid=75165) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 00:41:21 user nova-compute[75165]: DEBUG nova.network.neutron [None req-4d3018c1-54ca-4516-910a-d16a44f42685 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: bbb1769b-f252-4a6a-9932-a2e962595926] Updating instance_info_cache with network_info: [{"id": "c45711bb-b4a3-4471-853d-88ef000a2e63", "address": "fa:16:3e:8f:4d:97", "network": {"id": "dc50ae7b-d501-461f-aa0b-542514330ae8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1091857056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1051405ca054c4bb051fb842a5fb5a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc45711bb-b4", "ovs_interfaceid": "c45711bb-b4a3-4471-853d-88ef000a2e63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:41:21 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-4d3018c1-54ca-4516-910a-d16a44f42685 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Releasing lock "refresh_cache-bbb1769b-f252-4a6a-9932-a2e962595926" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:41:21 user nova-compute[75165]: DEBUG nova.compute.manager [None req-4d3018c1-54ca-4516-910a-d16a44f42685 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: bbb1769b-f252-4a6a-9932-a2e962595926] Instance network_info: |[{"id": "c45711bb-b4a3-4471-853d-88ef000a2e63", "address": "fa:16:3e:8f:4d:97", "network": {"id": "dc50ae7b-d501-461f-aa0b-542514330ae8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1091857056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1051405ca054c4bb051fb842a5fb5a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc45711bb-b4", "ovs_interfaceid": "c45711bb-b4a3-4471-853d-88ef000a2e63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75165) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 00:41:21 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-a128c61f-0c11-4b9e-bd03-2331750207c7 req-4ccf217b-3ae5-459e-b7ec-8ffdf78c3fad service nova] Acquired lock "refresh_cache-bbb1769b-f252-4a6a-9932-a2e962595926" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:41:21 user nova-compute[75165]: DEBUG nova.network.neutron [req-a128c61f-0c11-4b9e-bd03-2331750207c7 req-4ccf217b-3ae5-459e-b7ec-8ffdf78c3fad service nova] [instance: bbb1769b-f252-4a6a-9932-a2e962595926] Refreshing network info cache for port c45711bb-b4a3-4471-853d-88ef000a2e63 {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 00:41:21 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:41:22 user nova-compute[75165]: DEBUG nova.network.neutron [req-a128c61f-0c11-4b9e-bd03-2331750207c7 req-4ccf217b-3ae5-459e-b7ec-8ffdf78c3fad service nova] [instance: bbb1769b-f252-4a6a-9932-a2e962595926] Updated VIF entry in instance network info cache for port c45711bb-b4a3-4471-853d-88ef000a2e63. {{(pid=75165) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 00:41:22 user nova-compute[75165]: DEBUG nova.network.neutron [req-a128c61f-0c11-4b9e-bd03-2331750207c7 req-4ccf217b-3ae5-459e-b7ec-8ffdf78c3fad service nova] [instance: bbb1769b-f252-4a6a-9932-a2e962595926] Updating instance_info_cache with network_info: [{"id": "c45711bb-b4a3-4471-853d-88ef000a2e63", "address": "fa:16:3e:8f:4d:97", "network": {"id": "dc50ae7b-d501-461f-aa0b-542514330ae8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1091857056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1051405ca054c4bb051fb842a5fb5a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc45711bb-b4", "ovs_interfaceid": "c45711bb-b4a3-4471-853d-88ef000a2e63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:41:22 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-a128c61f-0c11-4b9e-bd03-2331750207c7 req-4ccf217b-3ae5-459e-b7ec-8ffdf78c3fad service nova] Releasing lock "refresh_cache-bbb1769b-f252-4a6a-9932-a2e962595926" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:41:22 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:41:22 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75165) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 00:41:23 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:41:23 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:41:23 user nova-compute[75165]: DEBUG os_brick.utils [None req-4d3018c1-54ca-4516-910a-d16a44f42685 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:41:23 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:41:23 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:41:23 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d2c8ff0-6b27-4d2f-979c-2107cdf6ebff]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa94814ccb35\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:41:23 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:41:23 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:41:23 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bb6e4af-bb6f-4f26-bd54-b0f7ec903a48]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:41:23 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:41:23 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:41:23 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[844239fb-2cbb-4d5a-bc49-98c708b5e1f3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:41:23 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[428e792e-6730-40eb-ad30-fdafc46b4064]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:41:23 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-4d3018c1-54ca-4516-910a-d16a44f42685 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Running cmd (subprocess): nvme version {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:41:23 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-4d3018c1-54ca-4516-910a-d16a44f42685 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] 'nvme version' failed. Not Retrying. {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 00:41:23 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4d3018c1-54ca-4516-910a-d16a44f42685 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] nvme not present on system {{(pid=75165) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 00:41:23 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:41:23 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 00:41:23 user nova-compute[75165]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 00:41:23 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a82dda4-1be3-42d8-a155-73bd8a18714e]: (4, '') {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:41:23 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-4d3018c1-54ca-4516-910a-d16a44f42685 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75165) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 00:41:23 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-4d3018c1-54ca-4516-910a-d16a44f42685 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75165) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 00:41:23 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-4d3018c1-54ca-4516-910a-d16a44f42685 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] LIGHTOS: no hostnqn found. {{(pid=75165) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 00:41:23 user nova-compute[75165]: DEBUG os_brick.utils [None req-4d3018c1-54ca-4516-910a-d16a44f42685 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa94814ccb35', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:41:23 user nova-compute[75165]: DEBUG nova.virt.block_device [None req-4d3018c1-54ca-4516-910a-d16a44f42685 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: bbb1769b-f252-4a6a-9932-a2e962595926] Updating existing volume attachment record: 896e62c2-fa64-464e-8fda-e2f42ba3ebdc {{(pid=75165) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 00:41:25 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:41:26 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-bef452bf-259d-492a-abbd-3b16a54377ec tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Acquiring lock "7c62961f-e928-4df6-9c4e-74f035dde9a2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:41:26 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-bef452bf-259d-492a-abbd-3b16a54377ec tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Lock "7c62961f-e928-4df6-9c4e-74f035dde9a2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:41:26 user nova-compute[75165]: DEBUG nova.compute.manager [None req-bef452bf-259d-492a-abbd-3b16a54377ec tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 7c62961f-e928-4df6-9c4e-74f035dde9a2] Starting instance... {{(pid=75165) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 00:41:26 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-bef452bf-259d-492a-abbd-3b16a54377ec tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:41:26 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-bef452bf-259d-492a-abbd-3b16a54377ec tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:41:26 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-bef452bf-259d-492a-abbd-3b16a54377ec tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75165) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 00:41:26 user nova-compute[75165]: INFO nova.compute.claims [None req-bef452bf-259d-492a-abbd-3b16a54377ec tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 7c62961f-e928-4df6-9c4e-74f035dde9a2] Claim successful on node user
Oct 26 00:41:26 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-bef452bf-259d-492a-abbd-3b16a54377ec tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:41:26 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-bef452bf-259d-492a-abbd-3b16a54377ec tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:41:26 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:41:26 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-bef452bf-259d-492a-abbd-3b16a54377ec tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.397s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:41:26 user nova-compute[75165]: DEBUG nova.compute.manager [None req-bef452bf-259d-492a-abbd-3b16a54377ec tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 7c62961f-e928-4df6-9c4e-74f035dde9a2] Start building networks asynchronously for instance. {{(pid=75165) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 00:41:27 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-f3f280de-e788-4dc2-a561-eda6ab339fb5 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Acquiring lock "50c16604-2066-4cd2-a74e-c47a2dc4c449" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:41:27 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-f3f280de-e788-4dc2-a561-eda6ab339fb5 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Lock "50c16604-2066-4cd2-a74e-c47a2dc4c449" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:41:27 user nova-compute[75165]: DEBUG nova.compute.manager [None req-bef452bf-259d-492a-abbd-3b16a54377ec tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 7c62961f-e928-4df6-9c4e-74f035dde9a2] Allocating IP information in the background. {{(pid=75165) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 00:41:27 user nova-compute[75165]: DEBUG nova.network.neutron [None req-bef452bf-259d-492a-abbd-3b16a54377ec tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 7c62961f-e928-4df6-9c4e-74f035dde9a2] allocate_for_instance() {{(pid=75165) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 00:41:27 user nova-compute[75165]: DEBUG nova.compute.manager [None req-f3f280de-e788-4dc2-a561-eda6ab339fb5 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] [instance: 50c16604-2066-4cd2-a74e-c47a2dc4c449] Starting instance... {{(pid=75165) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 00:41:27 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-bef452bf-259d-492a-abbd-3b16a54377ec tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 7c62961f-e928-4df6-9c4e-74f035dde9a2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 00:41:27 user nova-compute[75165]: DEBUG nova.compute.manager [None req-bef452bf-259d-492a-abbd-3b16a54377ec tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 7c62961f-e928-4df6-9c4e-74f035dde9a2] Start building block device mappings for instance. {{(pid=75165) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 00:41:27 user nova-compute[75165]: DEBUG nova.policy [None req-bef452bf-259d-492a-abbd-3b16a54377ec tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '041ebe2732c341129d6813549653cab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62572ce8ae524b55950532fd89729b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75165) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 00:41:27 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-f3f280de-e788-4dc2-a561-eda6ab339fb5 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:41:27 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-f3f280de-e788-4dc2-a561-eda6ab339fb5 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:41:27 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-f3f280de-e788-4dc2-a561-eda6ab339fb5 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75165) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 00:41:27 user nova-compute[75165]: INFO nova.compute.claims [None req-f3f280de-e788-4dc2-a561-eda6ab339fb5 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] [instance: 50c16604-2066-4cd2-a74e-c47a2dc4c449] Claim successful on node user
Oct 26 00:41:27 user nova-compute[75165]: DEBUG nova.compute.manager [None req-bef452bf-259d-492a-abbd-3b16a54377ec tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 7c62961f-e928-4df6-9c4e-74f035dde9a2] Start spawning the instance on the hypervisor. {{(pid=75165) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 00:41:27 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-bef452bf-259d-492a-abbd-3b16a54377ec tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 7c62961f-e928-4df6-9c4e-74f035dde9a2] Creating instance directory {{(pid=75165) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 00:41:27 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-bef452bf-259d-492a-abbd-3b16a54377ec tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 7c62961f-e928-4df6-9c4e-74f035dde9a2] Creating image(s)
Oct 26 00:41:27 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-bef452bf-259d-492a-abbd-3b16a54377ec tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Acquiring lock "/opt/stack/data/nova/instances/7c62961f-e928-4df6-9c4e-74f035dde9a2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:41:27 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-bef452bf-259d-492a-abbd-3b16a54377ec tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Lock "/opt/stack/data/nova/instances/7c62961f-e928-4df6-9c4e-74f035dde9a2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:41:27 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-bef452bf-259d-492a-abbd-3b16a54377ec tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Lock "/opt/stack/data/nova/instances/7c62961f-e928-4df6-9c4e-74f035dde9a2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:41:27 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-bef452bf-259d-492a-abbd-3b16a54377ec tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:41:27 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-bef452bf-259d-492a-abbd-3b16a54377ec tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json" returned: 0 in 0.191s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:41:27 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-bef452bf-259d-492a-abbd-3b16a54377ec tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Acquiring lock "7d3243421cf3fdc288b758f687a93103b7b95466" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:41:27 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-bef452bf-259d-492a-abbd-3b16a54377ec tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Lock "7d3243421cf3fdc288b758f687a93103b7b95466" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:41:27 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-bef452bf-259d-492a-abbd-3b16a54377ec tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:41:27 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-f3f280de-e788-4dc2-a561-eda6ab339fb5 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:41:27 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-f3f280de-e788-4dc2-a561-eda6ab339fb5 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:41:27 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-bef452bf-259d-492a-abbd-3b16a54377ec tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json" returned: 0 in 0.196s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:41:27 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-bef452bf-259d-492a-abbd-3b16a54377ec tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466,backing_fmt=raw /opt/stack/data/nova/instances/7c62961f-e928-4df6-9c4e-74f035dde9a2/disk 1073741824 {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:41:27 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-f3f280de-e788-4dc2-a561-eda6ab339fb5 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.508s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:41:27 user nova-compute[75165]: DEBUG nova.compute.manager [None req-f3f280de-e788-4dc2-a561-eda6ab339fb5 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] [instance: 50c16604-2066-4cd2-a74e-c47a2dc4c449] Start building networks asynchronously for instance. {{(pid=75165) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 00:41:27 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-bef452bf-259d-492a-abbd-3b16a54377ec tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466,backing_fmt=raw /opt/stack/data/nova/instances/7c62961f-e928-4df6-9c4e-74f035dde9a2/disk 1073741824" returned: 0 in 0.071s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:41:27 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-bef452bf-259d-492a-abbd-3b16a54377ec tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Lock "7d3243421cf3fdc288b758f687a93103b7b95466" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.273s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:41:27 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-bef452bf-259d-492a-abbd-3b16a54377ec tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:41:27 user nova-compute[75165]: DEBUG nova.compute.manager [None req-f3f280de-e788-4dc2-a561-eda6ab339fb5 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] [instance: 50c16604-2066-4cd2-a74e-c47a2dc4c449] Allocating IP information in the background. {{(pid=75165) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 00:41:27 user nova-compute[75165]: DEBUG nova.network.neutron [None req-f3f280de-e788-4dc2-a561-eda6ab339fb5 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] [instance: 50c16604-2066-4cd2-a74e-c47a2dc4c449] allocate_for_instance() {{(pid=75165) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 00:41:27 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-f3f280de-e788-4dc2-a561-eda6ab339fb5 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] [instance: 50c16604-2066-4cd2-a74e-c47a2dc4c449] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 00:41:27 user nova-compute[75165]: DEBUG nova.compute.manager [None req-f3f280de-e788-4dc2-a561-eda6ab339fb5 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] [instance: 50c16604-2066-4cd2-a74e-c47a2dc4c449] Start building block device mappings for instance. {{(pid=75165) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 00:41:27 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:41:27 user nova-compute[75165]: DEBUG nova.network.neutron [None req-bef452bf-259d-492a-abbd-3b16a54377ec tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 7c62961f-e928-4df6-9c4e-74f035dde9a2] Successfully created port: 336cfc3b-0045-4c7f-bd85-ce9b9080ff58 {{(pid=75165) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 00:41:27 user nova-compute[75165]: DEBUG nova.policy [None req-f3f280de-e788-4dc2-a561-eda6ab339fb5 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '613a2bfa5c6a41d99289eda4ab2a195c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b40f07ee85b4c55b1725a43a8ee718d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75165) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 00:41:27 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-bef452bf-259d-492a-abbd-3b16a54377ec tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json" returned: 0 in 0.247s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:41:27 user nova-compute[75165]: DEBUG nova.virt.disk.api [None req-bef452bf-259d-492a-abbd-3b16a54377ec tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7c62961f-e928-4df6-9c4e-74f035dde9a2/disk. size=1073741824 {{(pid=75165) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 00:41:27 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-bef452bf-259d-492a-abbd-3b16a54377ec tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c62961f-e928-4df6-9c4e-74f035dde9a2/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:41:28 user nova-compute[75165]: DEBUG nova.compute.manager [None req-f3f280de-e788-4dc2-a561-eda6ab339fb5 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] [instance: 50c16604-2066-4cd2-a74e-c47a2dc4c449] Start spawning the instance on the hypervisor. {{(pid=75165) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 00:41:28 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-f3f280de-e788-4dc2-a561-eda6ab339fb5 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] [instance: 50c16604-2066-4cd2-a74e-c47a2dc4c449] Creating instance directory {{(pid=75165) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 00:41:28 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-f3f280de-e788-4dc2-a561-eda6ab339fb5 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] [instance: 50c16604-2066-4cd2-a74e-c47a2dc4c449] Creating image(s)
Oct 26 00:41:28 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-f3f280de-e788-4dc2-a561-eda6ab339fb5 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Acquiring lock "/opt/stack/data/nova/instances/50c16604-2066-4cd2-a74e-c47a2dc4c449/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:41:28 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-f3f280de-e788-4dc2-a561-eda6ab339fb5 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Lock "/opt/stack/data/nova/instances/50c16604-2066-4cd2-a74e-c47a2dc4c449/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:41:28 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-f3f280de-e788-4dc2-a561-eda6ab339fb5 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Lock "/opt/stack/data/nova/instances/50c16604-2066-4cd2-a74e-c47a2dc4c449/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:41:28 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-f3f280de-e788-4dc2-a561-eda6ab339fb5 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:41:28 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-bef452bf-259d-492a-abbd-3b16a54377ec tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c62961f-e928-4df6-9c4e-74f035dde9a2/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:41:28 user nova-compute[75165]: DEBUG nova.virt.disk.api [None req-bef452bf-259d-492a-abbd-3b16a54377ec tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Cannot resize image /opt/stack/data/nova/instances/7c62961f-e928-4df6-9c4e-74f035dde9a2/disk to a smaller size. {{(pid=75165) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 00:41:28 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-bef452bf-259d-492a-abbd-3b16a54377ec tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 7c62961f-e928-4df6-9c4e-74f035dde9a2] Created local disks {{(pid=75165) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 00:41:28 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-bef452bf-259d-492a-abbd-3b16a54377ec tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 7c62961f-e928-4df6-9c4e-74f035dde9a2] Ensure instance console log exists: /opt/stack/data/nova/instances/7c62961f-e928-4df6-9c4e-74f035dde9a2/console.log {{(pid=75165) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 00:41:28 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-bef452bf-259d-492a-abbd-3b16a54377ec tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:41:28 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-bef452bf-259d-492a-abbd-3b16a54377ec tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:41:28 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-bef452bf-259d-492a-abbd-3b16a54377ec tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:41:28 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-f3f280de-e788-4dc2-a561-eda6ab339fb5 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json" returned: 0 in 0.211s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:41:28 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-f3f280de-e788-4dc2-a561-eda6ab339fb5 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Acquiring lock "7d3243421cf3fdc288b758f687a93103b7b95466" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:41:28 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-f3f280de-e788-4dc2-a561-eda6ab339fb5 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Lock "7d3243421cf3fdc288b758f687a93103b7b95466" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:41:28 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-f3f280de-e788-4dc2-a561-eda6ab339fb5 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:41:28 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-f3f280de-e788-4dc2-a561-eda6ab339fb5 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json" returned: 0 in 0.187s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:41:28 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-f3f280de-e788-4dc2-a561-eda6ab339fb5 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466,backing_fmt=raw /opt/stack/data/nova/instances/50c16604-2066-4cd2-a74e-c47a2dc4c449/disk 1073741824 {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:41:28 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-f3f280de-e788-4dc2-a561-eda6ab339fb5 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466,backing_fmt=raw /opt/stack/data/nova/instances/50c16604-2066-4cd2-a74e-c47a2dc4c449/disk 1073741824" returned: 0 in 0.061s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:41:28 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-f3f280de-e788-4dc2-a561-eda6ab339fb5 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Lock "7d3243421cf3fdc288b758f687a93103b7b95466" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.256s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:41:28 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-f3f280de-e788-4dc2-a561-eda6ab339fb5 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:41:28 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:41:28 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-f3f280de-e788-4dc2-a561-eda6ab339fb5 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json" returned: 0 in 0.207s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:41:28 user nova-compute[75165]: DEBUG nova.virt.disk.api [None req-f3f280de-e788-4dc2-a561-eda6ab339fb5 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Checking if we can resize image /opt/stack/data/nova/instances/50c16604-2066-4cd2-a74e-c47a2dc4c449/disk. size=1073741824 {{(pid=75165) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 00:41:28 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-f3f280de-e788-4dc2-a561-eda6ab339fb5 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c16604-2066-4cd2-a74e-c47a2dc4c449/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:41:28 user nova-compute[75165]: DEBUG nova.network.neutron [None req-f3f280de-e788-4dc2-a561-eda6ab339fb5 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] [instance: 50c16604-2066-4cd2-a74e-c47a2dc4c449] Successfully created port: 78fd9337-1104-4248-9500-e9be75713371 {{(pid=75165) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 00:41:28 user nova-compute[75165]: DEBUG nova.network.neutron [None req-bef452bf-259d-492a-abbd-3b16a54377ec tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 7c62961f-e928-4df6-9c4e-74f035dde9a2] Successfully updated port: 336cfc3b-0045-4c7f-bd85-ce9b9080ff58 {{(pid=75165) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 00:41:28 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-bef452bf-259d-492a-abbd-3b16a54377ec tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Acquiring lock "refresh_cache-7c62961f-e928-4df6-9c4e-74f035dde9a2" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:41:28 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-bef452bf-259d-492a-abbd-3b16a54377ec tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Acquired lock "refresh_cache-7c62961f-e928-4df6-9c4e-74f035dde9a2" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:41:28 user nova-compute[75165]: DEBUG nova.network.neutron [None req-bef452bf-259d-492a-abbd-3b16a54377ec tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 7c62961f-e928-4df6-9c4e-74f035dde9a2] Building network info cache for instance {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 00:41:28 user nova-compute[75165]: DEBUG nova.compute.manager [req-50d6055d-367b-409e-9e11-8b392c094174 req-5d80d44a-4174-4e6f-aa58-f380de057f14 service nova] [instance: 7c62961f-e928-4df6-9c4e-74f035dde9a2] Received event network-changed-336cfc3b-0045-4c7f-bd85-ce9b9080ff58 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:41:28 user nova-compute[75165]: DEBUG nova.compute.manager [req-50d6055d-367b-409e-9e11-8b392c094174 req-5d80d44a-4174-4e6f-aa58-f380de057f14 service nova] [instance: 7c62961f-e928-4df6-9c4e-74f035dde9a2] Refreshing instance network info cache due to event network-changed-336cfc3b-0045-4c7f-bd85-ce9b9080ff58. {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 00:41:28 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-50d6055d-367b-409e-9e11-8b392c094174 req-5d80d44a-4174-4e6f-aa58-f380de057f14 service nova] Acquiring lock "refresh_cache-7c62961f-e928-4df6-9c4e-74f035dde9a2" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:41:28 user nova-compute[75165]: DEBUG nova.network.neutron [None req-bef452bf-259d-492a-abbd-3b16a54377ec tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 7c62961f-e928-4df6-9c4e-74f035dde9a2] Instance cache missing network info. {{(pid=75165) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 00:41:28 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-f3f280de-e788-4dc2-a561-eda6ab339fb5 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c16604-2066-4cd2-a74e-c47a2dc4c449/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:41:28 user nova-compute[75165]: DEBUG nova.virt.disk.api [None req-f3f280de-e788-4dc2-a561-eda6ab339fb5 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Cannot resize image /opt/stack/data/nova/instances/50c16604-2066-4cd2-a74e-c47a2dc4c449/disk to a smaller size. {{(pid=75165) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 00:41:28 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-f3f280de-e788-4dc2-a561-eda6ab339fb5 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] [instance: 50c16604-2066-4cd2-a74e-c47a2dc4c449] Created local disks {{(pid=75165) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 00:41:28 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-f3f280de-e788-4dc2-a561-eda6ab339fb5 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] [instance: 50c16604-2066-4cd2-a74e-c47a2dc4c449] Ensure instance console log exists: /opt/stack/data/nova/instances/50c16604-2066-4cd2-a74e-c47a2dc4c449/console.log {{(pid=75165) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 00:41:28 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-f3f280de-e788-4dc2-a561-eda6ab339fb5 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:41:28 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-f3f280de-e788-4dc2-a561-eda6ab339fb5 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:41:28 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-f3f280de-e788-4dc2-a561-eda6ab339fb5 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:41:29 user nova-compute[75165]: DEBUG nova.network.neutron [None req-bef452bf-259d-492a-abbd-3b16a54377ec tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 7c62961f-e928-4df6-9c4e-74f035dde9a2] Updating instance_info_cache with network_info: [{"id": "336cfc3b-0045-4c7f-bd85-ce9b9080ff58", "address": "fa:16:3e:83:d2:12", "network": {"id": "1801db1c-315e-4bdf-b73b-132a38bf41b8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1254756052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62572ce8ae524b55950532fd89729b71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap336cfc3b-00", "ovs_interfaceid": "336cfc3b-0045-4c7f-bd85-ce9b9080ff58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:41:29 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-bef452bf-259d-492a-abbd-3b16a54377ec tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Releasing lock "refresh_cache-7c62961f-e928-4df6-9c4e-74f035dde9a2" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:41:29 user nova-compute[75165]: DEBUG nova.compute.manager [None req-bef452bf-259d-492a-abbd-3b16a54377ec tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 7c62961f-e928-4df6-9c4e-74f035dde9a2] Instance network_info: |[{"id": "336cfc3b-0045-4c7f-bd85-ce9b9080ff58", "address": "fa:16:3e:83:d2:12", "network": {"id": "1801db1c-315e-4bdf-b73b-132a38bf41b8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1254756052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62572ce8ae524b55950532fd89729b71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap336cfc3b-00", "ovs_interfaceid": "336cfc3b-0045-4c7f-bd85-ce9b9080ff58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75165) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 00:41:29 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-50d6055d-367b-409e-9e11-8b392c094174 req-5d80d44a-4174-4e6f-aa58-f380de057f14 service nova] Acquired lock "refresh_cache-7c62961f-e928-4df6-9c4e-74f035dde9a2" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:41:29 user nova-compute[75165]: DEBUG nova.network.neutron [req-50d6055d-367b-409e-9e11-8b392c094174 req-5d80d44a-4174-4e6f-aa58-f380de057f14 service nova] [instance: 7c62961f-e928-4df6-9c4e-74f035dde9a2] Refreshing network info cache for port 336cfc3b-0045-4c7f-bd85-ce9b9080ff58 {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 00:41:29 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-bef452bf-259d-492a-abbd-3b16a54377ec tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 7c62961f-e928-4df6-9c4e-74f035dde9a2] Start _get_guest_xml network_info=[{"id": "336cfc3b-0045-4c7f-bd85-ce9b9080ff58", "address": "fa:16:3e:83:d2:12", "network": {"id": "1801db1c-315e-4bdf-b73b-132a38bf41b8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1254756052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62572ce8ae524b55950532fd89729b71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap336cfc3b-00", "ovs_interfaceid": "336cfc3b-0045-4c7f-bd85-ce9b9080ff58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T00:03:24Z,direct_url=<?>,disk_format='qcow2',id=bff0d8a1-739e-4c4d-9efa-b73ba7b76d01,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e56bbf444fd34c348475c73673611447',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T00:03:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'size': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': 'bff0d8a1-739e-4c4d-9efa-b73ba7b76d01'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75165) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 00:41:29 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-bef452bf-259d-492a-abbd-3b16a54377ec tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:41:29 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-bef452bf-259d-492a-abbd-3b16a54377ec tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:41:29 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-bef452bf-259d-492a-abbd-3b16a54377ec tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75165) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 00:41:29 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-bef452bf-259d-492a-abbd-3b16a54377ec tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] CPU controller missing on host. {{(pid=75165) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 00:41:29 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-bef452bf-259d-492a-abbd-3b16a54377ec tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75165) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 00:41:29 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-bef452bf-259d-492a-abbd-3b16a54377ec tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] CPU controller found on host. {{(pid=75165) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 00:41:29 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-bef452bf-259d-492a-abbd-3b16a54377ec tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75165) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 00:41:29 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-bef452bf-259d-492a-abbd-3b16a54377ec tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T00:03:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T00:03:24Z,direct_url=<?>,disk_format='qcow2',id=bff0d8a1-739e-4c4d-9efa-b73ba7b76d01,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e56bbf444fd34c348475c73673611447',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T00:03:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 00:41:29 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-bef452bf-259d-492a-abbd-3b16a54377ec tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Flavor limits 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 00:41:29 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-bef452bf-259d-492a-abbd-3b16a54377ec tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Image limits 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 00:41:29 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-bef452bf-259d-492a-abbd-3b16a54377ec tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Flavor pref 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 00:41:29 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-bef452bf-259d-492a-abbd-3b16a54377ec tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Image pref 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 00:41:29 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-bef452bf-259d-492a-abbd-3b16a54377ec tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 00:41:29 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-bef452bf-259d-492a-abbd-3b16a54377ec tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 00:41:29 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-bef452bf-259d-492a-abbd-3b16a54377ec tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75165) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 00:41:29 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-bef452bf-259d-492a-abbd-3b16a54377ec tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Got 1 possible topologies {{(pid=75165) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 00:41:29 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-bef452bf-259d-492a-abbd-3b16a54377ec tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 00:41:29 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-bef452bf-259d-492a-abbd-3b16a54377ec tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 00:41:29 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-bef452bf-259d-492a-abbd-3b16a54377ec tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:41:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1214230028',display_name='tempest-AttachVolumeNegativeTest-server-1214230028',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1214230028',id=45,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJX3/YQeWZdwRzfmlZuMRzqAOKi0BJoDNrMUW3L1QjwQAlbO8W+pAU8qsGUmn1Tqd2Q09ieR6IDVBVI0wPyfCyab3SVHxh9MWVh+xoHx45ws6i8JqacBRhnXyzaa7LDjuQ==',key_name='tempest-keypair-446499808',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='62572ce8ae524b55950532fd89729b71',ramdisk_id='',reservation_id='r-uagruh4d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-988376295',owner_user_name='tempest-AttachVolumeNegativeTest-988376295-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T00:41:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='041ebe2732c341129d6813549653cab3',uuid=7c62961f-e928-4df6-9c4e-74f035dde9a2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "336cfc3b-0045-4c7f-bd85-ce9b9080ff58", "address": "fa:16:3e:83:d2:12", "network": {"id": "1801db1c-315e-4bdf-b73b-132a38bf41b8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1254756052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62572ce8ae524b55950532fd89729b71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap336cfc3b-00", "ovs_interfaceid": "336cfc3b-0045-4c7f-bd85-ce9b9080ff58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75165) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 00:41:29 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-bef452bf-259d-492a-abbd-3b16a54377ec tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Converting VIF {"id": "336cfc3b-0045-4c7f-bd85-ce9b9080ff58", "address": "fa:16:3e:83:d2:12", "network": {"id": "1801db1c-315e-4bdf-b73b-132a38bf41b8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1254756052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62572ce8ae524b55950532fd89729b71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap336cfc3b-00", "ovs_interfaceid": "336cfc3b-0045-4c7f-bd85-ce9b9080ff58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:41:29 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-bef452bf-259d-492a-abbd-3b16a54377ec tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:d2:12,bridge_name='br-int',has_traffic_filtering=True,id=336cfc3b-0045-4c7f-bd85-ce9b9080ff58,network=Network(1801db1c-315e-4bdf-b73b-132a38bf41b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap336cfc3b-00') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:41:29 user nova-compute[75165]: DEBUG nova.objects.instance [None req-bef452bf-259d-492a-abbd-3b16a54377ec tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Lazy-loading 'pci_devices' on Instance uuid 7c62961f-e928-4df6-9c4e-74f035dde9a2 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:41:29 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-bef452bf-259d-492a-abbd-3b16a54377ec tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 7c62961f-e928-4df6-9c4e-74f035dde9a2] End _get_guest_xml xml=<domain type="kvm">
Oct 26 00:41:29 user nova-compute[75165]:   <uuid>7c62961f-e928-4df6-9c4e-74f035dde9a2</uuid>
Oct 26 00:41:29 user nova-compute[75165]:   <name>instance-0000002d</name>
Oct 26 00:41:29 user nova-compute[75165]:   <memory>524288</memory>
Oct 26 00:41:29 user nova-compute[75165]:   <vcpu>1</vcpu>
Oct 26 00:41:29 user nova-compute[75165]:   <metadata>
Oct 26 00:41:29 user nova-compute[75165]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 00:41:29 user nova-compute[75165]:       <nova:package version="0.0.0"/>
Oct 26 00:41:29 user nova-compute[75165]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1214230028</nova:name>
Oct 26 00:41:29 user nova-compute[75165]:       <nova:creationTime>2023-10-26 00:41:29</nova:creationTime>
Oct 26 00:41:29 user nova-compute[75165]:       <nova:flavor name="m1.tiny">
Oct 26 00:41:29 user nova-compute[75165]:         <nova:memory>512</nova:memory>
Oct 26 00:41:29 user nova-compute[75165]:         <nova:disk>1</nova:disk>
Oct 26 00:41:29 user nova-compute[75165]:         <nova:swap>0</nova:swap>
Oct 26 00:41:29 user nova-compute[75165]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 00:41:29 user nova-compute[75165]:         <nova:vcpus>1</nova:vcpus>
Oct 26 00:41:29 user nova-compute[75165]:       </nova:flavor>
Oct 26 00:41:29 user nova-compute[75165]:       <nova:owner>
Oct 26 00:41:29 user nova-compute[75165]:         <nova:user uuid="041ebe2732c341129d6813549653cab3">tempest-AttachVolumeNegativeTest-988376295-project-member</nova:user>
Oct 26 00:41:29 user nova-compute[75165]:         <nova:project uuid="62572ce8ae524b55950532fd89729b71">tempest-AttachVolumeNegativeTest-988376295</nova:project>
Oct 26 00:41:29 user nova-compute[75165]:       </nova:owner>
Oct 26 00:41:29 user nova-compute[75165]:       <nova:root type="image" uuid="bff0d8a1-739e-4c4d-9efa-b73ba7b76d01"/>
Oct 26 00:41:29 user nova-compute[75165]:       <nova:ports>
Oct 26 00:41:29 user nova-compute[75165]:         <nova:port uuid="336cfc3b-0045-4c7f-bd85-ce9b9080ff58">
Oct 26 00:41:29 user nova-compute[75165]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 26 00:41:29 user nova-compute[75165]:         </nova:port>
Oct 26 00:41:29 user nova-compute[75165]:       </nova:ports>
Oct 26 00:41:29 user nova-compute[75165]:     </nova:instance>
Oct 26 00:41:29 user nova-compute[75165]:   </metadata>
Oct 26 00:41:29 user nova-compute[75165]:   <sysinfo type="smbios">
Oct 26 00:41:29 user nova-compute[75165]:     <system>
Oct 26 00:41:29 user nova-compute[75165]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 00:41:29 user nova-compute[75165]:       <entry name="product">OpenStack Nova</entry>
Oct 26 00:41:29 user nova-compute[75165]:       <entry name="version">0.0.0</entry>
Oct 26 00:41:29 user nova-compute[75165]:       <entry name="serial">7c62961f-e928-4df6-9c4e-74f035dde9a2</entry>
Oct 26 00:41:29 user nova-compute[75165]:       <entry name="uuid">7c62961f-e928-4df6-9c4e-74f035dde9a2</entry>
Oct 26 00:41:29 user nova-compute[75165]:       <entry name="family">Virtual Machine</entry>
Oct 26 00:41:29 user nova-compute[75165]:     </system>
Oct 26 00:41:29 user nova-compute[75165]:   </sysinfo>
Oct 26 00:41:29 user nova-compute[75165]:   <os>
Oct 26 00:41:29 user nova-compute[75165]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 00:41:29 user nova-compute[75165]:     <boot dev="hd"/>
Oct 26 00:41:29 user nova-compute[75165]:     <smbios mode="sysinfo"/>
Oct 26 00:41:29 user nova-compute[75165]:   </os>
Oct 26 00:41:29 user nova-compute[75165]:   <features>
Oct 26 00:41:29 user nova-compute[75165]:     <acpi/>
Oct 26 00:41:29 user nova-compute[75165]:     <apic/>
Oct 26 00:41:29 user nova-compute[75165]:     <vmcoreinfo/>
Oct 26 00:41:29 user nova-compute[75165]:   </features>
Oct 26 00:41:29 user nova-compute[75165]:   <clock offset="utc">
Oct 26 00:41:29 user nova-compute[75165]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 00:41:29 user nova-compute[75165]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 00:41:29 user nova-compute[75165]:     <timer name="hpet" present="no"/>
Oct 26 00:41:29 user nova-compute[75165]:   </clock>
Oct 26 00:41:29 user nova-compute[75165]:   <cpu mode="custom" match="exact">
Oct 26 00:41:29 user nova-compute[75165]:     <model>Nehalem</model>
Oct 26 00:41:29 user nova-compute[75165]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 00:41:29 user nova-compute[75165]:   </cpu>
Oct 26 00:41:29 user nova-compute[75165]:   <devices>
Oct 26 00:41:29 user nova-compute[75165]:     <disk type="file" device="disk">
Oct 26 00:41:29 user nova-compute[75165]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 00:41:29 user nova-compute[75165]:       <source file="/opt/stack/data/nova/instances/7c62961f-e928-4df6-9c4e-74f035dde9a2/disk"/>
Oct 26 00:41:29 user nova-compute[75165]:       <target dev="vda" bus="virtio"/>
Oct 26 00:41:29 user nova-compute[75165]:     </disk>
Oct 26 00:41:29 user nova-compute[75165]:     <interface type="ethernet">
Oct 26 00:41:29 user nova-compute[75165]:       <mac address="fa:16:3e:83:d2:12"/>
Oct 26 00:41:29 user nova-compute[75165]:       <model type="virtio"/>
Oct 26 00:41:29 user nova-compute[75165]:       <mtu size="1442"/>
Oct 26 00:41:29 user nova-compute[75165]:       <target dev="tap336cfc3b-00"/>
Oct 26 00:41:29 user nova-compute[75165]:     </interface>
Oct 26 00:41:29 user nova-compute[75165]:     <serial type="pty">
Oct 26 00:41:29 user nova-compute[75165]:       <log file="/opt/stack/data/nova/instances/7c62961f-e928-4df6-9c4e-74f035dde9a2/console.log" append="off"/>
Oct 26 00:41:29 user nova-compute[75165]:     </serial>
Oct 26 00:41:29 user nova-compute[75165]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 00:41:29 user nova-compute[75165]:     <video>
Oct 26 00:41:29 user nova-compute[75165]:       <model type="virtio"/>
Oct 26 00:41:29 user nova-compute[75165]:     </video>
Oct 26 00:41:29 user nova-compute[75165]:     <rng model="virtio">
Oct 26 00:41:29 user nova-compute[75165]:       <backend model="random">/dev/urandom</backend>
Oct 26 00:41:29 user nova-compute[75165]:     </rng>
Oct 26 00:41:29 user nova-compute[75165]:     <controller type="usb" index="0" model="none"/>
Oct 26 00:41:29 user nova-compute[75165]:     <memballoon model="virtio">
Oct 26 00:41:29 user nova-compute[75165]:       <stats period="10"/>
Oct 26 00:41:29 user nova-compute[75165]:     </memballoon>
Oct 26 00:41:29 user nova-compute[75165]:   </devices>
Oct 26 00:41:29 user nova-compute[75165]: </domain>
Oct 26 00:41:29 user nova-compute[75165]:  {{(pid=75165) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 00:41:29 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-bef452bf-259d-492a-abbd-3b16a54377ec tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:41:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1214230028',display_name='tempest-AttachVolumeNegativeTest-server-1214230028',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1214230028',id=45,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJX3/YQeWZdwRzfmlZuMRzqAOKi0BJoDNrMUW3L1QjwQAlbO8W+pAU8qsGUmn1Tqd2Q09ieR6IDVBVI0wPyfCyab3SVHxh9MWVh+xoHx45ws6i8JqacBRhnXyzaa7LDjuQ==',key_name='tempest-keypair-446499808',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='62572ce8ae524b55950532fd89729b71',ramdisk_id='',reservation_id='r-uagruh4d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-988376295',owner_user_name='tempest-AttachVolumeNegativeTest-988376295-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T00:41:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='041ebe2732c341129d6813549653cab3',uuid=7c62961f-e928-4df6-9c4e-74f035dde9a2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "336cfc3b-0045-4c7f-bd85-ce9b9080ff58", "address": "fa:16:3e:83:d2:12", "network": {"id": "1801db1c-315e-4bdf-b73b-132a38bf41b8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1254756052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62572ce8ae524b55950532fd89729b71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap336cfc3b-00", "ovs_interfaceid": "336cfc3b-0045-4c7f-bd85-ce9b9080ff58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 00:41:29 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-bef452bf-259d-492a-abbd-3b16a54377ec tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Converting VIF {"id": "336cfc3b-0045-4c7f-bd85-ce9b9080ff58", "address": "fa:16:3e:83:d2:12", "network": {"id": "1801db1c-315e-4bdf-b73b-132a38bf41b8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1254756052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62572ce8ae524b55950532fd89729b71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap336cfc3b-00", "ovs_interfaceid": "336cfc3b-0045-4c7f-bd85-ce9b9080ff58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:41:29 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-bef452bf-259d-492a-abbd-3b16a54377ec tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:d2:12,bridge_name='br-int',has_traffic_filtering=True,id=336cfc3b-0045-4c7f-bd85-ce9b9080ff58,network=Network(1801db1c-315e-4bdf-b73b-132a38bf41b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap336cfc3b-00') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:41:29 user nova-compute[75165]: DEBUG os_vif [None req-bef452bf-259d-492a-abbd-3b16a54377ec tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:d2:12,bridge_name='br-int',has_traffic_filtering=True,id=336cfc3b-0045-4c7f-bd85-ce9b9080ff58,network=Network(1801db1c-315e-4bdf-b73b-132a38bf41b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap336cfc3b-00') {{(pid=75165) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 00:41:29 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:41:29 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:41:29 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 00:41:29 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:41:29 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b1c5b35a-683e-540d-a29b-560413fd7547', '_type': 'linux-noop'}}, row=False) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:41:29 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:41:29 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:41:29 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:41:29 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap336cfc3b-00, may_exist=True, interface_attrs={}) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:41:29 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap336cfc3b-00, col_values=(('qos', UUID('2ae531d1-ceb1-4cbd-8593-ba604a516a15')),), if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:41:29 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap336cfc3b-00, col_values=(('external_ids', {'iface-id': '336cfc3b-0045-4c7f-bd85-ce9b9080ff58', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:83:d2:12', 'vm-uuid': '7c62961f-e928-4df6-9c4e-74f035dde9a2'}),), if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:41:29 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:41:29 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:41:29 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:41:29 user nova-compute[75165]: INFO os_vif [None req-bef452bf-259d-492a-abbd-3b16a54377ec tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:d2:12,bridge_name='br-int',has_traffic_filtering=True,id=336cfc3b-0045-4c7f-bd85-ce9b9080ff58,network=Network(1801db1c-315e-4bdf-b73b-132a38bf41b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap336cfc3b-00')
Oct 26 00:41:29 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-bef452bf-259d-492a-abbd-3b16a54377ec tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] No BDM found with device name vda, not building metadata. {{(pid=75165) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 00:41:29 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-bef452bf-259d-492a-abbd-3b16a54377ec tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] No VIF found with MAC fa:16:3e:83:d2:12, not building metadata {{(pid=75165) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 00:41:29 user nova-compute[75165]: DEBUG nova.network.neutron [req-50d6055d-367b-409e-9e11-8b392c094174 req-5d80d44a-4174-4e6f-aa58-f380de057f14 service nova] [instance: 7c62961f-e928-4df6-9c4e-74f035dde9a2] Updated VIF entry in instance network info cache for port 336cfc3b-0045-4c7f-bd85-ce9b9080ff58. {{(pid=75165) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 00:41:29 user nova-compute[75165]: DEBUG nova.network.neutron [req-50d6055d-367b-409e-9e11-8b392c094174 req-5d80d44a-4174-4e6f-aa58-f380de057f14 service nova] [instance: 7c62961f-e928-4df6-9c4e-74f035dde9a2] Updating instance_info_cache with network_info: [{"id": "336cfc3b-0045-4c7f-bd85-ce9b9080ff58", "address": "fa:16:3e:83:d2:12", "network": {"id": "1801db1c-315e-4bdf-b73b-132a38bf41b8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1254756052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62572ce8ae524b55950532fd89729b71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap336cfc3b-00", "ovs_interfaceid": "336cfc3b-0045-4c7f-bd85-ce9b9080ff58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:41:29 user nova-compute[75165]: DEBUG nova.network.neutron [None req-f3f280de-e788-4dc2-a561-eda6ab339fb5 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] [instance: 50c16604-2066-4cd2-a74e-c47a2dc4c449] Successfully updated port: 78fd9337-1104-4248-9500-e9be75713371 {{(pid=75165) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 00:41:29 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-50d6055d-367b-409e-9e11-8b392c094174 req-5d80d44a-4174-4e6f-aa58-f380de057f14 service nova] Releasing lock "refresh_cache-7c62961f-e928-4df6-9c4e-74f035dde9a2" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:41:29 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-f3f280de-e788-4dc2-a561-eda6ab339fb5 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Acquiring lock "refresh_cache-50c16604-2066-4cd2-a74e-c47a2dc4c449" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:41:29 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-f3f280de-e788-4dc2-a561-eda6ab339fb5 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Acquired lock "refresh_cache-50c16604-2066-4cd2-a74e-c47a2dc4c449" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:41:29 user nova-compute[75165]: DEBUG nova.network.neutron [None req-f3f280de-e788-4dc2-a561-eda6ab339fb5 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] [instance: 50c16604-2066-4cd2-a74e-c47a2dc4c449] Building network info cache for instance {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 00:41:29 user nova-compute[75165]: DEBUG nova.compute.manager [req-6fe9ce9e-e89b-4665-9a5e-ee364a74c9ff req-667a94b8-b2db-40c7-9703-68089c6e6aab service nova] [instance: 50c16604-2066-4cd2-a74e-c47a2dc4c449] Received event network-changed-78fd9337-1104-4248-9500-e9be75713371 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:41:29 user nova-compute[75165]: DEBUG nova.compute.manager [req-6fe9ce9e-e89b-4665-9a5e-ee364a74c9ff req-667a94b8-b2db-40c7-9703-68089c6e6aab service nova] [instance: 50c16604-2066-4cd2-a74e-c47a2dc4c449] Refreshing instance network info cache due to event network-changed-78fd9337-1104-4248-9500-e9be75713371. {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 00:41:29 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-6fe9ce9e-e89b-4665-9a5e-ee364a74c9ff req-667a94b8-b2db-40c7-9703-68089c6e6aab service nova] Acquiring lock "refresh_cache-50c16604-2066-4cd2-a74e-c47a2dc4c449" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:41:29 user nova-compute[75165]: DEBUG nova.network.neutron [None req-f3f280de-e788-4dc2-a561-eda6ab339fb5 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] [instance: 50c16604-2066-4cd2-a74e-c47a2dc4c449] Instance cache missing network info. {{(pid=75165) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 00:41:29 user nova-compute[75165]: DEBUG nova.network.neutron [None req-f3f280de-e788-4dc2-a561-eda6ab339fb5 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] [instance: 50c16604-2066-4cd2-a74e-c47a2dc4c449] Updating instance_info_cache with network_info: [{"id": "78fd9337-1104-4248-9500-e9be75713371", "address": "fa:16:3e:b3:14:9a", "network": {"id": "0fc59e9a-15a6-41b6-aee1-f8d958b92246", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1263090607-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b40f07ee85b4c55b1725a43a8ee718d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78fd9337-11", "ovs_interfaceid": "78fd9337-1104-4248-9500-e9be75713371", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:41:29 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-f3f280de-e788-4dc2-a561-eda6ab339fb5 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Releasing lock "refresh_cache-50c16604-2066-4cd2-a74e-c47a2dc4c449" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:41:29 user nova-compute[75165]: DEBUG nova.compute.manager [None req-f3f280de-e788-4dc2-a561-eda6ab339fb5 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] [instance: 50c16604-2066-4cd2-a74e-c47a2dc4c449] Instance network_info: |[{"id": "78fd9337-1104-4248-9500-e9be75713371", "address": "fa:16:3e:b3:14:9a", "network": {"id": "0fc59e9a-15a6-41b6-aee1-f8d958b92246", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1263090607-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b40f07ee85b4c55b1725a43a8ee718d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78fd9337-11", "ovs_interfaceid": "78fd9337-1104-4248-9500-e9be75713371", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75165) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 00:41:29 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-6fe9ce9e-e89b-4665-9a5e-ee364a74c9ff req-667a94b8-b2db-40c7-9703-68089c6e6aab service nova] Acquired lock "refresh_cache-50c16604-2066-4cd2-a74e-c47a2dc4c449" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:41:29 user nova-compute[75165]: DEBUG nova.network.neutron [req-6fe9ce9e-e89b-4665-9a5e-ee364a74c9ff req-667a94b8-b2db-40c7-9703-68089c6e6aab service nova] [instance: 50c16604-2066-4cd2-a74e-c47a2dc4c449] Refreshing network info cache for port 78fd9337-1104-4248-9500-e9be75713371 {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 00:41:29 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-f3f280de-e788-4dc2-a561-eda6ab339fb5 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] [instance: 50c16604-2066-4cd2-a74e-c47a2dc4c449] Start _get_guest_xml network_info=[{"id": "78fd9337-1104-4248-9500-e9be75713371", "address": "fa:16:3e:b3:14:9a", "network": {"id": "0fc59e9a-15a6-41b6-aee1-f8d958b92246", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1263090607-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b40f07ee85b4c55b1725a43a8ee718d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78fd9337-11", "ovs_interfaceid": "78fd9337-1104-4248-9500-e9be75713371", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T00:03:24Z,direct_url=<?>,disk_format='qcow2',id=bff0d8a1-739e-4c4d-9efa-b73ba7b76d01,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e56bbf444fd34c348475c73673611447',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T00:03:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'size': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': 'bff0d8a1-739e-4c4d-9efa-b73ba7b76d01'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75165) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 00:41:29 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-f3f280de-e788-4dc2-a561-eda6ab339fb5 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:41:29 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-f3f280de-e788-4dc2-a561-eda6ab339fb5 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:41:29 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-f3f280de-e788-4dc2-a561-eda6ab339fb5 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75165) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 00:41:29 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-f3f280de-e788-4dc2-a561-eda6ab339fb5 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] CPU controller missing on host. {{(pid=75165) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 00:41:29 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-f3f280de-e788-4dc2-a561-eda6ab339fb5 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75165) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 00:41:29 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-f3f280de-e788-4dc2-a561-eda6ab339fb5 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] CPU controller found on host. {{(pid=75165) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 00:41:29 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-f3f280de-e788-4dc2-a561-eda6ab339fb5 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75165) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 00:41:29 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-f3f280de-e788-4dc2-a561-eda6ab339fb5 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T00:03:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T00:03:24Z,direct_url=<?>,disk_format='qcow2',id=bff0d8a1-739e-4c4d-9efa-b73ba7b76d01,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e56bbf444fd34c348475c73673611447',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T00:03:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 00:41:29 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-f3f280de-e788-4dc2-a561-eda6ab339fb5 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Flavor limits 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 00:41:29 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-f3f280de-e788-4dc2-a561-eda6ab339fb5 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Image limits 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 00:41:29 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-f3f280de-e788-4dc2-a561-eda6ab339fb5 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Flavor pref 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 00:41:29 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-f3f280de-e788-4dc2-a561-eda6ab339fb5 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Image pref 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 00:41:29 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-f3f280de-e788-4dc2-a561-eda6ab339fb5 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 00:41:29 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-f3f280de-e788-4dc2-a561-eda6ab339fb5 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 00:41:29 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-f3f280de-e788-4dc2-a561-eda6ab339fb5 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75165) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 00:41:29 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-f3f280de-e788-4dc2-a561-eda6ab339fb5 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Got 1 possible topologies {{(pid=75165) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 00:41:29 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-f3f280de-e788-4dc2-a561-eda6ab339fb5 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 00:41:29 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-f3f280de-e788-4dc2-a561-eda6ab339fb5 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 00:41:30 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-f3f280de-e788-4dc2-a561-eda6ab339fb5 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:41:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-469617276',display_name='tempest-TestServerVolumeAttachmentScenario-server-469617276',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-469617276',id=46,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEkLqXxwWP+dYmpAAuTh4YBiWOF7IbbyhmXv/ucq7KGRnuZOcJeqcAU6gKMEbdw+yJiYKPWThKrSo26lQyeTtBWzcVe6kHxdRwMWw456uyAY+K1ArXVzKSYImgqppBfk/A==',key_name='tempest-keypair-1964090332',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7b40f07ee85b4c55b1725a43a8ee718d',ramdisk_id='',reservation_id='r-lxm7yoqw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1254788731',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1254788731-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T00:41:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='613a2bfa5c6a41d99289eda4ab2a195c',uuid=50c16604-2066-4cd2-a74e-c47a2dc4c449,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "78fd9337-1104-4248-9500-e9be75713371", "address": "fa:16:3e:b3:14:9a", "network": {"id": "0fc59e9a-15a6-41b6-aee1-f8d958b92246", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1263090607-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b40f07ee85b4c55b1725a43a8ee718d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78fd9337-11", "ovs_interfaceid": "78fd9337-1104-4248-9500-e9be75713371", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75165) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 00:41:30 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-f3f280de-e788-4dc2-a561-eda6ab339fb5 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Converting VIF {"id": "78fd9337-1104-4248-9500-e9be75713371", "address": "fa:16:3e:b3:14:9a", "network": {"id": "0fc59e9a-15a6-41b6-aee1-f8d958b92246", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1263090607-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b40f07ee85b4c55b1725a43a8ee718d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78fd9337-11", "ovs_interfaceid": "78fd9337-1104-4248-9500-e9be75713371", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:41:30 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-f3f280de-e788-4dc2-a561-eda6ab339fb5 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:14:9a,bridge_name='br-int',has_traffic_filtering=True,id=78fd9337-1104-4248-9500-e9be75713371,network=Network(0fc59e9a-15a6-41b6-aee1-f8d958b92246),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78fd9337-11') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:41:30 user nova-compute[75165]: DEBUG nova.objects.instance [None req-f3f280de-e788-4dc2-a561-eda6ab339fb5 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Lazy-loading 'pci_devices' on Instance uuid 50c16604-2066-4cd2-a74e-c47a2dc4c449 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:41:30 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-f3f280de-e788-4dc2-a561-eda6ab339fb5 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] [instance: 50c16604-2066-4cd2-a74e-c47a2dc4c449] End _get_guest_xml xml=<domain type="kvm">
Oct 26 00:41:30 user nova-compute[75165]:   <uuid>50c16604-2066-4cd2-a74e-c47a2dc4c449</uuid>
Oct 26 00:41:30 user nova-compute[75165]:   <name>instance-0000002e</name>
Oct 26 00:41:30 user nova-compute[75165]:   <memory>524288</memory>
Oct 26 00:41:30 user nova-compute[75165]:   <vcpu>1</vcpu>
Oct 26 00:41:30 user nova-compute[75165]:   <metadata>
Oct 26 00:41:30 user nova-compute[75165]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 00:41:30 user nova-compute[75165]:       <nova:package version="0.0.0"/>
Oct 26 00:41:30 user nova-compute[75165]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-469617276</nova:name>
Oct 26 00:41:30 user nova-compute[75165]:       <nova:creationTime>2023-10-26 00:41:29</nova:creationTime>
Oct 26 00:41:30 user nova-compute[75165]:       <nova:flavor name="m1.tiny">
Oct 26 00:41:30 user nova-compute[75165]:         <nova:memory>512</nova:memory>
Oct 26 00:41:30 user nova-compute[75165]:         <nova:disk>1</nova:disk>
Oct 26 00:41:30 user nova-compute[75165]:         <nova:swap>0</nova:swap>
Oct 26 00:41:30 user nova-compute[75165]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 00:41:30 user nova-compute[75165]:         <nova:vcpus>1</nova:vcpus>
Oct 26 00:41:30 user nova-compute[75165]:       </nova:flavor>
Oct 26 00:41:30 user nova-compute[75165]:       <nova:owner>
Oct 26 00:41:30 user nova-compute[75165]:         <nova:user uuid="613a2bfa5c6a41d99289eda4ab2a195c">tempest-TestServerVolumeAttachmentScenario-1254788731-project-member</nova:user>
Oct 26 00:41:30 user nova-compute[75165]:         <nova:project uuid="7b40f07ee85b4c55b1725a43a8ee718d">tempest-TestServerVolumeAttachmentScenario-1254788731</nova:project>
Oct 26 00:41:30 user nova-compute[75165]:       </nova:owner>
Oct 26 00:41:30 user nova-compute[75165]:       <nova:root type="image" uuid="bff0d8a1-739e-4c4d-9efa-b73ba7b76d01"/>
Oct 26 00:41:30 user nova-compute[75165]:       <nova:ports>
Oct 26 00:41:30 user nova-compute[75165]:         <nova:port uuid="78fd9337-1104-4248-9500-e9be75713371">
Oct 26 00:41:30 user nova-compute[75165]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 26 00:41:30 user nova-compute[75165]:         </nova:port>
Oct 26 00:41:30 user nova-compute[75165]:       </nova:ports>
Oct 26 00:41:30 user nova-compute[75165]:     </nova:instance>
Oct 26 00:41:30 user nova-compute[75165]:   </metadata>
Oct 26 00:41:30 user nova-compute[75165]:   <sysinfo type="smbios">
Oct 26 00:41:30 user nova-compute[75165]:     <system>
Oct 26 00:41:30 user nova-compute[75165]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 00:41:30 user nova-compute[75165]:       <entry name="product">OpenStack Nova</entry>
Oct 26 00:41:30 user nova-compute[75165]:       <entry name="version">0.0.0</entry>
Oct 26 00:41:30 user nova-compute[75165]:       <entry name="serial">50c16604-2066-4cd2-a74e-c47a2dc4c449</entry>
Oct 26 00:41:30 user nova-compute[75165]:       <entry name="uuid">50c16604-2066-4cd2-a74e-c47a2dc4c449</entry>
Oct 26 00:41:30 user nova-compute[75165]:       <entry name="family">Virtual Machine</entry>
Oct 26 00:41:30 user nova-compute[75165]:     </system>
Oct 26 00:41:30 user nova-compute[75165]:   </sysinfo>
Oct 26 00:41:30 user nova-compute[75165]:   <os>
Oct 26 00:41:30 user nova-compute[75165]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 00:41:30 user nova-compute[75165]:     <boot dev="hd"/>
Oct 26 00:41:30 user nova-compute[75165]:     <smbios mode="sysinfo"/>
Oct 26 00:41:30 user nova-compute[75165]:   </os>
Oct 26 00:41:30 user nova-compute[75165]:   <features>
Oct 26 00:41:30 user nova-compute[75165]:     <acpi/>
Oct 26 00:41:30 user nova-compute[75165]:     <apic/>
Oct 26 00:41:30 user nova-compute[75165]:     <vmcoreinfo/>
Oct 26 00:41:30 user nova-compute[75165]:   </features>
Oct 26 00:41:30 user nova-compute[75165]:   <clock offset="utc">
Oct 26 00:41:30 user nova-compute[75165]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 00:41:30 user nova-compute[75165]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 00:41:30 user nova-compute[75165]:     <timer name="hpet" present="no"/>
Oct 26 00:41:30 user nova-compute[75165]:   </clock>
Oct 26 00:41:30 user nova-compute[75165]:   <cpu mode="custom" match="exact">
Oct 26 00:41:30 user nova-compute[75165]:     <model>Nehalem</model>
Oct 26 00:41:30 user nova-compute[75165]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 00:41:30 user nova-compute[75165]:   </cpu>
Oct 26 00:41:30 user nova-compute[75165]:   <devices>
Oct 26 00:41:30 user nova-compute[75165]:     <disk type="file" device="disk">
Oct 26 00:41:30 user nova-compute[75165]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 00:41:30 user nova-compute[75165]:       <source file="/opt/stack/data/nova/instances/50c16604-2066-4cd2-a74e-c47a2dc4c449/disk"/>
Oct 26 00:41:30 user nova-compute[75165]:       <target dev="vda" bus="virtio"/>
Oct 26 00:41:30 user nova-compute[75165]:     </disk>
Oct 26 00:41:30 user nova-compute[75165]:     <interface type="ethernet">
Oct 26 00:41:30 user nova-compute[75165]:       <mac address="fa:16:3e:b3:14:9a"/>
Oct 26 00:41:30 user nova-compute[75165]:       <model type="virtio"/>
Oct 26 00:41:30 user nova-compute[75165]:       <mtu size="1442"/>
Oct 26 00:41:30 user nova-compute[75165]:       <target dev="tap78fd9337-11"/>
Oct 26 00:41:30 user nova-compute[75165]:     </interface>
Oct 26 00:41:30 user nova-compute[75165]:     <serial type="pty">
Oct 26 00:41:30 user nova-compute[75165]:       <log file="/opt/stack/data/nova/instances/50c16604-2066-4cd2-a74e-c47a2dc4c449/console.log" append="off"/>
Oct 26 00:41:30 user nova-compute[75165]:     </serial>
Oct 26 00:41:30 user nova-compute[75165]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 00:41:30 user nova-compute[75165]:     <video>
Oct 26 00:41:30 user nova-compute[75165]:       <model type="virtio"/>
Oct 26 00:41:30 user nova-compute[75165]:     </video>
Oct 26 00:41:30 user nova-compute[75165]:     <rng model="virtio">
Oct 26 00:41:30 user nova-compute[75165]:       <backend model="random">/dev/urandom</backend>
Oct 26 00:41:30 user nova-compute[75165]:     </rng>
Oct 26 00:41:30 user nova-compute[75165]:     <controller type="usb" index="0" model="none"/>
Oct 26 00:41:30 user nova-compute[75165]:     <memballoon model="virtio">
Oct 26 00:41:30 user nova-compute[75165]:       <stats period="10"/>
Oct 26 00:41:30 user nova-compute[75165]:     </memballoon>
Oct 26 00:41:30 user nova-compute[75165]:   </devices>
Oct 26 00:41:30 user nova-compute[75165]: </domain>
Oct 26 00:41:30 user nova-compute[75165]:  {{(pid=75165) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 00:41:30 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-f3f280de-e788-4dc2-a561-eda6ab339fb5 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:41:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-469617276',display_name='tempest-TestServerVolumeAttachmentScenario-server-469617276',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-469617276',id=46,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEkLqXxwWP+dYmpAAuTh4YBiWOF7IbbyhmXv/ucq7KGRnuZOcJeqcAU6gKMEbdw+yJiYKPWThKrSo26lQyeTtBWzcVe6kHxdRwMWw456uyAY+K1ArXVzKSYImgqppBfk/A==',key_name='tempest-keypair-1964090332',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7b40f07ee85b4c55b1725a43a8ee718d',ramdisk_id='',reservation_id='r-lxm7yoqw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1254788731',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1254788731-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T00:41:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='613a2bfa5c6a41d99289eda4ab2a195c',uuid=50c16604-2066-4cd2-a74e-c47a2dc4c449,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "78fd9337-1104-4248-9500-e9be75713371", "address": "fa:16:3e:b3:14:9a", "network": {"id": "0fc59e9a-15a6-41b6-aee1-f8d958b92246", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1263090607-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b40f07ee85b4c55b1725a43a8ee718d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78fd9337-11", "ovs_interfaceid": "78fd9337-1104-4248-9500-e9be75713371", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 00:41:30 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-f3f280de-e788-4dc2-a561-eda6ab339fb5 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Converting VIF {"id": "78fd9337-1104-4248-9500-e9be75713371", "address": "fa:16:3e:b3:14:9a", "network": {"id": "0fc59e9a-15a6-41b6-aee1-f8d958b92246", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1263090607-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b40f07ee85b4c55b1725a43a8ee718d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78fd9337-11", "ovs_interfaceid": "78fd9337-1104-4248-9500-e9be75713371", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:41:30 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-f3f280de-e788-4dc2-a561-eda6ab339fb5 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:14:9a,bridge_name='br-int',has_traffic_filtering=True,id=78fd9337-1104-4248-9500-e9be75713371,network=Network(0fc59e9a-15a6-41b6-aee1-f8d958b92246),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78fd9337-11') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:41:30 user nova-compute[75165]: DEBUG os_vif [None req-f3f280de-e788-4dc2-a561-eda6ab339fb5 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:14:9a,bridge_name='br-int',has_traffic_filtering=True,id=78fd9337-1104-4248-9500-e9be75713371,network=Network(0fc59e9a-15a6-41b6-aee1-f8d958b92246),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78fd9337-11') {{(pid=75165) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 00:41:30 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:41:30 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:41:30 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 00:41:30 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:41:30 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7e1923a5-d943-5c39-be26-b64ba9427cc8', '_type': 'linux-noop'}}, row=False) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:41:30 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:41:30 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-a06eb954-27da-4873-a777-3ab002a42167 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Acquiring lock "65b637f1-baea-4e1c-8b25-e943125eed32" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:41:30 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-a06eb954-27da-4873-a777-3ab002a42167 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Lock "65b637f1-baea-4e1c-8b25-e943125eed32" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:41:30 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-a06eb954-27da-4873-a777-3ab002a42167 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Acquiring lock "65b637f1-baea-4e1c-8b25-e943125eed32-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:41:30 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-a06eb954-27da-4873-a777-3ab002a42167 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Lock "65b637f1-baea-4e1c-8b25-e943125eed32-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:41:30 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-a06eb954-27da-4873-a777-3ab002a42167 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Lock "65b637f1-baea-4e1c-8b25-e943125eed32-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:41:30 user nova-compute[75165]: INFO nova.compute.manager [None req-a06eb954-27da-4873-a777-3ab002a42167 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] [instance: 65b637f1-baea-4e1c-8b25-e943125eed32] Terminating instance
Oct 26 00:41:30 user nova-compute[75165]: DEBUG nova.compute.manager [None req-a06eb954-27da-4873-a777-3ab002a42167 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] [instance: 65b637f1-baea-4e1c-8b25-e943125eed32] Start destroying the instance on the hypervisor. {{(pid=75165) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 00:41:30 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:41:30 user nova-compute[75165]: DEBUG nova.compute.manager [req-fa669687-65b8-4f8d-943e-715b47d1454b req-95bbd888-9e7a-4a8e-a8dc-6e99b5c01ccc service nova] [instance: 65b637f1-baea-4e1c-8b25-e943125eed32] Received event network-changed-29185859-2394-4d70-a21d-4a7723e80fcd {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:41:30 user nova-compute[75165]: DEBUG nova.compute.manager [req-fa669687-65b8-4f8d-943e-715b47d1454b req-95bbd888-9e7a-4a8e-a8dc-6e99b5c01ccc service nova] [instance: 65b637f1-baea-4e1c-8b25-e943125eed32] Refreshing instance network info cache due to event network-changed-29185859-2394-4d70-a21d-4a7723e80fcd. {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 00:41:30 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-fa669687-65b8-4f8d-943e-715b47d1454b req-95bbd888-9e7a-4a8e-a8dc-6e99b5c01ccc service nova] Acquiring lock "refresh_cache-65b637f1-baea-4e1c-8b25-e943125eed32" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:41:30 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-fa669687-65b8-4f8d-943e-715b47d1454b req-95bbd888-9e7a-4a8e-a8dc-6e99b5c01ccc service nova] Acquired lock "refresh_cache-65b637f1-baea-4e1c-8b25-e943125eed32" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:41:30 user nova-compute[75165]: DEBUG nova.network.neutron [req-fa669687-65b8-4f8d-943e-715b47d1454b req-95bbd888-9e7a-4a8e-a8dc-6e99b5c01ccc service nova] [instance: 65b637f1-baea-4e1c-8b25-e943125eed32] Refreshing network info cache for port 29185859-2394-4d70-a21d-4a7723e80fcd {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 00:41:30 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:41:30 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap78fd9337-11, may_exist=True, interface_attrs={}) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:41:30 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap78fd9337-11, col_values=(('qos', UUID('2707fb33-e499-48b6-be46-ff07fa201f15')),), if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:41:30 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap78fd9337-11, col_values=(('external_ids', {'iface-id': '78fd9337-1104-4248-9500-e9be75713371', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b3:14:9a', 'vm-uuid': '50c16604-2066-4cd2-a74e-c47a2dc4c449'}),), if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:41:30 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:41:30 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:41:30 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:41:30 user nova-compute[75165]: INFO os_vif [None req-f3f280de-e788-4dc2-a561-eda6ab339fb5 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:14:9a,bridge_name='br-int',has_traffic_filtering=True,id=78fd9337-1104-4248-9500-e9be75713371,network=Network(0fc59e9a-15a6-41b6-aee1-f8d958b92246),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78fd9337-11')
Oct 26 00:41:30 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-f3f280de-e788-4dc2-a561-eda6ab339fb5 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] No BDM found with device name vda, not building metadata. {{(pid=75165) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 00:41:30 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-f3f280de-e788-4dc2-a561-eda6ab339fb5 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] No VIF found with MAC fa:16:3e:b3:14:9a, not building metadata {{(pid=75165) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 00:41:30 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:41:30 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:41:30 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:41:30 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:41:30 user nova-compute[75165]: DEBUG nova.network.neutron [req-fa669687-65b8-4f8d-943e-715b47d1454b req-95bbd888-9e7a-4a8e-a8dc-6e99b5c01ccc service nova] [instance: 65b637f1-baea-4e1c-8b25-e943125eed32] Updated VIF entry in instance network info cache for port 29185859-2394-4d70-a21d-4a7723e80fcd. {{(pid=75165) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 00:41:30 user nova-compute[75165]: DEBUG nova.network.neutron [req-fa669687-65b8-4f8d-943e-715b47d1454b req-95bbd888-9e7a-4a8e-a8dc-6e99b5c01ccc service nova] [instance: 65b637f1-baea-4e1c-8b25-e943125eed32] Updating instance_info_cache with network_info: [{"id": "29185859-2394-4d70-a21d-4a7723e80fcd", "address": "fa:16:3e:0f:8c:52", "network": {"id": "03d2b5cd-b214-4767-a406-098bd6857327", "bridge": "br-int", "label": "tempest-TestStampPattern-968415108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e11255eee7bb4b13962634a1cd13d186", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29185859-23", "ovs_interfaceid": "29185859-2394-4d70-a21d-4a7723e80fcd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:41:30 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-fa669687-65b8-4f8d-943e-715b47d1454b req-95bbd888-9e7a-4a8e-a8dc-6e99b5c01ccc service nova] Releasing lock "refresh_cache-65b637f1-baea-4e1c-8b25-e943125eed32" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:41:30 user nova-compute[75165]: DEBUG nova.network.neutron [req-6fe9ce9e-e89b-4665-9a5e-ee364a74c9ff req-667a94b8-b2db-40c7-9703-68089c6e6aab service nova] [instance: 50c16604-2066-4cd2-a74e-c47a2dc4c449] Updated VIF entry in instance network info cache for port 78fd9337-1104-4248-9500-e9be75713371. {{(pid=75165) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 00:41:30 user nova-compute[75165]: DEBUG nova.network.neutron [req-6fe9ce9e-e89b-4665-9a5e-ee364a74c9ff req-667a94b8-b2db-40c7-9703-68089c6e6aab service nova] [instance: 50c16604-2066-4cd2-a74e-c47a2dc4c449] Updating instance_info_cache with network_info: [{"id": "78fd9337-1104-4248-9500-e9be75713371", "address": "fa:16:3e:b3:14:9a", "network": {"id": "0fc59e9a-15a6-41b6-aee1-f8d958b92246", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1263090607-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b40f07ee85b4c55b1725a43a8ee718d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78fd9337-11", "ovs_interfaceid": "78fd9337-1104-4248-9500-e9be75713371", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:41:30 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-6fe9ce9e-e89b-4665-9a5e-ee364a74c9ff req-667a94b8-b2db-40c7-9703-68089c6e6aab service nova] Releasing lock "refresh_cache-50c16604-2066-4cd2-a74e-c47a2dc4c449" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:41:30 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:41:30 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:41:31 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: 65b637f1-baea-4e1c-8b25-e943125eed32] Instance destroyed successfully.
Oct 26 00:41:31 user nova-compute[75165]: DEBUG nova.objects.instance [None req-a06eb954-27da-4873-a777-3ab002a42167 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Lazy-loading 'resources' on Instance uuid 65b637f1-baea-4e1c-8b25-e943125eed32 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:41:31 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-a06eb954-27da-4873-a777-3ab002a42167 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:38:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1255877134',display_name='tempest-TestStampPattern-server-1255877134',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1255877134',id=42,image_ref='1f5737a7-4490-4f44-971e-42604d4c5eef',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGm2My4nRv1TQMRxx0ZQGbSskYL8JiBedzBd6yh8xGYOqpiWk+KOkgfodgvUeL5VIyIOd6LANvVscgBF9awfoT7/2vctuNc54C96HHUt5A78B63ZjhSiwIVLzywUgmpbdw==',key_name='tempest-TestStampPattern-1939697091',keypairs=<?>,launch_index=0,launched_at=2023-10-26T00:38:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e11255eee7bb4b13962634a1cd13d186',ramdisk_id='',reservation_id='r-4jaje88m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='6ae9fe6f-eb17-44f5-89e4-fff5e3451336',image_min_disk='1',image_min_ram='0',image_owner_id='e11255eee7bb4b13962634a1cd13d186',image_owner_project_name='tempest-TestStampPattern-153617260',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-153617260-project-member',image_user_id='a8b04771d6df477ebd9015c46345afc5',owner_project_name='tempest-TestStampPattern-153617260',owner_user_name='tempest-TestStampPattern-153617260-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T00:38:30Z,user_data=None,user_id='a8b04771d6df477ebd9015c46345afc5',uuid=65b637f1-baea-4e1c-8b25-e943125eed32,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "29185859-2394-4d70-a21d-4a7723e80fcd", "address": "fa:16:3e:0f:8c:52", "network": {"id": "03d2b5cd-b214-4767-a406-098bd6857327", "bridge": "br-int", "label": "tempest-TestStampPattern-968415108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e11255eee7bb4b13962634a1cd13d186", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29185859-23", "ovs_interfaceid": "29185859-2394-4d70-a21d-4a7723e80fcd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 00:41:31 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-a06eb954-27da-4873-a777-3ab002a42167 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Converting VIF {"id": "29185859-2394-4d70-a21d-4a7723e80fcd", "address": "fa:16:3e:0f:8c:52", "network": {"id": "03d2b5cd-b214-4767-a406-098bd6857327", "bridge": "br-int", "label": "tempest-TestStampPattern-968415108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e11255eee7bb4b13962634a1cd13d186", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29185859-23", "ovs_interfaceid": "29185859-2394-4d70-a21d-4a7723e80fcd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:41:31 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-a06eb954-27da-4873-a777-3ab002a42167 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0f:8c:52,bridge_name='br-int',has_traffic_filtering=True,id=29185859-2394-4d70-a21d-4a7723e80fcd,network=Network(03d2b5cd-b214-4767-a406-098bd6857327),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29185859-23') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:41:31 user nova-compute[75165]: DEBUG os_vif [None req-a06eb954-27da-4873-a777-3ab002a42167 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0f:8c:52,bridge_name='br-int',has_traffic_filtering=True,id=29185859-2394-4d70-a21d-4a7723e80fcd,network=Network(03d2b5cd-b214-4767-a406-098bd6857327),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29185859-23') {{(pid=75165) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 00:41:31 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:41:31 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap29185859-23, bridge=br-int, if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:41:31 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:41:31 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:41:31 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:41:31 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:41:31 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=40143ae0-5e24-48c5-860b-3a12b5d0e048) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:41:31 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:41:31 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:41:31 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:41:31 user nova-compute[75165]: INFO os_vif [None req-a06eb954-27da-4873-a777-3ab002a42167 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0f:8c:52,bridge_name='br-int',has_traffic_filtering=True,id=29185859-2394-4d70-a21d-4a7723e80fcd,network=Network(03d2b5cd-b214-4767-a406-098bd6857327),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29185859-23')
Oct 26 00:41:31 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-a06eb954-27da-4873-a777-3ab002a42167 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] [instance: 65b637f1-baea-4e1c-8b25-e943125eed32] Deleting instance files /opt/stack/data/nova/instances/65b637f1-baea-4e1c-8b25-e943125eed32_del
Oct 26 00:41:31 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-a06eb954-27da-4873-a777-3ab002a42167 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] [instance: 65b637f1-baea-4e1c-8b25-e943125eed32] Deletion of /opt/stack/data/nova/instances/65b637f1-baea-4e1c-8b25-e943125eed32_del complete
Oct 26 00:41:31 user nova-compute[75165]: INFO nova.compute.manager [None req-a06eb954-27da-4873-a777-3ab002a42167 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] [instance: 65b637f1-baea-4e1c-8b25-e943125eed32] Took 1.43 seconds to destroy the instance on the hypervisor.
Oct 26 00:41:31 user nova-compute[75165]: DEBUG oslo.service.loopingcall [None req-a06eb954-27da-4873-a777-3ab002a42167 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75165) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 00:41:31 user nova-compute[75165]: DEBUG nova.compute.manager [-] [instance: 65b637f1-baea-4e1c-8b25-e943125eed32] Deallocating network for instance {{(pid=75165) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 00:41:31 user nova-compute[75165]: DEBUG nova.network.neutron [-] [instance: 65b637f1-baea-4e1c-8b25-e943125eed32] deallocate_for_instance() {{(pid=75165) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 00:41:31 user nova-compute[75165]: DEBUG nova.compute.manager [req-9517d152-cf5f-4f48-ba90-46a12ec316d4 req-e5672e5c-4f3b-4ef1-8c72-0d6cb33e032f service nova] [instance: 65b637f1-baea-4e1c-8b25-e943125eed32] Received event network-vif-unplugged-29185859-2394-4d70-a21d-4a7723e80fcd {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:41:31 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-9517d152-cf5f-4f48-ba90-46a12ec316d4 req-e5672e5c-4f3b-4ef1-8c72-0d6cb33e032f service nova] Acquiring lock "65b637f1-baea-4e1c-8b25-e943125eed32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:41:31 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-9517d152-cf5f-4f48-ba90-46a12ec316d4 req-e5672e5c-4f3b-4ef1-8c72-0d6cb33e032f service nova] Lock "65b637f1-baea-4e1c-8b25-e943125eed32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:41:31 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-9517d152-cf5f-4f48-ba90-46a12ec316d4 req-e5672e5c-4f3b-4ef1-8c72-0d6cb33e032f service nova] Lock "65b637f1-baea-4e1c-8b25-e943125eed32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:41:31 user nova-compute[75165]: DEBUG nova.compute.manager [req-9517d152-cf5f-4f48-ba90-46a12ec316d4 req-e5672e5c-4f3b-4ef1-8c72-0d6cb33e032f service nova] [instance: 65b637f1-baea-4e1c-8b25-e943125eed32] No waiting events found dispatching network-vif-unplugged-29185859-2394-4d70-a21d-4a7723e80fcd {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:41:31 user nova-compute[75165]: DEBUG nova.compute.manager [req-9517d152-cf5f-4f48-ba90-46a12ec316d4 req-e5672e5c-4f3b-4ef1-8c72-0d6cb33e032f service nova] [instance: 65b637f1-baea-4e1c-8b25-e943125eed32] Received event network-vif-unplugged-29185859-2394-4d70-a21d-4a7723e80fcd for instance with task_state deleting. {{(pid=75165) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 00:41:31 user nova-compute[75165]: DEBUG nova.compute.manager [req-9517d152-cf5f-4f48-ba90-46a12ec316d4 req-e5672e5c-4f3b-4ef1-8c72-0d6cb33e032f service nova] [instance: 65b637f1-baea-4e1c-8b25-e943125eed32] Received event network-vif-plugged-29185859-2394-4d70-a21d-4a7723e80fcd {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:41:31 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-9517d152-cf5f-4f48-ba90-46a12ec316d4 req-e5672e5c-4f3b-4ef1-8c72-0d6cb33e032f service nova] Acquiring lock "65b637f1-baea-4e1c-8b25-e943125eed32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:41:31 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-9517d152-cf5f-4f48-ba90-46a12ec316d4 req-e5672e5c-4f3b-4ef1-8c72-0d6cb33e032f service nova] Lock "65b637f1-baea-4e1c-8b25-e943125eed32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:41:31 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-9517d152-cf5f-4f48-ba90-46a12ec316d4 req-e5672e5c-4f3b-4ef1-8c72-0d6cb33e032f service nova] Lock "65b637f1-baea-4e1c-8b25-e943125eed32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:41:31 user nova-compute[75165]: DEBUG nova.compute.manager [req-9517d152-cf5f-4f48-ba90-46a12ec316d4 req-e5672e5c-4f3b-4ef1-8c72-0d6cb33e032f service nova] [instance: 65b637f1-baea-4e1c-8b25-e943125eed32] No waiting events found dispatching network-vif-plugged-29185859-2394-4d70-a21d-4a7723e80fcd {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:41:31 user nova-compute[75165]: WARNING nova.compute.manager [req-9517d152-cf5f-4f48-ba90-46a12ec316d4 req-e5672e5c-4f3b-4ef1-8c72-0d6cb33e032f service nova] [instance: 65b637f1-baea-4e1c-8b25-e943125eed32] Received unexpected event network-vif-plugged-29185859-2394-4d70-a21d-4a7723e80fcd for instance with vm_state active and task_state deleting.
Oct 26 00:41:31 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:41:31 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Starting heal instance info cache {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 00:41:31 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Rebuilding the list of instances to heal {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 00:41:31 user nova-compute[75165]: DEBUG nova.network.neutron [-] [instance: 65b637f1-baea-4e1c-8b25-e943125eed32] Updating instance_info_cache with network_info: [] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:41:31 user nova-compute[75165]: INFO nova.compute.manager [-] [instance: 65b637f1-baea-4e1c-8b25-e943125eed32] Took 0.39 seconds to deallocate network for instance.
Oct 26 00:41:31 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: bbb1769b-f252-4a6a-9932-a2e962595926] Skipping network cache update for instance because it is Building. {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9934}}
Oct 26 00:41:31 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: 7c62961f-e928-4df6-9c4e-74f035dde9a2] Skipping network cache update for instance because it is Building. {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9934}}
Oct 26 00:41:31 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: 50c16604-2066-4cd2-a74e-c47a2dc4c449] Skipping network cache update for instance because it is Building. {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9934}}
Oct 26 00:41:31 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: 65b637f1-baea-4e1c-8b25-e943125eed32] Skipping network cache update for instance because it is being deleted. {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9938}}
Oct 26 00:41:31 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "refresh_cache-6ae9fe6f-eb17-44f5-89e4-fff5e3451336" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:41:31 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquired lock "refresh_cache-6ae9fe6f-eb17-44f5-89e4-fff5e3451336" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:41:31 user nova-compute[75165]: DEBUG nova.network.neutron [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: 6ae9fe6f-eb17-44f5-89e4-fff5e3451336] Forcefully refreshing network info cache for instance {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 00:41:31 user nova-compute[75165]: DEBUG nova.objects.instance [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lazy-loading 'info_cache' on Instance uuid 6ae9fe6f-eb17-44f5-89e4-fff5e3451336 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:41:31 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-a06eb954-27da-4873-a777-3ab002a42167 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:41:31 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-a06eb954-27da-4873-a777-3ab002a42167 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:41:31 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:41:32 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:41:32 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:41:32 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:41:32 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:41:32 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-a06eb954-27da-4873-a777-3ab002a42167 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:41:32 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-a06eb954-27da-4873-a777-3ab002a42167 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:41:32 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-a06eb954-27da-4873-a777-3ab002a42167 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.383s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:41:32 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:41:32 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:41:32 user nova-compute[75165]: INFO nova.scheduler.client.report [None req-a06eb954-27da-4873-a777-3ab002a42167 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Deleted allocations for instance 65b637f1-baea-4e1c-8b25-e943125eed32
Oct 26 00:41:32 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:41:32 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-a06eb954-27da-4873-a777-3ab002a42167 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Lock "65b637f1-baea-4e1c-8b25-e943125eed32" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.429s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:41:32 user nova-compute[75165]: DEBUG nova.compute.manager [req-da9fdce8-05af-4308-9c6f-72d8f3943024 req-e52a3652-edd9-4d5e-841a-5c412712f299 service nova] [instance: 50c16604-2066-4cd2-a74e-c47a2dc4c449] Received event network-vif-plugged-78fd9337-1104-4248-9500-e9be75713371 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:41:32 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-da9fdce8-05af-4308-9c6f-72d8f3943024 req-e52a3652-edd9-4d5e-841a-5c412712f299 service nova] Acquiring lock "50c16604-2066-4cd2-a74e-c47a2dc4c449-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:41:32 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-da9fdce8-05af-4308-9c6f-72d8f3943024 req-e52a3652-edd9-4d5e-841a-5c412712f299 service nova] Lock "50c16604-2066-4cd2-a74e-c47a2dc4c449-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:41:32 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-da9fdce8-05af-4308-9c6f-72d8f3943024 req-e52a3652-edd9-4d5e-841a-5c412712f299 service nova] Lock "50c16604-2066-4cd2-a74e-c47a2dc4c449-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:41:32 user nova-compute[75165]: DEBUG nova.compute.manager [req-da9fdce8-05af-4308-9c6f-72d8f3943024 req-e52a3652-edd9-4d5e-841a-5c412712f299 service nova] [instance: 50c16604-2066-4cd2-a74e-c47a2dc4c449] No waiting events found dispatching network-vif-plugged-78fd9337-1104-4248-9500-e9be75713371 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:41:32 user nova-compute[75165]: WARNING nova.compute.manager [req-da9fdce8-05af-4308-9c6f-72d8f3943024 req-e52a3652-edd9-4d5e-841a-5c412712f299 service nova] [instance: 50c16604-2066-4cd2-a74e-c47a2dc4c449] Received unexpected event network-vif-plugged-78fd9337-1104-4248-9500-e9be75713371 for instance with vm_state building and task_state spawning.
Oct 26 00:41:32 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:41:32 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:41:32 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:41:32 user nova-compute[75165]: DEBUG nova.network.neutron [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: 6ae9fe6f-eb17-44f5-89e4-fff5e3451336] Updating instance_info_cache with network_info: [{"id": "5057f477-2080-4285-86a0-8f50541c3361", "address": "fa:16:3e:ca:e5:01", "network": {"id": "03d2b5cd-b214-4767-a406-098bd6857327", "bridge": "br-int", "label": "tempest-TestStampPattern-968415108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e11255eee7bb4b13962634a1cd13d186", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5057f477-20", "ovs_interfaceid": "5057f477-2080-4285-86a0-8f50541c3361", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:41:32 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Releasing lock "refresh_cache-6ae9fe6f-eb17-44f5-89e4-fff5e3451336" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:41:32 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: 6ae9fe6f-eb17-44f5-89e4-fff5e3451336] Updated the network info_cache for instance {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 00:41:32 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:41:32 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:41:33 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:41:33 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:41:33 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:41:33 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:41:33 user nova-compute[75165]: DEBUG nova.compute.manager [req-5d28de71-25f4-448c-8079-f974416ce048 req-6dfc28cb-6d19-437d-86f4-3ea7bd725360 service nova] [instance: 65b637f1-baea-4e1c-8b25-e943125eed32] Received event network-vif-deleted-29185859-2394-4d70-a21d-4a7723e80fcd {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:41:33 user nova-compute[75165]: DEBUG nova.compute.manager [req-5d28de71-25f4-448c-8079-f974416ce048 req-6dfc28cb-6d19-437d-86f4-3ea7bd725360 service nova] [instance: 7c62961f-e928-4df6-9c4e-74f035dde9a2] Received event network-vif-plugged-336cfc3b-0045-4c7f-bd85-ce9b9080ff58 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:41:33 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-5d28de71-25f4-448c-8079-f974416ce048 req-6dfc28cb-6d19-437d-86f4-3ea7bd725360 service nova] Acquiring lock "7c62961f-e928-4df6-9c4e-74f035dde9a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:41:33 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-5d28de71-25f4-448c-8079-f974416ce048 req-6dfc28cb-6d19-437d-86f4-3ea7bd725360 service nova] Lock "7c62961f-e928-4df6-9c4e-74f035dde9a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:41:33 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-5d28de71-25f4-448c-8079-f974416ce048 req-6dfc28cb-6d19-437d-86f4-3ea7bd725360 service nova] Lock "7c62961f-e928-4df6-9c4e-74f035dde9a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:41:33 user nova-compute[75165]: DEBUG nova.compute.manager [req-5d28de71-25f4-448c-8079-f974416ce048 req-6dfc28cb-6d19-437d-86f4-3ea7bd725360 service nova] [instance: 7c62961f-e928-4df6-9c4e-74f035dde9a2] No waiting events found dispatching network-vif-plugged-336cfc3b-0045-4c7f-bd85-ce9b9080ff58 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:41:33 user nova-compute[75165]: WARNING nova.compute.manager [req-5d28de71-25f4-448c-8079-f974416ce048 req-6dfc28cb-6d19-437d-86f4-3ea7bd725360 service nova] [instance: 7c62961f-e928-4df6-9c4e-74f035dde9a2] Received unexpected event network-vif-plugged-336cfc3b-0045-4c7f-bd85-ce9b9080ff58 for instance with vm_state building and task_state spawning.
Oct 26 00:41:33 user nova-compute[75165]: DEBUG nova.compute.manager [req-5d28de71-25f4-448c-8079-f974416ce048 req-6dfc28cb-6d19-437d-86f4-3ea7bd725360 service nova] [instance: 7c62961f-e928-4df6-9c4e-74f035dde9a2] Received event network-vif-plugged-336cfc3b-0045-4c7f-bd85-ce9b9080ff58 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:41:33 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-5d28de71-25f4-448c-8079-f974416ce048 req-6dfc28cb-6d19-437d-86f4-3ea7bd725360 service nova] Acquiring lock "7c62961f-e928-4df6-9c4e-74f035dde9a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:41:33 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-5d28de71-25f4-448c-8079-f974416ce048 req-6dfc28cb-6d19-437d-86f4-3ea7bd725360 service nova] Lock "7c62961f-e928-4df6-9c4e-74f035dde9a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:41:33 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-5d28de71-25f4-448c-8079-f974416ce048 req-6dfc28cb-6d19-437d-86f4-3ea7bd725360 service nova] Lock "7c62961f-e928-4df6-9c4e-74f035dde9a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:41:33 user nova-compute[75165]: DEBUG nova.compute.manager [req-5d28de71-25f4-448c-8079-f974416ce048 req-6dfc28cb-6d19-437d-86f4-3ea7bd725360 service nova] [instance: 7c62961f-e928-4df6-9c4e-74f035dde9a2] No waiting events found dispatching network-vif-plugged-336cfc3b-0045-4c7f-bd85-ce9b9080ff58 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:41:33 user nova-compute[75165]: WARNING nova.compute.manager [req-5d28de71-25f4-448c-8079-f974416ce048 req-6dfc28cb-6d19-437d-86f4-3ea7bd725360 service nova] [instance: 7c62961f-e928-4df6-9c4e-74f035dde9a2] Received unexpected event network-vif-plugged-336cfc3b-0045-4c7f-bd85-ce9b9080ff58 for instance with vm_state building and task_state spawning.
Oct 26 00:41:34 user nova-compute[75165]: DEBUG nova.compute.manager [req-a50a770f-5db1-4597-a230-8826113c5c42 req-0336825f-96f5-4df7-8cbd-72df297539f7 service nova] [instance: 50c16604-2066-4cd2-a74e-c47a2dc4c449] Received event network-vif-plugged-78fd9337-1104-4248-9500-e9be75713371 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:41:34 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-a50a770f-5db1-4597-a230-8826113c5c42 req-0336825f-96f5-4df7-8cbd-72df297539f7 service nova] Acquiring lock "50c16604-2066-4cd2-a74e-c47a2dc4c449-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:41:34 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-a50a770f-5db1-4597-a230-8826113c5c42 req-0336825f-96f5-4df7-8cbd-72df297539f7 service nova] Lock "50c16604-2066-4cd2-a74e-c47a2dc4c449-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:41:34 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-a50a770f-5db1-4597-a230-8826113c5c42 req-0336825f-96f5-4df7-8cbd-72df297539f7 service nova] Lock "50c16604-2066-4cd2-a74e-c47a2dc4c449-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:41:34 user nova-compute[75165]: DEBUG nova.compute.manager [req-a50a770f-5db1-4597-a230-8826113c5c42 req-0336825f-96f5-4df7-8cbd-72df297539f7 service nova] [instance: 50c16604-2066-4cd2-a74e-c47a2dc4c449] No waiting events found dispatching network-vif-plugged-78fd9337-1104-4248-9500-e9be75713371 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:41:34 user nova-compute[75165]: WARNING nova.compute.manager [req-a50a770f-5db1-4597-a230-8826113c5c42 req-0336825f-96f5-4df7-8cbd-72df297539f7 service nova] [instance: 50c16604-2066-4cd2-a74e-c47a2dc4c449] Received unexpected event network-vif-plugged-78fd9337-1104-4248-9500-e9be75713371 for instance with vm_state building and task_state spawning.
Oct 26 00:41:34 user nova-compute[75165]: DEBUG nova.compute.manager [None req-bef452bf-259d-492a-abbd-3b16a54377ec tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 7c62961f-e928-4df6-9c4e-74f035dde9a2] Instance event wait completed in 0 seconds for  {{(pid=75165) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 00:41:34 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-bef452bf-259d-492a-abbd-3b16a54377ec tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 7c62961f-e928-4df6-9c4e-74f035dde9a2] Guest created on hypervisor {{(pid=75165) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 00:41:34 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: 7c62961f-e928-4df6-9c4e-74f035dde9a2] Instance spawned successfully.
Oct 26 00:41:34 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-bef452bf-259d-492a-abbd-3b16a54377ec tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 7c62961f-e928-4df6-9c4e-74f035dde9a2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 00:41:34 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:41:34 user nova-compute[75165]: DEBUG nova.compute.manager [None req-f3f280de-e788-4dc2-a561-eda6ab339fb5 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] [instance: 50c16604-2066-4cd2-a74e-c47a2dc4c449] Instance event wait completed in 0 seconds for  {{(pid=75165) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 00:41:34 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-f3f280de-e788-4dc2-a561-eda6ab339fb5 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] [instance: 50c16604-2066-4cd2-a74e-c47a2dc4c449] Guest created on hypervisor {{(pid=75165) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 00:41:34 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-bef452bf-259d-492a-abbd-3b16a54377ec tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 7c62961f-e928-4df6-9c4e-74f035dde9a2] Found default for hw_cdrom_bus of ide {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:41:34 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-bef452bf-259d-492a-abbd-3b16a54377ec tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 7c62961f-e928-4df6-9c4e-74f035dde9a2] Found default for hw_disk_bus of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:41:34 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-bef452bf-259d-492a-abbd-3b16a54377ec tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 7c62961f-e928-4df6-9c4e-74f035dde9a2] Found default for hw_input_bus of None {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:41:34 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-bef452bf-259d-492a-abbd-3b16a54377ec tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 7c62961f-e928-4df6-9c4e-74f035dde9a2] Found default for hw_pointer_model of None {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:41:34 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-bef452bf-259d-492a-abbd-3b16a54377ec tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 7c62961f-e928-4df6-9c4e-74f035dde9a2] Found default for hw_video_model of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:41:34 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-bef452bf-259d-492a-abbd-3b16a54377ec tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 7c62961f-e928-4df6-9c4e-74f035dde9a2] Found default for hw_vif_model of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:41:34 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: 50c16604-2066-4cd2-a74e-c47a2dc4c449] Instance spawned successfully.
Oct 26 00:41:34 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-f3f280de-e788-4dc2-a561-eda6ab339fb5 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] [instance: 50c16604-2066-4cd2-a74e-c47a2dc4c449] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 00:41:34 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:41:34 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:41:34 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:41:34 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75165) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 00:41:34 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-f3f280de-e788-4dc2-a561-eda6ab339fb5 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] [instance: 50c16604-2066-4cd2-a74e-c47a2dc4c449] Found default for hw_cdrom_bus of ide {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:41:34 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-f3f280de-e788-4dc2-a561-eda6ab339fb5 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] [instance: 50c16604-2066-4cd2-a74e-c47a2dc4c449] Found default for hw_disk_bus of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:41:34 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-f3f280de-e788-4dc2-a561-eda6ab339fb5 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] [instance: 50c16604-2066-4cd2-a74e-c47a2dc4c449] Found default for hw_input_bus of None {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:41:34 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-f3f280de-e788-4dc2-a561-eda6ab339fb5 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] [instance: 50c16604-2066-4cd2-a74e-c47a2dc4c449] Found default for hw_pointer_model of None {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:41:34 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-f3f280de-e788-4dc2-a561-eda6ab339fb5 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] [instance: 50c16604-2066-4cd2-a74e-c47a2dc4c449] Found default for hw_video_model of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:41:34 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-f3f280de-e788-4dc2-a561-eda6ab339fb5 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] [instance: 50c16604-2066-4cd2-a74e-c47a2dc4c449] Found default for hw_vif_model of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:41:34 user nova-compute[75165]: INFO nova.compute.manager [None req-bef452bf-259d-492a-abbd-3b16a54377ec tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 7c62961f-e928-4df6-9c4e-74f035dde9a2] Took 7.71 seconds to spawn the instance on the hypervisor.
Oct 26 00:41:34 user nova-compute[75165]: DEBUG nova.compute.manager [None req-bef452bf-259d-492a-abbd-3b16a54377ec tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 7c62961f-e928-4df6-9c4e-74f035dde9a2] Checking state {{(pid=75165) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 00:41:34 user nova-compute[75165]: INFO nova.compute.manager [None req-f3f280de-e788-4dc2-a561-eda6ab339fb5 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] [instance: 50c16604-2066-4cd2-a74e-c47a2dc4c449] Took 6.97 seconds to spawn the instance on the hypervisor.
Oct 26 00:41:34 user nova-compute[75165]: DEBUG nova.compute.manager [None req-f3f280de-e788-4dc2-a561-eda6ab339fb5 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] [instance: 50c16604-2066-4cd2-a74e-c47a2dc4c449] Checking state {{(pid=75165) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 00:41:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c16604-2066-4cd2-a74e-c47a2dc4c449/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:41:35 user nova-compute[75165]: INFO nova.compute.manager [None req-bef452bf-259d-492a-abbd-3b16a54377ec tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 7c62961f-e928-4df6-9c4e-74f035dde9a2] Took 8.55 seconds to build instance.
Oct 26 00:41:35 user nova-compute[75165]: INFO nova.compute.manager [None req-f3f280de-e788-4dc2-a561-eda6ab339fb5 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] [instance: 50c16604-2066-4cd2-a74e-c47a2dc4c449] Took 7.93 seconds to build instance.
Oct 26 00:41:35 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-bef452bf-259d-492a-abbd-3b16a54377ec tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Lock "7c62961f-e928-4df6-9c4e-74f035dde9a2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.666s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:41:35 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-f3f280de-e788-4dc2-a561-eda6ab339fb5 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Lock "50c16604-2066-4cd2-a74e-c47a2dc4c449" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.059s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:41:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c16604-2066-4cd2-a74e-c47a2dc4c449/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:41:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c16604-2066-4cd2-a74e-c47a2dc4c449/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:41:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c16604-2066-4cd2-a74e-c47a2dc4c449/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:41:35 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75165) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 00:41:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c62961f-e928-4df6-9c4e-74f035dde9a2/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:41:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c62961f-e928-4df6-9c4e-74f035dde9a2/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:41:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c62961f-e928-4df6-9c4e-74f035dde9a2/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:41:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c62961f-e928-4df6-9c4e-74f035dde9a2/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:41:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae9fe6f-eb17-44f5-89e4-fff5e3451336/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:41:36 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae9fe6f-eb17-44f5-89e4-fff5e3451336/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:41:36 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae9fe6f-eb17-44f5-89e4-fff5e3451336/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:41:36 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae9fe6f-eb17-44f5-89e4-fff5e3451336/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:41:36 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:41:36 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:41:36 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:41:36 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Hypervisor/Node resource view: name=user free_ram=8704MB free_disk=24.74496841430664GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75165) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 00:41:36 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:41:36 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:41:36 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 6ae9fe6f-eb17-44f5-89e4-fff5e3451336 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:41:36 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 539bedc3-f788-4d5e-993b-3b168d027a57 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:41:36 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance bbb1769b-f252-4a6a-9932-a2e962595926 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:41:36 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 7c62961f-e928-4df6-9c4e-74f035dde9a2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:41:36 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 50c16604-2066-4cd2-a74e-c47a2dc4c449 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:41:36 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75165) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 00:41:36 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75165) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 00:41:36 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:41:37 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:41:37 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:41:37 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Compute_service record updated for user:user {{(pid=75165) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 00:41:37 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.574s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:41:38 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:41:41 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:41:42 user nova-compute[75165]: DEBUG nova.compute.manager [None req-4d3018c1-54ca-4516-910a-d16a44f42685 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: bbb1769b-f252-4a6a-9932-a2e962595926] Start spawning the instance on the hypervisor. {{(pid=75165) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 00:41:42 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-4d3018c1-54ca-4516-910a-d16a44f42685 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: bbb1769b-f252-4a6a-9932-a2e962595926] Creating instance directory {{(pid=75165) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 00:41:42 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-4d3018c1-54ca-4516-910a-d16a44f42685 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: bbb1769b-f252-4a6a-9932-a2e962595926] Creating image(s)
Oct 26 00:41:42 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-4d3018c1-54ca-4516-910a-d16a44f42685 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: bbb1769b-f252-4a6a-9932-a2e962595926] Did not create local disks {{(pid=75165) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 26 00:41:42 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-4d3018c1-54ca-4516-910a-d16a44f42685 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: bbb1769b-f252-4a6a-9932-a2e962595926] Ensure instance console log exists: /opt/stack/data/nova/instances/bbb1769b-f252-4a6a-9932-a2e962595926/console.log {{(pid=75165) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 00:41:42 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-4d3018c1-54ca-4516-910a-d16a44f42685 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:41:42 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-4d3018c1-54ca-4516-910a-d16a44f42685 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:41:42 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-4d3018c1-54ca-4516-910a-d16a44f42685 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:41:42 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-4d3018c1-54ca-4516-910a-d16a44f42685 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: bbb1769b-f252-4a6a-9932-a2e962595926] Start _get_guest_xml network_info=[{"id": "c45711bb-b4a3-4471-853d-88ef000a2e63", "address": "fa:16:3e:8f:4d:97", "network": {"id": "dc50ae7b-d501-461f-aa0b-542514330ae8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1091857056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1051405ca054c4bb051fb842a5fb5a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc45711bb-b4", "ovs_interfaceid": "c45711bb-b4a3-4471-853d-88ef000a2e63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-10-26T00:41:04Z,direct_url=<?>,disk_format='qcow2',id=1a8e8835-927b-455b-ae15-eb773ff0382b,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-757675635',owner='d1051405ca054c4bb051fb842a5fb5a0',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-10-26T00:41:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b66f7383-3ffd-4715-ad95-2df79f0fb531', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uJpjTsir', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'bbb1769b-f252-4a6a-9932-a2e962595926', 'attached_at': '', 'detached_at': '', 'volume_id': 'b66f7383-3ffd-4715-ad95-2df79f0fb531', 'serial': 'b66f7383-3ffd-4715-ad95-2df79f0fb531'}, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'attachment_id': '896e62c2-fa64-464e-8fda-e2f42ba3ebdc', 'delete_on_termination': True, 'volume_type': None} {{(pid=75165) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 00:41:42 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-4d3018c1-54ca-4516-910a-d16a44f42685 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:41:42 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-4d3018c1-54ca-4516-910a-d16a44f42685 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:41:42 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-4d3018c1-54ca-4516-910a-d16a44f42685 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75165) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 00:41:42 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-4d3018c1-54ca-4516-910a-d16a44f42685 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] CPU controller missing on host. {{(pid=75165) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 00:41:42 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-4d3018c1-54ca-4516-910a-d16a44f42685 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75165) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 00:41:42 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-4d3018c1-54ca-4516-910a-d16a44f42685 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] CPU controller found on host. {{(pid=75165) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 00:41:42 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-4d3018c1-54ca-4516-910a-d16a44f42685 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75165) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 00:41:42 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-4d3018c1-54ca-4516-910a-d16a44f42685 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T00:03:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-10-26T00:41:04Z,direct_url=<?>,disk_format='qcow2',id=1a8e8835-927b-455b-ae15-eb773ff0382b,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-757675635',owner='d1051405ca054c4bb051fb842a5fb5a0',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-10-26T00:41:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 00:41:42 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-4d3018c1-54ca-4516-910a-d16a44f42685 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Flavor limits 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 00:41:42 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-4d3018c1-54ca-4516-910a-d16a44f42685 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Image limits 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 00:41:42 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-4d3018c1-54ca-4516-910a-d16a44f42685 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Flavor pref 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 00:41:42 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-4d3018c1-54ca-4516-910a-d16a44f42685 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Image pref 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 00:41:42 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-4d3018c1-54ca-4516-910a-d16a44f42685 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 00:41:42 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-4d3018c1-54ca-4516-910a-d16a44f42685 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 00:41:42 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-4d3018c1-54ca-4516-910a-d16a44f42685 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75165) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 00:41:42 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-4d3018c1-54ca-4516-910a-d16a44f42685 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Got 1 possible topologies {{(pid=75165) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 00:41:42 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-4d3018c1-54ca-4516-910a-d16a44f42685 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 00:41:42 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-4d3018c1-54ca-4516-910a-d16a44f42685 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 00:41:42 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d3018c1-54ca-4516-910a-d16a44f42685 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: bbb1769b-f252-4a6a-9932-a2e962595926] Calling os-brick to attach iSCSI Volume {{(pid=75165) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 00:41:42 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d3018c1-54ca-4516-910a-d16a44f42685 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8bf8160e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b66f7383-3ffd-4715-ad95-2df79f0fb531', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uJpjTsir', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:41:42 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-4d3018c1-54ca-4516-910a-d16a44f42685 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:41:42 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-4d3018c1-54ca-4516-910a-d16a44f42685 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:41:42 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-4d3018c1-54ca-4516-910a-d16a44f42685 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:41:42 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-4d3018c1-54ca-4516-910a-d16a44f42685 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:41:42 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-4d3018c1-54ca-4516-910a-d16a44f42685 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b66f7383-3ffd-4715-ad95-2df79f0fb531" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:41:42 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-4d3018c1-54ca-4516-910a-d16a44f42685 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b66f7383-3ffd-4715-ad95-2df79f0fb531" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:41:42 user nova-compute[75165]: INFO os_brick.initiator.connectors.iscsi [None req-4d3018c1-54ca-4516-910a-d16a44f42685 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 00:41:42 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b66f7383-3ffd-4715-ad95-2df79f0fb531 -p 172.16.0.220:3260 {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:41:42 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b66f7383-3ffd-4715-ad95-2df79f0fb531 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:41:42 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[34b6db01-1506-4c88-b715-2f02d921e03b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:41:42 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d3018c1-54ca-4516-910a-d16a44f42685 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 00:41:42 user nova-compute[75165]:  {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:41:42 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b66f7383-3ffd-4715-ad95-2df79f0fb531 -p 172.16.0.220:3260 --interface default --op new {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:41:42 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b66f7383-3ffd-4715-ad95-2df79f0fb531 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:41:42 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[07f311ef-52c2-40f9-b26d-a7994fd1b84e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b66f7383-3ffd-4715-ad95-2df79f0fb531] added\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:41:42 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d3018c1-54ca-4516-910a-d16a44f42685 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b66f7383-3ffd-4715-ad95-2df79f0fb531] added
Oct 26 00:41:42 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:41:42 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b66f7383-3ffd-4715-ad95-2df79f0fb531 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:41:42 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b66f7383-3ffd-4715-ad95-2df79f0fb531 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:41:42 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[183db161-36cd-4dae-bee1-58215b63e181]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:41:42 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d3018c1-54ca-4516-910a-d16a44f42685 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:41:42 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b66f7383-3ffd-4715-ad95-2df79f0fb531 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:41:42 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b66f7383-3ffd-4715-ad95-2df79f0fb531 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:41:42 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7532948-8578-4fca-8fc4-5877efb3f759]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:41:42 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d3018c1-54ca-4516-910a-d16a44f42685 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:41:42 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b66f7383-3ffd-4715-ad95-2df79f0fb531 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uJpjTsir {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:41:42 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b66f7383-3ffd-4715-ad95-2df79f0fb531 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uJpjTsir" returned: 0 in 0.017s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:41:42 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[3973e23c-bba1-4d3c-b32a-7be01ea38a47]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:41:42 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d3018c1-54ca-4516-910a-d16a44f42685 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uJpjTsir'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:41:42 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b66f7383-3ffd-4715-ad95-2df79f0fb531 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:41:42 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b66f7383-3ffd-4715-ad95-2df79f0fb531 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:41:42 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4a8f09e-7c04-4af5-9225-06ba2a0f8a21]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:41:42 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d3018c1-54ca-4516-910a-d16a44f42685 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:41:42 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:41:42 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:41:42 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4b0cfa3-4414-4947-8479-0c305bca9900]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67c880f5-c46a-4e45-b73a-a052fca3638c (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:41:42 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d3018c1-54ca-4516-910a-d16a44f42685 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67c880f5-c46a-4e45-b73a-a052fca3638c (non-flash)
Oct 26 00:41:42 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:41:42 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d3018c1-54ca-4516-910a-d16a44f42685 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67c880f5-c46a-4e45-b73a-a052fca3638c (non-flash)
Oct 26 00:41:42 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:41:42 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b66f7383-3ffd-4715-ad95-2df79f0fb531 -p 172.16.0.220:3260 --login {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:41:42 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b66f7383-3ffd-4715-ad95-2df79f0fb531 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:41:42 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cbd72f3-787e-4d46-afa5-e1321e1d6101]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b66f7383-3ffd-4715-ad95-2df79f0fb531, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b66f7383-3ffd-4715-ad95-2df79f0fb531, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:41:42 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d3018c1-54ca-4516-910a-d16a44f42685 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b66f7383-3ffd-4715-ad95-2df79f0fb531, portal: 172.16.0.220,3260]
Oct 26 00:41:42 user nova-compute[75165]: Login to [iface: default, target: iqn.2010-10.org.openstack:b66f7383-3ffd-4715-ad95-2df79f0fb531, portal: 172.16.0.220,3260] successful.
Oct 26 00:41:42 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:41:42 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b66f7383-3ffd-4715-ad95-2df79f0fb531 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:41:42 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b66f7383-3ffd-4715-ad95-2df79f0fb531 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:41:42 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[f619b89a-7e6d-46ec-8df1-d36cc87ffe03]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:41:42 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d3018c1-54ca-4516-910a-d16a44f42685 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:41:42 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:41:42 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:41:42 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[77edc5da-c212-4141-9298-1b56e74b831c]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67c880f5-c46a-4e45-b73a-a052fca3638c (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b66f7383-3ffd-4715-ad95-2df79f0fb531 (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:41:42 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d3018c1-54ca-4516-910a-d16a44f42685 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67c880f5-c46a-4e45-b73a-a052fca3638c (non-flash)
Oct 26 00:41:42 user nova-compute[75165]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b66f7383-3ffd-4715-ad95-2df79f0fb531 (non-flash)
Oct 26 00:41:42 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:41:42 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d3018c1-54ca-4516-910a-d16a44f42685 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67c880f5-c46a-4e45-b73a-a052fca3638c (non-flash)
Oct 26 00:41:42 user nova-compute[75165]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b66f7383-3ffd-4715-ad95-2df79f0fb531 (non-flash)
Oct 26 00:41:42 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:41:42 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-4d3018c1-54ca-4516-910a-d16a44f42685 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b66f7383-3ffd-4715-ad95-2df79f0fb531" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.251s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:41:42 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d3018c1-54ca-4516-910a-d16a44f42685 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Connected to 172.16.0.220:3260 {{(pid=75165) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 00:41:42 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-4d3018c1-54ca-4516-910a-d16a44f42685 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] HCTL ('34', '-', '-', 0) found on session 48 with lun 0 {{(pid=75165) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 00:41:42 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-4d3018c1-54ca-4516-910a-d16a44f42685 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75165) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 00:41:42 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:41:42 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:41:42 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc0589f1-4acb-47a3-a460-1408e66a57c4]: (4, ('- - 0', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:41:42 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-4d3018c1-54ca-4516-910a-d16a44f42685 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Searching for a device in session 48 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75165) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 00:41:42 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d3018c1-54ca-4516-910a-d16a44f42685 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:b66f7383-3ffd-4715-ad95-2df79f0fb531', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uJpjTsir', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75165) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 00:41:43 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-4d3018c1-54ca-4516-910a-d16a44f42685 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.283s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:41:43 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d3018c1-54ca-4516-910a-d16a44f42685 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] <== connect_volume: return (1284ms) {'type': 'block', 'scsi_wwn': '23165633231323131', 'path': '/dev/sdc'} {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:41:43 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d3018c1-54ca-4516-910a-d16a44f42685 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: bbb1769b-f252-4a6a-9932-a2e962595926] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23165633231323131', 'path': '/dev/sdc'} {{(pid=75165) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 00:41:43 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-4d3018c1-54ca-4516-910a-d16a44f42685 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:41:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1143304098',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1143304098',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1143304098',id=44,image_ref='1a8e8835-927b-455b-ae15-eb773ff0382b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO9AUAxC0Goi3BlzHMx5yqHNVp2bemo7LModIb3KoBLLSf2AR7Xh+0UGXTqZf0MOmNqHrmKsRbXSX1EVZfBQGHcWEBm7CFrWU0EwrG15GWFIlK2PPneXhtqsFLmDqv/D4g==',key_name='tempest-keypair-297088254',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d1051405ca054c4bb051fb842a5fb5a0',ramdisk_id='',reservation_id='r-i0ahhvvf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1215567595',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1215567595-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1215567595',owner_user_name='tempest-TestVolumeBootPattern-1215567595-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T00:41:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ae836eab78514cf3894e5e11240ff374',uuid=bbb1769b-f252-4a6a-9932-a2e962595926,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c45711bb-b4a3-4471-853d-88ef000a2e63", "address": "fa:16:3e:8f:4d:97", "network": {"id": "dc50ae7b-d501-461f-aa0b-542514330ae8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1091857056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1051405ca054c4bb051fb842a5fb5a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc45711bb-b4", "ovs_interfaceid": "c45711bb-b4a3-4471-853d-88ef000a2e63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75165) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 00:41:43 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-4d3018c1-54ca-4516-910a-d16a44f42685 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Converting VIF {"id": "c45711bb-b4a3-4471-853d-88ef000a2e63", "address": "fa:16:3e:8f:4d:97", "network": {"id": "dc50ae7b-d501-461f-aa0b-542514330ae8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1091857056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1051405ca054c4bb051fb842a5fb5a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc45711bb-b4", "ovs_interfaceid": "c45711bb-b4a3-4471-853d-88ef000a2e63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:41:43 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-4d3018c1-54ca-4516-910a-d16a44f42685 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:4d:97,bridge_name='br-int',has_traffic_filtering=True,id=c45711bb-b4a3-4471-853d-88ef000a2e63,network=Network(dc50ae7b-d501-461f-aa0b-542514330ae8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc45711bb-b4') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:41:43 user nova-compute[75165]: DEBUG nova.objects.instance [None req-4d3018c1-54ca-4516-910a-d16a44f42685 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Lazy-loading 'pci_devices' on Instance uuid bbb1769b-f252-4a6a-9932-a2e962595926 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:41:43 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-4d3018c1-54ca-4516-910a-d16a44f42685 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: bbb1769b-f252-4a6a-9932-a2e962595926] End _get_guest_xml xml=<domain type="kvm">
Oct 26 00:41:43 user nova-compute[75165]:   <uuid>bbb1769b-f252-4a6a-9932-a2e962595926</uuid>
Oct 26 00:41:43 user nova-compute[75165]:   <name>instance-0000002c</name>
Oct 26 00:41:43 user nova-compute[75165]:   <memory>524288</memory>
Oct 26 00:41:43 user nova-compute[75165]:   <vcpu>1</vcpu>
Oct 26 00:41:43 user nova-compute[75165]:   <metadata>
Oct 26 00:41:43 user nova-compute[75165]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 00:41:43 user nova-compute[75165]:       <nova:package version="0.0.0"/>
Oct 26 00:41:43 user nova-compute[75165]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1143304098</nova:name>
Oct 26 00:41:43 user nova-compute[75165]:       <nova:creationTime>2023-10-26 00:41:42</nova:creationTime>
Oct 26 00:41:43 user nova-compute[75165]:       <nova:flavor name="m1.tiny">
Oct 26 00:41:43 user nova-compute[75165]:         <nova:memory>512</nova:memory>
Oct 26 00:41:43 user nova-compute[75165]:         <nova:disk>1</nova:disk>
Oct 26 00:41:43 user nova-compute[75165]:         <nova:swap>0</nova:swap>
Oct 26 00:41:43 user nova-compute[75165]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 00:41:43 user nova-compute[75165]:         <nova:vcpus>1</nova:vcpus>
Oct 26 00:41:43 user nova-compute[75165]:       </nova:flavor>
Oct 26 00:41:43 user nova-compute[75165]:       <nova:owner>
Oct 26 00:41:43 user nova-compute[75165]:         <nova:user uuid="ae836eab78514cf3894e5e11240ff374">tempest-TestVolumeBootPattern-1215567595-project-member</nova:user>
Oct 26 00:41:43 user nova-compute[75165]:         <nova:project uuid="d1051405ca054c4bb051fb842a5fb5a0">tempest-TestVolumeBootPattern-1215567595</nova:project>
Oct 26 00:41:43 user nova-compute[75165]:       </nova:owner>
Oct 26 00:41:43 user nova-compute[75165]:       <nova:root type="image" uuid="1a8e8835-927b-455b-ae15-eb773ff0382b"/>
Oct 26 00:41:43 user nova-compute[75165]:       <nova:ports>
Oct 26 00:41:43 user nova-compute[75165]:         <nova:port uuid="c45711bb-b4a3-4471-853d-88ef000a2e63">
Oct 26 00:41:43 user nova-compute[75165]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 26 00:41:43 user nova-compute[75165]:         </nova:port>
Oct 26 00:41:43 user nova-compute[75165]:       </nova:ports>
Oct 26 00:41:43 user nova-compute[75165]:     </nova:instance>
Oct 26 00:41:43 user nova-compute[75165]:   </metadata>
Oct 26 00:41:43 user nova-compute[75165]:   <sysinfo type="smbios">
Oct 26 00:41:43 user nova-compute[75165]:     <system>
Oct 26 00:41:43 user nova-compute[75165]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 00:41:43 user nova-compute[75165]:       <entry name="product">OpenStack Nova</entry>
Oct 26 00:41:43 user nova-compute[75165]:       <entry name="version">0.0.0</entry>
Oct 26 00:41:43 user nova-compute[75165]:       <entry name="serial">bbb1769b-f252-4a6a-9932-a2e962595926</entry>
Oct 26 00:41:43 user nova-compute[75165]:       <entry name="uuid">bbb1769b-f252-4a6a-9932-a2e962595926</entry>
Oct 26 00:41:43 user nova-compute[75165]:       <entry name="family">Virtual Machine</entry>
Oct 26 00:41:43 user nova-compute[75165]:     </system>
Oct 26 00:41:43 user nova-compute[75165]:   </sysinfo>
Oct 26 00:41:43 user nova-compute[75165]:   <os>
Oct 26 00:41:43 user nova-compute[75165]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 00:41:43 user nova-compute[75165]:     <boot dev="hd"/>
Oct 26 00:41:43 user nova-compute[75165]:     <smbios mode="sysinfo"/>
Oct 26 00:41:43 user nova-compute[75165]:   </os>
Oct 26 00:41:43 user nova-compute[75165]:   <features>
Oct 26 00:41:43 user nova-compute[75165]:     <acpi/>
Oct 26 00:41:43 user nova-compute[75165]:     <apic/>
Oct 26 00:41:43 user nova-compute[75165]:     <vmcoreinfo/>
Oct 26 00:41:43 user nova-compute[75165]:   </features>
Oct 26 00:41:43 user nova-compute[75165]:   <clock offset="utc">
Oct 26 00:41:43 user nova-compute[75165]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 00:41:43 user nova-compute[75165]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 00:41:43 user nova-compute[75165]:     <timer name="hpet" present="no"/>
Oct 26 00:41:43 user nova-compute[75165]:   </clock>
Oct 26 00:41:43 user nova-compute[75165]:   <cpu mode="custom" match="exact">
Oct 26 00:41:43 user nova-compute[75165]:     <model>Nehalem</model>
Oct 26 00:41:43 user nova-compute[75165]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 00:41:43 user nova-compute[75165]:   </cpu>
Oct 26 00:41:43 user nova-compute[75165]:   <devices>
Oct 26 00:41:43 user nova-compute[75165]:     <disk type="block" device="disk">
Oct 26 00:41:43 user nova-compute[75165]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 00:41:43 user nova-compute[75165]:       <source dev="/dev/sdc"/>
Oct 26 00:41:43 user nova-compute[75165]:       <target dev="vda" bus="virtio"/>
Oct 26 00:41:43 user nova-compute[75165]:       <serial>b66f7383-3ffd-4715-ad95-2df79f0fb531</serial>
Oct 26 00:41:43 user nova-compute[75165]:     </disk>
Oct 26 00:41:43 user nova-compute[75165]:     <interface type="ethernet">
Oct 26 00:41:43 user nova-compute[75165]:       <mac address="fa:16:3e:8f:4d:97"/>
Oct 26 00:41:43 user nova-compute[75165]:       <model type="virtio"/>
Oct 26 00:41:43 user nova-compute[75165]:       <mtu size="1442"/>
Oct 26 00:41:43 user nova-compute[75165]:       <target dev="tapc45711bb-b4"/>
Oct 26 00:41:43 user nova-compute[75165]:     </interface>
Oct 26 00:41:43 user nova-compute[75165]:     <serial type="pty">
Oct 26 00:41:43 user nova-compute[75165]:       <log file="/opt/stack/data/nova/instances/bbb1769b-f252-4a6a-9932-a2e962595926/console.log" append="off"/>
Oct 26 00:41:43 user nova-compute[75165]:     </serial>
Oct 26 00:41:43 user nova-compute[75165]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 00:41:43 user nova-compute[75165]:     <video>
Oct 26 00:41:43 user nova-compute[75165]:       <model type="virtio"/>
Oct 26 00:41:43 user nova-compute[75165]:     </video>
Oct 26 00:41:43 user nova-compute[75165]:     <rng model="virtio">
Oct 26 00:41:43 user nova-compute[75165]:       <backend model="random">/dev/urandom</backend>
Oct 26 00:41:43 user nova-compute[75165]:     </rng>
Oct 26 00:41:43 user nova-compute[75165]:     <controller type="usb" index="0" model="none"/>
Oct 26 00:41:43 user nova-compute[75165]:     <memballoon model="virtio">
Oct 26 00:41:43 user nova-compute[75165]:       <stats period="10"/>
Oct 26 00:41:43 user nova-compute[75165]:     </memballoon>
Oct 26 00:41:43 user nova-compute[75165]:   </devices>
Oct 26 00:41:43 user nova-compute[75165]: </domain>
Oct 26 00:41:43 user nova-compute[75165]:  {{(pid=75165) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 00:41:43 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-4d3018c1-54ca-4516-910a-d16a44f42685 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:41:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1143304098',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1143304098',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1143304098',id=44,image_ref='1a8e8835-927b-455b-ae15-eb773ff0382b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO9AUAxC0Goi3BlzHMx5yqHNVp2bemo7LModIb3KoBLLSf2AR7Xh+0UGXTqZf0MOmNqHrmKsRbXSX1EVZfBQGHcWEBm7CFrWU0EwrG15GWFIlK2PPneXhtqsFLmDqv/D4g==',key_name='tempest-keypair-297088254',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d1051405ca054c4bb051fb842a5fb5a0',ramdisk_id='',reservation_id='r-i0ahhvvf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1215567595',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1215567595-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1215567595',owner_user_name='tempest-TestVolumeBootPattern-1215567595-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T00:41:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ae836eab78514cf3894e5e11240ff374',uuid=bbb1769b-f252-4a6a-9932-a2e962595926,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c45711bb-b4a3-4471-853d-88ef000a2e63", "address": "fa:16:3e:8f:4d:97", "network": {"id": "dc50ae7b-d501-461f-aa0b-542514330ae8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1091857056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1051405ca054c4bb051fb842a5fb5a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc45711bb-b4", "ovs_interfaceid": "c45711bb-b4a3-4471-853d-88ef000a2e63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 00:41:43 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-4d3018c1-54ca-4516-910a-d16a44f42685 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Converting VIF {"id": "c45711bb-b4a3-4471-853d-88ef000a2e63", "address": "fa:16:3e:8f:4d:97", "network": {"id": "dc50ae7b-d501-461f-aa0b-542514330ae8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1091857056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1051405ca054c4bb051fb842a5fb5a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc45711bb-b4", "ovs_interfaceid": "c45711bb-b4a3-4471-853d-88ef000a2e63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:41:43 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-4d3018c1-54ca-4516-910a-d16a44f42685 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:4d:97,bridge_name='br-int',has_traffic_filtering=True,id=c45711bb-b4a3-4471-853d-88ef000a2e63,network=Network(dc50ae7b-d501-461f-aa0b-542514330ae8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc45711bb-b4') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:41:43 user nova-compute[75165]: DEBUG os_vif [None req-4d3018c1-54ca-4516-910a-d16a44f42685 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:4d:97,bridge_name='br-int',has_traffic_filtering=True,id=c45711bb-b4a3-4471-853d-88ef000a2e63,network=Network(dc50ae7b-d501-461f-aa0b-542514330ae8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc45711bb-b4') {{(pid=75165) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 00:41:43 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:41:43 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:41:43 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 00:41:43 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:41:43 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'baa80a29-5bb0-5ae5-8c61-4ce8ce429b09', '_type': 'linux-noop'}}, row=False) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:41:43 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:41:43 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:41:43 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:41:43 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc45711bb-b4, may_exist=True, interface_attrs={}) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:41:43 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc45711bb-b4, col_values=(('qos', UUID('20691ee5-dbff-4a24-b4f0-0efe6c566497')),), if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:41:43 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc45711bb-b4, col_values=(('external_ids', {'iface-id': 'c45711bb-b4a3-4471-853d-88ef000a2e63', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8f:4d:97', 'vm-uuid': 'bbb1769b-f252-4a6a-9932-a2e962595926'}),), if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:41:43 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:41:43 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:41:43 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:41:43 user nova-compute[75165]: INFO os_vif [None req-4d3018c1-54ca-4516-910a-d16a44f42685 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:4d:97,bridge_name='br-int',has_traffic_filtering=True,id=c45711bb-b4a3-4471-853d-88ef000a2e63,network=Network(dc50ae7b-d501-461f-aa0b-542514330ae8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc45711bb-b4')
Oct 26 00:41:43 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-4d3018c1-54ca-4516-910a-d16a44f42685 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] No BDM found with device name vda, not building metadata. {{(pid=75165) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 00:41:43 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-4d3018c1-54ca-4516-910a-d16a44f42685 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] No VIF found with MAC fa:16:3e:8f:4d:97, not building metadata {{(pid=75165) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 00:41:44 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:41:44 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:41:44 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:41:45 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:41:45 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:41:45 user nova-compute[75165]: DEBUG nova.compute.manager [req-7f01ec03-6b4b-43b7-a6a4-f2d14dc26421 req-53d9d63b-8c1c-4c98-b078-3b4284643d78 service nova] [instance: bbb1769b-f252-4a6a-9932-a2e962595926] Received event network-vif-plugged-c45711bb-b4a3-4471-853d-88ef000a2e63 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:41:45 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-7f01ec03-6b4b-43b7-a6a4-f2d14dc26421 req-53d9d63b-8c1c-4c98-b078-3b4284643d78 service nova] Acquiring lock "bbb1769b-f252-4a6a-9932-a2e962595926-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:41:45 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-7f01ec03-6b4b-43b7-a6a4-f2d14dc26421 req-53d9d63b-8c1c-4c98-b078-3b4284643d78 service nova] Lock "bbb1769b-f252-4a6a-9932-a2e962595926-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:41:45 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-7f01ec03-6b4b-43b7-a6a4-f2d14dc26421 req-53d9d63b-8c1c-4c98-b078-3b4284643d78 service nova] Lock "bbb1769b-f252-4a6a-9932-a2e962595926-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:41:45 user nova-compute[75165]: DEBUG nova.compute.manager [req-7f01ec03-6b4b-43b7-a6a4-f2d14dc26421 req-53d9d63b-8c1c-4c98-b078-3b4284643d78 service nova] [instance: bbb1769b-f252-4a6a-9932-a2e962595926] No waiting events found dispatching network-vif-plugged-c45711bb-b4a3-4471-853d-88ef000a2e63 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:41:45 user nova-compute[75165]: WARNING nova.compute.manager [req-7f01ec03-6b4b-43b7-a6a4-f2d14dc26421 req-53d9d63b-8c1c-4c98-b078-3b4284643d78 service nova] [instance: bbb1769b-f252-4a6a-9932-a2e962595926] Received unexpected event network-vif-plugged-c45711bb-b4a3-4471-853d-88ef000a2e63 for instance with vm_state building and task_state spawning.
Oct 26 00:41:46 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:41:46 user nova-compute[75165]: DEBUG nova.compute.manager [None req-4d3018c1-54ca-4516-910a-d16a44f42685 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: bbb1769b-f252-4a6a-9932-a2e962595926] Instance event wait completed in 0 seconds for  {{(pid=75165) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 00:41:46 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-4d3018c1-54ca-4516-910a-d16a44f42685 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: bbb1769b-f252-4a6a-9932-a2e962595926] Guest created on hypervisor {{(pid=75165) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 00:41:47 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: bbb1769b-f252-4a6a-9932-a2e962595926] Instance spawned successfully.
Oct 26 00:41:47 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-4d3018c1-54ca-4516-910a-d16a44f42685 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: bbb1769b-f252-4a6a-9932-a2e962595926] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 00:41:47 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-4d3018c1-54ca-4516-910a-d16a44f42685 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: bbb1769b-f252-4a6a-9932-a2e962595926] Found default for hw_input_bus of None {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:41:47 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-4d3018c1-54ca-4516-910a-d16a44f42685 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: bbb1769b-f252-4a6a-9932-a2e962595926] Found default for hw_pointer_model of None {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:41:47 user nova-compute[75165]: INFO nova.compute.manager [None req-4d3018c1-54ca-4516-910a-d16a44f42685 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: bbb1769b-f252-4a6a-9932-a2e962595926] Took 4.90 seconds to spawn the instance on the hypervisor.
Oct 26 00:41:47 user nova-compute[75165]: DEBUG nova.compute.manager [None req-4d3018c1-54ca-4516-910a-d16a44f42685 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: bbb1769b-f252-4a6a-9932-a2e962595926] Checking state {{(pid=75165) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 00:41:47 user nova-compute[75165]: INFO nova.compute.manager [None req-4d3018c1-54ca-4516-910a-d16a44f42685 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: bbb1769b-f252-4a6a-9932-a2e962595926] Took 29.48 seconds to build instance.
Oct 26 00:41:47 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-4d3018c1-54ca-4516-910a-d16a44f42685 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Lock "bbb1769b-f252-4a6a-9932-a2e962595926" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 29.577s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:41:47 user nova-compute[75165]: DEBUG nova.compute.manager [req-4e66bc98-5adf-4856-99fa-af9bcdb307d3 req-b64fb5c4-8403-4b50-9bba-df2f5b0fa888 service nova] [instance: bbb1769b-f252-4a6a-9932-a2e962595926] Received event network-vif-plugged-c45711bb-b4a3-4471-853d-88ef000a2e63 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:41:47 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-4e66bc98-5adf-4856-99fa-af9bcdb307d3 req-b64fb5c4-8403-4b50-9bba-df2f5b0fa888 service nova] Acquiring lock "bbb1769b-f252-4a6a-9932-a2e962595926-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:41:47 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-4e66bc98-5adf-4856-99fa-af9bcdb307d3 req-b64fb5c4-8403-4b50-9bba-df2f5b0fa888 service nova] Lock "bbb1769b-f252-4a6a-9932-a2e962595926-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:41:47 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-4e66bc98-5adf-4856-99fa-af9bcdb307d3 req-b64fb5c4-8403-4b50-9bba-df2f5b0fa888 service nova] Lock "bbb1769b-f252-4a6a-9932-a2e962595926-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:41:47 user nova-compute[75165]: DEBUG nova.compute.manager [req-4e66bc98-5adf-4856-99fa-af9bcdb307d3 req-b64fb5c4-8403-4b50-9bba-df2f5b0fa888 service nova] [instance: bbb1769b-f252-4a6a-9932-a2e962595926] No waiting events found dispatching network-vif-plugged-c45711bb-b4a3-4471-853d-88ef000a2e63 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:41:47 user nova-compute[75165]: WARNING nova.compute.manager [req-4e66bc98-5adf-4856-99fa-af9bcdb307d3 req-b64fb5c4-8403-4b50-9bba-df2f5b0fa888 service nova] [instance: bbb1769b-f252-4a6a-9932-a2e962595926] Received unexpected event network-vif-plugged-c45711bb-b4a3-4471-853d-88ef000a2e63 for instance with vm_state active and task_state None.
Oct 26 00:41:48 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:41:51 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:41:53 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:41:56 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:41:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:42:01 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:42:03 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:42:06 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:42:08 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:42:11 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:42:13 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:42:16 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:42:18 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:42:23 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:42:24 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:42:24 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75165) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 00:42:25 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:42:26 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:42:27 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:42:28 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:42:30 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:42:32 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:42:33 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:42:33 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:42:33 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75165) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 00:42:33 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75165) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 00:42:33 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75165) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 00:42:33 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:42:33 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:42:33 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Starting heal instance info cache {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 00:42:33 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "refresh_cache-539bedc3-f788-4d5e-993b-3b168d027a57" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:42:33 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquired lock "refresh_cache-539bedc3-f788-4d5e-993b-3b168d027a57" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:42:33 user nova-compute[75165]: DEBUG nova.network.neutron [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: 539bedc3-f788-4d5e-993b-3b168d027a57] Forcefully refreshing network info cache for instance {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 00:42:34 user nova-compute[75165]: DEBUG nova.network.neutron [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: 539bedc3-f788-4d5e-993b-3b168d027a57] Updating instance_info_cache with network_info: [{"id": "cf882314-eb1e-4555-b87d-4e010947f66f", "address": "fa:16:3e:dc:7e:ca", "network": {"id": "dc50ae7b-d501-461f-aa0b-542514330ae8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1091857056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1051405ca054c4bb051fb842a5fb5a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf882314-eb", "ovs_interfaceid": "cf882314-eb1e-4555-b87d-4e010947f66f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:42:34 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Releasing lock "refresh_cache-539bedc3-f788-4d5e-993b-3b168d027a57" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:42:34 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: 539bedc3-f788-4d5e-993b-3b168d027a57] Updated the network info_cache for instance {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 00:42:34 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:42:34 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:42:34 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:42:34 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:42:34 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:42:34 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75165) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 00:42:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c16604-2066-4cd2-a74e-c47a2dc4c449/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:42:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c16604-2066-4cd2-a74e-c47a2dc4c449/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:42:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c16604-2066-4cd2-a74e-c47a2dc4c449/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:42:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c16604-2066-4cd2-a74e-c47a2dc4c449/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:42:35 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75165) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 00:42:35 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75165) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 00:42:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c62961f-e928-4df6-9c4e-74f035dde9a2/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:42:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c62961f-e928-4df6-9c4e-74f035dde9a2/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:42:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c62961f-e928-4df6-9c4e-74f035dde9a2/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:42:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c62961f-e928-4df6-9c4e-74f035dde9a2/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:42:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae9fe6f-eb17-44f5-89e4-fff5e3451336/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:42:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae9fe6f-eb17-44f5-89e4-fff5e3451336/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:42:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae9fe6f-eb17-44f5-89e4-fff5e3451336/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:42:36 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae9fe6f-eb17-44f5-89e4-fff5e3451336/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:42:36 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:42:36 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:42:36 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Hypervisor/Node resource view: name=user free_ram=8422MB free_disk=24.785236358642578GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75165) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 00:42:36 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:42:36 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:42:36 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 6ae9fe6f-eb17-44f5-89e4-fff5e3451336 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:42:36 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 539bedc3-f788-4d5e-993b-3b168d027a57 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:42:36 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance bbb1769b-f252-4a6a-9932-a2e962595926 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:42:36 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 7c62961f-e928-4df6-9c4e-74f035dde9a2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:42:36 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 50c16604-2066-4cd2-a74e-c47a2dc4c449 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:42:36 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75165) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 00:42:36 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75165) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 00:42:36 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:42:36 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:42:36 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Compute_service record updated for user:user {{(pid=75165) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 00:42:36 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.337s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:42:38 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:42:38 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:42:40 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:42:40 user nova-compute[75165]: DEBUG nova.compute.manager [req-e173699d-c764-4b15-9001-f6066abd3eb8 req-06bb66d2-a9c1-4f65-89f3-558d7b8847ae service nova] [instance: 6ae9fe6f-eb17-44f5-89e4-fff5e3451336] Received event network-changed-5057f477-2080-4285-86a0-8f50541c3361 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:42:40 user nova-compute[75165]: DEBUG nova.compute.manager [req-e173699d-c764-4b15-9001-f6066abd3eb8 req-06bb66d2-a9c1-4f65-89f3-558d7b8847ae service nova] [instance: 6ae9fe6f-eb17-44f5-89e4-fff5e3451336] Refreshing instance network info cache due to event network-changed-5057f477-2080-4285-86a0-8f50541c3361. {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 00:42:40 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-e173699d-c764-4b15-9001-f6066abd3eb8 req-06bb66d2-a9c1-4f65-89f3-558d7b8847ae service nova] Acquiring lock "refresh_cache-6ae9fe6f-eb17-44f5-89e4-fff5e3451336" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:42:40 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-e173699d-c764-4b15-9001-f6066abd3eb8 req-06bb66d2-a9c1-4f65-89f3-558d7b8847ae service nova] Acquired lock "refresh_cache-6ae9fe6f-eb17-44f5-89e4-fff5e3451336" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:42:40 user nova-compute[75165]: DEBUG nova.network.neutron [req-e173699d-c764-4b15-9001-f6066abd3eb8 req-06bb66d2-a9c1-4f65-89f3-558d7b8847ae service nova] [instance: 6ae9fe6f-eb17-44f5-89e4-fff5e3451336] Refreshing network info cache for port 5057f477-2080-4285-86a0-8f50541c3361 {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 00:42:40 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-19f444de-83c9-4ed6-93e6-32f06ed14912 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Acquiring lock "6ae9fe6f-eb17-44f5-89e4-fff5e3451336" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:42:40 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-19f444de-83c9-4ed6-93e6-32f06ed14912 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Lock "6ae9fe6f-eb17-44f5-89e4-fff5e3451336" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:42:40 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-19f444de-83c9-4ed6-93e6-32f06ed14912 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Acquiring lock "6ae9fe6f-eb17-44f5-89e4-fff5e3451336-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:42:40 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-19f444de-83c9-4ed6-93e6-32f06ed14912 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Lock "6ae9fe6f-eb17-44f5-89e4-fff5e3451336-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:42:40 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-19f444de-83c9-4ed6-93e6-32f06ed14912 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Lock "6ae9fe6f-eb17-44f5-89e4-fff5e3451336-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:42:40 user nova-compute[75165]: INFO nova.compute.manager [None req-19f444de-83c9-4ed6-93e6-32f06ed14912 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] [instance: 6ae9fe6f-eb17-44f5-89e4-fff5e3451336] Terminating instance
Oct 26 00:42:40 user nova-compute[75165]: DEBUG nova.compute.manager [None req-19f444de-83c9-4ed6-93e6-32f06ed14912 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] [instance: 6ae9fe6f-eb17-44f5-89e4-fff5e3451336] Start destroying the instance on the hypervisor. {{(pid=75165) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 00:42:40 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:42:40 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:42:40 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:42:40 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:42:41 user nova-compute[75165]: DEBUG nova.network.neutron [req-e173699d-c764-4b15-9001-f6066abd3eb8 req-06bb66d2-a9c1-4f65-89f3-558d7b8847ae service nova] [instance: 6ae9fe6f-eb17-44f5-89e4-fff5e3451336] Updated VIF entry in instance network info cache for port 5057f477-2080-4285-86a0-8f50541c3361. {{(pid=75165) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 00:42:41 user nova-compute[75165]: DEBUG nova.network.neutron [req-e173699d-c764-4b15-9001-f6066abd3eb8 req-06bb66d2-a9c1-4f65-89f3-558d7b8847ae service nova] [instance: 6ae9fe6f-eb17-44f5-89e4-fff5e3451336] Updating instance_info_cache with network_info: [{"id": "5057f477-2080-4285-86a0-8f50541c3361", "address": "fa:16:3e:ca:e5:01", "network": {"id": "03d2b5cd-b214-4767-a406-098bd6857327", "bridge": "br-int", "label": "tempest-TestStampPattern-968415108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e11255eee7bb4b13962634a1cd13d186", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5057f477-20", "ovs_interfaceid": "5057f477-2080-4285-86a0-8f50541c3361", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:42:41 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-e173699d-c764-4b15-9001-f6066abd3eb8 req-06bb66d2-a9c1-4f65-89f3-558d7b8847ae service nova] Releasing lock "refresh_cache-6ae9fe6f-eb17-44f5-89e4-fff5e3451336" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:42:41 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:42:41 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: 6ae9fe6f-eb17-44f5-89e4-fff5e3451336] Instance destroyed successfully.
Oct 26 00:42:41 user nova-compute[75165]: DEBUG nova.objects.instance [None req-19f444de-83c9-4ed6-93e6-32f06ed14912 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Lazy-loading 'resources' on Instance uuid 6ae9fe6f-eb17-44f5-89e4-fff5e3451336 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:42:41 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-19f444de-83c9-4ed6-93e6-32f06ed14912 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:34:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1831353658',display_name='tempest-TestStampPattern-server-1831353658',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1831353658',id=39,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGm2My4nRv1TQMRxx0ZQGbSskYL8JiBedzBd6yh8xGYOqpiWk+KOkgfodgvUeL5VIyIOd6LANvVscgBF9awfoT7/2vctuNc54C96HHUt5A78B63ZjhSiwIVLzywUgmpbdw==',key_name='tempest-TestStampPattern-1939697091',keypairs=<?>,launch_index=0,launched_at=2023-10-26T00:35:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e11255eee7bb4b13962634a1cd13d186',ramdisk_id='',reservation_id='r-imgjeznd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-153617260',owner_user_name='tempest-TestStampPattern-153617260-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T00:38:21Z,user_data=None,user_id='a8b04771d6df477ebd9015c46345afc5',uuid=6ae9fe6f-eb17-44f5-89e4-fff5e3451336,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5057f477-2080-4285-86a0-8f50541c3361", "address": "fa:16:3e:ca:e5:01", "network": {"id": "03d2b5cd-b214-4767-a406-098bd6857327", "bridge": "br-int", "label": "tempest-TestStampPattern-968415108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e11255eee7bb4b13962634a1cd13d186", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5057f477-20", "ovs_interfaceid": "5057f477-2080-4285-86a0-8f50541c3361", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 00:42:41 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-19f444de-83c9-4ed6-93e6-32f06ed14912 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Converting VIF {"id": "5057f477-2080-4285-86a0-8f50541c3361", "address": "fa:16:3e:ca:e5:01", "network": {"id": "03d2b5cd-b214-4767-a406-098bd6857327", "bridge": "br-int", "label": "tempest-TestStampPattern-968415108-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e11255eee7bb4b13962634a1cd13d186", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5057f477-20", "ovs_interfaceid": "5057f477-2080-4285-86a0-8f50541c3361", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:42:41 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-19f444de-83c9-4ed6-93e6-32f06ed14912 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ca:e5:01,bridge_name='br-int',has_traffic_filtering=True,id=5057f477-2080-4285-86a0-8f50541c3361,network=Network(03d2b5cd-b214-4767-a406-098bd6857327),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5057f477-20') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:42:41 user nova-compute[75165]: DEBUG os_vif [None req-19f444de-83c9-4ed6-93e6-32f06ed14912 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ca:e5:01,bridge_name='br-int',has_traffic_filtering=True,id=5057f477-2080-4285-86a0-8f50541c3361,network=Network(03d2b5cd-b214-4767-a406-098bd6857327),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5057f477-20') {{(pid=75165) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 00:42:41 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:42:41 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5057f477-20, bridge=br-int, if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:42:41 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:42:41 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:42:41 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:42:41 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cee3755f-0f73-435f-874b-3683729ce3d5) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:42:41 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:42:41 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:42:41 user nova-compute[75165]: INFO os_vif [None req-19f444de-83c9-4ed6-93e6-32f06ed14912 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ca:e5:01,bridge_name='br-int',has_traffic_filtering=True,id=5057f477-2080-4285-86a0-8f50541c3361,network=Network(03d2b5cd-b214-4767-a406-098bd6857327),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5057f477-20')
Oct 26 00:42:41 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-19f444de-83c9-4ed6-93e6-32f06ed14912 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] [instance: 6ae9fe6f-eb17-44f5-89e4-fff5e3451336] Deleting instance files /opt/stack/data/nova/instances/6ae9fe6f-eb17-44f5-89e4-fff5e3451336_del
Oct 26 00:42:41 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-19f444de-83c9-4ed6-93e6-32f06ed14912 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] [instance: 6ae9fe6f-eb17-44f5-89e4-fff5e3451336] Deletion of /opt/stack/data/nova/instances/6ae9fe6f-eb17-44f5-89e4-fff5e3451336_del complete
Oct 26 00:42:41 user nova-compute[75165]: INFO nova.compute.manager [None req-19f444de-83c9-4ed6-93e6-32f06ed14912 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] [instance: 6ae9fe6f-eb17-44f5-89e4-fff5e3451336] Took 0.86 seconds to destroy the instance on the hypervisor.
Oct 26 00:42:41 user nova-compute[75165]: DEBUG oslo.service.loopingcall [None req-19f444de-83c9-4ed6-93e6-32f06ed14912 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75165) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 00:42:41 user nova-compute[75165]: DEBUG nova.compute.manager [-] [instance: 6ae9fe6f-eb17-44f5-89e4-fff5e3451336] Deallocating network for instance {{(pid=75165) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 00:42:41 user nova-compute[75165]: DEBUG nova.network.neutron [-] [instance: 6ae9fe6f-eb17-44f5-89e4-fff5e3451336] deallocate_for_instance() {{(pid=75165) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 00:42:41 user nova-compute[75165]: DEBUG nova.network.neutron [-] [instance: 6ae9fe6f-eb17-44f5-89e4-fff5e3451336] Updating instance_info_cache with network_info: [] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:42:41 user nova-compute[75165]: INFO nova.compute.manager [-] [instance: 6ae9fe6f-eb17-44f5-89e4-fff5e3451336] Took 0.44 seconds to deallocate network for instance.
Oct 26 00:42:41 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-19f444de-83c9-4ed6-93e6-32f06ed14912 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:42:41 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-19f444de-83c9-4ed6-93e6-32f06ed14912 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:42:41 user nova-compute[75165]: DEBUG nova.compute.manager [req-aafc9265-d83a-4ef9-bf73-1b68b595d124 req-86b38c0c-52b4-4267-802f-f5aa2cd10032 service nova] [instance: 6ae9fe6f-eb17-44f5-89e4-fff5e3451336] Received event network-vif-deleted-5057f477-2080-4285-86a0-8f50541c3361 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:42:42 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-19f444de-83c9-4ed6-93e6-32f06ed14912 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:42:42 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-19f444de-83c9-4ed6-93e6-32f06ed14912 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:42:42 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-19f444de-83c9-4ed6-93e6-32f06ed14912 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.221s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:42:42 user nova-compute[75165]: INFO nova.scheduler.client.report [None req-19f444de-83c9-4ed6-93e6-32f06ed14912 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Deleted allocations for instance 6ae9fe6f-eb17-44f5-89e4-fff5e3451336
Oct 26 00:42:42 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-19f444de-83c9-4ed6-93e6-32f06ed14912 tempest-TestStampPattern-153617260 tempest-TestStampPattern-153617260-project-member] Lock "6ae9fe6f-eb17-44f5-89e4-fff5e3451336" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.699s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:42:42 user nova-compute[75165]: DEBUG nova.compute.manager [req-b180c918-b70b-493b-ad89-e3743c2b163c req-9b489f34-8295-4590-8b71-975ba041e5c8 service nova] [instance: 6ae9fe6f-eb17-44f5-89e4-fff5e3451336] Received event network-vif-unplugged-5057f477-2080-4285-86a0-8f50541c3361 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:42:42 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-b180c918-b70b-493b-ad89-e3743c2b163c req-9b489f34-8295-4590-8b71-975ba041e5c8 service nova] Acquiring lock "6ae9fe6f-eb17-44f5-89e4-fff5e3451336-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:42:42 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-b180c918-b70b-493b-ad89-e3743c2b163c req-9b489f34-8295-4590-8b71-975ba041e5c8 service nova] Lock "6ae9fe6f-eb17-44f5-89e4-fff5e3451336-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:42:42 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-b180c918-b70b-493b-ad89-e3743c2b163c req-9b489f34-8295-4590-8b71-975ba041e5c8 service nova] Lock "6ae9fe6f-eb17-44f5-89e4-fff5e3451336-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:42:42 user nova-compute[75165]: DEBUG nova.compute.manager [req-b180c918-b70b-493b-ad89-e3743c2b163c req-9b489f34-8295-4590-8b71-975ba041e5c8 service nova] [instance: 6ae9fe6f-eb17-44f5-89e4-fff5e3451336] No waiting events found dispatching network-vif-unplugged-5057f477-2080-4285-86a0-8f50541c3361 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:42:42 user nova-compute[75165]: WARNING nova.compute.manager [req-b180c918-b70b-493b-ad89-e3743c2b163c req-9b489f34-8295-4590-8b71-975ba041e5c8 service nova] [instance: 6ae9fe6f-eb17-44f5-89e4-fff5e3451336] Received unexpected event network-vif-unplugged-5057f477-2080-4285-86a0-8f50541c3361 for instance with vm_state deleted and task_state None.
Oct 26 00:42:42 user nova-compute[75165]: DEBUG nova.compute.manager [req-b180c918-b70b-493b-ad89-e3743c2b163c req-9b489f34-8295-4590-8b71-975ba041e5c8 service nova] [instance: 6ae9fe6f-eb17-44f5-89e4-fff5e3451336] Received event network-vif-plugged-5057f477-2080-4285-86a0-8f50541c3361 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:42:42 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-b180c918-b70b-493b-ad89-e3743c2b163c req-9b489f34-8295-4590-8b71-975ba041e5c8 service nova] Acquiring lock "6ae9fe6f-eb17-44f5-89e4-fff5e3451336-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:42:42 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-b180c918-b70b-493b-ad89-e3743c2b163c req-9b489f34-8295-4590-8b71-975ba041e5c8 service nova] Lock "6ae9fe6f-eb17-44f5-89e4-fff5e3451336-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:42:42 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-b180c918-b70b-493b-ad89-e3743c2b163c req-9b489f34-8295-4590-8b71-975ba041e5c8 service nova] Lock "6ae9fe6f-eb17-44f5-89e4-fff5e3451336-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:42:42 user nova-compute[75165]: DEBUG nova.compute.manager [req-b180c918-b70b-493b-ad89-e3743c2b163c req-9b489f34-8295-4590-8b71-975ba041e5c8 service nova] [instance: 6ae9fe6f-eb17-44f5-89e4-fff5e3451336] No waiting events found dispatching network-vif-plugged-5057f477-2080-4285-86a0-8f50541c3361 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:42:42 user nova-compute[75165]: WARNING nova.compute.manager [req-b180c918-b70b-493b-ad89-e3743c2b163c req-9b489f34-8295-4590-8b71-975ba041e5c8 service nova] [instance: 6ae9fe6f-eb17-44f5-89e4-fff5e3451336] Received unexpected event network-vif-plugged-5057f477-2080-4285-86a0-8f50541c3361 for instance with vm_state deleted and task_state None.
Oct 26 00:42:46 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:42:51 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:42:54 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:42:54 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:42:54 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.002s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:42:54 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:42:54 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:42:54 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:42:54 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:42:54 user nova-compute[75165]: DEBUG nova.virt.libvirt.imagecache [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Verify base images {{(pid=75165) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Oct 26 00:42:54 user nova-compute[75165]: DEBUG nova.virt.libvirt.imagecache [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Image id bff0d8a1-739e-4c4d-9efa-b73ba7b76d01 yields fingerprint 7d3243421cf3fdc288b758f687a93103b7b95466 {{(pid=75165) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Oct 26 00:42:54 user nova-compute[75165]: INFO nova.virt.libvirt.imagecache [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] image bff0d8a1-739e-4c4d-9efa-b73ba7b76d01 at (/opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466): checking
Oct 26 00:42:54 user nova-compute[75165]: DEBUG nova.virt.libvirt.imagecache [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] image bff0d8a1-739e-4c4d-9efa-b73ba7b76d01 at (/opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466): image is in use {{(pid=75165) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Oct 26 00:42:54 user nova-compute[75165]: DEBUG nova.virt.libvirt.imagecache [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=75165) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Oct 26 00:42:54 user nova-compute[75165]: DEBUG nova.virt.libvirt.imagecache [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Image id 1a8e8835-927b-455b-ae15-eb773ff0382b yields fingerprint 3106d5d7ea9f1cee5669e95501bb2fecb261048a {{(pid=75165) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Oct 26 00:42:54 user nova-compute[75165]: DEBUG nova.virt.libvirt.imagecache [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] 539bedc3-f788-4d5e-993b-3b168d027a57 is a valid instance name {{(pid=75165) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Oct 26 00:42:54 user nova-compute[75165]: DEBUG nova.virt.libvirt.imagecache [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] 50c16604-2066-4cd2-a74e-c47a2dc4c449 is a valid instance name {{(pid=75165) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Oct 26 00:42:54 user nova-compute[75165]: DEBUG nova.virt.libvirt.imagecache [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] 50c16604-2066-4cd2-a74e-c47a2dc4c449 has a disk file {{(pid=75165) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Oct 26 00:42:54 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c16604-2066-4cd2-a74e-c47a2dc4c449/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:42:55 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c16604-2066-4cd2-a74e-c47a2dc4c449/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:42:55 user nova-compute[75165]: DEBUG nova.virt.libvirt.imagecache [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 50c16604-2066-4cd2-a74e-c47a2dc4c449 is backed by 7d3243421cf3fdc288b758f687a93103b7b95466 {{(pid=75165) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Oct 26 00:42:55 user nova-compute[75165]: DEBUG nova.virt.libvirt.imagecache [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] bbb1769b-f252-4a6a-9932-a2e962595926 is a valid instance name {{(pid=75165) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Oct 26 00:42:55 user nova-compute[75165]: DEBUG nova.virt.libvirt.imagecache [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] 7c62961f-e928-4df6-9c4e-74f035dde9a2 is a valid instance name {{(pid=75165) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Oct 26 00:42:55 user nova-compute[75165]: DEBUG nova.virt.libvirt.imagecache [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] 7c62961f-e928-4df6-9c4e-74f035dde9a2 has a disk file {{(pid=75165) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Oct 26 00:42:55 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c62961f-e928-4df6-9c4e-74f035dde9a2/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:42:55 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c62961f-e928-4df6-9c4e-74f035dde9a2/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:42:55 user nova-compute[75165]: DEBUG nova.virt.libvirt.imagecache [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 7c62961f-e928-4df6-9c4e-74f035dde9a2 is backed by 7d3243421cf3fdc288b758f687a93103b7b95466 {{(pid=75165) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Oct 26 00:42:55 user nova-compute[75165]: WARNING nova.virt.libvirt.imagecache [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Unknown base file: /opt/stack/data/nova/instances/_base/1d7965afce21bb22e0162b1282b87b9bf8110a53
Oct 26 00:42:55 user nova-compute[75165]: WARNING nova.virt.libvirt.imagecache [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Unknown base file: /opt/stack/data/nova/instances/_base/eb607d80b14fae12f267e90d6f5b92333c26409a
Oct 26 00:42:55 user nova-compute[75165]: WARNING nova.virt.libvirt.imagecache [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Unknown base file: /opt/stack/data/nova/instances/_base/db750091b70be3644b7e0b1b5770496167ab54cf
Oct 26 00:42:55 user nova-compute[75165]: WARNING nova.virt.libvirt.imagecache [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Unknown base file: /opt/stack/data/nova/instances/_base/49357207bed21777afe2b2880087c861e2355c6b
Oct 26 00:42:55 user nova-compute[75165]: WARNING nova.virt.libvirt.imagecache [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Unknown base file: /opt/stack/data/nova/instances/_base/b577127b41c299d5026ed11175cf70dd549a1f0a
Oct 26 00:42:55 user nova-compute[75165]: WARNING nova.virt.libvirt.imagecache [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Unknown base file: /opt/stack/data/nova/instances/_base/4586e48e46c231dfc61967b578547c063a70cb37
Oct 26 00:42:55 user nova-compute[75165]: WARNING nova.virt.libvirt.imagecache [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Unknown base file: /opt/stack/data/nova/instances/_base/ad66dd72abfd2d2e13a59983bf78e8afd78d0676
Oct 26 00:42:55 user nova-compute[75165]: INFO nova.virt.libvirt.imagecache [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Active base files: /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466
Oct 26 00:42:55 user nova-compute[75165]: INFO nova.virt.libvirt.imagecache [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Removable base files: /opt/stack/data/nova/instances/_base/1d7965afce21bb22e0162b1282b87b9bf8110a53 /opt/stack/data/nova/instances/_base/eb607d80b14fae12f267e90d6f5b92333c26409a /opt/stack/data/nova/instances/_base/db750091b70be3644b7e0b1b5770496167ab54cf /opt/stack/data/nova/instances/_base/49357207bed21777afe2b2880087c861e2355c6b /opt/stack/data/nova/instances/_base/b577127b41c299d5026ed11175cf70dd549a1f0a /opt/stack/data/nova/instances/_base/4586e48e46c231dfc61967b578547c063a70cb37 /opt/stack/data/nova/instances/_base/ad66dd72abfd2d2e13a59983bf78e8afd78d0676
Oct 26 00:42:55 user nova-compute[75165]: INFO nova.virt.libvirt.imagecache [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/1d7965afce21bb22e0162b1282b87b9bf8110a53
Oct 26 00:42:55 user nova-compute[75165]: INFO nova.virt.libvirt.imagecache [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/eb607d80b14fae12f267e90d6f5b92333c26409a
Oct 26 00:42:55 user nova-compute[75165]: INFO nova.virt.libvirt.imagecache [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/db750091b70be3644b7e0b1b5770496167ab54cf
Oct 26 00:42:55 user nova-compute[75165]: INFO nova.virt.libvirt.imagecache [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/49357207bed21777afe2b2880087c861e2355c6b
Oct 26 00:42:55 user nova-compute[75165]: INFO nova.virt.libvirt.imagecache [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/b577127b41c299d5026ed11175cf70dd549a1f0a
Oct 26 00:42:55 user nova-compute[75165]: INFO nova.virt.libvirt.imagecache [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/4586e48e46c231dfc61967b578547c063a70cb37
Oct 26 00:42:55 user nova-compute[75165]: INFO nova.virt.libvirt.imagecache [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/ad66dd72abfd2d2e13a59983bf78e8afd78d0676
Oct 26 00:42:55 user nova-compute[75165]: DEBUG nova.virt.libvirt.imagecache [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Verification complete {{(pid=75165) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Oct 26 00:42:55 user nova-compute[75165]: DEBUG nova.virt.libvirt.imagecache [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Verify swap images {{(pid=75165) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Oct 26 00:42:55 user nova-compute[75165]: DEBUG nova.virt.libvirt.imagecache [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Verify ephemeral images {{(pid=75165) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Oct 26 00:42:56 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:43:01 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:43:06 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:43:08 user nova-compute[75165]: DEBUG nova.compute.manager [req-85f1bbc7-e2c3-439d-bc76-12763558dd0d req-70c667a0-e5df-4733-bc2e-d634f1576bdd service nova] [instance: bbb1769b-f252-4a6a-9932-a2e962595926] Received event network-changed-c45711bb-b4a3-4471-853d-88ef000a2e63 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:43:08 user nova-compute[75165]: DEBUG nova.compute.manager [req-85f1bbc7-e2c3-439d-bc76-12763558dd0d req-70c667a0-e5df-4733-bc2e-d634f1576bdd service nova] [instance: bbb1769b-f252-4a6a-9932-a2e962595926] Refreshing instance network info cache due to event network-changed-c45711bb-b4a3-4471-853d-88ef000a2e63. {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 00:43:08 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-85f1bbc7-e2c3-439d-bc76-12763558dd0d req-70c667a0-e5df-4733-bc2e-d634f1576bdd service nova] Acquiring lock "refresh_cache-bbb1769b-f252-4a6a-9932-a2e962595926" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:43:08 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-85f1bbc7-e2c3-439d-bc76-12763558dd0d req-70c667a0-e5df-4733-bc2e-d634f1576bdd service nova] Acquired lock "refresh_cache-bbb1769b-f252-4a6a-9932-a2e962595926" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:43:08 user nova-compute[75165]: DEBUG nova.network.neutron [req-85f1bbc7-e2c3-439d-bc76-12763558dd0d req-70c667a0-e5df-4733-bc2e-d634f1576bdd service nova] [instance: bbb1769b-f252-4a6a-9932-a2e962595926] Refreshing network info cache for port c45711bb-b4a3-4471-853d-88ef000a2e63 {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 00:43:08 user nova-compute[75165]: DEBUG nova.network.neutron [req-85f1bbc7-e2c3-439d-bc76-12763558dd0d req-70c667a0-e5df-4733-bc2e-d634f1576bdd service nova] [instance: bbb1769b-f252-4a6a-9932-a2e962595926] Updated VIF entry in instance network info cache for port c45711bb-b4a3-4471-853d-88ef000a2e63. {{(pid=75165) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 00:43:08 user nova-compute[75165]: DEBUG nova.network.neutron [req-85f1bbc7-e2c3-439d-bc76-12763558dd0d req-70c667a0-e5df-4733-bc2e-d634f1576bdd service nova] [instance: bbb1769b-f252-4a6a-9932-a2e962595926] Updating instance_info_cache with network_info: [{"id": "c45711bb-b4a3-4471-853d-88ef000a2e63", "address": "fa:16:3e:8f:4d:97", "network": {"id": "dc50ae7b-d501-461f-aa0b-542514330ae8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1091857056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1051405ca054c4bb051fb842a5fb5a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc45711bb-b4", "ovs_interfaceid": "c45711bb-b4a3-4471-853d-88ef000a2e63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:43:08 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-85f1bbc7-e2c3-439d-bc76-12763558dd0d req-70c667a0-e5df-4733-bc2e-d634f1576bdd service nova] Releasing lock "refresh_cache-bbb1769b-f252-4a6a-9932-a2e962595926" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:43:09 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-a6548ea8-b944-4557-8827-881965db7a72 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Acquiring lock "bbb1769b-f252-4a6a-9932-a2e962595926" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:43:09 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-a6548ea8-b944-4557-8827-881965db7a72 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Lock "bbb1769b-f252-4a6a-9932-a2e962595926" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:43:09 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-a6548ea8-b944-4557-8827-881965db7a72 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Acquiring lock "bbb1769b-f252-4a6a-9932-a2e962595926-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:43:09 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-a6548ea8-b944-4557-8827-881965db7a72 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Lock "bbb1769b-f252-4a6a-9932-a2e962595926-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:43:09 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-a6548ea8-b944-4557-8827-881965db7a72 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Lock "bbb1769b-f252-4a6a-9932-a2e962595926-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:43:09 user nova-compute[75165]: INFO nova.compute.manager [None req-a6548ea8-b944-4557-8827-881965db7a72 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: bbb1769b-f252-4a6a-9932-a2e962595926] Terminating instance
Oct 26 00:43:09 user nova-compute[75165]: DEBUG nova.compute.manager [None req-a6548ea8-b944-4557-8827-881965db7a72 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: bbb1769b-f252-4a6a-9932-a2e962595926] Start destroying the instance on the hypervisor. {{(pid=75165) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 00:43:09 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:43:09 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:43:09 user nova-compute[75165]: DEBUG nova.compute.manager [req-943ef053-5ba4-4b06-8c75-ad10d4969d19 req-27f213e7-739b-4ba3-8af0-5806046ca87a service nova] [instance: bbb1769b-f252-4a6a-9932-a2e962595926] Received event network-vif-unplugged-c45711bb-b4a3-4471-853d-88ef000a2e63 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:43:09 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-943ef053-5ba4-4b06-8c75-ad10d4969d19 req-27f213e7-739b-4ba3-8af0-5806046ca87a service nova] Acquiring lock "bbb1769b-f252-4a6a-9932-a2e962595926-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:43:09 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-943ef053-5ba4-4b06-8c75-ad10d4969d19 req-27f213e7-739b-4ba3-8af0-5806046ca87a service nova] Lock "bbb1769b-f252-4a6a-9932-a2e962595926-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:43:09 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-943ef053-5ba4-4b06-8c75-ad10d4969d19 req-27f213e7-739b-4ba3-8af0-5806046ca87a service nova] Lock "bbb1769b-f252-4a6a-9932-a2e962595926-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:43:09 user nova-compute[75165]: DEBUG nova.compute.manager [req-943ef053-5ba4-4b06-8c75-ad10d4969d19 req-27f213e7-739b-4ba3-8af0-5806046ca87a service nova] [instance: bbb1769b-f252-4a6a-9932-a2e962595926] No waiting events found dispatching network-vif-unplugged-c45711bb-b4a3-4471-853d-88ef000a2e63 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:43:09 user nova-compute[75165]: DEBUG nova.compute.manager [req-943ef053-5ba4-4b06-8c75-ad10d4969d19 req-27f213e7-739b-4ba3-8af0-5806046ca87a service nova] [instance: bbb1769b-f252-4a6a-9932-a2e962595926] Received event network-vif-unplugged-c45711bb-b4a3-4471-853d-88ef000a2e63 for instance with task_state deleting. {{(pid=75165) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 00:43:09 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:43:09 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:43:09 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: bbb1769b-f252-4a6a-9932-a2e962595926] Instance destroyed successfully.
Oct 26 00:43:09 user nova-compute[75165]: DEBUG nova.objects.instance [None req-a6548ea8-b944-4557-8827-881965db7a72 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Lazy-loading 'resources' on Instance uuid bbb1769b-f252-4a6a-9932-a2e962595926 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:43:09 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-a6548ea8-b944-4557-8827-881965db7a72 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:41:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1143304098',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1143304098',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1143304098',id=44,image_ref='1a8e8835-927b-455b-ae15-eb773ff0382b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO9AUAxC0Goi3BlzHMx5yqHNVp2bemo7LModIb3KoBLLSf2AR7Xh+0UGXTqZf0MOmNqHrmKsRbXSX1EVZfBQGHcWEBm7CFrWU0EwrG15GWFIlK2PPneXhtqsFLmDqv/D4g==',key_name='tempest-keypair-297088254',keypairs=<?>,launch_index=0,launched_at=2023-10-26T00:41:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d1051405ca054c4bb051fb842a5fb5a0',ramdisk_id='',reservation_id='r-i0ahhvvf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1215567595',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1215567595-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-1215567595',owner_user_name='tempest-TestVolumeBootPattern-1215567595-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T00:41:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ae836eab78514cf3894e5e11240ff374',uuid=bbb1769b-f252-4a6a-9932-a2e962595926,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c45711bb-b4a3-4471-853d-88ef000a2e63", "address": "fa:16:3e:8f:4d:97", "network": {"id": "dc50ae7b-d501-461f-aa0b-542514330ae8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1091857056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1051405ca054c4bb051fb842a5fb5a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc45711bb-b4", "ovs_interfaceid": "c45711bb-b4a3-4471-853d-88ef000a2e63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 00:43:09 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-a6548ea8-b944-4557-8827-881965db7a72 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Converting VIF {"id": "c45711bb-b4a3-4471-853d-88ef000a2e63", "address": "fa:16:3e:8f:4d:97", "network": {"id": "dc50ae7b-d501-461f-aa0b-542514330ae8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1091857056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1051405ca054c4bb051fb842a5fb5a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc45711bb-b4", "ovs_interfaceid": "c45711bb-b4a3-4471-853d-88ef000a2e63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:43:09 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-a6548ea8-b944-4557-8827-881965db7a72 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8f:4d:97,bridge_name='br-int',has_traffic_filtering=True,id=c45711bb-b4a3-4471-853d-88ef000a2e63,network=Network(dc50ae7b-d501-461f-aa0b-542514330ae8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc45711bb-b4') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:43:09 user nova-compute[75165]: DEBUG os_vif [None req-a6548ea8-b944-4557-8827-881965db7a72 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:4d:97,bridge_name='br-int',has_traffic_filtering=True,id=c45711bb-b4a3-4471-853d-88ef000a2e63,network=Network(dc50ae7b-d501-461f-aa0b-542514330ae8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc45711bb-b4') {{(pid=75165) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 00:43:09 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:43:09 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc45711bb-b4, bridge=br-int, if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:43:09 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:43:09 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:43:09 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:43:09 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=20691ee5-dbff-4a24-b4f0-0efe6c566497) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:43:09 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:43:09 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:43:09 user nova-compute[75165]: INFO os_vif [None req-a6548ea8-b944-4557-8827-881965db7a72 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:4d:97,bridge_name='br-int',has_traffic_filtering=True,id=c45711bb-b4a3-4471-853d-88ef000a2e63,network=Network(dc50ae7b-d501-461f-aa0b-542514330ae8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc45711bb-b4')
Oct 26 00:43:09 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a6548ea8-b944-4557-8827-881965db7a72 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: bbb1769b-f252-4a6a-9932-a2e962595926] calling os-brick to detach iSCSI Volume {{(pid=75165) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 00:43:09 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6548ea8-b944-4557-8827-881965db7a72 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8bf8160e50>, {'target_iqn': 'iqn.2010-10.org.openstack:b66f7383-3ffd-4715-ad95-2df79f0fb531', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uJpjTsir', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:43:09 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-a6548ea8-b944-4557-8827-881965db7a72 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:43:09 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-a6548ea8-b944-4557-8827-881965db7a72 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:43:09 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-a6548ea8-b944-4557-8827-881965db7a72 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:43:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:43:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:43:09 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[abc51f37-0806-473e-8985-b2e86e5751c9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:67c880f5-c46a-4e45-b73a-a052fca3638c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b66f7383-3ffd-4715-ad95-2df79f0fb531\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:43:09 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6548ea8-b944-4557-8827-881965db7a72 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 00:43:09 user nova-compute[75165]: No targets found.
Oct 26 00:43:09 user nova-compute[75165]: iSNS:
Oct 26 00:43:09 user nova-compute[75165]: No targets found.
Oct 26 00:43:09 user nova-compute[75165]: STATIC:
Oct 26 00:43:09 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:67c880f5-c46a-4e45-b73a-a052fca3638c
Oct 26 00:43:09 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:43:09 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:43:09 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:b66f7383-3ffd-4715-ad95-2df79f0fb531
Oct 26 00:43:09 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:43:09 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:43:09 user nova-compute[75165]: FIRMWARE:
Oct 26 00:43:09 user nova-compute[75165]: No targets found.
Oct 26 00:43:09 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:43:09 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6548ea8-b944-4557-8827-881965db7a72 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 00:43:09 user nova-compute[75165]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 00:43:09 user nova-compute[75165]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75165) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 00:43:09 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6548ea8-b944-4557-8827-881965db7a72 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b66f7383-3ffd-4715-ad95-2df79f0fb531', 0)] {{(pid=75165) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 00:43:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:43:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:43:09 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[30ddc06c-b758-49eb-935b-274e9958d0f7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:67c880f5-c46a-4e45-b73a-a052fca3638c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b66f7383-3ffd-4715-ad95-2df79f0fb531\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:43:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:43:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:43:09 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[f68d8a7b-ea11-4877-b669-2ba2fbd5cc8d]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67c880f5-c46a-4e45-b73a-a052fca3638c (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b66f7383-3ffd-4715-ad95-2df79f0fb531 (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:43:09 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6548ea8-b944-4557-8827-881965db7a72 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67c880f5-c46a-4e45-b73a-a052fca3638c (non-flash)
Oct 26 00:43:09 user nova-compute[75165]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b66f7383-3ffd-4715-ad95-2df79f0fb531 (non-flash)
Oct 26 00:43:09 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:43:09 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6548ea8-b944-4557-8827-881965db7a72 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67c880f5-c46a-4e45-b73a-a052fca3638c (non-flash)
Oct 26 00:43:09 user nova-compute[75165]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b66f7383-3ffd-4715-ad95-2df79f0fb531 (non-flash)
Oct 26 00:43:09 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:43:09 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6548ea8-b944-4557-8827-881965db7a72 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8be04f2200>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b66f7383-3ffd-4715-ad95-2df79f0fb531'): ({'sdc'}, set())}) {{(pid=75165) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 00:43:09 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-a6548ea8-b944-4557-8827-881965db7a72 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Removing single pathed devices sdc {{(pid=75165) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 00:43:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:43:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:43:09 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[45eb936b-a359-4e7c-a081-251b15ce4649]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:43:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:43:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:43:09 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[40807f18-8190-41eb-a64d-162c5d7bde53]: (4, ('ok\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:43:09 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-a6548ea8-b944-4557-8827-881965db7a72 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Flushing IO for device /dev/sdc {{(pid=75165) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 00:43:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:43:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:43:09 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[91663557-4d9a-406e-b611-3a7033b10a9d]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:43:09 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-a6548ea8-b944-4557-8827-881965db7a72 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75165) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 00:43:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:43:10 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.037s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:43:10 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[e13f9cad-e469-4a73-b627-69081973f602]: (4, ('1', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:43:10 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-a6548ea8-b944-4557-8827-881965db7a72 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75165) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 00:43:10 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-a6548ea8-b944-4557-8827-881965db7a72 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] SCSI volumes sdc have been removed. {{(pid=75165) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 00:43:10 user nova-compute[75165]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_dbdbf352', '/dev/disk/by-id/scsi-1SCST_BIOdbdbf352-1ec212110786e615', '/dev/disk/by-id/scsi-23165633231323131') {{(pid=86976) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 26 00:43:10 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[abba506c-cc77-4893-a763-8dce4087245f]: (4, None) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:43:10 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6548ea8-b944-4557-8827-881965db7a72 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b66f7383-3ffd-4715-ad95-2df79f0fb531')] {{(pid=75165) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 00:43:10 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b66f7383-3ffd-4715-ad95-2df79f0fb531 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:43:10 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b66f7383-3ffd-4715-ad95-2df79f0fb531 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:43:10 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[b97c64b2-4e9e-445a-a2b9-2a5f19bff4b7]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:43:10 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6548ea8-b944-4557-8827-881965db7a72 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:43:10 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b66f7383-3ffd-4715-ad95-2df79f0fb531 -p 172.16.0.220:3260 --logout {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:43:10 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b66f7383-3ffd-4715-ad95-2df79f0fb531 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:43:10 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fec9ae6-2d84-4c52-8994-b72ca87d1613]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:b66f7383-3ffd-4715-ad95-2df79f0fb531, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:b66f7383-3ffd-4715-ad95-2df79f0fb531, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:43:10 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6548ea8-b944-4557-8827-881965db7a72 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:b66f7383-3ffd-4715-ad95-2df79f0fb531, portal: 172.16.0.220,3260]
Oct 26 00:43:10 user nova-compute[75165]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:b66f7383-3ffd-4715-ad95-2df79f0fb531, portal: 172.16.0.220,3260] successful.
Oct 26 00:43:10 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:43:10 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b66f7383-3ffd-4715-ad95-2df79f0fb531 -p 172.16.0.220:3260 --op delete {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:43:10 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b66f7383-3ffd-4715-ad95-2df79f0fb531 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:43:10 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[6078ae30-7274-415b-93e5-939f14f37130]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:43:10 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6548ea8-b944-4557-8827-881965db7a72 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:43:10 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-a6548ea8-b944-4557-8827-881965db7a72 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:43:10 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6548ea8-b944-4557-8827-881965db7a72 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] <== disconnect_volume: return (307ms) None {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:43:10 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a6548ea8-b944-4557-8827-881965db7a72 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: bbb1769b-f252-4a6a-9932-a2e962595926] Disconnected iSCSI Volume {{(pid=75165) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 00:43:10 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-a6548ea8-b944-4557-8827-881965db7a72 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: bbb1769b-f252-4a6a-9932-a2e962595926] Deleting instance files /opt/stack/data/nova/instances/bbb1769b-f252-4a6a-9932-a2e962595926_del
Oct 26 00:43:10 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-a6548ea8-b944-4557-8827-881965db7a72 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: bbb1769b-f252-4a6a-9932-a2e962595926] Deletion of /opt/stack/data/nova/instances/bbb1769b-f252-4a6a-9932-a2e962595926_del complete
Oct 26 00:43:10 user nova-compute[75165]: INFO nova.compute.manager [None req-a6548ea8-b944-4557-8827-881965db7a72 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: bbb1769b-f252-4a6a-9932-a2e962595926] Took 1.16 seconds to destroy the instance on the hypervisor.
Oct 26 00:43:10 user nova-compute[75165]: DEBUG oslo.service.loopingcall [None req-a6548ea8-b944-4557-8827-881965db7a72 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75165) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 00:43:10 user nova-compute[75165]: DEBUG nova.compute.manager [-] [instance: bbb1769b-f252-4a6a-9932-a2e962595926] Deallocating network for instance {{(pid=75165) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 00:43:10 user nova-compute[75165]: DEBUG nova.network.neutron [-] [instance: bbb1769b-f252-4a6a-9932-a2e962595926] deallocate_for_instance() {{(pid=75165) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 00:43:11 user nova-compute[75165]: DEBUG nova.compute.manager [req-ce45d645-236e-4c90-99ed-12b5974c9614 req-b179b466-3cdb-4cdd-ac27-c2c60bbb64f5 service nova] [instance: bbb1769b-f252-4a6a-9932-a2e962595926] Received event network-vif-deleted-c45711bb-b4a3-4471-853d-88ef000a2e63 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:43:11 user nova-compute[75165]: INFO nova.compute.manager [req-ce45d645-236e-4c90-99ed-12b5974c9614 req-b179b466-3cdb-4cdd-ac27-c2c60bbb64f5 service nova] [instance: bbb1769b-f252-4a6a-9932-a2e962595926] Neutron deleted interface c45711bb-b4a3-4471-853d-88ef000a2e63; detaching it from the instance and deleting it from the info cache
Oct 26 00:43:11 user nova-compute[75165]: DEBUG nova.network.neutron [req-ce45d645-236e-4c90-99ed-12b5974c9614 req-b179b466-3cdb-4cdd-ac27-c2c60bbb64f5 service nova] [instance: bbb1769b-f252-4a6a-9932-a2e962595926] Updating instance_info_cache with network_info: [] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:43:11 user nova-compute[75165]: DEBUG nova.network.neutron [-] [instance: bbb1769b-f252-4a6a-9932-a2e962595926] Updating instance_info_cache with network_info: [] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:43:11 user nova-compute[75165]: INFO nova.compute.manager [-] [instance: bbb1769b-f252-4a6a-9932-a2e962595926] Took 1.00 seconds to deallocate network for instance.
Oct 26 00:43:11 user nova-compute[75165]: DEBUG nova.compute.manager [req-ce45d645-236e-4c90-99ed-12b5974c9614 req-b179b466-3cdb-4cdd-ac27-c2c60bbb64f5 service nova] [instance: bbb1769b-f252-4a6a-9932-a2e962595926] Detach interface failed, port_id=c45711bb-b4a3-4471-853d-88ef000a2e63, reason: Instance bbb1769b-f252-4a6a-9932-a2e962595926 could not be found. {{(pid=75165) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 26 00:43:11 user nova-compute[75165]: DEBUG nova.compute.manager [req-96965ec7-9a72-45a3-ba4a-0bd4959a72cb req-6ff33a82-15ea-4dbc-8be9-7f05b98d665b service nova] [instance: bbb1769b-f252-4a6a-9932-a2e962595926] Received event network-vif-plugged-c45711bb-b4a3-4471-853d-88ef000a2e63 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:43:11 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-96965ec7-9a72-45a3-ba4a-0bd4959a72cb req-6ff33a82-15ea-4dbc-8be9-7f05b98d665b service nova] Acquiring lock "bbb1769b-f252-4a6a-9932-a2e962595926-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:43:11 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-96965ec7-9a72-45a3-ba4a-0bd4959a72cb req-6ff33a82-15ea-4dbc-8be9-7f05b98d665b service nova] Lock "bbb1769b-f252-4a6a-9932-a2e962595926-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:43:11 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-96965ec7-9a72-45a3-ba4a-0bd4959a72cb req-6ff33a82-15ea-4dbc-8be9-7f05b98d665b service nova] Lock "bbb1769b-f252-4a6a-9932-a2e962595926-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:43:11 user nova-compute[75165]: DEBUG nova.compute.manager [req-96965ec7-9a72-45a3-ba4a-0bd4959a72cb req-6ff33a82-15ea-4dbc-8be9-7f05b98d665b service nova] [instance: bbb1769b-f252-4a6a-9932-a2e962595926] No waiting events found dispatching network-vif-plugged-c45711bb-b4a3-4471-853d-88ef000a2e63 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:43:11 user nova-compute[75165]: WARNING nova.compute.manager [req-96965ec7-9a72-45a3-ba4a-0bd4959a72cb req-6ff33a82-15ea-4dbc-8be9-7f05b98d665b service nova] [instance: bbb1769b-f252-4a6a-9932-a2e962595926] Received unexpected event network-vif-plugged-c45711bb-b4a3-4471-853d-88ef000a2e63 for instance with vm_state active and task_state deleting.
Oct 26 00:43:12 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:43:12 user nova-compute[75165]: INFO nova.compute.manager [None req-a6548ea8-b944-4557-8827-881965db7a72 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: bbb1769b-f252-4a6a-9932-a2e962595926] Took 0.85 seconds to detach 1 volumes for instance.
Oct 26 00:43:12 user nova-compute[75165]: DEBUG nova.compute.manager [None req-a6548ea8-b944-4557-8827-881965db7a72 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: bbb1769b-f252-4a6a-9932-a2e962595926] Deleting volume: b66f7383-3ffd-4715-ad95-2df79f0fb531 {{(pid=75165) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 26 00:43:12 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-a6548ea8-b944-4557-8827-881965db7a72 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:43:12 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-a6548ea8-b944-4557-8827-881965db7a72 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:43:12 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-a6548ea8-b944-4557-8827-881965db7a72 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:43:12 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-a6548ea8-b944-4557-8827-881965db7a72 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:43:12 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-a6548ea8-b944-4557-8827-881965db7a72 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.189s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:43:12 user nova-compute[75165]: INFO nova.scheduler.client.report [None req-a6548ea8-b944-4557-8827-881965db7a72 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Deleted allocations for instance bbb1769b-f252-4a6a-9932-a2e962595926
Oct 26 00:43:12 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-a6548ea8-b944-4557-8827-881965db7a72 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Lock "bbb1769b-f252-4a6a-9932-a2e962595926" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.492s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:43:14 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:43:17 user nova-compute[75165]: DEBUG nova.compute.manager [req-93b67fd0-0be4-4270-b721-a368f8f22417 req-0917a853-0b77-4650-8a5c-35eaf96c6949 service nova] [instance: 7c62961f-e928-4df6-9c4e-74f035dde9a2] Received event network-changed-336cfc3b-0045-4c7f-bd85-ce9b9080ff58 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:43:17 user nova-compute[75165]: DEBUG nova.compute.manager [req-93b67fd0-0be4-4270-b721-a368f8f22417 req-0917a853-0b77-4650-8a5c-35eaf96c6949 service nova] [instance: 7c62961f-e928-4df6-9c4e-74f035dde9a2] Refreshing instance network info cache due to event network-changed-336cfc3b-0045-4c7f-bd85-ce9b9080ff58. {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 00:43:17 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-93b67fd0-0be4-4270-b721-a368f8f22417 req-0917a853-0b77-4650-8a5c-35eaf96c6949 service nova] Acquiring lock "refresh_cache-7c62961f-e928-4df6-9c4e-74f035dde9a2" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:43:17 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-93b67fd0-0be4-4270-b721-a368f8f22417 req-0917a853-0b77-4650-8a5c-35eaf96c6949 service nova] Acquired lock "refresh_cache-7c62961f-e928-4df6-9c4e-74f035dde9a2" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:43:17 user nova-compute[75165]: DEBUG nova.network.neutron [req-93b67fd0-0be4-4270-b721-a368f8f22417 req-0917a853-0b77-4650-8a5c-35eaf96c6949 service nova] [instance: 7c62961f-e928-4df6-9c4e-74f035dde9a2] Refreshing network info cache for port 336cfc3b-0045-4c7f-bd85-ce9b9080ff58 {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 00:43:17 user nova-compute[75165]: DEBUG nova.network.neutron [req-93b67fd0-0be4-4270-b721-a368f8f22417 req-0917a853-0b77-4650-8a5c-35eaf96c6949 service nova] [instance: 7c62961f-e928-4df6-9c4e-74f035dde9a2] Updated VIF entry in instance network info cache for port 336cfc3b-0045-4c7f-bd85-ce9b9080ff58. {{(pid=75165) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 00:43:17 user nova-compute[75165]: DEBUG nova.network.neutron [req-93b67fd0-0be4-4270-b721-a368f8f22417 req-0917a853-0b77-4650-8a5c-35eaf96c6949 service nova] [instance: 7c62961f-e928-4df6-9c4e-74f035dde9a2] Updating instance_info_cache with network_info: [{"id": "336cfc3b-0045-4c7f-bd85-ce9b9080ff58", "address": "fa:16:3e:83:d2:12", "network": {"id": "1801db1c-315e-4bdf-b73b-132a38bf41b8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1254756052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62572ce8ae524b55950532fd89729b71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap336cfc3b-00", "ovs_interfaceid": "336cfc3b-0045-4c7f-bd85-ce9b9080ff58", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:43:17 user nova-compute[75165]: DEBUG nova.compute.manager [req-98696aae-ba84-4bd3-b637-668f9123cd61 req-94dffea8-c967-46c2-bc0f-348125daa314 service nova] [instance: 50c16604-2066-4cd2-a74e-c47a2dc4c449] Received event network-changed-78fd9337-1104-4248-9500-e9be75713371 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:43:17 user nova-compute[75165]: DEBUG nova.compute.manager [req-98696aae-ba84-4bd3-b637-668f9123cd61 req-94dffea8-c967-46c2-bc0f-348125daa314 service nova] [instance: 50c16604-2066-4cd2-a74e-c47a2dc4c449] Refreshing instance network info cache due to event network-changed-78fd9337-1104-4248-9500-e9be75713371. {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 00:43:17 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-98696aae-ba84-4bd3-b637-668f9123cd61 req-94dffea8-c967-46c2-bc0f-348125daa314 service nova] Acquiring lock "refresh_cache-50c16604-2066-4cd2-a74e-c47a2dc4c449" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:43:17 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-98696aae-ba84-4bd3-b637-668f9123cd61 req-94dffea8-c967-46c2-bc0f-348125daa314 service nova] Acquired lock "refresh_cache-50c16604-2066-4cd2-a74e-c47a2dc4c449" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:43:17 user nova-compute[75165]: DEBUG nova.network.neutron [req-98696aae-ba84-4bd3-b637-668f9123cd61 req-94dffea8-c967-46c2-bc0f-348125daa314 service nova] [instance: 50c16604-2066-4cd2-a74e-c47a2dc4c449] Refreshing network info cache for port 78fd9337-1104-4248-9500-e9be75713371 {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 00:43:17 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-93b67fd0-0be4-4270-b721-a368f8f22417 req-0917a853-0b77-4650-8a5c-35eaf96c6949 service nova] Releasing lock "refresh_cache-7c62961f-e928-4df6-9c4e-74f035dde9a2" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:43:18 user nova-compute[75165]: DEBUG nova.network.neutron [req-98696aae-ba84-4bd3-b637-668f9123cd61 req-94dffea8-c967-46c2-bc0f-348125daa314 service nova] [instance: 50c16604-2066-4cd2-a74e-c47a2dc4c449] Updated VIF entry in instance network info cache for port 78fd9337-1104-4248-9500-e9be75713371. {{(pid=75165) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 00:43:18 user nova-compute[75165]: DEBUG nova.network.neutron [req-98696aae-ba84-4bd3-b637-668f9123cd61 req-94dffea8-c967-46c2-bc0f-348125daa314 service nova] [instance: 50c16604-2066-4cd2-a74e-c47a2dc4c449] Updating instance_info_cache with network_info: [{"id": "78fd9337-1104-4248-9500-e9be75713371", "address": "fa:16:3e:b3:14:9a", "network": {"id": "0fc59e9a-15a6-41b6-aee1-f8d958b92246", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1263090607-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b40f07ee85b4c55b1725a43a8ee718d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78fd9337-11", "ovs_interfaceid": "78fd9337-1104-4248-9500-e9be75713371", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:43:18 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-98696aae-ba84-4bd3-b637-668f9123cd61 req-94dffea8-c967-46c2-bc0f-348125daa314 service nova] Releasing lock "refresh_cache-50c16604-2066-4cd2-a74e-c47a2dc4c449" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:43:18 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-a0fa8ff7-9fcc-46a3-a050-f78495f2d1b0 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Acquiring lock "50c16604-2066-4cd2-a74e-c47a2dc4c449" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:43:18 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-a0fa8ff7-9fcc-46a3-a050-f78495f2d1b0 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Lock "50c16604-2066-4cd2-a74e-c47a2dc4c449" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:43:18 user nova-compute[75165]: DEBUG nova.objects.instance [None req-a0fa8ff7-9fcc-46a3-a050-f78495f2d1b0 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Lazy-loading 'flavor' on Instance uuid 50c16604-2066-4cd2-a74e-c47a2dc4c449 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:43:18 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-a0fa8ff7-9fcc-46a3-a050-f78495f2d1b0 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Lock "50c16604-2066-4cd2-a74e-c47a2dc4c449" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:43:19 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-a0fa8ff7-9fcc-46a3-a050-f78495f2d1b0 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Acquiring lock "50c16604-2066-4cd2-a74e-c47a2dc4c449" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:43:19 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-a0fa8ff7-9fcc-46a3-a050-f78495f2d1b0 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Lock "50c16604-2066-4cd2-a74e-c47a2dc4c449" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:43:19 user nova-compute[75165]: INFO nova.compute.manager [None req-a0fa8ff7-9fcc-46a3-a050-f78495f2d1b0 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] [instance: 50c16604-2066-4cd2-a74e-c47a2dc4c449] Attaching volume 8e97f54a-607f-40f2-ba2a-aa72f53c047e to /dev/vdb
Oct 26 00:43:19 user nova-compute[75165]: DEBUG os_brick.utils [None req-a0fa8ff7-9fcc-46a3-a050-f78495f2d1b0 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:43:19 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:43:19 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:43:19 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[8042c24c-ab99-498b-860a-7907d2c43821]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa94814ccb35\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:43:19 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:43:19 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:43:19 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[eda174a9-9c5e-4b0e-bc9d-1714ab8aeb94]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:43:19 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:43:19 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:43:19 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[32ca5662-1873-49f8-89e9-c5f1af8fc3b3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:43:19 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd3dcef3-17ce-4fdd-909f-36939c20cd39]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:43:19 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-a0fa8ff7-9fcc-46a3-a050-f78495f2d1b0 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Running cmd (subprocess): nvme version {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:43:19 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-a0fa8ff7-9fcc-46a3-a050-f78495f2d1b0 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] 'nvme version' failed. Not Retrying. {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 00:43:19 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a0fa8ff7-9fcc-46a3-a050-f78495f2d1b0 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] nvme not present on system {{(pid=75165) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 00:43:19 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:43:19 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 00:43:19 user nova-compute[75165]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 00:43:19 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[02edb61e-dabc-48b8-b937-edd79b4f5739]: (4, '') {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:43:19 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-a0fa8ff7-9fcc-46a3-a050-f78495f2d1b0 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75165) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 00:43:19 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-a0fa8ff7-9fcc-46a3-a050-f78495f2d1b0 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75165) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 00:43:19 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-a0fa8ff7-9fcc-46a3-a050-f78495f2d1b0 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] LIGHTOS: no hostnqn found. {{(pid=75165) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 00:43:19 user nova-compute[75165]: DEBUG os_brick.utils [None req-a0fa8ff7-9fcc-46a3-a050-f78495f2d1b0 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa94814ccb35', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:43:19 user nova-compute[75165]: DEBUG nova.virt.block_device [None req-a0fa8ff7-9fcc-46a3-a050-f78495f2d1b0 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] [instance: 50c16604-2066-4cd2-a74e-c47a2dc4c449] Updating existing volume attachment record: 8d149590-abf1-4bd5-ab62-650c5f462448 {{(pid=75165) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 00:43:19 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:43:22 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:43:23 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-48eca840-28ad-426a-83e8-371adf49289b tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Acquiring lock "7c62961f-e928-4df6-9c4e-74f035dde9a2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:43:23 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-48eca840-28ad-426a-83e8-371adf49289b tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Lock "7c62961f-e928-4df6-9c4e-74f035dde9a2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:43:23 user nova-compute[75165]: DEBUG nova.objects.instance [None req-48eca840-28ad-426a-83e8-371adf49289b tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Lazy-loading 'flavor' on Instance uuid 7c62961f-e928-4df6-9c4e-74f035dde9a2 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:43:23 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-48eca840-28ad-426a-83e8-371adf49289b tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Lock "7c62961f-e928-4df6-9c4e-74f035dde9a2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:43:23 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-48eca840-28ad-426a-83e8-371adf49289b tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Acquiring lock "7c62961f-e928-4df6-9c4e-74f035dde9a2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:43:23 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-48eca840-28ad-426a-83e8-371adf49289b tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Lock "7c62961f-e928-4df6-9c4e-74f035dde9a2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:43:23 user nova-compute[75165]: INFO nova.compute.manager [None req-48eca840-28ad-426a-83e8-371adf49289b tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 7c62961f-e928-4df6-9c4e-74f035dde9a2] Attaching volume 4f64eadd-847c-4116-8015-79e52adfbfd9 to /dev/vdb
Oct 26 00:43:23 user nova-compute[75165]: DEBUG os_brick.utils [None req-48eca840-28ad-426a-83e8-371adf49289b tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:43:23 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:43:23 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:43:23 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[be5d6d12-8100-4654-895e-71b1921015db]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa94814ccb35\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:43:23 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:43:23 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:43:23 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[84c5f2a9-09d4-4cac-a382-0749434e08ab]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:43:23 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:43:23 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:43:23 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[58d624bd-894a-4b0c-a665-57c7d84737b7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:43:23 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[394ffb39-11a6-4b2f-99e4-fb62357fa553]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:43:23 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-48eca840-28ad-426a-83e8-371adf49289b tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Running cmd (subprocess): nvme version {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:43:23 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-48eca840-28ad-426a-83e8-371adf49289b tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] 'nvme version' failed. Not Retrying. {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 00:43:23 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.nvmeof [None req-48eca840-28ad-426a-83e8-371adf49289b tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] nvme not present on system {{(pid=75165) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 00:43:23 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:43:23 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 00:43:23 user nova-compute[75165]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 00:43:23 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[50898127-d981-410a-b4fe-71e2657acf65]: (4, '') {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:43:23 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-48eca840-28ad-426a-83e8-371adf49289b tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75165) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 00:43:23 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-48eca840-28ad-426a-83e8-371adf49289b tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75165) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 00:43:23 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-48eca840-28ad-426a-83e8-371adf49289b tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] LIGHTOS: no hostnqn found. {{(pid=75165) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 00:43:23 user nova-compute[75165]: DEBUG os_brick.utils [None req-48eca840-28ad-426a-83e8-371adf49289b tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa94814ccb35', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:43:23 user nova-compute[75165]: DEBUG nova.virt.block_device [None req-48eca840-28ad-426a-83e8-371adf49289b tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 7c62961f-e928-4df6-9c4e-74f035dde9a2] Updating existing volume attachment record: 67c0e473-b3ef-4d19-918c-de4d50896da0 {{(pid=75165) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 00:43:24 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:43:26 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:43:26 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:43:26 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75165) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 00:43:27 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:43:27 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:43:29 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:43:32 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:43:32 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:43:32 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:43:33 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:43:33 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:43:34 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:43:34 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:43:34 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75165) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 00:43:34 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75165) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 00:43:34 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75165) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 00:43:34 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:43:35 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:43:35 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Starting heal instance info cache {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 00:43:35 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Rebuilding the list of instances to heal {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 00:43:35 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "refresh_cache-539bedc3-f788-4d5e-993b-3b168d027a57" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:43:35 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquired lock "refresh_cache-539bedc3-f788-4d5e-993b-3b168d027a57" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:43:35 user nova-compute[75165]: DEBUG nova.network.neutron [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: 539bedc3-f788-4d5e-993b-3b168d027a57] Forcefully refreshing network info cache for instance {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 00:43:35 user nova-compute[75165]: DEBUG nova.objects.instance [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lazy-loading 'info_cache' on Instance uuid 539bedc3-f788-4d5e-993b-3b168d027a57 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:43:36 user nova-compute[75165]: DEBUG nova.network.neutron [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: 539bedc3-f788-4d5e-993b-3b168d027a57] Updating instance_info_cache with network_info: [{"id": "cf882314-eb1e-4555-b87d-4e010947f66f", "address": "fa:16:3e:dc:7e:ca", "network": {"id": "dc50ae7b-d501-461f-aa0b-542514330ae8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1091857056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1051405ca054c4bb051fb842a5fb5a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf882314-eb", "ovs_interfaceid": "cf882314-eb1e-4555-b87d-4e010947f66f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:43:36 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Releasing lock "refresh_cache-539bedc3-f788-4d5e-993b-3b168d027a57" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:43:36 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: 539bedc3-f788-4d5e-993b-3b168d027a57] Updated the network info_cache for instance {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 00:43:36 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:43:36 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:43:36 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:43:36 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:43:36 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75165) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 00:43:36 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c16604-2066-4cd2-a74e-c47a2dc4c449/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:43:37 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:43:37 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a0fa8ff7-9fcc-46a3-a050-f78495f2d1b0 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] [instance: 50c16604-2066-4cd2-a74e-c47a2dc4c449] Calling os-brick to attach iSCSI Volume {{(pid=75165) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 00:43:37 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0fa8ff7-9fcc-46a3-a050-f78495f2d1b0 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8bf8160e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8e97f54a-607f-40f2-ba2a-aa72f53c047e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WvIkgSKd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:43:37 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-a0fa8ff7-9fcc-46a3-a050-f78495f2d1b0 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:43:37 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-a0fa8ff7-9fcc-46a3-a050-f78495f2d1b0 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:43:37 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-a0fa8ff7-9fcc-46a3-a050-f78495f2d1b0 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:43:37 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-a0fa8ff7-9fcc-46a3-a050-f78495f2d1b0 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:43:37 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-a0fa8ff7-9fcc-46a3-a050-f78495f2d1b0 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8e97f54a-607f-40f2-ba2a-aa72f53c047e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:43:37 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-a0fa8ff7-9fcc-46a3-a050-f78495f2d1b0 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8e97f54a-607f-40f2-ba2a-aa72f53c047e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:43:37 user nova-compute[75165]: INFO os_brick.initiator.connectors.iscsi [None req-a0fa8ff7-9fcc-46a3-a050-f78495f2d1b0 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 00:43:37 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e97f54a-607f-40f2-ba2a-aa72f53c047e -p 172.16.0.220:3260 {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:43:37 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e97f54a-607f-40f2-ba2a-aa72f53c047e -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:43:37 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f08f3c0-200a-4016-90cc-d36d21a611f7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:43:37 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0fa8ff7-9fcc-46a3-a050-f78495f2d1b0 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 00:43:37 user nova-compute[75165]:  {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:43:37 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e97f54a-607f-40f2-ba2a-aa72f53c047e -p 172.16.0.220:3260 --interface default --op new {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:43:37 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e97f54a-607f-40f2-ba2a-aa72f53c047e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:43:37 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e3e6cf7-1fa5-4dbf-b80d-4d73f258c1c5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8e97f54a-607f-40f2-ba2a-aa72f53c047e] added\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:43:37 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0fa8ff7-9fcc-46a3-a050-f78495f2d1b0 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8e97f54a-607f-40f2-ba2a-aa72f53c047e] added
Oct 26 00:43:37 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:43:37 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e97f54a-607f-40f2-ba2a-aa72f53c047e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:43:37 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e97f54a-607f-40f2-ba2a-aa72f53c047e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:43:37 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[27dda32d-3a96-4e3d-b2a6-d9144cdee32e]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:43:37 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0fa8ff7-9fcc-46a3-a050-f78495f2d1b0 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:43:37 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e97f54a-607f-40f2-ba2a-aa72f53c047e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:43:37 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e97f54a-607f-40f2-ba2a-aa72f53c047e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:43:37 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[3930b132-94c2-487b-85ec-b4f950b695f9]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:43:37 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0fa8ff7-9fcc-46a3-a050-f78495f2d1b0 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:43:37 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e97f54a-607f-40f2-ba2a-aa72f53c047e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WvIkgSKd {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:43:37 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e97f54a-607f-40f2-ba2a-aa72f53c047e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WvIkgSKd" returned: 0 in 0.021s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:43:37 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[c75ccfd3-a10e-4995-a347-287258802b29]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:43:37 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0fa8ff7-9fcc-46a3-a050-f78495f2d1b0 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WvIkgSKd'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:43:37 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e97f54a-607f-40f2-ba2a-aa72f53c047e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:43:37 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c16604-2066-4cd2-a74e-c47a2dc4c449/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:43:37 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c16604-2066-4cd2-a74e-c47a2dc4c449/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:43:37 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e97f54a-607f-40f2-ba2a-aa72f53c047e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:43:37 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1f08a4c-f579-45ee-986d-3e7e72719283]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:43:37 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0fa8ff7-9fcc-46a3-a050-f78495f2d1b0 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:43:37 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:43:37 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:43:37 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e057a8b-bb64-4a26-b550-4fa0fd83f4e7]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67c880f5-c46a-4e45-b73a-a052fca3638c (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:43:37 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0fa8ff7-9fcc-46a3-a050-f78495f2d1b0 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67c880f5-c46a-4e45-b73a-a052fca3638c (non-flash)
Oct 26 00:43:37 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:43:37 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0fa8ff7-9fcc-46a3-a050-f78495f2d1b0 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67c880f5-c46a-4e45-b73a-a052fca3638c (non-flash)
Oct 26 00:43:37 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:43:37 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e97f54a-607f-40f2-ba2a-aa72f53c047e -p 172.16.0.220:3260 --login {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:43:37 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e97f54a-607f-40f2-ba2a-aa72f53c047e -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:43:37 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[12052596-f47f-4e66-aaad-e2f161e69c27]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8e97f54a-607f-40f2-ba2a-aa72f53c047e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8e97f54a-607f-40f2-ba2a-aa72f53c047e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:43:37 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0fa8ff7-9fcc-46a3-a050-f78495f2d1b0 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8e97f54a-607f-40f2-ba2a-aa72f53c047e, portal: 172.16.0.220,3260]
Oct 26 00:43:37 user nova-compute[75165]: Login to [iface: default, target: iqn.2010-10.org.openstack:8e97f54a-607f-40f2-ba2a-aa72f53c047e, portal: 172.16.0.220,3260] successful.
Oct 26 00:43:37 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:43:37 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e97f54a-607f-40f2-ba2a-aa72f53c047e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:43:37 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e97f54a-607f-40f2-ba2a-aa72f53c047e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:43:37 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[11c15b41-9a56-48ad-9157-e99e7c6dd9de]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:43:37 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0fa8ff7-9fcc-46a3-a050-f78495f2d1b0 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:43:37 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:43:37 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:43:37 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8c5286b-7a85-4b8e-b2c6-deeaa00a9069]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67c880f5-c46a-4e45-b73a-a052fca3638c (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e97f54a-607f-40f2-ba2a-aa72f53c047e (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:43:37 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0fa8ff7-9fcc-46a3-a050-f78495f2d1b0 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67c880f5-c46a-4e45-b73a-a052fca3638c (non-flash)
Oct 26 00:43:37 user nova-compute[75165]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e97f54a-607f-40f2-ba2a-aa72f53c047e (non-flash)
Oct 26 00:43:37 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:43:37 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0fa8ff7-9fcc-46a3-a050-f78495f2d1b0 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67c880f5-c46a-4e45-b73a-a052fca3638c (non-flash)
Oct 26 00:43:37 user nova-compute[75165]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e97f54a-607f-40f2-ba2a-aa72f53c047e (non-flash)
Oct 26 00:43:37 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:43:37 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-a0fa8ff7-9fcc-46a3-a050-f78495f2d1b0 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8e97f54a-607f-40f2-ba2a-aa72f53c047e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.301s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:43:37 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0fa8ff7-9fcc-46a3-a050-f78495f2d1b0 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Connected to 172.16.0.220:3260 {{(pid=75165) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 00:43:37 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-a0fa8ff7-9fcc-46a3-a050-f78495f2d1b0 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] HCTL ('34', '-', '-', 0) found on session 49 with lun 0 {{(pid=75165) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 00:43:37 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-a0fa8ff7-9fcc-46a3-a050-f78495f2d1b0 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75165) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 00:43:37 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:43:37 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c16604-2066-4cd2-a74e-c47a2dc4c449/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:43:37 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75165) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 00:43:37 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:43:37 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c43a43c-5116-4ee0-812f-c260cf867491]: (4, ('- - 0', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:43:37 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-a0fa8ff7-9fcc-46a3-a050-f78495f2d1b0 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Searching for a device in session 49 and hctl ['34', '*', '*', 0] yield: None {{(pid=75165) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 00:43:37 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c62961f-e928-4df6-9c4e-74f035dde9a2/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:43:37 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c62961f-e928-4df6-9c4e-74f035dde9a2/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:43:37 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c62961f-e928-4df6-9c4e-74f035dde9a2/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:43:37 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c62961f-e928-4df6-9c4e-74f035dde9a2/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:43:38 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:43:38 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:43:38 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Hypervisor/Node resource view: name=user free_ram=8714MB free_disk=24.811386108398438GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75165) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 00:43:38 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:43:38 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:43:38 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-a0fa8ff7-9fcc-46a3-a050-f78495f2d1b0 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Searching for a device in session 49 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75165) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 00:43:38 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0fa8ff7-9fcc-46a3-a050-f78495f2d1b0 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:8e97f54a-607f-40f2-ba2a-aa72f53c047e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WvIkgSKd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75165) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 00:43:38 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-a0fa8ff7-9fcc-46a3-a050-f78495f2d1b0 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.333s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:43:38 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0fa8ff7-9fcc-46a3-a050-f78495f2d1b0 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] <== connect_volume: return (1335ms) {'type': 'block', 'scsi_wwn': '26264633538323235', 'path': '/dev/sdc'} {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:43:38 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a0fa8ff7-9fcc-46a3-a050-f78495f2d1b0 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] [instance: 50c16604-2066-4cd2-a74e-c47a2dc4c449] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26264633538323235', 'path': '/dev/sdc'} {{(pid=75165) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 00:43:38 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 539bedc3-f788-4d5e-993b-3b168d027a57 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:43:38 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 7c62961f-e928-4df6-9c4e-74f035dde9a2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:43:38 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 50c16604-2066-4cd2-a74e-c47a2dc4c449 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:43:38 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75165) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 00:43:38 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75165) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 00:43:38 user nova-compute[75165]: DEBUG nova.objects.instance [None req-a0fa8ff7-9fcc-46a3-a050-f78495f2d1b0 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Lazy-loading 'flavor' on Instance uuid 50c16604-2066-4cd2-a74e-c47a2dc4c449 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:43:38 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Refreshing inventories for resource provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 26 00:43:38 user nova-compute[75165]: DEBUG nova.virt.libvirt.guest [None req-a0fa8ff7-9fcc-46a3-a050-f78495f2d1b0 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 00:43:38 user nova-compute[75165]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 00:43:38 user nova-compute[75165]:   <source dev="/dev/sdc"/>
Oct 26 00:43:38 user nova-compute[75165]:   <target dev="vdb" bus="virtio"/>
Oct 26 00:43:38 user nova-compute[75165]:   <serial>8e97f54a-607f-40f2-ba2a-aa72f53c047e</serial>
Oct 26 00:43:38 user nova-compute[75165]: </disk>
Oct 26 00:43:38 user nova-compute[75165]:  {{(pid=75165) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 00:43:38 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Updating ProviderTree inventory for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 26 00:43:38 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Updating inventory in ProviderTree for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 26 00:43:38 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Refreshing aggregate associations for resource provider 03214fd5-21d1-46ec-b6b0-6449b77ba230, aggregates: None {{(pid=75165) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 26 00:43:38 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Refreshing trait associations for resource provider 03214fd5-21d1-46ec-b6b0-6449b77ba230, traits: COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NODE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_TRUSTED_CERTS,COMPUTE_DEVICE_TAGGING,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO {{(pid=75165) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 26 00:43:38 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:43:38 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:43:38 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Compute_service record updated for user:user {{(pid=75165) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 00:43:38 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.502s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:43:38 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-a0fa8ff7-9fcc-46a3-a050-f78495f2d1b0 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] No BDM found with device name vda, not building metadata. {{(pid=75165) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 00:43:38 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-a0fa8ff7-9fcc-46a3-a050-f78495f2d1b0 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75165) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 00:43:38 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-a0fa8ff7-9fcc-46a3-a050-f78495f2d1b0 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] No VIF found with MAC fa:16:3e:b3:14:9a, not building metadata {{(pid=75165) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 00:43:39 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-a0fa8ff7-9fcc-46a3-a050-f78495f2d1b0 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Lock "50c16604-2066-4cd2-a74e-c47a2dc4c449" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.078s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:43:39 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:43:40 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:43:40 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:43:40 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75165) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 26 00:43:41 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48eca840-28ad-426a-83e8-371adf49289b tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 7c62961f-e928-4df6-9c4e-74f035dde9a2] Calling os-brick to attach iSCSI Volume {{(pid=75165) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 00:43:41 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-48eca840-28ad-426a-83e8-371adf49289b tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8bf8160e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4f64eadd-847c-4116-8015-79e52adfbfd9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QsDWVcJo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:43:41 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-48eca840-28ad-426a-83e8-371adf49289b tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:43:41 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-48eca840-28ad-426a-83e8-371adf49289b tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:43:41 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-48eca840-28ad-426a-83e8-371adf49289b tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:43:41 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-48eca840-28ad-426a-83e8-371adf49289b tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:43:41 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-48eca840-28ad-426a-83e8-371adf49289b tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4f64eadd-847c-4116-8015-79e52adfbfd9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:43:41 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-48eca840-28ad-426a-83e8-371adf49289b tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4f64eadd-847c-4116-8015-79e52adfbfd9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:43:41 user nova-compute[75165]: INFO os_brick.initiator.connectors.iscsi [None req-48eca840-28ad-426a-83e8-371adf49289b tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 00:43:41 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f64eadd-847c-4116-8015-79e52adfbfd9 -p 172.16.0.220:3260 {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:43:41 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f64eadd-847c-4116-8015-79e52adfbfd9 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:43:41 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[a62258e9-323c-4be4-a865-6fcb870e9896]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:43:41 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-48eca840-28ad-426a-83e8-371adf49289b tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 00:43:41 user nova-compute[75165]:  {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:43:41 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f64eadd-847c-4116-8015-79e52adfbfd9 -p 172.16.0.220:3260 --interface default --op new {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:43:41 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f64eadd-847c-4116-8015-79e52adfbfd9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:43:41 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e6a8916-24a7-4200-beab-16940a575dab]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4f64eadd-847c-4116-8015-79e52adfbfd9] added\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:43:41 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-48eca840-28ad-426a-83e8-371adf49289b tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4f64eadd-847c-4116-8015-79e52adfbfd9] added
Oct 26 00:43:41 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:43:41 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f64eadd-847c-4116-8015-79e52adfbfd9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:43:41 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f64eadd-847c-4116-8015-79e52adfbfd9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:43:41 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f3f28db-f9eb-45f5-a10d-e8f19ce22eec]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:43:41 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-48eca840-28ad-426a-83e8-371adf49289b tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:43:41 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f64eadd-847c-4116-8015-79e52adfbfd9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:43:41 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-da16cebd-bf09-4920-8c31-c92f2fc303f8 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Acquiring lock "50c16604-2066-4cd2-a74e-c47a2dc4c449" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:43:41 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-da16cebd-bf09-4920-8c31-c92f2fc303f8 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Lock "50c16604-2066-4cd2-a74e-c47a2dc4c449" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:43:41 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f64eadd-847c-4116-8015-79e52adfbfd9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:43:41 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[563988bd-84cc-4665-bef9-2c5d8c8d9361]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:43:41 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-48eca840-28ad-426a-83e8-371adf49289b tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:43:41 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f64eadd-847c-4116-8015-79e52adfbfd9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QsDWVcJo {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:43:41 user nova-compute[75165]: DEBUG nova.objects.instance [None req-da16cebd-bf09-4920-8c31-c92f2fc303f8 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Lazy-loading 'flavor' on Instance uuid 50c16604-2066-4cd2-a74e-c47a2dc4c449 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:43:41 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f64eadd-847c-4116-8015-79e52adfbfd9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QsDWVcJo" returned: 0 in 0.018s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:43:41 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc29e7f5-b91c-412a-99dd-32d3629f06fe]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:43:41 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-48eca840-28ad-426a-83e8-371adf49289b tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QsDWVcJo'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:43:41 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f64eadd-847c-4116-8015-79e52adfbfd9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:43:41 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f64eadd-847c-4116-8015-79e52adfbfd9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:43:41 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff1d9af1-9b28-4e5d-a186-7e3572383de2]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:43:41 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-48eca840-28ad-426a-83e8-371adf49289b tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:43:41 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-da16cebd-bf09-4920-8c31-c92f2fc303f8 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Lock "50c16604-2066-4cd2-a74e-c47a2dc4c449" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:43:41 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:43:41 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:43:41 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8d15178-71ba-4e10-95fd-abf61af71b50]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67c880f5-c46a-4e45-b73a-a052fca3638c (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e97f54a-607f-40f2-ba2a-aa72f53c047e (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:43:41 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-48eca840-28ad-426a-83e8-371adf49289b tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67c880f5-c46a-4e45-b73a-a052fca3638c (non-flash)
Oct 26 00:43:41 user nova-compute[75165]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e97f54a-607f-40f2-ba2a-aa72f53c047e (non-flash)
Oct 26 00:43:41 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:43:41 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-48eca840-28ad-426a-83e8-371adf49289b tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67c880f5-c46a-4e45-b73a-a052fca3638c (non-flash)
Oct 26 00:43:41 user nova-compute[75165]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e97f54a-607f-40f2-ba2a-aa72f53c047e (non-flash)
Oct 26 00:43:41 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:43:41 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f64eadd-847c-4116-8015-79e52adfbfd9 -p 172.16.0.220:3260 --login {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:43:41 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f64eadd-847c-4116-8015-79e52adfbfd9 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:43:41 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[58d7ccec-840e-4ab1-a267-aba628704a5e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4f64eadd-847c-4116-8015-79e52adfbfd9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4f64eadd-847c-4116-8015-79e52adfbfd9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:43:41 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-48eca840-28ad-426a-83e8-371adf49289b tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4f64eadd-847c-4116-8015-79e52adfbfd9, portal: 172.16.0.220,3260]
Oct 26 00:43:41 user nova-compute[75165]: Login to [iface: default, target: iqn.2010-10.org.openstack:4f64eadd-847c-4116-8015-79e52adfbfd9, portal: 172.16.0.220,3260] successful.
Oct 26 00:43:41 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:43:41 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f64eadd-847c-4116-8015-79e52adfbfd9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:43:42 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f64eadd-847c-4116-8015-79e52adfbfd9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:43:42 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[de43a35e-ae17-459e-bce0-0e0f19bbced6]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:43:42 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-48eca840-28ad-426a-83e8-371adf49289b tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:43:42 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:43:42 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:43:42 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bb6ab8a-7b31-48bf-be34-41ee224b327e]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67c880f5-c46a-4e45-b73a-a052fca3638c (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e97f54a-607f-40f2-ba2a-aa72f53c047e (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f64eadd-847c-4116-8015-79e52adfbfd9 (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:43:42 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-48eca840-28ad-426a-83e8-371adf49289b tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67c880f5-c46a-4e45-b73a-a052fca3638c (non-flash)
Oct 26 00:43:42 user nova-compute[75165]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e97f54a-607f-40f2-ba2a-aa72f53c047e (non-flash)
Oct 26 00:43:42 user nova-compute[75165]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f64eadd-847c-4116-8015-79e52adfbfd9 (non-flash)
Oct 26 00:43:42 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:43:42 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-48eca840-28ad-426a-83e8-371adf49289b tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67c880f5-c46a-4e45-b73a-a052fca3638c (non-flash)
Oct 26 00:43:42 user nova-compute[75165]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e97f54a-607f-40f2-ba2a-aa72f53c047e (non-flash)
Oct 26 00:43:42 user nova-compute[75165]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f64eadd-847c-4116-8015-79e52adfbfd9 (non-flash)
Oct 26 00:43:42 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:43:42 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-48eca840-28ad-426a-83e8-371adf49289b tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4f64eadd-847c-4116-8015-79e52adfbfd9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.278s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:43:42 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-48eca840-28ad-426a-83e8-371adf49289b tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Connected to 172.16.0.220:3260 {{(pid=75165) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 00:43:42 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-48eca840-28ad-426a-83e8-371adf49289b tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] HCTL ('35', '-', '-', 0) found on session 50 with lun 0 {{(pid=75165) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 00:43:42 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-48eca840-28ad-426a-83e8-371adf49289b tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75165) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 00:43:42 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:43:42 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.022s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:43:42 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[773256fd-4cb9-458d-bf49-6500e67fd20e]: (4, ('- - 0', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:43:42 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-48eca840-28ad-426a-83e8-371adf49289b tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Searching for a device in session 50 and hctl ['35', '*', '*', 0] yield: None {{(pid=75165) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 00:43:42 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-da16cebd-bf09-4920-8c31-c92f2fc303f8 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Acquiring lock "50c16604-2066-4cd2-a74e-c47a2dc4c449" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:43:42 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-da16cebd-bf09-4920-8c31-c92f2fc303f8 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Lock "50c16604-2066-4cd2-a74e-c47a2dc4c449" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:43:42 user nova-compute[75165]: INFO nova.compute.manager [None req-da16cebd-bf09-4920-8c31-c92f2fc303f8 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] [instance: 50c16604-2066-4cd2-a74e-c47a2dc4c449] Attaching volume 5f6c7de5-b5d3-4d68-820e-02282b096f79 to /dev/vdc
Oct 26 00:43:42 user nova-compute[75165]: DEBUG os_brick.utils [None req-da16cebd-bf09-4920-8c31-c92f2fc303f8 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:43:42 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:43:42 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:43:42 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[547ba7ee-7bb0-48ba-8bb7-d1391ed3ad5a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa94814ccb35\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:43:42 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:43:42 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:43:42 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[28389711-e286-475a-a32f-c8e7146ac302]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:43:42 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:43:42 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:43:42 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ab5be17-4436-4e94-a88e-e2bf6389f34a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:43:42 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[0114934b-53df-410c-8549-e2f8375e99ff]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:43:42 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-da16cebd-bf09-4920-8c31-c92f2fc303f8 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Running cmd (subprocess): nvme version {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:43:42 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-da16cebd-bf09-4920-8c31-c92f2fc303f8 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] 'nvme version' failed. Not Retrying. {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 00:43:42 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.nvmeof [None req-da16cebd-bf09-4920-8c31-c92f2fc303f8 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] nvme not present on system {{(pid=75165) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 00:43:42 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:43:42 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 00:43:42 user nova-compute[75165]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 00:43:42 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc89597c-9e11-4787-890b-e2cfccf6d139]: (4, '') {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:43:42 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-da16cebd-bf09-4920-8c31-c92f2fc303f8 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75165) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 00:43:42 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-da16cebd-bf09-4920-8c31-c92f2fc303f8 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75165) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 00:43:42 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-da16cebd-bf09-4920-8c31-c92f2fc303f8 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] LIGHTOS: no hostnqn found. {{(pid=75165) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 00:43:42 user nova-compute[75165]: DEBUG os_brick.utils [None req-da16cebd-bf09-4920-8c31-c92f2fc303f8 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa94814ccb35', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:43:42 user nova-compute[75165]: DEBUG nova.virt.block_device [None req-da16cebd-bf09-4920-8c31-c92f2fc303f8 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] [instance: 50c16604-2066-4cd2-a74e-c47a2dc4c449] Updating existing volume attachment record: e9c8742f-3ffe-4b4c-b3da-72085e5a6900 {{(pid=75165) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 00:43:43 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-48eca840-28ad-426a-83e8-371adf49289b tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Searching for a device in session 50 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75165) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 00:43:43 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-48eca840-28ad-426a-83e8-371adf49289b tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:4f64eadd-847c-4116-8015-79e52adfbfd9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QsDWVcJo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75165) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 00:43:43 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-48eca840-28ad-426a-83e8-371adf49289b tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.316s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:43:43 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-48eca840-28ad-426a-83e8-371adf49289b tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] <== connect_volume: return (1316ms) {'type': 'block', 'scsi_wwn': '23136323231363064', 'path': '/dev/sdd'} {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:43:43 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48eca840-28ad-426a-83e8-371adf49289b tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 7c62961f-e928-4df6-9c4e-74f035dde9a2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23136323231363064', 'path': '/dev/sdd'} {{(pid=75165) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 00:43:43 user nova-compute[75165]: DEBUG nova.objects.instance [None req-48eca840-28ad-426a-83e8-371adf49289b tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Lazy-loading 'flavor' on Instance uuid 7c62961f-e928-4df6-9c4e-74f035dde9a2 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:43:43 user nova-compute[75165]: DEBUG nova.virt.libvirt.guest [None req-48eca840-28ad-426a-83e8-371adf49289b tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 00:43:43 user nova-compute[75165]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 00:43:43 user nova-compute[75165]:   <source dev="/dev/sdd"/>
Oct 26 00:43:43 user nova-compute[75165]:   <target dev="vdb" bus="virtio"/>
Oct 26 00:43:43 user nova-compute[75165]:   <serial>4f64eadd-847c-4116-8015-79e52adfbfd9</serial>
Oct 26 00:43:43 user nova-compute[75165]: </disk>
Oct 26 00:43:43 user nova-compute[75165]:  {{(pid=75165) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 00:43:43 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-48eca840-28ad-426a-83e8-371adf49289b tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] No BDM found with device name vda, not building metadata. {{(pid=75165) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 00:43:43 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-48eca840-28ad-426a-83e8-371adf49289b tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75165) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 00:43:43 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-48eca840-28ad-426a-83e8-371adf49289b tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] No VIF found with MAC fa:16:3e:83:d2:12, not building metadata {{(pid=75165) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 00:43:43 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-48eca840-28ad-426a-83e8-371adf49289b tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Lock "7c62961f-e928-4df6-9c4e-74f035dde9a2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.044s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:43:43 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:43:43 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:43:44 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-415b3976-d517-4b1b-8624-f007ded118f6 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Acquiring lock "7c62961f-e928-4df6-9c4e-74f035dde9a2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:43:44 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-415b3976-d517-4b1b-8624-f007ded118f6 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Lock "7c62961f-e928-4df6-9c4e-74f035dde9a2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:43:44 user nova-compute[75165]: INFO nova.compute.manager [None req-415b3976-d517-4b1b-8624-f007ded118f6 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 7c62961f-e928-4df6-9c4e-74f035dde9a2] Detaching volume 4f64eadd-847c-4116-8015-79e52adfbfd9
Oct 26 00:43:44 user nova-compute[75165]: INFO nova.virt.block_device [None req-415b3976-d517-4b1b-8624-f007ded118f6 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 7c62961f-e928-4df6-9c4e-74f035dde9a2] Attempting to driver detach volume 4f64eadd-847c-4116-8015-79e52adfbfd9 from mountpoint /dev/vdb
Oct 26 00:43:44 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-415b3976-d517-4b1b-8624-f007ded118f6 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Attempting to detach device vdb from instance 7c62961f-e928-4df6-9c4e-74f035dde9a2 from the persistent domain config. {{(pid=75165) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 00:43:44 user nova-compute[75165]: DEBUG nova.virt.libvirt.guest [None req-415b3976-d517-4b1b-8624-f007ded118f6 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 00:43:44 user nova-compute[75165]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 00:43:44 user nova-compute[75165]:   <source dev="/dev/sdd"/>
Oct 26 00:43:44 user nova-compute[75165]:   <target dev="vdb" bus="virtio"/>
Oct 26 00:43:44 user nova-compute[75165]:   <serial>4f64eadd-847c-4116-8015-79e52adfbfd9</serial>
Oct 26 00:43:44 user nova-compute[75165]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 00:43:44 user nova-compute[75165]: </disk>
Oct 26 00:43:44 user nova-compute[75165]:  {{(pid=75165) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 00:43:44 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-415b3976-d517-4b1b-8624-f007ded118f6 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Successfully detached device vdb from instance 7c62961f-e928-4df6-9c4e-74f035dde9a2 from the persistent domain config.
Oct 26 00:43:44 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-415b3976-d517-4b1b-8624-f007ded118f6 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7c62961f-e928-4df6-9c4e-74f035dde9a2 from the live domain config. {{(pid=75165) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 00:43:44 user nova-compute[75165]: DEBUG nova.virt.libvirt.guest [None req-415b3976-d517-4b1b-8624-f007ded118f6 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 00:43:44 user nova-compute[75165]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 00:43:44 user nova-compute[75165]:   <source dev="/dev/sdd"/>
Oct 26 00:43:44 user nova-compute[75165]:   <target dev="vdb" bus="virtio"/>
Oct 26 00:43:44 user nova-compute[75165]:   <serial>4f64eadd-847c-4116-8015-79e52adfbfd9</serial>
Oct 26 00:43:44 user nova-compute[75165]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 00:43:44 user nova-compute[75165]: </disk>
Oct 26 00:43:44 user nova-compute[75165]:  {{(pid=75165) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 00:43:44 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:43:45 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-415b3976-d517-4b1b-8624-f007ded118f6 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7c62961f-e928-4df6-9c4e-74f035dde9a2 {{(pid=75165) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 00:43:47 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:43:49 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:43:52 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:43:54 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:43:58 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:43:58 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Cleaning up deleted instances {{(pid=75165) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 26 00:43:58 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] There are 0 instances to clean {{(pid=75165) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 26 00:43:59 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:44:00 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da16cebd-bf09-4920-8c31-c92f2fc303f8 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] [instance: 50c16604-2066-4cd2-a74e-c47a2dc4c449] Calling os-brick to attach iSCSI Volume {{(pid=75165) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 00:44:00 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-da16cebd-bf09-4920-8c31-c92f2fc303f8 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8bf8160e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5f6c7de5-b5d3-4d68-820e-02282b096f79', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dIUvjXQL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:44:00 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-da16cebd-bf09-4920-8c31-c92f2fc303f8 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:44:00 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-da16cebd-bf09-4920-8c31-c92f2fc303f8 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:44:00 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-da16cebd-bf09-4920-8c31-c92f2fc303f8 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:44:00 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-da16cebd-bf09-4920-8c31-c92f2fc303f8 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:44:00 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-da16cebd-bf09-4920-8c31-c92f2fc303f8 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f6c7de5-b5d3-4d68-820e-02282b096f79" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:44:00 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-da16cebd-bf09-4920-8c31-c92f2fc303f8 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f6c7de5-b5d3-4d68-820e-02282b096f79" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:44:00 user nova-compute[75165]: INFO os_brick.initiator.connectors.iscsi [None req-da16cebd-bf09-4920-8c31-c92f2fc303f8 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 00:44:00 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f6c7de5-b5d3-4d68-820e-02282b096f79 -p 172.16.0.220:3260 {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:44:00 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f6c7de5-b5d3-4d68-820e-02282b096f79 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:44:00 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[78ad58c2-e451-47c4-9eec-9c6179301ad3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:44:00 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-da16cebd-bf09-4920-8c31-c92f2fc303f8 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 00:44:00 user nova-compute[75165]:  {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:44:00 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f6c7de5-b5d3-4d68-820e-02282b096f79 -p 172.16.0.220:3260 --interface default --op new {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:44:00 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f6c7de5-b5d3-4d68-820e-02282b096f79 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:44:00 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[db072621-cf92-4129-baed-42392a55a9fc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5f6c7de5-b5d3-4d68-820e-02282b096f79] added\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:44:00 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-da16cebd-bf09-4920-8c31-c92f2fc303f8 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5f6c7de5-b5d3-4d68-820e-02282b096f79] added
Oct 26 00:44:00 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:44:00 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f6c7de5-b5d3-4d68-820e-02282b096f79 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:44:00 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f6c7de5-b5d3-4d68-820e-02282b096f79 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:44:00 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[1db8beb3-1620-4250-85a2-9139d9456777]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:44:00 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-da16cebd-bf09-4920-8c31-c92f2fc303f8 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:44:00 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f6c7de5-b5d3-4d68-820e-02282b096f79 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:44:00 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f6c7de5-b5d3-4d68-820e-02282b096f79 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:44:00 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[d064289c-9cd3-4071-858b-e77cebe2da88]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:44:00 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-da16cebd-bf09-4920-8c31-c92f2fc303f8 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:44:00 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f6c7de5-b5d3-4d68-820e-02282b096f79 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dIUvjXQL {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:44:00 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f6c7de5-b5d3-4d68-820e-02282b096f79 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dIUvjXQL" returned: 0 in 0.017s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:44:00 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[3884f6a9-1245-4c74-8324-25cf49a911e0]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:44:00 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-da16cebd-bf09-4920-8c31-c92f2fc303f8 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dIUvjXQL'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:44:00 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f6c7de5-b5d3-4d68-820e-02282b096f79 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:44:00 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f6c7de5-b5d3-4d68-820e-02282b096f79 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:44:00 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9c3cc8f-6c0e-4bf3-b50a-bd8b2225db26]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:44:00 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-da16cebd-bf09-4920-8c31-c92f2fc303f8 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:44:00 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:44:00 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:44:00 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[19708c00-1c42-47fe-bb66-505df7bbd260]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67c880f5-c46a-4e45-b73a-a052fca3638c (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e97f54a-607f-40f2-ba2a-aa72f53c047e (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f64eadd-847c-4116-8015-79e52adfbfd9 (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:44:00 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-da16cebd-bf09-4920-8c31-c92f2fc303f8 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67c880f5-c46a-4e45-b73a-a052fca3638c (non-flash)
Oct 26 00:44:00 user nova-compute[75165]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e97f54a-607f-40f2-ba2a-aa72f53c047e (non-flash)
Oct 26 00:44:00 user nova-compute[75165]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f64eadd-847c-4116-8015-79e52adfbfd9 (non-flash)
Oct 26 00:44:00 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:44:00 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-da16cebd-bf09-4920-8c31-c92f2fc303f8 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67c880f5-c46a-4e45-b73a-a052fca3638c (non-flash)
Oct 26 00:44:00 user nova-compute[75165]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e97f54a-607f-40f2-ba2a-aa72f53c047e (non-flash)
Oct 26 00:44:00 user nova-compute[75165]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f64eadd-847c-4116-8015-79e52adfbfd9 (non-flash)
Oct 26 00:44:00 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:44:00 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f6c7de5-b5d3-4d68-820e-02282b096f79 -p 172.16.0.220:3260 --login {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:44:00 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f6c7de5-b5d3-4d68-820e-02282b096f79 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:44:00 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[2710ee93-c528-4356-a177-2fbcb10ca7e6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5f6c7de5-b5d3-4d68-820e-02282b096f79, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5f6c7de5-b5d3-4d68-820e-02282b096f79, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:44:00 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-da16cebd-bf09-4920-8c31-c92f2fc303f8 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5f6c7de5-b5d3-4d68-820e-02282b096f79, portal: 172.16.0.220,3260]
Oct 26 00:44:00 user nova-compute[75165]: Login to [iface: default, target: iqn.2010-10.org.openstack:5f6c7de5-b5d3-4d68-820e-02282b096f79, portal: 172.16.0.220,3260] successful.
Oct 26 00:44:00 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:44:00 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f6c7de5-b5d3-4d68-820e-02282b096f79 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:44:00 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f6c7de5-b5d3-4d68-820e-02282b096f79 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:44:00 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1575dda-f02b-4899-810e-2755ed0ba79b]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:44:00 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-da16cebd-bf09-4920-8c31-c92f2fc303f8 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:44:00 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:44:00 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:44:00 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[1889df52-db90-451a-9c79-b831832f149f]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67c880f5-c46a-4e45-b73a-a052fca3638c (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e97f54a-607f-40f2-ba2a-aa72f53c047e (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f64eadd-847c-4116-8015-79e52adfbfd9 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f6c7de5-b5d3-4d68-820e-02282b096f79 (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:44:00 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-da16cebd-bf09-4920-8c31-c92f2fc303f8 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67c880f5-c46a-4e45-b73a-a052fca3638c (non-flash)
Oct 26 00:44:00 user nova-compute[75165]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e97f54a-607f-40f2-ba2a-aa72f53c047e (non-flash)
Oct 26 00:44:00 user nova-compute[75165]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f64eadd-847c-4116-8015-79e52adfbfd9 (non-flash)
Oct 26 00:44:00 user nova-compute[75165]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f6c7de5-b5d3-4d68-820e-02282b096f79 (non-flash)
Oct 26 00:44:00 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:44:00 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-da16cebd-bf09-4920-8c31-c92f2fc303f8 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67c880f5-c46a-4e45-b73a-a052fca3638c (non-flash)
Oct 26 00:44:00 user nova-compute[75165]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e97f54a-607f-40f2-ba2a-aa72f53c047e (non-flash)
Oct 26 00:44:00 user nova-compute[75165]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f64eadd-847c-4116-8015-79e52adfbfd9 (non-flash)
Oct 26 00:44:00 user nova-compute[75165]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f6c7de5-b5d3-4d68-820e-02282b096f79 (non-flash)
Oct 26 00:44:00 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:44:00 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-da16cebd-bf09-4920-8c31-c92f2fc303f8 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f6c7de5-b5d3-4d68-820e-02282b096f79" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.271s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:44:00 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-da16cebd-bf09-4920-8c31-c92f2fc303f8 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Connected to 172.16.0.220:3260 {{(pid=75165) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 00:44:00 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-da16cebd-bf09-4920-8c31-c92f2fc303f8 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] HCTL ('36', '-', '-', 0) found on session 51 with lun 0 {{(pid=75165) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 00:44:00 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-da16cebd-bf09-4920-8c31-c92f2fc303f8 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75165) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 00:44:00 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:44:00 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:44:00 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[db5c7585-f5b8-4e77-ad29-2807cb564aee]: (4, ('- - 0', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:44:00 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-da16cebd-bf09-4920-8c31-c92f2fc303f8 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Searching for a device in session 51 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75165) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 00:44:00 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-da16cebd-bf09-4920-8c31-c92f2fc303f8 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:5f6c7de5-b5d3-4d68-820e-02282b096f79', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dIUvjXQL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75165) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 00:44:01 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-da16cebd-bf09-4920-8c31-c92f2fc303f8 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.300s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:44:01 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-da16cebd-bf09-4920-8c31-c92f2fc303f8 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] <== connect_volume: return (1302ms) {'type': 'block', 'scsi_wwn': '23638343038333235', 'path': '/dev/sde'} {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:44:01 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da16cebd-bf09-4920-8c31-c92f2fc303f8 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] [instance: 50c16604-2066-4cd2-a74e-c47a2dc4c449] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23638343038333235', 'path': '/dev/sde'} {{(pid=75165) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 00:44:01 user nova-compute[75165]: DEBUG nova.objects.instance [None req-da16cebd-bf09-4920-8c31-c92f2fc303f8 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Lazy-loading 'flavor' on Instance uuid 50c16604-2066-4cd2-a74e-c47a2dc4c449 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:44:01 user nova-compute[75165]: DEBUG nova.virt.libvirt.guest [None req-da16cebd-bf09-4920-8c31-c92f2fc303f8 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 00:44:01 user nova-compute[75165]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 00:44:01 user nova-compute[75165]:   <source dev="/dev/sde"/>
Oct 26 00:44:01 user nova-compute[75165]:   <target dev="vdc" bus="virtio"/>
Oct 26 00:44:01 user nova-compute[75165]:   <serial>5f6c7de5-b5d3-4d68-820e-02282b096f79</serial>
Oct 26 00:44:01 user nova-compute[75165]: </disk>
Oct 26 00:44:01 user nova-compute[75165]:  {{(pid=75165) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 00:44:01 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-da16cebd-bf09-4920-8c31-c92f2fc303f8 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] No BDM found with device name vda, not building metadata. {{(pid=75165) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 00:44:01 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-da16cebd-bf09-4920-8c31-c92f2fc303f8 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75165) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 00:44:01 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-da16cebd-bf09-4920-8c31-c92f2fc303f8 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75165) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 00:44:01 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-da16cebd-bf09-4920-8c31-c92f2fc303f8 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] No VIF found with MAC fa:16:3e:b3:14:9a, not building metadata {{(pid=75165) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 00:44:02 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-da16cebd-bf09-4920-8c31-c92f2fc303f8 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Lock "50c16604-2066-4cd2-a74e-c47a2dc4c449" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.966s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:44:02 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-3a715b19-7024-4db8-b2cb-e2fbac2ad081 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Acquiring lock "50c16604-2066-4cd2-a74e-c47a2dc4c449" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:44:02 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-3a715b19-7024-4db8-b2cb-e2fbac2ad081 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Lock "50c16604-2066-4cd2-a74e-c47a2dc4c449" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:44:02 user nova-compute[75165]: INFO nova.compute.manager [None req-3a715b19-7024-4db8-b2cb-e2fbac2ad081 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] [instance: 50c16604-2066-4cd2-a74e-c47a2dc4c449] Detaching volume 5f6c7de5-b5d3-4d68-820e-02282b096f79
Oct 26 00:44:02 user nova-compute[75165]: INFO nova.virt.block_device [None req-3a715b19-7024-4db8-b2cb-e2fbac2ad081 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] [instance: 50c16604-2066-4cd2-a74e-c47a2dc4c449] Attempting to driver detach volume 5f6c7de5-b5d3-4d68-820e-02282b096f79 from mountpoint /dev/vdc
Oct 26 00:44:02 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-3a715b19-7024-4db8-b2cb-e2fbac2ad081 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Attempting to detach device vdc from instance 50c16604-2066-4cd2-a74e-c47a2dc4c449 from the persistent domain config. {{(pid=75165) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 00:44:02 user nova-compute[75165]: DEBUG nova.virt.libvirt.guest [None req-3a715b19-7024-4db8-b2cb-e2fbac2ad081 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 00:44:02 user nova-compute[75165]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 00:44:02 user nova-compute[75165]:   <source dev="/dev/sde"/>
Oct 26 00:44:02 user nova-compute[75165]:   <target dev="vdc" bus="virtio"/>
Oct 26 00:44:02 user nova-compute[75165]:   <serial>5f6c7de5-b5d3-4d68-820e-02282b096f79</serial>
Oct 26 00:44:02 user nova-compute[75165]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 26 00:44:02 user nova-compute[75165]: </disk>
Oct 26 00:44:02 user nova-compute[75165]:  {{(pid=75165) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 00:44:02 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-3a715b19-7024-4db8-b2cb-e2fbac2ad081 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Successfully detached device vdc from instance 50c16604-2066-4cd2-a74e-c47a2dc4c449 from the persistent domain config.
Oct 26 00:44:02 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-3a715b19-7024-4db8-b2cb-e2fbac2ad081 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 50c16604-2066-4cd2-a74e-c47a2dc4c449 from the live domain config. {{(pid=75165) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 00:44:02 user nova-compute[75165]: DEBUG nova.virt.libvirt.guest [None req-3a715b19-7024-4db8-b2cb-e2fbac2ad081 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 00:44:02 user nova-compute[75165]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 00:44:02 user nova-compute[75165]:   <source dev="/dev/sde"/>
Oct 26 00:44:02 user nova-compute[75165]:   <target dev="vdc" bus="virtio"/>
Oct 26 00:44:02 user nova-compute[75165]:   <serial>5f6c7de5-b5d3-4d68-820e-02282b096f79</serial>
Oct 26 00:44:02 user nova-compute[75165]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 26 00:44:02 user nova-compute[75165]: </disk>
Oct 26 00:44:02 user nova-compute[75165]:  {{(pid=75165) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 00:44:03 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-3a715b19-7024-4db8-b2cb-e2fbac2ad081 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 50c16604-2066-4cd2-a74e-c47a2dc4c449 {{(pid=75165) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 00:44:04 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:44:04 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:44:04 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75165) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 00:44:04 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75165) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 00:44:04 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75165) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 00:44:04 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:44:05 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-415b3976-d517-4b1b-8624-f007ded118f6 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 7c62961f-e928-4df6-9c4e-74f035dde9a2 is timed out.
Oct 26 00:44:05 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-415b3976-d517-4b1b-8624-f007ded118f6 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Successfully detached device vdb from instance 7c62961f-e928-4df6-9c4e-74f035dde9a2 from the live domain config.
Oct 26 00:44:05 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-415b3976-d517-4b1b-8624-f007ded118f6 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 7c62961f-e928-4df6-9c4e-74f035dde9a2] calling os-brick to detach iSCSI Volume {{(pid=75165) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 00:44:05 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-415b3976-d517-4b1b-8624-f007ded118f6 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8bf8160e50>, {'target_iqn': 'iqn.2010-10.org.openstack:4f64eadd-847c-4116-8015-79e52adfbfd9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QsDWVcJo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:44:05 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-415b3976-d517-4b1b-8624-f007ded118f6 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:44:05 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-415b3976-d517-4b1b-8624-f007ded118f6 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:44:05 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-415b3976-d517-4b1b-8624-f007ded118f6 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:44:05 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:44:05 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:44:05 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[437e64bb-0f89-451f-80a1-b89a87f8d398]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:67c880f5-c46a-4e45-b73a-a052fca3638c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8e97f54a-607f-40f2-ba2a-aa72f53c047e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5f6c7de5-b5d3-4d68-820e-02282b096f79\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4f64eadd-847c-4116-8015-79e52adfbfd9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:44:05 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-415b3976-d517-4b1b-8624-f007ded118f6 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 00:44:05 user nova-compute[75165]: No targets found.
Oct 26 00:44:05 user nova-compute[75165]: iSNS:
Oct 26 00:44:05 user nova-compute[75165]: No targets found.
Oct 26 00:44:05 user nova-compute[75165]: STATIC:
Oct 26 00:44:05 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:67c880f5-c46a-4e45-b73a-a052fca3638c
Oct 26 00:44:05 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:44:05 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:44:05 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:8e97f54a-607f-40f2-ba2a-aa72f53c047e
Oct 26 00:44:05 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:44:05 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:44:05 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:5f6c7de5-b5d3-4d68-820e-02282b096f79
Oct 26 00:44:05 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:44:05 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:44:05 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:4f64eadd-847c-4116-8015-79e52adfbfd9
Oct 26 00:44:05 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:44:05 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:44:05 user nova-compute[75165]: FIRMWARE:
Oct 26 00:44:05 user nova-compute[75165]: No targets found.
Oct 26 00:44:05 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:44:05 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-415b3976-d517-4b1b-8624-f007ded118f6 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 00:44:05 user nova-compute[75165]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 00:44:05 user nova-compute[75165]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75165) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 00:44:05 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-415b3976-d517-4b1b-8624-f007ded118f6 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4f64eadd-847c-4116-8015-79e52adfbfd9', 0)] {{(pid=75165) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 00:44:05 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:44:05 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:44:05 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[6baf4377-eaab-4dea-bf46-2ec9a372ba88]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f64eadd-847c-4116-8015-79e52adfbfd9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f6c7de5-b5d3-4d68-820e-02282b096f79\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:67c880f5-c46a-4e45-b73a-a052fca3638c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8e97f54a-607f-40f2-ba2a-aa72f53c047e\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:44:05 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:44:05 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:44:05 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a094d32-3c29-40a7-9404-b52fec364dd4]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67c880f5-c46a-4e45-b73a-a052fca3638c (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e97f54a-607f-40f2-ba2a-aa72f53c047e (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f64eadd-847c-4116-8015-79e52adfbfd9 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f6c7de5-b5d3-4d68-820e-02282b096f79 (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:44:05 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-415b3976-d517-4b1b-8624-f007ded118f6 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67c880f5-c46a-4e45-b73a-a052fca3638c (non-flash)
Oct 26 00:44:05 user nova-compute[75165]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e97f54a-607f-40f2-ba2a-aa72f53c047e (non-flash)
Oct 26 00:44:05 user nova-compute[75165]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f64eadd-847c-4116-8015-79e52adfbfd9 (non-flash)
Oct 26 00:44:05 user nova-compute[75165]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f6c7de5-b5d3-4d68-820e-02282b096f79 (non-flash)
Oct 26 00:44:05 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:44:05 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-415b3976-d517-4b1b-8624-f007ded118f6 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67c880f5-c46a-4e45-b73a-a052fca3638c (non-flash)
Oct 26 00:44:05 user nova-compute[75165]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e97f54a-607f-40f2-ba2a-aa72f53c047e (non-flash)
Oct 26 00:44:05 user nova-compute[75165]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f64eadd-847c-4116-8015-79e52adfbfd9 (non-flash)
Oct 26 00:44:05 user nova-compute[75165]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f6c7de5-b5d3-4d68-820e-02282b096f79 (non-flash)
Oct 26 00:44:05 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:44:05 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-415b3976-d517-4b1b-8624-f007ded118f6 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8be04b9630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4f64eadd-847c-4116-8015-79e52adfbfd9'): ({'sdd'}, set())}) {{(pid=75165) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 00:44:05 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-415b3976-d517-4b1b-8624-f007ded118f6 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Removing single pathed devices sdd {{(pid=75165) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 00:44:05 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:44:05 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:44:05 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a4a3dcc-9b72-4e69-b8ad-dee1778ecae3]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:44:05 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:44:05 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:44:05 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad238ba4-5530-4a9d-8d0c-7ee4205e7d60]: (4, ('ok\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:44:05 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-415b3976-d517-4b1b-8624-f007ded118f6 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Flushing IO for device /dev/sdd {{(pid=75165) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 00:44:05 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:44:05 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:44:05 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c51f915-c16f-4afd-a76f-ed6d61ce8882]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:44:05 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-415b3976-d517-4b1b-8624-f007ded118f6 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75165) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 00:44:05 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:44:05 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.039s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:44:05 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[7060006d-6193-4149-866f-deec16a4f734]: (4, ('1', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:44:05 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-415b3976-d517-4b1b-8624-f007ded118f6 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75165) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 00:44:05 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-415b3976-d517-4b1b-8624-f007ded118f6 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] SCSI volumes sdd have been removed. {{(pid=75165) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 00:44:05 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-415b3976-d517-4b1b-8624-f007ded118f6 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4f64eadd-847c-4116-8015-79e52adfbfd9')] {{(pid=75165) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 00:44:05 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f64eadd-847c-4116-8015-79e52adfbfd9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:44:05 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f64eadd-847c-4116-8015-79e52adfbfd9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:44:05 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2a84e64-8ca4-4272-90ab-e560a3d65c1e]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:44:05 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-415b3976-d517-4b1b-8624-f007ded118f6 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:44:05 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f64eadd-847c-4116-8015-79e52adfbfd9 -p 172.16.0.220:3260 --logout {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:44:05 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f64eadd-847c-4116-8015-79e52adfbfd9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:44:05 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d4be9f9-49f7-45e7-bd07-02e121a43485]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:4f64eadd-847c-4116-8015-79e52adfbfd9, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:4f64eadd-847c-4116-8015-79e52adfbfd9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:44:05 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-415b3976-d517-4b1b-8624-f007ded118f6 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:4f64eadd-847c-4116-8015-79e52adfbfd9, portal: 172.16.0.220,3260]
Oct 26 00:44:05 user nova-compute[75165]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:4f64eadd-847c-4116-8015-79e52adfbfd9, portal: 172.16.0.220,3260] successful.
Oct 26 00:44:05 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:44:05 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f64eadd-847c-4116-8015-79e52adfbfd9 -p 172.16.0.220:3260 --op delete {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:44:05 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f64eadd-847c-4116-8015-79e52adfbfd9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:44:05 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee18b42e-8cb0-4f26-be62-ac70056fd594]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:44:05 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-415b3976-d517-4b1b-8624-f007ded118f6 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:44:05 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-415b3976-d517-4b1b-8624-f007ded118f6 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.295s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:44:05 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-415b3976-d517-4b1b-8624-f007ded118f6 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] <== disconnect_volume: return (296ms) None {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:44:05 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-415b3976-d517-4b1b-8624-f007ded118f6 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 7c62961f-e928-4df6-9c4e-74f035dde9a2] Disconnected iSCSI Volume {{(pid=75165) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 00:44:06 user nova-compute[75165]: DEBUG nova.objects.instance [None req-415b3976-d517-4b1b-8624-f007ded118f6 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Lazy-loading 'flavor' on Instance uuid 7c62961f-e928-4df6-9c4e-74f035dde9a2 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:44:06 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-415b3976-d517-4b1b-8624-f007ded118f6 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Lock "7c62961f-e928-4df6-9c4e-74f035dde9a2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.753s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:44:08 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-00b0fe87-7905-4930-bd1c-251b0448e53c tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Acquiring lock "539bedc3-f788-4d5e-993b-3b168d027a57" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:44:08 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-00b0fe87-7905-4930-bd1c-251b0448e53c tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Lock "539bedc3-f788-4d5e-993b-3b168d027a57" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:44:08 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-00b0fe87-7905-4930-bd1c-251b0448e53c tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Acquiring lock "539bedc3-f788-4d5e-993b-3b168d027a57-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:44:08 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-00b0fe87-7905-4930-bd1c-251b0448e53c tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Lock "539bedc3-f788-4d5e-993b-3b168d027a57-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:44:08 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-00b0fe87-7905-4930-bd1c-251b0448e53c tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Lock "539bedc3-f788-4d5e-993b-3b168d027a57-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:44:08 user nova-compute[75165]: INFO nova.compute.manager [None req-00b0fe87-7905-4930-bd1c-251b0448e53c tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 539bedc3-f788-4d5e-993b-3b168d027a57] Terminating instance
Oct 26 00:44:08 user nova-compute[75165]: DEBUG nova.compute.manager [None req-00b0fe87-7905-4930-bd1c-251b0448e53c tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 539bedc3-f788-4d5e-993b-3b168d027a57] Start destroying the instance on the hypervisor. {{(pid=75165) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 00:44:08 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:44:08 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:44:08 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:44:09 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:44:09 user nova-compute[75165]: DEBUG nova.compute.manager [req-d9384745-f873-4c0e-bbf0-5f2246fe5353 req-dee81b1b-6b21-43e3-ac00-1249f9ae49c4 service nova] [instance: 539bedc3-f788-4d5e-993b-3b168d027a57] Received event network-vif-unplugged-cf882314-eb1e-4555-b87d-4e010947f66f {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:44:09 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-d9384745-f873-4c0e-bbf0-5f2246fe5353 req-dee81b1b-6b21-43e3-ac00-1249f9ae49c4 service nova] Acquiring lock "539bedc3-f788-4d5e-993b-3b168d027a57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:44:09 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-d9384745-f873-4c0e-bbf0-5f2246fe5353 req-dee81b1b-6b21-43e3-ac00-1249f9ae49c4 service nova] Lock "539bedc3-f788-4d5e-993b-3b168d027a57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:44:09 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-d9384745-f873-4c0e-bbf0-5f2246fe5353 req-dee81b1b-6b21-43e3-ac00-1249f9ae49c4 service nova] Lock "539bedc3-f788-4d5e-993b-3b168d027a57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:44:09 user nova-compute[75165]: DEBUG nova.compute.manager [req-d9384745-f873-4c0e-bbf0-5f2246fe5353 req-dee81b1b-6b21-43e3-ac00-1249f9ae49c4 service nova] [instance: 539bedc3-f788-4d5e-993b-3b168d027a57] No waiting events found dispatching network-vif-unplugged-cf882314-eb1e-4555-b87d-4e010947f66f {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:44:09 user nova-compute[75165]: DEBUG nova.compute.manager [req-d9384745-f873-4c0e-bbf0-5f2246fe5353 req-dee81b1b-6b21-43e3-ac00-1249f9ae49c4 service nova] [instance: 539bedc3-f788-4d5e-993b-3b168d027a57] Received event network-vif-unplugged-cf882314-eb1e-4555-b87d-4e010947f66f for instance with task_state deleting. {{(pid=75165) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 00:44:09 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: 539bedc3-f788-4d5e-993b-3b168d027a57] Instance destroyed successfully.
Oct 26 00:44:09 user nova-compute[75165]: DEBUG nova.objects.instance [None req-00b0fe87-7905-4930-bd1c-251b0448e53c tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Lazy-loading 'resources' on Instance uuid 539bedc3-f788-4d5e-993b-3b168d027a57 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:44:09 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-00b0fe87-7905-4930-bd1c-251b0448e53c tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:39:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-560048754',display_name='tempest-TestVolumeBootPattern-volume-backed-server-560048754',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-560048754',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK3hRO5dmVvdThykFEui8jxYF0sctEmyOEy5r4zhirhW+m1kAsS3Y0CIsOeE/NyKN9RypIuB44JCgaUDx36gQtEOMW4ZS6ZaVz+bBqnF+5FJO6+tz67ZfEJ4NkHjOlu2Pg==',key_name='tempest-keypair-1970846225',keypairs=<?>,launch_index=0,launched_at=2023-10-26T00:39:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d1051405ca054c4bb051fb842a5fb5a0',ramdisk_id='',reservation_id='r-v5nzdxoq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1215567595',owner_user_name='tempest-TestVolumeBootPattern-1215567595-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T00:39:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ae836eab78514cf3894e5e11240ff374',uuid=539bedc3-f788-4d5e-993b-3b168d027a57,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cf882314-eb1e-4555-b87d-4e010947f66f", "address": "fa:16:3e:dc:7e:ca", "network": {"id": "dc50ae7b-d501-461f-aa0b-542514330ae8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1091857056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1051405ca054c4bb051fb842a5fb5a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf882314-eb", "ovs_interfaceid": "cf882314-eb1e-4555-b87d-4e010947f66f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 00:44:09 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-00b0fe87-7905-4930-bd1c-251b0448e53c tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Converting VIF {"id": "cf882314-eb1e-4555-b87d-4e010947f66f", "address": "fa:16:3e:dc:7e:ca", "network": {"id": "dc50ae7b-d501-461f-aa0b-542514330ae8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1091857056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1051405ca054c4bb051fb842a5fb5a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf882314-eb", "ovs_interfaceid": "cf882314-eb1e-4555-b87d-4e010947f66f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:44:09 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-00b0fe87-7905-4930-bd1c-251b0448e53c tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:dc:7e:ca,bridge_name='br-int',has_traffic_filtering=True,id=cf882314-eb1e-4555-b87d-4e010947f66f,network=Network(dc50ae7b-d501-461f-aa0b-542514330ae8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf882314-eb') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:44:09 user nova-compute[75165]: DEBUG os_vif [None req-00b0fe87-7905-4930-bd1c-251b0448e53c tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:dc:7e:ca,bridge_name='br-int',has_traffic_filtering=True,id=cf882314-eb1e-4555-b87d-4e010947f66f,network=Network(dc50ae7b-d501-461f-aa0b-542514330ae8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf882314-eb') {{(pid=75165) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 00:44:09 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:44:09 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcf882314-eb, bridge=br-int, if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:44:09 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:44:09 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:44:09 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:44:09 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b249d9b1-81a2-4623-9f1b-6fe638ab337b) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:44:09 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:44:09 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:44:09 user nova-compute[75165]: INFO os_vif [None req-00b0fe87-7905-4930-bd1c-251b0448e53c tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:dc:7e:ca,bridge_name='br-int',has_traffic_filtering=True,id=cf882314-eb1e-4555-b87d-4e010947f66f,network=Network(dc50ae7b-d501-461f-aa0b-542514330ae8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf882314-eb')
Oct 26 00:44:09 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00b0fe87-7905-4930-bd1c-251b0448e53c tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 539bedc3-f788-4d5e-993b-3b168d027a57] calling os-brick to detach iSCSI Volume {{(pid=75165) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 00:44:09 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-00b0fe87-7905-4930-bd1c-251b0448e53c tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8bf8160e50>, {'target_iqn': 'iqn.2010-10.org.openstack:67c880f5-c46a-4e45-b73a-a052fca3638c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oNvdpCXD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:44:09 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-00b0fe87-7905-4930-bd1c-251b0448e53c tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:44:09 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-00b0fe87-7905-4930-bd1c-251b0448e53c tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:44:09 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-00b0fe87-7905-4930-bd1c-251b0448e53c tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:44:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:44:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:44:09 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[1325da17-6542-42fa-a985-de16dd437896]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:67c880f5-c46a-4e45-b73a-a052fca3638c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8e97f54a-607f-40f2-ba2a-aa72f53c047e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5f6c7de5-b5d3-4d68-820e-02282b096f79\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:44:09 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-00b0fe87-7905-4930-bd1c-251b0448e53c tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 00:44:09 user nova-compute[75165]: No targets found.
Oct 26 00:44:09 user nova-compute[75165]: iSNS:
Oct 26 00:44:09 user nova-compute[75165]: No targets found.
Oct 26 00:44:09 user nova-compute[75165]: STATIC:
Oct 26 00:44:09 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:67c880f5-c46a-4e45-b73a-a052fca3638c
Oct 26 00:44:09 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:44:09 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:44:09 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:8e97f54a-607f-40f2-ba2a-aa72f53c047e
Oct 26 00:44:09 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:44:09 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:44:09 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:5f6c7de5-b5d3-4d68-820e-02282b096f79
Oct 26 00:44:09 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:44:09 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:44:09 user nova-compute[75165]: FIRMWARE:
Oct 26 00:44:09 user nova-compute[75165]: No targets found.
Oct 26 00:44:09 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:44:09 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-00b0fe87-7905-4930-bd1c-251b0448e53c tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 00:44:09 user nova-compute[75165]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 00:44:09 user nova-compute[75165]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75165) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 00:44:09 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-00b0fe87-7905-4930-bd1c-251b0448e53c tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:67c880f5-c46a-4e45-b73a-a052fca3638c', 0)] {{(pid=75165) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 00:44:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:44:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:44:09 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fe3d326-7d4f-4326-9bca-36037e86f996]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f6c7de5-b5d3-4d68-820e-02282b096f79\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:67c880f5-c46a-4e45-b73a-a052fca3638c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8e97f54a-607f-40f2-ba2a-aa72f53c047e\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:44:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:44:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:44:09 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cd82d4f-59ce-49a3-bfa5-471e215d75a8]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67c880f5-c46a-4e45-b73a-a052fca3638c (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e97f54a-607f-40f2-ba2a-aa72f53c047e (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f6c7de5-b5d3-4d68-820e-02282b096f79 (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:44:09 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-00b0fe87-7905-4930-bd1c-251b0448e53c tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67c880f5-c46a-4e45-b73a-a052fca3638c (non-flash)
Oct 26 00:44:09 user nova-compute[75165]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e97f54a-607f-40f2-ba2a-aa72f53c047e (non-flash)
Oct 26 00:44:09 user nova-compute[75165]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f6c7de5-b5d3-4d68-820e-02282b096f79 (non-flash)
Oct 26 00:44:09 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:44:09 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-00b0fe87-7905-4930-bd1c-251b0448e53c tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67c880f5-c46a-4e45-b73a-a052fca3638c (non-flash)
Oct 26 00:44:09 user nova-compute[75165]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e97f54a-607f-40f2-ba2a-aa72f53c047e (non-flash)
Oct 26 00:44:09 user nova-compute[75165]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f6c7de5-b5d3-4d68-820e-02282b096f79 (non-flash)
Oct 26 00:44:09 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:44:09 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-00b0fe87-7905-4930-bd1c-251b0448e53c tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8c0043e050>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:67c880f5-c46a-4e45-b73a-a052fca3638c'): ({'sdb'}, set())}) {{(pid=75165) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 00:44:09 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-00b0fe87-7905-4930-bd1c-251b0448e53c tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Removing single pathed devices sdb {{(pid=75165) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 00:44:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:44:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:44:09 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[557e2e31-9a0d-49c8-813c-cc90bc6f590f]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:44:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:44:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:44:09 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1ac2db3-d21e-4f1d-a222-42d3c4a635ee]: (4, ('ok\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:44:09 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-00b0fe87-7905-4930-bd1c-251b0448e53c tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Flushing IO for device /dev/sdb {{(pid=75165) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 00:44:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:44:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:44:09 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[68ff413b-7155-4c56-8073-fc013d0daded]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:44:09 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-00b0fe87-7905-4930-bd1c-251b0448e53c tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75165) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 00:44:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:44:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.099s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:44:09 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[5596aff5-e9a8-44fb-9cbf-4fc453dea58d]: (4, ('1', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:44:09 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-00b0fe87-7905-4930-bd1c-251b0448e53c tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75165) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 00:44:09 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-00b0fe87-7905-4930-bd1c-251b0448e53c tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] SCSI volumes sdb have been removed. {{(pid=75165) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 00:44:09 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-00b0fe87-7905-4930-bd1c-251b0448e53c tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:67c880f5-c46a-4e45-b73a-a052fca3638c')] {{(pid=75165) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 00:44:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67c880f5-c46a-4e45-b73a-a052fca3638c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:44:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67c880f5-c46a-4e45-b73a-a052fca3638c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:44:09 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[58e240aa-85c3-4784-b11d-47265d217e99]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:44:09 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-00b0fe87-7905-4930-bd1c-251b0448e53c tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:44:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67c880f5-c46a-4e45-b73a-a052fca3638c -p 172.16.0.220:3260 --logout {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:44:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67c880f5-c46a-4e45-b73a-a052fca3638c -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:44:09 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[5275faa6-b986-4a0a-abd7-2cd2d45feebb]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:67c880f5-c46a-4e45-b73a-a052fca3638c, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:67c880f5-c46a-4e45-b73a-a052fca3638c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:44:09 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-00b0fe87-7905-4930-bd1c-251b0448e53c tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:67c880f5-c46a-4e45-b73a-a052fca3638c, portal: 172.16.0.220,3260]
Oct 26 00:44:09 user nova-compute[75165]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:67c880f5-c46a-4e45-b73a-a052fca3638c, portal: 172.16.0.220,3260] successful.
Oct 26 00:44:09 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:44:09 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67c880f5-c46a-4e45-b73a-a052fca3638c -p 172.16.0.220:3260 --op delete {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:44:10 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67c880f5-c46a-4e45-b73a-a052fca3638c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:44:10 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d8f8d69-c49a-4796-a1cf-eea92b50e97e]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:44:10 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-00b0fe87-7905-4930-bd1c-251b0448e53c tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:44:10 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-00b0fe87-7905-4930-bd1c-251b0448e53c tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.362s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:44:10 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-00b0fe87-7905-4930-bd1c-251b0448e53c tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] <== disconnect_volume: return (364ms) None {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:44:10 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00b0fe87-7905-4930-bd1c-251b0448e53c tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 539bedc3-f788-4d5e-993b-3b168d027a57] Disconnected iSCSI Volume {{(pid=75165) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 00:44:10 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-00b0fe87-7905-4930-bd1c-251b0448e53c tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 539bedc3-f788-4d5e-993b-3b168d027a57] Deleting instance files /opt/stack/data/nova/instances/539bedc3-f788-4d5e-993b-3b168d027a57_del
Oct 26 00:44:10 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-00b0fe87-7905-4930-bd1c-251b0448e53c tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 539bedc3-f788-4d5e-993b-3b168d027a57] Deletion of /opt/stack/data/nova/instances/539bedc3-f788-4d5e-993b-3b168d027a57_del complete
Oct 26 00:44:10 user nova-compute[75165]: INFO nova.compute.manager [None req-00b0fe87-7905-4930-bd1c-251b0448e53c tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 539bedc3-f788-4d5e-993b-3b168d027a57] Took 1.22 seconds to destroy the instance on the hypervisor.
Oct 26 00:44:10 user nova-compute[75165]: DEBUG oslo.service.loopingcall [None req-00b0fe87-7905-4930-bd1c-251b0448e53c tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75165) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 00:44:10 user nova-compute[75165]: DEBUG nova.compute.manager [-] [instance: 539bedc3-f788-4d5e-993b-3b168d027a57] Deallocating network for instance {{(pid=75165) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 00:44:10 user nova-compute[75165]: DEBUG nova.network.neutron [-] [instance: 539bedc3-f788-4d5e-993b-3b168d027a57] deallocate_for_instance() {{(pid=75165) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 00:44:10 user nova-compute[75165]: DEBUG nova.network.neutron [-] [instance: 539bedc3-f788-4d5e-993b-3b168d027a57] Updating instance_info_cache with network_info: [] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:44:10 user nova-compute[75165]: INFO nova.compute.manager [-] [instance: 539bedc3-f788-4d5e-993b-3b168d027a57] Took 0.65 seconds to deallocate network for instance.
Oct 26 00:44:10 user nova-compute[75165]: DEBUG nova.compute.manager [req-874f8741-4007-4e7c-ace3-062eeaf1fd86 req-1a548888-b10f-494d-bf97-492bb15eb9dd service nova] [instance: 539bedc3-f788-4d5e-993b-3b168d027a57] Received event network-vif-deleted-cf882314-eb1e-4555-b87d-4e010947f66f {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:44:10 user nova-compute[75165]: INFO nova.compute.manager [req-874f8741-4007-4e7c-ace3-062eeaf1fd86 req-1a548888-b10f-494d-bf97-492bb15eb9dd service nova] [instance: 539bedc3-f788-4d5e-993b-3b168d027a57] Neutron deleted interface cf882314-eb1e-4555-b87d-4e010947f66f; detaching it from the instance and deleting it from the info cache
Oct 26 00:44:10 user nova-compute[75165]: DEBUG nova.network.neutron [req-874f8741-4007-4e7c-ace3-062eeaf1fd86 req-1a548888-b10f-494d-bf97-492bb15eb9dd service nova] [instance: 539bedc3-f788-4d5e-993b-3b168d027a57] Updating instance_info_cache with network_info: [] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:44:10 user nova-compute[75165]: DEBUG nova.compute.manager [req-874f8741-4007-4e7c-ace3-062eeaf1fd86 req-1a548888-b10f-494d-bf97-492bb15eb9dd service nova] [instance: 539bedc3-f788-4d5e-993b-3b168d027a57] Detach interface failed, port_id=cf882314-eb1e-4555-b87d-4e010947f66f, reason: Instance 539bedc3-f788-4d5e-993b-3b168d027a57 could not be found. {{(pid=75165) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 26 00:44:11 user nova-compute[75165]: DEBUG nova.compute.manager [req-0ad9c463-8ff8-476c-9728-8e159ca5edf9 req-9783f86c-9c4a-4122-915c-a647525fbf42 service nova] [instance: 539bedc3-f788-4d5e-993b-3b168d027a57] Received event network-vif-plugged-cf882314-eb1e-4555-b87d-4e010947f66f {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:44:11 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-0ad9c463-8ff8-476c-9728-8e159ca5edf9 req-9783f86c-9c4a-4122-915c-a647525fbf42 service nova] Acquiring lock "539bedc3-f788-4d5e-993b-3b168d027a57-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:44:11 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-0ad9c463-8ff8-476c-9728-8e159ca5edf9 req-9783f86c-9c4a-4122-915c-a647525fbf42 service nova] Lock "539bedc3-f788-4d5e-993b-3b168d027a57-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:44:11 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-0ad9c463-8ff8-476c-9728-8e159ca5edf9 req-9783f86c-9c4a-4122-915c-a647525fbf42 service nova] Lock "539bedc3-f788-4d5e-993b-3b168d027a57-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:44:11 user nova-compute[75165]: DEBUG nova.compute.manager [req-0ad9c463-8ff8-476c-9728-8e159ca5edf9 req-9783f86c-9c4a-4122-915c-a647525fbf42 service nova] [instance: 539bedc3-f788-4d5e-993b-3b168d027a57] No waiting events found dispatching network-vif-plugged-cf882314-eb1e-4555-b87d-4e010947f66f {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:44:11 user nova-compute[75165]: WARNING nova.compute.manager [req-0ad9c463-8ff8-476c-9728-8e159ca5edf9 req-9783f86c-9c4a-4122-915c-a647525fbf42 service nova] [instance: 539bedc3-f788-4d5e-993b-3b168d027a57] Received unexpected event network-vif-plugged-cf882314-eb1e-4555-b87d-4e010947f66f for instance with vm_state active and task_state deleting.
Oct 26 00:44:11 user nova-compute[75165]: INFO nova.compute.manager [None req-00b0fe87-7905-4930-bd1c-251b0448e53c tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 539bedc3-f788-4d5e-993b-3b168d027a57] Took 1.02 seconds to detach 1 volumes for instance.
Oct 26 00:44:11 user nova-compute[75165]: DEBUG nova.compute.manager [None req-00b0fe87-7905-4930-bd1c-251b0448e53c tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 539bedc3-f788-4d5e-993b-3b168d027a57] Deleting volume: 67c880f5-c46a-4e45-b73a-a052fca3638c {{(pid=75165) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 26 00:44:11 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-00b0fe87-7905-4930-bd1c-251b0448e53c tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:44:11 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-00b0fe87-7905-4930-bd1c-251b0448e53c tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:44:11 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-00b0fe87-7905-4930-bd1c-251b0448e53c tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:44:12 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-00b0fe87-7905-4930-bd1c-251b0448e53c tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:44:12 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-00b0fe87-7905-4930-bd1c-251b0448e53c tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.165s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:44:12 user nova-compute[75165]: INFO nova.scheduler.client.report [None req-00b0fe87-7905-4930-bd1c-251b0448e53c tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Deleted allocations for instance 539bedc3-f788-4d5e-993b-3b168d027a57
Oct 26 00:44:12 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-00b0fe87-7905-4930-bd1c-251b0448e53c tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Lock "539bedc3-f788-4d5e-993b-3b168d027a57" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.301s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:44:14 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:44:19 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:44:23 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-3a715b19-7024-4db8-b2cb-e2fbac2ad081 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 50c16604-2066-4cd2-a74e-c47a2dc4c449 is timed out.
Oct 26 00:44:23 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-3a715b19-7024-4db8-b2cb-e2fbac2ad081 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Successfully detached device vdc from instance 50c16604-2066-4cd2-a74e-c47a2dc4c449 from the live domain config.
Oct 26 00:44:23 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a715b19-7024-4db8-b2cb-e2fbac2ad081 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] [instance: 50c16604-2066-4cd2-a74e-c47a2dc4c449] calling os-brick to detach iSCSI Volume {{(pid=75165) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 00:44:23 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a715b19-7024-4db8-b2cb-e2fbac2ad081 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8bf8160e50>, {'target_iqn': 'iqn.2010-10.org.openstack:5f6c7de5-b5d3-4d68-820e-02282b096f79', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dIUvjXQL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:44:23 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-3a715b19-7024-4db8-b2cb-e2fbac2ad081 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:44:23 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-3a715b19-7024-4db8-b2cb-e2fbac2ad081 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:44:23 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-3a715b19-7024-4db8-b2cb-e2fbac2ad081 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:44:23 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:44:23 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:44:23 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0852c13-969b-46a6-ab4c-1103bf1084d4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8e97f54a-607f-40f2-ba2a-aa72f53c047e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5f6c7de5-b5d3-4d68-820e-02282b096f79\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:44:23 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a715b19-7024-4db8-b2cb-e2fbac2ad081 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 00:44:23 user nova-compute[75165]: No targets found.
Oct 26 00:44:23 user nova-compute[75165]: iSNS:
Oct 26 00:44:23 user nova-compute[75165]: No targets found.
Oct 26 00:44:23 user nova-compute[75165]: STATIC:
Oct 26 00:44:23 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:8e97f54a-607f-40f2-ba2a-aa72f53c047e
Oct 26 00:44:23 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:44:23 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:44:23 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:5f6c7de5-b5d3-4d68-820e-02282b096f79
Oct 26 00:44:23 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:44:23 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:44:23 user nova-compute[75165]: FIRMWARE:
Oct 26 00:44:23 user nova-compute[75165]: No targets found.
Oct 26 00:44:23 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:44:23 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a715b19-7024-4db8-b2cb-e2fbac2ad081 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 00:44:23 user nova-compute[75165]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 00:44:23 user nova-compute[75165]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75165) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 00:44:23 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a715b19-7024-4db8-b2cb-e2fbac2ad081 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f6c7de5-b5d3-4d68-820e-02282b096f79', 0)] {{(pid=75165) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 00:44:23 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:44:23 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:44:23 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[df1e4781-01b8-4920-8a43-6aaf8494829b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f6c7de5-b5d3-4d68-820e-02282b096f79\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8e97f54a-607f-40f2-ba2a-aa72f53c047e\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:44:23 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:44:23 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:44:23 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd01917b-4f3c-42f9-9a63-157eeb60d1b6]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e97f54a-607f-40f2-ba2a-aa72f53c047e (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f6c7de5-b5d3-4d68-820e-02282b096f79 (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:44:23 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a715b19-7024-4db8-b2cb-e2fbac2ad081 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e97f54a-607f-40f2-ba2a-aa72f53c047e (non-flash)
Oct 26 00:44:23 user nova-compute[75165]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f6c7de5-b5d3-4d68-820e-02282b096f79 (non-flash)
Oct 26 00:44:23 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:44:23 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a715b19-7024-4db8-b2cb-e2fbac2ad081 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e97f54a-607f-40f2-ba2a-aa72f53c047e (non-flash)
Oct 26 00:44:23 user nova-compute[75165]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f6c7de5-b5d3-4d68-820e-02282b096f79 (non-flash)
Oct 26 00:44:23 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:44:23 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a715b19-7024-4db8-b2cb-e2fbac2ad081 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8c0154d360>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f6c7de5-b5d3-4d68-820e-02282b096f79'): ({'sde'}, set())}) {{(pid=75165) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 00:44:23 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-3a715b19-7024-4db8-b2cb-e2fbac2ad081 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Removing single pathed devices sde {{(pid=75165) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 00:44:23 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:44:23 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:44:23 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e413f3e-2d3f-49d7-86f0-ca4098ada1ee]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:44:23 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:44:23 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:44:23 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d17889f-c70f-4958-b431-06baa29d3cca]: (4, ('ok\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:44:23 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-3a715b19-7024-4db8-b2cb-e2fbac2ad081 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Flushing IO for device /dev/sde {{(pid=75165) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 00:44:23 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:44:23 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:44:23 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[35043cc3-756e-4eff-b61e-ffea858e93fd]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:44:23 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-3a715b19-7024-4db8-b2cb-e2fbac2ad081 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75165) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 00:44:23 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:44:23 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.041s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:44:23 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[be50199e-c654-4da8-bacf-cd00a6a33c96]: (4, ('1', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:44:23 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-3a715b19-7024-4db8-b2cb-e2fbac2ad081 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75165) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 00:44:23 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-3a715b19-7024-4db8-b2cb-e2fbac2ad081 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] SCSI volumes sde have been removed. {{(pid=75165) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 00:44:23 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a715b19-7024-4db8-b2cb-e2fbac2ad081 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f6c7de5-b5d3-4d68-820e-02282b096f79')] {{(pid=75165) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 00:44:23 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f6c7de5-b5d3-4d68-820e-02282b096f79 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:44:23 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f6c7de5-b5d3-4d68-820e-02282b096f79 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:44:23 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[5807d9ec-3a38-4f13-8903-109d6316d380]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:44:23 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a715b19-7024-4db8-b2cb-e2fbac2ad081 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:44:23 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f6c7de5-b5d3-4d68-820e-02282b096f79 -p 172.16.0.220:3260 --logout {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:44:23 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f6c7de5-b5d3-4d68-820e-02282b096f79 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:44:23 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6ed22c3-5462-4006-a472-d98358495037]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:5f6c7de5-b5d3-4d68-820e-02282b096f79, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:5f6c7de5-b5d3-4d68-820e-02282b096f79, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:44:23 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a715b19-7024-4db8-b2cb-e2fbac2ad081 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:5f6c7de5-b5d3-4d68-820e-02282b096f79, portal: 172.16.0.220,3260]
Oct 26 00:44:23 user nova-compute[75165]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:5f6c7de5-b5d3-4d68-820e-02282b096f79, portal: 172.16.0.220,3260] successful.
Oct 26 00:44:23 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:44:23 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f6c7de5-b5d3-4d68-820e-02282b096f79 -p 172.16.0.220:3260 --op delete {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:44:23 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f6c7de5-b5d3-4d68-820e-02282b096f79 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:44:23 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[b350e3ed-a35e-4ff2-b699-6f87adb0b9c5]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:44:23 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a715b19-7024-4db8-b2cb-e2fbac2ad081 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:44:23 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-3a715b19-7024-4db8-b2cb-e2fbac2ad081 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.288s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:44:23 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a715b19-7024-4db8-b2cb-e2fbac2ad081 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] <== disconnect_volume: return (289ms) None {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:44:23 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a715b19-7024-4db8-b2cb-e2fbac2ad081 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] [instance: 50c16604-2066-4cd2-a74e-c47a2dc4c449] Disconnected iSCSI Volume {{(pid=75165) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 00:44:24 user nova-compute[75165]: DEBUG nova.objects.instance [None req-3a715b19-7024-4db8-b2cb-e2fbac2ad081 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Lazy-loading 'flavor' on Instance uuid 50c16604-2066-4cd2-a74e-c47a2dc4c449 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:44:24 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-3a715b19-7024-4db8-b2cb-e2fbac2ad081 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Lock "50c16604-2066-4cd2-a74e-c47a2dc4c449" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.778s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:44:24 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:44:25 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:44:25 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Triggering sync for uuid 7c62961f-e928-4df6-9c4e-74f035dde9a2 {{(pid=75165) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 00:44:25 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Triggering sync for uuid 50c16604-2066-4cd2-a74e-c47a2dc4c449 {{(pid=75165) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 00:44:25 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "7c62961f-e928-4df6-9c4e-74f035dde9a2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:44:25 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "7c62961f-e928-4df6-9c4e-74f035dde9a2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:44:25 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "50c16604-2066-4cd2-a74e-c47a2dc4c449" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:44:25 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "50c16604-2066-4cd2-a74e-c47a2dc4c449" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:44:25 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "50c16604-2066-4cd2-a74e-c47a2dc4c449" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.030s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:44:25 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "7c62961f-e928-4df6-9c4e-74f035dde9a2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.031s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:44:25 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:44:25 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75165) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 00:44:27 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:44:29 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:44:29 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:44:32 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:44:33 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:44:34 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:44:34 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:44:34 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-978747b6-68a8-4e8a-b282-c4d7957152c6 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Acquiring lock "7c62961f-e928-4df6-9c4e-74f035dde9a2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:44:34 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-978747b6-68a8-4e8a-b282-c4d7957152c6 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Lock "7c62961f-e928-4df6-9c4e-74f035dde9a2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:44:34 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-978747b6-68a8-4e8a-b282-c4d7957152c6 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Acquiring lock "7c62961f-e928-4df6-9c4e-74f035dde9a2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:44:34 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-978747b6-68a8-4e8a-b282-c4d7957152c6 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Lock "7c62961f-e928-4df6-9c4e-74f035dde9a2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:44:34 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-978747b6-68a8-4e8a-b282-c4d7957152c6 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Lock "7c62961f-e928-4df6-9c4e-74f035dde9a2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:44:34 user nova-compute[75165]: INFO nova.compute.manager [None req-978747b6-68a8-4e8a-b282-c4d7957152c6 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 7c62961f-e928-4df6-9c4e-74f035dde9a2] Terminating instance
Oct 26 00:44:34 user nova-compute[75165]: DEBUG nova.compute.manager [None req-978747b6-68a8-4e8a-b282-c4d7957152c6 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 7c62961f-e928-4df6-9c4e-74f035dde9a2] Start destroying the instance on the hypervisor. {{(pid=75165) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 00:44:34 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:44:35 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:44:35 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:44:35 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:44:35 user nova-compute[75165]: DEBUG nova.compute.manager [req-e5fc7efc-7229-4c37-9234-d7a3e641b04f req-12639fef-d6a6-47ed-8e00-f561300202c7 service nova] [instance: 7c62961f-e928-4df6-9c4e-74f035dde9a2] Received event network-vif-unplugged-336cfc3b-0045-4c7f-bd85-ce9b9080ff58 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:44:35 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-e5fc7efc-7229-4c37-9234-d7a3e641b04f req-12639fef-d6a6-47ed-8e00-f561300202c7 service nova] Acquiring lock "7c62961f-e928-4df6-9c4e-74f035dde9a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:44:35 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-e5fc7efc-7229-4c37-9234-d7a3e641b04f req-12639fef-d6a6-47ed-8e00-f561300202c7 service nova] Lock "7c62961f-e928-4df6-9c4e-74f035dde9a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:44:35 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-e5fc7efc-7229-4c37-9234-d7a3e641b04f req-12639fef-d6a6-47ed-8e00-f561300202c7 service nova] Lock "7c62961f-e928-4df6-9c4e-74f035dde9a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:44:35 user nova-compute[75165]: DEBUG nova.compute.manager [req-e5fc7efc-7229-4c37-9234-d7a3e641b04f req-12639fef-d6a6-47ed-8e00-f561300202c7 service nova] [instance: 7c62961f-e928-4df6-9c4e-74f035dde9a2] No waiting events found dispatching network-vif-unplugged-336cfc3b-0045-4c7f-bd85-ce9b9080ff58 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:44:35 user nova-compute[75165]: DEBUG nova.compute.manager [req-e5fc7efc-7229-4c37-9234-d7a3e641b04f req-12639fef-d6a6-47ed-8e00-f561300202c7 service nova] [instance: 7c62961f-e928-4df6-9c4e-74f035dde9a2] Received event network-vif-unplugged-336cfc3b-0045-4c7f-bd85-ce9b9080ff58 for instance with task_state deleting. {{(pid=75165) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 00:44:35 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: 7c62961f-e928-4df6-9c4e-74f035dde9a2] Instance destroyed successfully.
Oct 26 00:44:35 user nova-compute[75165]: DEBUG nova.objects.instance [None req-978747b6-68a8-4e8a-b282-c4d7957152c6 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Lazy-loading 'resources' on Instance uuid 7c62961f-e928-4df6-9c4e-74f035dde9a2 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:44:35 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-978747b6-68a8-4e8a-b282-c4d7957152c6 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:41:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1214230028',display_name='tempest-AttachVolumeNegativeTest-server-1214230028',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1214230028',id=45,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJX3/YQeWZdwRzfmlZuMRzqAOKi0BJoDNrMUW3L1QjwQAlbO8W+pAU8qsGUmn1Tqd2Q09ieR6IDVBVI0wPyfCyab3SVHxh9MWVh+xoHx45ws6i8JqacBRhnXyzaa7LDjuQ==',key_name='tempest-keypair-446499808',keypairs=<?>,launch_index=0,launched_at=2023-10-26T00:41:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='62572ce8ae524b55950532fd89729b71',ramdisk_id='',reservation_id='r-uagruh4d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-988376295',owner_user_name='tempest-AttachVolumeNegativeTest-988376295-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T00:41:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='041ebe2732c341129d6813549653cab3',uuid=7c62961f-e928-4df6-9c4e-74f035dde9a2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "336cfc3b-0045-4c7f-bd85-ce9b9080ff58", "address": "fa:16:3e:83:d2:12", "network": {"id": "1801db1c-315e-4bdf-b73b-132a38bf41b8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1254756052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62572ce8ae524b55950532fd89729b71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap336cfc3b-00", "ovs_interfaceid": "336cfc3b-0045-4c7f-bd85-ce9b9080ff58", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 00:44:35 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-978747b6-68a8-4e8a-b282-c4d7957152c6 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Converting VIF {"id": "336cfc3b-0045-4c7f-bd85-ce9b9080ff58", "address": "fa:16:3e:83:d2:12", "network": {"id": "1801db1c-315e-4bdf-b73b-132a38bf41b8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1254756052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62572ce8ae524b55950532fd89729b71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap336cfc3b-00", "ovs_interfaceid": "336cfc3b-0045-4c7f-bd85-ce9b9080ff58", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:44:35 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-978747b6-68a8-4e8a-b282-c4d7957152c6 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:83:d2:12,bridge_name='br-int',has_traffic_filtering=True,id=336cfc3b-0045-4c7f-bd85-ce9b9080ff58,network=Network(1801db1c-315e-4bdf-b73b-132a38bf41b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap336cfc3b-00') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:44:35 user nova-compute[75165]: DEBUG os_vif [None req-978747b6-68a8-4e8a-b282-c4d7957152c6 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:83:d2:12,bridge_name='br-int',has_traffic_filtering=True,id=336cfc3b-0045-4c7f-bd85-ce9b9080ff58,network=Network(1801db1c-315e-4bdf-b73b-132a38bf41b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap336cfc3b-00') {{(pid=75165) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 00:44:35 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:44:35 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap336cfc3b-00, bridge=br-int, if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:44:35 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:44:35 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:44:35 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:44:35 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2ae531d1-ceb1-4cbd-8593-ba604a516a15) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:44:35 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:44:35 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:44:35 user nova-compute[75165]: INFO os_vif [None req-978747b6-68a8-4e8a-b282-c4d7957152c6 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:83:d2:12,bridge_name='br-int',has_traffic_filtering=True,id=336cfc3b-0045-4c7f-bd85-ce9b9080ff58,network=Network(1801db1c-315e-4bdf-b73b-132a38bf41b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap336cfc3b-00')
Oct 26 00:44:35 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-978747b6-68a8-4e8a-b282-c4d7957152c6 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 7c62961f-e928-4df6-9c4e-74f035dde9a2] Deleting instance files /opt/stack/data/nova/instances/7c62961f-e928-4df6-9c4e-74f035dde9a2_del
Oct 26 00:44:35 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-978747b6-68a8-4e8a-b282-c4d7957152c6 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 7c62961f-e928-4df6-9c4e-74f035dde9a2] Deletion of /opt/stack/data/nova/instances/7c62961f-e928-4df6-9c4e-74f035dde9a2_del complete
Oct 26 00:44:35 user nova-compute[75165]: INFO nova.compute.manager [None req-978747b6-68a8-4e8a-b282-c4d7957152c6 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 7c62961f-e928-4df6-9c4e-74f035dde9a2] Took 0.83 seconds to destroy the instance on the hypervisor.
Oct 26 00:44:35 user nova-compute[75165]: DEBUG oslo.service.loopingcall [None req-978747b6-68a8-4e8a-b282-c4d7957152c6 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75165) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 00:44:35 user nova-compute[75165]: DEBUG nova.compute.manager [-] [instance: 7c62961f-e928-4df6-9c4e-74f035dde9a2] Deallocating network for instance {{(pid=75165) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 00:44:35 user nova-compute[75165]: DEBUG nova.network.neutron [-] [instance: 7c62961f-e928-4df6-9c4e-74f035dde9a2] deallocate_for_instance() {{(pid=75165) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 00:44:35 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:44:35 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Starting heal instance info cache {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 00:44:35 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: 7c62961f-e928-4df6-9c4e-74f035dde9a2] Skipping network cache update for instance because it is being deleted. {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9970}}
Oct 26 00:44:35 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "refresh_cache-50c16604-2066-4cd2-a74e-c47a2dc4c449" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:44:35 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquired lock "refresh_cache-50c16604-2066-4cd2-a74e-c47a2dc4c449" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:44:35 user nova-compute[75165]: DEBUG nova.network.neutron [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: 50c16604-2066-4cd2-a74e-c47a2dc4c449] Forcefully refreshing network info cache for instance {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 00:44:36 user nova-compute[75165]: DEBUG nova.network.neutron [-] [instance: 7c62961f-e928-4df6-9c4e-74f035dde9a2] Updating instance_info_cache with network_info: [] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:44:36 user nova-compute[75165]: DEBUG nova.network.neutron [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: 50c16604-2066-4cd2-a74e-c47a2dc4c449] Updating instance_info_cache with network_info: [{"id": "78fd9337-1104-4248-9500-e9be75713371", "address": "fa:16:3e:b3:14:9a", "network": {"id": "0fc59e9a-15a6-41b6-aee1-f8d958b92246", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1263090607-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b40f07ee85b4c55b1725a43a8ee718d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78fd9337-11", "ovs_interfaceid": "78fd9337-1104-4248-9500-e9be75713371", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:44:36 user nova-compute[75165]: INFO nova.compute.manager [-] [instance: 7c62961f-e928-4df6-9c4e-74f035dde9a2] Took 0.85 seconds to deallocate network for instance.
Oct 26 00:44:36 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Releasing lock "refresh_cache-50c16604-2066-4cd2-a74e-c47a2dc4c449" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:44:36 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: 50c16604-2066-4cd2-a74e-c47a2dc4c449] Updated the network info_cache for instance {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 00:44:36 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-978747b6-68a8-4e8a-b282-c4d7957152c6 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:44:36 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-978747b6-68a8-4e8a-b282-c4d7957152c6 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:44:36 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-978747b6-68a8-4e8a-b282-c4d7957152c6 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:44:36 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-978747b6-68a8-4e8a-b282-c4d7957152c6 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:44:36 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-978747b6-68a8-4e8a-b282-c4d7957152c6 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.165s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:44:36 user nova-compute[75165]: INFO nova.scheduler.client.report [None req-978747b6-68a8-4e8a-b282-c4d7957152c6 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Deleted allocations for instance 7c62961f-e928-4df6-9c4e-74f035dde9a2
Oct 26 00:44:36 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-978747b6-68a8-4e8a-b282-c4d7957152c6 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Lock "7c62961f-e928-4df6-9c4e-74f035dde9a2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.038s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:44:37 user nova-compute[75165]: DEBUG nova.compute.manager [req-8918e75c-882f-4758-91ba-331f299c1991 req-ce8c540f-7286-4731-8c84-dea7ac1967a1 service nova] [instance: 7c62961f-e928-4df6-9c4e-74f035dde9a2] Received event network-vif-plugged-336cfc3b-0045-4c7f-bd85-ce9b9080ff58 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:44:37 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-8918e75c-882f-4758-91ba-331f299c1991 req-ce8c540f-7286-4731-8c84-dea7ac1967a1 service nova] Acquiring lock "7c62961f-e928-4df6-9c4e-74f035dde9a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:44:37 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-8918e75c-882f-4758-91ba-331f299c1991 req-ce8c540f-7286-4731-8c84-dea7ac1967a1 service nova] Lock "7c62961f-e928-4df6-9c4e-74f035dde9a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:44:37 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-8918e75c-882f-4758-91ba-331f299c1991 req-ce8c540f-7286-4731-8c84-dea7ac1967a1 service nova] Lock "7c62961f-e928-4df6-9c4e-74f035dde9a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:44:37 user nova-compute[75165]: DEBUG nova.compute.manager [req-8918e75c-882f-4758-91ba-331f299c1991 req-ce8c540f-7286-4731-8c84-dea7ac1967a1 service nova] [instance: 7c62961f-e928-4df6-9c4e-74f035dde9a2] No waiting events found dispatching network-vif-plugged-336cfc3b-0045-4c7f-bd85-ce9b9080ff58 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:44:37 user nova-compute[75165]: WARNING nova.compute.manager [req-8918e75c-882f-4758-91ba-331f299c1991 req-ce8c540f-7286-4731-8c84-dea7ac1967a1 service nova] [instance: 7c62961f-e928-4df6-9c4e-74f035dde9a2] Received unexpected event network-vif-plugged-336cfc3b-0045-4c7f-bd85-ce9b9080ff58 for instance with vm_state deleted and task_state None.
Oct 26 00:44:37 user nova-compute[75165]: DEBUG nova.compute.manager [req-8918e75c-882f-4758-91ba-331f299c1991 req-ce8c540f-7286-4731-8c84-dea7ac1967a1 service nova] [instance: 7c62961f-e928-4df6-9c4e-74f035dde9a2] Received event network-vif-deleted-336cfc3b-0045-4c7f-bd85-ce9b9080ff58 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:44:37 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:44:37 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:44:37 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:44:37 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:44:37 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75165) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 00:44:37 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c16604-2066-4cd2-a74e-c47a2dc4c449/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:44:38 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c16604-2066-4cd2-a74e-c47a2dc4c449/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:44:38 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c16604-2066-4cd2-a74e-c47a2dc4c449/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:44:38 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c16604-2066-4cd2-a74e-c47a2dc4c449/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:44:38 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75165) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 00:44:38 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:44:38 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:44:38 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Hypervisor/Node resource view: name=user free_ram=8952MB free_disk=24.828720092773438GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75165) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 00:44:38 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:44:38 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:44:38 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 50c16604-2066-4cd2-a74e-c47a2dc4c449 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:44:38 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75165) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 00:44:38 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75165) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 00:44:39 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:44:39 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:44:39 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Compute_service record updated for user:user {{(pid=75165) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 00:44:39 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.392s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:44:40 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:44:42 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:44:45 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:44:50 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:44:53 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-a9549127-4d83-492f-bb29-556d6a1be5d6 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Acquiring lock "50c16604-2066-4cd2-a74e-c47a2dc4c449" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:44:53 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-a9549127-4d83-492f-bb29-556d6a1be5d6 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Lock "50c16604-2066-4cd2-a74e-c47a2dc4c449" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:44:53 user nova-compute[75165]: INFO nova.compute.manager [None req-a9549127-4d83-492f-bb29-556d6a1be5d6 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] [instance: 50c16604-2066-4cd2-a74e-c47a2dc4c449] Detaching volume 8e97f54a-607f-40f2-ba2a-aa72f53c047e
Oct 26 00:44:53 user nova-compute[75165]: INFO nova.virt.block_device [None req-a9549127-4d83-492f-bb29-556d6a1be5d6 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] [instance: 50c16604-2066-4cd2-a74e-c47a2dc4c449] Attempting to driver detach volume 8e97f54a-607f-40f2-ba2a-aa72f53c047e from mountpoint /dev/vdb
Oct 26 00:44:53 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-a9549127-4d83-492f-bb29-556d6a1be5d6 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Attempting to detach device vdb from instance 50c16604-2066-4cd2-a74e-c47a2dc4c449 from the persistent domain config. {{(pid=75165) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 00:44:53 user nova-compute[75165]: DEBUG nova.virt.libvirt.guest [None req-a9549127-4d83-492f-bb29-556d6a1be5d6 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 00:44:53 user nova-compute[75165]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 00:44:53 user nova-compute[75165]:   <source dev="/dev/sdc"/>
Oct 26 00:44:53 user nova-compute[75165]:   <target dev="vdb" bus="virtio"/>
Oct 26 00:44:53 user nova-compute[75165]:   <serial>8e97f54a-607f-40f2-ba2a-aa72f53c047e</serial>
Oct 26 00:44:53 user nova-compute[75165]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 00:44:53 user nova-compute[75165]: </disk>
Oct 26 00:44:53 user nova-compute[75165]:  {{(pid=75165) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 00:44:53 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-a9549127-4d83-492f-bb29-556d6a1be5d6 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Successfully detached device vdb from instance 50c16604-2066-4cd2-a74e-c47a2dc4c449 from the persistent domain config.
Oct 26 00:44:53 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-a9549127-4d83-492f-bb29-556d6a1be5d6 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 50c16604-2066-4cd2-a74e-c47a2dc4c449 from the live domain config. {{(pid=75165) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 00:44:53 user nova-compute[75165]: DEBUG nova.virt.libvirt.guest [None req-a9549127-4d83-492f-bb29-556d6a1be5d6 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 00:44:53 user nova-compute[75165]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 00:44:53 user nova-compute[75165]:   <source dev="/dev/sdc"/>
Oct 26 00:44:53 user nova-compute[75165]:   <target dev="vdb" bus="virtio"/>
Oct 26 00:44:53 user nova-compute[75165]:   <serial>8e97f54a-607f-40f2-ba2a-aa72f53c047e</serial>
Oct 26 00:44:53 user nova-compute[75165]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 00:44:53 user nova-compute[75165]: </disk>
Oct 26 00:44:53 user nova-compute[75165]:  {{(pid=75165) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 00:44:54 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-a9549127-4d83-492f-bb29-556d6a1be5d6 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 50c16604-2066-4cd2-a74e-c47a2dc4c449 {{(pid=75165) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 00:44:55 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:44:59 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:45:00 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:45:05 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:45:10 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:45:14 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-a9549127-4d83-492f-bb29-556d6a1be5d6 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 50c16604-2066-4cd2-a74e-c47a2dc4c449 is timed out.
Oct 26 00:45:14 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-a9549127-4d83-492f-bb29-556d6a1be5d6 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Successfully detached device vdb from instance 50c16604-2066-4cd2-a74e-c47a2dc4c449 from the live domain config.
Oct 26 00:45:14 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a9549127-4d83-492f-bb29-556d6a1be5d6 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] [instance: 50c16604-2066-4cd2-a74e-c47a2dc4c449] calling os-brick to detach iSCSI Volume {{(pid=75165) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 00:45:14 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9549127-4d83-492f-bb29-556d6a1be5d6 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8bf8160e50>, {'target_iqn': 'iqn.2010-10.org.openstack:8e97f54a-607f-40f2-ba2a-aa72f53c047e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WvIkgSKd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:45:14 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-a9549127-4d83-492f-bb29-556d6a1be5d6 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:45:14 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-a9549127-4d83-492f-bb29-556d6a1be5d6 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:45:14 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-a9549127-4d83-492f-bb29-556d6a1be5d6 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:45:14 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:45:14 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:45:14 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddebb96b-8862-41c9-8665-e41615ef3d1c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8e97f54a-607f-40f2-ba2a-aa72f53c047e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:45:14 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9549127-4d83-492f-bb29-556d6a1be5d6 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 00:45:14 user nova-compute[75165]: No targets found.
Oct 26 00:45:14 user nova-compute[75165]: iSNS:
Oct 26 00:45:14 user nova-compute[75165]: No targets found.
Oct 26 00:45:14 user nova-compute[75165]: STATIC:
Oct 26 00:45:14 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:8e97f54a-607f-40f2-ba2a-aa72f53c047e
Oct 26 00:45:14 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:45:14 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:45:14 user nova-compute[75165]: FIRMWARE:
Oct 26 00:45:14 user nova-compute[75165]: No targets found.
Oct 26 00:45:14 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:45:14 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9549127-4d83-492f-bb29-556d6a1be5d6 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 00:45:14 user nova-compute[75165]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 00:45:14 user nova-compute[75165]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75165) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 00:45:14 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9549127-4d83-492f-bb29-556d6a1be5d6 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8e97f54a-607f-40f2-ba2a-aa72f53c047e', 0)] {{(pid=75165) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 00:45:14 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:45:14 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:45:14 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b3c9cbd-d38f-4edc-baf8-efed6838073f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8e97f54a-607f-40f2-ba2a-aa72f53c047e\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:45:14 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:45:14 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:45:14 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdb55dd2-c0da-4355-9f98-b477d7dd764e]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e97f54a-607f-40f2-ba2a-aa72f53c047e (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:45:14 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9549127-4d83-492f-bb29-556d6a1be5d6 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e97f54a-607f-40f2-ba2a-aa72f53c047e (non-flash)
Oct 26 00:45:14 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:45:14 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9549127-4d83-492f-bb29-556d6a1be5d6 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e97f54a-607f-40f2-ba2a-aa72f53c047e (non-flash)
Oct 26 00:45:14 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:45:14 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9549127-4d83-492f-bb29-556d6a1be5d6 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8be04cacb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8e97f54a-607f-40f2-ba2a-aa72f53c047e'): ({'sdc'}, set())}) {{(pid=75165) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 00:45:14 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-a9549127-4d83-492f-bb29-556d6a1be5d6 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Removing single pathed devices sdc {{(pid=75165) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 00:45:14 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:45:14 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:45:14 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2787859-05f4-4f6f-93ff-af85a5459f84]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:45:14 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:45:14 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:45:14 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1ada3a1-b34e-4958-a5ce-fee09a2d82b3]: (4, ('ok\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:45:14 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-a9549127-4d83-492f-bb29-556d6a1be5d6 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Flushing IO for device /dev/sdc {{(pid=75165) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 00:45:14 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:45:14 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.023s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:45:14 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2e887dc-7bec-4b82-98a7-603617bad91a]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:45:14 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-a9549127-4d83-492f-bb29-556d6a1be5d6 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75165) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 00:45:14 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:45:14 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.039s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:45:14 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb4becf7-aadf-4a98-9b24-f7a8c90919f5]: (4, ('1', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:45:14 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-a9549127-4d83-492f-bb29-556d6a1be5d6 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75165) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 00:45:14 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-a9549127-4d83-492f-bb29-556d6a1be5d6 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] SCSI volumes sdc have been removed. {{(pid=75165) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 00:45:14 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9549127-4d83-492f-bb29-556d6a1be5d6 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8e97f54a-607f-40f2-ba2a-aa72f53c047e')] {{(pid=75165) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 00:45:14 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e97f54a-607f-40f2-ba2a-aa72f53c047e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:45:14 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e97f54a-607f-40f2-ba2a-aa72f53c047e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:45:14 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ffb2ba0-3172-43c9-9a78-d1483ab88c00]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:45:14 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9549127-4d83-492f-bb29-556d6a1be5d6 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:45:14 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e97f54a-607f-40f2-ba2a-aa72f53c047e -p 172.16.0.220:3260 --logout {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:45:14 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e97f54a-607f-40f2-ba2a-aa72f53c047e -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:45:14 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[845da348-ec5e-4460-8bc2-0951c0731e0b]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:8e97f54a-607f-40f2-ba2a-aa72f53c047e, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:8e97f54a-607f-40f2-ba2a-aa72f53c047e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:45:14 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9549127-4d83-492f-bb29-556d6a1be5d6 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:8e97f54a-607f-40f2-ba2a-aa72f53c047e, portal: 172.16.0.220,3260]
Oct 26 00:45:14 user nova-compute[75165]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:8e97f54a-607f-40f2-ba2a-aa72f53c047e, portal: 172.16.0.220,3260] successful.
Oct 26 00:45:14 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:45:14 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e97f54a-607f-40f2-ba2a-aa72f53c047e -p 172.16.0.220:3260 --op delete {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:45:14 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e97f54a-607f-40f2-ba2a-aa72f53c047e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:45:14 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[c764b48c-f76c-47b2-a1be-0b63ac172266]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:45:14 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9549127-4d83-492f-bb29-556d6a1be5d6 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:45:14 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-a9549127-4d83-492f-bb29-556d6a1be5d6 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:45:14 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9549127-4d83-492f-bb29-556d6a1be5d6 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] <== disconnect_volume: return (303ms) None {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:45:14 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a9549127-4d83-492f-bb29-556d6a1be5d6 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] [instance: 50c16604-2066-4cd2-a74e-c47a2dc4c449] Disconnected iSCSI Volume {{(pid=75165) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 00:45:15 user nova-compute[75165]: DEBUG nova.objects.instance [None req-a9549127-4d83-492f-bb29-556d6a1be5d6 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Lazy-loading 'flavor' on Instance uuid 50c16604-2066-4cd2-a74e-c47a2dc4c449 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:45:15 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-a9549127-4d83-492f-bb29-556d6a1be5d6 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Lock "50c16604-2066-4cd2-a74e-c47a2dc4c449" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.884s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:45:15 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:45:15 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:45:15 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75165) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 00:45:15 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75165) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 00:45:15 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75165) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 00:45:15 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:45:18 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-ae5b6e25-63b1-46ce-a65d-c14e83ebfff1 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Acquiring lock "b084f728-b8c4-4c9e-a856-18312012c110" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:45:18 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-ae5b6e25-63b1-46ce-a65d-c14e83ebfff1 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Lock "b084f728-b8c4-4c9e-a856-18312012c110" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:45:18 user nova-compute[75165]: DEBUG nova.compute.manager [None req-ae5b6e25-63b1-46ce-a65d-c14e83ebfff1 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: b084f728-b8c4-4c9e-a856-18312012c110] Starting instance... {{(pid=75165) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 00:45:18 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-ae5b6e25-63b1-46ce-a65d-c14e83ebfff1 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:45:18 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-ae5b6e25-63b1-46ce-a65d-c14e83ebfff1 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:45:18 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-ae5b6e25-63b1-46ce-a65d-c14e83ebfff1 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75165) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 00:45:18 user nova-compute[75165]: INFO nova.compute.claims [None req-ae5b6e25-63b1-46ce-a65d-c14e83ebfff1 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: b084f728-b8c4-4c9e-a856-18312012c110] Claim successful on node user
Oct 26 00:45:18 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-ae5b6e25-63b1-46ce-a65d-c14e83ebfff1 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:45:18 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-ae5b6e25-63b1-46ce-a65d-c14e83ebfff1 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:45:18 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-ae5b6e25-63b1-46ce-a65d-c14e83ebfff1 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.223s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:45:18 user nova-compute[75165]: DEBUG nova.compute.manager [None req-ae5b6e25-63b1-46ce-a65d-c14e83ebfff1 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: b084f728-b8c4-4c9e-a856-18312012c110] Start building networks asynchronously for instance. {{(pid=75165) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 00:45:18 user nova-compute[75165]: DEBUG nova.compute.manager [None req-ae5b6e25-63b1-46ce-a65d-c14e83ebfff1 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: b084f728-b8c4-4c9e-a856-18312012c110] Allocating IP information in the background. {{(pid=75165) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 00:45:18 user nova-compute[75165]: DEBUG nova.network.neutron [None req-ae5b6e25-63b1-46ce-a65d-c14e83ebfff1 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: b084f728-b8c4-4c9e-a856-18312012c110] allocate_for_instance() {{(pid=75165) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 00:45:18 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-ae5b6e25-63b1-46ce-a65d-c14e83ebfff1 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: b084f728-b8c4-4c9e-a856-18312012c110] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 00:45:18 user nova-compute[75165]: DEBUG nova.compute.manager [None req-ae5b6e25-63b1-46ce-a65d-c14e83ebfff1 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: b084f728-b8c4-4c9e-a856-18312012c110] Start building block device mappings for instance. {{(pid=75165) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 00:45:18 user nova-compute[75165]: INFO nova.virt.block_device [None req-ae5b6e25-63b1-46ce-a65d-c14e83ebfff1 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: b084f728-b8c4-4c9e-a856-18312012c110] Booting with volume 28483cbc-41a9-4961-9c30-fae820d1ad43 at /dev/vda
Oct 26 00:45:18 user nova-compute[75165]: DEBUG nova.policy [None req-ae5b6e25-63b1-46ce-a65d-c14e83ebfff1 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ae836eab78514cf3894e5e11240ff374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1051405ca054c4bb051fb842a5fb5a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75165) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 00:45:18 user nova-compute[75165]: DEBUG os_brick.utils [None req-ae5b6e25-63b1-46ce-a65d-c14e83ebfff1 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:45:18 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:45:18 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:45:18 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[50091c8a-f69d-4e7d-a526-91b47842ed36]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa94814ccb35\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:45:18 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:45:18 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:45:18 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[784842b2-8773-4b47-91ec-34347577b1a8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:45:18 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:45:18 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:45:18 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7f342c1-93f0-4c9d-b289-617c2110910e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:45:18 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[e780d2ff-8078-4142-8b97-4a1407c70410]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:45:18 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-ae5b6e25-63b1-46ce-a65d-c14e83ebfff1 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Running cmd (subprocess): nvme version {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:45:18 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-ae5b6e25-63b1-46ce-a65d-c14e83ebfff1 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] 'nvme version' failed. Not Retrying. {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 00:45:18 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ae5b6e25-63b1-46ce-a65d-c14e83ebfff1 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] nvme not present on system {{(pid=75165) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 00:45:18 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:45:18 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 00:45:18 user nova-compute[75165]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 00:45:18 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddef2e85-6140-4f03-880d-19e989e58999]: (4, '') {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:45:18 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-ae5b6e25-63b1-46ce-a65d-c14e83ebfff1 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75165) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 00:45:18 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-ae5b6e25-63b1-46ce-a65d-c14e83ebfff1 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75165) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 00:45:18 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-ae5b6e25-63b1-46ce-a65d-c14e83ebfff1 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] LIGHTOS: no hostnqn found. {{(pid=75165) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 00:45:18 user nova-compute[75165]: DEBUG os_brick.utils [None req-ae5b6e25-63b1-46ce-a65d-c14e83ebfff1 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa94814ccb35', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:45:18 user nova-compute[75165]: DEBUG nova.virt.block_device [None req-ae5b6e25-63b1-46ce-a65d-c14e83ebfff1 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: b084f728-b8c4-4c9e-a856-18312012c110] Updating existing volume attachment record: 26726163-9410-48a3-8637-be5c06b49e5c {{(pid=75165) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 00:45:19 user nova-compute[75165]: DEBUG nova.network.neutron [None req-ae5b6e25-63b1-46ce-a65d-c14e83ebfff1 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: b084f728-b8c4-4c9e-a856-18312012c110] Successfully created port: 3b4b4194-dc5f-486c-83fd-93f7c0727fca {{(pid=75165) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 00:45:19 user nova-compute[75165]: DEBUG nova.network.neutron [None req-ae5b6e25-63b1-46ce-a65d-c14e83ebfff1 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: b084f728-b8c4-4c9e-a856-18312012c110] Successfully updated port: 3b4b4194-dc5f-486c-83fd-93f7c0727fca {{(pid=75165) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 00:45:19 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-ae5b6e25-63b1-46ce-a65d-c14e83ebfff1 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Acquiring lock "refresh_cache-b084f728-b8c4-4c9e-a856-18312012c110" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:45:19 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-ae5b6e25-63b1-46ce-a65d-c14e83ebfff1 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Acquired lock "refresh_cache-b084f728-b8c4-4c9e-a856-18312012c110" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:45:19 user nova-compute[75165]: DEBUG nova.network.neutron [None req-ae5b6e25-63b1-46ce-a65d-c14e83ebfff1 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: b084f728-b8c4-4c9e-a856-18312012c110] Building network info cache for instance {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 00:45:19 user nova-compute[75165]: DEBUG nova.network.neutron [None req-ae5b6e25-63b1-46ce-a65d-c14e83ebfff1 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: b084f728-b8c4-4c9e-a856-18312012c110] Instance cache missing network info. {{(pid=75165) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 00:45:19 user nova-compute[75165]: DEBUG nova.compute.manager [req-399b52aa-b90b-470e-8169-acec7e27c56f req-de8bb3d3-28df-4120-a62a-b078a9730749 service nova] [instance: b084f728-b8c4-4c9e-a856-18312012c110] Received event network-changed-3b4b4194-dc5f-486c-83fd-93f7c0727fca {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:45:19 user nova-compute[75165]: DEBUG nova.compute.manager [req-399b52aa-b90b-470e-8169-acec7e27c56f req-de8bb3d3-28df-4120-a62a-b078a9730749 service nova] [instance: b084f728-b8c4-4c9e-a856-18312012c110] Refreshing instance network info cache due to event network-changed-3b4b4194-dc5f-486c-83fd-93f7c0727fca. {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 00:45:19 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-399b52aa-b90b-470e-8169-acec7e27c56f req-de8bb3d3-28df-4120-a62a-b078a9730749 service nova] Acquiring lock "refresh_cache-b084f728-b8c4-4c9e-a856-18312012c110" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:45:20 user nova-compute[75165]: DEBUG nova.network.neutron [None req-ae5b6e25-63b1-46ce-a65d-c14e83ebfff1 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: b084f728-b8c4-4c9e-a856-18312012c110] Updating instance_info_cache with network_info: [{"id": "3b4b4194-dc5f-486c-83fd-93f7c0727fca", "address": "fa:16:3e:22:f3:aa", "network": {"id": "dc50ae7b-d501-461f-aa0b-542514330ae8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1091857056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1051405ca054c4bb051fb842a5fb5a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b4b4194-dc", "ovs_interfaceid": "3b4b4194-dc5f-486c-83fd-93f7c0727fca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:45:20 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-ae5b6e25-63b1-46ce-a65d-c14e83ebfff1 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Releasing lock "refresh_cache-b084f728-b8c4-4c9e-a856-18312012c110" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:45:20 user nova-compute[75165]: DEBUG nova.compute.manager [None req-ae5b6e25-63b1-46ce-a65d-c14e83ebfff1 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: b084f728-b8c4-4c9e-a856-18312012c110] Instance network_info: |[{"id": "3b4b4194-dc5f-486c-83fd-93f7c0727fca", "address": "fa:16:3e:22:f3:aa", "network": {"id": "dc50ae7b-d501-461f-aa0b-542514330ae8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1091857056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1051405ca054c4bb051fb842a5fb5a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b4b4194-dc", "ovs_interfaceid": "3b4b4194-dc5f-486c-83fd-93f7c0727fca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75165) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 00:45:20 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-399b52aa-b90b-470e-8169-acec7e27c56f req-de8bb3d3-28df-4120-a62a-b078a9730749 service nova] Acquired lock "refresh_cache-b084f728-b8c4-4c9e-a856-18312012c110" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:45:20 user nova-compute[75165]: DEBUG nova.network.neutron [req-399b52aa-b90b-470e-8169-acec7e27c56f req-de8bb3d3-28df-4120-a62a-b078a9730749 service nova] [instance: b084f728-b8c4-4c9e-a856-18312012c110] Refreshing network info cache for port 3b4b4194-dc5f-486c-83fd-93f7c0727fca {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 00:45:20 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:45:20 user nova-compute[75165]: DEBUG nova.network.neutron [req-399b52aa-b90b-470e-8169-acec7e27c56f req-de8bb3d3-28df-4120-a62a-b078a9730749 service nova] [instance: b084f728-b8c4-4c9e-a856-18312012c110] Updated VIF entry in instance network info cache for port 3b4b4194-dc5f-486c-83fd-93f7c0727fca. {{(pid=75165) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 00:45:20 user nova-compute[75165]: DEBUG nova.network.neutron [req-399b52aa-b90b-470e-8169-acec7e27c56f req-de8bb3d3-28df-4120-a62a-b078a9730749 service nova] [instance: b084f728-b8c4-4c9e-a856-18312012c110] Updating instance_info_cache with network_info: [{"id": "3b4b4194-dc5f-486c-83fd-93f7c0727fca", "address": "fa:16:3e:22:f3:aa", "network": {"id": "dc50ae7b-d501-461f-aa0b-542514330ae8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1091857056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1051405ca054c4bb051fb842a5fb5a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b4b4194-dc", "ovs_interfaceid": "3b4b4194-dc5f-486c-83fd-93f7c0727fca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:45:20 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-399b52aa-b90b-470e-8169-acec7e27c56f req-de8bb3d3-28df-4120-a62a-b078a9730749 service nova] Releasing lock "refresh_cache-b084f728-b8c4-4c9e-a856-18312012c110" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:45:25 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:45:25 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:45:25 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75165) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 00:45:28 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-70d72d5d-4def-4acd-beea-1a24879fb632 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Acquiring lock "624db3ad-20f2-4302-8fec-b77a5b8ebc39" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:45:28 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-70d72d5d-4def-4acd-beea-1a24879fb632 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Lock "624db3ad-20f2-4302-8fec-b77a5b8ebc39" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:45:28 user nova-compute[75165]: DEBUG nova.compute.manager [None req-70d72d5d-4def-4acd-beea-1a24879fb632 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 624db3ad-20f2-4302-8fec-b77a5b8ebc39] Starting instance... {{(pid=75165) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 00:45:28 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-70d72d5d-4def-4acd-beea-1a24879fb632 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:45:28 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-70d72d5d-4def-4acd-beea-1a24879fb632 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:45:28 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-70d72d5d-4def-4acd-beea-1a24879fb632 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75165) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 00:45:28 user nova-compute[75165]: INFO nova.compute.claims [None req-70d72d5d-4def-4acd-beea-1a24879fb632 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 624db3ad-20f2-4302-8fec-b77a5b8ebc39] Claim successful on node user
Oct 26 00:45:28 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:45:28 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-70d72d5d-4def-4acd-beea-1a24879fb632 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:45:28 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-70d72d5d-4def-4acd-beea-1a24879fb632 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:45:28 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-70d72d5d-4def-4acd-beea-1a24879fb632 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.263s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:45:28 user nova-compute[75165]: DEBUG nova.compute.manager [None req-70d72d5d-4def-4acd-beea-1a24879fb632 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 624db3ad-20f2-4302-8fec-b77a5b8ebc39] Start building networks asynchronously for instance. {{(pid=75165) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 00:45:28 user nova-compute[75165]: DEBUG nova.compute.manager [None req-70d72d5d-4def-4acd-beea-1a24879fb632 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 624db3ad-20f2-4302-8fec-b77a5b8ebc39] Allocating IP information in the background. {{(pid=75165) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 00:45:28 user nova-compute[75165]: DEBUG nova.network.neutron [None req-70d72d5d-4def-4acd-beea-1a24879fb632 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 624db3ad-20f2-4302-8fec-b77a5b8ebc39] allocate_for_instance() {{(pid=75165) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 00:45:28 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-70d72d5d-4def-4acd-beea-1a24879fb632 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 624db3ad-20f2-4302-8fec-b77a5b8ebc39] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 00:45:29 user nova-compute[75165]: DEBUG nova.compute.manager [None req-70d72d5d-4def-4acd-beea-1a24879fb632 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 624db3ad-20f2-4302-8fec-b77a5b8ebc39] Start building block device mappings for instance. {{(pid=75165) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 00:45:29 user nova-compute[75165]: DEBUG nova.policy [None req-70d72d5d-4def-4acd-beea-1a24879fb632 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '041ebe2732c341129d6813549653cab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62572ce8ae524b55950532fd89729b71', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75165) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 00:45:29 user nova-compute[75165]: DEBUG nova.compute.manager [None req-70d72d5d-4def-4acd-beea-1a24879fb632 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 624db3ad-20f2-4302-8fec-b77a5b8ebc39] Start spawning the instance on the hypervisor. {{(pid=75165) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 00:45:29 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-70d72d5d-4def-4acd-beea-1a24879fb632 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 624db3ad-20f2-4302-8fec-b77a5b8ebc39] Creating instance directory {{(pid=75165) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 00:45:29 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-70d72d5d-4def-4acd-beea-1a24879fb632 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 624db3ad-20f2-4302-8fec-b77a5b8ebc39] Creating image(s)
Oct 26 00:45:29 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-70d72d5d-4def-4acd-beea-1a24879fb632 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Acquiring lock "/opt/stack/data/nova/instances/624db3ad-20f2-4302-8fec-b77a5b8ebc39/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:45:29 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-70d72d5d-4def-4acd-beea-1a24879fb632 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Lock "/opt/stack/data/nova/instances/624db3ad-20f2-4302-8fec-b77a5b8ebc39/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:45:29 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-70d72d5d-4def-4acd-beea-1a24879fb632 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Lock "/opt/stack/data/nova/instances/624db3ad-20f2-4302-8fec-b77a5b8ebc39/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:45:29 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-70d72d5d-4def-4acd-beea-1a24879fb632 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:45:29 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-70d72d5d-4def-4acd-beea-1a24879fb632 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json" returned: 0 in 0.183s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:45:29 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-70d72d5d-4def-4acd-beea-1a24879fb632 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Acquiring lock "7d3243421cf3fdc288b758f687a93103b7b95466" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:45:29 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-70d72d5d-4def-4acd-beea-1a24879fb632 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Lock "7d3243421cf3fdc288b758f687a93103b7b95466" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:45:29 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-70d72d5d-4def-4acd-beea-1a24879fb632 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:45:29 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-70d72d5d-4def-4acd-beea-1a24879fb632 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json" returned: 0 in 0.169s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:45:29 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-70d72d5d-4def-4acd-beea-1a24879fb632 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466,backing_fmt=raw /opt/stack/data/nova/instances/624db3ad-20f2-4302-8fec-b77a5b8ebc39/disk 1073741824 {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:45:29 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-70d72d5d-4def-4acd-beea-1a24879fb632 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466,backing_fmt=raw /opt/stack/data/nova/instances/624db3ad-20f2-4302-8fec-b77a5b8ebc39/disk 1073741824" returned: 0 in 0.051s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:45:29 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-70d72d5d-4def-4acd-beea-1a24879fb632 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Lock "7d3243421cf3fdc288b758f687a93103b7b95466" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.229s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:45:29 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-70d72d5d-4def-4acd-beea-1a24879fb632 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:45:29 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-70d72d5d-4def-4acd-beea-1a24879fb632 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7d3243421cf3fdc288b758f687a93103b7b95466 --force-share --output=json" returned: 0 in 0.178s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:45:29 user nova-compute[75165]: DEBUG nova.virt.disk.api [None req-70d72d5d-4def-4acd-beea-1a24879fb632 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Checking if we can resize image /opt/stack/data/nova/instances/624db3ad-20f2-4302-8fec-b77a5b8ebc39/disk. size=1073741824 {{(pid=75165) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 00:45:29 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-70d72d5d-4def-4acd-beea-1a24879fb632 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/624db3ad-20f2-4302-8fec-b77a5b8ebc39/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:45:29 user nova-compute[75165]: DEBUG nova.network.neutron [None req-70d72d5d-4def-4acd-beea-1a24879fb632 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 624db3ad-20f2-4302-8fec-b77a5b8ebc39] Successfully created port: 7b2215ca-3a79-4fbe-bad8-7cea3a0c2dca {{(pid=75165) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 00:45:29 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-70d72d5d-4def-4acd-beea-1a24879fb632 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/624db3ad-20f2-4302-8fec-b77a5b8ebc39/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:45:29 user nova-compute[75165]: DEBUG nova.virt.disk.api [None req-70d72d5d-4def-4acd-beea-1a24879fb632 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Cannot resize image /opt/stack/data/nova/instances/624db3ad-20f2-4302-8fec-b77a5b8ebc39/disk to a smaller size. {{(pid=75165) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 00:45:29 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-70d72d5d-4def-4acd-beea-1a24879fb632 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 624db3ad-20f2-4302-8fec-b77a5b8ebc39] Created local disks {{(pid=75165) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 00:45:29 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-70d72d5d-4def-4acd-beea-1a24879fb632 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 624db3ad-20f2-4302-8fec-b77a5b8ebc39] Ensure instance console log exists: /opt/stack/data/nova/instances/624db3ad-20f2-4302-8fec-b77a5b8ebc39/console.log {{(pid=75165) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 00:45:29 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-70d72d5d-4def-4acd-beea-1a24879fb632 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:45:29 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-70d72d5d-4def-4acd-beea-1a24879fb632 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:45:29 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-70d72d5d-4def-4acd-beea-1a24879fb632 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:45:30 user nova-compute[75165]: DEBUG nova.network.neutron [None req-70d72d5d-4def-4acd-beea-1a24879fb632 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 624db3ad-20f2-4302-8fec-b77a5b8ebc39] Successfully updated port: 7b2215ca-3a79-4fbe-bad8-7cea3a0c2dca {{(pid=75165) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 00:45:30 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-70d72d5d-4def-4acd-beea-1a24879fb632 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Acquiring lock "refresh_cache-624db3ad-20f2-4302-8fec-b77a5b8ebc39" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:45:30 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-70d72d5d-4def-4acd-beea-1a24879fb632 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Acquired lock "refresh_cache-624db3ad-20f2-4302-8fec-b77a5b8ebc39" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:45:30 user nova-compute[75165]: DEBUG nova.network.neutron [None req-70d72d5d-4def-4acd-beea-1a24879fb632 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 624db3ad-20f2-4302-8fec-b77a5b8ebc39] Building network info cache for instance {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 00:45:30 user nova-compute[75165]: DEBUG nova.compute.manager [req-76b4a7fd-b3e6-449b-bd28-9fac11a40723 req-3931fa43-66d7-4e48-85c4-b53c742f4764 service nova] [instance: 624db3ad-20f2-4302-8fec-b77a5b8ebc39] Received event network-changed-7b2215ca-3a79-4fbe-bad8-7cea3a0c2dca {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:45:30 user nova-compute[75165]: DEBUG nova.compute.manager [req-76b4a7fd-b3e6-449b-bd28-9fac11a40723 req-3931fa43-66d7-4e48-85c4-b53c742f4764 service nova] [instance: 624db3ad-20f2-4302-8fec-b77a5b8ebc39] Refreshing instance network info cache due to event network-changed-7b2215ca-3a79-4fbe-bad8-7cea3a0c2dca. {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 00:45:30 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-76b4a7fd-b3e6-449b-bd28-9fac11a40723 req-3931fa43-66d7-4e48-85c4-b53c742f4764 service nova] Acquiring lock "refresh_cache-624db3ad-20f2-4302-8fec-b77a5b8ebc39" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:45:30 user nova-compute[75165]: DEBUG nova.network.neutron [None req-70d72d5d-4def-4acd-beea-1a24879fb632 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 624db3ad-20f2-4302-8fec-b77a5b8ebc39] Instance cache missing network info. {{(pid=75165) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 00:45:30 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:45:31 user nova-compute[75165]: DEBUG nova.network.neutron [None req-70d72d5d-4def-4acd-beea-1a24879fb632 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 624db3ad-20f2-4302-8fec-b77a5b8ebc39] Updating instance_info_cache with network_info: [{"id": "7b2215ca-3a79-4fbe-bad8-7cea3a0c2dca", "address": "fa:16:3e:e4:cb:af", "network": {"id": "1801db1c-315e-4bdf-b73b-132a38bf41b8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1254756052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62572ce8ae524b55950532fd89729b71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b2215ca-3a", "ovs_interfaceid": "7b2215ca-3a79-4fbe-bad8-7cea3a0c2dca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:45:31 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-70d72d5d-4def-4acd-beea-1a24879fb632 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Releasing lock "refresh_cache-624db3ad-20f2-4302-8fec-b77a5b8ebc39" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:45:31 user nova-compute[75165]: DEBUG nova.compute.manager [None req-70d72d5d-4def-4acd-beea-1a24879fb632 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 624db3ad-20f2-4302-8fec-b77a5b8ebc39] Instance network_info: |[{"id": "7b2215ca-3a79-4fbe-bad8-7cea3a0c2dca", "address": "fa:16:3e:e4:cb:af", "network": {"id": "1801db1c-315e-4bdf-b73b-132a38bf41b8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1254756052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62572ce8ae524b55950532fd89729b71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b2215ca-3a", "ovs_interfaceid": "7b2215ca-3a79-4fbe-bad8-7cea3a0c2dca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75165) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 00:45:31 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-76b4a7fd-b3e6-449b-bd28-9fac11a40723 req-3931fa43-66d7-4e48-85c4-b53c742f4764 service nova] Acquired lock "refresh_cache-624db3ad-20f2-4302-8fec-b77a5b8ebc39" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:45:31 user nova-compute[75165]: DEBUG nova.network.neutron [req-76b4a7fd-b3e6-449b-bd28-9fac11a40723 req-3931fa43-66d7-4e48-85c4-b53c742f4764 service nova] [instance: 624db3ad-20f2-4302-8fec-b77a5b8ebc39] Refreshing network info cache for port 7b2215ca-3a79-4fbe-bad8-7cea3a0c2dca {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 00:45:31 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-70d72d5d-4def-4acd-beea-1a24879fb632 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 624db3ad-20f2-4302-8fec-b77a5b8ebc39] Start _get_guest_xml network_info=[{"id": "7b2215ca-3a79-4fbe-bad8-7cea3a0c2dca", "address": "fa:16:3e:e4:cb:af", "network": {"id": "1801db1c-315e-4bdf-b73b-132a38bf41b8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1254756052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62572ce8ae524b55950532fd89729b71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b2215ca-3a", "ovs_interfaceid": "7b2215ca-3a79-4fbe-bad8-7cea3a0c2dca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T00:03:24Z,direct_url=<?>,disk_format='qcow2',id=bff0d8a1-739e-4c4d-9efa-b73ba7b76d01,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e56bbf444fd34c348475c73673611447',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T00:03:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'size': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': 'bff0d8a1-739e-4c4d-9efa-b73ba7b76d01'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75165) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 00:45:31 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-70d72d5d-4def-4acd-beea-1a24879fb632 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:45:31 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-70d72d5d-4def-4acd-beea-1a24879fb632 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:45:31 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-70d72d5d-4def-4acd-beea-1a24879fb632 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75165) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 00:45:31 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-70d72d5d-4def-4acd-beea-1a24879fb632 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] CPU controller missing on host. {{(pid=75165) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 00:45:31 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-70d72d5d-4def-4acd-beea-1a24879fb632 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75165) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 00:45:31 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-70d72d5d-4def-4acd-beea-1a24879fb632 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] CPU controller found on host. {{(pid=75165) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 00:45:31 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-70d72d5d-4def-4acd-beea-1a24879fb632 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75165) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 00:45:31 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-70d72d5d-4def-4acd-beea-1a24879fb632 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T00:03:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T00:03:24Z,direct_url=<?>,disk_format='qcow2',id=bff0d8a1-739e-4c4d-9efa-b73ba7b76d01,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e56bbf444fd34c348475c73673611447',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T00:03:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 00:45:31 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-70d72d5d-4def-4acd-beea-1a24879fb632 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Flavor limits 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 00:45:31 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-70d72d5d-4def-4acd-beea-1a24879fb632 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Image limits 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 00:45:31 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-70d72d5d-4def-4acd-beea-1a24879fb632 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Flavor pref 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 00:45:31 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-70d72d5d-4def-4acd-beea-1a24879fb632 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Image pref 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 00:45:31 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-70d72d5d-4def-4acd-beea-1a24879fb632 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 00:45:31 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-70d72d5d-4def-4acd-beea-1a24879fb632 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 00:45:31 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-70d72d5d-4def-4acd-beea-1a24879fb632 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75165) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 00:45:31 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-70d72d5d-4def-4acd-beea-1a24879fb632 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Got 1 possible topologies {{(pid=75165) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 00:45:31 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-70d72d5d-4def-4acd-beea-1a24879fb632 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 00:45:31 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-70d72d5d-4def-4acd-beea-1a24879fb632 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 00:45:31 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-70d72d5d-4def-4acd-beea-1a24879fb632 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:45:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-46239259',display_name='tempest-AttachVolumeNegativeTest-server-46239259',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-46239259',id=48,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP8QuWCfmwXA+CjXd+b1yM7KY+je2xQytevsUcbENlFjJlfNU7eDMmDeCDX6t1ARUWX8tlYMbk98u0VgX5fB7r76RpcVYYKtcXzvEM9HSJqJR0D3zn0wqQUp2epxGITGvg==',key_name='tempest-keypair-45744395',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='62572ce8ae524b55950532fd89729b71',ramdisk_id='',reservation_id='r-8jd0e6ua',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-988376295',owner_user_name='tempest-AttachVolumeNegativeTest-988376295-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T00:45:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='041ebe2732c341129d6813549653cab3',uuid=624db3ad-20f2-4302-8fec-b77a5b8ebc39,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7b2215ca-3a79-4fbe-bad8-7cea3a0c2dca", "address": "fa:16:3e:e4:cb:af", "network": {"id": "1801db1c-315e-4bdf-b73b-132a38bf41b8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1254756052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62572ce8ae524b55950532fd89729b71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b2215ca-3a", "ovs_interfaceid": "7b2215ca-3a79-4fbe-bad8-7cea3a0c2dca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75165) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 00:45:31 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-70d72d5d-4def-4acd-beea-1a24879fb632 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Converting VIF {"id": "7b2215ca-3a79-4fbe-bad8-7cea3a0c2dca", "address": "fa:16:3e:e4:cb:af", "network": {"id": "1801db1c-315e-4bdf-b73b-132a38bf41b8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1254756052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62572ce8ae524b55950532fd89729b71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b2215ca-3a", "ovs_interfaceid": "7b2215ca-3a79-4fbe-bad8-7cea3a0c2dca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:45:31 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-70d72d5d-4def-4acd-beea-1a24879fb632 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:cb:af,bridge_name='br-int',has_traffic_filtering=True,id=7b2215ca-3a79-4fbe-bad8-7cea3a0c2dca,network=Network(1801db1c-315e-4bdf-b73b-132a38bf41b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b2215ca-3a') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:45:31 user nova-compute[75165]: DEBUG nova.objects.instance [None req-70d72d5d-4def-4acd-beea-1a24879fb632 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Lazy-loading 'pci_devices' on Instance uuid 624db3ad-20f2-4302-8fec-b77a5b8ebc39 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:45:31 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-70d72d5d-4def-4acd-beea-1a24879fb632 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 624db3ad-20f2-4302-8fec-b77a5b8ebc39] End _get_guest_xml xml=<domain type="kvm">
Oct 26 00:45:31 user nova-compute[75165]:   <uuid>624db3ad-20f2-4302-8fec-b77a5b8ebc39</uuid>
Oct 26 00:45:31 user nova-compute[75165]:   <name>instance-00000030</name>
Oct 26 00:45:31 user nova-compute[75165]:   <memory>524288</memory>
Oct 26 00:45:31 user nova-compute[75165]:   <vcpu>1</vcpu>
Oct 26 00:45:31 user nova-compute[75165]:   <metadata>
Oct 26 00:45:31 user nova-compute[75165]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 00:45:31 user nova-compute[75165]:       <nova:package version="0.0.0"/>
Oct 26 00:45:31 user nova-compute[75165]:       <nova:name>tempest-AttachVolumeNegativeTest-server-46239259</nova:name>
Oct 26 00:45:31 user nova-compute[75165]:       <nova:creationTime>2023-10-26 00:45:31</nova:creationTime>
Oct 26 00:45:31 user nova-compute[75165]:       <nova:flavor name="m1.tiny">
Oct 26 00:45:31 user nova-compute[75165]:         <nova:memory>512</nova:memory>
Oct 26 00:45:31 user nova-compute[75165]:         <nova:disk>1</nova:disk>
Oct 26 00:45:31 user nova-compute[75165]:         <nova:swap>0</nova:swap>
Oct 26 00:45:31 user nova-compute[75165]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 00:45:31 user nova-compute[75165]:         <nova:vcpus>1</nova:vcpus>
Oct 26 00:45:31 user nova-compute[75165]:       </nova:flavor>
Oct 26 00:45:31 user nova-compute[75165]:       <nova:owner>
Oct 26 00:45:31 user nova-compute[75165]:         <nova:user uuid="041ebe2732c341129d6813549653cab3">tempest-AttachVolumeNegativeTest-988376295-project-member</nova:user>
Oct 26 00:45:31 user nova-compute[75165]:         <nova:project uuid="62572ce8ae524b55950532fd89729b71">tempest-AttachVolumeNegativeTest-988376295</nova:project>
Oct 26 00:45:31 user nova-compute[75165]:       </nova:owner>
Oct 26 00:45:31 user nova-compute[75165]:       <nova:root type="image" uuid="bff0d8a1-739e-4c4d-9efa-b73ba7b76d01"/>
Oct 26 00:45:31 user nova-compute[75165]:       <nova:ports>
Oct 26 00:45:31 user nova-compute[75165]:         <nova:port uuid="7b2215ca-3a79-4fbe-bad8-7cea3a0c2dca">
Oct 26 00:45:31 user nova-compute[75165]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 26 00:45:31 user nova-compute[75165]:         </nova:port>
Oct 26 00:45:31 user nova-compute[75165]:       </nova:ports>
Oct 26 00:45:31 user nova-compute[75165]:     </nova:instance>
Oct 26 00:45:31 user nova-compute[75165]:   </metadata>
Oct 26 00:45:31 user nova-compute[75165]:   <sysinfo type="smbios">
Oct 26 00:45:31 user nova-compute[75165]:     <system>
Oct 26 00:45:31 user nova-compute[75165]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 00:45:31 user nova-compute[75165]:       <entry name="product">OpenStack Nova</entry>
Oct 26 00:45:31 user nova-compute[75165]:       <entry name="version">0.0.0</entry>
Oct 26 00:45:31 user nova-compute[75165]:       <entry name="serial">624db3ad-20f2-4302-8fec-b77a5b8ebc39</entry>
Oct 26 00:45:31 user nova-compute[75165]:       <entry name="uuid">624db3ad-20f2-4302-8fec-b77a5b8ebc39</entry>
Oct 26 00:45:31 user nova-compute[75165]:       <entry name="family">Virtual Machine</entry>
Oct 26 00:45:31 user nova-compute[75165]:     </system>
Oct 26 00:45:31 user nova-compute[75165]:   </sysinfo>
Oct 26 00:45:31 user nova-compute[75165]:   <os>
Oct 26 00:45:31 user nova-compute[75165]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 00:45:31 user nova-compute[75165]:     <boot dev="hd"/>
Oct 26 00:45:31 user nova-compute[75165]:     <smbios mode="sysinfo"/>
Oct 26 00:45:31 user nova-compute[75165]:   </os>
Oct 26 00:45:31 user nova-compute[75165]:   <features>
Oct 26 00:45:31 user nova-compute[75165]:     <acpi/>
Oct 26 00:45:31 user nova-compute[75165]:     <apic/>
Oct 26 00:45:31 user nova-compute[75165]:     <vmcoreinfo/>
Oct 26 00:45:31 user nova-compute[75165]:   </features>
Oct 26 00:45:31 user nova-compute[75165]:   <clock offset="utc">
Oct 26 00:45:31 user nova-compute[75165]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 00:45:31 user nova-compute[75165]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 00:45:31 user nova-compute[75165]:     <timer name="hpet" present="no"/>
Oct 26 00:45:31 user nova-compute[75165]:   </clock>
Oct 26 00:45:31 user nova-compute[75165]:   <cpu mode="custom" match="exact">
Oct 26 00:45:31 user nova-compute[75165]:     <model>Nehalem</model>
Oct 26 00:45:31 user nova-compute[75165]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 00:45:31 user nova-compute[75165]:   </cpu>
Oct 26 00:45:31 user nova-compute[75165]:   <devices>
Oct 26 00:45:31 user nova-compute[75165]:     <disk type="file" device="disk">
Oct 26 00:45:31 user nova-compute[75165]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 00:45:31 user nova-compute[75165]:       <source file="/opt/stack/data/nova/instances/624db3ad-20f2-4302-8fec-b77a5b8ebc39/disk"/>
Oct 26 00:45:31 user nova-compute[75165]:       <target dev="vda" bus="virtio"/>
Oct 26 00:45:31 user nova-compute[75165]:     </disk>
Oct 26 00:45:31 user nova-compute[75165]:     <interface type="ethernet">
Oct 26 00:45:31 user nova-compute[75165]:       <mac address="fa:16:3e:e4:cb:af"/>
Oct 26 00:45:31 user nova-compute[75165]:       <model type="virtio"/>
Oct 26 00:45:31 user nova-compute[75165]:       <mtu size="1442"/>
Oct 26 00:45:31 user nova-compute[75165]:       <target dev="tap7b2215ca-3a"/>
Oct 26 00:45:31 user nova-compute[75165]:     </interface>
Oct 26 00:45:31 user nova-compute[75165]:     <serial type="pty">
Oct 26 00:45:31 user nova-compute[75165]:       <log file="/opt/stack/data/nova/instances/624db3ad-20f2-4302-8fec-b77a5b8ebc39/console.log" append="off"/>
Oct 26 00:45:31 user nova-compute[75165]:     </serial>
Oct 26 00:45:31 user nova-compute[75165]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 00:45:31 user nova-compute[75165]:     <video>
Oct 26 00:45:31 user nova-compute[75165]:       <model type="virtio"/>
Oct 26 00:45:31 user nova-compute[75165]:     </video>
Oct 26 00:45:31 user nova-compute[75165]:     <rng model="virtio">
Oct 26 00:45:31 user nova-compute[75165]:       <backend model="random">/dev/urandom</backend>
Oct 26 00:45:31 user nova-compute[75165]:     </rng>
Oct 26 00:45:31 user nova-compute[75165]:     <controller type="usb" index="0" model="none"/>
Oct 26 00:45:31 user nova-compute[75165]:     <memballoon model="virtio">
Oct 26 00:45:31 user nova-compute[75165]:       <stats period="10"/>
Oct 26 00:45:31 user nova-compute[75165]:     </memballoon>
Oct 26 00:45:31 user nova-compute[75165]:   </devices>
Oct 26 00:45:31 user nova-compute[75165]: </domain>
Oct 26 00:45:31 user nova-compute[75165]:  {{(pid=75165) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 00:45:31 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-70d72d5d-4def-4acd-beea-1a24879fb632 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:45:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-46239259',display_name='tempest-AttachVolumeNegativeTest-server-46239259',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-46239259',id=48,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP8QuWCfmwXA+CjXd+b1yM7KY+je2xQytevsUcbENlFjJlfNU7eDMmDeCDX6t1ARUWX8tlYMbk98u0VgX5fB7r76RpcVYYKtcXzvEM9HSJqJR0D3zn0wqQUp2epxGITGvg==',key_name='tempest-keypair-45744395',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='62572ce8ae524b55950532fd89729b71',ramdisk_id='',reservation_id='r-8jd0e6ua',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-988376295',owner_user_name='tempest-AttachVolumeNegativeTest-988376295-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T00:45:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='041ebe2732c341129d6813549653cab3',uuid=624db3ad-20f2-4302-8fec-b77a5b8ebc39,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7b2215ca-3a79-4fbe-bad8-7cea3a0c2dca", "address": "fa:16:3e:e4:cb:af", "network": {"id": "1801db1c-315e-4bdf-b73b-132a38bf41b8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1254756052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62572ce8ae524b55950532fd89729b71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b2215ca-3a", "ovs_interfaceid": "7b2215ca-3a79-4fbe-bad8-7cea3a0c2dca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 00:45:31 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-70d72d5d-4def-4acd-beea-1a24879fb632 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Converting VIF {"id": "7b2215ca-3a79-4fbe-bad8-7cea3a0c2dca", "address": "fa:16:3e:e4:cb:af", "network": {"id": "1801db1c-315e-4bdf-b73b-132a38bf41b8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1254756052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62572ce8ae524b55950532fd89729b71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b2215ca-3a", "ovs_interfaceid": "7b2215ca-3a79-4fbe-bad8-7cea3a0c2dca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:45:31 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-70d72d5d-4def-4acd-beea-1a24879fb632 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:cb:af,bridge_name='br-int',has_traffic_filtering=True,id=7b2215ca-3a79-4fbe-bad8-7cea3a0c2dca,network=Network(1801db1c-315e-4bdf-b73b-132a38bf41b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b2215ca-3a') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:45:31 user nova-compute[75165]: DEBUG os_vif [None req-70d72d5d-4def-4acd-beea-1a24879fb632 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:cb:af,bridge_name='br-int',has_traffic_filtering=True,id=7b2215ca-3a79-4fbe-bad8-7cea3a0c2dca,network=Network(1801db1c-315e-4bdf-b73b-132a38bf41b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b2215ca-3a') {{(pid=75165) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 00:45:31 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:45:31 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:45:31 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 00:45:31 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:45:31 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4f7b5756-8627-544c-96eb-b60e2ab28df7', '_type': 'linux-noop'}}, row=False) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:45:31 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:45:31 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:45:31 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:45:31 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7b2215ca-3a, may_exist=True, interface_attrs={}) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:45:31 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7b2215ca-3a, col_values=(('qos', UUID('5dd4bca2-a9cb-4005-bcf5-f350d60a971e')),), if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:45:31 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7b2215ca-3a, col_values=(('external_ids', {'iface-id': '7b2215ca-3a79-4fbe-bad8-7cea3a0c2dca', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e4:cb:af', 'vm-uuid': '624db3ad-20f2-4302-8fec-b77a5b8ebc39'}),), if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:45:31 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:45:31 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:45:31 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:45:31 user nova-compute[75165]: INFO os_vif [None req-70d72d5d-4def-4acd-beea-1a24879fb632 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:cb:af,bridge_name='br-int',has_traffic_filtering=True,id=7b2215ca-3a79-4fbe-bad8-7cea3a0c2dca,network=Network(1801db1c-315e-4bdf-b73b-132a38bf41b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b2215ca-3a')
Oct 26 00:45:31 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-70d72d5d-4def-4acd-beea-1a24879fb632 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] No BDM found with device name vda, not building metadata. {{(pid=75165) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 00:45:31 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-70d72d5d-4def-4acd-beea-1a24879fb632 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] No VIF found with MAC fa:16:3e:e4:cb:af, not building metadata {{(pid=75165) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 00:45:31 user nova-compute[75165]: DEBUG nova.network.neutron [req-76b4a7fd-b3e6-449b-bd28-9fac11a40723 req-3931fa43-66d7-4e48-85c4-b53c742f4764 service nova] [instance: 624db3ad-20f2-4302-8fec-b77a5b8ebc39] Updated VIF entry in instance network info cache for port 7b2215ca-3a79-4fbe-bad8-7cea3a0c2dca. {{(pid=75165) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 00:45:31 user nova-compute[75165]: DEBUG nova.network.neutron [req-76b4a7fd-b3e6-449b-bd28-9fac11a40723 req-3931fa43-66d7-4e48-85c4-b53c742f4764 service nova] [instance: 624db3ad-20f2-4302-8fec-b77a5b8ebc39] Updating instance_info_cache with network_info: [{"id": "7b2215ca-3a79-4fbe-bad8-7cea3a0c2dca", "address": "fa:16:3e:e4:cb:af", "network": {"id": "1801db1c-315e-4bdf-b73b-132a38bf41b8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1254756052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62572ce8ae524b55950532fd89729b71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b2215ca-3a", "ovs_interfaceid": "7b2215ca-3a79-4fbe-bad8-7cea3a0c2dca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:45:31 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-76b4a7fd-b3e6-449b-bd28-9fac11a40723 req-3931fa43-66d7-4e48-85c4-b53c742f4764 service nova] Releasing lock "refresh_cache-624db3ad-20f2-4302-8fec-b77a5b8ebc39" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:45:31 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:45:32 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:45:32 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:45:32 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:45:32 user nova-compute[75165]: DEBUG nova.compute.manager [req-2272640e-55d5-44a2-ae1b-c20d10c8a91e req-57539cca-4562-4cdb-9626-3a372c384ff9 service nova] [instance: 624db3ad-20f2-4302-8fec-b77a5b8ebc39] Received event network-vif-plugged-7b2215ca-3a79-4fbe-bad8-7cea3a0c2dca {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:45:32 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-2272640e-55d5-44a2-ae1b-c20d10c8a91e req-57539cca-4562-4cdb-9626-3a372c384ff9 service nova] Acquiring lock "624db3ad-20f2-4302-8fec-b77a5b8ebc39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:45:32 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-2272640e-55d5-44a2-ae1b-c20d10c8a91e req-57539cca-4562-4cdb-9626-3a372c384ff9 service nova] Lock "624db3ad-20f2-4302-8fec-b77a5b8ebc39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:45:32 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-2272640e-55d5-44a2-ae1b-c20d10c8a91e req-57539cca-4562-4cdb-9626-3a372c384ff9 service nova] Lock "624db3ad-20f2-4302-8fec-b77a5b8ebc39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:45:32 user nova-compute[75165]: DEBUG nova.compute.manager [req-2272640e-55d5-44a2-ae1b-c20d10c8a91e req-57539cca-4562-4cdb-9626-3a372c384ff9 service nova] [instance: 624db3ad-20f2-4302-8fec-b77a5b8ebc39] No waiting events found dispatching network-vif-plugged-7b2215ca-3a79-4fbe-bad8-7cea3a0c2dca {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:45:32 user nova-compute[75165]: WARNING nova.compute.manager [req-2272640e-55d5-44a2-ae1b-c20d10c8a91e req-57539cca-4562-4cdb-9626-3a372c384ff9 service nova] [instance: 624db3ad-20f2-4302-8fec-b77a5b8ebc39] Received unexpected event network-vif-plugged-7b2215ca-3a79-4fbe-bad8-7cea3a0c2dca for instance with vm_state building and task_state spawning.
Oct 26 00:45:32 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:45:33 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:45:33 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:45:33 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:45:33 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:45:33 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:45:34 user nova-compute[75165]: DEBUG nova.compute.manager [None req-70d72d5d-4def-4acd-beea-1a24879fb632 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 624db3ad-20f2-4302-8fec-b77a5b8ebc39] Instance event wait completed in 0 seconds for  {{(pid=75165) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 00:45:34 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-70d72d5d-4def-4acd-beea-1a24879fb632 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 624db3ad-20f2-4302-8fec-b77a5b8ebc39] Guest created on hypervisor {{(pid=75165) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 00:45:34 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: 624db3ad-20f2-4302-8fec-b77a5b8ebc39] Instance spawned successfully.
Oct 26 00:45:34 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-70d72d5d-4def-4acd-beea-1a24879fb632 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 624db3ad-20f2-4302-8fec-b77a5b8ebc39] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 00:45:34 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-70d72d5d-4def-4acd-beea-1a24879fb632 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 624db3ad-20f2-4302-8fec-b77a5b8ebc39] Found default for hw_cdrom_bus of ide {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:45:34 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-70d72d5d-4def-4acd-beea-1a24879fb632 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 624db3ad-20f2-4302-8fec-b77a5b8ebc39] Found default for hw_disk_bus of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:45:34 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-70d72d5d-4def-4acd-beea-1a24879fb632 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 624db3ad-20f2-4302-8fec-b77a5b8ebc39] Found default for hw_input_bus of None {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:45:34 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-70d72d5d-4def-4acd-beea-1a24879fb632 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 624db3ad-20f2-4302-8fec-b77a5b8ebc39] Found default for hw_pointer_model of None {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:45:34 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-70d72d5d-4def-4acd-beea-1a24879fb632 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 624db3ad-20f2-4302-8fec-b77a5b8ebc39] Found default for hw_video_model of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:45:34 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-70d72d5d-4def-4acd-beea-1a24879fb632 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 624db3ad-20f2-4302-8fec-b77a5b8ebc39] Found default for hw_vif_model of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:45:34 user nova-compute[75165]: DEBUG nova.compute.manager [req-a01e47bc-31fc-4526-9e28-3d99de357a2e req-d8890ef1-e04e-416e-a4c6-a92e6f1cedb4 service nova] [instance: 624db3ad-20f2-4302-8fec-b77a5b8ebc39] Received event network-vif-plugged-7b2215ca-3a79-4fbe-bad8-7cea3a0c2dca {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:45:34 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-a01e47bc-31fc-4526-9e28-3d99de357a2e req-d8890ef1-e04e-416e-a4c6-a92e6f1cedb4 service nova] Acquiring lock "624db3ad-20f2-4302-8fec-b77a5b8ebc39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:45:34 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-a01e47bc-31fc-4526-9e28-3d99de357a2e req-d8890ef1-e04e-416e-a4c6-a92e6f1cedb4 service nova] Lock "624db3ad-20f2-4302-8fec-b77a5b8ebc39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:45:34 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-a01e47bc-31fc-4526-9e28-3d99de357a2e req-d8890ef1-e04e-416e-a4c6-a92e6f1cedb4 service nova] Lock "624db3ad-20f2-4302-8fec-b77a5b8ebc39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:45:34 user nova-compute[75165]: DEBUG nova.compute.manager [req-a01e47bc-31fc-4526-9e28-3d99de357a2e req-d8890ef1-e04e-416e-a4c6-a92e6f1cedb4 service nova] [instance: 624db3ad-20f2-4302-8fec-b77a5b8ebc39] No waiting events found dispatching network-vif-plugged-7b2215ca-3a79-4fbe-bad8-7cea3a0c2dca {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:45:34 user nova-compute[75165]: WARNING nova.compute.manager [req-a01e47bc-31fc-4526-9e28-3d99de357a2e req-d8890ef1-e04e-416e-a4c6-a92e6f1cedb4 service nova] [instance: 624db3ad-20f2-4302-8fec-b77a5b8ebc39] Received unexpected event network-vif-plugged-7b2215ca-3a79-4fbe-bad8-7cea3a0c2dca for instance with vm_state building and task_state spawning.
Oct 26 00:45:34 user nova-compute[75165]: INFO nova.compute.manager [None req-70d72d5d-4def-4acd-beea-1a24879fb632 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 624db3ad-20f2-4302-8fec-b77a5b8ebc39] Took 5.69 seconds to spawn the instance on the hypervisor.
Oct 26 00:45:34 user nova-compute[75165]: DEBUG nova.compute.manager [None req-70d72d5d-4def-4acd-beea-1a24879fb632 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 624db3ad-20f2-4302-8fec-b77a5b8ebc39] Checking state {{(pid=75165) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 00:45:34 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:45:34 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:45:34 user nova-compute[75165]: INFO nova.compute.manager [None req-70d72d5d-4def-4acd-beea-1a24879fb632 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 624db3ad-20f2-4302-8fec-b77a5b8ebc39] Took 6.27 seconds to build instance.
Oct 26 00:45:34 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-70d72d5d-4def-4acd-beea-1a24879fb632 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Lock "624db3ad-20f2-4302-8fec-b77a5b8ebc39" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.368s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:45:35 user nova-compute[75165]: DEBUG nova.compute.manager [None req-ae5b6e25-63b1-46ce-a65d-c14e83ebfff1 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: b084f728-b8c4-4c9e-a856-18312012c110] Start spawning the instance on the hypervisor. {{(pid=75165) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 00:45:35 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-ae5b6e25-63b1-46ce-a65d-c14e83ebfff1 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: b084f728-b8c4-4c9e-a856-18312012c110] Creating instance directory {{(pid=75165) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 00:45:35 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-ae5b6e25-63b1-46ce-a65d-c14e83ebfff1 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: b084f728-b8c4-4c9e-a856-18312012c110] Creating image(s)
Oct 26 00:45:35 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-ae5b6e25-63b1-46ce-a65d-c14e83ebfff1 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: b084f728-b8c4-4c9e-a856-18312012c110] Did not create local disks {{(pid=75165) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 26 00:45:35 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-ae5b6e25-63b1-46ce-a65d-c14e83ebfff1 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: b084f728-b8c4-4c9e-a856-18312012c110] Ensure instance console log exists: /opt/stack/data/nova/instances/b084f728-b8c4-4c9e-a856-18312012c110/console.log {{(pid=75165) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 00:45:35 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-ae5b6e25-63b1-46ce-a65d-c14e83ebfff1 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:45:35 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-ae5b6e25-63b1-46ce-a65d-c14e83ebfff1 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:45:35 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-ae5b6e25-63b1-46ce-a65d-c14e83ebfff1 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:45:35 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-ae5b6e25-63b1-46ce-a65d-c14e83ebfff1 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: b084f728-b8c4-4c9e-a856-18312012c110] Start _get_guest_xml network_info=[{"id": "3b4b4194-dc5f-486c-83fd-93f7c0727fca", "address": "fa:16:3e:22:f3:aa", "network": {"id": "dc50ae7b-d501-461f-aa0b-542514330ae8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1091857056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1051405ca054c4bb051fb842a5fb5a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b4b4194-dc", "ovs_interfaceid": "3b4b4194-dc5f-486c-83fd-93f7c0727fca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:28483cbc-41a9-4961-9c30-fae820d1ad43', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RmaYIrVs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b084f728-b8c4-4c9e-a856-18312012c110', 'attached_at': '', 'detached_at': '', 'volume_id': '28483cbc-41a9-4961-9c30-fae820d1ad43', 'serial': '28483cbc-41a9-4961-9c30-fae820d1ad43'}, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'attachment_id': '26726163-9410-48a3-8637-be5c06b49e5c', 'delete_on_termination': False, 'volume_type': None} {{(pid=75165) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 00:45:35 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-ae5b6e25-63b1-46ce-a65d-c14e83ebfff1 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:45:35 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-ae5b6e25-63b1-46ce-a65d-c14e83ebfff1 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:45:35 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-ae5b6e25-63b1-46ce-a65d-c14e83ebfff1 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75165) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 00:45:35 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-ae5b6e25-63b1-46ce-a65d-c14e83ebfff1 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] CPU controller missing on host. {{(pid=75165) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 00:45:35 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-ae5b6e25-63b1-46ce-a65d-c14e83ebfff1 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75165) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 00:45:35 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-ae5b6e25-63b1-46ce-a65d-c14e83ebfff1 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] CPU controller found on host. {{(pid=75165) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 00:45:35 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-ae5b6e25-63b1-46ce-a65d-c14e83ebfff1 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75165) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 00:45:35 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-ae5b6e25-63b1-46ce-a65d-c14e83ebfff1 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T00:03:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 00:45:35 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-ae5b6e25-63b1-46ce-a65d-c14e83ebfff1 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Flavor limits 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 00:45:35 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-ae5b6e25-63b1-46ce-a65d-c14e83ebfff1 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Image limits 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 00:45:35 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-ae5b6e25-63b1-46ce-a65d-c14e83ebfff1 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Flavor pref 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 00:45:35 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-ae5b6e25-63b1-46ce-a65d-c14e83ebfff1 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Image pref 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 00:45:35 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-ae5b6e25-63b1-46ce-a65d-c14e83ebfff1 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 00:45:35 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-ae5b6e25-63b1-46ce-a65d-c14e83ebfff1 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 00:45:35 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-ae5b6e25-63b1-46ce-a65d-c14e83ebfff1 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75165) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 00:45:35 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-ae5b6e25-63b1-46ce-a65d-c14e83ebfff1 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Got 1 possible topologies {{(pid=75165) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 00:45:35 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-ae5b6e25-63b1-46ce-a65d-c14e83ebfff1 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 00:45:35 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-ae5b6e25-63b1-46ce-a65d-c14e83ebfff1 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 00:45:35 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae5b6e25-63b1-46ce-a65d-c14e83ebfff1 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: b084f728-b8c4-4c9e-a856-18312012c110] Calling os-brick to attach iSCSI Volume {{(pid=75165) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 00:45:35 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae5b6e25-63b1-46ce-a65d-c14e83ebfff1 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8bf8160e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:28483cbc-41a9-4961-9c30-fae820d1ad43', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RmaYIrVs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:45:35 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-ae5b6e25-63b1-46ce-a65d-c14e83ebfff1 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:45:35 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-ae5b6e25-63b1-46ce-a65d-c14e83ebfff1 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:45:35 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-ae5b6e25-63b1-46ce-a65d-c14e83ebfff1 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:45:35 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-ae5b6e25-63b1-46ce-a65d-c14e83ebfff1 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:45:35 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-ae5b6e25-63b1-46ce-a65d-c14e83ebfff1 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:28483cbc-41a9-4961-9c30-fae820d1ad43" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:45:35 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-ae5b6e25-63b1-46ce-a65d-c14e83ebfff1 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:28483cbc-41a9-4961-9c30-fae820d1ad43" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:45:35 user nova-compute[75165]: INFO os_brick.initiator.connectors.iscsi [None req-ae5b6e25-63b1-46ce-a65d-c14e83ebfff1 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 00:45:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28483cbc-41a9-4961-9c30-fae820d1ad43 -p 172.16.0.220:3260 {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:45:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28483cbc-41a9-4961-9c30-fae820d1ad43 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:45:35 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[a79e9f3b-8191-459e-a40b-dc456a94315f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:45:35 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae5b6e25-63b1-46ce-a65d-c14e83ebfff1 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 00:45:35 user nova-compute[75165]:  {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:45:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28483cbc-41a9-4961-9c30-fae820d1ad43 -p 172.16.0.220:3260 --interface default --op new {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:45:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28483cbc-41a9-4961-9c30-fae820d1ad43 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:45:35 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[2693f464-3919-428d-bc2c-fd22a1bec58b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:28483cbc-41a9-4961-9c30-fae820d1ad43] added\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:45:35 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae5b6e25-63b1-46ce-a65d-c14e83ebfff1 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:28483cbc-41a9-4961-9c30-fae820d1ad43] added
Oct 26 00:45:35 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:45:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28483cbc-41a9-4961-9c30-fae820d1ad43 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:45:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28483cbc-41a9-4961-9c30-fae820d1ad43 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:45:35 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[676bf4af-ce24-44be-be01-a93a75ee93a9]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:45:35 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae5b6e25-63b1-46ce-a65d-c14e83ebfff1 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:45:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28483cbc-41a9-4961-9c30-fae820d1ad43 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:45:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28483cbc-41a9-4961-9c30-fae820d1ad43 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:45:35 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[b433ceb1-214f-4bf2-a16d-fc6d2c5a1268]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:45:35 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae5b6e25-63b1-46ce-a65d-c14e83ebfff1 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:45:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28483cbc-41a9-4961-9c30-fae820d1ad43 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RmaYIrVs {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:45:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28483cbc-41a9-4961-9c30-fae820d1ad43 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RmaYIrVs" returned: 0 in 0.017s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:45:35 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf08cf1e-296c-49c9-a46b-9aff49df8e1b]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:45:35 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae5b6e25-63b1-46ce-a65d-c14e83ebfff1 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RmaYIrVs'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:45:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28483cbc-41a9-4961-9c30-fae820d1ad43 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:45:35 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:45:35 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Starting heal instance info cache {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 00:45:35 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Rebuilding the list of instances to heal {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 00:45:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28483cbc-41a9-4961-9c30-fae820d1ad43 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:45:35 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[d931c106-f00a-4db4-b12a-77f88465174d]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:45:35 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae5b6e25-63b1-46ce-a65d-c14e83ebfff1 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:45:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:45:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:45:35 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[378eeb17-5463-4bc4-832a-ad2ac76aab4d]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:45:35 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae5b6e25-63b1-46ce-a65d-c14e83ebfff1 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 26 00:45:35 user nova-compute[75165]:  {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:45:35 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae5b6e25-63b1-46ce-a65d-c14e83ebfff1 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 26 00:45:35 user nova-compute[75165]:  {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:45:35 user nova-compute[75165]: WARNING os_brick.initiator.connectors.iscsi [None req-ae5b6e25-63b1-46ce-a65d-c14e83ebfff1 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 26 00:45:35 user nova-compute[75165]: 
Oct 26 00:45:35 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: b084f728-b8c4-4c9e-a856-18312012c110] Skipping network cache update for instance because it is Building. {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9934}}
Oct 26 00:45:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28483cbc-41a9-4961-9c30-fae820d1ad43 -p 172.16.0.220:3260 --login {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:45:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28483cbc-41a9-4961-9c30-fae820d1ad43 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:45:35 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[7be4eab1-03b5-447e-b223-f6f167f869b5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:28483cbc-41a9-4961-9c30-fae820d1ad43, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:28483cbc-41a9-4961-9c30-fae820d1ad43, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:45:35 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae5b6e25-63b1-46ce-a65d-c14e83ebfff1 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:28483cbc-41a9-4961-9c30-fae820d1ad43, portal: 172.16.0.220,3260]
Oct 26 00:45:35 user nova-compute[75165]: Login to [iface: default, target: iqn.2010-10.org.openstack:28483cbc-41a9-4961-9c30-fae820d1ad43, portal: 172.16.0.220,3260] successful.
Oct 26 00:45:35 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:45:35 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "refresh_cache-50c16604-2066-4cd2-a74e-c47a2dc4c449" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:45:35 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquired lock "refresh_cache-50c16604-2066-4cd2-a74e-c47a2dc4c449" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:45:35 user nova-compute[75165]: DEBUG nova.network.neutron [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: 50c16604-2066-4cd2-a74e-c47a2dc4c449] Forcefully refreshing network info cache for instance {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 00:45:35 user nova-compute[75165]: DEBUG nova.objects.instance [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lazy-loading 'info_cache' on Instance uuid 50c16604-2066-4cd2-a74e-c47a2dc4c449 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:45:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28483cbc-41a9-4961-9c30-fae820d1ad43 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:45:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28483cbc-41a9-4961-9c30-fae820d1ad43 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:45:35 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[527b7a22-1bdf-4018-90a8-bffe3b1e61cc]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:45:35 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae5b6e25-63b1-46ce-a65d-c14e83ebfff1 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:45:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:45:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:45:35 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dbe3c86-20ac-4b5c-bfc0-2da4a06329cb]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28483cbc-41a9-4961-9c30-fae820d1ad43 (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:45:35 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae5b6e25-63b1-46ce-a65d-c14e83ebfff1 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28483cbc-41a9-4961-9c30-fae820d1ad43 (non-flash)
Oct 26 00:45:35 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:45:35 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae5b6e25-63b1-46ce-a65d-c14e83ebfff1 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28483cbc-41a9-4961-9c30-fae820d1ad43 (non-flash)
Oct 26 00:45:35 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:45:36 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-ae5b6e25-63b1-46ce-a65d-c14e83ebfff1 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:28483cbc-41a9-4961-9c30-fae820d1ad43" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.276s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:45:36 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae5b6e25-63b1-46ce-a65d-c14e83ebfff1 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Connected to 172.16.0.220:3260 {{(pid=75165) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 00:45:36 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-ae5b6e25-63b1-46ce-a65d-c14e83ebfff1 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] HCTL ('33', '-', '-', 0) found on session 52 with lun 0 {{(pid=75165) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 00:45:36 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-ae5b6e25-63b1-46ce-a65d-c14e83ebfff1 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75165) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 00:45:36 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:45:36 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:45:36 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[c804c196-4fef-4f41-a14a-017f1f552ec2]: (4, ('- - 0', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:45:36 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-ae5b6e25-63b1-46ce-a65d-c14e83ebfff1 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: None {{(pid=75165) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 00:45:36 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:45:36 user nova-compute[75165]: DEBUG nova.network.neutron [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: 50c16604-2066-4cd2-a74e-c47a2dc4c449] Updating instance_info_cache with network_info: [{"id": "78fd9337-1104-4248-9500-e9be75713371", "address": "fa:16:3e:b3:14:9a", "network": {"id": "0fc59e9a-15a6-41b6-aee1-f8d958b92246", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1263090607-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b40f07ee85b4c55b1725a43a8ee718d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78fd9337-11", "ovs_interfaceid": "78fd9337-1104-4248-9500-e9be75713371", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:45:36 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Releasing lock "refresh_cache-50c16604-2066-4cd2-a74e-c47a2dc4c449" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:45:36 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: 50c16604-2066-4cd2-a74e-c47a2dc4c449] Updated the network info_cache for instance {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 00:45:37 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-ae5b6e25-63b1-46ce-a65d-c14e83ebfff1 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75165) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 00:45:37 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae5b6e25-63b1-46ce-a65d-c14e83ebfff1 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:28483cbc-41a9-4961-9c30-fae820d1ad43', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RmaYIrVs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75165) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 00:45:37 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-ae5b6e25-63b1-46ce-a65d-c14e83ebfff1 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.304s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:45:37 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae5b6e25-63b1-46ce-a65d-c14e83ebfff1 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] <== connect_volume: return (1305ms) {'type': 'block', 'scsi_wwn': '26532343461376432', 'path': '/dev/sdb'} {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:45:37 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae5b6e25-63b1-46ce-a65d-c14e83ebfff1 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: b084f728-b8c4-4c9e-a856-18312012c110] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26532343461376432', 'path': '/dev/sdb'} {{(pid=75165) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 00:45:37 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-ae5b6e25-63b1-46ce-a65d-c14e83ebfff1 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:45:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1016085172',display_name='tempest-TestVolumeBootPattern-server-1016085172',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1016085172',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBChKvTLd4nhrj5htJzspkP8o+qgId41EjTR/fmBLYf3vmPpK9NBbxwvdQKkZqqXFiSi6AG6cvipLHicvfW4NLnZq3yjDwP+cF/yBIdW+iAQl3BC4GDkkyYulLa73yUYFmw==',key_name='tempest-TestVolumeBootPattern-819204347',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d1051405ca054c4bb051fb842a5fb5a0',ramdisk_id='',reservation_id='r-tq860558',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1215567595',owner_user_name='tempest-TestVolumeBootPattern-1215567595-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T00:45:18Z,user_data=None,user_id='ae836eab78514cf3894e5e11240ff374',uuid=b084f728-b8c4-4c9e-a856-18312012c110,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3b4b4194-dc5f-486c-83fd-93f7c0727fca", "address": "fa:16:3e:22:f3:aa", "network": {"id": "dc50ae7b-d501-461f-aa0b-542514330ae8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1091857056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1051405ca054c4bb051fb842a5fb5a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b4b4194-dc", "ovs_interfaceid": "3b4b4194-dc5f-486c-83fd-93f7c0727fca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75165) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 00:45:37 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-ae5b6e25-63b1-46ce-a65d-c14e83ebfff1 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Converting VIF {"id": "3b4b4194-dc5f-486c-83fd-93f7c0727fca", "address": "fa:16:3e:22:f3:aa", "network": {"id": "dc50ae7b-d501-461f-aa0b-542514330ae8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1091857056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1051405ca054c4bb051fb842a5fb5a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b4b4194-dc", "ovs_interfaceid": "3b4b4194-dc5f-486c-83fd-93f7c0727fca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:45:37 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-ae5b6e25-63b1-46ce-a65d-c14e83ebfff1 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:f3:aa,bridge_name='br-int',has_traffic_filtering=True,id=3b4b4194-dc5f-486c-83fd-93f7c0727fca,network=Network(dc50ae7b-d501-461f-aa0b-542514330ae8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b4b4194-dc') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:45:37 user nova-compute[75165]: DEBUG nova.objects.instance [None req-ae5b6e25-63b1-46ce-a65d-c14e83ebfff1 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Lazy-loading 'pci_devices' on Instance uuid b084f728-b8c4-4c9e-a856-18312012c110 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:45:37 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-ae5b6e25-63b1-46ce-a65d-c14e83ebfff1 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: b084f728-b8c4-4c9e-a856-18312012c110] End _get_guest_xml xml=<domain type="kvm">
Oct 26 00:45:37 user nova-compute[75165]:   <uuid>b084f728-b8c4-4c9e-a856-18312012c110</uuid>
Oct 26 00:45:37 user nova-compute[75165]:   <name>instance-0000002f</name>
Oct 26 00:45:37 user nova-compute[75165]:   <memory>524288</memory>
Oct 26 00:45:37 user nova-compute[75165]:   <vcpu>1</vcpu>
Oct 26 00:45:37 user nova-compute[75165]:   <metadata>
Oct 26 00:45:37 user nova-compute[75165]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 00:45:37 user nova-compute[75165]:       <nova:package version="0.0.0"/>
Oct 26 00:45:37 user nova-compute[75165]:       <nova:name>tempest-TestVolumeBootPattern-server-1016085172</nova:name>
Oct 26 00:45:37 user nova-compute[75165]:       <nova:creationTime>2023-10-26 00:45:35</nova:creationTime>
Oct 26 00:45:37 user nova-compute[75165]:       <nova:flavor name="m1.tiny">
Oct 26 00:45:37 user nova-compute[75165]:         <nova:memory>512</nova:memory>
Oct 26 00:45:37 user nova-compute[75165]:         <nova:disk>1</nova:disk>
Oct 26 00:45:37 user nova-compute[75165]:         <nova:swap>0</nova:swap>
Oct 26 00:45:37 user nova-compute[75165]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 00:45:37 user nova-compute[75165]:         <nova:vcpus>1</nova:vcpus>
Oct 26 00:45:37 user nova-compute[75165]:       </nova:flavor>
Oct 26 00:45:37 user nova-compute[75165]:       <nova:owner>
Oct 26 00:45:37 user nova-compute[75165]:         <nova:user uuid="ae836eab78514cf3894e5e11240ff374">tempest-TestVolumeBootPattern-1215567595-project-member</nova:user>
Oct 26 00:45:37 user nova-compute[75165]:         <nova:project uuid="d1051405ca054c4bb051fb842a5fb5a0">tempest-TestVolumeBootPattern-1215567595</nova:project>
Oct 26 00:45:37 user nova-compute[75165]:       </nova:owner>
Oct 26 00:45:37 user nova-compute[75165]:       <nova:ports>
Oct 26 00:45:37 user nova-compute[75165]:         <nova:port uuid="3b4b4194-dc5f-486c-83fd-93f7c0727fca">
Oct 26 00:45:37 user nova-compute[75165]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 26 00:45:37 user nova-compute[75165]:         </nova:port>
Oct 26 00:45:37 user nova-compute[75165]:       </nova:ports>
Oct 26 00:45:37 user nova-compute[75165]:     </nova:instance>
Oct 26 00:45:37 user nova-compute[75165]:   </metadata>
Oct 26 00:45:37 user nova-compute[75165]:   <sysinfo type="smbios">
Oct 26 00:45:37 user nova-compute[75165]:     <system>
Oct 26 00:45:37 user nova-compute[75165]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 00:45:37 user nova-compute[75165]:       <entry name="product">OpenStack Nova</entry>
Oct 26 00:45:37 user nova-compute[75165]:       <entry name="version">0.0.0</entry>
Oct 26 00:45:37 user nova-compute[75165]:       <entry name="serial">b084f728-b8c4-4c9e-a856-18312012c110</entry>
Oct 26 00:45:37 user nova-compute[75165]:       <entry name="uuid">b084f728-b8c4-4c9e-a856-18312012c110</entry>
Oct 26 00:45:37 user nova-compute[75165]:       <entry name="family">Virtual Machine</entry>
Oct 26 00:45:37 user nova-compute[75165]:     </system>
Oct 26 00:45:37 user nova-compute[75165]:   </sysinfo>
Oct 26 00:45:37 user nova-compute[75165]:   <os>
Oct 26 00:45:37 user nova-compute[75165]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 00:45:37 user nova-compute[75165]:     <boot dev="hd"/>
Oct 26 00:45:37 user nova-compute[75165]:     <smbios mode="sysinfo"/>
Oct 26 00:45:37 user nova-compute[75165]:   </os>
Oct 26 00:45:37 user nova-compute[75165]:   <features>
Oct 26 00:45:37 user nova-compute[75165]:     <acpi/>
Oct 26 00:45:37 user nova-compute[75165]:     <apic/>
Oct 26 00:45:37 user nova-compute[75165]:     <vmcoreinfo/>
Oct 26 00:45:37 user nova-compute[75165]:   </features>
Oct 26 00:45:37 user nova-compute[75165]:   <clock offset="utc">
Oct 26 00:45:37 user nova-compute[75165]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 00:45:37 user nova-compute[75165]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 00:45:37 user nova-compute[75165]:     <timer name="hpet" present="no"/>
Oct 26 00:45:37 user nova-compute[75165]:   </clock>
Oct 26 00:45:37 user nova-compute[75165]:   <cpu mode="custom" match="exact">
Oct 26 00:45:37 user nova-compute[75165]:     <model>Nehalem</model>
Oct 26 00:45:37 user nova-compute[75165]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 00:45:37 user nova-compute[75165]:   </cpu>
Oct 26 00:45:37 user nova-compute[75165]:   <devices>
Oct 26 00:45:37 user nova-compute[75165]:     <disk type="block" device="disk">
Oct 26 00:45:37 user nova-compute[75165]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 00:45:37 user nova-compute[75165]:       <source dev="/dev/sdb"/>
Oct 26 00:45:37 user nova-compute[75165]:       <target dev="vda" bus="virtio"/>
Oct 26 00:45:37 user nova-compute[75165]:       <serial>28483cbc-41a9-4961-9c30-fae820d1ad43</serial>
Oct 26 00:45:37 user nova-compute[75165]:     </disk>
Oct 26 00:45:37 user nova-compute[75165]:     <interface type="ethernet">
Oct 26 00:45:37 user nova-compute[75165]:       <mac address="fa:16:3e:22:f3:aa"/>
Oct 26 00:45:37 user nova-compute[75165]:       <model type="virtio"/>
Oct 26 00:45:37 user nova-compute[75165]:       <mtu size="1442"/>
Oct 26 00:45:37 user nova-compute[75165]:       <target dev="tap3b4b4194-dc"/>
Oct 26 00:45:37 user nova-compute[75165]:     </interface>
Oct 26 00:45:37 user nova-compute[75165]:     <serial type="pty">
Oct 26 00:45:37 user nova-compute[75165]:       <log file="/opt/stack/data/nova/instances/b084f728-b8c4-4c9e-a856-18312012c110/console.log" append="off"/>
Oct 26 00:45:37 user nova-compute[75165]:     </serial>
Oct 26 00:45:37 user nova-compute[75165]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 00:45:37 user nova-compute[75165]:     <video>
Oct 26 00:45:37 user nova-compute[75165]:       <model type="virtio"/>
Oct 26 00:45:37 user nova-compute[75165]:     </video>
Oct 26 00:45:37 user nova-compute[75165]:     <rng model="virtio">
Oct 26 00:45:37 user nova-compute[75165]:       <backend model="random">/dev/urandom</backend>
Oct 26 00:45:37 user nova-compute[75165]:     </rng>
Oct 26 00:45:37 user nova-compute[75165]:     <controller type="usb" index="0" model="none"/>
Oct 26 00:45:37 user nova-compute[75165]:     <memballoon model="virtio">
Oct 26 00:45:37 user nova-compute[75165]:       <stats period="10"/>
Oct 26 00:45:37 user nova-compute[75165]:     </memballoon>
Oct 26 00:45:37 user nova-compute[75165]:   </devices>
Oct 26 00:45:37 user nova-compute[75165]: </domain>
Oct 26 00:45:37 user nova-compute[75165]:  {{(pid=75165) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 00:45:37 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-ae5b6e25-63b1-46ce-a65d-c14e83ebfff1 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:45:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1016085172',display_name='tempest-TestVolumeBootPattern-server-1016085172',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1016085172',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBChKvTLd4nhrj5htJzspkP8o+qgId41EjTR/fmBLYf3vmPpK9NBbxwvdQKkZqqXFiSi6AG6cvipLHicvfW4NLnZq3yjDwP+cF/yBIdW+iAQl3BC4GDkkyYulLa73yUYFmw==',key_name='tempest-TestVolumeBootPattern-819204347',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d1051405ca054c4bb051fb842a5fb5a0',ramdisk_id='',reservation_id='r-tq860558',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1215567595',owner_user_name='tempest-TestVolumeBootPattern-1215567595-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T00:45:18Z,user_data=None,user_id='ae836eab78514cf3894e5e11240ff374',uuid=b084f728-b8c4-4c9e-a856-18312012c110,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3b4b4194-dc5f-486c-83fd-93f7c0727fca", "address": "fa:16:3e:22:f3:aa", "network": {"id": "dc50ae7b-d501-461f-aa0b-542514330ae8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1091857056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1051405ca054c4bb051fb842a5fb5a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b4b4194-dc", "ovs_interfaceid": "3b4b4194-dc5f-486c-83fd-93f7c0727fca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 00:45:37 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-ae5b6e25-63b1-46ce-a65d-c14e83ebfff1 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Converting VIF {"id": "3b4b4194-dc5f-486c-83fd-93f7c0727fca", "address": "fa:16:3e:22:f3:aa", "network": {"id": "dc50ae7b-d501-461f-aa0b-542514330ae8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1091857056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1051405ca054c4bb051fb842a5fb5a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b4b4194-dc", "ovs_interfaceid": "3b4b4194-dc5f-486c-83fd-93f7c0727fca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:45:37 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-ae5b6e25-63b1-46ce-a65d-c14e83ebfff1 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:f3:aa,bridge_name='br-int',has_traffic_filtering=True,id=3b4b4194-dc5f-486c-83fd-93f7c0727fca,network=Network(dc50ae7b-d501-461f-aa0b-542514330ae8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b4b4194-dc') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:45:37 user nova-compute[75165]: DEBUG os_vif [None req-ae5b6e25-63b1-46ce-a65d-c14e83ebfff1 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:f3:aa,bridge_name='br-int',has_traffic_filtering=True,id=3b4b4194-dc5f-486c-83fd-93f7c0727fca,network=Network(dc50ae7b-d501-461f-aa0b-542514330ae8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b4b4194-dc') {{(pid=75165) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 00:45:37 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:45:37 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:45:37 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 00:45:37 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:45:37 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cce8e909-0d45-5953-b81b-e55f7fee454b', '_type': 'linux-noop'}}, row=False) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:45:37 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:45:37 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:45:37 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:45:37 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3b4b4194-dc, may_exist=True, interface_attrs={}) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:45:37 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3b4b4194-dc, col_values=(('qos', UUID('103b69ea-df74-4b5f-8965-aef05e9afa5b')),), if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:45:37 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3b4b4194-dc, col_values=(('external_ids', {'iface-id': '3b4b4194-dc5f-486c-83fd-93f7c0727fca', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:22:f3:aa', 'vm-uuid': 'b084f728-b8c4-4c9e-a856-18312012c110'}),), if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:45:37 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:45:37 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:45:37 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:45:37 user nova-compute[75165]: INFO os_vif [None req-ae5b6e25-63b1-46ce-a65d-c14e83ebfff1 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:f3:aa,bridge_name='br-int',has_traffic_filtering=True,id=3b4b4194-dc5f-486c-83fd-93f7c0727fca,network=Network(dc50ae7b-d501-461f-aa0b-542514330ae8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b4b4194-dc')
Oct 26 00:45:37 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:45:37 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-ae5b6e25-63b1-46ce-a65d-c14e83ebfff1 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] No BDM found with device name vda, not building metadata. {{(pid=75165) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 00:45:37 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-ae5b6e25-63b1-46ce-a65d-c14e83ebfff1 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] No VIF found with MAC fa:16:3e:22:f3:aa, not building metadata {{(pid=75165) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 00:45:38 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:45:38 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:45:38 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:45:38 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:45:38 user nova-compute[75165]: DEBUG nova.compute.manager [req-e40a845e-95d4-440f-bd5a-48ab473e23dd req-32e2c63c-ddf6-405d-84ad-8f56bed0a0fa service nova] [instance: b084f728-b8c4-4c9e-a856-18312012c110] Received event network-vif-plugged-3b4b4194-dc5f-486c-83fd-93f7c0727fca {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:45:38 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-e40a845e-95d4-440f-bd5a-48ab473e23dd req-32e2c63c-ddf6-405d-84ad-8f56bed0a0fa service nova] Acquiring lock "b084f728-b8c4-4c9e-a856-18312012c110-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:45:38 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-e40a845e-95d4-440f-bd5a-48ab473e23dd req-32e2c63c-ddf6-405d-84ad-8f56bed0a0fa service nova] Lock "b084f728-b8c4-4c9e-a856-18312012c110-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:45:38 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-e40a845e-95d4-440f-bd5a-48ab473e23dd req-32e2c63c-ddf6-405d-84ad-8f56bed0a0fa service nova] Lock "b084f728-b8c4-4c9e-a856-18312012c110-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:45:38 user nova-compute[75165]: DEBUG nova.compute.manager [req-e40a845e-95d4-440f-bd5a-48ab473e23dd req-32e2c63c-ddf6-405d-84ad-8f56bed0a0fa service nova] [instance: b084f728-b8c4-4c9e-a856-18312012c110] No waiting events found dispatching network-vif-plugged-3b4b4194-dc5f-486c-83fd-93f7c0727fca {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:45:38 user nova-compute[75165]: WARNING nova.compute.manager [req-e40a845e-95d4-440f-bd5a-48ab473e23dd req-32e2c63c-ddf6-405d-84ad-8f56bed0a0fa service nova] [instance: b084f728-b8c4-4c9e-a856-18312012c110] Received unexpected event network-vif-plugged-3b4b4194-dc5f-486c-83fd-93f7c0727fca for instance with vm_state building and task_state spawning.
Oct 26 00:45:39 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:45:39 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:45:39 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:45:39 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:45:39 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:45:39 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:45:39 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:45:39 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:45:39 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75165) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 00:45:39 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c16604-2066-4cd2-a74e-c47a2dc4c449/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:45:40 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c16604-2066-4cd2-a74e-c47a2dc4c449/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:45:40 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c16604-2066-4cd2-a74e-c47a2dc4c449/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:45:40 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50c16604-2066-4cd2-a74e-c47a2dc4c449/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:45:40 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75165) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 00:45:40 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/624db3ad-20f2-4302-8fec-b77a5b8ebc39/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:45:40 user nova-compute[75165]: DEBUG nova.compute.manager [None req-ae5b6e25-63b1-46ce-a65d-c14e83ebfff1 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: b084f728-b8c4-4c9e-a856-18312012c110] Instance event wait completed in 0 seconds for  {{(pid=75165) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 00:45:40 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-ae5b6e25-63b1-46ce-a65d-c14e83ebfff1 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: b084f728-b8c4-4c9e-a856-18312012c110] Guest created on hypervisor {{(pid=75165) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 00:45:40 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: b084f728-b8c4-4c9e-a856-18312012c110] Instance spawned successfully.
Oct 26 00:45:40 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-ae5b6e25-63b1-46ce-a65d-c14e83ebfff1 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: b084f728-b8c4-4c9e-a856-18312012c110] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 00:45:40 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/624db3ad-20f2-4302-8fec-b77a5b8ebc39/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:45:40 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/624db3ad-20f2-4302-8fec-b77a5b8ebc39/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:45:40 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-ae5b6e25-63b1-46ce-a65d-c14e83ebfff1 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: b084f728-b8c4-4c9e-a856-18312012c110] Found default for hw_cdrom_bus of ide {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:45:40 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-ae5b6e25-63b1-46ce-a65d-c14e83ebfff1 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: b084f728-b8c4-4c9e-a856-18312012c110] Found default for hw_disk_bus of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:45:40 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-ae5b6e25-63b1-46ce-a65d-c14e83ebfff1 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: b084f728-b8c4-4c9e-a856-18312012c110] Found default for hw_input_bus of None {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:45:40 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-ae5b6e25-63b1-46ce-a65d-c14e83ebfff1 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: b084f728-b8c4-4c9e-a856-18312012c110] Found default for hw_pointer_model of None {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:45:40 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-ae5b6e25-63b1-46ce-a65d-c14e83ebfff1 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: b084f728-b8c4-4c9e-a856-18312012c110] Found default for hw_video_model of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:45:40 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-ae5b6e25-63b1-46ce-a65d-c14e83ebfff1 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: b084f728-b8c4-4c9e-a856-18312012c110] Found default for hw_vif_model of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:45:40 user nova-compute[75165]: DEBUG nova.compute.manager [req-f1b2186f-37ad-4b82-8003-0f009b4fe997 req-39dfcbfe-4163-4dd4-bb25-7bf95d0c8cad service nova] [instance: b084f728-b8c4-4c9e-a856-18312012c110] Received event network-vif-plugged-3b4b4194-dc5f-486c-83fd-93f7c0727fca {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:45:40 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-f1b2186f-37ad-4b82-8003-0f009b4fe997 req-39dfcbfe-4163-4dd4-bb25-7bf95d0c8cad service nova] Acquiring lock "b084f728-b8c4-4c9e-a856-18312012c110-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:45:40 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-f1b2186f-37ad-4b82-8003-0f009b4fe997 req-39dfcbfe-4163-4dd4-bb25-7bf95d0c8cad service nova] Lock "b084f728-b8c4-4c9e-a856-18312012c110-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:45:40 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-f1b2186f-37ad-4b82-8003-0f009b4fe997 req-39dfcbfe-4163-4dd4-bb25-7bf95d0c8cad service nova] Lock "b084f728-b8c4-4c9e-a856-18312012c110-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:45:40 user nova-compute[75165]: DEBUG nova.compute.manager [req-f1b2186f-37ad-4b82-8003-0f009b4fe997 req-39dfcbfe-4163-4dd4-bb25-7bf95d0c8cad service nova] [instance: b084f728-b8c4-4c9e-a856-18312012c110] No waiting events found dispatching network-vif-plugged-3b4b4194-dc5f-486c-83fd-93f7c0727fca {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:45:40 user nova-compute[75165]: WARNING nova.compute.manager [req-f1b2186f-37ad-4b82-8003-0f009b4fe997 req-39dfcbfe-4163-4dd4-bb25-7bf95d0c8cad service nova] [instance: b084f728-b8c4-4c9e-a856-18312012c110] Received unexpected event network-vif-plugged-3b4b4194-dc5f-486c-83fd-93f7c0727fca for instance with vm_state building and task_state spawning.
Oct 26 00:45:40 user nova-compute[75165]: INFO nova.compute.manager [None req-ae5b6e25-63b1-46ce-a65d-c14e83ebfff1 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: b084f728-b8c4-4c9e-a856-18312012c110] Took 5.06 seconds to spawn the instance on the hypervisor.
Oct 26 00:45:40 user nova-compute[75165]: DEBUG nova.compute.manager [None req-ae5b6e25-63b1-46ce-a65d-c14e83ebfff1 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: b084f728-b8c4-4c9e-a856-18312012c110] Checking state {{(pid=75165) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 00:45:40 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/624db3ad-20f2-4302-8fec-b77a5b8ebc39/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:45:41 user nova-compute[75165]: INFO nova.compute.manager [None req-ae5b6e25-63b1-46ce-a65d-c14e83ebfff1 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: b084f728-b8c4-4c9e-a856-18312012c110] Took 23.03 seconds to build instance.
Oct 26 00:45:41 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:45:41 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:45:41 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Hypervisor/Node resource view: name=user free_ram=8839MB free_disk=24.825199127197266GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75165) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 00:45:41 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:45:41 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:45:41 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-ae5b6e25-63b1-46ce-a65d-c14e83ebfff1 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Lock "b084f728-b8c4-4c9e-a856-18312012c110" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 23.118s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:45:41 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 50c16604-2066-4cd2-a74e-c47a2dc4c449 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:45:41 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance b084f728-b8c4-4c9e-a856-18312012c110 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:45:41 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 624db3ad-20f2-4302-8fec-b77a5b8ebc39 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:45:41 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75165) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 00:45:41 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75165) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 00:45:41 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:45:41 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:45:41 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Compute_service record updated for user:user {{(pid=75165) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 00:45:41 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.245s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:45:42 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:45:42 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:45:43 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:45:43 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-cad0338a-ec6a-4b33-8c96-aba520d14017 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Acquiring lock "50c16604-2066-4cd2-a74e-c47a2dc4c449" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:45:43 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-cad0338a-ec6a-4b33-8c96-aba520d14017 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Lock "50c16604-2066-4cd2-a74e-c47a2dc4c449" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:45:43 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-cad0338a-ec6a-4b33-8c96-aba520d14017 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Acquiring lock "50c16604-2066-4cd2-a74e-c47a2dc4c449-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:45:43 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-cad0338a-ec6a-4b33-8c96-aba520d14017 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Lock "50c16604-2066-4cd2-a74e-c47a2dc4c449-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:45:43 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-cad0338a-ec6a-4b33-8c96-aba520d14017 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Lock "50c16604-2066-4cd2-a74e-c47a2dc4c449-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:45:43 user nova-compute[75165]: INFO nova.compute.manager [None req-cad0338a-ec6a-4b33-8c96-aba520d14017 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] [instance: 50c16604-2066-4cd2-a74e-c47a2dc4c449] Terminating instance
Oct 26 00:45:43 user nova-compute[75165]: DEBUG nova.compute.manager [None req-cad0338a-ec6a-4b33-8c96-aba520d14017 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] [instance: 50c16604-2066-4cd2-a74e-c47a2dc4c449] Start destroying the instance on the hypervisor. {{(pid=75165) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 00:45:44 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:45:44 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:45:44 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:45:44 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:45:44 user nova-compute[75165]: DEBUG nova.compute.manager [req-c969f1c0-e9dd-42d5-8edb-ec6c170e128b req-3bbfde82-fada-4ea0-9fbf-e4de572d75a7 service nova] [instance: 50c16604-2066-4cd2-a74e-c47a2dc4c449] Received event network-vif-unplugged-78fd9337-1104-4248-9500-e9be75713371 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:45:44 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-c969f1c0-e9dd-42d5-8edb-ec6c170e128b req-3bbfde82-fada-4ea0-9fbf-e4de572d75a7 service nova] Acquiring lock "50c16604-2066-4cd2-a74e-c47a2dc4c449-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:45:44 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-c969f1c0-e9dd-42d5-8edb-ec6c170e128b req-3bbfde82-fada-4ea0-9fbf-e4de572d75a7 service nova] Lock "50c16604-2066-4cd2-a74e-c47a2dc4c449-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:45:44 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-c969f1c0-e9dd-42d5-8edb-ec6c170e128b req-3bbfde82-fada-4ea0-9fbf-e4de572d75a7 service nova] Lock "50c16604-2066-4cd2-a74e-c47a2dc4c449-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:45:44 user nova-compute[75165]: DEBUG nova.compute.manager [req-c969f1c0-e9dd-42d5-8edb-ec6c170e128b req-3bbfde82-fada-4ea0-9fbf-e4de572d75a7 service nova] [instance: 50c16604-2066-4cd2-a74e-c47a2dc4c449] No waiting events found dispatching network-vif-unplugged-78fd9337-1104-4248-9500-e9be75713371 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:45:44 user nova-compute[75165]: DEBUG nova.compute.manager [req-c969f1c0-e9dd-42d5-8edb-ec6c170e128b req-3bbfde82-fada-4ea0-9fbf-e4de572d75a7 service nova] [instance: 50c16604-2066-4cd2-a74e-c47a2dc4c449] Received event network-vif-unplugged-78fd9337-1104-4248-9500-e9be75713371 for instance with task_state deleting. {{(pid=75165) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 00:45:44 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: 50c16604-2066-4cd2-a74e-c47a2dc4c449] Instance destroyed successfully.
Oct 26 00:45:44 user nova-compute[75165]: DEBUG nova.objects.instance [None req-cad0338a-ec6a-4b33-8c96-aba520d14017 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Lazy-loading 'resources' on Instance uuid 50c16604-2066-4cd2-a74e-c47a2dc4c449 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:45:44 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-cad0338a-ec6a-4b33-8c96-aba520d14017 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:41:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-469617276',display_name='tempest-TestServerVolumeAttachmentScenario-server-469617276',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-469617276',id=46,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEkLqXxwWP+dYmpAAuTh4YBiWOF7IbbyhmXv/ucq7KGRnuZOcJeqcAU6gKMEbdw+yJiYKPWThKrSo26lQyeTtBWzcVe6kHxdRwMWw456uyAY+K1ArXVzKSYImgqppBfk/A==',key_name='tempest-keypair-1964090332',keypairs=<?>,launch_index=0,launched_at=2023-10-26T00:41:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7b40f07ee85b4c55b1725a43a8ee718d',ramdisk_id='',reservation_id='r-lxm7yoqw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1254788731',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1254788731-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T00:41:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='613a2bfa5c6a41d99289eda4ab2a195c',uuid=50c16604-2066-4cd2-a74e-c47a2dc4c449,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "78fd9337-1104-4248-9500-e9be75713371", "address": "fa:16:3e:b3:14:9a", "network": {"id": "0fc59e9a-15a6-41b6-aee1-f8d958b92246", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1263090607-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b40f07ee85b4c55b1725a43a8ee718d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78fd9337-11", "ovs_interfaceid": "78fd9337-1104-4248-9500-e9be75713371", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 00:45:44 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-cad0338a-ec6a-4b33-8c96-aba520d14017 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Converting VIF {"id": "78fd9337-1104-4248-9500-e9be75713371", "address": "fa:16:3e:b3:14:9a", "network": {"id": "0fc59e9a-15a6-41b6-aee1-f8d958b92246", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1263090607-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b40f07ee85b4c55b1725a43a8ee718d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78fd9337-11", "ovs_interfaceid": "78fd9337-1104-4248-9500-e9be75713371", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:45:44 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-cad0338a-ec6a-4b33-8c96-aba520d14017 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b3:14:9a,bridge_name='br-int',has_traffic_filtering=True,id=78fd9337-1104-4248-9500-e9be75713371,network=Network(0fc59e9a-15a6-41b6-aee1-f8d958b92246),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78fd9337-11') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:45:44 user nova-compute[75165]: DEBUG os_vif [None req-cad0338a-ec6a-4b33-8c96-aba520d14017 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b3:14:9a,bridge_name='br-int',has_traffic_filtering=True,id=78fd9337-1104-4248-9500-e9be75713371,network=Network(0fc59e9a-15a6-41b6-aee1-f8d958b92246),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78fd9337-11') {{(pid=75165) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 00:45:44 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:45:44 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap78fd9337-11, bridge=br-int, if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:45:44 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:45:44 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:45:44 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:45:44 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2707fb33-e499-48b6-be46-ff07fa201f15) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:45:44 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:45:44 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:45:44 user nova-compute[75165]: INFO os_vif [None req-cad0338a-ec6a-4b33-8c96-aba520d14017 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b3:14:9a,bridge_name='br-int',has_traffic_filtering=True,id=78fd9337-1104-4248-9500-e9be75713371,network=Network(0fc59e9a-15a6-41b6-aee1-f8d958b92246),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78fd9337-11')
Oct 26 00:45:44 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-cad0338a-ec6a-4b33-8c96-aba520d14017 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] [instance: 50c16604-2066-4cd2-a74e-c47a2dc4c449] Deleting instance files /opt/stack/data/nova/instances/50c16604-2066-4cd2-a74e-c47a2dc4c449_del
Oct 26 00:45:44 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-cad0338a-ec6a-4b33-8c96-aba520d14017 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] [instance: 50c16604-2066-4cd2-a74e-c47a2dc4c449] Deletion of /opt/stack/data/nova/instances/50c16604-2066-4cd2-a74e-c47a2dc4c449_del complete
Oct 26 00:45:44 user nova-compute[75165]: INFO nova.compute.manager [None req-cad0338a-ec6a-4b33-8c96-aba520d14017 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] [instance: 50c16604-2066-4cd2-a74e-c47a2dc4c449] Took 0.95 seconds to destroy the instance on the hypervisor.
Oct 26 00:45:44 user nova-compute[75165]: DEBUG oslo.service.loopingcall [None req-cad0338a-ec6a-4b33-8c96-aba520d14017 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75165) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 00:45:44 user nova-compute[75165]: DEBUG nova.compute.manager [-] [instance: 50c16604-2066-4cd2-a74e-c47a2dc4c449] Deallocating network for instance {{(pid=75165) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 00:45:44 user nova-compute[75165]: DEBUG nova.network.neutron [-] [instance: 50c16604-2066-4cd2-a74e-c47a2dc4c449] deallocate_for_instance() {{(pid=75165) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 00:45:45 user nova-compute[75165]: DEBUG nova.network.neutron [-] [instance: 50c16604-2066-4cd2-a74e-c47a2dc4c449] Updating instance_info_cache with network_info: [] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:45:45 user nova-compute[75165]: INFO nova.compute.manager [-] [instance: 50c16604-2066-4cd2-a74e-c47a2dc4c449] Took 0.74 seconds to deallocate network for instance.
Oct 26 00:45:45 user nova-compute[75165]: DEBUG nova.compute.manager [req-e4a475dc-9e0c-4e08-bfcc-9f9ee07015bf req-1025f806-aadb-4860-9a7d-6e6759b37aeb service nova] [instance: 50c16604-2066-4cd2-a74e-c47a2dc4c449] Received event network-vif-deleted-78fd9337-1104-4248-9500-e9be75713371 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:45:45 user nova-compute[75165]: INFO nova.compute.manager [req-e4a475dc-9e0c-4e08-bfcc-9f9ee07015bf req-1025f806-aadb-4860-9a7d-6e6759b37aeb service nova] [instance: 50c16604-2066-4cd2-a74e-c47a2dc4c449] Neutron deleted interface 78fd9337-1104-4248-9500-e9be75713371; detaching it from the instance and deleting it from the info cache
Oct 26 00:45:45 user nova-compute[75165]: DEBUG nova.network.neutron [req-e4a475dc-9e0c-4e08-bfcc-9f9ee07015bf req-1025f806-aadb-4860-9a7d-6e6759b37aeb service nova] [instance: 50c16604-2066-4cd2-a74e-c47a2dc4c449] Updating instance_info_cache with network_info: [] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:45:45 user nova-compute[75165]: DEBUG nova.compute.manager [req-e4a475dc-9e0c-4e08-bfcc-9f9ee07015bf req-1025f806-aadb-4860-9a7d-6e6759b37aeb service nova] [instance: 50c16604-2066-4cd2-a74e-c47a2dc4c449] Detach interface failed, port_id=78fd9337-1104-4248-9500-e9be75713371, reason: Instance 50c16604-2066-4cd2-a74e-c47a2dc4c449 could not be found. {{(pid=75165) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 26 00:45:45 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-cad0338a-ec6a-4b33-8c96-aba520d14017 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:45:45 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-cad0338a-ec6a-4b33-8c96-aba520d14017 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:45:45 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-cad0338a-ec6a-4b33-8c96-aba520d14017 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:45:45 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-cad0338a-ec6a-4b33-8c96-aba520d14017 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:45:45 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-cad0338a-ec6a-4b33-8c96-aba520d14017 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.167s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:45:45 user nova-compute[75165]: INFO nova.scheduler.client.report [None req-cad0338a-ec6a-4b33-8c96-aba520d14017 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Deleted allocations for instance 50c16604-2066-4cd2-a74e-c47a2dc4c449
Oct 26 00:45:46 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-cad0338a-ec6a-4b33-8c96-aba520d14017 tempest-TestServerVolumeAttachmentScenario-1254788731 tempest-TestServerVolumeAttachmentScenario-1254788731-project-member] Lock "50c16604-2066-4cd2-a74e-c47a2dc4c449" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.140s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:45:46 user nova-compute[75165]: DEBUG nova.compute.manager [req-3e56c889-7505-4c7b-b058-2ec05b39fd2b req-e244d8ac-d1bd-4f7c-9f31-08bb97007fc5 service nova] [instance: 50c16604-2066-4cd2-a74e-c47a2dc4c449] Received event network-vif-plugged-78fd9337-1104-4248-9500-e9be75713371 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:45:46 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-3e56c889-7505-4c7b-b058-2ec05b39fd2b req-e244d8ac-d1bd-4f7c-9f31-08bb97007fc5 service nova] Acquiring lock "50c16604-2066-4cd2-a74e-c47a2dc4c449-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:45:46 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-3e56c889-7505-4c7b-b058-2ec05b39fd2b req-e244d8ac-d1bd-4f7c-9f31-08bb97007fc5 service nova] Lock "50c16604-2066-4cd2-a74e-c47a2dc4c449-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:45:46 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-3e56c889-7505-4c7b-b058-2ec05b39fd2b req-e244d8ac-d1bd-4f7c-9f31-08bb97007fc5 service nova] Lock "50c16604-2066-4cd2-a74e-c47a2dc4c449-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:45:46 user nova-compute[75165]: DEBUG nova.compute.manager [req-3e56c889-7505-4c7b-b058-2ec05b39fd2b req-e244d8ac-d1bd-4f7c-9f31-08bb97007fc5 service nova] [instance: 50c16604-2066-4cd2-a74e-c47a2dc4c449] No waiting events found dispatching network-vif-plugged-78fd9337-1104-4248-9500-e9be75713371 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:45:46 user nova-compute[75165]: WARNING nova.compute.manager [req-3e56c889-7505-4c7b-b058-2ec05b39fd2b req-e244d8ac-d1bd-4f7c-9f31-08bb97007fc5 service nova] [instance: 50c16604-2066-4cd2-a74e-c47a2dc4c449] Received unexpected event network-vif-plugged-78fd9337-1104-4248-9500-e9be75713371 for instance with vm_state deleted and task_state None.
Oct 26 00:45:49 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:45:52 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:45:54 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:45:57 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:45:59 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:46:02 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:46:04 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:46:07 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:46:09 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:46:12 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:46:14 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:46:19 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:46:24 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:46:26 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:46:26 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75165) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 00:46:29 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:46:30 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:46:31 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:46:34 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:46:34 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:46:34 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:46:35 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:46:35 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:46:36 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:46:36 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Starting heal instance info cache {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 00:46:36 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "refresh_cache-624db3ad-20f2-4302-8fec-b77a5b8ebc39" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:46:36 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquired lock "refresh_cache-624db3ad-20f2-4302-8fec-b77a5b8ebc39" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:46:36 user nova-compute[75165]: DEBUG nova.network.neutron [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: 624db3ad-20f2-4302-8fec-b77a5b8ebc39] Forcefully refreshing network info cache for instance {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 00:46:37 user nova-compute[75165]: DEBUG nova.network.neutron [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: 624db3ad-20f2-4302-8fec-b77a5b8ebc39] Updating instance_info_cache with network_info: [{"id": "7b2215ca-3a79-4fbe-bad8-7cea3a0c2dca", "address": "fa:16:3e:e4:cb:af", "network": {"id": "1801db1c-315e-4bdf-b73b-132a38bf41b8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1254756052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62572ce8ae524b55950532fd89729b71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b2215ca-3a", "ovs_interfaceid": "7b2215ca-3a79-4fbe-bad8-7cea3a0c2dca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:46:37 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Releasing lock "refresh_cache-624db3ad-20f2-4302-8fec-b77a5b8ebc39" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:46:37 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: 624db3ad-20f2-4302-8fec-b77a5b8ebc39] Updated the network info_cache for instance {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 00:46:39 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:46:39 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:46:39 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75165) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 00:46:39 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75165) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 00:46:39 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:46:39 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75165) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 00:46:40 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:46:40 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:46:40 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:46:40 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:46:40 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75165) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 00:46:40 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75165) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 00:46:40 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/624db3ad-20f2-4302-8fec-b77a5b8ebc39/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:46:41 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/624db3ad-20f2-4302-8fec-b77a5b8ebc39/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:46:41 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/624db3ad-20f2-4302-8fec-b77a5b8ebc39/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:46:41 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/624db3ad-20f2-4302-8fec-b77a5b8ebc39/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:46:41 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:46:41 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:46:41 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Hypervisor/Node resource view: name=user free_ram=8854MB free_disk=24.824127197265625GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75165) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 00:46:41 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:46:41 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:46:41 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance b084f728-b8c4-4c9e-a856-18312012c110 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:46:41 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 624db3ad-20f2-4302-8fec-b77a5b8ebc39 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:46:41 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75165) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 00:46:41 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75165) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 00:46:41 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:46:41 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:46:41 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Compute_service record updated for user:user {{(pid=75165) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 00:46:41 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.224s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:46:44 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:46:44 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:46:49 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:46:54 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:46:54 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:46:54 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75165) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 00:46:54 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75165) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 00:46:54 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75165) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 00:46:54 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:46:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:46:59 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:47:01 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:47:04 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:47:09 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:47:10 user nova-compute[75165]: DEBUG nova.compute.manager [req-15c1b57b-2caf-4177-8b27-cbfcc6ab19d9 req-3280eec0-b192-4aed-9bba-2776b36217de service nova] [instance: b084f728-b8c4-4c9e-a856-18312012c110] Received event network-changed-3b4b4194-dc5f-486c-83fd-93f7c0727fca {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:47:10 user nova-compute[75165]: DEBUG nova.compute.manager [req-15c1b57b-2caf-4177-8b27-cbfcc6ab19d9 req-3280eec0-b192-4aed-9bba-2776b36217de service nova] [instance: b084f728-b8c4-4c9e-a856-18312012c110] Refreshing instance network info cache due to event network-changed-3b4b4194-dc5f-486c-83fd-93f7c0727fca. {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 00:47:10 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-15c1b57b-2caf-4177-8b27-cbfcc6ab19d9 req-3280eec0-b192-4aed-9bba-2776b36217de service nova] Acquiring lock "refresh_cache-b084f728-b8c4-4c9e-a856-18312012c110" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:47:10 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-15c1b57b-2caf-4177-8b27-cbfcc6ab19d9 req-3280eec0-b192-4aed-9bba-2776b36217de service nova] Acquired lock "refresh_cache-b084f728-b8c4-4c9e-a856-18312012c110" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:47:10 user nova-compute[75165]: DEBUG nova.network.neutron [req-15c1b57b-2caf-4177-8b27-cbfcc6ab19d9 req-3280eec0-b192-4aed-9bba-2776b36217de service nova] [instance: b084f728-b8c4-4c9e-a856-18312012c110] Refreshing network info cache for port 3b4b4194-dc5f-486c-83fd-93f7c0727fca {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 00:47:10 user nova-compute[75165]: DEBUG nova.network.neutron [req-15c1b57b-2caf-4177-8b27-cbfcc6ab19d9 req-3280eec0-b192-4aed-9bba-2776b36217de service nova] [instance: b084f728-b8c4-4c9e-a856-18312012c110] Updated VIF entry in instance network info cache for port 3b4b4194-dc5f-486c-83fd-93f7c0727fca. {{(pid=75165) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 00:47:10 user nova-compute[75165]: DEBUG nova.network.neutron [req-15c1b57b-2caf-4177-8b27-cbfcc6ab19d9 req-3280eec0-b192-4aed-9bba-2776b36217de service nova] [instance: b084f728-b8c4-4c9e-a856-18312012c110] Updating instance_info_cache with network_info: [{"id": "3b4b4194-dc5f-486c-83fd-93f7c0727fca", "address": "fa:16:3e:22:f3:aa", "network": {"id": "dc50ae7b-d501-461f-aa0b-542514330ae8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1091857056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1051405ca054c4bb051fb842a5fb5a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b4b4194-dc", "ovs_interfaceid": "3b4b4194-dc5f-486c-83fd-93f7c0727fca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:47:10 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-15c1b57b-2caf-4177-8b27-cbfcc6ab19d9 req-3280eec0-b192-4aed-9bba-2776b36217de service nova] Releasing lock "refresh_cache-b084f728-b8c4-4c9e-a856-18312012c110" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:47:10 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-969be252-b007-43d5-83c6-a53c42d39a09 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Acquiring lock "b084f728-b8c4-4c9e-a856-18312012c110" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:47:10 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-969be252-b007-43d5-83c6-a53c42d39a09 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Lock "b084f728-b8c4-4c9e-a856-18312012c110" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:47:10 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-969be252-b007-43d5-83c6-a53c42d39a09 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Acquiring lock "b084f728-b8c4-4c9e-a856-18312012c110-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:47:10 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-969be252-b007-43d5-83c6-a53c42d39a09 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Lock "b084f728-b8c4-4c9e-a856-18312012c110-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:47:10 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-969be252-b007-43d5-83c6-a53c42d39a09 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Lock "b084f728-b8c4-4c9e-a856-18312012c110-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:47:10 user nova-compute[75165]: INFO nova.compute.manager [None req-969be252-b007-43d5-83c6-a53c42d39a09 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: b084f728-b8c4-4c9e-a856-18312012c110] Terminating instance
Oct 26 00:47:10 user nova-compute[75165]: DEBUG nova.compute.manager [None req-969be252-b007-43d5-83c6-a53c42d39a09 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: b084f728-b8c4-4c9e-a856-18312012c110] Start destroying the instance on the hypervisor. {{(pid=75165) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 00:47:10 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:47:11 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:47:11 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:47:11 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:47:11 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: b084f728-b8c4-4c9e-a856-18312012c110] Instance destroyed successfully.
Oct 26 00:47:11 user nova-compute[75165]: DEBUG nova.objects.instance [None req-969be252-b007-43d5-83c6-a53c42d39a09 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Lazy-loading 'resources' on Instance uuid b084f728-b8c4-4c9e-a856-18312012c110 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:47:11 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-969be252-b007-43d5-83c6-a53c42d39a09 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:45:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1016085172',display_name='tempest-TestVolumeBootPattern-server-1016085172',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1016085172',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBChKvTLd4nhrj5htJzspkP8o+qgId41EjTR/fmBLYf3vmPpK9NBbxwvdQKkZqqXFiSi6AG6cvipLHicvfW4NLnZq3yjDwP+cF/yBIdW+iAQl3BC4GDkkyYulLa73yUYFmw==',key_name='tempest-TestVolumeBootPattern-819204347',keypairs=<?>,launch_index=0,launched_at=2023-10-26T00:45:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d1051405ca054c4bb051fb842a5fb5a0',ramdisk_id='',reservation_id='r-tq860558',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1215567595',owner_user_name='tempest-TestVolumeBootPattern-1215567595-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T00:45:41Z,user_data=None,user_id='ae836eab78514cf3894e5e11240ff374',uuid=b084f728-b8c4-4c9e-a856-18312012c110,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3b4b4194-dc5f-486c-83fd-93f7c0727fca", "address": "fa:16:3e:22:f3:aa", "network": {"id": "dc50ae7b-d501-461f-aa0b-542514330ae8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1091857056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1051405ca054c4bb051fb842a5fb5a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b4b4194-dc", "ovs_interfaceid": "3b4b4194-dc5f-486c-83fd-93f7c0727fca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 00:47:11 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-969be252-b007-43d5-83c6-a53c42d39a09 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Converting VIF {"id": "3b4b4194-dc5f-486c-83fd-93f7c0727fca", "address": "fa:16:3e:22:f3:aa", "network": {"id": "dc50ae7b-d501-461f-aa0b-542514330ae8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1091857056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1051405ca054c4bb051fb842a5fb5a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b4b4194-dc", "ovs_interfaceid": "3b4b4194-dc5f-486c-83fd-93f7c0727fca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:47:11 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-969be252-b007-43d5-83c6-a53c42d39a09 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:22:f3:aa,bridge_name='br-int',has_traffic_filtering=True,id=3b4b4194-dc5f-486c-83fd-93f7c0727fca,network=Network(dc50ae7b-d501-461f-aa0b-542514330ae8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b4b4194-dc') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:47:11 user nova-compute[75165]: DEBUG os_vif [None req-969be252-b007-43d5-83c6-a53c42d39a09 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:22:f3:aa,bridge_name='br-int',has_traffic_filtering=True,id=3b4b4194-dc5f-486c-83fd-93f7c0727fca,network=Network(dc50ae7b-d501-461f-aa0b-542514330ae8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b4b4194-dc') {{(pid=75165) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 00:47:11 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:47:11 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3b4b4194-dc, bridge=br-int, if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:47:11 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:47:11 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:47:11 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:47:11 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=103b69ea-df74-4b5f-8965-aef05e9afa5b) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:47:11 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:47:11 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:47:11 user nova-compute[75165]: INFO os_vif [None req-969be252-b007-43d5-83c6-a53c42d39a09 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:22:f3:aa,bridge_name='br-int',has_traffic_filtering=True,id=3b4b4194-dc5f-486c-83fd-93f7c0727fca,network=Network(dc50ae7b-d501-461f-aa0b-542514330ae8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b4b4194-dc')
Oct 26 00:47:11 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-969be252-b007-43d5-83c6-a53c42d39a09 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: b084f728-b8c4-4c9e-a856-18312012c110] calling os-brick to detach iSCSI Volume {{(pid=75165) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 00:47:11 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-969be252-b007-43d5-83c6-a53c42d39a09 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8bf8160e50>, {'target_iqn': 'iqn.2010-10.org.openstack:28483cbc-41a9-4961-9c30-fae820d1ad43', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RmaYIrVs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:47:11 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-969be252-b007-43d5-83c6-a53c42d39a09 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:47:11 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-969be252-b007-43d5-83c6-a53c42d39a09 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:47:11 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-969be252-b007-43d5-83c6-a53c42d39a09 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:47:11 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:47:11 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:47:11 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[9110aa75-44a1-4d0b-bdf2-1366a961cb36]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:28483cbc-41a9-4961-9c30-fae820d1ad43\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:47:11 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-969be252-b007-43d5-83c6-a53c42d39a09 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 00:47:11 user nova-compute[75165]: No targets found.
Oct 26 00:47:11 user nova-compute[75165]: iSNS:
Oct 26 00:47:11 user nova-compute[75165]: No targets found.
Oct 26 00:47:11 user nova-compute[75165]: STATIC:
Oct 26 00:47:11 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:28483cbc-41a9-4961-9c30-fae820d1ad43
Oct 26 00:47:11 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:47:11 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:47:11 user nova-compute[75165]: FIRMWARE:
Oct 26 00:47:11 user nova-compute[75165]: No targets found.
Oct 26 00:47:11 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:47:11 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-969be252-b007-43d5-83c6-a53c42d39a09 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 00:47:11 user nova-compute[75165]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 00:47:11 user nova-compute[75165]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75165) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 00:47:11 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-969be252-b007-43d5-83c6-a53c42d39a09 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:28483cbc-41a9-4961-9c30-fae820d1ad43', 0)] {{(pid=75165) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 00:47:11 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:47:11 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:47:11 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[845ea3ca-2ffc-4a77-8d59-559db9bb8551]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:28483cbc-41a9-4961-9c30-fae820d1ad43\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:47:11 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:47:11 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:47:11 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[782318ab-d694-401e-982b-63e4f92ad792]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28483cbc-41a9-4961-9c30-fae820d1ad43 (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:47:11 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-969be252-b007-43d5-83c6-a53c42d39a09 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28483cbc-41a9-4961-9c30-fae820d1ad43 (non-flash)
Oct 26 00:47:11 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:47:11 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-969be252-b007-43d5-83c6-a53c42d39a09 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28483cbc-41a9-4961-9c30-fae820d1ad43 (non-flash)
Oct 26 00:47:11 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:47:11 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-969be252-b007-43d5-83c6-a53c42d39a09 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8bf82a15a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:28483cbc-41a9-4961-9c30-fae820d1ad43'): ({'sdb'}, set())}) {{(pid=75165) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 00:47:11 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-969be252-b007-43d5-83c6-a53c42d39a09 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Removing single pathed devices sdb {{(pid=75165) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 00:47:11 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:47:11 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:47:11 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[f253fcde-80a0-4507-973a-bb18ff5ba0f0]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:47:11 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:47:11 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:47:11 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[b84b785e-e0f2-414b-8d35-dd01eec472ba]: (4, ('ok\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:47:11 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-969be252-b007-43d5-83c6-a53c42d39a09 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Flushing IO for device /dev/sdb {{(pid=75165) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 00:47:11 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:47:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.132s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:47:12 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[46b04239-711a-4825-9aac-e2a77b9a85e3]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:47:12 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-969be252-b007-43d5-83c6-a53c42d39a09 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75165) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 00:47:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:47:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:47:12 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[b945f18b-5736-4a54-a5dc-1ec3554cd4d5]: (4, ('1', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:47:12 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-969be252-b007-43d5-83c6-a53c42d39a09 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75165) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 00:47:12 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-969be252-b007-43d5-83c6-a53c42d39a09 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] SCSI volumes sdb have been removed. {{(pid=75165) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 00:47:12 user nova-compute[75165]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO896f712-e244a7d2e72901f0', '/dev/disk/by-id/scsi-26532343461376432', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_896f712') {{(pid=86976) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 26 00:47:12 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[40c81ef4-aed3-4414-a5a4-62016d854b76]: (4, None) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:47:12 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-969be252-b007-43d5-83c6-a53c42d39a09 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:28483cbc-41a9-4961-9c30-fae820d1ad43')] {{(pid=75165) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 00:47:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28483cbc-41a9-4961-9c30-fae820d1ad43 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:47:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28483cbc-41a9-4961-9c30-fae820d1ad43 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:47:12 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c098a07-f454-4d50-88f0-6e6b75c4c96c]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:47:12 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-969be252-b007-43d5-83c6-a53c42d39a09 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:47:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28483cbc-41a9-4961-9c30-fae820d1ad43 -p 172.16.0.220:3260 --logout {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:47:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28483cbc-41a9-4961-9c30-fae820d1ad43 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:47:12 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f63a3cc-951e-4f97-a8fb-303e893511f9]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:28483cbc-41a9-4961-9c30-fae820d1ad43, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:28483cbc-41a9-4961-9c30-fae820d1ad43, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:47:12 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-969be252-b007-43d5-83c6-a53c42d39a09 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:28483cbc-41a9-4961-9c30-fae820d1ad43, portal: 172.16.0.220,3260]
Oct 26 00:47:12 user nova-compute[75165]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:28483cbc-41a9-4961-9c30-fae820d1ad43, portal: 172.16.0.220,3260] successful.
Oct 26 00:47:12 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:47:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28483cbc-41a9-4961-9c30-fae820d1ad43 -p 172.16.0.220:3260 --op delete {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:47:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28483cbc-41a9-4961-9c30-fae820d1ad43 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:47:12 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d42bd13-7cf0-4963-b980-e4fcaa937d42]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:47:12 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-969be252-b007-43d5-83c6-a53c42d39a09 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:47:12 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-969be252-b007-43d5-83c6-a53c42d39a09 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.420s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:47:12 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-969be252-b007-43d5-83c6-a53c42d39a09 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] <== disconnect_volume: return (422ms) None {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:47:12 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-969be252-b007-43d5-83c6-a53c42d39a09 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: b084f728-b8c4-4c9e-a856-18312012c110] Disconnected iSCSI Volume {{(pid=75165) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 00:47:12 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-969be252-b007-43d5-83c6-a53c42d39a09 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: b084f728-b8c4-4c9e-a856-18312012c110] Deleting instance files /opt/stack/data/nova/instances/b084f728-b8c4-4c9e-a856-18312012c110_del
Oct 26 00:47:12 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-969be252-b007-43d5-83c6-a53c42d39a09 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: b084f728-b8c4-4c9e-a856-18312012c110] Deletion of /opt/stack/data/nova/instances/b084f728-b8c4-4c9e-a856-18312012c110_del complete
Oct 26 00:47:12 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:47:12 user nova-compute[75165]: INFO nova.compute.manager [None req-969be252-b007-43d5-83c6-a53c42d39a09 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: b084f728-b8c4-4c9e-a856-18312012c110] Took 1.31 seconds to destroy the instance on the hypervisor.
Oct 26 00:47:12 user nova-compute[75165]: DEBUG oslo.service.loopingcall [None req-969be252-b007-43d5-83c6-a53c42d39a09 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75165) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 00:47:12 user nova-compute[75165]: DEBUG nova.compute.manager [-] [instance: b084f728-b8c4-4c9e-a856-18312012c110] Deallocating network for instance {{(pid=75165) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 00:47:12 user nova-compute[75165]: DEBUG nova.network.neutron [-] [instance: b084f728-b8c4-4c9e-a856-18312012c110] deallocate_for_instance() {{(pid=75165) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 00:47:12 user nova-compute[75165]: DEBUG nova.compute.manager [req-95faa970-af8d-4d21-9696-ed9cb35dd020 req-16fac868-6f5e-41c2-a2bb-509b8a1eb38f service nova] [instance: b084f728-b8c4-4c9e-a856-18312012c110] Received event network-vif-unplugged-3b4b4194-dc5f-486c-83fd-93f7c0727fca {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:47:12 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-95faa970-af8d-4d21-9696-ed9cb35dd020 req-16fac868-6f5e-41c2-a2bb-509b8a1eb38f service nova] Acquiring lock "b084f728-b8c4-4c9e-a856-18312012c110-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:47:12 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-95faa970-af8d-4d21-9696-ed9cb35dd020 req-16fac868-6f5e-41c2-a2bb-509b8a1eb38f service nova] Lock "b084f728-b8c4-4c9e-a856-18312012c110-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:47:12 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-95faa970-af8d-4d21-9696-ed9cb35dd020 req-16fac868-6f5e-41c2-a2bb-509b8a1eb38f service nova] Lock "b084f728-b8c4-4c9e-a856-18312012c110-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:47:12 user nova-compute[75165]: DEBUG nova.compute.manager [req-95faa970-af8d-4d21-9696-ed9cb35dd020 req-16fac868-6f5e-41c2-a2bb-509b8a1eb38f service nova] [instance: b084f728-b8c4-4c9e-a856-18312012c110] No waiting events found dispatching network-vif-unplugged-3b4b4194-dc5f-486c-83fd-93f7c0727fca {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:47:12 user nova-compute[75165]: DEBUG nova.compute.manager [req-95faa970-af8d-4d21-9696-ed9cb35dd020 req-16fac868-6f5e-41c2-a2bb-509b8a1eb38f service nova] [instance: b084f728-b8c4-4c9e-a856-18312012c110] Received event network-vif-unplugged-3b4b4194-dc5f-486c-83fd-93f7c0727fca for instance with task_state deleting. {{(pid=75165) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 00:47:12 user nova-compute[75165]: DEBUG nova.compute.manager [req-95faa970-af8d-4d21-9696-ed9cb35dd020 req-16fac868-6f5e-41c2-a2bb-509b8a1eb38f service nova] [instance: b084f728-b8c4-4c9e-a856-18312012c110] Received event network-vif-plugged-3b4b4194-dc5f-486c-83fd-93f7c0727fca {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:47:12 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-95faa970-af8d-4d21-9696-ed9cb35dd020 req-16fac868-6f5e-41c2-a2bb-509b8a1eb38f service nova] Acquiring lock "b084f728-b8c4-4c9e-a856-18312012c110-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:47:12 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-95faa970-af8d-4d21-9696-ed9cb35dd020 req-16fac868-6f5e-41c2-a2bb-509b8a1eb38f service nova] Lock "b084f728-b8c4-4c9e-a856-18312012c110-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:47:12 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-95faa970-af8d-4d21-9696-ed9cb35dd020 req-16fac868-6f5e-41c2-a2bb-509b8a1eb38f service nova] Lock "b084f728-b8c4-4c9e-a856-18312012c110-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:47:12 user nova-compute[75165]: DEBUG nova.compute.manager [req-95faa970-af8d-4d21-9696-ed9cb35dd020 req-16fac868-6f5e-41c2-a2bb-509b8a1eb38f service nova] [instance: b084f728-b8c4-4c9e-a856-18312012c110] No waiting events found dispatching network-vif-plugged-3b4b4194-dc5f-486c-83fd-93f7c0727fca {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:47:12 user nova-compute[75165]: WARNING nova.compute.manager [req-95faa970-af8d-4d21-9696-ed9cb35dd020 req-16fac868-6f5e-41c2-a2bb-509b8a1eb38f service nova] [instance: b084f728-b8c4-4c9e-a856-18312012c110] Received unexpected event network-vif-plugged-3b4b4194-dc5f-486c-83fd-93f7c0727fca for instance with vm_state active and task_state deleting.
Oct 26 00:47:12 user nova-compute[75165]: DEBUG nova.network.neutron [-] [instance: b084f728-b8c4-4c9e-a856-18312012c110] Updating instance_info_cache with network_info: [] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:47:12 user nova-compute[75165]: INFO nova.compute.manager [-] [instance: b084f728-b8c4-4c9e-a856-18312012c110] Took 0.75 seconds to deallocate network for instance.
Oct 26 00:47:13 user nova-compute[75165]: DEBUG nova.compute.manager [req-9693c70e-3dc0-4f5b-a0a2-bf766c9afe9a req-020de7ed-6a71-481e-bc9b-5819402f630e service nova] [instance: b084f728-b8c4-4c9e-a856-18312012c110] Received event network-vif-deleted-3b4b4194-dc5f-486c-83fd-93f7c0727fca {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:47:13 user nova-compute[75165]: INFO nova.compute.manager [None req-969be252-b007-43d5-83c6-a53c42d39a09 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: b084f728-b8c4-4c9e-a856-18312012c110] Took 0.96 seconds to detach 1 volumes for instance.
Oct 26 00:47:14 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-969be252-b007-43d5-83c6-a53c42d39a09 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:47:14 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-969be252-b007-43d5-83c6-a53c42d39a09 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:47:14 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-969be252-b007-43d5-83c6-a53c42d39a09 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:47:14 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-969be252-b007-43d5-83c6-a53c42d39a09 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:47:14 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-969be252-b007-43d5-83c6-a53c42d39a09 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.147s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:47:14 user nova-compute[75165]: INFO nova.scheduler.client.report [None req-969be252-b007-43d5-83c6-a53c42d39a09 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Deleted allocations for instance b084f728-b8c4-4c9e-a856-18312012c110
Oct 26 00:47:14 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-969be252-b007-43d5-83c6-a53c42d39a09 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Lock "b084f728-b8c4-4c9e-a856-18312012c110" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.380s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:47:16 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:47:19 user nova-compute[75165]: DEBUG nova.compute.manager [req-7ea0dbf9-b1a4-4d35-802b-2efbdd489ce2 req-8e67ad49-88fc-4535-bdde-3ea8ae5e9ef2 service nova] [instance: 624db3ad-20f2-4302-8fec-b77a5b8ebc39] Received event network-changed-7b2215ca-3a79-4fbe-bad8-7cea3a0c2dca {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:47:19 user nova-compute[75165]: DEBUG nova.compute.manager [req-7ea0dbf9-b1a4-4d35-802b-2efbdd489ce2 req-8e67ad49-88fc-4535-bdde-3ea8ae5e9ef2 service nova] [instance: 624db3ad-20f2-4302-8fec-b77a5b8ebc39] Refreshing instance network info cache due to event network-changed-7b2215ca-3a79-4fbe-bad8-7cea3a0c2dca. {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 00:47:19 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-7ea0dbf9-b1a4-4d35-802b-2efbdd489ce2 req-8e67ad49-88fc-4535-bdde-3ea8ae5e9ef2 service nova] Acquiring lock "refresh_cache-624db3ad-20f2-4302-8fec-b77a5b8ebc39" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:47:19 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-7ea0dbf9-b1a4-4d35-802b-2efbdd489ce2 req-8e67ad49-88fc-4535-bdde-3ea8ae5e9ef2 service nova] Acquired lock "refresh_cache-624db3ad-20f2-4302-8fec-b77a5b8ebc39" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:47:19 user nova-compute[75165]: DEBUG nova.network.neutron [req-7ea0dbf9-b1a4-4d35-802b-2efbdd489ce2 req-8e67ad49-88fc-4535-bdde-3ea8ae5e9ef2 service nova] [instance: 624db3ad-20f2-4302-8fec-b77a5b8ebc39] Refreshing network info cache for port 7b2215ca-3a79-4fbe-bad8-7cea3a0c2dca {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 00:47:20 user nova-compute[75165]: DEBUG nova.network.neutron [req-7ea0dbf9-b1a4-4d35-802b-2efbdd489ce2 req-8e67ad49-88fc-4535-bdde-3ea8ae5e9ef2 service nova] [instance: 624db3ad-20f2-4302-8fec-b77a5b8ebc39] Updated VIF entry in instance network info cache for port 7b2215ca-3a79-4fbe-bad8-7cea3a0c2dca. {{(pid=75165) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 00:47:20 user nova-compute[75165]: DEBUG nova.network.neutron [req-7ea0dbf9-b1a4-4d35-802b-2efbdd489ce2 req-8e67ad49-88fc-4535-bdde-3ea8ae5e9ef2 service nova] [instance: 624db3ad-20f2-4302-8fec-b77a5b8ebc39] Updating instance_info_cache with network_info: [{"id": "7b2215ca-3a79-4fbe-bad8-7cea3a0c2dca", "address": "fa:16:3e:e4:cb:af", "network": {"id": "1801db1c-315e-4bdf-b73b-132a38bf41b8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1254756052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62572ce8ae524b55950532fd89729b71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b2215ca-3a", "ovs_interfaceid": "7b2215ca-3a79-4fbe-bad8-7cea3a0c2dca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:47:20 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-7ea0dbf9-b1a4-4d35-802b-2efbdd489ce2 req-8e67ad49-88fc-4535-bdde-3ea8ae5e9ef2 service nova] Releasing lock "refresh_cache-624db3ad-20f2-4302-8fec-b77a5b8ebc39" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:47:21 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:47:22 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:47:25 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-1d82762e-5e29-4c51-bdcb-03a8d65d844f tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Acquiring lock "624db3ad-20f2-4302-8fec-b77a5b8ebc39" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:47:25 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-1d82762e-5e29-4c51-bdcb-03a8d65d844f tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Lock "624db3ad-20f2-4302-8fec-b77a5b8ebc39" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:47:25 user nova-compute[75165]: DEBUG nova.objects.instance [None req-1d82762e-5e29-4c51-bdcb-03a8d65d844f tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Lazy-loading 'flavor' on Instance uuid 624db3ad-20f2-4302-8fec-b77a5b8ebc39 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:47:25 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-1d82762e-5e29-4c51-bdcb-03a8d65d844f tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Lock "624db3ad-20f2-4302-8fec-b77a5b8ebc39" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:47:25 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-1d82762e-5e29-4c51-bdcb-03a8d65d844f tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Acquiring lock "624db3ad-20f2-4302-8fec-b77a5b8ebc39" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:47:25 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-1d82762e-5e29-4c51-bdcb-03a8d65d844f tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Lock "624db3ad-20f2-4302-8fec-b77a5b8ebc39" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:47:25 user nova-compute[75165]: INFO nova.compute.manager [None req-1d82762e-5e29-4c51-bdcb-03a8d65d844f tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 624db3ad-20f2-4302-8fec-b77a5b8ebc39] Attaching volume e7327f9e-6f38-443f-9cc3-bc1f54fed745 to /dev/vdb
Oct 26 00:47:25 user nova-compute[75165]: DEBUG os_brick.utils [None req-1d82762e-5e29-4c51-bdcb-03a8d65d844f tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:47:25 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:47:25 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:47:25 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[08c91e72-3f43-4786-8321-98819fa53720]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa94814ccb35\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:47:25 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:47:25 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:47:25 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[9450a9dd-e964-4a49-9330-afdd7da8cb0e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:47:25 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:47:25 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:47:25 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[4967f0f2-866e-4218-a654-2448636e48b8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:47:25 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0ac693b-0807-4744-b795-0c04ae9fdb62]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:47:25 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-1d82762e-5e29-4c51-bdcb-03a8d65d844f tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Running cmd (subprocess): nvme version {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:47:25 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-1d82762e-5e29-4c51-bdcb-03a8d65d844f tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] 'nvme version' failed. Not Retrying. {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 00:47:25 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1d82762e-5e29-4c51-bdcb-03a8d65d844f tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] nvme not present on system {{(pid=75165) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 00:47:25 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:47:26 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 00:47:26 user nova-compute[75165]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 00:47:26 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[aea3db12-347f-450d-968e-48f73115f696]: (4, '') {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:47:26 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-1d82762e-5e29-4c51-bdcb-03a8d65d844f tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75165) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 00:47:26 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-1d82762e-5e29-4c51-bdcb-03a8d65d844f tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75165) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 00:47:26 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-1d82762e-5e29-4c51-bdcb-03a8d65d844f tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] LIGHTOS: no hostnqn found. {{(pid=75165) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 00:47:26 user nova-compute[75165]: DEBUG os_brick.utils [None req-1d82762e-5e29-4c51-bdcb-03a8d65d844f tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa94814ccb35', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:47:26 user nova-compute[75165]: DEBUG nova.virt.block_device [None req-1d82762e-5e29-4c51-bdcb-03a8d65d844f tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 624db3ad-20f2-4302-8fec-b77a5b8ebc39] Updating existing volume attachment record: b41f5082-7327-4262-bd86-68e3e5b594f5 {{(pid=75165) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 00:47:26 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:47:27 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:47:27 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:47:27 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75165) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 00:47:31 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:47:31 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:47:33 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:47:34 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:47:35 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:47:36 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:47:36 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:47:37 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:47:37 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:47:38 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:47:38 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Starting heal instance info cache {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 00:47:38 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Rebuilding the list of instances to heal {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 00:47:39 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "refresh_cache-624db3ad-20f2-4302-8fec-b77a5b8ebc39" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:47:39 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquired lock "refresh_cache-624db3ad-20f2-4302-8fec-b77a5b8ebc39" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:47:39 user nova-compute[75165]: DEBUG nova.network.neutron [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: 624db3ad-20f2-4302-8fec-b77a5b8ebc39] Forcefully refreshing network info cache for instance {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 00:47:39 user nova-compute[75165]: DEBUG nova.objects.instance [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lazy-loading 'info_cache' on Instance uuid 624db3ad-20f2-4302-8fec-b77a5b8ebc39 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:47:39 user nova-compute[75165]: DEBUG nova.network.neutron [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: 624db3ad-20f2-4302-8fec-b77a5b8ebc39] Updating instance_info_cache with network_info: [{"id": "7b2215ca-3a79-4fbe-bad8-7cea3a0c2dca", "address": "fa:16:3e:e4:cb:af", "network": {"id": "1801db1c-315e-4bdf-b73b-132a38bf41b8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1254756052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62572ce8ae524b55950532fd89729b71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b2215ca-3a", "ovs_interfaceid": "7b2215ca-3a79-4fbe-bad8-7cea3a0c2dca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:47:39 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Releasing lock "refresh_cache-624db3ad-20f2-4302-8fec-b77a5b8ebc39" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:47:39 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: 624db3ad-20f2-4302-8fec-b77a5b8ebc39] Updated the network info_cache for instance {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 00:47:41 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:47:41 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:47:41 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:47:41 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:47:41 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:47:41 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75165) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 00:47:41 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/624db3ad-20f2-4302-8fec-b77a5b8ebc39/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:47:42 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/624db3ad-20f2-4302-8fec-b77a5b8ebc39/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:47:42 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/624db3ad-20f2-4302-8fec-b77a5b8ebc39/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:47:42 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/624db3ad-20f2-4302-8fec-b77a5b8ebc39/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:47:42 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:47:42 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:47:42 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Hypervisor/Node resource view: name=user free_ram=8941MB free_disk=24.82170867919922GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75165) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 00:47:42 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:47:42 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:47:42 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 624db3ad-20f2-4302-8fec-b77a5b8ebc39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:47:42 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75165) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 00:47:42 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75165) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 00:47:42 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:47:42 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:47:42 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Compute_service record updated for user:user {{(pid=75165) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 00:47:42 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.280s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:47:43 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d82762e-5e29-4c51-bdcb-03a8d65d844f tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 624db3ad-20f2-4302-8fec-b77a5b8ebc39] Calling os-brick to attach iSCSI Volume {{(pid=75165) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 00:47:43 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d82762e-5e29-4c51-bdcb-03a8d65d844f tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8bf8160e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e7327f9e-6f38-443f-9cc3-bc1f54fed745', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vCHtRhNQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:47:43 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-1d82762e-5e29-4c51-bdcb-03a8d65d844f tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:47:43 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-1d82762e-5e29-4c51-bdcb-03a8d65d844f tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:47:43 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-1d82762e-5e29-4c51-bdcb-03a8d65d844f tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:47:43 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-1d82762e-5e29-4c51-bdcb-03a8d65d844f tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:47:43 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-1d82762e-5e29-4c51-bdcb-03a8d65d844f tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e7327f9e-6f38-443f-9cc3-bc1f54fed745" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:47:43 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-1d82762e-5e29-4c51-bdcb-03a8d65d844f tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e7327f9e-6f38-443f-9cc3-bc1f54fed745" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:47:43 user nova-compute[75165]: INFO os_brick.initiator.connectors.iscsi [None req-1d82762e-5e29-4c51-bdcb-03a8d65d844f tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 00:47:43 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7327f9e-6f38-443f-9cc3-bc1f54fed745 -p 172.16.0.220:3260 {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:47:43 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7327f9e-6f38-443f-9cc3-bc1f54fed745 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:47:43 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[3df3bbb1-f367-4fbd-995a-d0fde7230f2d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:47:43 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d82762e-5e29-4c51-bdcb-03a8d65d844f tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 00:47:43 user nova-compute[75165]:  {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:47:43 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7327f9e-6f38-443f-9cc3-bc1f54fed745 -p 172.16.0.220:3260 --interface default --op new {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:47:43 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7327f9e-6f38-443f-9cc3-bc1f54fed745 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:47:43 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[a190157b-2957-4ff4-be72-20b9d9010239]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e7327f9e-6f38-443f-9cc3-bc1f54fed745] added\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:47:43 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d82762e-5e29-4c51-bdcb-03a8d65d844f tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e7327f9e-6f38-443f-9cc3-bc1f54fed745] added
Oct 26 00:47:43 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:47:43 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7327f9e-6f38-443f-9cc3-bc1f54fed745 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:47:43 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7327f9e-6f38-443f-9cc3-bc1f54fed745 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:47:43 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[5410528d-6799-4c3c-a641-dd68718fc264]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:47:43 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d82762e-5e29-4c51-bdcb-03a8d65d844f tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:47:43 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7327f9e-6f38-443f-9cc3-bc1f54fed745 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:47:43 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7327f9e-6f38-443f-9cc3-bc1f54fed745 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:47:43 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ab9c54e-0f6e-4fa8-ba0f-68f600ff6052]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:47:43 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d82762e-5e29-4c51-bdcb-03a8d65d844f tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:47:43 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7327f9e-6f38-443f-9cc3-bc1f54fed745 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vCHtRhNQ {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:47:43 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7327f9e-6f38-443f-9cc3-bc1f54fed745 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vCHtRhNQ" returned: 0 in 0.021s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:47:43 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[c525b005-cafc-4d03-b1a1-b2a22a1a2b4c]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:47:43 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d82762e-5e29-4c51-bdcb-03a8d65d844f tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vCHtRhNQ'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:47:43 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7327f9e-6f38-443f-9cc3-bc1f54fed745 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:47:43 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7327f9e-6f38-443f-9cc3-bc1f54fed745 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:47:43 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3086bc2-a78f-401f-b2b6-2d7d846b7e3a]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:47:43 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d82762e-5e29-4c51-bdcb-03a8d65d844f tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:47:43 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:47:43 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:47:43 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[e20e94c3-f7f7-43d2-8410-429abc22bf75]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:47:43 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d82762e-5e29-4c51-bdcb-03a8d65d844f tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 26 00:47:43 user nova-compute[75165]:  {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:47:43 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d82762e-5e29-4c51-bdcb-03a8d65d844f tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 26 00:47:43 user nova-compute[75165]:  {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:47:43 user nova-compute[75165]: WARNING os_brick.initiator.connectors.iscsi [None req-1d82762e-5e29-4c51-bdcb-03a8d65d844f tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 26 00:47:43 user nova-compute[75165]: 
Oct 26 00:47:43 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7327f9e-6f38-443f-9cc3-bc1f54fed745 -p 172.16.0.220:3260 --login {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:47:43 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7327f9e-6f38-443f-9cc3-bc1f54fed745 -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:47:43 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb76fefd-0e53-4edc-8114-691894fdd112]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e7327f9e-6f38-443f-9cc3-bc1f54fed745, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e7327f9e-6f38-443f-9cc3-bc1f54fed745, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:47:43 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d82762e-5e29-4c51-bdcb-03a8d65d844f tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e7327f9e-6f38-443f-9cc3-bc1f54fed745, portal: 172.16.0.220,3260]
Oct 26 00:47:43 user nova-compute[75165]: Login to [iface: default, target: iqn.2010-10.org.openstack:e7327f9e-6f38-443f-9cc3-bc1f54fed745, portal: 172.16.0.220,3260] successful.
Oct 26 00:47:43 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:47:43 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7327f9e-6f38-443f-9cc3-bc1f54fed745 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:47:43 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7327f9e-6f38-443f-9cc3-bc1f54fed745 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:47:43 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1e2cb8d-4ba0-4b75-ba94-ae0cf7e4d49f]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:47:43 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d82762e-5e29-4c51-bdcb-03a8d65d844f tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:47:43 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:47:43 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:47:43 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[496bf95c-4fb7-406f-82bb-ba3bd33a24f3]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7327f9e-6f38-443f-9cc3-bc1f54fed745 (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:47:43 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d82762e-5e29-4c51-bdcb-03a8d65d844f tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7327f9e-6f38-443f-9cc3-bc1f54fed745 (non-flash)
Oct 26 00:47:43 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:47:43 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d82762e-5e29-4c51-bdcb-03a8d65d844f tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7327f9e-6f38-443f-9cc3-bc1f54fed745 (non-flash)
Oct 26 00:47:43 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:47:43 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-1d82762e-5e29-4c51-bdcb-03a8d65d844f tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e7327f9e-6f38-443f-9cc3-bc1f54fed745" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.256s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:47:43 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d82762e-5e29-4c51-bdcb-03a8d65d844f tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Connected to 172.16.0.220:3260 {{(pid=75165) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 00:47:43 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-1d82762e-5e29-4c51-bdcb-03a8d65d844f tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] HCTL ('33', '-', '-', 0) found on session 54 with lun 0 {{(pid=75165) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 00:47:43 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-1d82762e-5e29-4c51-bdcb-03a8d65d844f tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75165) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 00:47:43 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:47:43 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:47:43 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[7673d0ae-0946-49ee-b4f3-675e1cdf98a9]: (4, ('- - 0', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:47:43 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-1d82762e-5e29-4c51-bdcb-03a8d65d844f tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: None {{(pid=75165) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 00:47:44 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-1d82762e-5e29-4c51-bdcb-03a8d65d844f tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75165) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 00:47:44 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d82762e-5e29-4c51-bdcb-03a8d65d844f tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:e7327f9e-6f38-443f-9cc3-bc1f54fed745', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vCHtRhNQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75165) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 00:47:44 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-1d82762e-5e29-4c51-bdcb-03a8d65d844f tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.285s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:47:44 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d82762e-5e29-4c51-bdcb-03a8d65d844f tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] <== connect_volume: return (1286ms) {'type': 'block', 'scsi_wwn': '23338653530376336', 'path': '/dev/sdb'} {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:47:44 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d82762e-5e29-4c51-bdcb-03a8d65d844f tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 624db3ad-20f2-4302-8fec-b77a5b8ebc39] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23338653530376336', 'path': '/dev/sdb'} {{(pid=75165) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 00:47:44 user nova-compute[75165]: DEBUG nova.objects.instance [None req-1d82762e-5e29-4c51-bdcb-03a8d65d844f tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Lazy-loading 'flavor' on Instance uuid 624db3ad-20f2-4302-8fec-b77a5b8ebc39 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:47:44 user nova-compute[75165]: DEBUG nova.virt.libvirt.guest [None req-1d82762e-5e29-4c51-bdcb-03a8d65d844f tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 00:47:44 user nova-compute[75165]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 00:47:44 user nova-compute[75165]:   <source dev="/dev/sdb"/>
Oct 26 00:47:44 user nova-compute[75165]:   <target dev="vdb" bus="virtio"/>
Oct 26 00:47:44 user nova-compute[75165]:   <serial>e7327f9e-6f38-443f-9cc3-bc1f54fed745</serial>
Oct 26 00:47:44 user nova-compute[75165]: </disk>
Oct 26 00:47:44 user nova-compute[75165]:  {{(pid=75165) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 00:47:44 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:47:45 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-1d82762e-5e29-4c51-bdcb-03a8d65d844f tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] No BDM found with device name vda, not building metadata. {{(pid=75165) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 00:47:45 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-1d82762e-5e29-4c51-bdcb-03a8d65d844f tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75165) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 00:47:45 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-1d82762e-5e29-4c51-bdcb-03a8d65d844f tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] No VIF found with MAC fa:16:3e:e4:cb:af, not building metadata {{(pid=75165) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 00:47:45 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-1d82762e-5e29-4c51-bdcb-03a8d65d844f tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Lock "624db3ad-20f2-4302-8fec-b77a5b8ebc39" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.352s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:47:46 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-66d72ffd-055a-4994-bd8e-7a3aef7f81e7 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Acquiring lock "624db3ad-20f2-4302-8fec-b77a5b8ebc39" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:47:46 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-66d72ffd-055a-4994-bd8e-7a3aef7f81e7 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Lock "624db3ad-20f2-4302-8fec-b77a5b8ebc39" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:47:46 user nova-compute[75165]: INFO nova.compute.manager [None req-66d72ffd-055a-4994-bd8e-7a3aef7f81e7 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 624db3ad-20f2-4302-8fec-b77a5b8ebc39] Detaching volume e7327f9e-6f38-443f-9cc3-bc1f54fed745
Oct 26 00:47:46 user nova-compute[75165]: INFO nova.virt.block_device [None req-66d72ffd-055a-4994-bd8e-7a3aef7f81e7 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 624db3ad-20f2-4302-8fec-b77a5b8ebc39] Attempting to driver detach volume e7327f9e-6f38-443f-9cc3-bc1f54fed745 from mountpoint /dev/vdb
Oct 26 00:47:46 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-66d72ffd-055a-4994-bd8e-7a3aef7f81e7 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Attempting to detach device vdb from instance 624db3ad-20f2-4302-8fec-b77a5b8ebc39 from the persistent domain config. {{(pid=75165) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 00:47:46 user nova-compute[75165]: DEBUG nova.virt.libvirt.guest [None req-66d72ffd-055a-4994-bd8e-7a3aef7f81e7 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 00:47:46 user nova-compute[75165]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 00:47:46 user nova-compute[75165]:   <source dev="/dev/sdb"/>
Oct 26 00:47:46 user nova-compute[75165]:   <target dev="vdb" bus="virtio"/>
Oct 26 00:47:46 user nova-compute[75165]:   <serial>e7327f9e-6f38-443f-9cc3-bc1f54fed745</serial>
Oct 26 00:47:46 user nova-compute[75165]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 00:47:46 user nova-compute[75165]: </disk>
Oct 26 00:47:46 user nova-compute[75165]:  {{(pid=75165) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 00:47:46 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-66d72ffd-055a-4994-bd8e-7a3aef7f81e7 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Successfully detached device vdb from instance 624db3ad-20f2-4302-8fec-b77a5b8ebc39 from the persistent domain config.
Oct 26 00:47:46 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-66d72ffd-055a-4994-bd8e-7a3aef7f81e7 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 624db3ad-20f2-4302-8fec-b77a5b8ebc39 from the live domain config. {{(pid=75165) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 00:47:46 user nova-compute[75165]: DEBUG nova.virt.libvirt.guest [None req-66d72ffd-055a-4994-bd8e-7a3aef7f81e7 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 00:47:46 user nova-compute[75165]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 00:47:46 user nova-compute[75165]:   <source dev="/dev/sdb"/>
Oct 26 00:47:46 user nova-compute[75165]:   <target dev="vdb" bus="virtio"/>
Oct 26 00:47:46 user nova-compute[75165]:   <serial>e7327f9e-6f38-443f-9cc3-bc1f54fed745</serial>
Oct 26 00:47:46 user nova-compute[75165]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 00:47:46 user nova-compute[75165]: </disk>
Oct 26 00:47:46 user nova-compute[75165]:  {{(pid=75165) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 00:47:46 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:47:47 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-66d72ffd-055a-4994-bd8e-7a3aef7f81e7 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 624db3ad-20f2-4302-8fec-b77a5b8ebc39 {{(pid=75165) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 00:47:51 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:47:52 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:47:56 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:48:01 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:48:02 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-cbdae197-e20f-46f6-a74f-dc99b2dad477 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Acquiring lock "08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:48:02 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-cbdae197-e20f-46f6-a74f-dc99b2dad477 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Lock "08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:48:02 user nova-compute[75165]: DEBUG nova.compute.manager [None req-cbdae197-e20f-46f6-a74f-dc99b2dad477 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed] Starting instance... {{(pid=75165) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 00:48:02 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-cbdae197-e20f-46f6-a74f-dc99b2dad477 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:48:02 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-cbdae197-e20f-46f6-a74f-dc99b2dad477 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:48:02 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-cbdae197-e20f-46f6-a74f-dc99b2dad477 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75165) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 00:48:02 user nova-compute[75165]: INFO nova.compute.claims [None req-cbdae197-e20f-46f6-a74f-dc99b2dad477 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed] Claim successful on node user
Oct 26 00:48:02 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-cbdae197-e20f-46f6-a74f-dc99b2dad477 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:48:02 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-cbdae197-e20f-46f6-a74f-dc99b2dad477 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:48:02 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-cbdae197-e20f-46f6-a74f-dc99b2dad477 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.232s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:48:02 user nova-compute[75165]: DEBUG nova.compute.manager [None req-cbdae197-e20f-46f6-a74f-dc99b2dad477 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed] Start building networks asynchronously for instance. {{(pid=75165) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 00:48:03 user nova-compute[75165]: DEBUG nova.compute.manager [None req-cbdae197-e20f-46f6-a74f-dc99b2dad477 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed] Allocating IP information in the background. {{(pid=75165) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 00:48:03 user nova-compute[75165]: DEBUG nova.network.neutron [None req-cbdae197-e20f-46f6-a74f-dc99b2dad477 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed] allocate_for_instance() {{(pid=75165) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 00:48:03 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-cbdae197-e20f-46f6-a74f-dc99b2dad477 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 00:48:03 user nova-compute[75165]: DEBUG nova.compute.manager [None req-cbdae197-e20f-46f6-a74f-dc99b2dad477 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed] Start building block device mappings for instance. {{(pid=75165) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 00:48:03 user nova-compute[75165]: INFO nova.virt.block_device [None req-cbdae197-e20f-46f6-a74f-dc99b2dad477 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed] Booting with volume 28483cbc-41a9-4961-9c30-fae820d1ad43 at /dev/vda
Oct 26 00:48:03 user nova-compute[75165]: DEBUG nova.policy [None req-cbdae197-e20f-46f6-a74f-dc99b2dad477 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ae836eab78514cf3894e5e11240ff374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1051405ca054c4bb051fb842a5fb5a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75165) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 00:48:03 user nova-compute[75165]: DEBUG os_brick.utils [None req-cbdae197-e20f-46f6-a74f-dc99b2dad477 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:48:03 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:48:03 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:48:03 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddba39a6-574c-4bbb-b081-efdbcdf1fd33]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa94814ccb35\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:48:03 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:48:03 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:48:03 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[84564959-26cc-4f5f-9246-9016876fdc36]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:48:03 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:48:03 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:48:03 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb36d668-987d-42cd-8e22-d2d245a24572]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:48:03 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fbac718-387e-49a6-8fb8-c68a38168ddf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:48:03 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-cbdae197-e20f-46f6-a74f-dc99b2dad477 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Running cmd (subprocess): nvme version {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:48:03 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-cbdae197-e20f-46f6-a74f-dc99b2dad477 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] 'nvme version' failed. Not Retrying. {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 00:48:03 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cbdae197-e20f-46f6-a74f-dc99b2dad477 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] nvme not present on system {{(pid=75165) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 00:48:03 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:48:03 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 00:48:03 user nova-compute[75165]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 00:48:03 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c801a87-3800-4302-88e4-1cc96ae64acd]: (4, '') {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:48:03 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-cbdae197-e20f-46f6-a74f-dc99b2dad477 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75165) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 00:48:03 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-cbdae197-e20f-46f6-a74f-dc99b2dad477 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75165) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 00:48:03 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-cbdae197-e20f-46f6-a74f-dc99b2dad477 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] LIGHTOS: no hostnqn found. {{(pid=75165) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 00:48:03 user nova-compute[75165]: DEBUG os_brick.utils [None req-cbdae197-e20f-46f6-a74f-dc99b2dad477 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa94814ccb35', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:48:03 user nova-compute[75165]: DEBUG nova.virt.block_device [None req-cbdae197-e20f-46f6-a74f-dc99b2dad477 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed] Updating existing volume attachment record: 65233b9d-8c42-45ff-b613-b3375383855a {{(pid=75165) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 00:48:03 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:48:03 user nova-compute[75165]: DEBUG nova.network.neutron [None req-cbdae197-e20f-46f6-a74f-dc99b2dad477 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed] Successfully created port: 4983d9d7-3996-4f95-bc35-0ab5b325e341 {{(pid=75165) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 00:48:04 user nova-compute[75165]: DEBUG nova.network.neutron [None req-cbdae197-e20f-46f6-a74f-dc99b2dad477 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed] Successfully updated port: 4983d9d7-3996-4f95-bc35-0ab5b325e341 {{(pid=75165) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 00:48:04 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-cbdae197-e20f-46f6-a74f-dc99b2dad477 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Acquiring lock "refresh_cache-08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:48:04 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-cbdae197-e20f-46f6-a74f-dc99b2dad477 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Acquired lock "refresh_cache-08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:48:04 user nova-compute[75165]: DEBUG nova.network.neutron [None req-cbdae197-e20f-46f6-a74f-dc99b2dad477 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed] Building network info cache for instance {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 00:48:04 user nova-compute[75165]: DEBUG nova.compute.manager [req-5fbed9d4-7444-4e1d-a027-34c796be1496 req-cfac587e-e814-4ebf-a104-4d5b7fd15129 service nova] [instance: 08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed] Received event network-changed-4983d9d7-3996-4f95-bc35-0ab5b325e341 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:48:04 user nova-compute[75165]: DEBUG nova.compute.manager [req-5fbed9d4-7444-4e1d-a027-34c796be1496 req-cfac587e-e814-4ebf-a104-4d5b7fd15129 service nova] [instance: 08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed] Refreshing instance network info cache due to event network-changed-4983d9d7-3996-4f95-bc35-0ab5b325e341. {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 00:48:04 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-5fbed9d4-7444-4e1d-a027-34c796be1496 req-cfac587e-e814-4ebf-a104-4d5b7fd15129 service nova] Acquiring lock "refresh_cache-08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:48:04 user nova-compute[75165]: DEBUG nova.network.neutron [None req-cbdae197-e20f-46f6-a74f-dc99b2dad477 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed] Instance cache missing network info. {{(pid=75165) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 00:48:05 user nova-compute[75165]: DEBUG nova.network.neutron [None req-cbdae197-e20f-46f6-a74f-dc99b2dad477 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed] Updating instance_info_cache with network_info: [{"id": "4983d9d7-3996-4f95-bc35-0ab5b325e341", "address": "fa:16:3e:fc:8d:e2", "network": {"id": "dc50ae7b-d501-461f-aa0b-542514330ae8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1091857056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1051405ca054c4bb051fb842a5fb5a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4983d9d7-39", "ovs_interfaceid": "4983d9d7-3996-4f95-bc35-0ab5b325e341", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:48:05 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-cbdae197-e20f-46f6-a74f-dc99b2dad477 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Releasing lock "refresh_cache-08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:48:05 user nova-compute[75165]: DEBUG nova.compute.manager [None req-cbdae197-e20f-46f6-a74f-dc99b2dad477 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed] Instance network_info: |[{"id": "4983d9d7-3996-4f95-bc35-0ab5b325e341", "address": "fa:16:3e:fc:8d:e2", "network": {"id": "dc50ae7b-d501-461f-aa0b-542514330ae8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1091857056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1051405ca054c4bb051fb842a5fb5a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4983d9d7-39", "ovs_interfaceid": "4983d9d7-3996-4f95-bc35-0ab5b325e341", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75165) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 00:48:05 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-5fbed9d4-7444-4e1d-a027-34c796be1496 req-cfac587e-e814-4ebf-a104-4d5b7fd15129 service nova] Acquired lock "refresh_cache-08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:48:05 user nova-compute[75165]: DEBUG nova.network.neutron [req-5fbed9d4-7444-4e1d-a027-34c796be1496 req-cfac587e-e814-4ebf-a104-4d5b7fd15129 service nova] [instance: 08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed] Refreshing network info cache for port 4983d9d7-3996-4f95-bc35-0ab5b325e341 {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 00:48:05 user nova-compute[75165]: DEBUG nova.network.neutron [req-5fbed9d4-7444-4e1d-a027-34c796be1496 req-cfac587e-e814-4ebf-a104-4d5b7fd15129 service nova] [instance: 08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed] Updated VIF entry in instance network info cache for port 4983d9d7-3996-4f95-bc35-0ab5b325e341. {{(pid=75165) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 00:48:05 user nova-compute[75165]: DEBUG nova.network.neutron [req-5fbed9d4-7444-4e1d-a027-34c796be1496 req-cfac587e-e814-4ebf-a104-4d5b7fd15129 service nova] [instance: 08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed] Updating instance_info_cache with network_info: [{"id": "4983d9d7-3996-4f95-bc35-0ab5b325e341", "address": "fa:16:3e:fc:8d:e2", "network": {"id": "dc50ae7b-d501-461f-aa0b-542514330ae8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1091857056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1051405ca054c4bb051fb842a5fb5a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4983d9d7-39", "ovs_interfaceid": "4983d9d7-3996-4f95-bc35-0ab5b325e341", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:48:05 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-5fbed9d4-7444-4e1d-a027-34c796be1496 req-cfac587e-e814-4ebf-a104-4d5b7fd15129 service nova] Releasing lock "refresh_cache-08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:48:06 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:48:07 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-66d72ffd-055a-4994-bd8e-7a3aef7f81e7 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 624db3ad-20f2-4302-8fec-b77a5b8ebc39 is timed out.
Oct 26 00:48:07 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-66d72ffd-055a-4994-bd8e-7a3aef7f81e7 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Successfully detached device vdb from instance 624db3ad-20f2-4302-8fec-b77a5b8ebc39 from the live domain config.
Oct 26 00:48:07 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66d72ffd-055a-4994-bd8e-7a3aef7f81e7 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 624db3ad-20f2-4302-8fec-b77a5b8ebc39] calling os-brick to detach iSCSI Volume {{(pid=75165) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 00:48:07 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-66d72ffd-055a-4994-bd8e-7a3aef7f81e7 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8bf8160e50>, {'target_iqn': 'iqn.2010-10.org.openstack:e7327f9e-6f38-443f-9cc3-bc1f54fed745', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vCHtRhNQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:48:07 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-66d72ffd-055a-4994-bd8e-7a3aef7f81e7 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:48:07 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-66d72ffd-055a-4994-bd8e-7a3aef7f81e7 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:48:07 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-66d72ffd-055a-4994-bd8e-7a3aef7f81e7 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:48:07 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:48:07 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:48:07 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[99cd4211-1e3e-466f-99ac-8fb20871144b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e7327f9e-6f38-443f-9cc3-bc1f54fed745\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:48:07 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-66d72ffd-055a-4994-bd8e-7a3aef7f81e7 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 00:48:07 user nova-compute[75165]: No targets found.
Oct 26 00:48:07 user nova-compute[75165]: iSNS:
Oct 26 00:48:07 user nova-compute[75165]: No targets found.
Oct 26 00:48:07 user nova-compute[75165]: STATIC:
Oct 26 00:48:07 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:e7327f9e-6f38-443f-9cc3-bc1f54fed745
Oct 26 00:48:07 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:48:07 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:48:07 user nova-compute[75165]: FIRMWARE:
Oct 26 00:48:07 user nova-compute[75165]: No targets found.
Oct 26 00:48:07 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:48:07 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-66d72ffd-055a-4994-bd8e-7a3aef7f81e7 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 00:48:07 user nova-compute[75165]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 00:48:07 user nova-compute[75165]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75165) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 00:48:07 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-66d72ffd-055a-4994-bd8e-7a3aef7f81e7 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e7327f9e-6f38-443f-9cc3-bc1f54fed745', 0)] {{(pid=75165) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 00:48:07 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:48:07 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:48:07 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[27df970f-49fb-48ab-b42c-ea5b314bca72]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7327f9e-6f38-443f-9cc3-bc1f54fed745\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:48:07 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:48:07 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:48:07 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[71057ac4-5e3e-47d3-bdab-accbcfd49e25]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7327f9e-6f38-443f-9cc3-bc1f54fed745 (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:48:07 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-66d72ffd-055a-4994-bd8e-7a3aef7f81e7 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7327f9e-6f38-443f-9cc3-bc1f54fed745 (non-flash)
Oct 26 00:48:07 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:48:07 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-66d72ffd-055a-4994-bd8e-7a3aef7f81e7 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7327f9e-6f38-443f-9cc3-bc1f54fed745 (non-flash)
Oct 26 00:48:07 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:48:07 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-66d72ffd-055a-4994-bd8e-7a3aef7f81e7 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8be03483a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e7327f9e-6f38-443f-9cc3-bc1f54fed745'): ({'sdb'}, set())}) {{(pid=75165) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 00:48:07 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-66d72ffd-055a-4994-bd8e-7a3aef7f81e7 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Removing single pathed devices sdb {{(pid=75165) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 00:48:07 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:48:07 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:48:07 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[72570bd3-b401-41a0-8d0a-ee1b0c5dc4bb]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:48:07 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:48:07 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:48:07 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[85560824-8943-4fe2-bf4f-d7bded911031]: (4, ('ok\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:48:07 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-66d72ffd-055a-4994-bd8e-7a3aef7f81e7 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Flushing IO for device /dev/sdb {{(pid=75165) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 00:48:07 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:48:07 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:48:07 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[de00b59b-5f15-4670-a2a3-01b71e17211a]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:48:07 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-66d72ffd-055a-4994-bd8e-7a3aef7f81e7 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75165) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 00:48:07 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:48:07 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:48:07 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a4d2738-d171-43e0-a170-f476466b1d6b]: (4, ('1', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:48:07 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-66d72ffd-055a-4994-bd8e-7a3aef7f81e7 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75165) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 00:48:07 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-66d72ffd-055a-4994-bd8e-7a3aef7f81e7 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] SCSI volumes sdb have been removed. {{(pid=75165) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 00:48:07 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-66d72ffd-055a-4994-bd8e-7a3aef7f81e7 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e7327f9e-6f38-443f-9cc3-bc1f54fed745')] {{(pid=75165) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 00:48:07 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7327f9e-6f38-443f-9cc3-bc1f54fed745 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:48:07 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7327f9e-6f38-443f-9cc3-bc1f54fed745 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:48:07 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a1160c9-a851-4a53-9b83-bc8f79936ceb]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:48:07 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-66d72ffd-055a-4994-bd8e-7a3aef7f81e7 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:48:07 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7327f9e-6f38-443f-9cc3-bc1f54fed745 -p 172.16.0.220:3260 --logout {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:48:07 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7327f9e-6f38-443f-9cc3-bc1f54fed745 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:48:07 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[75b504a7-9d58-4ac0-9c02-7c175ec2dce5]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:e7327f9e-6f38-443f-9cc3-bc1f54fed745, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:e7327f9e-6f38-443f-9cc3-bc1f54fed745, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:48:07 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-66d72ffd-055a-4994-bd8e-7a3aef7f81e7 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:e7327f9e-6f38-443f-9cc3-bc1f54fed745, portal: 172.16.0.220,3260]
Oct 26 00:48:07 user nova-compute[75165]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:e7327f9e-6f38-443f-9cc3-bc1f54fed745, portal: 172.16.0.220,3260] successful.
Oct 26 00:48:07 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:48:07 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7327f9e-6f38-443f-9cc3-bc1f54fed745 -p 172.16.0.220:3260 --op delete {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:48:07 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7327f9e-6f38-443f-9cc3-bc1f54fed745 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:48:07 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cca688d-a755-4290-b7a6-011562c97382]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:48:07 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-66d72ffd-055a-4994-bd8e-7a3aef7f81e7 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:48:07 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-66d72ffd-055a-4994-bd8e-7a3aef7f81e7 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.279s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:48:07 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-66d72ffd-055a-4994-bd8e-7a3aef7f81e7 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] <== disconnect_volume: return (281ms) None {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:48:07 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66d72ffd-055a-4994-bd8e-7a3aef7f81e7 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 624db3ad-20f2-4302-8fec-b77a5b8ebc39] Disconnected iSCSI Volume {{(pid=75165) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 00:48:11 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:48:16 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:48:20 user nova-compute[75165]: DEBUG nova.objects.instance [None req-66d72ffd-055a-4994-bd8e-7a3aef7f81e7 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Lazy-loading 'flavor' on Instance uuid 624db3ad-20f2-4302-8fec-b77a5b8ebc39 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:48:20 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-66d72ffd-055a-4994-bd8e-7a3aef7f81e7 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Lock "624db3ad-20f2-4302-8fec-b77a5b8ebc39" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 34.391s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:48:21 user nova-compute[75165]: DEBUG nova.compute.manager [None req-cbdae197-e20f-46f6-a74f-dc99b2dad477 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed] Start spawning the instance on the hypervisor. {{(pid=75165) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 00:48:21 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-cbdae197-e20f-46f6-a74f-dc99b2dad477 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed] Creating instance directory {{(pid=75165) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 00:48:21 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-cbdae197-e20f-46f6-a74f-dc99b2dad477 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed] Creating image(s)
Oct 26 00:48:21 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-cbdae197-e20f-46f6-a74f-dc99b2dad477 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed] Did not create local disks {{(pid=75165) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 26 00:48:21 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-cbdae197-e20f-46f6-a74f-dc99b2dad477 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed] Ensure instance console log exists: /opt/stack/data/nova/instances/08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed/console.log {{(pid=75165) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 00:48:21 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-cbdae197-e20f-46f6-a74f-dc99b2dad477 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:48:21 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-cbdae197-e20f-46f6-a74f-dc99b2dad477 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:48:21 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-cbdae197-e20f-46f6-a74f-dc99b2dad477 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:48:21 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-cbdae197-e20f-46f6-a74f-dc99b2dad477 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed] Start _get_guest_xml network_info=[{"id": "4983d9d7-3996-4f95-bc35-0ab5b325e341", "address": "fa:16:3e:fc:8d:e2", "network": {"id": "dc50ae7b-d501-461f-aa0b-542514330ae8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1091857056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1051405ca054c4bb051fb842a5fb5a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4983d9d7-39", "ovs_interfaceid": "4983d9d7-3996-4f95-bc35-0ab5b325e341", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:28483cbc-41a9-4961-9c30-fae820d1ad43', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RmaYIrVs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed', 'attached_at': '', 'detached_at': '', 'volume_id': '28483cbc-41a9-4961-9c30-fae820d1ad43', 'serial': '28483cbc-41a9-4961-9c30-fae820d1ad43'}, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'attachment_id': '65233b9d-8c42-45ff-b613-b3375383855a', 'delete_on_termination': False, 'volume_type': None} {{(pid=75165) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 00:48:21 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-cbdae197-e20f-46f6-a74f-dc99b2dad477 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:48:21 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-cbdae197-e20f-46f6-a74f-dc99b2dad477 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:48:21 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-cbdae197-e20f-46f6-a74f-dc99b2dad477 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75165) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 00:48:21 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-cbdae197-e20f-46f6-a74f-dc99b2dad477 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] CPU controller missing on host. {{(pid=75165) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 00:48:21 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-cbdae197-e20f-46f6-a74f-dc99b2dad477 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75165) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 00:48:21 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-cbdae197-e20f-46f6-a74f-dc99b2dad477 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] CPU controller found on host. {{(pid=75165) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 00:48:21 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-cbdae197-e20f-46f6-a74f-dc99b2dad477 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75165) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 00:48:21 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-cbdae197-e20f-46f6-a74f-dc99b2dad477 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T00:03:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 00:48:21 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-cbdae197-e20f-46f6-a74f-dc99b2dad477 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Flavor limits 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 00:48:21 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-cbdae197-e20f-46f6-a74f-dc99b2dad477 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Image limits 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 00:48:21 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-cbdae197-e20f-46f6-a74f-dc99b2dad477 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Flavor pref 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 00:48:21 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-cbdae197-e20f-46f6-a74f-dc99b2dad477 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Image pref 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 00:48:21 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-cbdae197-e20f-46f6-a74f-dc99b2dad477 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 00:48:21 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-cbdae197-e20f-46f6-a74f-dc99b2dad477 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 00:48:21 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-cbdae197-e20f-46f6-a74f-dc99b2dad477 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75165) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 00:48:21 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-cbdae197-e20f-46f6-a74f-dc99b2dad477 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Got 1 possible topologies {{(pid=75165) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 00:48:21 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-cbdae197-e20f-46f6-a74f-dc99b2dad477 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 00:48:21 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-cbdae197-e20f-46f6-a74f-dc99b2dad477 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 00:48:21 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cbdae197-e20f-46f6-a74f-dc99b2dad477 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed] Calling os-brick to attach iSCSI Volume {{(pid=75165) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 00:48:21 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbdae197-e20f-46f6-a74f-dc99b2dad477 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8bf8160e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:28483cbc-41a9-4961-9c30-fae820d1ad43', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RmaYIrVs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:48:21 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-cbdae197-e20f-46f6-a74f-dc99b2dad477 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:48:21 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-cbdae197-e20f-46f6-a74f-dc99b2dad477 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:48:21 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-cbdae197-e20f-46f6-a74f-dc99b2dad477 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:48:21 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-cbdae197-e20f-46f6-a74f-dc99b2dad477 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:48:21 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-cbdae197-e20f-46f6-a74f-dc99b2dad477 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:28483cbc-41a9-4961-9c30-fae820d1ad43" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:48:21 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-cbdae197-e20f-46f6-a74f-dc99b2dad477 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:28483cbc-41a9-4961-9c30-fae820d1ad43" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:48:21 user nova-compute[75165]: INFO os_brick.initiator.connectors.iscsi [None req-cbdae197-e20f-46f6-a74f-dc99b2dad477 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 00:48:21 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28483cbc-41a9-4961-9c30-fae820d1ad43 -p 172.16.0.220:3260 {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:48:21 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28483cbc-41a9-4961-9c30-fae820d1ad43 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:48:21 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[80240629-02b8-494e-9940-7698b1736d62]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:48:21 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbdae197-e20f-46f6-a74f-dc99b2dad477 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 00:48:21 user nova-compute[75165]:  {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:48:21 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28483cbc-41a9-4961-9c30-fae820d1ad43 -p 172.16.0.220:3260 --interface default --op new {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:48:21 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28483cbc-41a9-4961-9c30-fae820d1ad43 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:48:21 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[b94c0c8e-effc-4818-859d-d48ca4a24ebd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:28483cbc-41a9-4961-9c30-fae820d1ad43] added\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:48:21 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbdae197-e20f-46f6-a74f-dc99b2dad477 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:28483cbc-41a9-4961-9c30-fae820d1ad43] added
Oct 26 00:48:21 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:48:21 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28483cbc-41a9-4961-9c30-fae820d1ad43 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:48:21 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28483cbc-41a9-4961-9c30-fae820d1ad43 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.152s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:48:21 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cb393c0-5ef4-4d4d-b4c1-5829640b712e]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:48:21 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbdae197-e20f-46f6-a74f-dc99b2dad477 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:48:21 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28483cbc-41a9-4961-9c30-fae820d1ad43 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:48:21 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28483cbc-41a9-4961-9c30-fae820d1ad43 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:48:21 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ba8b4d7-53a7-477f-851e-c72fea00dca4]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:48:21 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbdae197-e20f-46f6-a74f-dc99b2dad477 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:48:21 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28483cbc-41a9-4961-9c30-fae820d1ad43 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RmaYIrVs {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:48:21 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28483cbc-41a9-4961-9c30-fae820d1ad43 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RmaYIrVs" returned: 0 in 0.017s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:48:21 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad531d0c-da72-4b06-bad6-6e5350fa6f4b]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:48:21 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbdae197-e20f-46f6-a74f-dc99b2dad477 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RmaYIrVs'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:48:21 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28483cbc-41a9-4961-9c30-fae820d1ad43 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:48:21 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28483cbc-41a9-4961-9c30-fae820d1ad43 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:48:21 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[92c47e06-9c33-46ba-8ce8-816a10054cdc]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:48:21 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbdae197-e20f-46f6-a74f-dc99b2dad477 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:48:21 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:48:21 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:48:21 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[accfa4c7-37fe-469e-9d3b-2282ca56b48b]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:48:21 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbdae197-e20f-46f6-a74f-dc99b2dad477 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 26 00:48:21 user nova-compute[75165]:  {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:48:21 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbdae197-e20f-46f6-a74f-dc99b2dad477 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 26 00:48:21 user nova-compute[75165]:  {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:48:21 user nova-compute[75165]: WARNING os_brick.initiator.connectors.iscsi [None req-cbdae197-e20f-46f6-a74f-dc99b2dad477 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 26 00:48:21 user nova-compute[75165]: 
Oct 26 00:48:21 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28483cbc-41a9-4961-9c30-fae820d1ad43 -p 172.16.0.220:3260 --login {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:48:21 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28483cbc-41a9-4961-9c30-fae820d1ad43 -p 172.16.0.220:3260 --login" returned: 0 in 0.042s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:48:21 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[00cf0e19-c310-4e58-b275-681f217ce782]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:28483cbc-41a9-4961-9c30-fae820d1ad43, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:28483cbc-41a9-4961-9c30-fae820d1ad43, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:48:21 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbdae197-e20f-46f6-a74f-dc99b2dad477 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:28483cbc-41a9-4961-9c30-fae820d1ad43, portal: 172.16.0.220,3260]
Oct 26 00:48:21 user nova-compute[75165]: Login to [iface: default, target: iqn.2010-10.org.openstack:28483cbc-41a9-4961-9c30-fae820d1ad43, portal: 172.16.0.220,3260] successful.
Oct 26 00:48:21 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:48:21 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28483cbc-41a9-4961-9c30-fae820d1ad43 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:48:21 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28483cbc-41a9-4961-9c30-fae820d1ad43 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:48:21 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d32bb39-aae7-4bba-b31e-184f3c55ba9d]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:48:21 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbdae197-e20f-46f6-a74f-dc99b2dad477 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:48:21 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:48:21 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:48:21 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[440c42e4-c01a-4f7d-8eb1-f8c2ec110c67]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28483cbc-41a9-4961-9c30-fae820d1ad43 (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:48:21 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbdae197-e20f-46f6-a74f-dc99b2dad477 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28483cbc-41a9-4961-9c30-fae820d1ad43 (non-flash)
Oct 26 00:48:21 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:48:21 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbdae197-e20f-46f6-a74f-dc99b2dad477 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28483cbc-41a9-4961-9c30-fae820d1ad43 (non-flash)
Oct 26 00:48:21 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:48:21 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-cbdae197-e20f-46f6-a74f-dc99b2dad477 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:28483cbc-41a9-4961-9c30-fae820d1ad43" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.383s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:48:21 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbdae197-e20f-46f6-a74f-dc99b2dad477 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Connected to 172.16.0.220:3260 {{(pid=75165) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 00:48:21 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-cbdae197-e20f-46f6-a74f-dc99b2dad477 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] HCTL ('33', '-', '-', 0) found on session 55 with lun 0 {{(pid=75165) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 00:48:21 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-cbdae197-e20f-46f6-a74f-dc99b2dad477 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75165) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 00:48:21 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:48:21 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:48:21 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[aed8ab68-652e-48c6-a6ce-c63d8c4b8be0]: (4, ('- - 0', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:48:21 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-cbdae197-e20f-46f6-a74f-dc99b2dad477 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Searching for a device in session 55 and hctl ['33', '*', '*', 0] yield: None {{(pid=75165) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 00:48:21 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:48:22 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-cbdae197-e20f-46f6-a74f-dc99b2dad477 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Searching for a device in session 55 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75165) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 00:48:22 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbdae197-e20f-46f6-a74f-dc99b2dad477 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:28483cbc-41a9-4961-9c30-fae820d1ad43', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RmaYIrVs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75165) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 00:48:22 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-cbdae197-e20f-46f6-a74f-dc99b2dad477 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.409s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:48:22 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbdae197-e20f-46f6-a74f-dc99b2dad477 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] <== connect_volume: return (1410ms) {'type': 'block', 'scsi_wwn': '26532343461376432', 'path': '/dev/sdb'} {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:48:22 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cbdae197-e20f-46f6-a74f-dc99b2dad477 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26532343461376432', 'path': '/dev/sdb'} {{(pid=75165) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 00:48:22 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-cbdae197-e20f-46f6-a74f-dc99b2dad477 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:48:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-951983608',display_name='tempest-TestVolumeBootPattern-server-951983608',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-951983608',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBChKvTLd4nhrj5htJzspkP8o+qgId41EjTR/fmBLYf3vmPpK9NBbxwvdQKkZqqXFiSi6AG6cvipLHicvfW4NLnZq3yjDwP+cF/yBIdW+iAQl3BC4GDkkyYulLa73yUYFmw==',key_name='tempest-TestVolumeBootPattern-819204347',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d1051405ca054c4bb051fb842a5fb5a0',ramdisk_id='',reservation_id='r-1e0ujb90',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1215567595',owner_user_name='tempest-TestVolumeBootPattern-1215567595-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T00:48:03Z,user_data=None,user_id='ae836eab78514cf3894e5e11240ff374',uuid=08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4983d9d7-3996-4f95-bc35-0ab5b325e341", "address": "fa:16:3e:fc:8d:e2", "network": {"id": "dc50ae7b-d501-461f-aa0b-542514330ae8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1091857056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1051405ca054c4bb051fb842a5fb5a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4983d9d7-39", "ovs_interfaceid": "4983d9d7-3996-4f95-bc35-0ab5b325e341", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75165) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 00:48:22 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-cbdae197-e20f-46f6-a74f-dc99b2dad477 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Converting VIF {"id": "4983d9d7-3996-4f95-bc35-0ab5b325e341", "address": "fa:16:3e:fc:8d:e2", "network": {"id": "dc50ae7b-d501-461f-aa0b-542514330ae8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1091857056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1051405ca054c4bb051fb842a5fb5a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4983d9d7-39", "ovs_interfaceid": "4983d9d7-3996-4f95-bc35-0ab5b325e341", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:48:22 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-cbdae197-e20f-46f6-a74f-dc99b2dad477 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:8d:e2,bridge_name='br-int',has_traffic_filtering=True,id=4983d9d7-3996-4f95-bc35-0ab5b325e341,network=Network(dc50ae7b-d501-461f-aa0b-542514330ae8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4983d9d7-39') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:48:22 user nova-compute[75165]: DEBUG nova.objects.instance [None req-cbdae197-e20f-46f6-a74f-dc99b2dad477 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Lazy-loading 'pci_devices' on Instance uuid 08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:48:22 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-cbdae197-e20f-46f6-a74f-dc99b2dad477 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed] End _get_guest_xml xml=<domain type="kvm">
Oct 26 00:48:22 user nova-compute[75165]:   <uuid>08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed</uuid>
Oct 26 00:48:22 user nova-compute[75165]:   <name>instance-00000031</name>
Oct 26 00:48:22 user nova-compute[75165]:   <memory>524288</memory>
Oct 26 00:48:22 user nova-compute[75165]:   <vcpu>1</vcpu>
Oct 26 00:48:22 user nova-compute[75165]:   <metadata>
Oct 26 00:48:22 user nova-compute[75165]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 00:48:22 user nova-compute[75165]:       <nova:package version="0.0.0"/>
Oct 26 00:48:22 user nova-compute[75165]:       <nova:name>tempest-TestVolumeBootPattern-server-951983608</nova:name>
Oct 26 00:48:22 user nova-compute[75165]:       <nova:creationTime>2023-10-26 00:48:21</nova:creationTime>
Oct 26 00:48:22 user nova-compute[75165]:       <nova:flavor name="m1.tiny">
Oct 26 00:48:22 user nova-compute[75165]:         <nova:memory>512</nova:memory>
Oct 26 00:48:22 user nova-compute[75165]:         <nova:disk>1</nova:disk>
Oct 26 00:48:22 user nova-compute[75165]:         <nova:swap>0</nova:swap>
Oct 26 00:48:22 user nova-compute[75165]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 00:48:22 user nova-compute[75165]:         <nova:vcpus>1</nova:vcpus>
Oct 26 00:48:22 user nova-compute[75165]:       </nova:flavor>
Oct 26 00:48:22 user nova-compute[75165]:       <nova:owner>
Oct 26 00:48:22 user nova-compute[75165]:         <nova:user uuid="ae836eab78514cf3894e5e11240ff374">tempest-TestVolumeBootPattern-1215567595-project-member</nova:user>
Oct 26 00:48:22 user nova-compute[75165]:         <nova:project uuid="d1051405ca054c4bb051fb842a5fb5a0">tempest-TestVolumeBootPattern-1215567595</nova:project>
Oct 26 00:48:22 user nova-compute[75165]:       </nova:owner>
Oct 26 00:48:22 user nova-compute[75165]:       <nova:ports>
Oct 26 00:48:22 user nova-compute[75165]:         <nova:port uuid="4983d9d7-3996-4f95-bc35-0ab5b325e341">
Oct 26 00:48:22 user nova-compute[75165]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 26 00:48:22 user nova-compute[75165]:         </nova:port>
Oct 26 00:48:22 user nova-compute[75165]:       </nova:ports>
Oct 26 00:48:22 user nova-compute[75165]:     </nova:instance>
Oct 26 00:48:22 user nova-compute[75165]:   </metadata>
Oct 26 00:48:22 user nova-compute[75165]:   <sysinfo type="smbios">
Oct 26 00:48:22 user nova-compute[75165]:     <system>
Oct 26 00:48:22 user nova-compute[75165]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 00:48:22 user nova-compute[75165]:       <entry name="product">OpenStack Nova</entry>
Oct 26 00:48:22 user nova-compute[75165]:       <entry name="version">0.0.0</entry>
Oct 26 00:48:22 user nova-compute[75165]:       <entry name="serial">08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed</entry>
Oct 26 00:48:22 user nova-compute[75165]:       <entry name="uuid">08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed</entry>
Oct 26 00:48:22 user nova-compute[75165]:       <entry name="family">Virtual Machine</entry>
Oct 26 00:48:22 user nova-compute[75165]:     </system>
Oct 26 00:48:22 user nova-compute[75165]:   </sysinfo>
Oct 26 00:48:22 user nova-compute[75165]:   <os>
Oct 26 00:48:22 user nova-compute[75165]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 00:48:22 user nova-compute[75165]:     <boot dev="hd"/>
Oct 26 00:48:22 user nova-compute[75165]:     <smbios mode="sysinfo"/>
Oct 26 00:48:22 user nova-compute[75165]:   </os>
Oct 26 00:48:22 user nova-compute[75165]:   <features>
Oct 26 00:48:22 user nova-compute[75165]:     <acpi/>
Oct 26 00:48:22 user nova-compute[75165]:     <apic/>
Oct 26 00:48:22 user nova-compute[75165]:     <vmcoreinfo/>
Oct 26 00:48:22 user nova-compute[75165]:   </features>
Oct 26 00:48:22 user nova-compute[75165]:   <clock offset="utc">
Oct 26 00:48:22 user nova-compute[75165]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 00:48:22 user nova-compute[75165]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 00:48:22 user nova-compute[75165]:     <timer name="hpet" present="no"/>
Oct 26 00:48:22 user nova-compute[75165]:   </clock>
Oct 26 00:48:22 user nova-compute[75165]:   <cpu mode="custom" match="exact">
Oct 26 00:48:22 user nova-compute[75165]:     <model>Nehalem</model>
Oct 26 00:48:22 user nova-compute[75165]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 00:48:22 user nova-compute[75165]:   </cpu>
Oct 26 00:48:22 user nova-compute[75165]:   <devices>
Oct 26 00:48:22 user nova-compute[75165]:     <disk type="block" device="disk">
Oct 26 00:48:22 user nova-compute[75165]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 00:48:22 user nova-compute[75165]:       <source dev="/dev/sdb"/>
Oct 26 00:48:22 user nova-compute[75165]:       <target dev="vda" bus="virtio"/>
Oct 26 00:48:22 user nova-compute[75165]:       <serial>28483cbc-41a9-4961-9c30-fae820d1ad43</serial>
Oct 26 00:48:22 user nova-compute[75165]:     </disk>
Oct 26 00:48:22 user nova-compute[75165]:     <interface type="ethernet">
Oct 26 00:48:22 user nova-compute[75165]:       <mac address="fa:16:3e:fc:8d:e2"/>
Oct 26 00:48:22 user nova-compute[75165]:       <model type="virtio"/>
Oct 26 00:48:22 user nova-compute[75165]:       <mtu size="1442"/>
Oct 26 00:48:22 user nova-compute[75165]:       <target dev="tap4983d9d7-39"/>
Oct 26 00:48:22 user nova-compute[75165]:     </interface>
Oct 26 00:48:22 user nova-compute[75165]:     <serial type="pty">
Oct 26 00:48:22 user nova-compute[75165]:       <log file="/opt/stack/data/nova/instances/08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed/console.log" append="off"/>
Oct 26 00:48:22 user nova-compute[75165]:     </serial>
Oct 26 00:48:22 user nova-compute[75165]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 00:48:22 user nova-compute[75165]:     <video>
Oct 26 00:48:22 user nova-compute[75165]:       <model type="virtio"/>
Oct 26 00:48:22 user nova-compute[75165]:     </video>
Oct 26 00:48:22 user nova-compute[75165]:     <rng model="virtio">
Oct 26 00:48:22 user nova-compute[75165]:       <backend model="random">/dev/urandom</backend>
Oct 26 00:48:22 user nova-compute[75165]:     </rng>
Oct 26 00:48:22 user nova-compute[75165]:     <controller type="usb" index="0" model="none"/>
Oct 26 00:48:22 user nova-compute[75165]:     <memballoon model="virtio">
Oct 26 00:48:22 user nova-compute[75165]:       <stats period="10"/>
Oct 26 00:48:22 user nova-compute[75165]:     </memballoon>
Oct 26 00:48:22 user nova-compute[75165]:   </devices>
Oct 26 00:48:22 user nova-compute[75165]: </domain>
Oct 26 00:48:22 user nova-compute[75165]:  {{(pid=75165) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 00:48:22 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-cbdae197-e20f-46f6-a74f-dc99b2dad477 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:48:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-951983608',display_name='tempest-TestVolumeBootPattern-server-951983608',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-951983608',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBChKvTLd4nhrj5htJzspkP8o+qgId41EjTR/fmBLYf3vmPpK9NBbxwvdQKkZqqXFiSi6AG6cvipLHicvfW4NLnZq3yjDwP+cF/yBIdW+iAQl3BC4GDkkyYulLa73yUYFmw==',key_name='tempest-TestVolumeBootPattern-819204347',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d1051405ca054c4bb051fb842a5fb5a0',ramdisk_id='',reservation_id='r-1e0ujb90',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1215567595',owner_user_name='tempest-TestVolumeBootPattern-1215567595-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T00:48:03Z,user_data=None,user_id='ae836eab78514cf3894e5e11240ff374',uuid=08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4983d9d7-3996-4f95-bc35-0ab5b325e341", "address": "fa:16:3e:fc:8d:e2", "network": {"id": "dc50ae7b-d501-461f-aa0b-542514330ae8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1091857056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1051405ca054c4bb051fb842a5fb5a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4983d9d7-39", "ovs_interfaceid": "4983d9d7-3996-4f95-bc35-0ab5b325e341", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 00:48:22 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-cbdae197-e20f-46f6-a74f-dc99b2dad477 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Converting VIF {"id": "4983d9d7-3996-4f95-bc35-0ab5b325e341", "address": "fa:16:3e:fc:8d:e2", "network": {"id": "dc50ae7b-d501-461f-aa0b-542514330ae8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1091857056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1051405ca054c4bb051fb842a5fb5a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4983d9d7-39", "ovs_interfaceid": "4983d9d7-3996-4f95-bc35-0ab5b325e341", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:48:22 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-cbdae197-e20f-46f6-a74f-dc99b2dad477 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:8d:e2,bridge_name='br-int',has_traffic_filtering=True,id=4983d9d7-3996-4f95-bc35-0ab5b325e341,network=Network(dc50ae7b-d501-461f-aa0b-542514330ae8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4983d9d7-39') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:48:22 user nova-compute[75165]: DEBUG os_vif [None req-cbdae197-e20f-46f6-a74f-dc99b2dad477 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:8d:e2,bridge_name='br-int',has_traffic_filtering=True,id=4983d9d7-3996-4f95-bc35-0ab5b325e341,network=Network(dc50ae7b-d501-461f-aa0b-542514330ae8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4983d9d7-39') {{(pid=75165) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 00:48:22 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:48:22 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:48:22 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 00:48:22 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:48:22 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3a10d8d7-3fa3-5a4b-821b-76addd7ad459', '_type': 'linux-noop'}}, row=False) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:48:22 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:48:22 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:48:22 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:48:22 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4983d9d7-39, may_exist=True, interface_attrs={}) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:48:22 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4983d9d7-39, col_values=(('qos', UUID('384c7f2e-5484-490b-a26c-c13d285c6c3a')),), if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:48:22 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4983d9d7-39, col_values=(('external_ids', {'iface-id': '4983d9d7-3996-4f95-bc35-0ab5b325e341', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fc:8d:e2', 'vm-uuid': '08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed'}),), if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:48:22 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:48:22 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:48:22 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:48:22 user nova-compute[75165]: INFO os_vif [None req-cbdae197-e20f-46f6-a74f-dc99b2dad477 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:8d:e2,bridge_name='br-int',has_traffic_filtering=True,id=4983d9d7-3996-4f95-bc35-0ab5b325e341,network=Network(dc50ae7b-d501-461f-aa0b-542514330ae8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4983d9d7-39')
Oct 26 00:48:22 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-cbdae197-e20f-46f6-a74f-dc99b2dad477 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] No BDM found with device name vda, not building metadata. {{(pid=75165) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 00:48:22 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-cbdae197-e20f-46f6-a74f-dc99b2dad477 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] No VIF found with MAC fa:16:3e:fc:8d:e2, not building metadata {{(pid=75165) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 00:48:23 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:48:23 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:48:24 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:48:24 user nova-compute[75165]: DEBUG nova.compute.manager [req-b86059dd-4e12-4cb0-8dd4-c8a129171a16 req-22a4d93e-6763-42db-b762-8774a4d3e637 service nova] [instance: 08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed] Received event network-vif-plugged-4983d9d7-3996-4f95-bc35-0ab5b325e341 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:48:24 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-b86059dd-4e12-4cb0-8dd4-c8a129171a16 req-22a4d93e-6763-42db-b762-8774a4d3e637 service nova] Acquiring lock "08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:48:24 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-b86059dd-4e12-4cb0-8dd4-c8a129171a16 req-22a4d93e-6763-42db-b762-8774a4d3e637 service nova] Lock "08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:48:24 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-b86059dd-4e12-4cb0-8dd4-c8a129171a16 req-22a4d93e-6763-42db-b762-8774a4d3e637 service nova] Lock "08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:48:24 user nova-compute[75165]: DEBUG nova.compute.manager [req-b86059dd-4e12-4cb0-8dd4-c8a129171a16 req-22a4d93e-6763-42db-b762-8774a4d3e637 service nova] [instance: 08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed] No waiting events found dispatching network-vif-plugged-4983d9d7-3996-4f95-bc35-0ab5b325e341 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:48:24 user nova-compute[75165]: WARNING nova.compute.manager [req-b86059dd-4e12-4cb0-8dd4-c8a129171a16 req-22a4d93e-6763-42db-b762-8774a4d3e637 service nova] [instance: 08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed] Received unexpected event network-vif-plugged-4983d9d7-3996-4f95-bc35-0ab5b325e341 for instance with vm_state building and task_state spawning.
Oct 26 00:48:24 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:48:24 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:48:24 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:48:24 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:48:26 user nova-compute[75165]: DEBUG nova.compute.manager [None req-cbdae197-e20f-46f6-a74f-dc99b2dad477 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed] Instance event wait completed in 0 seconds for  {{(pid=75165) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 00:48:26 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-cbdae197-e20f-46f6-a74f-dc99b2dad477 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed] Guest created on hypervisor {{(pid=75165) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 00:48:26 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: 08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed] Instance spawned successfully.
Oct 26 00:48:26 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-cbdae197-e20f-46f6-a74f-dc99b2dad477 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 00:48:26 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-cbdae197-e20f-46f6-a74f-dc99b2dad477 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed] Found default for hw_cdrom_bus of ide {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:48:26 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-cbdae197-e20f-46f6-a74f-dc99b2dad477 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed] Found default for hw_disk_bus of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:48:26 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-cbdae197-e20f-46f6-a74f-dc99b2dad477 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed] Found default for hw_input_bus of None {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:48:26 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-cbdae197-e20f-46f6-a74f-dc99b2dad477 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed] Found default for hw_pointer_model of None {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:48:26 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-cbdae197-e20f-46f6-a74f-dc99b2dad477 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed] Found default for hw_video_model of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:48:26 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-cbdae197-e20f-46f6-a74f-dc99b2dad477 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed] Found default for hw_vif_model of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:48:26 user nova-compute[75165]: INFO nova.compute.manager [None req-cbdae197-e20f-46f6-a74f-dc99b2dad477 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed] Took 4.99 seconds to spawn the instance on the hypervisor.
Oct 26 00:48:26 user nova-compute[75165]: DEBUG nova.compute.manager [None req-cbdae197-e20f-46f6-a74f-dc99b2dad477 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed] Checking state {{(pid=75165) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 00:48:26 user nova-compute[75165]: INFO nova.compute.manager [None req-cbdae197-e20f-46f6-a74f-dc99b2dad477 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed] Took 23.56 seconds to build instance.
Oct 26 00:48:26 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-cbdae197-e20f-46f6-a74f-dc99b2dad477 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Lock "08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 23.662s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:48:26 user nova-compute[75165]: DEBUG nova.compute.manager [req-ee1c1968-d078-47c3-932e-2a97cbefecde req-dfbdf8fd-5368-487a-8a20-eb0cad7c46ca service nova] [instance: 08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed] Received event network-vif-plugged-4983d9d7-3996-4f95-bc35-0ab5b325e341 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:48:26 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-ee1c1968-d078-47c3-932e-2a97cbefecde req-dfbdf8fd-5368-487a-8a20-eb0cad7c46ca service nova] Acquiring lock "08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:48:26 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-ee1c1968-d078-47c3-932e-2a97cbefecde req-dfbdf8fd-5368-487a-8a20-eb0cad7c46ca service nova] Lock "08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:48:26 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-ee1c1968-d078-47c3-932e-2a97cbefecde req-dfbdf8fd-5368-487a-8a20-eb0cad7c46ca service nova] Lock "08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:48:26 user nova-compute[75165]: DEBUG nova.compute.manager [req-ee1c1968-d078-47c3-932e-2a97cbefecde req-dfbdf8fd-5368-487a-8a20-eb0cad7c46ca service nova] [instance: 08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed] No waiting events found dispatching network-vif-plugged-4983d9d7-3996-4f95-bc35-0ab5b325e341 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:48:26 user nova-compute[75165]: WARNING nova.compute.manager [req-ee1c1968-d078-47c3-932e-2a97cbefecde req-dfbdf8fd-5368-487a-8a20-eb0cad7c46ca service nova] [instance: 08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed] Received unexpected event network-vif-plugged-4983d9d7-3996-4f95-bc35-0ab5b325e341 for instance with vm_state active and task_state None.
Oct 26 00:48:27 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:48:27 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:48:27 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:48:27 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75165) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 00:48:32 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:48:32 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:48:32 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=75165) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 00:48:32 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75165) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 00:48:32 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75165) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 00:48:32 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:48:33 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:48:35 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:48:36 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:48:36 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:48:36 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-19d7ff4e-3fd9-415f-a78b-74c2d11cd9a3 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Acquiring lock "624db3ad-20f2-4302-8fec-b77a5b8ebc39" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:48:36 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-19d7ff4e-3fd9-415f-a78b-74c2d11cd9a3 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Lock "624db3ad-20f2-4302-8fec-b77a5b8ebc39" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:48:36 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-19d7ff4e-3fd9-415f-a78b-74c2d11cd9a3 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Acquiring lock "624db3ad-20f2-4302-8fec-b77a5b8ebc39-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:48:36 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-19d7ff4e-3fd9-415f-a78b-74c2d11cd9a3 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Lock "624db3ad-20f2-4302-8fec-b77a5b8ebc39-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:48:36 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-19d7ff4e-3fd9-415f-a78b-74c2d11cd9a3 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Lock "624db3ad-20f2-4302-8fec-b77a5b8ebc39-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:48:36 user nova-compute[75165]: INFO nova.compute.manager [None req-19d7ff4e-3fd9-415f-a78b-74c2d11cd9a3 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 624db3ad-20f2-4302-8fec-b77a5b8ebc39] Terminating instance
Oct 26 00:48:36 user nova-compute[75165]: DEBUG nova.compute.manager [None req-19d7ff4e-3fd9-415f-a78b-74c2d11cd9a3 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 624db3ad-20f2-4302-8fec-b77a5b8ebc39] Start destroying the instance on the hypervisor. {{(pid=75165) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 00:48:37 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:48:37 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:48:37 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:48:37 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:48:37 user nova-compute[75165]: DEBUG nova.compute.manager [req-6c0188ea-acaa-4008-b7e1-7b5d82906ffa req-9286c370-ad29-42b8-9e2a-a0d873ac4b39 service nova] [instance: 624db3ad-20f2-4302-8fec-b77a5b8ebc39] Received event network-vif-unplugged-7b2215ca-3a79-4fbe-bad8-7cea3a0c2dca {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:48:37 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-6c0188ea-acaa-4008-b7e1-7b5d82906ffa req-9286c370-ad29-42b8-9e2a-a0d873ac4b39 service nova] Acquiring lock "624db3ad-20f2-4302-8fec-b77a5b8ebc39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:48:37 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-6c0188ea-acaa-4008-b7e1-7b5d82906ffa req-9286c370-ad29-42b8-9e2a-a0d873ac4b39 service nova] Lock "624db3ad-20f2-4302-8fec-b77a5b8ebc39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:48:37 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-6c0188ea-acaa-4008-b7e1-7b5d82906ffa req-9286c370-ad29-42b8-9e2a-a0d873ac4b39 service nova] Lock "624db3ad-20f2-4302-8fec-b77a5b8ebc39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:48:37 user nova-compute[75165]: DEBUG nova.compute.manager [req-6c0188ea-acaa-4008-b7e1-7b5d82906ffa req-9286c370-ad29-42b8-9e2a-a0d873ac4b39 service nova] [instance: 624db3ad-20f2-4302-8fec-b77a5b8ebc39] No waiting events found dispatching network-vif-unplugged-7b2215ca-3a79-4fbe-bad8-7cea3a0c2dca {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:48:37 user nova-compute[75165]: DEBUG nova.compute.manager [req-6c0188ea-acaa-4008-b7e1-7b5d82906ffa req-9286c370-ad29-42b8-9e2a-a0d873ac4b39 service nova] [instance: 624db3ad-20f2-4302-8fec-b77a5b8ebc39] Received event network-vif-unplugged-7b2215ca-3a79-4fbe-bad8-7cea3a0c2dca for instance with task_state deleting. {{(pid=75165) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 00:48:37 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: 624db3ad-20f2-4302-8fec-b77a5b8ebc39] Instance destroyed successfully.
Oct 26 00:48:37 user nova-compute[75165]: DEBUG nova.objects.instance [None req-19d7ff4e-3fd9-415f-a78b-74c2d11cd9a3 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Lazy-loading 'resources' on Instance uuid 624db3ad-20f2-4302-8fec-b77a5b8ebc39 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:48:37 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:48:37 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-19d7ff4e-3fd9-415f-a78b-74c2d11cd9a3 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:45:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-46239259',display_name='tempest-AttachVolumeNegativeTest-server-46239259',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-46239259',id=48,image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP8QuWCfmwXA+CjXd+b1yM7KY+je2xQytevsUcbENlFjJlfNU7eDMmDeCDX6t1ARUWX8tlYMbk98u0VgX5fB7r76RpcVYYKtcXzvEM9HSJqJR0D3zn0wqQUp2epxGITGvg==',key_name='tempest-keypair-45744395',keypairs=<?>,launch_index=0,launched_at=2023-10-26T00:45:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='62572ce8ae524b55950532fd89729b71',ramdisk_id='',reservation_id='r-8jd0e6ua',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bff0d8a1-739e-4c4d-9efa-b73ba7b76d01',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-988376295',owner_user_name='tempest-AttachVolumeNegativeTest-988376295-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T00:45:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='041ebe2732c341129d6813549653cab3',uuid=624db3ad-20f2-4302-8fec-b77a5b8ebc39,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7b2215ca-3a79-4fbe-bad8-7cea3a0c2dca", "address": "fa:16:3e:e4:cb:af", "network": {"id": "1801db1c-315e-4bdf-b73b-132a38bf41b8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1254756052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62572ce8ae524b55950532fd89729b71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b2215ca-3a", "ovs_interfaceid": "7b2215ca-3a79-4fbe-bad8-7cea3a0c2dca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 00:48:37 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-19d7ff4e-3fd9-415f-a78b-74c2d11cd9a3 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Converting VIF {"id": "7b2215ca-3a79-4fbe-bad8-7cea3a0c2dca", "address": "fa:16:3e:e4:cb:af", "network": {"id": "1801db1c-315e-4bdf-b73b-132a38bf41b8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1254756052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62572ce8ae524b55950532fd89729b71", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b2215ca-3a", "ovs_interfaceid": "7b2215ca-3a79-4fbe-bad8-7cea3a0c2dca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:48:37 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-19d7ff4e-3fd9-415f-a78b-74c2d11cd9a3 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e4:cb:af,bridge_name='br-int',has_traffic_filtering=True,id=7b2215ca-3a79-4fbe-bad8-7cea3a0c2dca,network=Network(1801db1c-315e-4bdf-b73b-132a38bf41b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b2215ca-3a') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:48:37 user nova-compute[75165]: DEBUG os_vif [None req-19d7ff4e-3fd9-415f-a78b-74c2d11cd9a3 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e4:cb:af,bridge_name='br-int',has_traffic_filtering=True,id=7b2215ca-3a79-4fbe-bad8-7cea3a0c2dca,network=Network(1801db1c-315e-4bdf-b73b-132a38bf41b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b2215ca-3a') {{(pid=75165) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 00:48:37 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:48:37 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7b2215ca-3a, bridge=br-int, if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:48:37 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:48:37 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:48:37 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:48:37 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5dd4bca2-a9cb-4005-bcf5-f350d60a971e) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:48:37 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:48:37 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:48:37 user nova-compute[75165]: INFO os_vif [None req-19d7ff4e-3fd9-415f-a78b-74c2d11cd9a3 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e4:cb:af,bridge_name='br-int',has_traffic_filtering=True,id=7b2215ca-3a79-4fbe-bad8-7cea3a0c2dca,network=Network(1801db1c-315e-4bdf-b73b-132a38bf41b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b2215ca-3a')
Oct 26 00:48:37 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-19d7ff4e-3fd9-415f-a78b-74c2d11cd9a3 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 624db3ad-20f2-4302-8fec-b77a5b8ebc39] Deleting instance files /opt/stack/data/nova/instances/624db3ad-20f2-4302-8fec-b77a5b8ebc39_del
Oct 26 00:48:37 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-19d7ff4e-3fd9-415f-a78b-74c2d11cd9a3 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 624db3ad-20f2-4302-8fec-b77a5b8ebc39] Deletion of /opt/stack/data/nova/instances/624db3ad-20f2-4302-8fec-b77a5b8ebc39_del complete
Oct 26 00:48:37 user nova-compute[75165]: INFO nova.compute.manager [None req-19d7ff4e-3fd9-415f-a78b-74c2d11cd9a3 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] [instance: 624db3ad-20f2-4302-8fec-b77a5b8ebc39] Took 0.85 seconds to destroy the instance on the hypervisor.
Oct 26 00:48:37 user nova-compute[75165]: DEBUG oslo.service.loopingcall [None req-19d7ff4e-3fd9-415f-a78b-74c2d11cd9a3 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75165) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 00:48:37 user nova-compute[75165]: DEBUG nova.compute.manager [-] [instance: 624db3ad-20f2-4302-8fec-b77a5b8ebc39] Deallocating network for instance {{(pid=75165) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 00:48:37 user nova-compute[75165]: DEBUG nova.network.neutron [-] [instance: 624db3ad-20f2-4302-8fec-b77a5b8ebc39] deallocate_for_instance() {{(pid=75165) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 00:48:37 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:48:37 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:48:39 user nova-compute[75165]: DEBUG nova.network.neutron [-] [instance: 624db3ad-20f2-4302-8fec-b77a5b8ebc39] Updating instance_info_cache with network_info: [] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:48:39 user nova-compute[75165]: INFO nova.compute.manager [-] [instance: 624db3ad-20f2-4302-8fec-b77a5b8ebc39] Took 1.22 seconds to deallocate network for instance.
Oct 26 00:48:39 user nova-compute[75165]: DEBUG nova.compute.manager [req-b40af1f0-f08f-4453-a524-7e842806af99 req-9c6fc7ad-b93e-489f-bcac-60683956e2a4 service nova] [instance: 624db3ad-20f2-4302-8fec-b77a5b8ebc39] Received event network-vif-deleted-7b2215ca-3a79-4fbe-bad8-7cea3a0c2dca {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:48:39 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-19d7ff4e-3fd9-415f-a78b-74c2d11cd9a3 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:48:39 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-19d7ff4e-3fd9-415f-a78b-74c2d11cd9a3 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:48:39 user nova-compute[75165]: DEBUG nova.compute.manager [req-1cd19cd9-7541-4adb-b85b-577819687242 req-507dac51-37ca-4670-82a8-9ff0ab842460 service nova] [instance: 624db3ad-20f2-4302-8fec-b77a5b8ebc39] Received event network-vif-plugged-7b2215ca-3a79-4fbe-bad8-7cea3a0c2dca {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:48:39 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-1cd19cd9-7541-4adb-b85b-577819687242 req-507dac51-37ca-4670-82a8-9ff0ab842460 service nova] Acquiring lock "624db3ad-20f2-4302-8fec-b77a5b8ebc39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:48:39 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-1cd19cd9-7541-4adb-b85b-577819687242 req-507dac51-37ca-4670-82a8-9ff0ab842460 service nova] Lock "624db3ad-20f2-4302-8fec-b77a5b8ebc39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:48:39 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-1cd19cd9-7541-4adb-b85b-577819687242 req-507dac51-37ca-4670-82a8-9ff0ab842460 service nova] Lock "624db3ad-20f2-4302-8fec-b77a5b8ebc39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:48:39 user nova-compute[75165]: DEBUG nova.compute.manager [req-1cd19cd9-7541-4adb-b85b-577819687242 req-507dac51-37ca-4670-82a8-9ff0ab842460 service nova] [instance: 624db3ad-20f2-4302-8fec-b77a5b8ebc39] No waiting events found dispatching network-vif-plugged-7b2215ca-3a79-4fbe-bad8-7cea3a0c2dca {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:48:39 user nova-compute[75165]: WARNING nova.compute.manager [req-1cd19cd9-7541-4adb-b85b-577819687242 req-507dac51-37ca-4670-82a8-9ff0ab842460 service nova] [instance: 624db3ad-20f2-4302-8fec-b77a5b8ebc39] Received unexpected event network-vif-plugged-7b2215ca-3a79-4fbe-bad8-7cea3a0c2dca for instance with vm_state deleted and task_state None.
Oct 26 00:48:39 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-19d7ff4e-3fd9-415f-a78b-74c2d11cd9a3 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Refreshing inventories for resource provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 26 00:48:39 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-19d7ff4e-3fd9-415f-a78b-74c2d11cd9a3 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Updating ProviderTree inventory for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 26 00:48:39 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-19d7ff4e-3fd9-415f-a78b-74c2d11cd9a3 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Updating inventory in ProviderTree for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 26 00:48:39 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-19d7ff4e-3fd9-415f-a78b-74c2d11cd9a3 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Refreshing aggregate associations for resource provider 03214fd5-21d1-46ec-b6b0-6449b77ba230, aggregates: None {{(pid=75165) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 26 00:48:39 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-19d7ff4e-3fd9-415f-a78b-74c2d11cd9a3 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Refreshing trait associations for resource provider 03214fd5-21d1-46ec-b6b0-6449b77ba230, traits: COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NODE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_TRUSTED_CERTS,COMPUTE_DEVICE_TAGGING,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO {{(pid=75165) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 26 00:48:39 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-19d7ff4e-3fd9-415f-a78b-74c2d11cd9a3 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:48:39 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-19d7ff4e-3fd9-415f-a78b-74c2d11cd9a3 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:48:39 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-19d7ff4e-3fd9-415f-a78b-74c2d11cd9a3 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.522s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:48:39 user nova-compute[75165]: INFO nova.scheduler.client.report [None req-19d7ff4e-3fd9-415f-a78b-74c2d11cd9a3 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Deleted allocations for instance 624db3ad-20f2-4302-8fec-b77a5b8ebc39
Oct 26 00:48:39 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-19d7ff4e-3fd9-415f-a78b-74c2d11cd9a3 tempest-AttachVolumeNegativeTest-988376295 tempest-AttachVolumeNegativeTest-988376295-project-member] Lock "624db3ad-20f2-4302-8fec-b77a5b8ebc39" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.786s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:48:40 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:48:40 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Starting heal instance info cache {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 00:48:40 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Rebuilding the list of instances to heal {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 00:48:41 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "refresh_cache-08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:48:41 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquired lock "refresh_cache-08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:48:41 user nova-compute[75165]: DEBUG nova.network.neutron [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: 08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed] Forcefully refreshing network info cache for instance {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 00:48:41 user nova-compute[75165]: DEBUG nova.objects.instance [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lazy-loading 'info_cache' on Instance uuid 08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:48:41 user nova-compute[75165]: DEBUG nova.network.neutron [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: 08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed] Updating instance_info_cache with network_info: [{"id": "4983d9d7-3996-4f95-bc35-0ab5b325e341", "address": "fa:16:3e:fc:8d:e2", "network": {"id": "dc50ae7b-d501-461f-aa0b-542514330ae8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1091857056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1051405ca054c4bb051fb842a5fb5a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4983d9d7-39", "ovs_interfaceid": "4983d9d7-3996-4f95-bc35-0ab5b325e341", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:48:41 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Releasing lock "refresh_cache-08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:48:41 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: 08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed] Updated the network info_cache for instance {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 00:48:42 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:48:42 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:48:43 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:48:43 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:48:43 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:48:43 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:48:43 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:48:43 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75165) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 00:48:43 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75165) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 00:48:44 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:48:44 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:48:44 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Hypervisor/Node resource view: name=user free_ram=8966MB free_disk=24.839214324951172GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75165) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 00:48:44 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:48:44 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:48:44 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:48:44 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75165) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 00:48:44 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75165) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 00:48:44 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:48:44 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:48:44 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Compute_service record updated for user:user {{(pid=75165) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 00:48:44 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.202s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:48:44 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:48:44 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75165) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 26 00:48:47 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:48:47 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:48:52 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:48:52 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:48:57 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:48:57 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:49:02 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:49:06 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:49:06 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Cleaning up deleted instances {{(pid=75165) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 26 00:49:06 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] There are 0 instances to clean {{(pid=75165) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 26 00:49:07 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:49:12 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:49:17 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:49:22 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:49:27 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:49:27 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:49:27 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:49:27 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75165) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 00:49:32 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:49:34 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:49:36 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:49:36 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:49:37 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:49:37 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:49:38 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:49:39 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:49:41 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:49:41 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Starting heal instance info cache {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 00:49:41 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Rebuilding the list of instances to heal {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 00:49:41 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "refresh_cache-08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:49:41 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquired lock "refresh_cache-08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:49:41 user nova-compute[75165]: DEBUG nova.network.neutron [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: 08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed] Forcefully refreshing network info cache for instance {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 00:49:41 user nova-compute[75165]: DEBUG nova.objects.instance [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lazy-loading 'info_cache' on Instance uuid 08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:49:42 user nova-compute[75165]: DEBUG nova.network.neutron [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: 08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed] Updating instance_info_cache with network_info: [{"id": "4983d9d7-3996-4f95-bc35-0ab5b325e341", "address": "fa:16:3e:fc:8d:e2", "network": {"id": "dc50ae7b-d501-461f-aa0b-542514330ae8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1091857056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1051405ca054c4bb051fb842a5fb5a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4983d9d7-39", "ovs_interfaceid": "4983d9d7-3996-4f95-bc35-0ab5b325e341", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:49:42 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Releasing lock "refresh_cache-08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:49:42 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: 08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed] Updated the network info_cache for instance {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 00:49:42 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:49:44 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:49:45 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:49:45 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:49:45 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:49:45 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:49:45 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75165) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 00:49:45 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75165) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 00:49:46 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:49:46 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:49:46 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Hypervisor/Node resource view: name=user free_ram=9006MB free_disk=24.838287353515625GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75165) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 00:49:46 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:49:46 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:49:46 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:49:46 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75165) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 00:49:46 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75165) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 00:49:46 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:49:46 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:49:46 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Compute_service record updated for user:user {{(pid=75165) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 00:49:46 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.172s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:49:47 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:49:52 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:49:54 user nova-compute[75165]: DEBUG nova.compute.manager [req-091e90f3-c72a-4d81-b621-48e4f2d2617d req-d3fcfcd2-239a-4434-96e4-2ca33ed249ba service nova] [instance: 08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed] Received event network-changed-4983d9d7-3996-4f95-bc35-0ab5b325e341 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:49:54 user nova-compute[75165]: DEBUG nova.compute.manager [req-091e90f3-c72a-4d81-b621-48e4f2d2617d req-d3fcfcd2-239a-4434-96e4-2ca33ed249ba service nova] [instance: 08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed] Refreshing instance network info cache due to event network-changed-4983d9d7-3996-4f95-bc35-0ab5b325e341. {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 00:49:54 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-091e90f3-c72a-4d81-b621-48e4f2d2617d req-d3fcfcd2-239a-4434-96e4-2ca33ed249ba service nova] Acquiring lock "refresh_cache-08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:49:54 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-091e90f3-c72a-4d81-b621-48e4f2d2617d req-d3fcfcd2-239a-4434-96e4-2ca33ed249ba service nova] Acquired lock "refresh_cache-08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:49:54 user nova-compute[75165]: DEBUG nova.network.neutron [req-091e90f3-c72a-4d81-b621-48e4f2d2617d req-d3fcfcd2-239a-4434-96e4-2ca33ed249ba service nova] [instance: 08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed] Refreshing network info cache for port 4983d9d7-3996-4f95-bc35-0ab5b325e341 {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 00:49:55 user nova-compute[75165]: DEBUG nova.network.neutron [req-091e90f3-c72a-4d81-b621-48e4f2d2617d req-d3fcfcd2-239a-4434-96e4-2ca33ed249ba service nova] [instance: 08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed] Updated VIF entry in instance network info cache for port 4983d9d7-3996-4f95-bc35-0ab5b325e341. {{(pid=75165) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 00:49:55 user nova-compute[75165]: DEBUG nova.network.neutron [req-091e90f3-c72a-4d81-b621-48e4f2d2617d req-d3fcfcd2-239a-4434-96e4-2ca33ed249ba service nova] [instance: 08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed] Updating instance_info_cache with network_info: [{"id": "4983d9d7-3996-4f95-bc35-0ab5b325e341", "address": "fa:16:3e:fc:8d:e2", "network": {"id": "dc50ae7b-d501-461f-aa0b-542514330ae8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1091857056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1051405ca054c4bb051fb842a5fb5a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4983d9d7-39", "ovs_interfaceid": "4983d9d7-3996-4f95-bc35-0ab5b325e341", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:49:55 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-091e90f3-c72a-4d81-b621-48e4f2d2617d req-d3fcfcd2-239a-4434-96e4-2ca33ed249ba service nova] Releasing lock "refresh_cache-08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:49:57 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:49:57 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:50:01 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:50:02 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:50:02 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:50:07 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:50:11 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-c14b63ba-4ce1-4b61-92e6-642cb248cb17 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Acquiring lock "2bbdbdc6-ce56-4357-87cb-85bbc99e3343" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:50:11 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-c14b63ba-4ce1-4b61-92e6-642cb248cb17 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Lock "2bbdbdc6-ce56-4357-87cb-85bbc99e3343" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:50:11 user nova-compute[75165]: DEBUG nova.compute.manager [None req-c14b63ba-4ce1-4b61-92e6-642cb248cb17 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 2bbdbdc6-ce56-4357-87cb-85bbc99e3343] Starting instance... {{(pid=75165) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 00:50:11 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-c14b63ba-4ce1-4b61-92e6-642cb248cb17 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:50:11 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-c14b63ba-4ce1-4b61-92e6-642cb248cb17 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:50:11 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-c14b63ba-4ce1-4b61-92e6-642cb248cb17 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75165) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 00:50:11 user nova-compute[75165]: INFO nova.compute.claims [None req-c14b63ba-4ce1-4b61-92e6-642cb248cb17 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 2bbdbdc6-ce56-4357-87cb-85bbc99e3343] Claim successful on node user
Oct 26 00:50:11 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-c14b63ba-4ce1-4b61-92e6-642cb248cb17 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:50:11 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-c14b63ba-4ce1-4b61-92e6-642cb248cb17 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:50:11 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-c14b63ba-4ce1-4b61-92e6-642cb248cb17 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.237s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:50:11 user nova-compute[75165]: DEBUG nova.compute.manager [None req-c14b63ba-4ce1-4b61-92e6-642cb248cb17 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 2bbdbdc6-ce56-4357-87cb-85bbc99e3343] Start building networks asynchronously for instance. {{(pid=75165) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 00:50:11 user nova-compute[75165]: DEBUG nova.compute.manager [None req-c14b63ba-4ce1-4b61-92e6-642cb248cb17 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 2bbdbdc6-ce56-4357-87cb-85bbc99e3343] Allocating IP information in the background. {{(pid=75165) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 00:50:11 user nova-compute[75165]: DEBUG nova.network.neutron [None req-c14b63ba-4ce1-4b61-92e6-642cb248cb17 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 2bbdbdc6-ce56-4357-87cb-85bbc99e3343] allocate_for_instance() {{(pid=75165) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 00:50:11 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-c14b63ba-4ce1-4b61-92e6-642cb248cb17 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 2bbdbdc6-ce56-4357-87cb-85bbc99e3343] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 00:50:11 user nova-compute[75165]: DEBUG nova.compute.manager [None req-c14b63ba-4ce1-4b61-92e6-642cb248cb17 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 2bbdbdc6-ce56-4357-87cb-85bbc99e3343] Start building block device mappings for instance. {{(pid=75165) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 00:50:11 user nova-compute[75165]: DEBUG nova.policy [None req-c14b63ba-4ce1-4b61-92e6-642cb248cb17 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ae836eab78514cf3894e5e11240ff374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1051405ca054c4bb051fb842a5fb5a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75165) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 00:50:11 user nova-compute[75165]: INFO nova.virt.block_device [None req-c14b63ba-4ce1-4b61-92e6-642cb248cb17 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 2bbdbdc6-ce56-4357-87cb-85bbc99e3343] Booting with volume c9c9fee3-6885-4dc9-9b49-cca3631705bb at /dev/vda
Oct 26 00:50:11 user nova-compute[75165]: DEBUG os_brick.utils [None req-c14b63ba-4ce1-4b61-92e6-642cb248cb17 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:50:11 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:50:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:50:12 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[699a5a70-3bbf-419e-8d9e-8e23a4f54f6b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa94814ccb35\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:50:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:50:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:50:12 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[a020be56-af98-495a-b7c1-012f0dd549d0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:50:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:50:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:50:12 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[e24abce3-c31b-46ce-9cde-0eadac81ea50]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:50:12 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[181f8ee9-3834-4895-bf1a-d4ac5de85bda]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:50:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-c14b63ba-4ce1-4b61-92e6-642cb248cb17 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Running cmd (subprocess): nvme version {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:50:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-c14b63ba-4ce1-4b61-92e6-642cb248cb17 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] 'nvme version' failed. Not Retrying. {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 00:50:12 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c14b63ba-4ce1-4b61-92e6-642cb248cb17 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] nvme not present on system {{(pid=75165) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 00:50:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:50:12 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 00:50:12 user nova-compute[75165]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 00:50:12 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb886552-8cfe-4f4f-a8dc-08f013c80df0]: (4, '') {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:50:12 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-c14b63ba-4ce1-4b61-92e6-642cb248cb17 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75165) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 00:50:12 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-c14b63ba-4ce1-4b61-92e6-642cb248cb17 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75165) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 00:50:12 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-c14b63ba-4ce1-4b61-92e6-642cb248cb17 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] LIGHTOS: no hostnqn found. {{(pid=75165) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 00:50:12 user nova-compute[75165]: DEBUG os_brick.utils [None req-c14b63ba-4ce1-4b61-92e6-642cb248cb17 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa94814ccb35', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:50:12 user nova-compute[75165]: DEBUG nova.virt.block_device [None req-c14b63ba-4ce1-4b61-92e6-642cb248cb17 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 2bbdbdc6-ce56-4357-87cb-85bbc99e3343] Updating existing volume attachment record: 5abe34cb-6192-4363-9ce3-f1817b8d6d68 {{(pid=75165) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 00:50:12 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:50:12 user nova-compute[75165]: DEBUG nova.network.neutron [None req-c14b63ba-4ce1-4b61-92e6-642cb248cb17 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 2bbdbdc6-ce56-4357-87cb-85bbc99e3343] Successfully created port: fd36e9ef-0d0c-4f08-a359-4b65e4cd371e {{(pid=75165) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 00:50:12 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:50:13 user nova-compute[75165]: DEBUG nova.network.neutron [None req-c14b63ba-4ce1-4b61-92e6-642cb248cb17 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 2bbdbdc6-ce56-4357-87cb-85bbc99e3343] Successfully updated port: fd36e9ef-0d0c-4f08-a359-4b65e4cd371e {{(pid=75165) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 00:50:13 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-c14b63ba-4ce1-4b61-92e6-642cb248cb17 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Acquiring lock "refresh_cache-2bbdbdc6-ce56-4357-87cb-85bbc99e3343" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:50:13 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-c14b63ba-4ce1-4b61-92e6-642cb248cb17 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Acquired lock "refresh_cache-2bbdbdc6-ce56-4357-87cb-85bbc99e3343" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:50:13 user nova-compute[75165]: DEBUG nova.network.neutron [None req-c14b63ba-4ce1-4b61-92e6-642cb248cb17 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 2bbdbdc6-ce56-4357-87cb-85bbc99e3343] Building network info cache for instance {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 00:50:13 user nova-compute[75165]: DEBUG nova.compute.manager [req-576abe90-bcf2-42e0-96db-304c9876a545 req-03b3e332-5380-459f-acea-669af4c1446f service nova] [instance: 2bbdbdc6-ce56-4357-87cb-85bbc99e3343] Received event network-changed-fd36e9ef-0d0c-4f08-a359-4b65e4cd371e {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:50:13 user nova-compute[75165]: DEBUG nova.compute.manager [req-576abe90-bcf2-42e0-96db-304c9876a545 req-03b3e332-5380-459f-acea-669af4c1446f service nova] [instance: 2bbdbdc6-ce56-4357-87cb-85bbc99e3343] Refreshing instance network info cache due to event network-changed-fd36e9ef-0d0c-4f08-a359-4b65e4cd371e. {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 00:50:13 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-576abe90-bcf2-42e0-96db-304c9876a545 req-03b3e332-5380-459f-acea-669af4c1446f service nova] Acquiring lock "refresh_cache-2bbdbdc6-ce56-4357-87cb-85bbc99e3343" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:50:13 user nova-compute[75165]: DEBUG nova.network.neutron [None req-c14b63ba-4ce1-4b61-92e6-642cb248cb17 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 2bbdbdc6-ce56-4357-87cb-85bbc99e3343] Instance cache missing network info. {{(pid=75165) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 00:50:13 user nova-compute[75165]: DEBUG nova.network.neutron [None req-c14b63ba-4ce1-4b61-92e6-642cb248cb17 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 2bbdbdc6-ce56-4357-87cb-85bbc99e3343] Updating instance_info_cache with network_info: [{"id": "fd36e9ef-0d0c-4f08-a359-4b65e4cd371e", "address": "fa:16:3e:86:4e:e2", "network": {"id": "dc50ae7b-d501-461f-aa0b-542514330ae8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1091857056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1051405ca054c4bb051fb842a5fb5a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd36e9ef-0d", "ovs_interfaceid": "fd36e9ef-0d0c-4f08-a359-4b65e4cd371e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:50:13 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-c14b63ba-4ce1-4b61-92e6-642cb248cb17 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Releasing lock "refresh_cache-2bbdbdc6-ce56-4357-87cb-85bbc99e3343" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:50:13 user nova-compute[75165]: DEBUG nova.compute.manager [None req-c14b63ba-4ce1-4b61-92e6-642cb248cb17 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 2bbdbdc6-ce56-4357-87cb-85bbc99e3343] Instance network_info: |[{"id": "fd36e9ef-0d0c-4f08-a359-4b65e4cd371e", "address": "fa:16:3e:86:4e:e2", "network": {"id": "dc50ae7b-d501-461f-aa0b-542514330ae8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1091857056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1051405ca054c4bb051fb842a5fb5a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd36e9ef-0d", "ovs_interfaceid": "fd36e9ef-0d0c-4f08-a359-4b65e4cd371e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75165) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 00:50:13 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-576abe90-bcf2-42e0-96db-304c9876a545 req-03b3e332-5380-459f-acea-669af4c1446f service nova] Acquired lock "refresh_cache-2bbdbdc6-ce56-4357-87cb-85bbc99e3343" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:50:13 user nova-compute[75165]: DEBUG nova.network.neutron [req-576abe90-bcf2-42e0-96db-304c9876a545 req-03b3e332-5380-459f-acea-669af4c1446f service nova] [instance: 2bbdbdc6-ce56-4357-87cb-85bbc99e3343] Refreshing network info cache for port fd36e9ef-0d0c-4f08-a359-4b65e4cd371e {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 00:50:13 user nova-compute[75165]: DEBUG nova.network.neutron [req-576abe90-bcf2-42e0-96db-304c9876a545 req-03b3e332-5380-459f-acea-669af4c1446f service nova] [instance: 2bbdbdc6-ce56-4357-87cb-85bbc99e3343] Updated VIF entry in instance network info cache for port fd36e9ef-0d0c-4f08-a359-4b65e4cd371e. {{(pid=75165) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 00:50:13 user nova-compute[75165]: DEBUG nova.network.neutron [req-576abe90-bcf2-42e0-96db-304c9876a545 req-03b3e332-5380-459f-acea-669af4c1446f service nova] [instance: 2bbdbdc6-ce56-4357-87cb-85bbc99e3343] Updating instance_info_cache with network_info: [{"id": "fd36e9ef-0d0c-4f08-a359-4b65e4cd371e", "address": "fa:16:3e:86:4e:e2", "network": {"id": "dc50ae7b-d501-461f-aa0b-542514330ae8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1091857056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1051405ca054c4bb051fb842a5fb5a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd36e9ef-0d", "ovs_interfaceid": "fd36e9ef-0d0c-4f08-a359-4b65e4cd371e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:50:13 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-576abe90-bcf2-42e0-96db-304c9876a545 req-03b3e332-5380-459f-acea-669af4c1446f service nova] Releasing lock "refresh_cache-2bbdbdc6-ce56-4357-87cb-85bbc99e3343" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:50:17 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:50:22 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:50:27 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:50:27 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:50:29 user nova-compute[75165]: DEBUG nova.compute.manager [None req-c14b63ba-4ce1-4b61-92e6-642cb248cb17 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 2bbdbdc6-ce56-4357-87cb-85bbc99e3343] Start spawning the instance on the hypervisor. {{(pid=75165) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 00:50:29 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-c14b63ba-4ce1-4b61-92e6-642cb248cb17 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 2bbdbdc6-ce56-4357-87cb-85bbc99e3343] Creating instance directory {{(pid=75165) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 00:50:29 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-c14b63ba-4ce1-4b61-92e6-642cb248cb17 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 2bbdbdc6-ce56-4357-87cb-85bbc99e3343] Creating image(s)
Oct 26 00:50:29 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-c14b63ba-4ce1-4b61-92e6-642cb248cb17 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 2bbdbdc6-ce56-4357-87cb-85bbc99e3343] Did not create local disks {{(pid=75165) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 26 00:50:29 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-c14b63ba-4ce1-4b61-92e6-642cb248cb17 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 2bbdbdc6-ce56-4357-87cb-85bbc99e3343] Ensure instance console log exists: /opt/stack/data/nova/instances/2bbdbdc6-ce56-4357-87cb-85bbc99e3343/console.log {{(pid=75165) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 00:50:29 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-c14b63ba-4ce1-4b61-92e6-642cb248cb17 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:50:29 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-c14b63ba-4ce1-4b61-92e6-642cb248cb17 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:50:29 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-c14b63ba-4ce1-4b61-92e6-642cb248cb17 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:50:29 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-c14b63ba-4ce1-4b61-92e6-642cb248cb17 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 2bbdbdc6-ce56-4357-87cb-85bbc99e3343] Start _get_guest_xml network_info=[{"id": "fd36e9ef-0d0c-4f08-a359-4b65e4cd371e", "address": "fa:16:3e:86:4e:e2", "network": {"id": "dc50ae7b-d501-461f-aa0b-542514330ae8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1091857056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1051405ca054c4bb051fb842a5fb5a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd36e9ef-0d", "ovs_interfaceid": "fd36e9ef-0d0c-4f08-a359-4b65e4cd371e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c9c9fee3-6885-4dc9-9b49-cca3631705bb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VwklHDJg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2bbdbdc6-ce56-4357-87cb-85bbc99e3343', 'attached_at': '', 'detached_at': '', 'volume_id': 'c9c9fee3-6885-4dc9-9b49-cca3631705bb', 'serial': 'c9c9fee3-6885-4dc9-9b49-cca3631705bb'}, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'attachment_id': '5abe34cb-6192-4363-9ce3-f1817b8d6d68', 'delete_on_termination': False, 'volume_type': None} {{(pid=75165) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 00:50:29 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-c14b63ba-4ce1-4b61-92e6-642cb248cb17 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:50:29 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-c14b63ba-4ce1-4b61-92e6-642cb248cb17 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:50:29 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-c14b63ba-4ce1-4b61-92e6-642cb248cb17 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75165) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 00:50:29 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-c14b63ba-4ce1-4b61-92e6-642cb248cb17 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] CPU controller missing on host. {{(pid=75165) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 00:50:29 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-c14b63ba-4ce1-4b61-92e6-642cb248cb17 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75165) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 00:50:29 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-c14b63ba-4ce1-4b61-92e6-642cb248cb17 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] CPU controller found on host. {{(pid=75165) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 00:50:29 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-c14b63ba-4ce1-4b61-92e6-642cb248cb17 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75165) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 00:50:29 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-c14b63ba-4ce1-4b61-92e6-642cb248cb17 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T00:03:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 00:50:29 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-c14b63ba-4ce1-4b61-92e6-642cb248cb17 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Flavor limits 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 00:50:29 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-c14b63ba-4ce1-4b61-92e6-642cb248cb17 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Image limits 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 00:50:29 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-c14b63ba-4ce1-4b61-92e6-642cb248cb17 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Flavor pref 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 00:50:29 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-c14b63ba-4ce1-4b61-92e6-642cb248cb17 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Image pref 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 00:50:29 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-c14b63ba-4ce1-4b61-92e6-642cb248cb17 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 00:50:29 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-c14b63ba-4ce1-4b61-92e6-642cb248cb17 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 00:50:29 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-c14b63ba-4ce1-4b61-92e6-642cb248cb17 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75165) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 00:50:29 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-c14b63ba-4ce1-4b61-92e6-642cb248cb17 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Got 1 possible topologies {{(pid=75165) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 00:50:29 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-c14b63ba-4ce1-4b61-92e6-642cb248cb17 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 00:50:29 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-c14b63ba-4ce1-4b61-92e6-642cb248cb17 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 00:50:29 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c14b63ba-4ce1-4b61-92e6-642cb248cb17 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 2bbdbdc6-ce56-4357-87cb-85bbc99e3343] Calling os-brick to attach iSCSI Volume {{(pid=75165) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 00:50:29 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-c14b63ba-4ce1-4b61-92e6-642cb248cb17 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8bf8160e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c9c9fee3-6885-4dc9-9b49-cca3631705bb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VwklHDJg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:50:29 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-c14b63ba-4ce1-4b61-92e6-642cb248cb17 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:50:29 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-c14b63ba-4ce1-4b61-92e6-642cb248cb17 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:50:29 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-c14b63ba-4ce1-4b61-92e6-642cb248cb17 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:50:29 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-c14b63ba-4ce1-4b61-92e6-642cb248cb17 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:50:29 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-c14b63ba-4ce1-4b61-92e6-642cb248cb17 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c9c9fee3-6885-4dc9-9b49-cca3631705bb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:50:29 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-c14b63ba-4ce1-4b61-92e6-642cb248cb17 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c9c9fee3-6885-4dc9-9b49-cca3631705bb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:50:29 user nova-compute[75165]: INFO os_brick.initiator.connectors.iscsi [None req-c14b63ba-4ce1-4b61-92e6-642cb248cb17 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 00:50:29 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9c9fee3-6885-4dc9-9b49-cca3631705bb -p 172.16.0.220:3260 {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:50:29 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9c9fee3-6885-4dc9-9b49-cca3631705bb -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:50:29 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0c30986-e48c-4e8d-bff2-9f25a4fa4ecc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:50:29 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-c14b63ba-4ce1-4b61-92e6-642cb248cb17 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 00:50:29 user nova-compute[75165]:  {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:50:29 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9c9fee3-6885-4dc9-9b49-cca3631705bb -p 172.16.0.220:3260 --interface default --op new {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:50:29 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9c9fee3-6885-4dc9-9b49-cca3631705bb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:50:29 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[30fe09af-d9ac-4e6e-86d9-e5594fd9d79c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c9c9fee3-6885-4dc9-9b49-cca3631705bb] added\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:50:29 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-c14b63ba-4ce1-4b61-92e6-642cb248cb17 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c9c9fee3-6885-4dc9-9b49-cca3631705bb] added
Oct 26 00:50:29 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:50:29 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9c9fee3-6885-4dc9-9b49-cca3631705bb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:50:29 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9c9fee3-6885-4dc9-9b49-cca3631705bb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:50:29 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[61633e94-d107-45a9-8b5b-2d4b14d6311b]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:50:29 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-c14b63ba-4ce1-4b61-92e6-642cb248cb17 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:50:29 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9c9fee3-6885-4dc9-9b49-cca3631705bb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:50:29 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9c9fee3-6885-4dc9-9b49-cca3631705bb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:50:29 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e47782d-311b-41b3-a6db-6f9e70303890]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:50:29 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-c14b63ba-4ce1-4b61-92e6-642cb248cb17 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:50:29 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9c9fee3-6885-4dc9-9b49-cca3631705bb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VwklHDJg {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:50:29 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9c9fee3-6885-4dc9-9b49-cca3631705bb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VwklHDJg" returned: 0 in 0.019s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:50:29 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c4bd804-383b-4e28-a3c8-59ff989d85fb]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:50:29 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-c14b63ba-4ce1-4b61-92e6-642cb248cb17 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VwklHDJg'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:50:29 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9c9fee3-6885-4dc9-9b49-cca3631705bb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:50:29 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9c9fee3-6885-4dc9-9b49-cca3631705bb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:50:29 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8caf0ab-1d5b-4f06-bedc-c84c03ac4b69]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:50:29 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-c14b63ba-4ce1-4b61-92e6-642cb248cb17 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:50:29 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:50:29 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:50:29 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[acb2416b-125a-4d7d-8677-0d98df3ce8b1]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28483cbc-41a9-4961-9c30-fae820d1ad43 (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:50:29 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-c14b63ba-4ce1-4b61-92e6-642cb248cb17 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28483cbc-41a9-4961-9c30-fae820d1ad43 (non-flash)
Oct 26 00:50:29 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:50:29 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-c14b63ba-4ce1-4b61-92e6-642cb248cb17 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28483cbc-41a9-4961-9c30-fae820d1ad43 (non-flash)
Oct 26 00:50:29 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:50:29 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9c9fee3-6885-4dc9-9b49-cca3631705bb -p 172.16.0.220:3260 --login {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:50:30 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9c9fee3-6885-4dc9-9b49-cca3631705bb -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:50:30 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c392f14-0259-4bf8-93d7-73dcbc3d2baf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c9c9fee3-6885-4dc9-9b49-cca3631705bb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c9c9fee3-6885-4dc9-9b49-cca3631705bb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:50:30 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-c14b63ba-4ce1-4b61-92e6-642cb248cb17 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c9c9fee3-6885-4dc9-9b49-cca3631705bb, portal: 172.16.0.220,3260]
Oct 26 00:50:30 user nova-compute[75165]: Login to [iface: default, target: iqn.2010-10.org.openstack:c9c9fee3-6885-4dc9-9b49-cca3631705bb, portal: 172.16.0.220,3260] successful.
Oct 26 00:50:30 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:50:30 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9c9fee3-6885-4dc9-9b49-cca3631705bb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:50:30 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9c9fee3-6885-4dc9-9b49-cca3631705bb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:50:30 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9c2f6a2-e6c6-4a27-9b6c-b0b56896424a]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:50:30 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-c14b63ba-4ce1-4b61-92e6-642cb248cb17 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:50:30 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:50:30 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:50:30 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec2833c6-cb43-4335-a3bb-62bb78da61f2]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28483cbc-41a9-4961-9c30-fae820d1ad43 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c9fee3-6885-4dc9-9b49-cca3631705bb (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:50:30 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-c14b63ba-4ce1-4b61-92e6-642cb248cb17 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28483cbc-41a9-4961-9c30-fae820d1ad43 (non-flash)
Oct 26 00:50:30 user nova-compute[75165]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c9fee3-6885-4dc9-9b49-cca3631705bb (non-flash)
Oct 26 00:50:30 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:50:30 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-c14b63ba-4ce1-4b61-92e6-642cb248cb17 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28483cbc-41a9-4961-9c30-fae820d1ad43 (non-flash)
Oct 26 00:50:30 user nova-compute[75165]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c9fee3-6885-4dc9-9b49-cca3631705bb (non-flash)
Oct 26 00:50:30 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:50:30 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-c14b63ba-4ce1-4b61-92e6-642cb248cb17 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c9c9fee3-6885-4dc9-9b49-cca3631705bb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.276s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:50:30 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-c14b63ba-4ce1-4b61-92e6-642cb248cb17 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Connected to 172.16.0.220:3260 {{(pid=75165) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 00:50:30 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-c14b63ba-4ce1-4b61-92e6-642cb248cb17 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] HCTL ('34', '-', '-', 0) found on session 56 with lun 0 {{(pid=75165) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 00:50:30 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-c14b63ba-4ce1-4b61-92e6-642cb248cb17 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75165) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 00:50:30 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:50:30 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.022s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:50:30 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[e695a3b2-4787-40d6-90e9-9375e26df544]: (4, ('- - 0', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:50:30 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-c14b63ba-4ce1-4b61-92e6-642cb248cb17 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Searching for a device in session 56 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75165) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 00:50:30 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-c14b63ba-4ce1-4b61-92e6-642cb248cb17 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:c9c9fee3-6885-4dc9-9b49-cca3631705bb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VwklHDJg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75165) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 00:50:30 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:50:30 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75165) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 00:50:31 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-c14b63ba-4ce1-4b61-92e6-642cb248cb17 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.312s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:50:31 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-c14b63ba-4ce1-4b61-92e6-642cb248cb17 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] <== connect_volume: return (1314ms) {'type': 'block', 'scsi_wwn': '23535373332366662', 'path': '/dev/sdc'} {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:50:31 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c14b63ba-4ce1-4b61-92e6-642cb248cb17 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 2bbdbdc6-ce56-4357-87cb-85bbc99e3343] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23535373332366662', 'path': '/dev/sdc'} {{(pid=75165) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 00:50:31 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-c14b63ba-4ce1-4b61-92e6-642cb248cb17 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:50:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1539441902',display_name='tempest-TestVolumeBootPattern-server-1539441902',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1539441902',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBChKvTLd4nhrj5htJzspkP8o+qgId41EjTR/fmBLYf3vmPpK9NBbxwvdQKkZqqXFiSi6AG6cvipLHicvfW4NLnZq3yjDwP+cF/yBIdW+iAQl3BC4GDkkyYulLa73yUYFmw==',key_name='tempest-TestVolumeBootPattern-819204347',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d1051405ca054c4bb051fb842a5fb5a0',ramdisk_id='',reservation_id='r-hu8a2pr5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1215567595',owner_user_name='tempest-TestVolumeBootPattern-1215567595-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T00:50:12Z,user_data=None,user_id='ae836eab78514cf3894e5e11240ff374',uuid=2bbdbdc6-ce56-4357-87cb-85bbc99e3343,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fd36e9ef-0d0c-4f08-a359-4b65e4cd371e", "address": "fa:16:3e:86:4e:e2", "network": {"id": "dc50ae7b-d501-461f-aa0b-542514330ae8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1091857056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1051405ca054c4bb051fb842a5fb5a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd36e9ef-0d", "ovs_interfaceid": "fd36e9ef-0d0c-4f08-a359-4b65e4cd371e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75165) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 00:50:31 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-c14b63ba-4ce1-4b61-92e6-642cb248cb17 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Converting VIF {"id": "fd36e9ef-0d0c-4f08-a359-4b65e4cd371e", "address": "fa:16:3e:86:4e:e2", "network": {"id": "dc50ae7b-d501-461f-aa0b-542514330ae8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1091857056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1051405ca054c4bb051fb842a5fb5a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd36e9ef-0d", "ovs_interfaceid": "fd36e9ef-0d0c-4f08-a359-4b65e4cd371e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:50:31 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-c14b63ba-4ce1-4b61-92e6-642cb248cb17 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:4e:e2,bridge_name='br-int',has_traffic_filtering=True,id=fd36e9ef-0d0c-4f08-a359-4b65e4cd371e,network=Network(dc50ae7b-d501-461f-aa0b-542514330ae8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd36e9ef-0d') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:50:31 user nova-compute[75165]: DEBUG nova.objects.instance [None req-c14b63ba-4ce1-4b61-92e6-642cb248cb17 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Lazy-loading 'pci_devices' on Instance uuid 2bbdbdc6-ce56-4357-87cb-85bbc99e3343 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:50:31 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-c14b63ba-4ce1-4b61-92e6-642cb248cb17 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 2bbdbdc6-ce56-4357-87cb-85bbc99e3343] End _get_guest_xml xml=<domain type="kvm">
Oct 26 00:50:31 user nova-compute[75165]:   <uuid>2bbdbdc6-ce56-4357-87cb-85bbc99e3343</uuid>
Oct 26 00:50:31 user nova-compute[75165]:   <name>instance-00000032</name>
Oct 26 00:50:31 user nova-compute[75165]:   <memory>524288</memory>
Oct 26 00:50:31 user nova-compute[75165]:   <vcpu>1</vcpu>
Oct 26 00:50:31 user nova-compute[75165]:   <metadata>
Oct 26 00:50:31 user nova-compute[75165]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 00:50:31 user nova-compute[75165]:       <nova:package version="0.0.0"/>
Oct 26 00:50:31 user nova-compute[75165]:       <nova:name>tempest-TestVolumeBootPattern-server-1539441902</nova:name>
Oct 26 00:50:31 user nova-compute[75165]:       <nova:creationTime>2023-10-26 00:50:29</nova:creationTime>
Oct 26 00:50:31 user nova-compute[75165]:       <nova:flavor name="m1.tiny">
Oct 26 00:50:31 user nova-compute[75165]:         <nova:memory>512</nova:memory>
Oct 26 00:50:31 user nova-compute[75165]:         <nova:disk>1</nova:disk>
Oct 26 00:50:31 user nova-compute[75165]:         <nova:swap>0</nova:swap>
Oct 26 00:50:31 user nova-compute[75165]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 00:50:31 user nova-compute[75165]:         <nova:vcpus>1</nova:vcpus>
Oct 26 00:50:31 user nova-compute[75165]:       </nova:flavor>
Oct 26 00:50:31 user nova-compute[75165]:       <nova:owner>
Oct 26 00:50:31 user nova-compute[75165]:         <nova:user uuid="ae836eab78514cf3894e5e11240ff374">tempest-TestVolumeBootPattern-1215567595-project-member</nova:user>
Oct 26 00:50:31 user nova-compute[75165]:         <nova:project uuid="d1051405ca054c4bb051fb842a5fb5a0">tempest-TestVolumeBootPattern-1215567595</nova:project>
Oct 26 00:50:31 user nova-compute[75165]:       </nova:owner>
Oct 26 00:50:31 user nova-compute[75165]:       <nova:ports>
Oct 26 00:50:31 user nova-compute[75165]:         <nova:port uuid="fd36e9ef-0d0c-4f08-a359-4b65e4cd371e">
Oct 26 00:50:31 user nova-compute[75165]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 26 00:50:31 user nova-compute[75165]:         </nova:port>
Oct 26 00:50:31 user nova-compute[75165]:       </nova:ports>
Oct 26 00:50:31 user nova-compute[75165]:     </nova:instance>
Oct 26 00:50:31 user nova-compute[75165]:   </metadata>
Oct 26 00:50:31 user nova-compute[75165]:   <sysinfo type="smbios">
Oct 26 00:50:31 user nova-compute[75165]:     <system>
Oct 26 00:50:31 user nova-compute[75165]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 00:50:31 user nova-compute[75165]:       <entry name="product">OpenStack Nova</entry>
Oct 26 00:50:31 user nova-compute[75165]:       <entry name="version">0.0.0</entry>
Oct 26 00:50:31 user nova-compute[75165]:       <entry name="serial">2bbdbdc6-ce56-4357-87cb-85bbc99e3343</entry>
Oct 26 00:50:31 user nova-compute[75165]:       <entry name="uuid">2bbdbdc6-ce56-4357-87cb-85bbc99e3343</entry>
Oct 26 00:50:31 user nova-compute[75165]:       <entry name="family">Virtual Machine</entry>
Oct 26 00:50:31 user nova-compute[75165]:     </system>
Oct 26 00:50:31 user nova-compute[75165]:   </sysinfo>
Oct 26 00:50:31 user nova-compute[75165]:   <os>
Oct 26 00:50:31 user nova-compute[75165]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 00:50:31 user nova-compute[75165]:     <boot dev="hd"/>
Oct 26 00:50:31 user nova-compute[75165]:     <smbios mode="sysinfo"/>
Oct 26 00:50:31 user nova-compute[75165]:   </os>
Oct 26 00:50:31 user nova-compute[75165]:   <features>
Oct 26 00:50:31 user nova-compute[75165]:     <acpi/>
Oct 26 00:50:31 user nova-compute[75165]:     <apic/>
Oct 26 00:50:31 user nova-compute[75165]:     <vmcoreinfo/>
Oct 26 00:50:31 user nova-compute[75165]:   </features>
Oct 26 00:50:31 user nova-compute[75165]:   <clock offset="utc">
Oct 26 00:50:31 user nova-compute[75165]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 00:50:31 user nova-compute[75165]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 00:50:31 user nova-compute[75165]:     <timer name="hpet" present="no"/>
Oct 26 00:50:31 user nova-compute[75165]:   </clock>
Oct 26 00:50:31 user nova-compute[75165]:   <cpu mode="custom" match="exact">
Oct 26 00:50:31 user nova-compute[75165]:     <model>Nehalem</model>
Oct 26 00:50:31 user nova-compute[75165]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 00:50:31 user nova-compute[75165]:   </cpu>
Oct 26 00:50:31 user nova-compute[75165]:   <devices>
Oct 26 00:50:31 user nova-compute[75165]:     <disk type="block" device="disk">
Oct 26 00:50:31 user nova-compute[75165]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 00:50:31 user nova-compute[75165]:       <source dev="/dev/sdc"/>
Oct 26 00:50:31 user nova-compute[75165]:       <target dev="vda" bus="virtio"/>
Oct 26 00:50:31 user nova-compute[75165]:       <serial>c9c9fee3-6885-4dc9-9b49-cca3631705bb</serial>
Oct 26 00:50:31 user nova-compute[75165]:     </disk>
Oct 26 00:50:31 user nova-compute[75165]:     <interface type="ethernet">
Oct 26 00:50:31 user nova-compute[75165]:       <mac address="fa:16:3e:86:4e:e2"/>
Oct 26 00:50:31 user nova-compute[75165]:       <model type="virtio"/>
Oct 26 00:50:31 user nova-compute[75165]:       <mtu size="1442"/>
Oct 26 00:50:31 user nova-compute[75165]:       <target dev="tapfd36e9ef-0d"/>
Oct 26 00:50:31 user nova-compute[75165]:     </interface>
Oct 26 00:50:31 user nova-compute[75165]:     <serial type="pty">
Oct 26 00:50:31 user nova-compute[75165]:       <log file="/opt/stack/data/nova/instances/2bbdbdc6-ce56-4357-87cb-85bbc99e3343/console.log" append="off"/>
Oct 26 00:50:31 user nova-compute[75165]:     </serial>
Oct 26 00:50:31 user nova-compute[75165]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 00:50:31 user nova-compute[75165]:     <video>
Oct 26 00:50:31 user nova-compute[75165]:       <model type="virtio"/>
Oct 26 00:50:31 user nova-compute[75165]:     </video>
Oct 26 00:50:31 user nova-compute[75165]:     <rng model="virtio">
Oct 26 00:50:31 user nova-compute[75165]:       <backend model="random">/dev/urandom</backend>
Oct 26 00:50:31 user nova-compute[75165]:     </rng>
Oct 26 00:50:31 user nova-compute[75165]:     <controller type="usb" index="0" model="none"/>
Oct 26 00:50:31 user nova-compute[75165]:     <memballoon model="virtio">
Oct 26 00:50:31 user nova-compute[75165]:       <stats period="10"/>
Oct 26 00:50:31 user nova-compute[75165]:     </memballoon>
Oct 26 00:50:31 user nova-compute[75165]:   </devices>
Oct 26 00:50:31 user nova-compute[75165]: </domain>
Oct 26 00:50:31 user nova-compute[75165]:  {{(pid=75165) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 00:50:31 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-c14b63ba-4ce1-4b61-92e6-642cb248cb17 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:50:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1539441902',display_name='tempest-TestVolumeBootPattern-server-1539441902',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1539441902',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBChKvTLd4nhrj5htJzspkP8o+qgId41EjTR/fmBLYf3vmPpK9NBbxwvdQKkZqqXFiSi6AG6cvipLHicvfW4NLnZq3yjDwP+cF/yBIdW+iAQl3BC4GDkkyYulLa73yUYFmw==',key_name='tempest-TestVolumeBootPattern-819204347',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d1051405ca054c4bb051fb842a5fb5a0',ramdisk_id='',reservation_id='r-hu8a2pr5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1215567595',owner_user_name='tempest-TestVolumeBootPattern-1215567595-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T00:50:12Z,user_data=None,user_id='ae836eab78514cf3894e5e11240ff374',uuid=2bbdbdc6-ce56-4357-87cb-85bbc99e3343,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fd36e9ef-0d0c-4f08-a359-4b65e4cd371e", "address": "fa:16:3e:86:4e:e2", "network": {"id": "dc50ae7b-d501-461f-aa0b-542514330ae8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1091857056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1051405ca054c4bb051fb842a5fb5a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd36e9ef-0d", "ovs_interfaceid": "fd36e9ef-0d0c-4f08-a359-4b65e4cd371e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 00:50:31 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-c14b63ba-4ce1-4b61-92e6-642cb248cb17 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Converting VIF {"id": "fd36e9ef-0d0c-4f08-a359-4b65e4cd371e", "address": "fa:16:3e:86:4e:e2", "network": {"id": "dc50ae7b-d501-461f-aa0b-542514330ae8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1091857056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1051405ca054c4bb051fb842a5fb5a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd36e9ef-0d", "ovs_interfaceid": "fd36e9ef-0d0c-4f08-a359-4b65e4cd371e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:50:31 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-c14b63ba-4ce1-4b61-92e6-642cb248cb17 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:4e:e2,bridge_name='br-int',has_traffic_filtering=True,id=fd36e9ef-0d0c-4f08-a359-4b65e4cd371e,network=Network(dc50ae7b-d501-461f-aa0b-542514330ae8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd36e9ef-0d') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:50:31 user nova-compute[75165]: DEBUG os_vif [None req-c14b63ba-4ce1-4b61-92e6-642cb248cb17 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:4e:e2,bridge_name='br-int',has_traffic_filtering=True,id=fd36e9ef-0d0c-4f08-a359-4b65e4cd371e,network=Network(dc50ae7b-d501-461f-aa0b-542514330ae8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd36e9ef-0d') {{(pid=75165) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 00:50:31 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:50:31 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:50:31 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 00:50:31 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:50:31 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'db7a4a04-b487-5cb2-a948-47844cfca8d7', '_type': 'linux-noop'}}, row=False) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:50:31 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:50:31 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:50:31 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:50:31 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfd36e9ef-0d, may_exist=True, interface_attrs={}) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:50:31 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfd36e9ef-0d, col_values=(('qos', UUID('c5f68b90-a29c-4654-a381-0f748e903bc9')),), if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:50:31 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfd36e9ef-0d, col_values=(('external_ids', {'iface-id': 'fd36e9ef-0d0c-4f08-a359-4b65e4cd371e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:86:4e:e2', 'vm-uuid': '2bbdbdc6-ce56-4357-87cb-85bbc99e3343'}),), if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:50:31 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:50:31 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:50:31 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:50:31 user nova-compute[75165]: INFO os_vif [None req-c14b63ba-4ce1-4b61-92e6-642cb248cb17 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:4e:e2,bridge_name='br-int',has_traffic_filtering=True,id=fd36e9ef-0d0c-4f08-a359-4b65e4cd371e,network=Network(dc50ae7b-d501-461f-aa0b-542514330ae8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd36e9ef-0d')
Oct 26 00:50:31 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-c14b63ba-4ce1-4b61-92e6-642cb248cb17 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] No BDM found with device name vda, not building metadata. {{(pid=75165) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 00:50:31 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-c14b63ba-4ce1-4b61-92e6-642cb248cb17 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] No VIF found with MAC fa:16:3e:86:4e:e2, not building metadata {{(pid=75165) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 00:50:32 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:50:32 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:50:32 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:50:32 user nova-compute[75165]: DEBUG nova.compute.manager [req-5e6ba422-bdf6-4685-9c2f-1ba283b25034 req-829a08cf-fe89-4ba0-9e25-96b2235414d5 service nova] [instance: 2bbdbdc6-ce56-4357-87cb-85bbc99e3343] Received event network-vif-plugged-fd36e9ef-0d0c-4f08-a359-4b65e4cd371e {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:50:32 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-5e6ba422-bdf6-4685-9c2f-1ba283b25034 req-829a08cf-fe89-4ba0-9e25-96b2235414d5 service nova] Acquiring lock "2bbdbdc6-ce56-4357-87cb-85bbc99e3343-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:50:32 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-5e6ba422-bdf6-4685-9c2f-1ba283b25034 req-829a08cf-fe89-4ba0-9e25-96b2235414d5 service nova] Lock "2bbdbdc6-ce56-4357-87cb-85bbc99e3343-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:50:32 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-5e6ba422-bdf6-4685-9c2f-1ba283b25034 req-829a08cf-fe89-4ba0-9e25-96b2235414d5 service nova] Lock "2bbdbdc6-ce56-4357-87cb-85bbc99e3343-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:50:32 user nova-compute[75165]: DEBUG nova.compute.manager [req-5e6ba422-bdf6-4685-9c2f-1ba283b25034 req-829a08cf-fe89-4ba0-9e25-96b2235414d5 service nova] [instance: 2bbdbdc6-ce56-4357-87cb-85bbc99e3343] No waiting events found dispatching network-vif-plugged-fd36e9ef-0d0c-4f08-a359-4b65e4cd371e {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:50:32 user nova-compute[75165]: WARNING nova.compute.manager [req-5e6ba422-bdf6-4685-9c2f-1ba283b25034 req-829a08cf-fe89-4ba0-9e25-96b2235414d5 service nova] [instance: 2bbdbdc6-ce56-4357-87cb-85bbc99e3343] Received unexpected event network-vif-plugged-fd36e9ef-0d0c-4f08-a359-4b65e4cd371e for instance with vm_state building and task_state spawning.
Oct 26 00:50:32 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:50:32 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:50:34 user nova-compute[75165]: DEBUG nova.compute.manager [None req-c14b63ba-4ce1-4b61-92e6-642cb248cb17 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 2bbdbdc6-ce56-4357-87cb-85bbc99e3343] Instance event wait completed in 0 seconds for  {{(pid=75165) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 00:50:34 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-c14b63ba-4ce1-4b61-92e6-642cb248cb17 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 2bbdbdc6-ce56-4357-87cb-85bbc99e3343] Guest created on hypervisor {{(pid=75165) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 00:50:34 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: 2bbdbdc6-ce56-4357-87cb-85bbc99e3343] Instance spawned successfully.
Oct 26 00:50:34 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-c14b63ba-4ce1-4b61-92e6-642cb248cb17 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 2bbdbdc6-ce56-4357-87cb-85bbc99e3343] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 00:50:34 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-c14b63ba-4ce1-4b61-92e6-642cb248cb17 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 2bbdbdc6-ce56-4357-87cb-85bbc99e3343] Found default for hw_cdrom_bus of ide {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:50:34 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-c14b63ba-4ce1-4b61-92e6-642cb248cb17 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 2bbdbdc6-ce56-4357-87cb-85bbc99e3343] Found default for hw_disk_bus of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:50:34 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-c14b63ba-4ce1-4b61-92e6-642cb248cb17 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 2bbdbdc6-ce56-4357-87cb-85bbc99e3343] Found default for hw_input_bus of None {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:50:34 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-c14b63ba-4ce1-4b61-92e6-642cb248cb17 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 2bbdbdc6-ce56-4357-87cb-85bbc99e3343] Found default for hw_pointer_model of None {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:50:34 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-c14b63ba-4ce1-4b61-92e6-642cb248cb17 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 2bbdbdc6-ce56-4357-87cb-85bbc99e3343] Found default for hw_video_model of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:50:34 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-c14b63ba-4ce1-4b61-92e6-642cb248cb17 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 2bbdbdc6-ce56-4357-87cb-85bbc99e3343] Found default for hw_vif_model of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:50:34 user nova-compute[75165]: INFO nova.compute.manager [None req-c14b63ba-4ce1-4b61-92e6-642cb248cb17 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 2bbdbdc6-ce56-4357-87cb-85bbc99e3343] Took 4.87 seconds to spawn the instance on the hypervisor.
Oct 26 00:50:34 user nova-compute[75165]: DEBUG nova.compute.manager [None req-c14b63ba-4ce1-4b61-92e6-642cb248cb17 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 2bbdbdc6-ce56-4357-87cb-85bbc99e3343] Checking state {{(pid=75165) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 00:50:34 user nova-compute[75165]: INFO nova.compute.manager [None req-c14b63ba-4ce1-4b61-92e6-642cb248cb17 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 2bbdbdc6-ce56-4357-87cb-85bbc99e3343] Took 23.22 seconds to build instance.
Oct 26 00:50:34 user nova-compute[75165]: DEBUG nova.compute.manager [req-8e73aad2-2d7f-4c8b-96f2-9175342c1c9a req-781d9fc3-30e3-4625-b513-67018c35a64d service nova] [instance: 2bbdbdc6-ce56-4357-87cb-85bbc99e3343] Received event network-vif-plugged-fd36e9ef-0d0c-4f08-a359-4b65e4cd371e {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:50:34 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-8e73aad2-2d7f-4c8b-96f2-9175342c1c9a req-781d9fc3-30e3-4625-b513-67018c35a64d service nova] Acquiring lock "2bbdbdc6-ce56-4357-87cb-85bbc99e3343-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:50:34 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-8e73aad2-2d7f-4c8b-96f2-9175342c1c9a req-781d9fc3-30e3-4625-b513-67018c35a64d service nova] Lock "2bbdbdc6-ce56-4357-87cb-85bbc99e3343-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:50:34 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-8e73aad2-2d7f-4c8b-96f2-9175342c1c9a req-781d9fc3-30e3-4625-b513-67018c35a64d service nova] Lock "2bbdbdc6-ce56-4357-87cb-85bbc99e3343-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:50:34 user nova-compute[75165]: DEBUG nova.compute.manager [req-8e73aad2-2d7f-4c8b-96f2-9175342c1c9a req-781d9fc3-30e3-4625-b513-67018c35a64d service nova] [instance: 2bbdbdc6-ce56-4357-87cb-85bbc99e3343] No waiting events found dispatching network-vif-plugged-fd36e9ef-0d0c-4f08-a359-4b65e4cd371e {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:50:34 user nova-compute[75165]: WARNING nova.compute.manager [req-8e73aad2-2d7f-4c8b-96f2-9175342c1c9a req-781d9fc3-30e3-4625-b513-67018c35a64d service nova] [instance: 2bbdbdc6-ce56-4357-87cb-85bbc99e3343] Received unexpected event network-vif-plugged-fd36e9ef-0d0c-4f08-a359-4b65e4cd371e for instance with vm_state active and task_state None.
Oct 26 00:50:34 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-c14b63ba-4ce1-4b61-92e6-642cb248cb17 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Lock "2bbdbdc6-ce56-4357-87cb-85bbc99e3343" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 23.315s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:50:36 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:50:36 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:50:36 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:50:37 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:50:38 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:50:40 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:50:40 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:50:41 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:50:43 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:50:43 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:50:43 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Starting heal instance info cache {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 00:50:43 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Rebuilding the list of instances to heal {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 00:50:43 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "refresh_cache-08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:50:43 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquired lock "refresh_cache-08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:50:43 user nova-compute[75165]: DEBUG nova.network.neutron [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: 08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed] Forcefully refreshing network info cache for instance {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 00:50:43 user nova-compute[75165]: DEBUG nova.objects.instance [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lazy-loading 'info_cache' on Instance uuid 08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:50:44 user nova-compute[75165]: DEBUG nova.network.neutron [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: 08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed] Updating instance_info_cache with network_info: [{"id": "4983d9d7-3996-4f95-bc35-0ab5b325e341", "address": "fa:16:3e:fc:8d:e2", "network": {"id": "dc50ae7b-d501-461f-aa0b-542514330ae8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1091857056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1051405ca054c4bb051fb842a5fb5a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4983d9d7-39", "ovs_interfaceid": "4983d9d7-3996-4f95-bc35-0ab5b325e341", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:50:44 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Releasing lock "refresh_cache-08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:50:44 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: 08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed] Updated the network info_cache for instance {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 00:50:46 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:50:46 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:50:46 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75165) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 00:50:46 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75165) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 00:50:46 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75165) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 00:50:46 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:50:46 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:50:46 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:50:46 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:50:46 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:50:46 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75165) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 00:50:46 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75165) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 00:50:46 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75165) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 00:50:47 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:50:47 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:50:47 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Hypervisor/Node resource view: name=user free_ram=8838MB free_disk=24.835010528564453GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75165) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 00:50:47 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:50:47 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:50:47 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:50:47 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 2bbdbdc6-ce56-4357-87cb-85bbc99e3343 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:50:47 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75165) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 00:50:47 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75165) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 00:50:47 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:50:47 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:50:47 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Compute_service record updated for user:user {{(pid=75165) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 00:50:47 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.226s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:50:51 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:50:52 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:50:56 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:50:57 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:51:01 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:51:02 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:51:06 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:51:11 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:51:16 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:51:21 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:51:26 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:51:31 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:51:31 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:51:31 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75165) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 00:51:31 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75165) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 00:51:31 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75165) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 00:51:31 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:51:31 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:51:31 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75165) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 00:51:36 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:51:36 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:51:37 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:51:38 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:51:39 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:51:40 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:51:40 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:51:41 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:51:44 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:51:44 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:51:45 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:51:45 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Starting heal instance info cache {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 00:51:46 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "refresh_cache-2bbdbdc6-ce56-4357-87cb-85bbc99e3343" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:51:46 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquired lock "refresh_cache-2bbdbdc6-ce56-4357-87cb-85bbc99e3343" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:51:46 user nova-compute[75165]: DEBUG nova.network.neutron [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: 2bbdbdc6-ce56-4357-87cb-85bbc99e3343] Forcefully refreshing network info cache for instance {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 00:51:46 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:51:46 user nova-compute[75165]: DEBUG nova.network.neutron [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: 2bbdbdc6-ce56-4357-87cb-85bbc99e3343] Updating instance_info_cache with network_info: [{"id": "fd36e9ef-0d0c-4f08-a359-4b65e4cd371e", "address": "fa:16:3e:86:4e:e2", "network": {"id": "dc50ae7b-d501-461f-aa0b-542514330ae8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1091857056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1051405ca054c4bb051fb842a5fb5a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd36e9ef-0d", "ovs_interfaceid": "fd36e9ef-0d0c-4f08-a359-4b65e4cd371e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:51:46 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Releasing lock "refresh_cache-2bbdbdc6-ce56-4357-87cb-85bbc99e3343" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:51:46 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: 2bbdbdc6-ce56-4357-87cb-85bbc99e3343] Updated the network info_cache for instance {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 00:51:48 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:51:48 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:51:48 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:51:48 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:51:48 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75165) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 00:51:48 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75165) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 00:51:48 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75165) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 00:51:49 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:51:49 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:51:49 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Hypervisor/Node resource view: name=user free_ram=8916MB free_disk=24.833572387695312GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75165) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 00:51:49 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:51:49 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:51:49 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:51:49 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 2bbdbdc6-ce56-4357-87cb-85bbc99e3343 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:51:49 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75165) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 00:51:49 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75165) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 00:51:49 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:51:49 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:51:49 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Compute_service record updated for user:user {{(pid=75165) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 00:51:49 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.201s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:51:51 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:51:56 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:52:01 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:52:01 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:52:01 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75165) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 00:52:01 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75165) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 00:52:01 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75165) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 00:52:01 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:52:04 user nova-compute[75165]: DEBUG nova.compute.manager [req-fb8c7269-9459-41cc-a56b-9fcc6e0e2d15 req-640de934-a851-427a-8045-ee8da7cc7511 service nova] [instance: 2bbdbdc6-ce56-4357-87cb-85bbc99e3343] Received event network-changed-fd36e9ef-0d0c-4f08-a359-4b65e4cd371e {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:52:04 user nova-compute[75165]: DEBUG nova.compute.manager [req-fb8c7269-9459-41cc-a56b-9fcc6e0e2d15 req-640de934-a851-427a-8045-ee8da7cc7511 service nova] [instance: 2bbdbdc6-ce56-4357-87cb-85bbc99e3343] Refreshing instance network info cache due to event network-changed-fd36e9ef-0d0c-4f08-a359-4b65e4cd371e. {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 00:52:04 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-fb8c7269-9459-41cc-a56b-9fcc6e0e2d15 req-640de934-a851-427a-8045-ee8da7cc7511 service nova] Acquiring lock "refresh_cache-2bbdbdc6-ce56-4357-87cb-85bbc99e3343" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:52:04 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-fb8c7269-9459-41cc-a56b-9fcc6e0e2d15 req-640de934-a851-427a-8045-ee8da7cc7511 service nova] Acquired lock "refresh_cache-2bbdbdc6-ce56-4357-87cb-85bbc99e3343" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:52:04 user nova-compute[75165]: DEBUG nova.network.neutron [req-fb8c7269-9459-41cc-a56b-9fcc6e0e2d15 req-640de934-a851-427a-8045-ee8da7cc7511 service nova] [instance: 2bbdbdc6-ce56-4357-87cb-85bbc99e3343] Refreshing network info cache for port fd36e9ef-0d0c-4f08-a359-4b65e4cd371e {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 00:52:04 user nova-compute[75165]: DEBUG nova.network.neutron [req-fb8c7269-9459-41cc-a56b-9fcc6e0e2d15 req-640de934-a851-427a-8045-ee8da7cc7511 service nova] [instance: 2bbdbdc6-ce56-4357-87cb-85bbc99e3343] Updated VIF entry in instance network info cache for port fd36e9ef-0d0c-4f08-a359-4b65e4cd371e. {{(pid=75165) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 00:52:04 user nova-compute[75165]: DEBUG nova.network.neutron [req-fb8c7269-9459-41cc-a56b-9fcc6e0e2d15 req-640de934-a851-427a-8045-ee8da7cc7511 service nova] [instance: 2bbdbdc6-ce56-4357-87cb-85bbc99e3343] Updating instance_info_cache with network_info: [{"id": "fd36e9ef-0d0c-4f08-a359-4b65e4cd371e", "address": "fa:16:3e:86:4e:e2", "network": {"id": "dc50ae7b-d501-461f-aa0b-542514330ae8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1091857056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1051405ca054c4bb051fb842a5fb5a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd36e9ef-0d", "ovs_interfaceid": "fd36e9ef-0d0c-4f08-a359-4b65e4cd371e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:52:04 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-fb8c7269-9459-41cc-a56b-9fcc6e0e2d15 req-640de934-a851-427a-8045-ee8da7cc7511 service nova] Releasing lock "refresh_cache-2bbdbdc6-ce56-4357-87cb-85bbc99e3343" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:52:05 user nova-compute[75165]: DEBUG nova.compute.manager [req-6360295b-4c86-4142-b358-9754f3cd1060 req-49f471b1-09d5-49ad-9f07-d20557464874 service nova] [instance: 2bbdbdc6-ce56-4357-87cb-85bbc99e3343] Received event network-changed-fd36e9ef-0d0c-4f08-a359-4b65e4cd371e {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:52:05 user nova-compute[75165]: DEBUG nova.compute.manager [req-6360295b-4c86-4142-b358-9754f3cd1060 req-49f471b1-09d5-49ad-9f07-d20557464874 service nova] [instance: 2bbdbdc6-ce56-4357-87cb-85bbc99e3343] Refreshing instance network info cache due to event network-changed-fd36e9ef-0d0c-4f08-a359-4b65e4cd371e. {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 00:52:05 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-6360295b-4c86-4142-b358-9754f3cd1060 req-49f471b1-09d5-49ad-9f07-d20557464874 service nova] Acquiring lock "refresh_cache-2bbdbdc6-ce56-4357-87cb-85bbc99e3343" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:52:05 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-6360295b-4c86-4142-b358-9754f3cd1060 req-49f471b1-09d5-49ad-9f07-d20557464874 service nova] Acquired lock "refresh_cache-2bbdbdc6-ce56-4357-87cb-85bbc99e3343" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:52:05 user nova-compute[75165]: DEBUG nova.network.neutron [req-6360295b-4c86-4142-b358-9754f3cd1060 req-49f471b1-09d5-49ad-9f07-d20557464874 service nova] [instance: 2bbdbdc6-ce56-4357-87cb-85bbc99e3343] Refreshing network info cache for port fd36e9ef-0d0c-4f08-a359-4b65e4cd371e {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 00:52:05 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-2e3a72de-1676-4e59-97fb-42369606701b tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Acquiring lock "2bbdbdc6-ce56-4357-87cb-85bbc99e3343" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:52:05 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-2e3a72de-1676-4e59-97fb-42369606701b tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Lock "2bbdbdc6-ce56-4357-87cb-85bbc99e3343" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:52:05 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-2e3a72de-1676-4e59-97fb-42369606701b tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Acquiring lock "2bbdbdc6-ce56-4357-87cb-85bbc99e3343-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:52:05 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-2e3a72de-1676-4e59-97fb-42369606701b tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Lock "2bbdbdc6-ce56-4357-87cb-85bbc99e3343-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:52:05 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-2e3a72de-1676-4e59-97fb-42369606701b tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Lock "2bbdbdc6-ce56-4357-87cb-85bbc99e3343-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:52:05 user nova-compute[75165]: INFO nova.compute.manager [None req-2e3a72de-1676-4e59-97fb-42369606701b tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 2bbdbdc6-ce56-4357-87cb-85bbc99e3343] Terminating instance
Oct 26 00:52:05 user nova-compute[75165]: DEBUG nova.compute.manager [None req-2e3a72de-1676-4e59-97fb-42369606701b tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 2bbdbdc6-ce56-4357-87cb-85bbc99e3343] Start destroying the instance on the hypervisor. {{(pid=75165) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 00:52:05 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:52:05 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:52:05 user nova-compute[75165]: DEBUG nova.compute.manager [req-62027786-1687-4eb3-bf13-da8c3fcccf7c req-c04ed910-39db-4f6d-88dc-65dccfceddb6 service nova] [instance: 2bbdbdc6-ce56-4357-87cb-85bbc99e3343] Received event network-vif-unplugged-fd36e9ef-0d0c-4f08-a359-4b65e4cd371e {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:52:05 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-62027786-1687-4eb3-bf13-da8c3fcccf7c req-c04ed910-39db-4f6d-88dc-65dccfceddb6 service nova] Acquiring lock "2bbdbdc6-ce56-4357-87cb-85bbc99e3343-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:52:05 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-62027786-1687-4eb3-bf13-da8c3fcccf7c req-c04ed910-39db-4f6d-88dc-65dccfceddb6 service nova] Lock "2bbdbdc6-ce56-4357-87cb-85bbc99e3343-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:52:05 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-62027786-1687-4eb3-bf13-da8c3fcccf7c req-c04ed910-39db-4f6d-88dc-65dccfceddb6 service nova] Lock "2bbdbdc6-ce56-4357-87cb-85bbc99e3343-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:52:05 user nova-compute[75165]: DEBUG nova.compute.manager [req-62027786-1687-4eb3-bf13-da8c3fcccf7c req-c04ed910-39db-4f6d-88dc-65dccfceddb6 service nova] [instance: 2bbdbdc6-ce56-4357-87cb-85bbc99e3343] No waiting events found dispatching network-vif-unplugged-fd36e9ef-0d0c-4f08-a359-4b65e4cd371e {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:52:05 user nova-compute[75165]: DEBUG nova.compute.manager [req-62027786-1687-4eb3-bf13-da8c3fcccf7c req-c04ed910-39db-4f6d-88dc-65dccfceddb6 service nova] [instance: 2bbdbdc6-ce56-4357-87cb-85bbc99e3343] Received event network-vif-unplugged-fd36e9ef-0d0c-4f08-a359-4b65e4cd371e for instance with task_state deleting. {{(pid=75165) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 00:52:05 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:52:05 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:52:05 user nova-compute[75165]: DEBUG nova.network.neutron [req-6360295b-4c86-4142-b358-9754f3cd1060 req-49f471b1-09d5-49ad-9f07-d20557464874 service nova] [instance: 2bbdbdc6-ce56-4357-87cb-85bbc99e3343] Updated VIF entry in instance network info cache for port fd36e9ef-0d0c-4f08-a359-4b65e4cd371e. {{(pid=75165) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 00:52:05 user nova-compute[75165]: DEBUG nova.network.neutron [req-6360295b-4c86-4142-b358-9754f3cd1060 req-49f471b1-09d5-49ad-9f07-d20557464874 service nova] [instance: 2bbdbdc6-ce56-4357-87cb-85bbc99e3343] Updating instance_info_cache with network_info: [{"id": "fd36e9ef-0d0c-4f08-a359-4b65e4cd371e", "address": "fa:16:3e:86:4e:e2", "network": {"id": "dc50ae7b-d501-461f-aa0b-542514330ae8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1091857056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1051405ca054c4bb051fb842a5fb5a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd36e9ef-0d", "ovs_interfaceid": "fd36e9ef-0d0c-4f08-a359-4b65e4cd371e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:52:05 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-6360295b-4c86-4142-b358-9754f3cd1060 req-49f471b1-09d5-49ad-9f07-d20557464874 service nova] Releasing lock "refresh_cache-2bbdbdc6-ce56-4357-87cb-85bbc99e3343" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:52:05 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: 2bbdbdc6-ce56-4357-87cb-85bbc99e3343] Instance destroyed successfully.
Oct 26 00:52:05 user nova-compute[75165]: DEBUG nova.objects.instance [None req-2e3a72de-1676-4e59-97fb-42369606701b tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Lazy-loading 'resources' on Instance uuid 2bbdbdc6-ce56-4357-87cb-85bbc99e3343 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:52:05 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-2e3a72de-1676-4e59-97fb-42369606701b tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:50:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1539441902',display_name='tempest-TestVolumeBootPattern-server-1539441902',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1539441902',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBChKvTLd4nhrj5htJzspkP8o+qgId41EjTR/fmBLYf3vmPpK9NBbxwvdQKkZqqXFiSi6AG6cvipLHicvfW4NLnZq3yjDwP+cF/yBIdW+iAQl3BC4GDkkyYulLa73yUYFmw==',key_name='tempest-TestVolumeBootPattern-819204347',keypairs=<?>,launch_index=0,launched_at=2023-10-26T00:50:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d1051405ca054c4bb051fb842a5fb5a0',ramdisk_id='',reservation_id='r-hu8a2pr5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1215567595',owner_user_name='tempest-TestVolumeBootPattern-1215567595-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T00:50:35Z,user_data=None,user_id='ae836eab78514cf3894e5e11240ff374',uuid=2bbdbdc6-ce56-4357-87cb-85bbc99e3343,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fd36e9ef-0d0c-4f08-a359-4b65e4cd371e", "address": "fa:16:3e:86:4e:e2", "network": {"id": "dc50ae7b-d501-461f-aa0b-542514330ae8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1091857056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1051405ca054c4bb051fb842a5fb5a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd36e9ef-0d", "ovs_interfaceid": "fd36e9ef-0d0c-4f08-a359-4b65e4cd371e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 00:52:05 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-2e3a72de-1676-4e59-97fb-42369606701b tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Converting VIF {"id": "fd36e9ef-0d0c-4f08-a359-4b65e4cd371e", "address": "fa:16:3e:86:4e:e2", "network": {"id": "dc50ae7b-d501-461f-aa0b-542514330ae8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1091857056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1051405ca054c4bb051fb842a5fb5a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd36e9ef-0d", "ovs_interfaceid": "fd36e9ef-0d0c-4f08-a359-4b65e4cd371e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:52:05 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-2e3a72de-1676-4e59-97fb-42369606701b tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:86:4e:e2,bridge_name='br-int',has_traffic_filtering=True,id=fd36e9ef-0d0c-4f08-a359-4b65e4cd371e,network=Network(dc50ae7b-d501-461f-aa0b-542514330ae8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd36e9ef-0d') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:52:05 user nova-compute[75165]: DEBUG os_vif [None req-2e3a72de-1676-4e59-97fb-42369606701b tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:86:4e:e2,bridge_name='br-int',has_traffic_filtering=True,id=fd36e9ef-0d0c-4f08-a359-4b65e4cd371e,network=Network(dc50ae7b-d501-461f-aa0b-542514330ae8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd36e9ef-0d') {{(pid=75165) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 00:52:05 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:52:05 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfd36e9ef-0d, bridge=br-int, if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:52:05 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:52:05 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:52:05 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:52:05 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c5f68b90-a29c-4654-a381-0f748e903bc9) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:52:05 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:52:05 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:52:05 user nova-compute[75165]: INFO os_vif [None req-2e3a72de-1676-4e59-97fb-42369606701b tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:86:4e:e2,bridge_name='br-int',has_traffic_filtering=True,id=fd36e9ef-0d0c-4f08-a359-4b65e4cd371e,network=Network(dc50ae7b-d501-461f-aa0b-542514330ae8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd36e9ef-0d')
Oct 26 00:52:05 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e3a72de-1676-4e59-97fb-42369606701b tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 2bbdbdc6-ce56-4357-87cb-85bbc99e3343] calling os-brick to detach iSCSI Volume {{(pid=75165) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 00:52:05 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e3a72de-1676-4e59-97fb-42369606701b tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8bf8160e50>, {'target_iqn': 'iqn.2010-10.org.openstack:c9c9fee3-6885-4dc9-9b49-cca3631705bb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VwklHDJg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:52:05 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-2e3a72de-1676-4e59-97fb-42369606701b tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:52:05 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-2e3a72de-1676-4e59-97fb-42369606701b tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:52:05 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-2e3a72de-1676-4e59-97fb-42369606701b tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:52:05 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:52:05 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:52:05 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[42257602-c46d-4a1a-b5d4-60626bf95878]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c9c9fee3-6885-4dc9-9b49-cca3631705bb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:28483cbc-41a9-4961-9c30-fae820d1ad43\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:52:05 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e3a72de-1676-4e59-97fb-42369606701b tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 00:52:05 user nova-compute[75165]: No targets found.
Oct 26 00:52:05 user nova-compute[75165]: iSNS:
Oct 26 00:52:05 user nova-compute[75165]: No targets found.
Oct 26 00:52:05 user nova-compute[75165]: STATIC:
Oct 26 00:52:05 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:c9c9fee3-6885-4dc9-9b49-cca3631705bb
Oct 26 00:52:05 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:52:05 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:52:05 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:28483cbc-41a9-4961-9c30-fae820d1ad43
Oct 26 00:52:05 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:52:05 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:52:05 user nova-compute[75165]: FIRMWARE:
Oct 26 00:52:05 user nova-compute[75165]: No targets found.
Oct 26 00:52:05 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:52:05 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e3a72de-1676-4e59-97fb-42369606701b tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 00:52:05 user nova-compute[75165]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 00:52:05 user nova-compute[75165]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75165) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 00:52:05 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e3a72de-1676-4e59-97fb-42369606701b tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c9c9fee3-6885-4dc9-9b49-cca3631705bb', 0)] {{(pid=75165) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 00:52:05 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:52:06 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:52:06 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[954d42ce-c33c-4936-9901-d9b094f39324]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:28483cbc-41a9-4961-9c30-fae820d1ad43\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9c9fee3-6885-4dc9-9b49-cca3631705bb\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:52:06 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:52:06 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:52:06 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[72b46901-8231-4d5f-9a2a-d5a758526664]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28483cbc-41a9-4961-9c30-fae820d1ad43 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c9fee3-6885-4dc9-9b49-cca3631705bb (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:52:06 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e3a72de-1676-4e59-97fb-42369606701b tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28483cbc-41a9-4961-9c30-fae820d1ad43 (non-flash)
Oct 26 00:52:06 user nova-compute[75165]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c9fee3-6885-4dc9-9b49-cca3631705bb (non-flash)
Oct 26 00:52:06 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:52:06 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e3a72de-1676-4e59-97fb-42369606701b tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28483cbc-41a9-4961-9c30-fae820d1ad43 (non-flash)
Oct 26 00:52:06 user nova-compute[75165]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c9fee3-6885-4dc9-9b49-cca3631705bb (non-flash)
Oct 26 00:52:06 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:52:06 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e3a72de-1676-4e59-97fb-42369606701b tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8be01bb370>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c9c9fee3-6885-4dc9-9b49-cca3631705bb'): ({'sdc'}, set())}) {{(pid=75165) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 00:52:06 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-2e3a72de-1676-4e59-97fb-42369606701b tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Removing single pathed devices sdc {{(pid=75165) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 00:52:06 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:52:06 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:52:06 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[3803aece-9c11-4a73-b46d-0f409a4183cc]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:52:06 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:52:06 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:52:06 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[83d70a3a-eff0-4dff-aeb2-6e19c2ef88e1]: (4, ('ok\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:52:06 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-2e3a72de-1676-4e59-97fb-42369606701b tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Flushing IO for device /dev/sdc {{(pid=75165) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 00:52:06 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:52:06 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:52:06 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce713336-e83b-4413-b2fc-a57696ed61f5]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:52:06 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-2e3a72de-1676-4e59-97fb-42369606701b tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75165) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 00:52:06 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:52:06 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:52:06 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd68b71d-ed22-46ad-978f-3ef6328f4635]: (4, ('1', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:52:06 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-2e3a72de-1676-4e59-97fb-42369606701b tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75165) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 00:52:06 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-2e3a72de-1676-4e59-97fb-42369606701b tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] SCSI volumes sdc have been removed. {{(pid=75165) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 00:52:06 user nova-compute[75165]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23535373332366662', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_aa40836f', '/dev/disk/by-id/scsi-1SCST_BIOaa40836f-557326fba5cf8c3d') {{(pid=86976) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 26 00:52:06 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[d08148b3-6181-4bd4-bae6-689bc5a937ee]: (4, None) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:52:06 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e3a72de-1676-4e59-97fb-42369606701b tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c9c9fee3-6885-4dc9-9b49-cca3631705bb')] {{(pid=75165) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 00:52:06 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9c9fee3-6885-4dc9-9b49-cca3631705bb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:52:06 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9c9fee3-6885-4dc9-9b49-cca3631705bb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:52:06 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec01a522-b8d3-42d3-9154-786ce5d35a23]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:52:06 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e3a72de-1676-4e59-97fb-42369606701b tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:52:06 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9c9fee3-6885-4dc9-9b49-cca3631705bb -p 172.16.0.220:3260 --logout {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:52:06 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9c9fee3-6885-4dc9-9b49-cca3631705bb -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:52:06 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a94b4c6-8218-43d2-8576-0d6b5b17ad39]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:c9c9fee3-6885-4dc9-9b49-cca3631705bb, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:c9c9fee3-6885-4dc9-9b49-cca3631705bb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:52:06 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e3a72de-1676-4e59-97fb-42369606701b tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:c9c9fee3-6885-4dc9-9b49-cca3631705bb, portal: 172.16.0.220,3260]
Oct 26 00:52:06 user nova-compute[75165]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:c9c9fee3-6885-4dc9-9b49-cca3631705bb, portal: 172.16.0.220,3260] successful.
Oct 26 00:52:06 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:52:06 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9c9fee3-6885-4dc9-9b49-cca3631705bb -p 172.16.0.220:3260 --op delete {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:52:06 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9c9fee3-6885-4dc9-9b49-cca3631705bb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:52:06 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b01e47a-c30a-4be1-bb1c-eb2f1e438fca]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:52:06 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e3a72de-1676-4e59-97fb-42369606701b tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:52:06 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-2e3a72de-1676-4e59-97fb-42369606701b tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:52:06 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e3a72de-1676-4e59-97fb-42369606701b tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] <== disconnect_volume: return (303ms) None {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:52:06 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e3a72de-1676-4e59-97fb-42369606701b tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 2bbdbdc6-ce56-4357-87cb-85bbc99e3343] Disconnected iSCSI Volume {{(pid=75165) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 00:52:06 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-2e3a72de-1676-4e59-97fb-42369606701b tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 2bbdbdc6-ce56-4357-87cb-85bbc99e3343] Deleting instance files /opt/stack/data/nova/instances/2bbdbdc6-ce56-4357-87cb-85bbc99e3343_del
Oct 26 00:52:06 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-2e3a72de-1676-4e59-97fb-42369606701b tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 2bbdbdc6-ce56-4357-87cb-85bbc99e3343] Deletion of /opt/stack/data/nova/instances/2bbdbdc6-ce56-4357-87cb-85bbc99e3343_del complete
Oct 26 00:52:06 user nova-compute[75165]: INFO nova.compute.manager [None req-2e3a72de-1676-4e59-97fb-42369606701b tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 2bbdbdc6-ce56-4357-87cb-85bbc99e3343] Took 1.16 seconds to destroy the instance on the hypervisor.
Oct 26 00:52:06 user nova-compute[75165]: DEBUG oslo.service.loopingcall [None req-2e3a72de-1676-4e59-97fb-42369606701b tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75165) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 00:52:06 user nova-compute[75165]: DEBUG nova.compute.manager [-] [instance: 2bbdbdc6-ce56-4357-87cb-85bbc99e3343] Deallocating network for instance {{(pid=75165) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 00:52:06 user nova-compute[75165]: DEBUG nova.network.neutron [-] [instance: 2bbdbdc6-ce56-4357-87cb-85bbc99e3343] deallocate_for_instance() {{(pid=75165) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 00:52:06 user nova-compute[75165]: DEBUG nova.network.neutron [-] [instance: 2bbdbdc6-ce56-4357-87cb-85bbc99e3343] Updating instance_info_cache with network_info: [] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:52:06 user nova-compute[75165]: INFO nova.compute.manager [-] [instance: 2bbdbdc6-ce56-4357-87cb-85bbc99e3343] Took 0.63 seconds to deallocate network for instance.
Oct 26 00:52:06 user nova-compute[75165]: DEBUG nova.compute.manager [req-94bfd744-19b6-40eb-84d9-aed19a0b753c req-b9cb4fe5-32f2-4048-99df-fa58f8c53d7d service nova] [instance: 2bbdbdc6-ce56-4357-87cb-85bbc99e3343] Received event network-vif-deleted-fd36e9ef-0d0c-4f08-a359-4b65e4cd371e {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:52:06 user nova-compute[75165]: INFO nova.compute.manager [req-94bfd744-19b6-40eb-84d9-aed19a0b753c req-b9cb4fe5-32f2-4048-99df-fa58f8c53d7d service nova] [instance: 2bbdbdc6-ce56-4357-87cb-85bbc99e3343] Neutron deleted interface fd36e9ef-0d0c-4f08-a359-4b65e4cd371e; detaching it from the instance and deleting it from the info cache
Oct 26 00:52:06 user nova-compute[75165]: DEBUG nova.network.neutron [req-94bfd744-19b6-40eb-84d9-aed19a0b753c req-b9cb4fe5-32f2-4048-99df-fa58f8c53d7d service nova] [instance: 2bbdbdc6-ce56-4357-87cb-85bbc99e3343] Updating instance_info_cache with network_info: [] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:52:06 user nova-compute[75165]: DEBUG nova.compute.manager [req-94bfd744-19b6-40eb-84d9-aed19a0b753c req-b9cb4fe5-32f2-4048-99df-fa58f8c53d7d service nova] [instance: 2bbdbdc6-ce56-4357-87cb-85bbc99e3343] Detach interface failed, port_id=fd36e9ef-0d0c-4f08-a359-4b65e4cd371e, reason: Instance 2bbdbdc6-ce56-4357-87cb-85bbc99e3343 could not be found. {{(pid=75165) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 26 00:52:07 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:52:07 user nova-compute[75165]: DEBUG nova.compute.manager [req-b0d35811-848a-4b3d-a839-591ec299aec9 req-27b91d5b-e234-4cb1-bc00-ec74a65079e7 service nova] [instance: 2bbdbdc6-ce56-4357-87cb-85bbc99e3343] Received event network-vif-plugged-fd36e9ef-0d0c-4f08-a359-4b65e4cd371e {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:52:07 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-b0d35811-848a-4b3d-a839-591ec299aec9 req-27b91d5b-e234-4cb1-bc00-ec74a65079e7 service nova] Acquiring lock "2bbdbdc6-ce56-4357-87cb-85bbc99e3343-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:52:07 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-b0d35811-848a-4b3d-a839-591ec299aec9 req-27b91d5b-e234-4cb1-bc00-ec74a65079e7 service nova] Lock "2bbdbdc6-ce56-4357-87cb-85bbc99e3343-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:52:07 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-b0d35811-848a-4b3d-a839-591ec299aec9 req-27b91d5b-e234-4cb1-bc00-ec74a65079e7 service nova] Lock "2bbdbdc6-ce56-4357-87cb-85bbc99e3343-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:52:07 user nova-compute[75165]: DEBUG nova.compute.manager [req-b0d35811-848a-4b3d-a839-591ec299aec9 req-27b91d5b-e234-4cb1-bc00-ec74a65079e7 service nova] [instance: 2bbdbdc6-ce56-4357-87cb-85bbc99e3343] No waiting events found dispatching network-vif-plugged-fd36e9ef-0d0c-4f08-a359-4b65e4cd371e {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:52:07 user nova-compute[75165]: WARNING nova.compute.manager [req-b0d35811-848a-4b3d-a839-591ec299aec9 req-27b91d5b-e234-4cb1-bc00-ec74a65079e7 service nova] [instance: 2bbdbdc6-ce56-4357-87cb-85bbc99e3343] Received unexpected event network-vif-plugged-fd36e9ef-0d0c-4f08-a359-4b65e4cd371e for instance with vm_state active and task_state deleting.
Oct 26 00:52:07 user nova-compute[75165]: INFO nova.compute.manager [None req-2e3a72de-1676-4e59-97fb-42369606701b tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 2bbdbdc6-ce56-4357-87cb-85bbc99e3343] Took 0.82 seconds to detach 1 volumes for instance.
Oct 26 00:52:07 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-2e3a72de-1676-4e59-97fb-42369606701b tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:52:07 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-2e3a72de-1676-4e59-97fb-42369606701b tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:52:07 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-2e3a72de-1676-4e59-97fb-42369606701b tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:52:07 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-2e3a72de-1676-4e59-97fb-42369606701b tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:52:07 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-2e3a72de-1676-4e59-97fb-42369606701b tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.140s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:52:08 user nova-compute[75165]: INFO nova.scheduler.client.report [None req-2e3a72de-1676-4e59-97fb-42369606701b tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Deleted allocations for instance 2bbdbdc6-ce56-4357-87cb-85bbc99e3343
Oct 26 00:52:08 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-2e3a72de-1676-4e59-97fb-42369606701b tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Lock "2bbdbdc6-ce56-4357-87cb-85bbc99e3343" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.989s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:52:10 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:52:15 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:52:20 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:52:25 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:52:26 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:52:28 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:52:30 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:52:31 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:52:31 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75165) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 00:52:32 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:52:32 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:52:34 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:52:35 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:52:37 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:52:37 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:52:38 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-1a7e8eca-649b-4f10-9095-165288474b9a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Acquiring lock "b59b5027-502d-4e4d-8f0d-8e19961ba3e4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:52:38 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-1a7e8eca-649b-4f10-9095-165288474b9a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Lock "b59b5027-502d-4e4d-8f0d-8e19961ba3e4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:52:38 user nova-compute[75165]: DEBUG nova.compute.manager [None req-1a7e8eca-649b-4f10-9095-165288474b9a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] [instance: b59b5027-502d-4e4d-8f0d-8e19961ba3e4] Starting instance... {{(pid=75165) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 00:52:38 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-1a7e8eca-649b-4f10-9095-165288474b9a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:52:38 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-1a7e8eca-649b-4f10-9095-165288474b9a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:52:38 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-1a7e8eca-649b-4f10-9095-165288474b9a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75165) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 00:52:38 user nova-compute[75165]: INFO nova.compute.claims [None req-1a7e8eca-649b-4f10-9095-165288474b9a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] [instance: b59b5027-502d-4e4d-8f0d-8e19961ba3e4] Claim successful on node user
Oct 26 00:52:38 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-1a7e8eca-649b-4f10-9095-165288474b9a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:52:38 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-1a7e8eca-649b-4f10-9095-165288474b9a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:52:38 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-1a7e8eca-649b-4f10-9095-165288474b9a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.223s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:52:38 user nova-compute[75165]: DEBUG nova.compute.manager [None req-1a7e8eca-649b-4f10-9095-165288474b9a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] [instance: b59b5027-502d-4e4d-8f0d-8e19961ba3e4] Start building networks asynchronously for instance. {{(pid=75165) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 00:52:38 user nova-compute[75165]: DEBUG nova.compute.manager [None req-1a7e8eca-649b-4f10-9095-165288474b9a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] [instance: b59b5027-502d-4e4d-8f0d-8e19961ba3e4] Allocating IP information in the background. {{(pid=75165) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 00:52:38 user nova-compute[75165]: DEBUG nova.network.neutron [None req-1a7e8eca-649b-4f10-9095-165288474b9a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] [instance: b59b5027-502d-4e4d-8f0d-8e19961ba3e4] allocate_for_instance() {{(pid=75165) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 00:52:38 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-1a7e8eca-649b-4f10-9095-165288474b9a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] [instance: b59b5027-502d-4e4d-8f0d-8e19961ba3e4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 00:52:38 user nova-compute[75165]: DEBUG nova.compute.manager [None req-1a7e8eca-649b-4f10-9095-165288474b9a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] [instance: b59b5027-502d-4e4d-8f0d-8e19961ba3e4] Start building block device mappings for instance. {{(pid=75165) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 00:52:38 user nova-compute[75165]: DEBUG nova.policy [None req-1a7e8eca-649b-4f10-9095-165288474b9a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd7f8020ca2184967b2a810b0e6c8d4a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f535693c3cbd4f4e969f279167ef7ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75165) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 00:52:39 user nova-compute[75165]: DEBUG nova.compute.manager [None req-1a7e8eca-649b-4f10-9095-165288474b9a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] [instance: b59b5027-502d-4e4d-8f0d-8e19961ba3e4] Start spawning the instance on the hypervisor. {{(pid=75165) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 00:52:39 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-1a7e8eca-649b-4f10-9095-165288474b9a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] [instance: b59b5027-502d-4e4d-8f0d-8e19961ba3e4] Creating instance directory {{(pid=75165) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 00:52:39 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-1a7e8eca-649b-4f10-9095-165288474b9a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] [instance: b59b5027-502d-4e4d-8f0d-8e19961ba3e4] Creating image(s)
Oct 26 00:52:39 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-1a7e8eca-649b-4f10-9095-165288474b9a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Acquiring lock "/opt/stack/data/nova/instances/b59b5027-502d-4e4d-8f0d-8e19961ba3e4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:52:39 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-1a7e8eca-649b-4f10-9095-165288474b9a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Lock "/opt/stack/data/nova/instances/b59b5027-502d-4e4d-8f0d-8e19961ba3e4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:52:39 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-1a7e8eca-649b-4f10-9095-165288474b9a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Lock "/opt/stack/data/nova/instances/b59b5027-502d-4e4d-8f0d-8e19961ba3e4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:52:39 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-1a7e8eca-649b-4f10-9095-165288474b9a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Acquiring lock "ad0ebf0830f495080781d69f6d08bcf46d41a5d7" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:52:39 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-1a7e8eca-649b-4f10-9095-165288474b9a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Lock "ad0ebf0830f495080781d69f6d08bcf46d41a5d7" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:52:39 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-1a7e8eca-649b-4f10-9095-165288474b9a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad0ebf0830f495080781d69f6d08bcf46d41a5d7.part --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:52:39 user nova-compute[75165]: DEBUG nova.network.neutron [None req-1a7e8eca-649b-4f10-9095-165288474b9a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] [instance: b59b5027-502d-4e4d-8f0d-8e19961ba3e4] Successfully created port: 5a3b58e2-07f1-427d-91e2-791138476ac6 {{(pid=75165) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 00:52:39 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-1a7e8eca-649b-4f10-9095-165288474b9a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad0ebf0830f495080781d69f6d08bcf46d41a5d7.part --force-share --output=json" returned: 0 in 0.173s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:52:39 user nova-compute[75165]: DEBUG nova.virt.images [None req-1a7e8eca-649b-4f10-9095-165288474b9a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] bc9330e4-6355-46ac-9bc2-84be0afe29c4 was qcow2, converting to raw {{(pid=75165) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 26 00:52:39 user nova-compute[75165]: DEBUG nova.privsep.utils [None req-1a7e8eca-649b-4f10-9095-165288474b9a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75165) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 26 00:52:39 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-1a7e8eca-649b-4f10-9095-165288474b9a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ad0ebf0830f495080781d69f6d08bcf46d41a5d7.part /opt/stack/data/nova/instances/_base/ad0ebf0830f495080781d69f6d08bcf46d41a5d7.converted {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:52:39 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:52:39 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-1a7e8eca-649b-4f10-9095-165288474b9a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ad0ebf0830f495080781d69f6d08bcf46d41a5d7.part /opt/stack/data/nova/instances/_base/ad0ebf0830f495080781d69f6d08bcf46d41a5d7.converted" returned: 0 in 0.326s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:52:39 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-1a7e8eca-649b-4f10-9095-165288474b9a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad0ebf0830f495080781d69f6d08bcf46d41a5d7.converted --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:52:40 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-1a7e8eca-649b-4f10-9095-165288474b9a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad0ebf0830f495080781d69f6d08bcf46d41a5d7.converted --force-share --output=json" returned: 0 in 0.167s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:52:40 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-1a7e8eca-649b-4f10-9095-165288474b9a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Lock "ad0ebf0830f495080781d69f6d08bcf46d41a5d7" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.125s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:52:40 user nova-compute[75165]: DEBUG nova.network.neutron [None req-1a7e8eca-649b-4f10-9095-165288474b9a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] [instance: b59b5027-502d-4e4d-8f0d-8e19961ba3e4] Successfully updated port: 5a3b58e2-07f1-427d-91e2-791138476ac6 {{(pid=75165) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 00:52:40 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-1a7e8eca-649b-4f10-9095-165288474b9a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad0ebf0830f495080781d69f6d08bcf46d41a5d7 --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:52:40 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-1a7e8eca-649b-4f10-9095-165288474b9a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Acquiring lock "refresh_cache-b59b5027-502d-4e4d-8f0d-8e19961ba3e4" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:52:40 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-1a7e8eca-649b-4f10-9095-165288474b9a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Acquired lock "refresh_cache-b59b5027-502d-4e4d-8f0d-8e19961ba3e4" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:52:40 user nova-compute[75165]: DEBUG nova.network.neutron [None req-1a7e8eca-649b-4f10-9095-165288474b9a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] [instance: b59b5027-502d-4e4d-8f0d-8e19961ba3e4] Building network info cache for instance {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 00:52:40 user nova-compute[75165]: DEBUG nova.compute.manager [req-84e5022a-3740-4962-8f94-0eb30181ca43 req-f0aad41f-d866-4ff2-bee8-b1ab02000b88 service nova] [instance: b59b5027-502d-4e4d-8f0d-8e19961ba3e4] Received event network-changed-5a3b58e2-07f1-427d-91e2-791138476ac6 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:52:40 user nova-compute[75165]: DEBUG nova.compute.manager [req-84e5022a-3740-4962-8f94-0eb30181ca43 req-f0aad41f-d866-4ff2-bee8-b1ab02000b88 service nova] [instance: b59b5027-502d-4e4d-8f0d-8e19961ba3e4] Refreshing instance network info cache due to event network-changed-5a3b58e2-07f1-427d-91e2-791138476ac6. {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 00:52:40 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-84e5022a-3740-4962-8f94-0eb30181ca43 req-f0aad41f-d866-4ff2-bee8-b1ab02000b88 service nova] Acquiring lock "refresh_cache-b59b5027-502d-4e4d-8f0d-8e19961ba3e4" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:52:40 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-1a7e8eca-649b-4f10-9095-165288474b9a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad0ebf0830f495080781d69f6d08bcf46d41a5d7 --force-share --output=json" returned: 0 in 0.175s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:52:40 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-1a7e8eca-649b-4f10-9095-165288474b9a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Acquiring lock "ad0ebf0830f495080781d69f6d08bcf46d41a5d7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:52:40 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-1a7e8eca-649b-4f10-9095-165288474b9a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Lock "ad0ebf0830f495080781d69f6d08bcf46d41a5d7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:52:40 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-1a7e8eca-649b-4f10-9095-165288474b9a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad0ebf0830f495080781d69f6d08bcf46d41a5d7 --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:52:40 user nova-compute[75165]: DEBUG nova.network.neutron [None req-1a7e8eca-649b-4f10-9095-165288474b9a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] [instance: b59b5027-502d-4e4d-8f0d-8e19961ba3e4] Instance cache missing network info. {{(pid=75165) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 00:52:40 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-1a7e8eca-649b-4f10-9095-165288474b9a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad0ebf0830f495080781d69f6d08bcf46d41a5d7 --force-share --output=json" returned: 0 in 0.194s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:52:40 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-1a7e8eca-649b-4f10-9095-165288474b9a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad0ebf0830f495080781d69f6d08bcf46d41a5d7,backing_fmt=raw /opt/stack/data/nova/instances/b59b5027-502d-4e4d-8f0d-8e19961ba3e4/disk 1073741824 {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:52:40 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-1a7e8eca-649b-4f10-9095-165288474b9a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ad0ebf0830f495080781d69f6d08bcf46d41a5d7,backing_fmt=raw /opt/stack/data/nova/instances/b59b5027-502d-4e4d-8f0d-8e19961ba3e4/disk 1073741824" returned: 0 in 0.049s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:52:40 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-1a7e8eca-649b-4f10-9095-165288474b9a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Lock "ad0ebf0830f495080781d69f6d08bcf46d41a5d7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:52:40 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-1a7e8eca-649b-4f10-9095-165288474b9a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad0ebf0830f495080781d69f6d08bcf46d41a5d7 --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:52:40 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-1a7e8eca-649b-4f10-9095-165288474b9a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad0ebf0830f495080781d69f6d08bcf46d41a5d7 --force-share --output=json" returned: 0 in 0.162s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:52:40 user nova-compute[75165]: DEBUG nova.virt.disk.api [None req-1a7e8eca-649b-4f10-9095-165288474b9a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b59b5027-502d-4e4d-8f0d-8e19961ba3e4/disk. size=1073741824 {{(pid=75165) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 00:52:40 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-1a7e8eca-649b-4f10-9095-165288474b9a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b59b5027-502d-4e4d-8f0d-8e19961ba3e4/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:52:40 user nova-compute[75165]: DEBUG nova.network.neutron [None req-1a7e8eca-649b-4f10-9095-165288474b9a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] [instance: b59b5027-502d-4e4d-8f0d-8e19961ba3e4] Updating instance_info_cache with network_info: [{"id": "5a3b58e2-07f1-427d-91e2-791138476ac6", "address": "fa:16:3e:73:3b:67", "network": {"id": "30343eb9-5e61-407a-8491-e58b28ff1645", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1025901471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f535693c3cbd4f4e969f279167ef7ba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a3b58e2-07", "ovs_interfaceid": "5a3b58e2-07f1-427d-91e2-791138476ac6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:52:40 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-1a7e8eca-649b-4f10-9095-165288474b9a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Releasing lock "refresh_cache-b59b5027-502d-4e4d-8f0d-8e19961ba3e4" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:52:40 user nova-compute[75165]: DEBUG nova.compute.manager [None req-1a7e8eca-649b-4f10-9095-165288474b9a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] [instance: b59b5027-502d-4e4d-8f0d-8e19961ba3e4] Instance network_info: |[{"id": "5a3b58e2-07f1-427d-91e2-791138476ac6", "address": "fa:16:3e:73:3b:67", "network": {"id": "30343eb9-5e61-407a-8491-e58b28ff1645", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1025901471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f535693c3cbd4f4e969f279167ef7ba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a3b58e2-07", "ovs_interfaceid": "5a3b58e2-07f1-427d-91e2-791138476ac6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75165) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 00:52:40 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-84e5022a-3740-4962-8f94-0eb30181ca43 req-f0aad41f-d866-4ff2-bee8-b1ab02000b88 service nova] Acquired lock "refresh_cache-b59b5027-502d-4e4d-8f0d-8e19961ba3e4" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:52:40 user nova-compute[75165]: DEBUG nova.network.neutron [req-84e5022a-3740-4962-8f94-0eb30181ca43 req-f0aad41f-d866-4ff2-bee8-b1ab02000b88 service nova] [instance: b59b5027-502d-4e4d-8f0d-8e19961ba3e4] Refreshing network info cache for port 5a3b58e2-07f1-427d-91e2-791138476ac6 {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 00:52:40 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:52:40 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:52:40 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-1a7e8eca-649b-4f10-9095-165288474b9a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b59b5027-502d-4e4d-8f0d-8e19961ba3e4/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:52:40 user nova-compute[75165]: DEBUG nova.virt.disk.api [None req-1a7e8eca-649b-4f10-9095-165288474b9a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Cannot resize image /opt/stack/data/nova/instances/b59b5027-502d-4e4d-8f0d-8e19961ba3e4/disk to a smaller size. {{(pid=75165) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 00:52:40 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-1a7e8eca-649b-4f10-9095-165288474b9a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] [instance: b59b5027-502d-4e4d-8f0d-8e19961ba3e4] Created local disks {{(pid=75165) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 00:52:40 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-1a7e8eca-649b-4f10-9095-165288474b9a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] [instance: b59b5027-502d-4e4d-8f0d-8e19961ba3e4] Ensure instance console log exists: /opt/stack/data/nova/instances/b59b5027-502d-4e4d-8f0d-8e19961ba3e4/console.log {{(pid=75165) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 00:52:40 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-1a7e8eca-649b-4f10-9095-165288474b9a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:52:40 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-1a7e8eca-649b-4f10-9095-165288474b9a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:52:40 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-1a7e8eca-649b-4f10-9095-165288474b9a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:52:40 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-1a7e8eca-649b-4f10-9095-165288474b9a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] [instance: b59b5027-502d-4e4d-8f0d-8e19961ba3e4] Start _get_guest_xml network_info=[{"id": "5a3b58e2-07f1-427d-91e2-791138476ac6", "address": "fa:16:3e:73:3b:67", "network": {"id": "30343eb9-5e61-407a-8491-e58b28ff1645", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1025901471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f535693c3cbd4f4e969f279167ef7ba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a3b58e2-07", "ovs_interfaceid": "5a3b58e2-07f1-427d-91e2-791138476ac6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T00:52:35Z,direct_url=<?>,disk_format='qcow2',id=bc9330e4-6355-46ac-9bc2-84be0afe29c4,min_disk=0,min_ram=0,name='tempest-scenario-img--1907737570',owner='f535693c3cbd4f4e969f279167ef7ba8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T00:52:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'size': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': 'bc9330e4-6355-46ac-9bc2-84be0afe29c4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75165) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 00:52:40 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-1a7e8eca-649b-4f10-9095-165288474b9a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:52:40 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-1a7e8eca-649b-4f10-9095-165288474b9a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:52:40 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-1a7e8eca-649b-4f10-9095-165288474b9a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75165) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 00:52:40 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-1a7e8eca-649b-4f10-9095-165288474b9a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] CPU controller missing on host. {{(pid=75165) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 00:52:40 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-1a7e8eca-649b-4f10-9095-165288474b9a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75165) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 00:52:40 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-1a7e8eca-649b-4f10-9095-165288474b9a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] CPU controller found on host. {{(pid=75165) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 00:52:40 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-1a7e8eca-649b-4f10-9095-165288474b9a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75165) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 00:52:40 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-1a7e8eca-649b-4f10-9095-165288474b9a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T00:03:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T00:52:35Z,direct_url=<?>,disk_format='qcow2',id=bc9330e4-6355-46ac-9bc2-84be0afe29c4,min_disk=0,min_ram=0,name='tempest-scenario-img--1907737570',owner='f535693c3cbd4f4e969f279167ef7ba8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T00:52:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 00:52:40 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-1a7e8eca-649b-4f10-9095-165288474b9a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Flavor limits 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 00:52:40 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-1a7e8eca-649b-4f10-9095-165288474b9a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Image limits 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 00:52:40 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-1a7e8eca-649b-4f10-9095-165288474b9a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Flavor pref 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 00:52:40 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-1a7e8eca-649b-4f10-9095-165288474b9a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Image pref 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 00:52:40 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-1a7e8eca-649b-4f10-9095-165288474b9a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 00:52:40 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-1a7e8eca-649b-4f10-9095-165288474b9a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 00:52:40 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-1a7e8eca-649b-4f10-9095-165288474b9a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75165) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 00:52:40 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-1a7e8eca-649b-4f10-9095-165288474b9a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Got 1 possible topologies {{(pid=75165) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 00:52:40 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-1a7e8eca-649b-4f10-9095-165288474b9a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 00:52:40 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-1a7e8eca-649b-4f10-9095-165288474b9a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 00:52:41 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-1a7e8eca-649b-4f10-9095-165288474b9a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:52:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1122751109',display_name='tempest-TestMinimumBasicScenario-server-1122751109',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1122751109',id=51,image_ref='bc9330e4-6355-46ac-9bc2-84be0afe29c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLrwnU95bX4MXNUTHar2eaBwFFDXaAKPvDXhaGoFnu8Q3nONzRsaw3xwMy98kEX6RSU/ez5DYEE4MxheYs9fETw9ddTIa3nk6bvxzEXDsTVNDnjYLWaz4whLAgBaNRNvag==',key_name='tempest-TestMinimumBasicScenario-649507707',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f535693c3cbd4f4e969f279167ef7ba8',ramdisk_id='',reservation_id='r-y4cdz8zq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc9330e4-6355-46ac-9bc2-84be0afe29c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-387809061',owner_user_name='tempest-TestMinimumBasicScenario-387809061-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T00:52:39Z,user_data=None,user_id='d7f8020ca2184967b2a810b0e6c8d4a0',uuid=b59b5027-502d-4e4d-8f0d-8e19961ba3e4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5a3b58e2-07f1-427d-91e2-791138476ac6", "address": "fa:16:3e:73:3b:67", "network": {"id": "30343eb9-5e61-407a-8491-e58b28ff1645", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1025901471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f535693c3cbd4f4e969f279167ef7ba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a3b58e2-07", "ovs_interfaceid": "5a3b58e2-07f1-427d-91e2-791138476ac6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75165) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 00:52:41 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-1a7e8eca-649b-4f10-9095-165288474b9a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Converting VIF {"id": "5a3b58e2-07f1-427d-91e2-791138476ac6", "address": "fa:16:3e:73:3b:67", "network": {"id": "30343eb9-5e61-407a-8491-e58b28ff1645", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1025901471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f535693c3cbd4f4e969f279167ef7ba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a3b58e2-07", "ovs_interfaceid": "5a3b58e2-07f1-427d-91e2-791138476ac6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:52:41 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-1a7e8eca-649b-4f10-9095-165288474b9a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:3b:67,bridge_name='br-int',has_traffic_filtering=True,id=5a3b58e2-07f1-427d-91e2-791138476ac6,network=Network(30343eb9-5e61-407a-8491-e58b28ff1645),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a3b58e2-07') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:52:41 user nova-compute[75165]: DEBUG nova.objects.instance [None req-1a7e8eca-649b-4f10-9095-165288474b9a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Lazy-loading 'pci_devices' on Instance uuid b59b5027-502d-4e4d-8f0d-8e19961ba3e4 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:52:41 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:52:41 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-1a7e8eca-649b-4f10-9095-165288474b9a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] [instance: b59b5027-502d-4e4d-8f0d-8e19961ba3e4] End _get_guest_xml xml=<domain type="kvm">
Oct 26 00:52:41 user nova-compute[75165]:   <uuid>b59b5027-502d-4e4d-8f0d-8e19961ba3e4</uuid>
Oct 26 00:52:41 user nova-compute[75165]:   <name>instance-00000033</name>
Oct 26 00:52:41 user nova-compute[75165]:   <memory>524288</memory>
Oct 26 00:52:41 user nova-compute[75165]:   <vcpu>1</vcpu>
Oct 26 00:52:41 user nova-compute[75165]:   <metadata>
Oct 26 00:52:41 user nova-compute[75165]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 00:52:41 user nova-compute[75165]:       <nova:package version="0.0.0"/>
Oct 26 00:52:41 user nova-compute[75165]:       <nova:name>tempest-TestMinimumBasicScenario-server-1122751109</nova:name>
Oct 26 00:52:41 user nova-compute[75165]:       <nova:creationTime>2023-10-26 00:52:40</nova:creationTime>
Oct 26 00:52:41 user nova-compute[75165]:       <nova:flavor name="m1.tiny">
Oct 26 00:52:41 user nova-compute[75165]:         <nova:memory>512</nova:memory>
Oct 26 00:52:41 user nova-compute[75165]:         <nova:disk>1</nova:disk>
Oct 26 00:52:41 user nova-compute[75165]:         <nova:swap>0</nova:swap>
Oct 26 00:52:41 user nova-compute[75165]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 00:52:41 user nova-compute[75165]:         <nova:vcpus>1</nova:vcpus>
Oct 26 00:52:41 user nova-compute[75165]:       </nova:flavor>
Oct 26 00:52:41 user nova-compute[75165]:       <nova:owner>
Oct 26 00:52:41 user nova-compute[75165]:         <nova:user uuid="d7f8020ca2184967b2a810b0e6c8d4a0">tempest-TestMinimumBasicScenario-387809061-project-member</nova:user>
Oct 26 00:52:41 user nova-compute[75165]:         <nova:project uuid="f535693c3cbd4f4e969f279167ef7ba8">tempest-TestMinimumBasicScenario-387809061</nova:project>
Oct 26 00:52:41 user nova-compute[75165]:       </nova:owner>
Oct 26 00:52:41 user nova-compute[75165]:       <nova:root type="image" uuid="bc9330e4-6355-46ac-9bc2-84be0afe29c4"/>
Oct 26 00:52:41 user nova-compute[75165]:       <nova:ports>
Oct 26 00:52:41 user nova-compute[75165]:         <nova:port uuid="5a3b58e2-07f1-427d-91e2-791138476ac6">
Oct 26 00:52:41 user nova-compute[75165]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 26 00:52:41 user nova-compute[75165]:         </nova:port>
Oct 26 00:52:41 user nova-compute[75165]:       </nova:ports>
Oct 26 00:52:41 user nova-compute[75165]:     </nova:instance>
Oct 26 00:52:41 user nova-compute[75165]:   </metadata>
Oct 26 00:52:41 user nova-compute[75165]:   <sysinfo type="smbios">
Oct 26 00:52:41 user nova-compute[75165]:     <system>
Oct 26 00:52:41 user nova-compute[75165]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 00:52:41 user nova-compute[75165]:       <entry name="product">OpenStack Nova</entry>
Oct 26 00:52:41 user nova-compute[75165]:       <entry name="version">0.0.0</entry>
Oct 26 00:52:41 user nova-compute[75165]:       <entry name="serial">b59b5027-502d-4e4d-8f0d-8e19961ba3e4</entry>
Oct 26 00:52:41 user nova-compute[75165]:       <entry name="uuid">b59b5027-502d-4e4d-8f0d-8e19961ba3e4</entry>
Oct 26 00:52:41 user nova-compute[75165]:       <entry name="family">Virtual Machine</entry>
Oct 26 00:52:41 user nova-compute[75165]:     </system>
Oct 26 00:52:41 user nova-compute[75165]:   </sysinfo>
Oct 26 00:52:41 user nova-compute[75165]:   <os>
Oct 26 00:52:41 user nova-compute[75165]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 00:52:41 user nova-compute[75165]:     <boot dev="hd"/>
Oct 26 00:52:41 user nova-compute[75165]:     <smbios mode="sysinfo"/>
Oct 26 00:52:41 user nova-compute[75165]:   </os>
Oct 26 00:52:41 user nova-compute[75165]:   <features>
Oct 26 00:52:41 user nova-compute[75165]:     <acpi/>
Oct 26 00:52:41 user nova-compute[75165]:     <apic/>
Oct 26 00:52:41 user nova-compute[75165]:     <vmcoreinfo/>
Oct 26 00:52:41 user nova-compute[75165]:   </features>
Oct 26 00:52:41 user nova-compute[75165]:   <clock offset="utc">
Oct 26 00:52:41 user nova-compute[75165]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 00:52:41 user nova-compute[75165]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 00:52:41 user nova-compute[75165]:     <timer name="hpet" present="no"/>
Oct 26 00:52:41 user nova-compute[75165]:   </clock>
Oct 26 00:52:41 user nova-compute[75165]:   <cpu mode="custom" match="exact">
Oct 26 00:52:41 user nova-compute[75165]:     <model>Nehalem</model>
Oct 26 00:52:41 user nova-compute[75165]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 00:52:41 user nova-compute[75165]:   </cpu>
Oct 26 00:52:41 user nova-compute[75165]:   <devices>
Oct 26 00:52:41 user nova-compute[75165]:     <disk type="file" device="disk">
Oct 26 00:52:41 user nova-compute[75165]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 00:52:41 user nova-compute[75165]:       <source file="/opt/stack/data/nova/instances/b59b5027-502d-4e4d-8f0d-8e19961ba3e4/disk"/>
Oct 26 00:52:41 user nova-compute[75165]:       <target dev="vda" bus="virtio"/>
Oct 26 00:52:41 user nova-compute[75165]:     </disk>
Oct 26 00:52:41 user nova-compute[75165]:     <interface type="ethernet">
Oct 26 00:52:41 user nova-compute[75165]:       <mac address="fa:16:3e:73:3b:67"/>
Oct 26 00:52:41 user nova-compute[75165]:       <model type="virtio"/>
Oct 26 00:52:41 user nova-compute[75165]:       <mtu size="1442"/>
Oct 26 00:52:41 user nova-compute[75165]:       <target dev="tap5a3b58e2-07"/>
Oct 26 00:52:41 user nova-compute[75165]:     </interface>
Oct 26 00:52:41 user nova-compute[75165]:     <serial type="pty">
Oct 26 00:52:41 user nova-compute[75165]:       <log file="/opt/stack/data/nova/instances/b59b5027-502d-4e4d-8f0d-8e19961ba3e4/console.log" append="off"/>
Oct 26 00:52:41 user nova-compute[75165]:     </serial>
Oct 26 00:52:41 user nova-compute[75165]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 00:52:41 user nova-compute[75165]:     <video>
Oct 26 00:52:41 user nova-compute[75165]:       <model type="virtio"/>
Oct 26 00:52:41 user nova-compute[75165]:     </video>
Oct 26 00:52:41 user nova-compute[75165]:     <rng model="virtio">
Oct 26 00:52:41 user nova-compute[75165]:       <backend model="random">/dev/urandom</backend>
Oct 26 00:52:41 user nova-compute[75165]:     </rng>
Oct 26 00:52:41 user nova-compute[75165]:     <controller type="usb" index="0" model="none"/>
Oct 26 00:52:41 user nova-compute[75165]:     <memballoon model="virtio">
Oct 26 00:52:41 user nova-compute[75165]:       <stats period="10"/>
Oct 26 00:52:41 user nova-compute[75165]:     </memballoon>
Oct 26 00:52:41 user nova-compute[75165]:   </devices>
Oct 26 00:52:41 user nova-compute[75165]: </domain>
Oct 26 00:52:41 user nova-compute[75165]:  {{(pid=75165) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 00:52:41 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-1a7e8eca-649b-4f10-9095-165288474b9a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:52:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1122751109',display_name='tempest-TestMinimumBasicScenario-server-1122751109',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1122751109',id=51,image_ref='bc9330e4-6355-46ac-9bc2-84be0afe29c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLrwnU95bX4MXNUTHar2eaBwFFDXaAKPvDXhaGoFnu8Q3nONzRsaw3xwMy98kEX6RSU/ez5DYEE4MxheYs9fETw9ddTIa3nk6bvxzEXDsTVNDnjYLWaz4whLAgBaNRNvag==',key_name='tempest-TestMinimumBasicScenario-649507707',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f535693c3cbd4f4e969f279167ef7ba8',ramdisk_id='',reservation_id='r-y4cdz8zq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc9330e4-6355-46ac-9bc2-84be0afe29c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-387809061',owner_user_name='tempest-TestMinimumBasicScenario-387809061-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T00:52:39Z,user_data=None,user_id='d7f8020ca2184967b2a810b0e6c8d4a0',uuid=b59b5027-502d-4e4d-8f0d-8e19961ba3e4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5a3b58e2-07f1-427d-91e2-791138476ac6", "address": "fa:16:3e:73:3b:67", "network": {"id": "30343eb9-5e61-407a-8491-e58b28ff1645", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1025901471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f535693c3cbd4f4e969f279167ef7ba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a3b58e2-07", "ovs_interfaceid": "5a3b58e2-07f1-427d-91e2-791138476ac6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 00:52:41 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-1a7e8eca-649b-4f10-9095-165288474b9a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Converting VIF {"id": "5a3b58e2-07f1-427d-91e2-791138476ac6", "address": "fa:16:3e:73:3b:67", "network": {"id": "30343eb9-5e61-407a-8491-e58b28ff1645", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1025901471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f535693c3cbd4f4e969f279167ef7ba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a3b58e2-07", "ovs_interfaceid": "5a3b58e2-07f1-427d-91e2-791138476ac6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:52:41 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-1a7e8eca-649b-4f10-9095-165288474b9a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:3b:67,bridge_name='br-int',has_traffic_filtering=True,id=5a3b58e2-07f1-427d-91e2-791138476ac6,network=Network(30343eb9-5e61-407a-8491-e58b28ff1645),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a3b58e2-07') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:52:41 user nova-compute[75165]: DEBUG os_vif [None req-1a7e8eca-649b-4f10-9095-165288474b9a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:3b:67,bridge_name='br-int',has_traffic_filtering=True,id=5a3b58e2-07f1-427d-91e2-791138476ac6,network=Network(30343eb9-5e61-407a-8491-e58b28ff1645),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a3b58e2-07') {{(pid=75165) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 00:52:41 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:52:41 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:52:41 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 00:52:41 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:52:41 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '56de35cc-44c5-5c46-84f0-cdcff19779c2', '_type': 'linux-noop'}}, row=False) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:52:41 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:52:41 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:52:41 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:52:41 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5a3b58e2-07, may_exist=True, interface_attrs={}) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:52:41 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5a3b58e2-07, col_values=(('qos', UUID('e0046098-2bac-4e7c-8669-162a79c0cdb4')),), if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:52:41 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5a3b58e2-07, col_values=(('external_ids', {'iface-id': '5a3b58e2-07f1-427d-91e2-791138476ac6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:73:3b:67', 'vm-uuid': 'b59b5027-502d-4e4d-8f0d-8e19961ba3e4'}),), if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:52:41 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:52:41 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:52:41 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:52:41 user nova-compute[75165]: INFO os_vif [None req-1a7e8eca-649b-4f10-9095-165288474b9a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:3b:67,bridge_name='br-int',has_traffic_filtering=True,id=5a3b58e2-07f1-427d-91e2-791138476ac6,network=Network(30343eb9-5e61-407a-8491-e58b28ff1645),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a3b58e2-07')
Oct 26 00:52:41 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-1a7e8eca-649b-4f10-9095-165288474b9a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] No BDM found with device name vda, not building metadata. {{(pid=75165) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 00:52:41 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-1a7e8eca-649b-4f10-9095-165288474b9a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] No VIF found with MAC fa:16:3e:73:3b:67, not building metadata {{(pid=75165) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 00:52:41 user nova-compute[75165]: DEBUG nova.network.neutron [req-84e5022a-3740-4962-8f94-0eb30181ca43 req-f0aad41f-d866-4ff2-bee8-b1ab02000b88 service nova] [instance: b59b5027-502d-4e4d-8f0d-8e19961ba3e4] Updated VIF entry in instance network info cache for port 5a3b58e2-07f1-427d-91e2-791138476ac6. {{(pid=75165) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 00:52:41 user nova-compute[75165]: DEBUG nova.network.neutron [req-84e5022a-3740-4962-8f94-0eb30181ca43 req-f0aad41f-d866-4ff2-bee8-b1ab02000b88 service nova] [instance: b59b5027-502d-4e4d-8f0d-8e19961ba3e4] Updating instance_info_cache with network_info: [{"id": "5a3b58e2-07f1-427d-91e2-791138476ac6", "address": "fa:16:3e:73:3b:67", "network": {"id": "30343eb9-5e61-407a-8491-e58b28ff1645", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1025901471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f535693c3cbd4f4e969f279167ef7ba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a3b58e2-07", "ovs_interfaceid": "5a3b58e2-07f1-427d-91e2-791138476ac6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:52:41 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-84e5022a-3740-4962-8f94-0eb30181ca43 req-f0aad41f-d866-4ff2-bee8-b1ab02000b88 service nova] Releasing lock "refresh_cache-b59b5027-502d-4e4d-8f0d-8e19961ba3e4" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:52:41 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:52:42 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:52:42 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:52:42 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:52:42 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:52:42 user nova-compute[75165]: DEBUG nova.compute.manager [req-60dfeb5d-1f40-418b-bc0e-2d5a75a0dd49 req-261089f7-a788-4706-a37b-9033eeef8e17 service nova] [instance: b59b5027-502d-4e4d-8f0d-8e19961ba3e4] Received event network-vif-plugged-5a3b58e2-07f1-427d-91e2-791138476ac6 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:52:42 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-60dfeb5d-1f40-418b-bc0e-2d5a75a0dd49 req-261089f7-a788-4706-a37b-9033eeef8e17 service nova] Acquiring lock "b59b5027-502d-4e4d-8f0d-8e19961ba3e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:52:42 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-60dfeb5d-1f40-418b-bc0e-2d5a75a0dd49 req-261089f7-a788-4706-a37b-9033eeef8e17 service nova] Lock "b59b5027-502d-4e4d-8f0d-8e19961ba3e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:52:42 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-60dfeb5d-1f40-418b-bc0e-2d5a75a0dd49 req-261089f7-a788-4706-a37b-9033eeef8e17 service nova] Lock "b59b5027-502d-4e4d-8f0d-8e19961ba3e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:52:42 user nova-compute[75165]: DEBUG nova.compute.manager [req-60dfeb5d-1f40-418b-bc0e-2d5a75a0dd49 req-261089f7-a788-4706-a37b-9033eeef8e17 service nova] [instance: b59b5027-502d-4e4d-8f0d-8e19961ba3e4] No waiting events found dispatching network-vif-plugged-5a3b58e2-07f1-427d-91e2-791138476ac6 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:52:42 user nova-compute[75165]: WARNING nova.compute.manager [req-60dfeb5d-1f40-418b-bc0e-2d5a75a0dd49 req-261089f7-a788-4706-a37b-9033eeef8e17 service nova] [instance: b59b5027-502d-4e4d-8f0d-8e19961ba3e4] Received unexpected event network-vif-plugged-5a3b58e2-07f1-427d-91e2-791138476ac6 for instance with vm_state building and task_state spawning.
Oct 26 00:52:43 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:52:43 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:52:43 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:52:44 user nova-compute[75165]: DEBUG nova.compute.manager [None req-1a7e8eca-649b-4f10-9095-165288474b9a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] [instance: b59b5027-502d-4e4d-8f0d-8e19961ba3e4] Instance event wait completed in 0 seconds for  {{(pid=75165) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 00:52:44 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-1a7e8eca-649b-4f10-9095-165288474b9a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] [instance: b59b5027-502d-4e4d-8f0d-8e19961ba3e4] Guest created on hypervisor {{(pid=75165) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 00:52:44 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: b59b5027-502d-4e4d-8f0d-8e19961ba3e4] Instance spawned successfully.
Oct 26 00:52:44 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-1a7e8eca-649b-4f10-9095-165288474b9a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] [instance: b59b5027-502d-4e4d-8f0d-8e19961ba3e4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 00:52:44 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-1a7e8eca-649b-4f10-9095-165288474b9a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] [instance: b59b5027-502d-4e4d-8f0d-8e19961ba3e4] Found default for hw_cdrom_bus of ide {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:52:44 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-1a7e8eca-649b-4f10-9095-165288474b9a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] [instance: b59b5027-502d-4e4d-8f0d-8e19961ba3e4] Found default for hw_disk_bus of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:52:44 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-1a7e8eca-649b-4f10-9095-165288474b9a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] [instance: b59b5027-502d-4e4d-8f0d-8e19961ba3e4] Found default for hw_input_bus of None {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:52:44 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-1a7e8eca-649b-4f10-9095-165288474b9a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] [instance: b59b5027-502d-4e4d-8f0d-8e19961ba3e4] Found default for hw_pointer_model of None {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:52:44 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-1a7e8eca-649b-4f10-9095-165288474b9a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] [instance: b59b5027-502d-4e4d-8f0d-8e19961ba3e4] Found default for hw_video_model of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:52:44 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-1a7e8eca-649b-4f10-9095-165288474b9a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] [instance: b59b5027-502d-4e4d-8f0d-8e19961ba3e4] Found default for hw_vif_model of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:52:44 user nova-compute[75165]: INFO nova.compute.manager [None req-1a7e8eca-649b-4f10-9095-165288474b9a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] [instance: b59b5027-502d-4e4d-8f0d-8e19961ba3e4] Took 5.65 seconds to spawn the instance on the hypervisor.
Oct 26 00:52:44 user nova-compute[75165]: DEBUG nova.compute.manager [None req-1a7e8eca-649b-4f10-9095-165288474b9a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] [instance: b59b5027-502d-4e4d-8f0d-8e19961ba3e4] Checking state {{(pid=75165) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 00:52:44 user nova-compute[75165]: DEBUG nova.compute.manager [req-4f0bb0c3-bc24-45c1-954f-004a7fb6f19f req-2b838284-d717-4709-aa8b-0779c98e8c4c service nova] [instance: b59b5027-502d-4e4d-8f0d-8e19961ba3e4] Received event network-vif-plugged-5a3b58e2-07f1-427d-91e2-791138476ac6 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:52:44 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-4f0bb0c3-bc24-45c1-954f-004a7fb6f19f req-2b838284-d717-4709-aa8b-0779c98e8c4c service nova] Acquiring lock "b59b5027-502d-4e4d-8f0d-8e19961ba3e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:52:44 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-4f0bb0c3-bc24-45c1-954f-004a7fb6f19f req-2b838284-d717-4709-aa8b-0779c98e8c4c service nova] Lock "b59b5027-502d-4e4d-8f0d-8e19961ba3e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:52:44 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-4f0bb0c3-bc24-45c1-954f-004a7fb6f19f req-2b838284-d717-4709-aa8b-0779c98e8c4c service nova] Lock "b59b5027-502d-4e4d-8f0d-8e19961ba3e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:52:44 user nova-compute[75165]: DEBUG nova.compute.manager [req-4f0bb0c3-bc24-45c1-954f-004a7fb6f19f req-2b838284-d717-4709-aa8b-0779c98e8c4c service nova] [instance: b59b5027-502d-4e4d-8f0d-8e19961ba3e4] No waiting events found dispatching network-vif-plugged-5a3b58e2-07f1-427d-91e2-791138476ac6 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:52:44 user nova-compute[75165]: WARNING nova.compute.manager [req-4f0bb0c3-bc24-45c1-954f-004a7fb6f19f req-2b838284-d717-4709-aa8b-0779c98e8c4c service nova] [instance: b59b5027-502d-4e4d-8f0d-8e19961ba3e4] Received unexpected event network-vif-plugged-5a3b58e2-07f1-427d-91e2-791138476ac6 for instance with vm_state building and task_state spawning.
Oct 26 00:52:44 user nova-compute[75165]: INFO nova.compute.manager [None req-1a7e8eca-649b-4f10-9095-165288474b9a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] [instance: b59b5027-502d-4e4d-8f0d-8e19961ba3e4] Took 6.23 seconds to build instance.
Oct 26 00:52:44 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-1a7e8eca-649b-4f10-9095-165288474b9a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Lock "b59b5027-502d-4e4d-8f0d-8e19961ba3e4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.324s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:52:44 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:52:46 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:52:46 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:52:46 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Starting heal instance info cache {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 00:52:46 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Rebuilding the list of instances to heal {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 00:52:46 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "refresh_cache-08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:52:46 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquired lock "refresh_cache-08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:52:46 user nova-compute[75165]: DEBUG nova.network.neutron [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: 08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed] Forcefully refreshing network info cache for instance {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 00:52:46 user nova-compute[75165]: DEBUG nova.objects.instance [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lazy-loading 'info_cache' on Instance uuid 08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:52:47 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:52:47 user nova-compute[75165]: DEBUG nova.network.neutron [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: 08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed] Updating instance_info_cache with network_info: [{"id": "4983d9d7-3996-4f95-bc35-0ab5b325e341", "address": "fa:16:3e:fc:8d:e2", "network": {"id": "dc50ae7b-d501-461f-aa0b-542514330ae8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1091857056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1051405ca054c4bb051fb842a5fb5a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4983d9d7-39", "ovs_interfaceid": "4983d9d7-3996-4f95-bc35-0ab5b325e341", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:52:47 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Releasing lock "refresh_cache-08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:52:47 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: 08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed] Updated the network info_cache for instance {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 00:52:48 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:52:48 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:52:48 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:52:48 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:52:48 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75165) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 00:52:48 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75165) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 00:52:49 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b59b5027-502d-4e4d-8f0d-8e19961ba3e4/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:52:49 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b59b5027-502d-4e4d-8f0d-8e19961ba3e4/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:52:49 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b59b5027-502d-4e4d-8f0d-8e19961ba3e4/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:52:49 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b59b5027-502d-4e4d-8f0d-8e19961ba3e4/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:52:49 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:52:49 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:52:49 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Hypervisor/Node resource view: name=user free_ram=8921MB free_disk=24.76956558227539GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75165) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 00:52:49 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:52:49 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:52:49 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:52:49 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance b59b5027-502d-4e4d-8f0d-8e19961ba3e4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:52:49 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75165) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 00:52:49 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75165) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 00:52:49 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:52:49 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:52:50 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Compute_service record updated for user:user {{(pid=75165) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 00:52:50 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.221s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:52:51 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:52:52 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:52:56 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:53:01 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:53:02 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:53:06 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:53:07 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:53:11 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:53:12 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:53:16 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:53:16 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:53:16 user nova-compute[75165]: DEBUG nova.compute.manager [req-18b6da30-944a-4c4d-884d-dc132ac960a9 req-9b589c75-3157-4523-9e59-408c2004b55d service nova] [instance: 08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed] Received event network-changed-4983d9d7-3996-4f95-bc35-0ab5b325e341 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:53:16 user nova-compute[75165]: DEBUG nova.compute.manager [req-18b6da30-944a-4c4d-884d-dc132ac960a9 req-9b589c75-3157-4523-9e59-408c2004b55d service nova] [instance: 08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed] Refreshing instance network info cache due to event network-changed-4983d9d7-3996-4f95-bc35-0ab5b325e341. {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 00:53:16 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-18b6da30-944a-4c4d-884d-dc132ac960a9 req-9b589c75-3157-4523-9e59-408c2004b55d service nova] Acquiring lock "refresh_cache-08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:53:16 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-18b6da30-944a-4c4d-884d-dc132ac960a9 req-9b589c75-3157-4523-9e59-408c2004b55d service nova] Acquired lock "refresh_cache-08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:53:16 user nova-compute[75165]: DEBUG nova.network.neutron [req-18b6da30-944a-4c4d-884d-dc132ac960a9 req-9b589c75-3157-4523-9e59-408c2004b55d service nova] [instance: 08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed] Refreshing network info cache for port 4983d9d7-3996-4f95-bc35-0ab5b325e341 {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 00:53:16 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-e875434f-d6ff-4c14-bf72-9a1c40214425 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Acquiring lock "08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:53:16 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-e875434f-d6ff-4c14-bf72-9a1c40214425 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Lock "08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:53:16 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-e875434f-d6ff-4c14-bf72-9a1c40214425 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Acquiring lock "08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:53:16 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-e875434f-d6ff-4c14-bf72-9a1c40214425 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Lock "08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:53:16 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-e875434f-d6ff-4c14-bf72-9a1c40214425 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Lock "08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:53:16 user nova-compute[75165]: INFO nova.compute.manager [None req-e875434f-d6ff-4c14-bf72-9a1c40214425 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed] Terminating instance
Oct 26 00:53:16 user nova-compute[75165]: DEBUG nova.compute.manager [None req-e875434f-d6ff-4c14-bf72-9a1c40214425 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed] Start destroying the instance on the hypervisor. {{(pid=75165) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 00:53:16 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:53:16 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:53:16 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:53:16 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:53:16 user nova-compute[75165]: DEBUG nova.compute.manager [req-d74b8595-89b6-497e-869a-4b3d6d01da62 req-039777b4-2023-488c-aefa-b7e3357218c0 service nova] [instance: 08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed] Received event network-vif-unplugged-4983d9d7-3996-4f95-bc35-0ab5b325e341 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:53:16 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-d74b8595-89b6-497e-869a-4b3d6d01da62 req-039777b4-2023-488c-aefa-b7e3357218c0 service nova] Acquiring lock "08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:53:16 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-d74b8595-89b6-497e-869a-4b3d6d01da62 req-039777b4-2023-488c-aefa-b7e3357218c0 service nova] Lock "08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:53:16 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-d74b8595-89b6-497e-869a-4b3d6d01da62 req-039777b4-2023-488c-aefa-b7e3357218c0 service nova] Lock "08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:53:16 user nova-compute[75165]: DEBUG nova.compute.manager [req-d74b8595-89b6-497e-869a-4b3d6d01da62 req-039777b4-2023-488c-aefa-b7e3357218c0 service nova] [instance: 08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed] No waiting events found dispatching network-vif-unplugged-4983d9d7-3996-4f95-bc35-0ab5b325e341 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:53:16 user nova-compute[75165]: DEBUG nova.compute.manager [req-d74b8595-89b6-497e-869a-4b3d6d01da62 req-039777b4-2023-488c-aefa-b7e3357218c0 service nova] [instance: 08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed] Received event network-vif-unplugged-4983d9d7-3996-4f95-bc35-0ab5b325e341 for instance with task_state deleting. {{(pid=75165) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 00:53:16 user nova-compute[75165]: DEBUG nova.network.neutron [req-18b6da30-944a-4c4d-884d-dc132ac960a9 req-9b589c75-3157-4523-9e59-408c2004b55d service nova] [instance: 08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed] Updated VIF entry in instance network info cache for port 4983d9d7-3996-4f95-bc35-0ab5b325e341. {{(pid=75165) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 00:53:16 user nova-compute[75165]: DEBUG nova.network.neutron [req-18b6da30-944a-4c4d-884d-dc132ac960a9 req-9b589c75-3157-4523-9e59-408c2004b55d service nova] [instance: 08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed] Updating instance_info_cache with network_info: [{"id": "4983d9d7-3996-4f95-bc35-0ab5b325e341", "address": "fa:16:3e:fc:8d:e2", "network": {"id": "dc50ae7b-d501-461f-aa0b-542514330ae8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1091857056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1051405ca054c4bb051fb842a5fb5a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4983d9d7-39", "ovs_interfaceid": "4983d9d7-3996-4f95-bc35-0ab5b325e341", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:53:16 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-18b6da30-944a-4c4d-884d-dc132ac960a9 req-9b589c75-3157-4523-9e59-408c2004b55d service nova] Releasing lock "refresh_cache-08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:53:17 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:53:17 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: 08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed] Instance destroyed successfully.
Oct 26 00:53:17 user nova-compute[75165]: DEBUG nova.objects.instance [None req-e875434f-d6ff-4c14-bf72-9a1c40214425 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Lazy-loading 'resources' on Instance uuid 08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:53:17 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-e875434f-d6ff-4c14-bf72-9a1c40214425 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:48:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-951983608',display_name='tempest-TestVolumeBootPattern-server-951983608',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-951983608',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBChKvTLd4nhrj5htJzspkP8o+qgId41EjTR/fmBLYf3vmPpK9NBbxwvdQKkZqqXFiSi6AG6cvipLHicvfW4NLnZq3yjDwP+cF/yBIdW+iAQl3BC4GDkkyYulLa73yUYFmw==',key_name='tempest-TestVolumeBootPattern-819204347',keypairs=<?>,launch_index=0,launched_at=2023-10-26T00:48:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d1051405ca054c4bb051fb842a5fb5a0',ramdisk_id='',reservation_id='r-1e0ujb90',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1215567595',owner_user_name='tempest-TestVolumeBootPattern-1215567595-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T00:48:26Z,user_data=None,user_id='ae836eab78514cf3894e5e11240ff374',uuid=08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4983d9d7-3996-4f95-bc35-0ab5b325e341", "address": "fa:16:3e:fc:8d:e2", "network": {"id": "dc50ae7b-d501-461f-aa0b-542514330ae8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1091857056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1051405ca054c4bb051fb842a5fb5a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4983d9d7-39", "ovs_interfaceid": "4983d9d7-3996-4f95-bc35-0ab5b325e341", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 00:53:17 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-e875434f-d6ff-4c14-bf72-9a1c40214425 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Converting VIF {"id": "4983d9d7-3996-4f95-bc35-0ab5b325e341", "address": "fa:16:3e:fc:8d:e2", "network": {"id": "dc50ae7b-d501-461f-aa0b-542514330ae8", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1091857056-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1051405ca054c4bb051fb842a5fb5a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4983d9d7-39", "ovs_interfaceid": "4983d9d7-3996-4f95-bc35-0ab5b325e341", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:53:17 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-e875434f-d6ff-4c14-bf72-9a1c40214425 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fc:8d:e2,bridge_name='br-int',has_traffic_filtering=True,id=4983d9d7-3996-4f95-bc35-0ab5b325e341,network=Network(dc50ae7b-d501-461f-aa0b-542514330ae8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4983d9d7-39') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:53:17 user nova-compute[75165]: DEBUG os_vif [None req-e875434f-d6ff-4c14-bf72-9a1c40214425 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fc:8d:e2,bridge_name='br-int',has_traffic_filtering=True,id=4983d9d7-3996-4f95-bc35-0ab5b325e341,network=Network(dc50ae7b-d501-461f-aa0b-542514330ae8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4983d9d7-39') {{(pid=75165) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 00:53:17 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:53:17 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4983d9d7-39, bridge=br-int, if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:53:17 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:53:17 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:53:17 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:53:17 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=384c7f2e-5484-490b-a26c-c13d285c6c3a) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:53:17 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:53:17 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:53:17 user nova-compute[75165]: INFO os_vif [None req-e875434f-d6ff-4c14-bf72-9a1c40214425 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fc:8d:e2,bridge_name='br-int',has_traffic_filtering=True,id=4983d9d7-3996-4f95-bc35-0ab5b325e341,network=Network(dc50ae7b-d501-461f-aa0b-542514330ae8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4983d9d7-39')
Oct 26 00:53:17 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e875434f-d6ff-4c14-bf72-9a1c40214425 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed] calling os-brick to detach iSCSI Volume {{(pid=75165) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 00:53:17 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e875434f-d6ff-4c14-bf72-9a1c40214425 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8bf8160e50>, {'target_iqn': 'iqn.2010-10.org.openstack:28483cbc-41a9-4961-9c30-fae820d1ad43', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RmaYIrVs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:53:17 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-e875434f-d6ff-4c14-bf72-9a1c40214425 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:53:17 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-e875434f-d6ff-4c14-bf72-9a1c40214425 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:53:17 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-e875434f-d6ff-4c14-bf72-9a1c40214425 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:53:17 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:53:17 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:53:17 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f8ef207-b3e4-480d-b4e3-5d6187b666ea]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:28483cbc-41a9-4961-9c30-fae820d1ad43\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:53:17 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e875434f-d6ff-4c14-bf72-9a1c40214425 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 00:53:17 user nova-compute[75165]: No targets found.
Oct 26 00:53:17 user nova-compute[75165]: iSNS:
Oct 26 00:53:17 user nova-compute[75165]: No targets found.
Oct 26 00:53:17 user nova-compute[75165]: STATIC:
Oct 26 00:53:17 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:28483cbc-41a9-4961-9c30-fae820d1ad43
Oct 26 00:53:17 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:53:17 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:53:17 user nova-compute[75165]: FIRMWARE:
Oct 26 00:53:17 user nova-compute[75165]: No targets found.
Oct 26 00:53:17 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:53:17 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e875434f-d6ff-4c14-bf72-9a1c40214425 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 00:53:17 user nova-compute[75165]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 00:53:17 user nova-compute[75165]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75165) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 00:53:17 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e875434f-d6ff-4c14-bf72-9a1c40214425 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:28483cbc-41a9-4961-9c30-fae820d1ad43', 0)] {{(pid=75165) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 00:53:17 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:53:17 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:53:17 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fc57891-dc54-46ce-b83f-45376f5c4725]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:28483cbc-41a9-4961-9c30-fae820d1ad43\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:53:17 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:53:17 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:53:17 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[104f56be-28f2-445b-a97d-6ee9221322b8]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28483cbc-41a9-4961-9c30-fae820d1ad43 (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:53:17 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e875434f-d6ff-4c14-bf72-9a1c40214425 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28483cbc-41a9-4961-9c30-fae820d1ad43 (non-flash)
Oct 26 00:53:17 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:53:17 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e875434f-d6ff-4c14-bf72-9a1c40214425 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28483cbc-41a9-4961-9c30-fae820d1ad43 (non-flash)
Oct 26 00:53:17 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:53:17 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e875434f-d6ff-4c14-bf72-9a1c40214425 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8be04e4940>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:28483cbc-41a9-4961-9c30-fae820d1ad43'): ({'sdb'}, set())}) {{(pid=75165) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 00:53:17 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-e875434f-d6ff-4c14-bf72-9a1c40214425 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Removing single pathed devices sdb {{(pid=75165) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 00:53:17 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:53:17 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:53:17 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bfe9985-afe1-4eb5-9310-59069c48e25d]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:53:17 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:53:17 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:53:17 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[48bc7eba-098e-4197-948a-6fabb7f37a98]: (4, ('ok\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:53:17 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-e875434f-d6ff-4c14-bf72-9a1c40214425 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Flushing IO for device /dev/sdb {{(pid=75165) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 00:53:17 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:53:17 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:53:17 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[259d3b4b-1a0b-4a0f-a088-d7a4e0a5b965]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:53:17 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-e875434f-d6ff-4c14-bf72-9a1c40214425 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75165) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 00:53:17 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:53:17 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:53:17 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a18153c-9dd2-4265-a418-95f467d14015]: (4, ('1', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:53:17 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-e875434f-d6ff-4c14-bf72-9a1c40214425 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75165) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 00:53:17 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-e875434f-d6ff-4c14-bf72-9a1c40214425 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] SCSI volumes sdb have been removed. {{(pid=75165) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 00:53:17 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e875434f-d6ff-4c14-bf72-9a1c40214425 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:28483cbc-41a9-4961-9c30-fae820d1ad43')] {{(pid=75165) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 00:53:17 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28483cbc-41a9-4961-9c30-fae820d1ad43 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:53:17 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28483cbc-41a9-4961-9c30-fae820d1ad43 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:53:17 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[a49c17d3-8383-41f6-b02f-27977e6eb8c9]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:53:17 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e875434f-d6ff-4c14-bf72-9a1c40214425 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:53:17 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28483cbc-41a9-4961-9c30-fae820d1ad43 -p 172.16.0.220:3260 --logout {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:53:17 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28483cbc-41a9-4961-9c30-fae820d1ad43 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:53:17 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bdf84c2-82b4-49c2-96c9-bf2b97bc7bf1]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:28483cbc-41a9-4961-9c30-fae820d1ad43, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:28483cbc-41a9-4961-9c30-fae820d1ad43, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:53:17 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e875434f-d6ff-4c14-bf72-9a1c40214425 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:28483cbc-41a9-4961-9c30-fae820d1ad43, portal: 172.16.0.220,3260]
Oct 26 00:53:17 user nova-compute[75165]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:28483cbc-41a9-4961-9c30-fae820d1ad43, portal: 172.16.0.220,3260] successful.
Oct 26 00:53:17 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:53:17 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28483cbc-41a9-4961-9c30-fae820d1ad43 -p 172.16.0.220:3260 --op delete {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:53:17 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28483cbc-41a9-4961-9c30-fae820d1ad43 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:53:17 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[72d72418-c081-4d6c-9521-362f03a64b0a]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:53:17 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e875434f-d6ff-4c14-bf72-9a1c40214425 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:53:17 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-e875434f-d6ff-4c14-bf72-9a1c40214425 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.293s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:53:17 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-e875434f-d6ff-4c14-bf72-9a1c40214425 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] <== disconnect_volume: return (294ms) None {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:53:17 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e875434f-d6ff-4c14-bf72-9a1c40214425 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed] Disconnected iSCSI Volume {{(pid=75165) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 00:53:17 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-e875434f-d6ff-4c14-bf72-9a1c40214425 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed] Deleting instance files /opt/stack/data/nova/instances/08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed_del
Oct 26 00:53:17 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-e875434f-d6ff-4c14-bf72-9a1c40214425 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed] Deletion of /opt/stack/data/nova/instances/08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed_del complete
Oct 26 00:53:17 user nova-compute[75165]: INFO nova.compute.manager [None req-e875434f-d6ff-4c14-bf72-9a1c40214425 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed] Took 1.20 seconds to destroy the instance on the hypervisor.
Oct 26 00:53:17 user nova-compute[75165]: DEBUG oslo.service.loopingcall [None req-e875434f-d6ff-4c14-bf72-9a1c40214425 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75165) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 00:53:17 user nova-compute[75165]: DEBUG nova.compute.manager [-] [instance: 08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed] Deallocating network for instance {{(pid=75165) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 00:53:17 user nova-compute[75165]: DEBUG nova.network.neutron [-] [instance: 08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed] deallocate_for_instance() {{(pid=75165) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 00:53:18 user nova-compute[75165]: DEBUG nova.network.neutron [-] [instance: 08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed] Updating instance_info_cache with network_info: [] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:53:18 user nova-compute[75165]: INFO nova.compute.manager [-] [instance: 08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed] Took 0.83 seconds to deallocate network for instance.
Oct 26 00:53:18 user nova-compute[75165]: DEBUG nova.compute.manager [req-527d3cb3-356b-45dd-a965-3394bfe9d92f req-ff70e44d-9612-4cc3-a78f-33e32a18db76 service nova] [instance: 08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed] Received event network-vif-deleted-4983d9d7-3996-4f95-bc35-0ab5b325e341 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:53:18 user nova-compute[75165]: INFO nova.compute.manager [req-527d3cb3-356b-45dd-a965-3394bfe9d92f req-ff70e44d-9612-4cc3-a78f-33e32a18db76 service nova] [instance: 08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed] Neutron deleted interface 4983d9d7-3996-4f95-bc35-0ab5b325e341; detaching it from the instance and deleting it from the info cache
Oct 26 00:53:18 user nova-compute[75165]: DEBUG nova.network.neutron [req-527d3cb3-356b-45dd-a965-3394bfe9d92f req-ff70e44d-9612-4cc3-a78f-33e32a18db76 service nova] [instance: 08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed] Updating instance_info_cache with network_info: [] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:53:18 user nova-compute[75165]: DEBUG nova.compute.manager [req-527d3cb3-356b-45dd-a965-3394bfe9d92f req-ff70e44d-9612-4cc3-a78f-33e32a18db76 service nova] [instance: 08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed] Detach interface failed, port_id=4983d9d7-3996-4f95-bc35-0ab5b325e341, reason: Instance 08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed could not be found. {{(pid=75165) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 26 00:53:18 user nova-compute[75165]: DEBUG nova.compute.manager [req-d4f6bf57-8085-4b5e-ac98-2c89cdecfd5b req-1346e266-fd28-4f06-93a9-8a3a3e2356b7 service nova] [instance: 08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed] Received event network-vif-plugged-4983d9d7-3996-4f95-bc35-0ab5b325e341 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:53:18 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-d4f6bf57-8085-4b5e-ac98-2c89cdecfd5b req-1346e266-fd28-4f06-93a9-8a3a3e2356b7 service nova] Acquiring lock "08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:53:18 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-d4f6bf57-8085-4b5e-ac98-2c89cdecfd5b req-1346e266-fd28-4f06-93a9-8a3a3e2356b7 service nova] Lock "08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:53:18 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-d4f6bf57-8085-4b5e-ac98-2c89cdecfd5b req-1346e266-fd28-4f06-93a9-8a3a3e2356b7 service nova] Lock "08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:53:18 user nova-compute[75165]: DEBUG nova.compute.manager [req-d4f6bf57-8085-4b5e-ac98-2c89cdecfd5b req-1346e266-fd28-4f06-93a9-8a3a3e2356b7 service nova] [instance: 08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed] No waiting events found dispatching network-vif-plugged-4983d9d7-3996-4f95-bc35-0ab5b325e341 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:53:18 user nova-compute[75165]: WARNING nova.compute.manager [req-d4f6bf57-8085-4b5e-ac98-2c89cdecfd5b req-1346e266-fd28-4f06-93a9-8a3a3e2356b7 service nova] [instance: 08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed] Received unexpected event network-vif-plugged-4983d9d7-3996-4f95-bc35-0ab5b325e341 for instance with vm_state active and task_state deleting.
Oct 26 00:53:19 user nova-compute[75165]: INFO nova.compute.manager [None req-e875434f-d6ff-4c14-bf72-9a1c40214425 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] [instance: 08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed] Took 0.87 seconds to detach 1 volumes for instance.
Oct 26 00:53:19 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-e875434f-d6ff-4c14-bf72-9a1c40214425 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:53:19 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-e875434f-d6ff-4c14-bf72-9a1c40214425 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:53:19 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-e875434f-d6ff-4c14-bf72-9a1c40214425 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:53:19 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-e875434f-d6ff-4c14-bf72-9a1c40214425 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:53:19 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-e875434f-d6ff-4c14-bf72-9a1c40214425 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.136s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:53:19 user nova-compute[75165]: INFO nova.scheduler.client.report [None req-e875434f-d6ff-4c14-bf72-9a1c40214425 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Deleted allocations for instance 08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed
Oct 26 00:53:19 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-e875434f-d6ff-4c14-bf72-9a1c40214425 tempest-TestVolumeBootPattern-1215567595 tempest-TestVolumeBootPattern-1215567595-project-member] Lock "08b2bb2b-bc91-4f2f-9ab6-5d64bd6fe0ed" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.281s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:53:22 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:53:27 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:53:27 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:53:27 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75165) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 00:53:27 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75165) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 00:53:27 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75165) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 00:53:27 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:53:32 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:53:34 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:53:34 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75165) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 00:53:37 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:53:37 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:53:38 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:53:40 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:53:41 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:53:42 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:53:42 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:53:43 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:53:45 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:53:46 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:53:47 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:53:48 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:53:48 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Starting heal instance info cache {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 00:53:49 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "refresh_cache-b59b5027-502d-4e4d-8f0d-8e19961ba3e4" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:53:49 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquired lock "refresh_cache-b59b5027-502d-4e4d-8f0d-8e19961ba3e4" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:53:49 user nova-compute[75165]: DEBUG nova.network.neutron [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: b59b5027-502d-4e4d-8f0d-8e19961ba3e4] Forcefully refreshing network info cache for instance {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 00:53:49 user nova-compute[75165]: DEBUG nova.network.neutron [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: b59b5027-502d-4e4d-8f0d-8e19961ba3e4] Updating instance_info_cache with network_info: [{"id": "5a3b58e2-07f1-427d-91e2-791138476ac6", "address": "fa:16:3e:73:3b:67", "network": {"id": "30343eb9-5e61-407a-8491-e58b28ff1645", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1025901471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f535693c3cbd4f4e969f279167ef7ba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a3b58e2-07", "ovs_interfaceid": "5a3b58e2-07f1-427d-91e2-791138476ac6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:53:49 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Releasing lock "refresh_cache-b59b5027-502d-4e4d-8f0d-8e19961ba3e4" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:53:49 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: b59b5027-502d-4e4d-8f0d-8e19961ba3e4] Updated the network info_cache for instance {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 00:53:49 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:53:49 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:53:49 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:53:49 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:53:49 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75165) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 00:53:49 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b59b5027-502d-4e4d-8f0d-8e19961ba3e4/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:53:50 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b59b5027-502d-4e4d-8f0d-8e19961ba3e4/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:53:50 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b59b5027-502d-4e4d-8f0d-8e19961ba3e4/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:53:50 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b59b5027-502d-4e4d-8f0d-8e19961ba3e4/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:53:50 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:53:50 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:53:50 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Hypervisor/Node resource view: name=user free_ram=8967MB free_disk=24.732948303222656GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75165) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 00:53:50 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:53:50 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:53:51 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance b59b5027-502d-4e4d-8f0d-8e19961ba3e4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:53:51 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75165) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 00:53:51 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75165) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 00:53:51 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Refreshing inventories for resource provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 26 00:53:51 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Updating ProviderTree inventory for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 26 00:53:51 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Updating inventory in ProviderTree for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 26 00:53:51 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Refreshing aggregate associations for resource provider 03214fd5-21d1-46ec-b6b0-6449b77ba230, aggregates: None {{(pid=75165) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 26 00:53:51 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Refreshing trait associations for resource provider 03214fd5-21d1-46ec-b6b0-6449b77ba230, traits: COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NODE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_TRUSTED_CERTS,COMPUTE_DEVICE_TAGGING,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO {{(pid=75165) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 26 00:53:51 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:53:51 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:53:51 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Compute_service record updated for user:user {{(pid=75165) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 00:53:51 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.503s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:53:52 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:53:57 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:53:58 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:53:58 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75165) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 26 00:54:02 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:54:07 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:54:07 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:54:12 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:54:13 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:54:13 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Cleaning up deleted instances {{(pid=75165) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 26 00:54:13 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] There are 0 instances to clean {{(pid=75165) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 26 00:54:17 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:54:17 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:54:17 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75165) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 00:54:17 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75165) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 00:54:17 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75165) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 00:54:17 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:54:22 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:54:22 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:54:22 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75165) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 00:54:22 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75165) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 00:54:22 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75165) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 00:54:22 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:54:27 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:54:29 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:54:30 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:54:30 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Triggering sync for uuid b59b5027-502d-4e4d-8f0d-8e19961ba3e4 {{(pid=75165) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 00:54:30 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "b59b5027-502d-4e4d-8f0d-8e19961ba3e4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:54:30 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "b59b5027-502d-4e4d-8f0d-8e19961ba3e4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:54:30 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "b59b5027-502d-4e4d-8f0d-8e19961ba3e4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.025s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:54:32 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:54:32 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:54:33 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:54:33 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75165) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 00:54:34 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-68ef3d82-e9d1-4f79-b8f3-463e168709f7 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Acquiring lock "b59b5027-502d-4e4d-8f0d-8e19961ba3e4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:54:34 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-68ef3d82-e9d1-4f79-b8f3-463e168709f7 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Lock "b59b5027-502d-4e4d-8f0d-8e19961ba3e4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:54:34 user nova-compute[75165]: DEBUG nova.objects.instance [None req-68ef3d82-e9d1-4f79-b8f3-463e168709f7 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Lazy-loading 'flavor' on Instance uuid b59b5027-502d-4e4d-8f0d-8e19961ba3e4 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:54:34 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-68ef3d82-e9d1-4f79-b8f3-463e168709f7 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Lock "b59b5027-502d-4e4d-8f0d-8e19961ba3e4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:54:34 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-68ef3d82-e9d1-4f79-b8f3-463e168709f7 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Acquiring lock "b59b5027-502d-4e4d-8f0d-8e19961ba3e4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:54:34 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-68ef3d82-e9d1-4f79-b8f3-463e168709f7 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Lock "b59b5027-502d-4e4d-8f0d-8e19961ba3e4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:54:34 user nova-compute[75165]: INFO nova.compute.manager [None req-68ef3d82-e9d1-4f79-b8f3-463e168709f7 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] [instance: b59b5027-502d-4e4d-8f0d-8e19961ba3e4] Attaching volume f30b1013-6007-485f-bc23-1e0362241d38 to /dev/vdb
Oct 26 00:54:34 user nova-compute[75165]: DEBUG os_brick.utils [None req-68ef3d82-e9d1-4f79-b8f3-463e168709f7 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:54:34 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:54:34 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:54:34 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ab6971e-afbf-42ee-9ac6-5cbae254e363]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa94814ccb35\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:54:34 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:54:34 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:54:34 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[e01f8952-5750-441d-9b12-46cb568e13b5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:54:34 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:54:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:54:35 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbb5ec33-61b1-4695-a635-6e50bbdeaf5d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:54:35 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e5b7b2a-83a6-431f-bc95-9b72d7147e01]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:54:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-68ef3d82-e9d1-4f79-b8f3-463e168709f7 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Running cmd (subprocess): nvme version {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:54:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-68ef3d82-e9d1-4f79-b8f3-463e168709f7 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] 'nvme version' failed. Not Retrying. {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 00:54:35 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.nvmeof [None req-68ef3d82-e9d1-4f79-b8f3-463e168709f7 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] nvme not present on system {{(pid=75165) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 00:54:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:54:35 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 00:54:35 user nova-compute[75165]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 00:54:35 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[b527f665-6775-49e5-bfbb-5603041b6b28]: (4, '') {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:54:35 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-68ef3d82-e9d1-4f79-b8f3-463e168709f7 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75165) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 00:54:35 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-68ef3d82-e9d1-4f79-b8f3-463e168709f7 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75165) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 00:54:35 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-68ef3d82-e9d1-4f79-b8f3-463e168709f7 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] LIGHTOS: no hostnqn found. {{(pid=75165) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 00:54:35 user nova-compute[75165]: DEBUG os_brick.utils [None req-68ef3d82-e9d1-4f79-b8f3-463e168709f7 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa94814ccb35', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:54:35 user nova-compute[75165]: DEBUG nova.virt.block_device [None req-68ef3d82-e9d1-4f79-b8f3-463e168709f7 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] [instance: b59b5027-502d-4e4d-8f0d-8e19961ba3e4] Updating existing volume attachment record: 6aa70aaf-1b84-4480-b762-bfe1f02e49bb {{(pid=75165) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 00:54:37 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:54:39 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:54:40 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:54:42 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:54:42 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:54:42 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75165) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 00:54:42 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75165) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 00:54:42 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:54:42 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75165) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 00:54:42 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:54:43 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:54:44 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:54:47 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:54:47 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:54:49 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:54:49 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:54:49 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:54:49 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:54:49 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75165) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 00:54:49 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b59b5027-502d-4e4d-8f0d-8e19961ba3e4/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:54:50 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b59b5027-502d-4e4d-8f0d-8e19961ba3e4/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:54:50 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b59b5027-502d-4e4d-8f0d-8e19961ba3e4/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:54:50 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b59b5027-502d-4e4d-8f0d-8e19961ba3e4/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:54:50 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:54:50 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:54:50 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Hypervisor/Node resource view: name=user free_ram=9044MB free_disk=24.73131561279297GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75165) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 00:54:50 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:54:50 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:54:50 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance b59b5027-502d-4e4d-8f0d-8e19961ba3e4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:54:50 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75165) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 00:54:50 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75165) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 00:54:50 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:54:50 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:54:50 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Compute_service record updated for user:user {{(pid=75165) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 00:54:50 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.169s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:54:51 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68ef3d82-e9d1-4f79-b8f3-463e168709f7 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] [instance: b59b5027-502d-4e4d-8f0d-8e19961ba3e4] Calling os-brick to attach iSCSI Volume {{(pid=75165) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 00:54:51 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-68ef3d82-e9d1-4f79-b8f3-463e168709f7 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8bf8160e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f30b1013-6007-485f-bc23-1e0362241d38', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xObhESdr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:54:51 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-68ef3d82-e9d1-4f79-b8f3-463e168709f7 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:54:51 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-68ef3d82-e9d1-4f79-b8f3-463e168709f7 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:54:51 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-68ef3d82-e9d1-4f79-b8f3-463e168709f7 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:54:51 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-68ef3d82-e9d1-4f79-b8f3-463e168709f7 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:54:51 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-68ef3d82-e9d1-4f79-b8f3-463e168709f7 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f30b1013-6007-485f-bc23-1e0362241d38" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:54:51 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-68ef3d82-e9d1-4f79-b8f3-463e168709f7 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f30b1013-6007-485f-bc23-1e0362241d38" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:54:51 user nova-compute[75165]: INFO os_brick.initiator.connectors.iscsi [None req-68ef3d82-e9d1-4f79-b8f3-463e168709f7 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 00:54:51 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f30b1013-6007-485f-bc23-1e0362241d38 -p 172.16.0.220:3260 {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:54:51 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f30b1013-6007-485f-bc23-1e0362241d38 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:54:51 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[957eed88-378e-4f1d-8fa6-610831762d6a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:54:51 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-68ef3d82-e9d1-4f79-b8f3-463e168709f7 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 00:54:51 user nova-compute[75165]:  {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:54:51 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f30b1013-6007-485f-bc23-1e0362241d38 -p 172.16.0.220:3260 --interface default --op new {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:54:51 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f30b1013-6007-485f-bc23-1e0362241d38 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:54:51 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[17c6e2ce-05af-4120-90ab-c1b96f6a6f40]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f30b1013-6007-485f-bc23-1e0362241d38] added\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:54:51 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-68ef3d82-e9d1-4f79-b8f3-463e168709f7 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f30b1013-6007-485f-bc23-1e0362241d38] added
Oct 26 00:54:51 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:54:51 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f30b1013-6007-485f-bc23-1e0362241d38 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:54:51 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f30b1013-6007-485f-bc23-1e0362241d38 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:54:51 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[33deb007-2756-4b71-88b1-05e3bfb38971]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:54:51 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-68ef3d82-e9d1-4f79-b8f3-463e168709f7 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:54:51 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f30b1013-6007-485f-bc23-1e0362241d38 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:54:51 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f30b1013-6007-485f-bc23-1e0362241d38 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:54:51 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d3f327f-5087-49ce-99a8-0fd087d925a7]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:54:51 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-68ef3d82-e9d1-4f79-b8f3-463e168709f7 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:54:51 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f30b1013-6007-485f-bc23-1e0362241d38 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xObhESdr {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:54:51 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f30b1013-6007-485f-bc23-1e0362241d38 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xObhESdr" returned: 0 in 0.027s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:54:51 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[97f9c136-36d0-46b4-893a-0b9a56b29a4c]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:54:51 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-68ef3d82-e9d1-4f79-b8f3-463e168709f7 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xObhESdr'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:54:51 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f30b1013-6007-485f-bc23-1e0362241d38 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:54:51 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f30b1013-6007-485f-bc23-1e0362241d38 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:54:51 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff7aba7d-2641-44f3-b3c5-11584d6f4df7]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:54:51 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-68ef3d82-e9d1-4f79-b8f3-463e168709f7 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:54:51 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:54:51 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:54:51 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ba44a60-b4c3-4420-9fc2-954bfa67a1c3]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:54:51 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-68ef3d82-e9d1-4f79-b8f3-463e168709f7 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 26 00:54:51 user nova-compute[75165]:  {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:54:51 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-68ef3d82-e9d1-4f79-b8f3-463e168709f7 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 26 00:54:51 user nova-compute[75165]:  {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:54:51 user nova-compute[75165]: WARNING os_brick.initiator.connectors.iscsi [None req-68ef3d82-e9d1-4f79-b8f3-463e168709f7 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 26 00:54:51 user nova-compute[75165]: 
Oct 26 00:54:51 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f30b1013-6007-485f-bc23-1e0362241d38 -p 172.16.0.220:3260 --login {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:54:51 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:54:51 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Starting heal instance info cache {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 00:54:51 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Rebuilding the list of instances to heal {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 00:54:51 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f30b1013-6007-485f-bc23-1e0362241d38 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:54:51 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8e890b8-2a23-4a9a-bce1-d1bf39edbd57]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f30b1013-6007-485f-bc23-1e0362241d38, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f30b1013-6007-485f-bc23-1e0362241d38, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:54:51 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-68ef3d82-e9d1-4f79-b8f3-463e168709f7 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f30b1013-6007-485f-bc23-1e0362241d38, portal: 172.16.0.220,3260]
Oct 26 00:54:51 user nova-compute[75165]: Login to [iface: default, target: iqn.2010-10.org.openstack:f30b1013-6007-485f-bc23-1e0362241d38, portal: 172.16.0.220,3260] successful.
Oct 26 00:54:51 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:54:51 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f30b1013-6007-485f-bc23-1e0362241d38 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:54:51 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f30b1013-6007-485f-bc23-1e0362241d38 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:54:51 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c1c5aac-e02e-431b-beff-b46dde4328d0]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:54:51 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-68ef3d82-e9d1-4f79-b8f3-463e168709f7 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:54:51 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:54:51 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:54:51 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[4de12ea5-b035-4917-b0be-28ce17e4077a]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f30b1013-6007-485f-bc23-1e0362241d38 (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:54:51 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-68ef3d82-e9d1-4f79-b8f3-463e168709f7 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f30b1013-6007-485f-bc23-1e0362241d38 (non-flash)
Oct 26 00:54:51 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:54:51 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-68ef3d82-e9d1-4f79-b8f3-463e168709f7 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f30b1013-6007-485f-bc23-1e0362241d38 (non-flash)
Oct 26 00:54:51 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:54:51 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-68ef3d82-e9d1-4f79-b8f3-463e168709f7 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f30b1013-6007-485f-bc23-1e0362241d38" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.276s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:54:51 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-68ef3d82-e9d1-4f79-b8f3-463e168709f7 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Connected to 172.16.0.220:3260 {{(pid=75165) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 00:54:51 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-68ef3d82-e9d1-4f79-b8f3-463e168709f7 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] HCTL ('33', '-', '-', 0) found on session 57 with lun 0 {{(pid=75165) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 00:54:51 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-68ef3d82-e9d1-4f79-b8f3-463e168709f7 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75165) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 00:54:51 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:54:51 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:54:51 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[b59507a0-212a-43cb-905f-a6a9a62528a8]: (4, ('- - 0', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:54:51 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-68ef3d82-e9d1-4f79-b8f3-463e168709f7 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: None {{(pid=75165) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 00:54:52 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "refresh_cache-b59b5027-502d-4e4d-8f0d-8e19961ba3e4" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:54:52 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquired lock "refresh_cache-b59b5027-502d-4e4d-8f0d-8e19961ba3e4" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:54:52 user nova-compute[75165]: DEBUG nova.network.neutron [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: b59b5027-502d-4e4d-8f0d-8e19961ba3e4] Forcefully refreshing network info cache for instance {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 00:54:52 user nova-compute[75165]: DEBUG nova.objects.instance [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lazy-loading 'info_cache' on Instance uuid b59b5027-502d-4e4d-8f0d-8e19961ba3e4 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:54:52 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:54:52 user nova-compute[75165]: DEBUG nova.network.neutron [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: b59b5027-502d-4e4d-8f0d-8e19961ba3e4] Updating instance_info_cache with network_info: [{"id": "5a3b58e2-07f1-427d-91e2-791138476ac6", "address": "fa:16:3e:73:3b:67", "network": {"id": "30343eb9-5e61-407a-8491-e58b28ff1645", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1025901471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f535693c3cbd4f4e969f279167ef7ba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a3b58e2-07", "ovs_interfaceid": "5a3b58e2-07f1-427d-91e2-791138476ac6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:54:52 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Releasing lock "refresh_cache-b59b5027-502d-4e4d-8f0d-8e19961ba3e4" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:54:52 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: b59b5027-502d-4e4d-8f0d-8e19961ba3e4] Updated the network info_cache for instance {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 00:54:52 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-68ef3d82-e9d1-4f79-b8f3-463e168709f7 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75165) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 00:54:52 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-68ef3d82-e9d1-4f79-b8f3-463e168709f7 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:f30b1013-6007-485f-bc23-1e0362241d38', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xObhESdr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75165) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 00:54:52 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-68ef3d82-e9d1-4f79-b8f3-463e168709f7 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.310s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:54:52 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-68ef3d82-e9d1-4f79-b8f3-463e168709f7 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] <== connect_volume: return (1311ms) {'type': 'block', 'scsi_wwn': '26462313731646663', 'path': '/dev/sdb'} {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:54:52 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68ef3d82-e9d1-4f79-b8f3-463e168709f7 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] [instance: b59b5027-502d-4e4d-8f0d-8e19961ba3e4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26462313731646663', 'path': '/dev/sdb'} {{(pid=75165) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 00:54:52 user nova-compute[75165]: DEBUG nova.objects.instance [None req-68ef3d82-e9d1-4f79-b8f3-463e168709f7 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Lazy-loading 'flavor' on Instance uuid b59b5027-502d-4e4d-8f0d-8e19961ba3e4 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:54:52 user nova-compute[75165]: DEBUG nova.virt.libvirt.guest [None req-68ef3d82-e9d1-4f79-b8f3-463e168709f7 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 00:54:52 user nova-compute[75165]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 00:54:52 user nova-compute[75165]:   <source dev="/dev/sdb"/>
Oct 26 00:54:52 user nova-compute[75165]:   <target dev="vdb" bus="virtio"/>
Oct 26 00:54:52 user nova-compute[75165]:   <serial>f30b1013-6007-485f-bc23-1e0362241d38</serial>
Oct 26 00:54:52 user nova-compute[75165]: </disk>
Oct 26 00:54:52 user nova-compute[75165]:  {{(pid=75165) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 00:54:53 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-68ef3d82-e9d1-4f79-b8f3-463e168709f7 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] No BDM found with device name vda, not building metadata. {{(pid=75165) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 00:54:53 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-68ef3d82-e9d1-4f79-b8f3-463e168709f7 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75165) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 00:54:53 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-68ef3d82-e9d1-4f79-b8f3-463e168709f7 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] No VIF found with MAC fa:16:3e:73:3b:67, not building metadata {{(pid=75165) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 00:54:53 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-68ef3d82-e9d1-4f79-b8f3-463e168709f7 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Lock "b59b5027-502d-4e4d-8f0d-8e19961ba3e4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.742s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:54:57 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:55:02 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:55:06 user nova-compute[75165]: DEBUG nova.compute.manager [req-3fc62295-f2c3-4ab1-b8e4-82931ad058d1 req-4ece8195-5bd7-420d-9d0f-561e68b7f560 service nova] [instance: b59b5027-502d-4e4d-8f0d-8e19961ba3e4] Received event network-changed-5a3b58e2-07f1-427d-91e2-791138476ac6 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:55:06 user nova-compute[75165]: DEBUG nova.compute.manager [req-3fc62295-f2c3-4ab1-b8e4-82931ad058d1 req-4ece8195-5bd7-420d-9d0f-561e68b7f560 service nova] [instance: b59b5027-502d-4e4d-8f0d-8e19961ba3e4] Refreshing instance network info cache due to event network-changed-5a3b58e2-07f1-427d-91e2-791138476ac6. {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 00:55:06 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-3fc62295-f2c3-4ab1-b8e4-82931ad058d1 req-4ece8195-5bd7-420d-9d0f-561e68b7f560 service nova] Acquiring lock "refresh_cache-b59b5027-502d-4e4d-8f0d-8e19961ba3e4" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:55:06 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-3fc62295-f2c3-4ab1-b8e4-82931ad058d1 req-4ece8195-5bd7-420d-9d0f-561e68b7f560 service nova] Acquired lock "refresh_cache-b59b5027-502d-4e4d-8f0d-8e19961ba3e4" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:55:06 user nova-compute[75165]: DEBUG nova.network.neutron [req-3fc62295-f2c3-4ab1-b8e4-82931ad058d1 req-4ece8195-5bd7-420d-9d0f-561e68b7f560 service nova] [instance: b59b5027-502d-4e4d-8f0d-8e19961ba3e4] Refreshing network info cache for port 5a3b58e2-07f1-427d-91e2-791138476ac6 {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 00:55:07 user nova-compute[75165]: DEBUG nova.network.neutron [req-3fc62295-f2c3-4ab1-b8e4-82931ad058d1 req-4ece8195-5bd7-420d-9d0f-561e68b7f560 service nova] [instance: b59b5027-502d-4e4d-8f0d-8e19961ba3e4] Updated VIF entry in instance network info cache for port 5a3b58e2-07f1-427d-91e2-791138476ac6. {{(pid=75165) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 00:55:07 user nova-compute[75165]: DEBUG nova.network.neutron [req-3fc62295-f2c3-4ab1-b8e4-82931ad058d1 req-4ece8195-5bd7-420d-9d0f-561e68b7f560 service nova] [instance: b59b5027-502d-4e4d-8f0d-8e19961ba3e4] Updating instance_info_cache with network_info: [{"id": "5a3b58e2-07f1-427d-91e2-791138476ac6", "address": "fa:16:3e:73:3b:67", "network": {"id": "30343eb9-5e61-407a-8491-e58b28ff1645", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1025901471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f535693c3cbd4f4e969f279167ef7ba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a3b58e2-07", "ovs_interfaceid": "5a3b58e2-07f1-427d-91e2-791138476ac6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:55:07 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-3fc62295-f2c3-4ab1-b8e4-82931ad058d1 req-4ece8195-5bd7-420d-9d0f-561e68b7f560 service nova] Releasing lock "refresh_cache-b59b5027-502d-4e4d-8f0d-8e19961ba3e4" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:55:07 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:55:07 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:55:07 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:55:09 user nova-compute[75165]: DEBUG nova.compute.manager [req-605d43f0-eae6-48e2-9e1f-9cfb169d035e req-738bdea7-a671-4d8a-a324-97c0792ce060 service nova] [instance: b59b5027-502d-4e4d-8f0d-8e19961ba3e4] Received event network-changed-5a3b58e2-07f1-427d-91e2-791138476ac6 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:55:09 user nova-compute[75165]: DEBUG nova.compute.manager [req-605d43f0-eae6-48e2-9e1f-9cfb169d035e req-738bdea7-a671-4d8a-a324-97c0792ce060 service nova] [instance: b59b5027-502d-4e4d-8f0d-8e19961ba3e4] Refreshing instance network info cache due to event network-changed-5a3b58e2-07f1-427d-91e2-791138476ac6. {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 00:55:09 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-605d43f0-eae6-48e2-9e1f-9cfb169d035e req-738bdea7-a671-4d8a-a324-97c0792ce060 service nova] Acquiring lock "refresh_cache-b59b5027-502d-4e4d-8f0d-8e19961ba3e4" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:55:09 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-605d43f0-eae6-48e2-9e1f-9cfb169d035e req-738bdea7-a671-4d8a-a324-97c0792ce060 service nova] Acquired lock "refresh_cache-b59b5027-502d-4e4d-8f0d-8e19961ba3e4" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:55:09 user nova-compute[75165]: DEBUG nova.network.neutron [req-605d43f0-eae6-48e2-9e1f-9cfb169d035e req-738bdea7-a671-4d8a-a324-97c0792ce060 service nova] [instance: b59b5027-502d-4e4d-8f0d-8e19961ba3e4] Refreshing network info cache for port 5a3b58e2-07f1-427d-91e2-791138476ac6 {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 00:55:09 user nova-compute[75165]: DEBUG nova.network.neutron [req-605d43f0-eae6-48e2-9e1f-9cfb169d035e req-738bdea7-a671-4d8a-a324-97c0792ce060 service nova] [instance: b59b5027-502d-4e4d-8f0d-8e19961ba3e4] Updated VIF entry in instance network info cache for port 5a3b58e2-07f1-427d-91e2-791138476ac6. {{(pid=75165) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 00:55:09 user nova-compute[75165]: DEBUG nova.network.neutron [req-605d43f0-eae6-48e2-9e1f-9cfb169d035e req-738bdea7-a671-4d8a-a324-97c0792ce060 service nova] [instance: b59b5027-502d-4e4d-8f0d-8e19961ba3e4] Updating instance_info_cache with network_info: [{"id": "5a3b58e2-07f1-427d-91e2-791138476ac6", "address": "fa:16:3e:73:3b:67", "network": {"id": "30343eb9-5e61-407a-8491-e58b28ff1645", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1025901471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f535693c3cbd4f4e969f279167ef7ba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a3b58e2-07", "ovs_interfaceid": "5a3b58e2-07f1-427d-91e2-791138476ac6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:55:09 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-605d43f0-eae6-48e2-9e1f-9cfb169d035e req-738bdea7-a671-4d8a-a324-97c0792ce060 service nova] Releasing lock "refresh_cache-b59b5027-502d-4e4d-8f0d-8e19961ba3e4" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:55:12 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:55:12 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:55:17 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:55:17 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:55:19 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-0088f120-e512-4c4e-bd2e-37e7377879f8 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Acquiring lock "b59b5027-502d-4e4d-8f0d-8e19961ba3e4" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:55:19 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-0088f120-e512-4c4e-bd2e-37e7377879f8 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Lock "b59b5027-502d-4e4d-8f0d-8e19961ba3e4" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:55:19 user nova-compute[75165]: INFO nova.compute.manager [None req-0088f120-e512-4c4e-bd2e-37e7377879f8 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] [instance: b59b5027-502d-4e4d-8f0d-8e19961ba3e4] Rebooting instance
Oct 26 00:55:19 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-0088f120-e512-4c4e-bd2e-37e7377879f8 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Acquiring lock "refresh_cache-b59b5027-502d-4e4d-8f0d-8e19961ba3e4" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:55:19 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-0088f120-e512-4c4e-bd2e-37e7377879f8 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Acquired lock "refresh_cache-b59b5027-502d-4e4d-8f0d-8e19961ba3e4" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:55:19 user nova-compute[75165]: DEBUG nova.network.neutron [None req-0088f120-e512-4c4e-bd2e-37e7377879f8 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] [instance: b59b5027-502d-4e4d-8f0d-8e19961ba3e4] Building network info cache for instance {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 00:55:19 user nova-compute[75165]: DEBUG nova.network.neutron [None req-0088f120-e512-4c4e-bd2e-37e7377879f8 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] [instance: b59b5027-502d-4e4d-8f0d-8e19961ba3e4] Updating instance_info_cache with network_info: [{"id": "5a3b58e2-07f1-427d-91e2-791138476ac6", "address": "fa:16:3e:73:3b:67", "network": {"id": "30343eb9-5e61-407a-8491-e58b28ff1645", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1025901471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f535693c3cbd4f4e969f279167ef7ba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a3b58e2-07", "ovs_interfaceid": "5a3b58e2-07f1-427d-91e2-791138476ac6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:55:19 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-0088f120-e512-4c4e-bd2e-37e7377879f8 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Releasing lock "refresh_cache-b59b5027-502d-4e4d-8f0d-8e19961ba3e4" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:55:19 user nova-compute[75165]: DEBUG nova.compute.manager [None req-0088f120-e512-4c4e-bd2e-37e7377879f8 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] [instance: b59b5027-502d-4e4d-8f0d-8e19961ba3e4] Checking state {{(pid=75165) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 00:55:20 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:55:20 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:55:20 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:55:20 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:55:20 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:55:20 user nova-compute[75165]: DEBUG nova.compute.manager [req-2d214103-31c0-4dd8-98f7-5585424ce01b req-3f5eebfd-d9fe-4aa3-bf6b-d1c9aa942a82 service nova] [instance: b59b5027-502d-4e4d-8f0d-8e19961ba3e4] Received event network-vif-unplugged-5a3b58e2-07f1-427d-91e2-791138476ac6 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:55:20 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-2d214103-31c0-4dd8-98f7-5585424ce01b req-3f5eebfd-d9fe-4aa3-bf6b-d1c9aa942a82 service nova] Acquiring lock "b59b5027-502d-4e4d-8f0d-8e19961ba3e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:55:20 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-2d214103-31c0-4dd8-98f7-5585424ce01b req-3f5eebfd-d9fe-4aa3-bf6b-d1c9aa942a82 service nova] Lock "b59b5027-502d-4e4d-8f0d-8e19961ba3e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:55:20 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-2d214103-31c0-4dd8-98f7-5585424ce01b req-3f5eebfd-d9fe-4aa3-bf6b-d1c9aa942a82 service nova] Lock "b59b5027-502d-4e4d-8f0d-8e19961ba3e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:55:20 user nova-compute[75165]: DEBUG nova.compute.manager [req-2d214103-31c0-4dd8-98f7-5585424ce01b req-3f5eebfd-d9fe-4aa3-bf6b-d1c9aa942a82 service nova] [instance: b59b5027-502d-4e4d-8f0d-8e19961ba3e4] No waiting events found dispatching network-vif-unplugged-5a3b58e2-07f1-427d-91e2-791138476ac6 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:55:20 user nova-compute[75165]: WARNING nova.compute.manager [req-2d214103-31c0-4dd8-98f7-5585424ce01b req-3f5eebfd-d9fe-4aa3-bf6b-d1c9aa942a82 service nova] [instance: b59b5027-502d-4e4d-8f0d-8e19961ba3e4] Received unexpected event network-vif-unplugged-5a3b58e2-07f1-427d-91e2-791138476ac6 for instance with vm_state active and task_state reboot_started_hard.
Oct 26 00:55:20 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: b59b5027-502d-4e4d-8f0d-8e19961ba3e4] Instance destroyed successfully.
Oct 26 00:55:20 user nova-compute[75165]: DEBUG nova.objects.instance [None req-0088f120-e512-4c4e-bd2e-37e7377879f8 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Lazy-loading 'resources' on Instance uuid b59b5027-502d-4e4d-8f0d-8e19961ba3e4 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:55:20 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-0088f120-e512-4c4e-bd2e-37e7377879f8 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:52:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1122751109',display_name='tempest-TestMinimumBasicScenario-server-1122751109',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1122751109',id=51,image_ref='bc9330e4-6355-46ac-9bc2-84be0afe29c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLrwnU95bX4MXNUTHar2eaBwFFDXaAKPvDXhaGoFnu8Q3nONzRsaw3xwMy98kEX6RSU/ez5DYEE4MxheYs9fETw9ddTIa3nk6bvxzEXDsTVNDnjYLWaz4whLAgBaNRNvag==',key_name='tempest-TestMinimumBasicScenario-649507707',keypairs=<?>,launch_index=0,launched_at=2023-10-26T00:52:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f535693c3cbd4f4e969f279167ef7ba8',ramdisk_id='',reservation_id='r-y4cdz8zq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc9330e4-6355-46ac-9bc2-84be0afe29c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-387809061',owner_user_name='tempest-TestMinimumBasicScenario-387809061-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T00:55:20Z,user_data=None,user_id='d7f8020ca2184967b2a810b0e6c8d4a0',uuid=b59b5027-502d-4e4d-8f0d-8e19961ba3e4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5a3b58e2-07f1-427d-91e2-791138476ac6", "address": "fa:16:3e:73:3b:67", "network": {"id": "30343eb9-5e61-407a-8491-e58b28ff1645", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1025901471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f535693c3cbd4f4e969f279167ef7ba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a3b58e2-07", "ovs_interfaceid": "5a3b58e2-07f1-427d-91e2-791138476ac6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 00:55:20 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-0088f120-e512-4c4e-bd2e-37e7377879f8 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Converting VIF {"id": "5a3b58e2-07f1-427d-91e2-791138476ac6", "address": "fa:16:3e:73:3b:67", "network": {"id": "30343eb9-5e61-407a-8491-e58b28ff1645", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1025901471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f535693c3cbd4f4e969f279167ef7ba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a3b58e2-07", "ovs_interfaceid": "5a3b58e2-07f1-427d-91e2-791138476ac6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:55:20 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-0088f120-e512-4c4e-bd2e-37e7377879f8 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:73:3b:67,bridge_name='br-int',has_traffic_filtering=True,id=5a3b58e2-07f1-427d-91e2-791138476ac6,network=Network(30343eb9-5e61-407a-8491-e58b28ff1645),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a3b58e2-07') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:55:20 user nova-compute[75165]: DEBUG os_vif [None req-0088f120-e512-4c4e-bd2e-37e7377879f8 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:73:3b:67,bridge_name='br-int',has_traffic_filtering=True,id=5a3b58e2-07f1-427d-91e2-791138476ac6,network=Network(30343eb9-5e61-407a-8491-e58b28ff1645),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a3b58e2-07') {{(pid=75165) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 00:55:20 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:55:20 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5a3b58e2-07, bridge=br-int, if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:55:20 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:55:20 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:55:20 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:55:20 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e0046098-2bac-4e7c-8669-162a79c0cdb4) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:55:20 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:55:20 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:55:20 user nova-compute[75165]: INFO os_vif [None req-0088f120-e512-4c4e-bd2e-37e7377879f8 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:73:3b:67,bridge_name='br-int',has_traffic_filtering=True,id=5a3b58e2-07f1-427d-91e2-791138476ac6,network=Network(30343eb9-5e61-407a-8491-e58b28ff1645),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a3b58e2-07')
Oct 26 00:55:20 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0088f120-e512-4c4e-bd2e-37e7377879f8 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] [instance: b59b5027-502d-4e4d-8f0d-8e19961ba3e4] calling os-brick to detach iSCSI Volume {{(pid=75165) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 00:55:20 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-0088f120-e512-4c4e-bd2e-37e7377879f8 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8bf8160e50>, {'target_iqn': 'iqn.2010-10.org.openstack:f30b1013-6007-485f-bc23-1e0362241d38', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xObhESdr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:55:20 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-0088f120-e512-4c4e-bd2e-37e7377879f8 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:55:20 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-0088f120-e512-4c4e-bd2e-37e7377879f8 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:55:20 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-0088f120-e512-4c4e-bd2e-37e7377879f8 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:55:20 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:55:20 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:55:20 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad40184a-7042-46e7-a921-4fca74a18000]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f30b1013-6007-485f-bc23-1e0362241d38\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:55:20 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-0088f120-e512-4c4e-bd2e-37e7377879f8 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 00:55:20 user nova-compute[75165]: No targets found.
Oct 26 00:55:20 user nova-compute[75165]: iSNS:
Oct 26 00:55:20 user nova-compute[75165]: No targets found.
Oct 26 00:55:20 user nova-compute[75165]: STATIC:
Oct 26 00:55:20 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:f30b1013-6007-485f-bc23-1e0362241d38
Oct 26 00:55:20 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:55:20 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:55:20 user nova-compute[75165]: FIRMWARE:
Oct 26 00:55:20 user nova-compute[75165]: No targets found.
Oct 26 00:55:20 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:55:20 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-0088f120-e512-4c4e-bd2e-37e7377879f8 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 00:55:20 user nova-compute[75165]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 00:55:20 user nova-compute[75165]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75165) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 00:55:20 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-0088f120-e512-4c4e-bd2e-37e7377879f8 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f30b1013-6007-485f-bc23-1e0362241d38', 0)] {{(pid=75165) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 00:55:20 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:55:20 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:55:20 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca51fade-e0ce-40a4-9cc5-5ed177b15a63]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f30b1013-6007-485f-bc23-1e0362241d38\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:55:20 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:55:20 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:55:20 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce71f59c-4361-41f6-a837-85d3baa9e7a8]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f30b1013-6007-485f-bc23-1e0362241d38 (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:55:20 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-0088f120-e512-4c4e-bd2e-37e7377879f8 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f30b1013-6007-485f-bc23-1e0362241d38 (non-flash)
Oct 26 00:55:20 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:55:20 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-0088f120-e512-4c4e-bd2e-37e7377879f8 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f30b1013-6007-485f-bc23-1e0362241d38 (non-flash)
Oct 26 00:55:20 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:55:20 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-0088f120-e512-4c4e-bd2e-37e7377879f8 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8be04e6a70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f30b1013-6007-485f-bc23-1e0362241d38'): ({'sdb'}, set())}) {{(pid=75165) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 00:55:20 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-0088f120-e512-4c4e-bd2e-37e7377879f8 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Removing single pathed devices sdb {{(pid=75165) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 00:55:20 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:55:20 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:55:20 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e2d6e53-a24c-48a5-bc5d-83f2698ed59f]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:55:20 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:55:20 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:55:20 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[e745c72c-279c-4883-8418-c0381228057c]: (4, ('ok\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:55:20 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-0088f120-e512-4c4e-bd2e-37e7377879f8 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Flushing IO for device /dev/sdb {{(pid=75165) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 00:55:20 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:55:20 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:55:20 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cfd9595-c92a-410d-b0ff-e611a99d2963]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:55:20 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-0088f120-e512-4c4e-bd2e-37e7377879f8 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75165) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 00:55:20 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:55:20 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:55:20 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[04e78f28-e58f-42e0-a6c6-149388e6c92f]: (4, ('1', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:55:20 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-0088f120-e512-4c4e-bd2e-37e7377879f8 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75165) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 00:55:20 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-0088f120-e512-4c4e-bd2e-37e7377879f8 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] SCSI volumes sdb have been removed. {{(pid=75165) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 00:55:20 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-0088f120-e512-4c4e-bd2e-37e7377879f8 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f30b1013-6007-485f-bc23-1e0362241d38')] {{(pid=75165) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 00:55:20 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f30b1013-6007-485f-bc23-1e0362241d38 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:55:20 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f30b1013-6007-485f-bc23-1e0362241d38 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:55:20 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[676210ee-fedc-4bcd-9d71-b6408d736193]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:55:20 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-0088f120-e512-4c4e-bd2e-37e7377879f8 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:55:20 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f30b1013-6007-485f-bc23-1e0362241d38 -p 172.16.0.220:3260 --logout {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:55:20 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f30b1013-6007-485f-bc23-1e0362241d38 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:55:20 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[d13ea49b-f4f9-4ae3-83fa-c61898089caf]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:f30b1013-6007-485f-bc23-1e0362241d38, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:f30b1013-6007-485f-bc23-1e0362241d38, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:55:20 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-0088f120-e512-4c4e-bd2e-37e7377879f8 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:f30b1013-6007-485f-bc23-1e0362241d38, portal: 172.16.0.220,3260]
Oct 26 00:55:20 user nova-compute[75165]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:f30b1013-6007-485f-bc23-1e0362241d38, portal: 172.16.0.220,3260] successful.
Oct 26 00:55:20 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:55:20 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f30b1013-6007-485f-bc23-1e0362241d38 -p 172.16.0.220:3260 --op delete {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:55:21 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f30b1013-6007-485f-bc23-1e0362241d38 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:55:21 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[267b1680-22d2-4452-8538-5e2a7580c5a1]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:55:21 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-0088f120-e512-4c4e-bd2e-37e7377879f8 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:55:21 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-0088f120-e512-4c4e-bd2e-37e7377879f8 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.268s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:55:21 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-0088f120-e512-4c4e-bd2e-37e7377879f8 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] <== disconnect_volume: return (269ms) None {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:55:21 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0088f120-e512-4c4e-bd2e-37e7377879f8 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] [instance: b59b5027-502d-4e4d-8f0d-8e19961ba3e4] Disconnected iSCSI Volume {{(pid=75165) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 00:55:21 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-0088f120-e512-4c4e-bd2e-37e7377879f8 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] [instance: b59b5027-502d-4e4d-8f0d-8e19961ba3e4] Start _get_guest_xml network_info=[{"id": "5a3b58e2-07f1-427d-91e2-791138476ac6", "address": "fa:16:3e:73:3b:67", "network": {"id": "30343eb9-5e61-407a-8491-e58b28ff1645", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1025901471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f535693c3cbd4f4e969f279167ef7ba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a3b58e2-07", "ovs_interfaceid": "5a3b58e2-07f1-427d-91e2-791138476ac6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=bc9330e4-6355-46ac-9bc2-84be0afe29c4,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'size': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': 'bc9330e4-6355-46ac-9bc2-84be0afe29c4'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f30b1013-6007-485f-bc23-1e0362241d38', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xObhESdr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'b59b5027-502d-4e4d-8f0d-8e19961ba3e4', 'attached_at': '', 'detached_at': '', 'volume_id': 'f30b1013-6007-485f-bc23-1e0362241d38', 'serial': 'f30b1013-6007-485f-bc23-1e0362241d38'}, 'guest_format': None, 'boot_index': None, 'disk_bus': 'virtio', 'attachment_id': '6aa70aaf-1b84-4480-b762-bfe1f02e49bb', 'delete_on_termination': False, 'volume_type': None} {{(pid=75165) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 00:55:21 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-0088f120-e512-4c4e-bd2e-37e7377879f8 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:55:21 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-0088f120-e512-4c4e-bd2e-37e7377879f8 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:55:21 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-0088f120-e512-4c4e-bd2e-37e7377879f8 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75165) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 00:55:21 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-0088f120-e512-4c4e-bd2e-37e7377879f8 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] CPU controller missing on host. {{(pid=75165) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 00:55:21 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-0088f120-e512-4c4e-bd2e-37e7377879f8 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75165) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 00:55:21 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-0088f120-e512-4c4e-bd2e-37e7377879f8 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] CPU controller found on host. {{(pid=75165) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 00:55:21 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-0088f120-e512-4c4e-bd2e-37e7377879f8 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75165) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 00:55:21 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-0088f120-e512-4c4e-bd2e-37e7377879f8 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T00:03:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=bc9330e4-6355-46ac-9bc2-84be0afe29c4,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 00:55:21 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-0088f120-e512-4c4e-bd2e-37e7377879f8 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Flavor limits 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 00:55:21 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-0088f120-e512-4c4e-bd2e-37e7377879f8 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Image limits 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 00:55:21 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-0088f120-e512-4c4e-bd2e-37e7377879f8 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Flavor pref 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 00:55:21 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-0088f120-e512-4c4e-bd2e-37e7377879f8 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Image pref 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 00:55:21 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-0088f120-e512-4c4e-bd2e-37e7377879f8 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 00:55:21 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-0088f120-e512-4c4e-bd2e-37e7377879f8 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 00:55:21 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-0088f120-e512-4c4e-bd2e-37e7377879f8 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75165) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 00:55:21 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-0088f120-e512-4c4e-bd2e-37e7377879f8 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Got 1 possible topologies {{(pid=75165) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 00:55:21 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-0088f120-e512-4c4e-bd2e-37e7377879f8 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 00:55:21 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-0088f120-e512-4c4e-bd2e-37e7377879f8 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 00:55:21 user nova-compute[75165]: DEBUG nova.objects.instance [None req-0088f120-e512-4c4e-bd2e-37e7377879f8 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Lazy-loading 'vcpu_model' on Instance uuid b59b5027-502d-4e4d-8f0d-8e19961ba3e4 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:55:21 user nova-compute[75165]: DEBUG nova.objects.base [None req-0088f120-e512-4c4e-bd2e-37e7377879f8 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Object Instance<b59b5027-502d-4e4d-8f0d-8e19961ba3e4> lazy-loaded attributes: resources,vcpu_model {{(pid=75165) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 00:55:21 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0088f120-e512-4c4e-bd2e-37e7377879f8 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] [instance: b59b5027-502d-4e4d-8f0d-8e19961ba3e4] Calling os-brick to attach iSCSI Volume {{(pid=75165) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 00:55:21 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-0088f120-e512-4c4e-bd2e-37e7377879f8 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8bf8160e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f30b1013-6007-485f-bc23-1e0362241d38', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xObhESdr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:55:21 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-0088f120-e512-4c4e-bd2e-37e7377879f8 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:55:21 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-0088f120-e512-4c4e-bd2e-37e7377879f8 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:55:21 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-0088f120-e512-4c4e-bd2e-37e7377879f8 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:55:21 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-0088f120-e512-4c4e-bd2e-37e7377879f8 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:55:21 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-0088f120-e512-4c4e-bd2e-37e7377879f8 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f30b1013-6007-485f-bc23-1e0362241d38" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:55:21 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-0088f120-e512-4c4e-bd2e-37e7377879f8 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f30b1013-6007-485f-bc23-1e0362241d38" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:55:21 user nova-compute[75165]: INFO os_brick.initiator.connectors.iscsi [None req-0088f120-e512-4c4e-bd2e-37e7377879f8 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 00:55:21 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f30b1013-6007-485f-bc23-1e0362241d38 -p 172.16.0.220:3260 {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:55:21 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f30b1013-6007-485f-bc23-1e0362241d38 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:55:21 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bb756b6-b6c1-42ec-89e5-7947b325ec62]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:55:21 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-0088f120-e512-4c4e-bd2e-37e7377879f8 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 00:55:21 user nova-compute[75165]:  {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:55:21 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f30b1013-6007-485f-bc23-1e0362241d38 -p 172.16.0.220:3260 --interface default --op new {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:55:21 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f30b1013-6007-485f-bc23-1e0362241d38 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.037s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:55:21 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dd1f0ba-935b-40aa-8bfd-0b18180c6a74]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f30b1013-6007-485f-bc23-1e0362241d38] added\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:55:21 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-0088f120-e512-4c4e-bd2e-37e7377879f8 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f30b1013-6007-485f-bc23-1e0362241d38] added
Oct 26 00:55:21 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:55:21 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f30b1013-6007-485f-bc23-1e0362241d38 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:55:21 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f30b1013-6007-485f-bc23-1e0362241d38 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:55:21 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[92b52c95-be26-4bcd-99bc-dbbecfed0238]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:55:21 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-0088f120-e512-4c4e-bd2e-37e7377879f8 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:55:21 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f30b1013-6007-485f-bc23-1e0362241d38 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:55:21 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f30b1013-6007-485f-bc23-1e0362241d38 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:55:21 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f454a49-bcd6-4cc0-bf6e-764b8fbe8926]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:55:21 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-0088f120-e512-4c4e-bd2e-37e7377879f8 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:55:21 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f30b1013-6007-485f-bc23-1e0362241d38 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xObhESdr {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:55:21 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f30b1013-6007-485f-bc23-1e0362241d38 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xObhESdr" returned: 0 in 0.017s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:55:21 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[75cebf3a-195d-476c-804f-5c76bae9bcb2]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:55:21 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-0088f120-e512-4c4e-bd2e-37e7377879f8 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xObhESdr'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:55:21 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f30b1013-6007-485f-bc23-1e0362241d38 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:55:21 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f30b1013-6007-485f-bc23-1e0362241d38 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:55:21 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[8faad485-7065-4d29-a519-861bf374d8dc]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:55:21 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-0088f120-e512-4c4e-bd2e-37e7377879f8 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:55:21 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:55:21 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.022s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:55:21 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b4a9b48-2f0f-49d6-8a63-ffd0c8dbd6c1]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:55:21 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-0088f120-e512-4c4e-bd2e-37e7377879f8 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 26 00:55:21 user nova-compute[75165]:  {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:55:21 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-0088f120-e512-4c4e-bd2e-37e7377879f8 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 26 00:55:21 user nova-compute[75165]:  {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:55:21 user nova-compute[75165]: WARNING os_brick.initiator.connectors.iscsi [None req-0088f120-e512-4c4e-bd2e-37e7377879f8 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 26 00:55:21 user nova-compute[75165]: 
Oct 26 00:55:21 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f30b1013-6007-485f-bc23-1e0362241d38 -p 172.16.0.220:3260 --login {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:55:21 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f30b1013-6007-485f-bc23-1e0362241d38 -p 172.16.0.220:3260 --login" returned: 0 in 0.042s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:55:21 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3e316c8-83f9-4605-9d17-eb139ba81af9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f30b1013-6007-485f-bc23-1e0362241d38, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f30b1013-6007-485f-bc23-1e0362241d38, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:55:21 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-0088f120-e512-4c4e-bd2e-37e7377879f8 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f30b1013-6007-485f-bc23-1e0362241d38, portal: 172.16.0.220,3260]
Oct 26 00:55:21 user nova-compute[75165]: Login to [iface: default, target: iqn.2010-10.org.openstack:f30b1013-6007-485f-bc23-1e0362241d38, portal: 172.16.0.220,3260] successful.
Oct 26 00:55:21 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:55:21 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f30b1013-6007-485f-bc23-1e0362241d38 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:55:21 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f30b1013-6007-485f-bc23-1e0362241d38 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:55:21 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca89808b-0615-49da-b1ac-f65d103486d7]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:55:21 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-0088f120-e512-4c4e-bd2e-37e7377879f8 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:55:21 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:55:21 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:55:21 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cd4f29e-cb1a-4db8-b63b-220bf7a47568]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f30b1013-6007-485f-bc23-1e0362241d38 (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:55:21 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-0088f120-e512-4c4e-bd2e-37e7377879f8 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f30b1013-6007-485f-bc23-1e0362241d38 (non-flash)
Oct 26 00:55:21 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:55:21 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-0088f120-e512-4c4e-bd2e-37e7377879f8 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f30b1013-6007-485f-bc23-1e0362241d38 (non-flash)
Oct 26 00:55:21 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:55:21 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-0088f120-e512-4c4e-bd2e-37e7377879f8 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f30b1013-6007-485f-bc23-1e0362241d38" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.260s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:55:21 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-0088f120-e512-4c4e-bd2e-37e7377879f8 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Connected to 172.16.0.220:3260 {{(pid=75165) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 00:55:21 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-0088f120-e512-4c4e-bd2e-37e7377879f8 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] HCTL ('33', '-', '-', 0) found on session 58 with lun 0 {{(pid=75165) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 00:55:21 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-0088f120-e512-4c4e-bd2e-37e7377879f8 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75165) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 00:55:21 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:55:21 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:55:21 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[c05b8412-0174-4402-8d02-8ae96e0a6c8d]: (4, ('- - 0', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:55:21 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-0088f120-e512-4c4e-bd2e-37e7377879f8 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: None {{(pid=75165) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 00:55:22 user nova-compute[75165]: DEBUG nova.compute.manager [req-a88c1b88-cc1b-488d-80f3-182bcafb2572 req-4fc1c255-acdd-4844-af82-450ad9ce5c84 service nova] [instance: b59b5027-502d-4e4d-8f0d-8e19961ba3e4] Received event network-vif-plugged-5a3b58e2-07f1-427d-91e2-791138476ac6 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:55:22 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-a88c1b88-cc1b-488d-80f3-182bcafb2572 req-4fc1c255-acdd-4844-af82-450ad9ce5c84 service nova] Acquiring lock "b59b5027-502d-4e4d-8f0d-8e19961ba3e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:55:22 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-a88c1b88-cc1b-488d-80f3-182bcafb2572 req-4fc1c255-acdd-4844-af82-450ad9ce5c84 service nova] Lock "b59b5027-502d-4e4d-8f0d-8e19961ba3e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:55:22 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-a88c1b88-cc1b-488d-80f3-182bcafb2572 req-4fc1c255-acdd-4844-af82-450ad9ce5c84 service nova] Lock "b59b5027-502d-4e4d-8f0d-8e19961ba3e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:55:22 user nova-compute[75165]: DEBUG nova.compute.manager [req-a88c1b88-cc1b-488d-80f3-182bcafb2572 req-4fc1c255-acdd-4844-af82-450ad9ce5c84 service nova] [instance: b59b5027-502d-4e4d-8f0d-8e19961ba3e4] No waiting events found dispatching network-vif-plugged-5a3b58e2-07f1-427d-91e2-791138476ac6 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:55:22 user nova-compute[75165]: WARNING nova.compute.manager [req-a88c1b88-cc1b-488d-80f3-182bcafb2572 req-4fc1c255-acdd-4844-af82-450ad9ce5c84 service nova] [instance: b59b5027-502d-4e4d-8f0d-8e19961ba3e4] Received unexpected event network-vif-plugged-5a3b58e2-07f1-427d-91e2-791138476ac6 for instance with vm_state active and task_state reboot_started_hard.
Oct 26 00:55:22 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:55:22 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-0088f120-e512-4c4e-bd2e-37e7377879f8 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75165) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 00:55:22 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-0088f120-e512-4c4e-bd2e-37e7377879f8 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:f30b1013-6007-485f-bc23-1e0362241d38', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xObhESdr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75165) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 00:55:22 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-0088f120-e512-4c4e-bd2e-37e7377879f8 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.289s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:55:22 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-0088f120-e512-4c4e-bd2e-37e7377879f8 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] <== connect_volume: return (1291ms) {'type': 'block', 'scsi_wwn': '26462313731646663', 'path': '/dev/sdb'} {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:55:22 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0088f120-e512-4c4e-bd2e-37e7377879f8 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] [instance: b59b5027-502d-4e4d-8f0d-8e19961ba3e4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26462313731646663', 'path': '/dev/sdb'} {{(pid=75165) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 00:55:22 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-0088f120-e512-4c4e-bd2e-37e7377879f8 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:52:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1122751109',display_name='tempest-TestMinimumBasicScenario-server-1122751109',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1122751109',id=51,image_ref='bc9330e4-6355-46ac-9bc2-84be0afe29c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLrwnU95bX4MXNUTHar2eaBwFFDXaAKPvDXhaGoFnu8Q3nONzRsaw3xwMy98kEX6RSU/ez5DYEE4MxheYs9fETw9ddTIa3nk6bvxzEXDsTVNDnjYLWaz4whLAgBaNRNvag==',key_name='tempest-TestMinimumBasicScenario-649507707',keypairs=<?>,launch_index=0,launched_at=2023-10-26T00:52:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f535693c3cbd4f4e969f279167ef7ba8',ramdisk_id='',reservation_id='r-y4cdz8zq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc9330e4-6355-46ac-9bc2-84be0afe29c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-387809061',owner_user_name='tempest-TestMinimumBasicScenario-387809061-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T00:55:20Z,user_data=None,user_id='d7f8020ca2184967b2a810b0e6c8d4a0',uuid=b59b5027-502d-4e4d-8f0d-8e19961ba3e4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5a3b58e2-07f1-427d-91e2-791138476ac6", "address": "fa:16:3e:73:3b:67", "network": {"id": "30343eb9-5e61-407a-8491-e58b28ff1645", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1025901471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f535693c3cbd4f4e969f279167ef7ba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a3b58e2-07", "ovs_interfaceid": "5a3b58e2-07f1-427d-91e2-791138476ac6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75165) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 00:55:22 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-0088f120-e512-4c4e-bd2e-37e7377879f8 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Converting VIF {"id": "5a3b58e2-07f1-427d-91e2-791138476ac6", "address": "fa:16:3e:73:3b:67", "network": {"id": "30343eb9-5e61-407a-8491-e58b28ff1645", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1025901471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f535693c3cbd4f4e969f279167ef7ba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a3b58e2-07", "ovs_interfaceid": "5a3b58e2-07f1-427d-91e2-791138476ac6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:55:22 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-0088f120-e512-4c4e-bd2e-37e7377879f8 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:73:3b:67,bridge_name='br-int',has_traffic_filtering=True,id=5a3b58e2-07f1-427d-91e2-791138476ac6,network=Network(30343eb9-5e61-407a-8491-e58b28ff1645),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a3b58e2-07') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:55:22 user nova-compute[75165]: DEBUG nova.objects.instance [None req-0088f120-e512-4c4e-bd2e-37e7377879f8 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Lazy-loading 'pci_devices' on Instance uuid b59b5027-502d-4e4d-8f0d-8e19961ba3e4 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:55:22 user nova-compute[75165]: DEBUG nova.objects.base [None req-0088f120-e512-4c4e-bd2e-37e7377879f8 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Object Instance<b59b5027-502d-4e4d-8f0d-8e19961ba3e4> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=75165) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 00:55:22 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-0088f120-e512-4c4e-bd2e-37e7377879f8 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] [instance: b59b5027-502d-4e4d-8f0d-8e19961ba3e4] End _get_guest_xml xml=<domain type="kvm">
Oct 26 00:55:22 user nova-compute[75165]:   <uuid>b59b5027-502d-4e4d-8f0d-8e19961ba3e4</uuid>
Oct 26 00:55:22 user nova-compute[75165]:   <name>instance-00000033</name>
Oct 26 00:55:22 user nova-compute[75165]:   <memory>524288</memory>
Oct 26 00:55:22 user nova-compute[75165]:   <vcpu>1</vcpu>
Oct 26 00:55:22 user nova-compute[75165]:   <metadata>
Oct 26 00:55:22 user nova-compute[75165]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 00:55:22 user nova-compute[75165]:       <nova:package version="0.0.0"/>
Oct 26 00:55:22 user nova-compute[75165]:       <nova:name>tempest-TestMinimumBasicScenario-server-1122751109</nova:name>
Oct 26 00:55:22 user nova-compute[75165]:       <nova:creationTime>2023-10-26 00:55:21</nova:creationTime>
Oct 26 00:55:22 user nova-compute[75165]:       <nova:flavor name="m1.tiny">
Oct 26 00:55:22 user nova-compute[75165]:         <nova:memory>512</nova:memory>
Oct 26 00:55:22 user nova-compute[75165]:         <nova:disk>1</nova:disk>
Oct 26 00:55:22 user nova-compute[75165]:         <nova:swap>0</nova:swap>
Oct 26 00:55:22 user nova-compute[75165]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 00:55:22 user nova-compute[75165]:         <nova:vcpus>1</nova:vcpus>
Oct 26 00:55:22 user nova-compute[75165]:       </nova:flavor>
Oct 26 00:55:22 user nova-compute[75165]:       <nova:owner>
Oct 26 00:55:22 user nova-compute[75165]:         <nova:user uuid="d7f8020ca2184967b2a810b0e6c8d4a0">tempest-TestMinimumBasicScenario-387809061-project-member</nova:user>
Oct 26 00:55:22 user nova-compute[75165]:         <nova:project uuid="f535693c3cbd4f4e969f279167ef7ba8">tempest-TestMinimumBasicScenario-387809061</nova:project>
Oct 26 00:55:22 user nova-compute[75165]:       </nova:owner>
Oct 26 00:55:22 user nova-compute[75165]:       <nova:root type="image" uuid="bc9330e4-6355-46ac-9bc2-84be0afe29c4"/>
Oct 26 00:55:22 user nova-compute[75165]:       <nova:ports>
Oct 26 00:55:22 user nova-compute[75165]:         <nova:port uuid="5a3b58e2-07f1-427d-91e2-791138476ac6">
Oct 26 00:55:22 user nova-compute[75165]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 26 00:55:22 user nova-compute[75165]:         </nova:port>
Oct 26 00:55:22 user nova-compute[75165]:       </nova:ports>
Oct 26 00:55:22 user nova-compute[75165]:     </nova:instance>
Oct 26 00:55:22 user nova-compute[75165]:   </metadata>
Oct 26 00:55:22 user nova-compute[75165]:   <sysinfo type="smbios">
Oct 26 00:55:22 user nova-compute[75165]:     <system>
Oct 26 00:55:22 user nova-compute[75165]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 00:55:22 user nova-compute[75165]:       <entry name="product">OpenStack Nova</entry>
Oct 26 00:55:22 user nova-compute[75165]:       <entry name="version">0.0.0</entry>
Oct 26 00:55:22 user nova-compute[75165]:       <entry name="serial">b59b5027-502d-4e4d-8f0d-8e19961ba3e4</entry>
Oct 26 00:55:22 user nova-compute[75165]:       <entry name="uuid">b59b5027-502d-4e4d-8f0d-8e19961ba3e4</entry>
Oct 26 00:55:22 user nova-compute[75165]:       <entry name="family">Virtual Machine</entry>
Oct 26 00:55:22 user nova-compute[75165]:     </system>
Oct 26 00:55:22 user nova-compute[75165]:   </sysinfo>
Oct 26 00:55:22 user nova-compute[75165]:   <os>
Oct 26 00:55:22 user nova-compute[75165]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 00:55:22 user nova-compute[75165]:     <boot dev="hd"/>
Oct 26 00:55:22 user nova-compute[75165]:     <smbios mode="sysinfo"/>
Oct 26 00:55:22 user nova-compute[75165]:   </os>
Oct 26 00:55:22 user nova-compute[75165]:   <features>
Oct 26 00:55:22 user nova-compute[75165]:     <acpi/>
Oct 26 00:55:22 user nova-compute[75165]:     <apic/>
Oct 26 00:55:22 user nova-compute[75165]:     <vmcoreinfo/>
Oct 26 00:55:22 user nova-compute[75165]:   </features>
Oct 26 00:55:22 user nova-compute[75165]:   <clock offset="utc">
Oct 26 00:55:22 user nova-compute[75165]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 00:55:22 user nova-compute[75165]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 00:55:22 user nova-compute[75165]:     <timer name="hpet" present="no"/>
Oct 26 00:55:22 user nova-compute[75165]:   </clock>
Oct 26 00:55:22 user nova-compute[75165]:   <cpu mode="custom" match="exact">
Oct 26 00:55:22 user nova-compute[75165]:     <model>Nehalem</model>
Oct 26 00:55:22 user nova-compute[75165]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 00:55:22 user nova-compute[75165]:   </cpu>
Oct 26 00:55:22 user nova-compute[75165]:   <devices>
Oct 26 00:55:22 user nova-compute[75165]:     <disk type="file" device="disk">
Oct 26 00:55:22 user nova-compute[75165]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 00:55:22 user nova-compute[75165]:       <source file="/opt/stack/data/nova/instances/b59b5027-502d-4e4d-8f0d-8e19961ba3e4/disk"/>
Oct 26 00:55:22 user nova-compute[75165]:       <target dev="vda" bus="virtio"/>
Oct 26 00:55:22 user nova-compute[75165]:     </disk>
Oct 26 00:55:22 user nova-compute[75165]:     <disk type="block" device="disk">
Oct 26 00:55:22 user nova-compute[75165]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 00:55:22 user nova-compute[75165]:       <source dev="/dev/sdb"/>
Oct 26 00:55:22 user nova-compute[75165]:       <target dev="vdb" bus="virtio"/>
Oct 26 00:55:22 user nova-compute[75165]:       <serial>f30b1013-6007-485f-bc23-1e0362241d38</serial>
Oct 26 00:55:22 user nova-compute[75165]:     </disk>
Oct 26 00:55:22 user nova-compute[75165]:     <interface type="ethernet">
Oct 26 00:55:22 user nova-compute[75165]:       <mac address="fa:16:3e:73:3b:67"/>
Oct 26 00:55:22 user nova-compute[75165]:       <model type="virtio"/>
Oct 26 00:55:22 user nova-compute[75165]:       <mtu size="1442"/>
Oct 26 00:55:22 user nova-compute[75165]:       <target dev="tap5a3b58e2-07"/>
Oct 26 00:55:22 user nova-compute[75165]:     </interface>
Oct 26 00:55:22 user nova-compute[75165]:     <serial type="pty">
Oct 26 00:55:22 user nova-compute[75165]:       <log file="/opt/stack/data/nova/instances/b59b5027-502d-4e4d-8f0d-8e19961ba3e4/console.log" append="off"/>
Oct 26 00:55:22 user nova-compute[75165]:     </serial>
Oct 26 00:55:22 user nova-compute[75165]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 00:55:22 user nova-compute[75165]:     <video>
Oct 26 00:55:22 user nova-compute[75165]:       <model type="virtio"/>
Oct 26 00:55:22 user nova-compute[75165]:     </video>
Oct 26 00:55:22 user nova-compute[75165]:     <rng model="virtio">
Oct 26 00:55:22 user nova-compute[75165]:       <backend model="random">/dev/urandom</backend>
Oct 26 00:55:22 user nova-compute[75165]:     </rng>
Oct 26 00:55:22 user nova-compute[75165]:     <controller type="usb" index="0" model="none"/>
Oct 26 00:55:22 user nova-compute[75165]:     <memballoon model="virtio">
Oct 26 00:55:22 user nova-compute[75165]:       <stats period="10"/>
Oct 26 00:55:22 user nova-compute[75165]:     </memballoon>
Oct 26 00:55:22 user nova-compute[75165]:   </devices>
Oct 26 00:55:22 user nova-compute[75165]: </domain>
Oct 26 00:55:22 user nova-compute[75165]:  {{(pid=75165) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 00:55:22 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-0088f120-e512-4c4e-bd2e-37e7377879f8 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b59b5027-502d-4e4d-8f0d-8e19961ba3e4/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:55:22 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-0088f120-e512-4c4e-bd2e-37e7377879f8 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b59b5027-502d-4e4d-8f0d-8e19961ba3e4/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:55:22 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-0088f120-e512-4c4e-bd2e-37e7377879f8 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b59b5027-502d-4e4d-8f0d-8e19961ba3e4/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:55:22 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-0088f120-e512-4c4e-bd2e-37e7377879f8 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b59b5027-502d-4e4d-8f0d-8e19961ba3e4/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:55:22 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-0088f120-e512-4c4e-bd2e-37e7377879f8 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75165) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 00:55:22 user nova-compute[75165]: DEBUG nova.objects.instance [None req-0088f120-e512-4c4e-bd2e-37e7377879f8 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Lazy-loading 'trusted_certs' on Instance uuid b59b5027-502d-4e4d-8f0d-8e19961ba3e4 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:55:22 user nova-compute[75165]: DEBUG nova.objects.base [None req-0088f120-e512-4c4e-bd2e-37e7377879f8 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Object Instance<b59b5027-502d-4e4d-8f0d-8e19961ba3e4> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=75165) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 00:55:22 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-0088f120-e512-4c4e-bd2e-37e7377879f8 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad0ebf0830f495080781d69f6d08bcf46d41a5d7 --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:55:23 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-0088f120-e512-4c4e-bd2e-37e7377879f8 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ad0ebf0830f495080781d69f6d08bcf46d41a5d7 --force-share --output=json" returned: 0 in 0.191s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:55:23 user nova-compute[75165]: DEBUG nova.virt.disk.api [None req-0088f120-e512-4c4e-bd2e-37e7377879f8 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b59b5027-502d-4e4d-8f0d-8e19961ba3e4/disk. size=1073741824 {{(pid=75165) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 00:55:23 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-0088f120-e512-4c4e-bd2e-37e7377879f8 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b59b5027-502d-4e4d-8f0d-8e19961ba3e4/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:55:23 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-0088f120-e512-4c4e-bd2e-37e7377879f8 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b59b5027-502d-4e4d-8f0d-8e19961ba3e4/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:55:23 user nova-compute[75165]: DEBUG nova.virt.disk.api [None req-0088f120-e512-4c4e-bd2e-37e7377879f8 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Cannot resize image /opt/stack/data/nova/instances/b59b5027-502d-4e4d-8f0d-8e19961ba3e4/disk to a smaller size. {{(pid=75165) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 00:55:23 user nova-compute[75165]: DEBUG nova.objects.instance [None req-0088f120-e512-4c4e-bd2e-37e7377879f8 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Lazy-loading 'migration_context' on Instance uuid b59b5027-502d-4e4d-8f0d-8e19961ba3e4 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:55:23 user nova-compute[75165]: DEBUG nova.objects.base [None req-0088f120-e512-4c4e-bd2e-37e7377879f8 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Object Instance<b59b5027-502d-4e4d-8f0d-8e19961ba3e4> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75165) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 00:55:23 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-0088f120-e512-4c4e-bd2e-37e7377879f8 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:52:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1122751109',display_name='tempest-TestMinimumBasicScenario-server-1122751109',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1122751109',id=51,image_ref='bc9330e4-6355-46ac-9bc2-84be0afe29c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLrwnU95bX4MXNUTHar2eaBwFFDXaAKPvDXhaGoFnu8Q3nONzRsaw3xwMy98kEX6RSU/ez5DYEE4MxheYs9fETw9ddTIa3nk6bvxzEXDsTVNDnjYLWaz4whLAgBaNRNvag==',key_name='tempest-TestMinimumBasicScenario-649507707',keypairs=<?>,launch_index=0,launched_at=2023-10-26T00:52:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='f535693c3cbd4f4e969f279167ef7ba8',ramdisk_id='',reservation_id='r-y4cdz8zq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc9330e4-6355-46ac-9bc2-84be0afe29c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-387809061',owner_user_name='tempest-TestMinimumBasicScenario-387809061-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T00:55:20Z,user_data=None,user_id='d7f8020ca2184967b2a810b0e6c8d4a0',uuid=b59b5027-502d-4e4d-8f0d-8e19961ba3e4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5a3b58e2-07f1-427d-91e2-791138476ac6", "address": "fa:16:3e:73:3b:67", "network": {"id": "30343eb9-5e61-407a-8491-e58b28ff1645", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1025901471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f535693c3cbd4f4e969f279167ef7ba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a3b58e2-07", "ovs_interfaceid": "5a3b58e2-07f1-427d-91e2-791138476ac6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 00:55:23 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-0088f120-e512-4c4e-bd2e-37e7377879f8 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Converting VIF {"id": "5a3b58e2-07f1-427d-91e2-791138476ac6", "address": "fa:16:3e:73:3b:67", "network": {"id": "30343eb9-5e61-407a-8491-e58b28ff1645", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1025901471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f535693c3cbd4f4e969f279167ef7ba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a3b58e2-07", "ovs_interfaceid": "5a3b58e2-07f1-427d-91e2-791138476ac6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:55:23 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-0088f120-e512-4c4e-bd2e-37e7377879f8 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:73:3b:67,bridge_name='br-int',has_traffic_filtering=True,id=5a3b58e2-07f1-427d-91e2-791138476ac6,network=Network(30343eb9-5e61-407a-8491-e58b28ff1645),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a3b58e2-07') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:55:23 user nova-compute[75165]: DEBUG os_vif [None req-0088f120-e512-4c4e-bd2e-37e7377879f8 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:73:3b:67,bridge_name='br-int',has_traffic_filtering=True,id=5a3b58e2-07f1-427d-91e2-791138476ac6,network=Network(30343eb9-5e61-407a-8491-e58b28ff1645),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a3b58e2-07') {{(pid=75165) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 00:55:23 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:55:23 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:55:23 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 00:55:23 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:55:23 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '56de35cc-44c5-5c46-84f0-cdcff19779c2', '_type': 'linux-noop'}}, row=False) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:55:23 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:55:23 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:55:23 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:55:23 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5a3b58e2-07, may_exist=True, interface_attrs={}) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:55:23 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5a3b58e2-07, col_values=(('qos', UUID('4798ad1e-04f3-4fb8-ad68-8de65976fbd0')),), if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:55:23 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5a3b58e2-07, col_values=(('external_ids', {'iface-id': '5a3b58e2-07f1-427d-91e2-791138476ac6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:73:3b:67', 'vm-uuid': 'b59b5027-502d-4e4d-8f0d-8e19961ba3e4'}),), if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:55:23 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:55:23 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:55:23 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:55:23 user nova-compute[75165]: INFO os_vif [None req-0088f120-e512-4c4e-bd2e-37e7377879f8 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:73:3b:67,bridge_name='br-int',has_traffic_filtering=True,id=5a3b58e2-07f1-427d-91e2-791138476ac6,network=Network(30343eb9-5e61-407a-8491-e58b28ff1645),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a3b58e2-07')
Oct 26 00:55:24 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:55:24 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:55:24 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:55:24 user nova-compute[75165]: DEBUG nova.compute.manager [req-a3c58519-9368-409e-b04b-5939da42b308 req-45cad2c5-83b1-4faa-ba0f-c340927c1e68 service nova] [instance: b59b5027-502d-4e4d-8f0d-8e19961ba3e4] Received event network-vif-plugged-5a3b58e2-07f1-427d-91e2-791138476ac6 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:55:24 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-a3c58519-9368-409e-b04b-5939da42b308 req-45cad2c5-83b1-4faa-ba0f-c340927c1e68 service nova] Acquiring lock "b59b5027-502d-4e4d-8f0d-8e19961ba3e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:55:24 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-a3c58519-9368-409e-b04b-5939da42b308 req-45cad2c5-83b1-4faa-ba0f-c340927c1e68 service nova] Lock "b59b5027-502d-4e4d-8f0d-8e19961ba3e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:55:24 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-a3c58519-9368-409e-b04b-5939da42b308 req-45cad2c5-83b1-4faa-ba0f-c340927c1e68 service nova] Lock "b59b5027-502d-4e4d-8f0d-8e19961ba3e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:55:24 user nova-compute[75165]: DEBUG nova.compute.manager [req-a3c58519-9368-409e-b04b-5939da42b308 req-45cad2c5-83b1-4faa-ba0f-c340927c1e68 service nova] [instance: b59b5027-502d-4e4d-8f0d-8e19961ba3e4] No waiting events found dispatching network-vif-plugged-5a3b58e2-07f1-427d-91e2-791138476ac6 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:55:24 user nova-compute[75165]: WARNING nova.compute.manager [req-a3c58519-9368-409e-b04b-5939da42b308 req-45cad2c5-83b1-4faa-ba0f-c340927c1e68 service nova] [instance: b59b5027-502d-4e4d-8f0d-8e19961ba3e4] Received unexpected event network-vif-plugged-5a3b58e2-07f1-427d-91e2-791138476ac6 for instance with vm_state active and task_state reboot_started_hard.
Oct 26 00:55:25 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:55:25 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:55:26 user nova-compute[75165]: DEBUG nova.compute.manager [None req-0088f120-e512-4c4e-bd2e-37e7377879f8 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] [instance: b59b5027-502d-4e4d-8f0d-8e19961ba3e4] Instance event wait completed in 0 seconds for  {{(pid=75165) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 00:55:26 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: b59b5027-502d-4e4d-8f0d-8e19961ba3e4] Instance rebooted successfully.
Oct 26 00:55:26 user nova-compute[75165]: DEBUG nova.compute.manager [None req-0088f120-e512-4c4e-bd2e-37e7377879f8 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] [instance: b59b5027-502d-4e4d-8f0d-8e19961ba3e4] Checking state {{(pid=75165) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 00:55:26 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-0088f120-e512-4c4e-bd2e-37e7377879f8 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Lock "b59b5027-502d-4e4d-8f0d-8e19961ba3e4" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.312s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:55:26 user nova-compute[75165]: DEBUG nova.compute.manager [req-9a5ad015-e578-4777-9c5f-e1afb7205e64 req-4364c132-7505-4580-a3b1-c29118b9aff0 service nova] [instance: b59b5027-502d-4e4d-8f0d-8e19961ba3e4] Received event network-vif-plugged-5a3b58e2-07f1-427d-91e2-791138476ac6 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:55:26 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-9a5ad015-e578-4777-9c5f-e1afb7205e64 req-4364c132-7505-4580-a3b1-c29118b9aff0 service nova] Acquiring lock "b59b5027-502d-4e4d-8f0d-8e19961ba3e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:55:26 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-9a5ad015-e578-4777-9c5f-e1afb7205e64 req-4364c132-7505-4580-a3b1-c29118b9aff0 service nova] Lock "b59b5027-502d-4e4d-8f0d-8e19961ba3e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:55:26 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-9a5ad015-e578-4777-9c5f-e1afb7205e64 req-4364c132-7505-4580-a3b1-c29118b9aff0 service nova] Lock "b59b5027-502d-4e4d-8f0d-8e19961ba3e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:55:26 user nova-compute[75165]: DEBUG nova.compute.manager [req-9a5ad015-e578-4777-9c5f-e1afb7205e64 req-4364c132-7505-4580-a3b1-c29118b9aff0 service nova] [instance: b59b5027-502d-4e4d-8f0d-8e19961ba3e4] No waiting events found dispatching network-vif-plugged-5a3b58e2-07f1-427d-91e2-791138476ac6 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:55:26 user nova-compute[75165]: WARNING nova.compute.manager [req-9a5ad015-e578-4777-9c5f-e1afb7205e64 req-4364c132-7505-4580-a3b1-c29118b9aff0 service nova] [instance: b59b5027-502d-4e4d-8f0d-8e19961ba3e4] Received unexpected event network-vif-plugged-5a3b58e2-07f1-427d-91e2-791138476ac6 for instance with vm_state active and task_state None.
Oct 26 00:55:27 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:55:28 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:55:33 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:55:34 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:55:34 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75165) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 00:55:37 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:55:38 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:55:38 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:55:39 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:55:42 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:55:42 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:55:42 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:55:43 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:55:45 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:55:46 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:55:47 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:55:48 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:55:48 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:55:49 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:55:49 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:55:49 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:55:49 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:55:49 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75165) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 00:55:49 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b59b5027-502d-4e4d-8f0d-8e19961ba3e4/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:55:50 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b59b5027-502d-4e4d-8f0d-8e19961ba3e4/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:55:50 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b59b5027-502d-4e4d-8f0d-8e19961ba3e4/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:55:50 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b59b5027-502d-4e4d-8f0d-8e19961ba3e4/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:55:50 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75165) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 00:55:50 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:55:50 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:55:50 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Hypervisor/Node resource view: name=user free_ram=9011MB free_disk=24.72915267944336GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75165) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 00:55:50 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:55:50 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:55:50 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance b59b5027-502d-4e4d-8f0d-8e19961ba3e4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:55:50 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75165) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 00:55:50 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75165) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 00:55:50 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:55:50 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:55:50 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Compute_service record updated for user:user {{(pid=75165) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 00:55:50 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.180s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:55:51 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:55:51 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Starting heal instance info cache {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 00:55:51 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Rebuilding the list of instances to heal {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 00:55:51 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "refresh_cache-b59b5027-502d-4e4d-8f0d-8e19961ba3e4" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:55:51 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquired lock "refresh_cache-b59b5027-502d-4e4d-8f0d-8e19961ba3e4" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:55:51 user nova-compute[75165]: DEBUG nova.network.neutron [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: b59b5027-502d-4e4d-8f0d-8e19961ba3e4] Forcefully refreshing network info cache for instance {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 00:55:51 user nova-compute[75165]: DEBUG nova.objects.instance [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lazy-loading 'info_cache' on Instance uuid b59b5027-502d-4e4d-8f0d-8e19961ba3e4 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:55:52 user nova-compute[75165]: DEBUG nova.network.neutron [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: b59b5027-502d-4e4d-8f0d-8e19961ba3e4] Updating instance_info_cache with network_info: [{"id": "5a3b58e2-07f1-427d-91e2-791138476ac6", "address": "fa:16:3e:73:3b:67", "network": {"id": "30343eb9-5e61-407a-8491-e58b28ff1645", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1025901471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f535693c3cbd4f4e969f279167ef7ba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a3b58e2-07", "ovs_interfaceid": "5a3b58e2-07f1-427d-91e2-791138476ac6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:55:52 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:55:52 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Releasing lock "refresh_cache-b59b5027-502d-4e4d-8f0d-8e19961ba3e4" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:55:52 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: b59b5027-502d-4e4d-8f0d-8e19961ba3e4] Updated the network info_cache for instance {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 00:55:53 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:55:57 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:55:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:56:03 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:56:08 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:56:13 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:56:18 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:56:23 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:56:28 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:56:33 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:56:36 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:56:36 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75165) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 00:56:38 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:56:40 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:56:42 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:56:42 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:56:43 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:56:47 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:56:48 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:56:48 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:56:49 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:56:49 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:56:49 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:56:49 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:56:49 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:56:49 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75165) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 00:56:49 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b59b5027-502d-4e4d-8f0d-8e19961ba3e4/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:56:50 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b59b5027-502d-4e4d-8f0d-8e19961ba3e4/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:56:50 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b59b5027-502d-4e4d-8f0d-8e19961ba3e4/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:56:50 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b59b5027-502d-4e4d-8f0d-8e19961ba3e4/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:56:50 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75165) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 00:56:50 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:56:50 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:56:50 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Hypervisor/Node resource view: name=user free_ram=9056MB free_disk=24.728534698486328GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75165) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 00:56:50 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:56:50 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:56:50 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance b59b5027-502d-4e4d-8f0d-8e19961ba3e4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:56:50 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75165) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 00:56:50 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75165) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 00:56:50 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:56:50 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:56:50 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Compute_service record updated for user:user {{(pid=75165) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 00:56:50 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.167s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:56:51 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:56:51 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Starting heal instance info cache {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 00:56:51 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Rebuilding the list of instances to heal {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 00:56:51 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "refresh_cache-b59b5027-502d-4e4d-8f0d-8e19961ba3e4" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:56:51 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquired lock "refresh_cache-b59b5027-502d-4e4d-8f0d-8e19961ba3e4" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:56:51 user nova-compute[75165]: DEBUG nova.network.neutron [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: b59b5027-502d-4e4d-8f0d-8e19961ba3e4] Forcefully refreshing network info cache for instance {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 00:56:51 user nova-compute[75165]: DEBUG nova.objects.instance [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lazy-loading 'info_cache' on Instance uuid b59b5027-502d-4e4d-8f0d-8e19961ba3e4 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:56:52 user nova-compute[75165]: DEBUG nova.network.neutron [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: b59b5027-502d-4e4d-8f0d-8e19961ba3e4] Updating instance_info_cache with network_info: [{"id": "5a3b58e2-07f1-427d-91e2-791138476ac6", "address": "fa:16:3e:73:3b:67", "network": {"id": "30343eb9-5e61-407a-8491-e58b28ff1645", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1025901471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f535693c3cbd4f4e969f279167ef7ba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a3b58e2-07", "ovs_interfaceid": "5a3b58e2-07f1-427d-91e2-791138476ac6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:56:52 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Releasing lock "refresh_cache-b59b5027-502d-4e4d-8f0d-8e19961ba3e4" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:56:52 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: b59b5027-502d-4e4d-8f0d-8e19961ba3e4] Updated the network info_cache for instance {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 00:56:53 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:56:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:56:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:56:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75165) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 00:56:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75165) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 00:56:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75165) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 00:56:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:57:03 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:57:08 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:57:11 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:57:11 user nova-compute[75165]: DEBUG nova.compute.manager [req-c85fa248-b38f-46d0-9e39-ae172d68a2f0 req-946f28db-a990-48fe-87f8-92074ea84176 service nova] [instance: b59b5027-502d-4e4d-8f0d-8e19961ba3e4] Received event network-changed-5a3b58e2-07f1-427d-91e2-791138476ac6 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:57:11 user nova-compute[75165]: DEBUG nova.compute.manager [req-c85fa248-b38f-46d0-9e39-ae172d68a2f0 req-946f28db-a990-48fe-87f8-92074ea84176 service nova] [instance: b59b5027-502d-4e4d-8f0d-8e19961ba3e4] Refreshing instance network info cache due to event network-changed-5a3b58e2-07f1-427d-91e2-791138476ac6. {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 00:57:11 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-c85fa248-b38f-46d0-9e39-ae172d68a2f0 req-946f28db-a990-48fe-87f8-92074ea84176 service nova] Acquiring lock "refresh_cache-b59b5027-502d-4e4d-8f0d-8e19961ba3e4" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:57:11 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-c85fa248-b38f-46d0-9e39-ae172d68a2f0 req-946f28db-a990-48fe-87f8-92074ea84176 service nova] Acquired lock "refresh_cache-b59b5027-502d-4e4d-8f0d-8e19961ba3e4" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:57:11 user nova-compute[75165]: DEBUG nova.network.neutron [req-c85fa248-b38f-46d0-9e39-ae172d68a2f0 req-946f28db-a990-48fe-87f8-92074ea84176 service nova] [instance: b59b5027-502d-4e4d-8f0d-8e19961ba3e4] Refreshing network info cache for port 5a3b58e2-07f1-427d-91e2-791138476ac6 {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 00:57:11 user nova-compute[75165]: DEBUG nova.network.neutron [req-c85fa248-b38f-46d0-9e39-ae172d68a2f0 req-946f28db-a990-48fe-87f8-92074ea84176 service nova] [instance: b59b5027-502d-4e4d-8f0d-8e19961ba3e4] Updated VIF entry in instance network info cache for port 5a3b58e2-07f1-427d-91e2-791138476ac6. {{(pid=75165) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 00:57:11 user nova-compute[75165]: DEBUG nova.network.neutron [req-c85fa248-b38f-46d0-9e39-ae172d68a2f0 req-946f28db-a990-48fe-87f8-92074ea84176 service nova] [instance: b59b5027-502d-4e4d-8f0d-8e19961ba3e4] Updating instance_info_cache with network_info: [{"id": "5a3b58e2-07f1-427d-91e2-791138476ac6", "address": "fa:16:3e:73:3b:67", "network": {"id": "30343eb9-5e61-407a-8491-e58b28ff1645", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1025901471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f535693c3cbd4f4e969f279167ef7ba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a3b58e2-07", "ovs_interfaceid": "5a3b58e2-07f1-427d-91e2-791138476ac6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:57:11 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-c85fa248-b38f-46d0-9e39-ae172d68a2f0 req-946f28db-a990-48fe-87f8-92074ea84176 service nova] Releasing lock "refresh_cache-b59b5027-502d-4e4d-8f0d-8e19961ba3e4" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:57:12 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-c17d97ab-31b1-4a7a-b631-bd6682fffc42 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Acquiring lock "b59b5027-502d-4e4d-8f0d-8e19961ba3e4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:57:12 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-c17d97ab-31b1-4a7a-b631-bd6682fffc42 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Lock "b59b5027-502d-4e4d-8f0d-8e19961ba3e4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:57:12 user nova-compute[75165]: INFO nova.compute.manager [None req-c17d97ab-31b1-4a7a-b631-bd6682fffc42 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] [instance: b59b5027-502d-4e4d-8f0d-8e19961ba3e4] Detaching volume f30b1013-6007-485f-bc23-1e0362241d38
Oct 26 00:57:12 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:57:12 user nova-compute[75165]: INFO nova.virt.block_device [None req-c17d97ab-31b1-4a7a-b631-bd6682fffc42 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] [instance: b59b5027-502d-4e4d-8f0d-8e19961ba3e4] Attempting to driver detach volume f30b1013-6007-485f-bc23-1e0362241d38 from mountpoint /dev/vdb
Oct 26 00:57:12 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-c17d97ab-31b1-4a7a-b631-bd6682fffc42 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Attempting to detach device vdb from instance b59b5027-502d-4e4d-8f0d-8e19961ba3e4 from the persistent domain config. {{(pid=75165) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 00:57:12 user nova-compute[75165]: DEBUG nova.virt.libvirt.guest [None req-c17d97ab-31b1-4a7a-b631-bd6682fffc42 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 00:57:12 user nova-compute[75165]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 00:57:12 user nova-compute[75165]:   <source dev="/dev/sdb"/>
Oct 26 00:57:12 user nova-compute[75165]:   <target dev="vdb" bus="virtio"/>
Oct 26 00:57:12 user nova-compute[75165]:   <serial>f30b1013-6007-485f-bc23-1e0362241d38</serial>
Oct 26 00:57:12 user nova-compute[75165]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 26 00:57:12 user nova-compute[75165]: </disk>
Oct 26 00:57:12 user nova-compute[75165]:  {{(pid=75165) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 00:57:12 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-c17d97ab-31b1-4a7a-b631-bd6682fffc42 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Successfully detached device vdb from instance b59b5027-502d-4e4d-8f0d-8e19961ba3e4 from the persistent domain config.
Oct 26 00:57:12 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-c17d97ab-31b1-4a7a-b631-bd6682fffc42 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b59b5027-502d-4e4d-8f0d-8e19961ba3e4 from the live domain config. {{(pid=75165) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 00:57:12 user nova-compute[75165]: DEBUG nova.virt.libvirt.guest [None req-c17d97ab-31b1-4a7a-b631-bd6682fffc42 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 00:57:12 user nova-compute[75165]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 00:57:12 user nova-compute[75165]:   <source dev="/dev/sdb"/>
Oct 26 00:57:12 user nova-compute[75165]:   <target dev="vdb" bus="virtio"/>
Oct 26 00:57:12 user nova-compute[75165]:   <serial>f30b1013-6007-485f-bc23-1e0362241d38</serial>
Oct 26 00:57:12 user nova-compute[75165]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 26 00:57:12 user nova-compute[75165]: </disk>
Oct 26 00:57:12 user nova-compute[75165]:  {{(pid=75165) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 00:57:12 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-c17d97ab-31b1-4a7a-b631-bd6682fffc42 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b59b5027-502d-4e4d-8f0d-8e19961ba3e4 {{(pid=75165) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 00:57:13 user nova-compute[75165]: DEBUG nova.compute.manager [req-eaeaeecd-66dd-4135-a3dd-7110cfd458c5 req-bece1d6d-1aa5-4a83-a1f3-d673b40bc0c8 service nova] [instance: b59b5027-502d-4e4d-8f0d-8e19961ba3e4] Received event network-changed-5a3b58e2-07f1-427d-91e2-791138476ac6 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:57:13 user nova-compute[75165]: DEBUG nova.compute.manager [req-eaeaeecd-66dd-4135-a3dd-7110cfd458c5 req-bece1d6d-1aa5-4a83-a1f3-d673b40bc0c8 service nova] [instance: b59b5027-502d-4e4d-8f0d-8e19961ba3e4] Refreshing instance network info cache due to event network-changed-5a3b58e2-07f1-427d-91e2-791138476ac6. {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 00:57:13 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-eaeaeecd-66dd-4135-a3dd-7110cfd458c5 req-bece1d6d-1aa5-4a83-a1f3-d673b40bc0c8 service nova] Acquiring lock "refresh_cache-b59b5027-502d-4e4d-8f0d-8e19961ba3e4" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:57:13 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-eaeaeecd-66dd-4135-a3dd-7110cfd458c5 req-bece1d6d-1aa5-4a83-a1f3-d673b40bc0c8 service nova] Acquired lock "refresh_cache-b59b5027-502d-4e4d-8f0d-8e19961ba3e4" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:57:13 user nova-compute[75165]: DEBUG nova.network.neutron [req-eaeaeecd-66dd-4135-a3dd-7110cfd458c5 req-bece1d6d-1aa5-4a83-a1f3-d673b40bc0c8 service nova] [instance: b59b5027-502d-4e4d-8f0d-8e19961ba3e4] Refreshing network info cache for port 5a3b58e2-07f1-427d-91e2-791138476ac6 {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 00:57:13 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:57:13 user nova-compute[75165]: DEBUG nova.network.neutron [req-eaeaeecd-66dd-4135-a3dd-7110cfd458c5 req-bece1d6d-1aa5-4a83-a1f3-d673b40bc0c8 service nova] [instance: b59b5027-502d-4e4d-8f0d-8e19961ba3e4] Updated VIF entry in instance network info cache for port 5a3b58e2-07f1-427d-91e2-791138476ac6. {{(pid=75165) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 00:57:13 user nova-compute[75165]: DEBUG nova.network.neutron [req-eaeaeecd-66dd-4135-a3dd-7110cfd458c5 req-bece1d6d-1aa5-4a83-a1f3-d673b40bc0c8 service nova] [instance: b59b5027-502d-4e4d-8f0d-8e19961ba3e4] Updating instance_info_cache with network_info: [{"id": "5a3b58e2-07f1-427d-91e2-791138476ac6", "address": "fa:16:3e:73:3b:67", "network": {"id": "30343eb9-5e61-407a-8491-e58b28ff1645", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1025901471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f535693c3cbd4f4e969f279167ef7ba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a3b58e2-07", "ovs_interfaceid": "5a3b58e2-07f1-427d-91e2-791138476ac6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:57:13 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-eaeaeecd-66dd-4135-a3dd-7110cfd458c5 req-bece1d6d-1aa5-4a83-a1f3-d673b40bc0c8 service nova] Releasing lock "refresh_cache-b59b5027-502d-4e4d-8f0d-8e19961ba3e4" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:57:18 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:57:18 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:57:18 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75165) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 00:57:18 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75165) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 00:57:18 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75165) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 00:57:18 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:57:23 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:57:28 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:57:32 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-c17d97ab-31b1-4a7a-b631-bd6682fffc42 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b59b5027-502d-4e4d-8f0d-8e19961ba3e4 is timed out.
Oct 26 00:57:32 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-c17d97ab-31b1-4a7a-b631-bd6682fffc42 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Successfully detached device vdb from instance b59b5027-502d-4e4d-8f0d-8e19961ba3e4 from the live domain config.
Oct 26 00:57:32 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c17d97ab-31b1-4a7a-b631-bd6682fffc42 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] [instance: b59b5027-502d-4e4d-8f0d-8e19961ba3e4] calling os-brick to detach iSCSI Volume {{(pid=75165) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 00:57:32 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-c17d97ab-31b1-4a7a-b631-bd6682fffc42 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8bf8160e50>, {'target_iqn': 'iqn.2010-10.org.openstack:f30b1013-6007-485f-bc23-1e0362241d38', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xObhESdr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 00:57:32 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-c17d97ab-31b1-4a7a-b631-bd6682fffc42 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 00:57:32 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-c17d97ab-31b1-4a7a-b631-bd6682fffc42 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 00:57:32 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-c17d97ab-31b1-4a7a-b631-bd6682fffc42 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 00:57:32 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:57:32 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:57:32 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[22cfe709-f46c-44ee-98e6-79a88014e4c8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f30b1013-6007-485f-bc23-1e0362241d38\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:57:32 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-c17d97ab-31b1-4a7a-b631-bd6682fffc42 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 00:57:32 user nova-compute[75165]: No targets found.
Oct 26 00:57:32 user nova-compute[75165]: iSNS:
Oct 26 00:57:32 user nova-compute[75165]: No targets found.
Oct 26 00:57:32 user nova-compute[75165]: STATIC:
Oct 26 00:57:32 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:f30b1013-6007-485f-bc23-1e0362241d38
Oct 26 00:57:32 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 00:57:32 user nova-compute[75165]:                 Iface Name: default
Oct 26 00:57:32 user nova-compute[75165]: FIRMWARE:
Oct 26 00:57:32 user nova-compute[75165]: No targets found.
Oct 26 00:57:32 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:57:32 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-c17d97ab-31b1-4a7a-b631-bd6682fffc42 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 00:57:32 user nova-compute[75165]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 00:57:32 user nova-compute[75165]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75165) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 00:57:32 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-c17d97ab-31b1-4a7a-b631-bd6682fffc42 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f30b1013-6007-485f-bc23-1e0362241d38', 0)] {{(pid=75165) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 00:57:32 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:57:32 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:57:32 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[47e9abb3-c940-4ee7-8efa-8e4dfabcb5e8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f30b1013-6007-485f-bc23-1e0362241d38\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:57:32 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:57:32 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:57:32 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[f04e0e64-79ed-4c44-a39d-91125ed85826]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f30b1013-6007-485f-bc23-1e0362241d38 (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:57:32 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-c17d97ab-31b1-4a7a-b631-bd6682fffc42 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f30b1013-6007-485f-bc23-1e0362241d38 (non-flash)
Oct 26 00:57:32 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 00:57:32 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-c17d97ab-31b1-4a7a-b631-bd6682fffc42 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f30b1013-6007-485f-bc23-1e0362241d38 (non-flash)
Oct 26 00:57:32 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 00:57:32 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-c17d97ab-31b1-4a7a-b631-bd6682fffc42 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8be01cbd00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f30b1013-6007-485f-bc23-1e0362241d38'): ({'sdb'}, set())}) {{(pid=75165) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 00:57:32 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-c17d97ab-31b1-4a7a-b631-bd6682fffc42 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Removing single pathed devices sdb {{(pid=75165) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 00:57:32 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:57:32 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:57:32 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c40514d-2c3a-4980-8212-7c122dea27a6]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:57:32 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:57:32 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:57:32 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc96a8bf-89fe-4d37-8499-c3cb6faeee39]: (4, ('ok\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:57:32 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-c17d97ab-31b1-4a7a-b631-bd6682fffc42 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Flushing IO for device /dev/sdb {{(pid=75165) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 00:57:32 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:57:33 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:57:33 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce486e34-a0cb-4a2e-9620-bbd4b67b232e]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:57:33 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-c17d97ab-31b1-4a7a-b631-bd6682fffc42 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75165) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 00:57:33 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:57:33 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:57:33 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b0bcc63-a762-4725-b141-a5dcd4ffd27e]: (4, ('1', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:57:33 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-c17d97ab-31b1-4a7a-b631-bd6682fffc42 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75165) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 00:57:33 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-c17d97ab-31b1-4a7a-b631-bd6682fffc42 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] SCSI volumes sdb have been removed. {{(pid=75165) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 00:57:33 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-c17d97ab-31b1-4a7a-b631-bd6682fffc42 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f30b1013-6007-485f-bc23-1e0362241d38')] {{(pid=75165) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 00:57:33 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f30b1013-6007-485f-bc23-1e0362241d38 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:57:33 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f30b1013-6007-485f-bc23-1e0362241d38 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:57:33 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9d5efaf-fad4-475f-958f-75a691e7bf1b]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:57:33 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-c17d97ab-31b1-4a7a-b631-bd6682fffc42 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:57:33 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f30b1013-6007-485f-bc23-1e0362241d38 -p 172.16.0.220:3260 --logout {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:57:33 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f30b1013-6007-485f-bc23-1e0362241d38 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:57:33 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e802c83-a6b9-45a4-bd90-fa9d9d7d751b]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:f30b1013-6007-485f-bc23-1e0362241d38, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:f30b1013-6007-485f-bc23-1e0362241d38, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:57:33 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-c17d97ab-31b1-4a7a-b631-bd6682fffc42 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:f30b1013-6007-485f-bc23-1e0362241d38, portal: 172.16.0.220,3260]
Oct 26 00:57:33 user nova-compute[75165]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:f30b1013-6007-485f-bc23-1e0362241d38, portal: 172.16.0.220,3260] successful.
Oct 26 00:57:33 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:57:33 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f30b1013-6007-485f-bc23-1e0362241d38 -p 172.16.0.220:3260 --op delete {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:57:33 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f30b1013-6007-485f-bc23-1e0362241d38 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:57:33 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[08a95eed-3d8c-4858-bd19-5a88b6fbe3e5]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 00:57:33 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-c17d97ab-31b1-4a7a-b631-bd6682fffc42 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 00:57:33 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-c17d97ab-31b1-4a7a-b631-bd6682fffc42 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.276s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 00:57:33 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-c17d97ab-31b1-4a7a-b631-bd6682fffc42 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] <== disconnect_volume: return (278ms) None {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 00:57:33 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c17d97ab-31b1-4a7a-b631-bd6682fffc42 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] [instance: b59b5027-502d-4e4d-8f0d-8e19961ba3e4] Disconnected iSCSI Volume {{(pid=75165) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 00:57:33 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:57:34 user nova-compute[75165]: DEBUG nova.objects.instance [None req-c17d97ab-31b1-4a7a-b631-bd6682fffc42 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Lazy-loading 'flavor' on Instance uuid b59b5027-502d-4e4d-8f0d-8e19961ba3e4 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:57:34 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-c17d97ab-31b1-4a7a-b631-bd6682fffc42 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Lock "b59b5027-502d-4e4d-8f0d-8e19961ba3e4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.738s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:57:36 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:57:36 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75165) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 00:57:38 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:57:38 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:57:40 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:57:42 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:57:43 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:57:44 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:57:47 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:57:48 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:57:49 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:57:49 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:57:49 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:57:49 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:57:49 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:57:49 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:57:49 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75165) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 00:57:49 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b59b5027-502d-4e4d-8f0d-8e19961ba3e4/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:57:50 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b59b5027-502d-4e4d-8f0d-8e19961ba3e4/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:57:50 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b59b5027-502d-4e4d-8f0d-8e19961ba3e4/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:57:50 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b59b5027-502d-4e4d-8f0d-8e19961ba3e4/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:57:50 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:57:50 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:57:50 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Hypervisor/Node resource view: name=user free_ram=9069MB free_disk=24.72775650024414GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75165) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 00:57:50 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:57:50 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:57:50 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance b59b5027-502d-4e4d-8f0d-8e19961ba3e4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:57:50 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75165) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 00:57:50 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75165) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 00:57:50 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:57:50 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:57:50 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Compute_service record updated for user:user {{(pid=75165) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 00:57:50 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.188s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:57:51 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:57:51 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Starting heal instance info cache {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 00:57:51 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Rebuilding the list of instances to heal {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 00:57:52 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "refresh_cache-b59b5027-502d-4e4d-8f0d-8e19961ba3e4" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:57:52 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquired lock "refresh_cache-b59b5027-502d-4e4d-8f0d-8e19961ba3e4" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:57:52 user nova-compute[75165]: DEBUG nova.network.neutron [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: b59b5027-502d-4e4d-8f0d-8e19961ba3e4] Forcefully refreshing network info cache for instance {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 00:57:52 user nova-compute[75165]: DEBUG nova.objects.instance [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lazy-loading 'info_cache' on Instance uuid b59b5027-502d-4e4d-8f0d-8e19961ba3e4 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:57:52 user nova-compute[75165]: DEBUG nova.network.neutron [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: b59b5027-502d-4e4d-8f0d-8e19961ba3e4] Updating instance_info_cache with network_info: [{"id": "5a3b58e2-07f1-427d-91e2-791138476ac6", "address": "fa:16:3e:73:3b:67", "network": {"id": "30343eb9-5e61-407a-8491-e58b28ff1645", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1025901471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f535693c3cbd4f4e969f279167ef7ba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a3b58e2-07", "ovs_interfaceid": "5a3b58e2-07f1-427d-91e2-791138476ac6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:57:52 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Releasing lock "refresh_cache-b59b5027-502d-4e4d-8f0d-8e19961ba3e4" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:57:52 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: b59b5027-502d-4e4d-8f0d-8e19961ba3e4] Updated the network info_cache for instance {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 00:57:53 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:57:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:58:03 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:58:08 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:58:08 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:58:08 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=75165) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 00:58:08 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75165) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 00:58:08 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75165) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 00:58:08 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:58:12 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-fcd5ac18-f5a4-4ab4-83f5-7eac931e26af tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Acquiring lock "b59b5027-502d-4e4d-8f0d-8e19961ba3e4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:58:12 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-fcd5ac18-f5a4-4ab4-83f5-7eac931e26af tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Lock "b59b5027-502d-4e4d-8f0d-8e19961ba3e4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:58:12 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-fcd5ac18-f5a4-4ab4-83f5-7eac931e26af tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Acquiring lock "b59b5027-502d-4e4d-8f0d-8e19961ba3e4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:58:12 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-fcd5ac18-f5a4-4ab4-83f5-7eac931e26af tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Lock "b59b5027-502d-4e4d-8f0d-8e19961ba3e4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:58:12 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-fcd5ac18-f5a4-4ab4-83f5-7eac931e26af tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Lock "b59b5027-502d-4e4d-8f0d-8e19961ba3e4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:58:12 user nova-compute[75165]: INFO nova.compute.manager [None req-fcd5ac18-f5a4-4ab4-83f5-7eac931e26af tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] [instance: b59b5027-502d-4e4d-8f0d-8e19961ba3e4] Terminating instance
Oct 26 00:58:12 user nova-compute[75165]: DEBUG nova.compute.manager [None req-fcd5ac18-f5a4-4ab4-83f5-7eac931e26af tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] [instance: b59b5027-502d-4e4d-8f0d-8e19961ba3e4] Start destroying the instance on the hypervisor. {{(pid=75165) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 00:58:12 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:58:12 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:58:12 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:58:12 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:58:12 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:58:12 user nova-compute[75165]: DEBUG nova.compute.manager [req-6aaeec66-108e-4e4f-afb7-14f794fa79d9 req-e4271fba-967a-4b3d-ac87-e11ac5a03e3f service nova] [instance: b59b5027-502d-4e4d-8f0d-8e19961ba3e4] Received event network-vif-unplugged-5a3b58e2-07f1-427d-91e2-791138476ac6 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:58:12 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-6aaeec66-108e-4e4f-afb7-14f794fa79d9 req-e4271fba-967a-4b3d-ac87-e11ac5a03e3f service nova] Acquiring lock "b59b5027-502d-4e4d-8f0d-8e19961ba3e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:58:12 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-6aaeec66-108e-4e4f-afb7-14f794fa79d9 req-e4271fba-967a-4b3d-ac87-e11ac5a03e3f service nova] Lock "b59b5027-502d-4e4d-8f0d-8e19961ba3e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:58:12 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-6aaeec66-108e-4e4f-afb7-14f794fa79d9 req-e4271fba-967a-4b3d-ac87-e11ac5a03e3f service nova] Lock "b59b5027-502d-4e4d-8f0d-8e19961ba3e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:58:12 user nova-compute[75165]: DEBUG nova.compute.manager [req-6aaeec66-108e-4e4f-afb7-14f794fa79d9 req-e4271fba-967a-4b3d-ac87-e11ac5a03e3f service nova] [instance: b59b5027-502d-4e4d-8f0d-8e19961ba3e4] No waiting events found dispatching network-vif-unplugged-5a3b58e2-07f1-427d-91e2-791138476ac6 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:58:12 user nova-compute[75165]: DEBUG nova.compute.manager [req-6aaeec66-108e-4e4f-afb7-14f794fa79d9 req-e4271fba-967a-4b3d-ac87-e11ac5a03e3f service nova] [instance: b59b5027-502d-4e4d-8f0d-8e19961ba3e4] Received event network-vif-unplugged-5a3b58e2-07f1-427d-91e2-791138476ac6 for instance with task_state deleting. {{(pid=75165) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 00:58:12 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:58:13 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: b59b5027-502d-4e4d-8f0d-8e19961ba3e4] Instance destroyed successfully.
Oct 26 00:58:13 user nova-compute[75165]: DEBUG nova.objects.instance [None req-fcd5ac18-f5a4-4ab4-83f5-7eac931e26af tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Lazy-loading 'resources' on Instance uuid b59b5027-502d-4e4d-8f0d-8e19961ba3e4 {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:58:13 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-fcd5ac18-f5a4-4ab4-83f5-7eac931e26af tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:52:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1122751109',display_name='tempest-TestMinimumBasicScenario-server-1122751109',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1122751109',id=51,image_ref='bc9330e4-6355-46ac-9bc2-84be0afe29c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLrwnU95bX4MXNUTHar2eaBwFFDXaAKPvDXhaGoFnu8Q3nONzRsaw3xwMy98kEX6RSU/ez5DYEE4MxheYs9fETw9ddTIa3nk6bvxzEXDsTVNDnjYLWaz4whLAgBaNRNvag==',key_name='tempest-TestMinimumBasicScenario-649507707',keypairs=<?>,launch_index=0,launched_at=2023-10-26T00:52:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f535693c3cbd4f4e969f279167ef7ba8',ramdisk_id='',reservation_id='r-y4cdz8zq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bc9330e4-6355-46ac-9bc2-84be0afe29c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-387809061',owner_user_name='tempest-TestMinimumBasicScenario-387809061-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T00:55:27Z,user_data=None,user_id='d7f8020ca2184967b2a810b0e6c8d4a0',uuid=b59b5027-502d-4e4d-8f0d-8e19961ba3e4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5a3b58e2-07f1-427d-91e2-791138476ac6", "address": "fa:16:3e:73:3b:67", "network": {"id": "30343eb9-5e61-407a-8491-e58b28ff1645", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1025901471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f535693c3cbd4f4e969f279167ef7ba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a3b58e2-07", "ovs_interfaceid": "5a3b58e2-07f1-427d-91e2-791138476ac6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 00:58:13 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-fcd5ac18-f5a4-4ab4-83f5-7eac931e26af tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Converting VIF {"id": "5a3b58e2-07f1-427d-91e2-791138476ac6", "address": "fa:16:3e:73:3b:67", "network": {"id": "30343eb9-5e61-407a-8491-e58b28ff1645", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1025901471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f535693c3cbd4f4e969f279167ef7ba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a3b58e2-07", "ovs_interfaceid": "5a3b58e2-07f1-427d-91e2-791138476ac6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:58:13 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-fcd5ac18-f5a4-4ab4-83f5-7eac931e26af tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:73:3b:67,bridge_name='br-int',has_traffic_filtering=True,id=5a3b58e2-07f1-427d-91e2-791138476ac6,network=Network(30343eb9-5e61-407a-8491-e58b28ff1645),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a3b58e2-07') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:58:13 user nova-compute[75165]: DEBUG os_vif [None req-fcd5ac18-f5a4-4ab4-83f5-7eac931e26af tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:73:3b:67,bridge_name='br-int',has_traffic_filtering=True,id=5a3b58e2-07f1-427d-91e2-791138476ac6,network=Network(30343eb9-5e61-407a-8491-e58b28ff1645),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a3b58e2-07') {{(pid=75165) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 00:58:13 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:58:13 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5a3b58e2-07, bridge=br-int, if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:58:13 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:58:13 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:58:13 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:58:13 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4798ad1e-04f3-4fb8-ad68-8de65976fbd0) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:58:13 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:58:13 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:58:13 user nova-compute[75165]: INFO os_vif [None req-fcd5ac18-f5a4-4ab4-83f5-7eac931e26af tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:73:3b:67,bridge_name='br-int',has_traffic_filtering=True,id=5a3b58e2-07f1-427d-91e2-791138476ac6,network=Network(30343eb9-5e61-407a-8491-e58b28ff1645),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a3b58e2-07')
Oct 26 00:58:13 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-fcd5ac18-f5a4-4ab4-83f5-7eac931e26af tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] [instance: b59b5027-502d-4e4d-8f0d-8e19961ba3e4] Deleting instance files /opt/stack/data/nova/instances/b59b5027-502d-4e4d-8f0d-8e19961ba3e4_del
Oct 26 00:58:13 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-fcd5ac18-f5a4-4ab4-83f5-7eac931e26af tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] [instance: b59b5027-502d-4e4d-8f0d-8e19961ba3e4] Deletion of /opt/stack/data/nova/instances/b59b5027-502d-4e4d-8f0d-8e19961ba3e4_del complete
Oct 26 00:58:13 user nova-compute[75165]: INFO nova.compute.manager [None req-fcd5ac18-f5a4-4ab4-83f5-7eac931e26af tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] [instance: b59b5027-502d-4e4d-8f0d-8e19961ba3e4] Took 0.85 seconds to destroy the instance on the hypervisor.
Oct 26 00:58:13 user nova-compute[75165]: DEBUG oslo.service.loopingcall [None req-fcd5ac18-f5a4-4ab4-83f5-7eac931e26af tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75165) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 00:58:13 user nova-compute[75165]: DEBUG nova.compute.manager [-] [instance: b59b5027-502d-4e4d-8f0d-8e19961ba3e4] Deallocating network for instance {{(pid=75165) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 00:58:13 user nova-compute[75165]: DEBUG nova.network.neutron [-] [instance: b59b5027-502d-4e4d-8f0d-8e19961ba3e4] deallocate_for_instance() {{(pid=75165) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 00:58:13 user nova-compute[75165]: DEBUG nova.network.neutron [-] [instance: b59b5027-502d-4e4d-8f0d-8e19961ba3e4] Updating instance_info_cache with network_info: [] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:58:13 user nova-compute[75165]: INFO nova.compute.manager [-] [instance: b59b5027-502d-4e4d-8f0d-8e19961ba3e4] Took 0.59 seconds to deallocate network for instance.
Oct 26 00:58:14 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-fcd5ac18-f5a4-4ab4-83f5-7eac931e26af tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:58:14 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-fcd5ac18-f5a4-4ab4-83f5-7eac931e26af tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:58:14 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-fcd5ac18-f5a4-4ab4-83f5-7eac931e26af tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:58:14 user nova-compute[75165]: DEBUG nova.compute.manager [req-b0fe0f46-af07-4c76-9f12-8d87a38f4fa4 req-be7fe484-1618-4ec2-99be-59f00930814a service nova] [instance: b59b5027-502d-4e4d-8f0d-8e19961ba3e4] Received event network-vif-deleted-5a3b58e2-07f1-427d-91e2-791138476ac6 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:58:14 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-fcd5ac18-f5a4-4ab4-83f5-7eac931e26af tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:58:14 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-fcd5ac18-f5a4-4ab4-83f5-7eac931e26af tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.119s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:58:14 user nova-compute[75165]: INFO nova.scheduler.client.report [None req-fcd5ac18-f5a4-4ab4-83f5-7eac931e26af tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Deleted allocations for instance b59b5027-502d-4e4d-8f0d-8e19961ba3e4
Oct 26 00:58:14 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-fcd5ac18-f5a4-4ab4-83f5-7eac931e26af tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Lock "b59b5027-502d-4e4d-8f0d-8e19961ba3e4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.744s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:58:14 user nova-compute[75165]: DEBUG nova.compute.manager [req-59db1beb-eb66-484a-81fe-bfcddcb15ee4 req-d527a568-32b9-41fb-a4fb-a78b5ffced45 service nova] [instance: b59b5027-502d-4e4d-8f0d-8e19961ba3e4] Received event network-vif-plugged-5a3b58e2-07f1-427d-91e2-791138476ac6 {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:58:14 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-59db1beb-eb66-484a-81fe-bfcddcb15ee4 req-d527a568-32b9-41fb-a4fb-a78b5ffced45 service nova] Acquiring lock "b59b5027-502d-4e4d-8f0d-8e19961ba3e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:58:14 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-59db1beb-eb66-484a-81fe-bfcddcb15ee4 req-d527a568-32b9-41fb-a4fb-a78b5ffced45 service nova] Lock "b59b5027-502d-4e4d-8f0d-8e19961ba3e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:58:14 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-59db1beb-eb66-484a-81fe-bfcddcb15ee4 req-d527a568-32b9-41fb-a4fb-a78b5ffced45 service nova] Lock "b59b5027-502d-4e4d-8f0d-8e19961ba3e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:58:14 user nova-compute[75165]: DEBUG nova.compute.manager [req-59db1beb-eb66-484a-81fe-bfcddcb15ee4 req-d527a568-32b9-41fb-a4fb-a78b5ffced45 service nova] [instance: b59b5027-502d-4e4d-8f0d-8e19961ba3e4] No waiting events found dispatching network-vif-plugged-5a3b58e2-07f1-427d-91e2-791138476ac6 {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:58:14 user nova-compute[75165]: WARNING nova.compute.manager [req-59db1beb-eb66-484a-81fe-bfcddcb15ee4 req-d527a568-32b9-41fb-a4fb-a78b5ffced45 service nova] [instance: b59b5027-502d-4e4d-8f0d-8e19961ba3e4] Received unexpected event network-vif-plugged-5a3b58e2-07f1-427d-91e2-791138476ac6 for instance with vm_state deleted and task_state None.
Oct 26 00:58:18 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:58:23 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:58:28 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:58:33 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:58:38 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:58:38 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:58:38 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75165) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 00:58:42 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:58:43 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:58:44 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:58:44 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:58:46 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:58:48 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:58:49 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:58:49 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:58:50 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:58:50 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:58:50 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:58:50 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:58:50 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:58:50 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75165) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 00:58:51 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:58:51 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:58:51 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Hypervisor/Node resource view: name=user free_ram=9186MB free_disk=24.755146026611328GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75165) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 00:58:51 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:58:51 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:58:51 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75165) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 00:58:51 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75165) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 00:58:51 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Refreshing inventories for resource provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 26 00:58:51 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Updating ProviderTree inventory for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 26 00:58:51 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Updating inventory in ProviderTree for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 26 00:58:51 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Refreshing aggregate associations for resource provider 03214fd5-21d1-46ec-b6b0-6449b77ba230, aggregates: None {{(pid=75165) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 26 00:58:51 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Refreshing trait associations for resource provider 03214fd5-21d1-46ec-b6b0-6449b77ba230, traits: COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NODE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_TRUSTED_CERTS,COMPUTE_DEVICE_TAGGING,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO {{(pid=75165) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 26 00:58:51 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:58:51 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:58:51 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Compute_service record updated for user:user {{(pid=75165) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 00:58:51 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.416s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:58:52 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:58:52 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Starting heal instance info cache {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 00:58:52 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Rebuilding the list of instances to heal {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 00:58:52 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Didn't find any instances for network info cache update. {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 26 00:58:53 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:58:58 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:59:01 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:59:01 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75165) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 26 00:59:03 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:59:06 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-2fdaa314-a681-49ce-b46c-a59d769926a1 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Acquiring lock "5dc4f5bd-aba6-476c-a924-503108815feb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:59:06 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-2fdaa314-a681-49ce-b46c-a59d769926a1 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Lock "5dc4f5bd-aba6-476c-a924-503108815feb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:59:06 user nova-compute[75165]: DEBUG nova.compute.manager [None req-2fdaa314-a681-49ce-b46c-a59d769926a1 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] [instance: 5dc4f5bd-aba6-476c-a924-503108815feb] Starting instance... {{(pid=75165) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 00:59:06 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-2fdaa314-a681-49ce-b46c-a59d769926a1 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:59:06 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-2fdaa314-a681-49ce-b46c-a59d769926a1 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:59:06 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-2fdaa314-a681-49ce-b46c-a59d769926a1 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75165) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 00:59:06 user nova-compute[75165]: INFO nova.compute.claims [None req-2fdaa314-a681-49ce-b46c-a59d769926a1 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] [instance: 5dc4f5bd-aba6-476c-a924-503108815feb] Claim successful on node user
Oct 26 00:59:06 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-2fdaa314-a681-49ce-b46c-a59d769926a1 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:59:06 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-2fdaa314-a681-49ce-b46c-a59d769926a1 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:59:06 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-2fdaa314-a681-49ce-b46c-a59d769926a1 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.219s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:59:06 user nova-compute[75165]: DEBUG nova.compute.manager [None req-2fdaa314-a681-49ce-b46c-a59d769926a1 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] [instance: 5dc4f5bd-aba6-476c-a924-503108815feb] Start building networks asynchronously for instance. {{(pid=75165) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 00:59:06 user nova-compute[75165]: DEBUG nova.compute.manager [None req-2fdaa314-a681-49ce-b46c-a59d769926a1 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] [instance: 5dc4f5bd-aba6-476c-a924-503108815feb] Allocating IP information in the background. {{(pid=75165) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 00:59:06 user nova-compute[75165]: DEBUG nova.network.neutron [None req-2fdaa314-a681-49ce-b46c-a59d769926a1 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] [instance: 5dc4f5bd-aba6-476c-a924-503108815feb] allocate_for_instance() {{(pid=75165) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 00:59:06 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-2fdaa314-a681-49ce-b46c-a59d769926a1 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] [instance: 5dc4f5bd-aba6-476c-a924-503108815feb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 00:59:06 user nova-compute[75165]: DEBUG nova.compute.manager [None req-2fdaa314-a681-49ce-b46c-a59d769926a1 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] [instance: 5dc4f5bd-aba6-476c-a924-503108815feb] Start building block device mappings for instance. {{(pid=75165) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 00:59:06 user nova-compute[75165]: DEBUG nova.policy [None req-2fdaa314-a681-49ce-b46c-a59d769926a1 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd7f8020ca2184967b2a810b0e6c8d4a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f535693c3cbd4f4e969f279167ef7ba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75165) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 00:59:07 user nova-compute[75165]: DEBUG nova.compute.manager [None req-2fdaa314-a681-49ce-b46c-a59d769926a1 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] [instance: 5dc4f5bd-aba6-476c-a924-503108815feb] Start spawning the instance on the hypervisor. {{(pid=75165) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 00:59:07 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-2fdaa314-a681-49ce-b46c-a59d769926a1 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] [instance: 5dc4f5bd-aba6-476c-a924-503108815feb] Creating instance directory {{(pid=75165) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 00:59:07 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-2fdaa314-a681-49ce-b46c-a59d769926a1 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] [instance: 5dc4f5bd-aba6-476c-a924-503108815feb] Creating image(s)
Oct 26 00:59:07 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-2fdaa314-a681-49ce-b46c-a59d769926a1 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Acquiring lock "/opt/stack/data/nova/instances/5dc4f5bd-aba6-476c-a924-503108815feb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:59:07 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-2fdaa314-a681-49ce-b46c-a59d769926a1 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Lock "/opt/stack/data/nova/instances/5dc4f5bd-aba6-476c-a924-503108815feb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:59:07 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-2fdaa314-a681-49ce-b46c-a59d769926a1 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Lock "/opt/stack/data/nova/instances/5dc4f5bd-aba6-476c-a924-503108815feb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:59:07 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-2fdaa314-a681-49ce-b46c-a59d769926a1 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Acquiring lock "1b0b555d91179f818025e184fcc8b69a61c788ff" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:59:07 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-2fdaa314-a681-49ce-b46c-a59d769926a1 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Lock "1b0b555d91179f818025e184fcc8b69a61c788ff" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:59:07 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-2fdaa314-a681-49ce-b46c-a59d769926a1 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1b0b555d91179f818025e184fcc8b69a61c788ff.part --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:59:07 user nova-compute[75165]: DEBUG nova.network.neutron [None req-2fdaa314-a681-49ce-b46c-a59d769926a1 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] [instance: 5dc4f5bd-aba6-476c-a924-503108815feb] Successfully created port: fcf41550-37ef-4e93-9a0c-3d427418d01b {{(pid=75165) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 00:59:07 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-2fdaa314-a681-49ce-b46c-a59d769926a1 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1b0b555d91179f818025e184fcc8b69a61c788ff.part --force-share --output=json" returned: 0 in 0.178s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:59:07 user nova-compute[75165]: DEBUG nova.virt.images [None req-2fdaa314-a681-49ce-b46c-a59d769926a1 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] 9623dafc-f204-4cde-96bd-232b02083d9d was qcow2, converting to raw {{(pid=75165) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 26 00:59:07 user nova-compute[75165]: DEBUG nova.privsep.utils [None req-2fdaa314-a681-49ce-b46c-a59d769926a1 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75165) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 26 00:59:07 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-2fdaa314-a681-49ce-b46c-a59d769926a1 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1b0b555d91179f818025e184fcc8b69a61c788ff.part /opt/stack/data/nova/instances/_base/1b0b555d91179f818025e184fcc8b69a61c788ff.converted {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:59:07 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-2fdaa314-a681-49ce-b46c-a59d769926a1 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1b0b555d91179f818025e184fcc8b69a61c788ff.part /opt/stack/data/nova/instances/_base/1b0b555d91179f818025e184fcc8b69a61c788ff.converted" returned: 0 in 0.351s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:59:07 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-2fdaa314-a681-49ce-b46c-a59d769926a1 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1b0b555d91179f818025e184fcc8b69a61c788ff.converted --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:59:08 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-2fdaa314-a681-49ce-b46c-a59d769926a1 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1b0b555d91179f818025e184fcc8b69a61c788ff.converted --force-share --output=json" returned: 0 in 0.179s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:59:08 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-2fdaa314-a681-49ce-b46c-a59d769926a1 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Lock "1b0b555d91179f818025e184fcc8b69a61c788ff" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.143s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:59:08 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-2fdaa314-a681-49ce-b46c-a59d769926a1 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1b0b555d91179f818025e184fcc8b69a61c788ff --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:59:08 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:59:08 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-2fdaa314-a681-49ce-b46c-a59d769926a1 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1b0b555d91179f818025e184fcc8b69a61c788ff --force-share --output=json" returned: 0 in 0.180s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:59:08 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-2fdaa314-a681-49ce-b46c-a59d769926a1 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Acquiring lock "1b0b555d91179f818025e184fcc8b69a61c788ff" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:59:08 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-2fdaa314-a681-49ce-b46c-a59d769926a1 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Lock "1b0b555d91179f818025e184fcc8b69a61c788ff" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:59:08 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-2fdaa314-a681-49ce-b46c-a59d769926a1 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1b0b555d91179f818025e184fcc8b69a61c788ff --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:59:08 user nova-compute[75165]: DEBUG nova.network.neutron [None req-2fdaa314-a681-49ce-b46c-a59d769926a1 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] [instance: 5dc4f5bd-aba6-476c-a924-503108815feb] Successfully updated port: fcf41550-37ef-4e93-9a0c-3d427418d01b {{(pid=75165) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 00:59:08 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-2fdaa314-a681-49ce-b46c-a59d769926a1 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Acquiring lock "refresh_cache-5dc4f5bd-aba6-476c-a924-503108815feb" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:59:08 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-2fdaa314-a681-49ce-b46c-a59d769926a1 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Acquired lock "refresh_cache-5dc4f5bd-aba6-476c-a924-503108815feb" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:59:08 user nova-compute[75165]: DEBUG nova.network.neutron [None req-2fdaa314-a681-49ce-b46c-a59d769926a1 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] [instance: 5dc4f5bd-aba6-476c-a924-503108815feb] Building network info cache for instance {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 00:59:08 user nova-compute[75165]: DEBUG nova.compute.manager [req-18189202-2b97-4aac-87db-d2f7ade73ae8 req-5e3b0399-be36-45a3-8e34-b36177f742c5 service nova] [instance: 5dc4f5bd-aba6-476c-a924-503108815feb] Received event network-changed-fcf41550-37ef-4e93-9a0c-3d427418d01b {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:59:08 user nova-compute[75165]: DEBUG nova.compute.manager [req-18189202-2b97-4aac-87db-d2f7ade73ae8 req-5e3b0399-be36-45a3-8e34-b36177f742c5 service nova] [instance: 5dc4f5bd-aba6-476c-a924-503108815feb] Refreshing instance network info cache due to event network-changed-fcf41550-37ef-4e93-9a0c-3d427418d01b. {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 00:59:08 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-18189202-2b97-4aac-87db-d2f7ade73ae8 req-5e3b0399-be36-45a3-8e34-b36177f742c5 service nova] Acquiring lock "refresh_cache-5dc4f5bd-aba6-476c-a924-503108815feb" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:59:08 user nova-compute[75165]: DEBUG nova.network.neutron [None req-2fdaa314-a681-49ce-b46c-a59d769926a1 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] [instance: 5dc4f5bd-aba6-476c-a924-503108815feb] Instance cache missing network info. {{(pid=75165) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 00:59:08 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-2fdaa314-a681-49ce-b46c-a59d769926a1 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1b0b555d91179f818025e184fcc8b69a61c788ff --force-share --output=json" returned: 0 in 0.177s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:59:08 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-2fdaa314-a681-49ce-b46c-a59d769926a1 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1b0b555d91179f818025e184fcc8b69a61c788ff,backing_fmt=raw /opt/stack/data/nova/instances/5dc4f5bd-aba6-476c-a924-503108815feb/disk 1073741824 {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:59:08 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-2fdaa314-a681-49ce-b46c-a59d769926a1 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1b0b555d91179f818025e184fcc8b69a61c788ff,backing_fmt=raw /opt/stack/data/nova/instances/5dc4f5bd-aba6-476c-a924-503108815feb/disk 1073741824" returned: 0 in 0.053s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:59:08 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-2fdaa314-a681-49ce-b46c-a59d769926a1 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Lock "1b0b555d91179f818025e184fcc8b69a61c788ff" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:59:08 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-2fdaa314-a681-49ce-b46c-a59d769926a1 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1b0b555d91179f818025e184fcc8b69a61c788ff --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:59:08 user nova-compute[75165]: DEBUG nova.network.neutron [None req-2fdaa314-a681-49ce-b46c-a59d769926a1 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] [instance: 5dc4f5bd-aba6-476c-a924-503108815feb] Updating instance_info_cache with network_info: [{"id": "fcf41550-37ef-4e93-9a0c-3d427418d01b", "address": "fa:16:3e:fd:a5:fb", "network": {"id": "30343eb9-5e61-407a-8491-e58b28ff1645", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1025901471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f535693c3cbd4f4e969f279167ef7ba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcf41550-37", "ovs_interfaceid": "fcf41550-37ef-4e93-9a0c-3d427418d01b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:59:08 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-2fdaa314-a681-49ce-b46c-a59d769926a1 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1b0b555d91179f818025e184fcc8b69a61c788ff --force-share --output=json" returned: 0 in 0.177s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:59:08 user nova-compute[75165]: DEBUG nova.virt.disk.api [None req-2fdaa314-a681-49ce-b46c-a59d769926a1 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5dc4f5bd-aba6-476c-a924-503108815feb/disk. size=1073741824 {{(pid=75165) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 00:59:08 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-2fdaa314-a681-49ce-b46c-a59d769926a1 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dc4f5bd-aba6-476c-a924-503108815feb/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:59:08 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-2fdaa314-a681-49ce-b46c-a59d769926a1 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Releasing lock "refresh_cache-5dc4f5bd-aba6-476c-a924-503108815feb" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:59:08 user nova-compute[75165]: DEBUG nova.compute.manager [None req-2fdaa314-a681-49ce-b46c-a59d769926a1 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] [instance: 5dc4f5bd-aba6-476c-a924-503108815feb] Instance network_info: |[{"id": "fcf41550-37ef-4e93-9a0c-3d427418d01b", "address": "fa:16:3e:fd:a5:fb", "network": {"id": "30343eb9-5e61-407a-8491-e58b28ff1645", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1025901471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f535693c3cbd4f4e969f279167ef7ba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcf41550-37", "ovs_interfaceid": "fcf41550-37ef-4e93-9a0c-3d427418d01b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75165) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 00:59:08 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-18189202-2b97-4aac-87db-d2f7ade73ae8 req-5e3b0399-be36-45a3-8e34-b36177f742c5 service nova] Acquired lock "refresh_cache-5dc4f5bd-aba6-476c-a924-503108815feb" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:59:08 user nova-compute[75165]: DEBUG nova.network.neutron [req-18189202-2b97-4aac-87db-d2f7ade73ae8 req-5e3b0399-be36-45a3-8e34-b36177f742c5 service nova] [instance: 5dc4f5bd-aba6-476c-a924-503108815feb] Refreshing network info cache for port fcf41550-37ef-4e93-9a0c-3d427418d01b {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 00:59:08 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-2fdaa314-a681-49ce-b46c-a59d769926a1 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dc4f5bd-aba6-476c-a924-503108815feb/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:59:08 user nova-compute[75165]: DEBUG nova.virt.disk.api [None req-2fdaa314-a681-49ce-b46c-a59d769926a1 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Cannot resize image /opt/stack/data/nova/instances/5dc4f5bd-aba6-476c-a924-503108815feb/disk to a smaller size. {{(pid=75165) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 00:59:08 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-2fdaa314-a681-49ce-b46c-a59d769926a1 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] [instance: 5dc4f5bd-aba6-476c-a924-503108815feb] Created local disks {{(pid=75165) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 00:59:08 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-2fdaa314-a681-49ce-b46c-a59d769926a1 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] [instance: 5dc4f5bd-aba6-476c-a924-503108815feb] Ensure instance console log exists: /opt/stack/data/nova/instances/5dc4f5bd-aba6-476c-a924-503108815feb/console.log {{(pid=75165) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 00:59:08 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-2fdaa314-a681-49ce-b46c-a59d769926a1 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:59:08 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-2fdaa314-a681-49ce-b46c-a59d769926a1 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:59:08 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-2fdaa314-a681-49ce-b46c-a59d769926a1 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:59:08 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-2fdaa314-a681-49ce-b46c-a59d769926a1 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] [instance: 5dc4f5bd-aba6-476c-a924-503108815feb] Start _get_guest_xml network_info=[{"id": "fcf41550-37ef-4e93-9a0c-3d427418d01b", "address": "fa:16:3e:fd:a5:fb", "network": {"id": "30343eb9-5e61-407a-8491-e58b28ff1645", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1025901471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f535693c3cbd4f4e969f279167ef7ba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcf41550-37", "ovs_interfaceid": "fcf41550-37ef-4e93-9a0c-3d427418d01b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T00:59:04Z,direct_url=<?>,disk_format='qcow2',id=9623dafc-f204-4cde-96bd-232b02083d9d,min_disk=0,min_ram=0,name='tempest-scenario-img--1015984973',owner='f535693c3cbd4f4e969f279167ef7ba8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T00:59:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'device_type': 'disk', 'encrypted': False, 'size': 0, 'encryption_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'image_id': '9623dafc-f204-4cde-96bd-232b02083d9d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75165) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 00:59:09 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-2fdaa314-a681-49ce-b46c-a59d769926a1 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:59:09 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-2fdaa314-a681-49ce-b46c-a59d769926a1 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:59:09 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-2fdaa314-a681-49ce-b46c-a59d769926a1 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75165) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 00:59:09 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-2fdaa314-a681-49ce-b46c-a59d769926a1 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] CPU controller missing on host. {{(pid=75165) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 00:59:09 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-2fdaa314-a681-49ce-b46c-a59d769926a1 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75165) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 00:59:09 user nova-compute[75165]: DEBUG nova.virt.libvirt.host [None req-2fdaa314-a681-49ce-b46c-a59d769926a1 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] CPU controller found on host. {{(pid=75165) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 00:59:09 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-2fdaa314-a681-49ce-b46c-a59d769926a1 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75165) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 00:59:09 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-2fdaa314-a681-49ce-b46c-a59d769926a1 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T00:03:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T00:59:04Z,direct_url=<?>,disk_format='qcow2',id=9623dafc-f204-4cde-96bd-232b02083d9d,min_disk=0,min_ram=0,name='tempest-scenario-img--1015984973',owner='f535693c3cbd4f4e969f279167ef7ba8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T00:59:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 00:59:09 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-2fdaa314-a681-49ce-b46c-a59d769926a1 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Flavor limits 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 00:59:09 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-2fdaa314-a681-49ce-b46c-a59d769926a1 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Image limits 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 00:59:09 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-2fdaa314-a681-49ce-b46c-a59d769926a1 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Flavor pref 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 00:59:09 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-2fdaa314-a681-49ce-b46c-a59d769926a1 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Image pref 0:0:0 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 00:59:09 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-2fdaa314-a681-49ce-b46c-a59d769926a1 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75165) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 00:59:09 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-2fdaa314-a681-49ce-b46c-a59d769926a1 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 00:59:09 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-2fdaa314-a681-49ce-b46c-a59d769926a1 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75165) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 00:59:09 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-2fdaa314-a681-49ce-b46c-a59d769926a1 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Got 1 possible topologies {{(pid=75165) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 00:59:09 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-2fdaa314-a681-49ce-b46c-a59d769926a1 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 00:59:09 user nova-compute[75165]: DEBUG nova.virt.hardware [None req-2fdaa314-a681-49ce-b46c-a59d769926a1 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75165) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 00:59:09 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-2fdaa314-a681-49ce-b46c-a59d769926a1 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:59:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1105020865',display_name='tempest-TestMinimumBasicScenario-server-1105020865',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1105020865',id=52,image_ref='9623dafc-f204-4cde-96bd-232b02083d9d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBERtRZmi/S9frXiSJg9mjeHHOicf9GeslXqW2YXjh+MQyatcH700wJi2yiU3TwBlIlfRrbf+gdugkGZVF5eaQO8HSXJ4K8e5z9EKrXZ9faikpml2/7wDMg3L0PXxGgS0Bg==',key_name='tempest-TestMinimumBasicScenario-1702867609',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f535693c3cbd4f4e969f279167ef7ba8',ramdisk_id='',reservation_id='r-qf9yiq2b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9623dafc-f204-4cde-96bd-232b02083d9d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-387809061',owner_user_name='tempest-TestMinimumBasicScenario-387809061-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T00:59:07Z,user_data=None,user_id='d7f8020ca2184967b2a810b0e6c8d4a0',uuid=5dc4f5bd-aba6-476c-a924-503108815feb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fcf41550-37ef-4e93-9a0c-3d427418d01b", "address": "fa:16:3e:fd:a5:fb", "network": {"id": "30343eb9-5e61-407a-8491-e58b28ff1645", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1025901471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f535693c3cbd4f4e969f279167ef7ba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcf41550-37", "ovs_interfaceid": "fcf41550-37ef-4e93-9a0c-3d427418d01b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75165) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 00:59:09 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-2fdaa314-a681-49ce-b46c-a59d769926a1 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Converting VIF {"id": "fcf41550-37ef-4e93-9a0c-3d427418d01b", "address": "fa:16:3e:fd:a5:fb", "network": {"id": "30343eb9-5e61-407a-8491-e58b28ff1645", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1025901471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f535693c3cbd4f4e969f279167ef7ba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcf41550-37", "ovs_interfaceid": "fcf41550-37ef-4e93-9a0c-3d427418d01b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:59:09 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-2fdaa314-a681-49ce-b46c-a59d769926a1 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:a5:fb,bridge_name='br-int',has_traffic_filtering=True,id=fcf41550-37ef-4e93-9a0c-3d427418d01b,network=Network(30343eb9-5e61-407a-8491-e58b28ff1645),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcf41550-37') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:59:09 user nova-compute[75165]: DEBUG nova.objects.instance [None req-2fdaa314-a681-49ce-b46c-a59d769926a1 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Lazy-loading 'pci_devices' on Instance uuid 5dc4f5bd-aba6-476c-a924-503108815feb {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:59:09 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-2fdaa314-a681-49ce-b46c-a59d769926a1 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] [instance: 5dc4f5bd-aba6-476c-a924-503108815feb] End _get_guest_xml xml=<domain type="kvm">
Oct 26 00:59:09 user nova-compute[75165]:   <uuid>5dc4f5bd-aba6-476c-a924-503108815feb</uuid>
Oct 26 00:59:09 user nova-compute[75165]:   <name>instance-00000034</name>
Oct 26 00:59:09 user nova-compute[75165]:   <memory>524288</memory>
Oct 26 00:59:09 user nova-compute[75165]:   <vcpu>1</vcpu>
Oct 26 00:59:09 user nova-compute[75165]:   <metadata>
Oct 26 00:59:09 user nova-compute[75165]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 00:59:09 user nova-compute[75165]:       <nova:package version="0.0.0"/>
Oct 26 00:59:09 user nova-compute[75165]:       <nova:name>tempest-TestMinimumBasicScenario-server-1105020865</nova:name>
Oct 26 00:59:09 user nova-compute[75165]:       <nova:creationTime>2023-10-26 00:59:09</nova:creationTime>
Oct 26 00:59:09 user nova-compute[75165]:       <nova:flavor name="m1.tiny">
Oct 26 00:59:09 user nova-compute[75165]:         <nova:memory>512</nova:memory>
Oct 26 00:59:09 user nova-compute[75165]:         <nova:disk>1</nova:disk>
Oct 26 00:59:09 user nova-compute[75165]:         <nova:swap>0</nova:swap>
Oct 26 00:59:09 user nova-compute[75165]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 00:59:09 user nova-compute[75165]:         <nova:vcpus>1</nova:vcpus>
Oct 26 00:59:09 user nova-compute[75165]:       </nova:flavor>
Oct 26 00:59:09 user nova-compute[75165]:       <nova:owner>
Oct 26 00:59:09 user nova-compute[75165]:         <nova:user uuid="d7f8020ca2184967b2a810b0e6c8d4a0">tempest-TestMinimumBasicScenario-387809061-project-member</nova:user>
Oct 26 00:59:09 user nova-compute[75165]:         <nova:project uuid="f535693c3cbd4f4e969f279167ef7ba8">tempest-TestMinimumBasicScenario-387809061</nova:project>
Oct 26 00:59:09 user nova-compute[75165]:       </nova:owner>
Oct 26 00:59:09 user nova-compute[75165]:       <nova:root type="image" uuid="9623dafc-f204-4cde-96bd-232b02083d9d"/>
Oct 26 00:59:09 user nova-compute[75165]:       <nova:ports>
Oct 26 00:59:09 user nova-compute[75165]:         <nova:port uuid="fcf41550-37ef-4e93-9a0c-3d427418d01b">
Oct 26 00:59:09 user nova-compute[75165]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 26 00:59:09 user nova-compute[75165]:         </nova:port>
Oct 26 00:59:09 user nova-compute[75165]:       </nova:ports>
Oct 26 00:59:09 user nova-compute[75165]:     </nova:instance>
Oct 26 00:59:09 user nova-compute[75165]:   </metadata>
Oct 26 00:59:09 user nova-compute[75165]:   <sysinfo type="smbios">
Oct 26 00:59:09 user nova-compute[75165]:     <system>
Oct 26 00:59:09 user nova-compute[75165]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 00:59:09 user nova-compute[75165]:       <entry name="product">OpenStack Nova</entry>
Oct 26 00:59:09 user nova-compute[75165]:       <entry name="version">0.0.0</entry>
Oct 26 00:59:09 user nova-compute[75165]:       <entry name="serial">5dc4f5bd-aba6-476c-a924-503108815feb</entry>
Oct 26 00:59:09 user nova-compute[75165]:       <entry name="uuid">5dc4f5bd-aba6-476c-a924-503108815feb</entry>
Oct 26 00:59:09 user nova-compute[75165]:       <entry name="family">Virtual Machine</entry>
Oct 26 00:59:09 user nova-compute[75165]:     </system>
Oct 26 00:59:09 user nova-compute[75165]:   </sysinfo>
Oct 26 00:59:09 user nova-compute[75165]:   <os>
Oct 26 00:59:09 user nova-compute[75165]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 00:59:09 user nova-compute[75165]:     <boot dev="hd"/>
Oct 26 00:59:09 user nova-compute[75165]:     <smbios mode="sysinfo"/>
Oct 26 00:59:09 user nova-compute[75165]:   </os>
Oct 26 00:59:09 user nova-compute[75165]:   <features>
Oct 26 00:59:09 user nova-compute[75165]:     <acpi/>
Oct 26 00:59:09 user nova-compute[75165]:     <apic/>
Oct 26 00:59:09 user nova-compute[75165]:     <vmcoreinfo/>
Oct 26 00:59:09 user nova-compute[75165]:   </features>
Oct 26 00:59:09 user nova-compute[75165]:   <clock offset="utc">
Oct 26 00:59:09 user nova-compute[75165]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 00:59:09 user nova-compute[75165]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 00:59:09 user nova-compute[75165]:     <timer name="hpet" present="no"/>
Oct 26 00:59:09 user nova-compute[75165]:   </clock>
Oct 26 00:59:09 user nova-compute[75165]:   <cpu mode="custom" match="exact">
Oct 26 00:59:09 user nova-compute[75165]:     <model>Nehalem</model>
Oct 26 00:59:09 user nova-compute[75165]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 00:59:09 user nova-compute[75165]:   </cpu>
Oct 26 00:59:09 user nova-compute[75165]:   <devices>
Oct 26 00:59:09 user nova-compute[75165]:     <disk type="file" device="disk">
Oct 26 00:59:09 user nova-compute[75165]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 00:59:09 user nova-compute[75165]:       <source file="/opt/stack/data/nova/instances/5dc4f5bd-aba6-476c-a924-503108815feb/disk"/>
Oct 26 00:59:09 user nova-compute[75165]:       <target dev="vda" bus="virtio"/>
Oct 26 00:59:09 user nova-compute[75165]:     </disk>
Oct 26 00:59:09 user nova-compute[75165]:     <interface type="ethernet">
Oct 26 00:59:09 user nova-compute[75165]:       <mac address="fa:16:3e:fd:a5:fb"/>
Oct 26 00:59:09 user nova-compute[75165]:       <model type="virtio"/>
Oct 26 00:59:09 user nova-compute[75165]:       <mtu size="1442"/>
Oct 26 00:59:09 user nova-compute[75165]:       <target dev="tapfcf41550-37"/>
Oct 26 00:59:09 user nova-compute[75165]:     </interface>
Oct 26 00:59:09 user nova-compute[75165]:     <serial type="pty">
Oct 26 00:59:09 user nova-compute[75165]:       <log file="/opt/stack/data/nova/instances/5dc4f5bd-aba6-476c-a924-503108815feb/console.log" append="off"/>
Oct 26 00:59:09 user nova-compute[75165]:     </serial>
Oct 26 00:59:09 user nova-compute[75165]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 00:59:09 user nova-compute[75165]:     <video>
Oct 26 00:59:09 user nova-compute[75165]:       <model type="virtio"/>
Oct 26 00:59:09 user nova-compute[75165]:     </video>
Oct 26 00:59:09 user nova-compute[75165]:     <rng model="virtio">
Oct 26 00:59:09 user nova-compute[75165]:       <backend model="random">/dev/urandom</backend>
Oct 26 00:59:09 user nova-compute[75165]:     </rng>
Oct 26 00:59:09 user nova-compute[75165]:     <controller type="usb" index="0" model="none"/>
Oct 26 00:59:09 user nova-compute[75165]:     <memballoon model="virtio">
Oct 26 00:59:09 user nova-compute[75165]:       <stats period="10"/>
Oct 26 00:59:09 user nova-compute[75165]:     </memballoon>
Oct 26 00:59:09 user nova-compute[75165]:   </devices>
Oct 26 00:59:09 user nova-compute[75165]: </domain>
Oct 26 00:59:09 user nova-compute[75165]:  {{(pid=75165) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 00:59:09 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-2fdaa314-a681-49ce-b46c-a59d769926a1 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:59:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1105020865',display_name='tempest-TestMinimumBasicScenario-server-1105020865',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1105020865',id=52,image_ref='9623dafc-f204-4cde-96bd-232b02083d9d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBERtRZmi/S9frXiSJg9mjeHHOicf9GeslXqW2YXjh+MQyatcH700wJi2yiU3TwBlIlfRrbf+gdugkGZVF5eaQO8HSXJ4K8e5z9EKrXZ9faikpml2/7wDMg3L0PXxGgS0Bg==',key_name='tempest-TestMinimumBasicScenario-1702867609',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f535693c3cbd4f4e969f279167ef7ba8',ramdisk_id='',reservation_id='r-qf9yiq2b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9623dafc-f204-4cde-96bd-232b02083d9d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-387809061',owner_user_name='tempest-TestMinimumBasicScenario-387809061-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T00:59:07Z,user_data=None,user_id='d7f8020ca2184967b2a810b0e6c8d4a0',uuid=5dc4f5bd-aba6-476c-a924-503108815feb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fcf41550-37ef-4e93-9a0c-3d427418d01b", "address": "fa:16:3e:fd:a5:fb", "network": {"id": "30343eb9-5e61-407a-8491-e58b28ff1645", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1025901471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f535693c3cbd4f4e969f279167ef7ba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcf41550-37", "ovs_interfaceid": "fcf41550-37ef-4e93-9a0c-3d427418d01b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 00:59:09 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-2fdaa314-a681-49ce-b46c-a59d769926a1 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Converting VIF {"id": "fcf41550-37ef-4e93-9a0c-3d427418d01b", "address": "fa:16:3e:fd:a5:fb", "network": {"id": "30343eb9-5e61-407a-8491-e58b28ff1645", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1025901471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f535693c3cbd4f4e969f279167ef7ba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcf41550-37", "ovs_interfaceid": "fcf41550-37ef-4e93-9a0c-3d427418d01b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 00:59:09 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-2fdaa314-a681-49ce-b46c-a59d769926a1 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:a5:fb,bridge_name='br-int',has_traffic_filtering=True,id=fcf41550-37ef-4e93-9a0c-3d427418d01b,network=Network(30343eb9-5e61-407a-8491-e58b28ff1645),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcf41550-37') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 00:59:09 user nova-compute[75165]: DEBUG os_vif [None req-2fdaa314-a681-49ce-b46c-a59d769926a1 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:a5:fb,bridge_name='br-int',has_traffic_filtering=True,id=fcf41550-37ef-4e93-9a0c-3d427418d01b,network=Network(30343eb9-5e61-407a-8491-e58b28ff1645),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcf41550-37') {{(pid=75165) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 00:59:09 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:59:09 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:59:09 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 00:59:09 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:59:09 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'df6985f0-917b-543e-8330-7e86cd96cf20', '_type': 'linux-noop'}}, row=False) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:59:09 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:59:09 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:59:09 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:59:09 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfcf41550-37, may_exist=True, interface_attrs={}) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:59:09 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfcf41550-37, col_values=(('qos', UUID('11d67a1a-1ea8-42f3-b219-3c2f9fef5f74')),), if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:59:09 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfcf41550-37, col_values=(('external_ids', {'iface-id': 'fcf41550-37ef-4e93-9a0c-3d427418d01b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fd:a5:fb', 'vm-uuid': '5dc4f5bd-aba6-476c-a924-503108815feb'}),), if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 00:59:09 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:59:09 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:59:09 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:59:09 user nova-compute[75165]: INFO os_vif [None req-2fdaa314-a681-49ce-b46c-a59d769926a1 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:a5:fb,bridge_name='br-int',has_traffic_filtering=True,id=fcf41550-37ef-4e93-9a0c-3d427418d01b,network=Network(30343eb9-5e61-407a-8491-e58b28ff1645),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcf41550-37')
Oct 26 00:59:09 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-2fdaa314-a681-49ce-b46c-a59d769926a1 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] No BDM found with device name vda, not building metadata. {{(pid=75165) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 00:59:09 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-2fdaa314-a681-49ce-b46c-a59d769926a1 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] No VIF found with MAC fa:16:3e:fd:a5:fb, not building metadata {{(pid=75165) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 00:59:09 user nova-compute[75165]: DEBUG nova.network.neutron [req-18189202-2b97-4aac-87db-d2f7ade73ae8 req-5e3b0399-be36-45a3-8e34-b36177f742c5 service nova] [instance: 5dc4f5bd-aba6-476c-a924-503108815feb] Updated VIF entry in instance network info cache for port fcf41550-37ef-4e93-9a0c-3d427418d01b. {{(pid=75165) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 00:59:09 user nova-compute[75165]: DEBUG nova.network.neutron [req-18189202-2b97-4aac-87db-d2f7ade73ae8 req-5e3b0399-be36-45a3-8e34-b36177f742c5 service nova] [instance: 5dc4f5bd-aba6-476c-a924-503108815feb] Updating instance_info_cache with network_info: [{"id": "fcf41550-37ef-4e93-9a0c-3d427418d01b", "address": "fa:16:3e:fd:a5:fb", "network": {"id": "30343eb9-5e61-407a-8491-e58b28ff1645", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1025901471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f535693c3cbd4f4e969f279167ef7ba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcf41550-37", "ovs_interfaceid": "fcf41550-37ef-4e93-9a0c-3d427418d01b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:59:09 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-18189202-2b97-4aac-87db-d2f7ade73ae8 req-5e3b0399-be36-45a3-8e34-b36177f742c5 service nova] Releasing lock "refresh_cache-5dc4f5bd-aba6-476c-a924-503108815feb" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:59:10 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:59:10 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:59:10 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:59:10 user nova-compute[75165]: DEBUG nova.compute.manager [req-09792636-e127-45e9-9fc9-5f7b98df85c7 req-b8897649-d7f3-47ac-9f4f-49ceb8f21b97 service nova] [instance: 5dc4f5bd-aba6-476c-a924-503108815feb] Received event network-vif-plugged-fcf41550-37ef-4e93-9a0c-3d427418d01b {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:59:10 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-09792636-e127-45e9-9fc9-5f7b98df85c7 req-b8897649-d7f3-47ac-9f4f-49ceb8f21b97 service nova] Acquiring lock "5dc4f5bd-aba6-476c-a924-503108815feb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:59:10 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-09792636-e127-45e9-9fc9-5f7b98df85c7 req-b8897649-d7f3-47ac-9f4f-49ceb8f21b97 service nova] Lock "5dc4f5bd-aba6-476c-a924-503108815feb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:59:10 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-09792636-e127-45e9-9fc9-5f7b98df85c7 req-b8897649-d7f3-47ac-9f4f-49ceb8f21b97 service nova] Lock "5dc4f5bd-aba6-476c-a924-503108815feb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:59:10 user nova-compute[75165]: DEBUG nova.compute.manager [req-09792636-e127-45e9-9fc9-5f7b98df85c7 req-b8897649-d7f3-47ac-9f4f-49ceb8f21b97 service nova] [instance: 5dc4f5bd-aba6-476c-a924-503108815feb] No waiting events found dispatching network-vif-plugged-fcf41550-37ef-4e93-9a0c-3d427418d01b {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:59:10 user nova-compute[75165]: WARNING nova.compute.manager [req-09792636-e127-45e9-9fc9-5f7b98df85c7 req-b8897649-d7f3-47ac-9f4f-49ceb8f21b97 service nova] [instance: 5dc4f5bd-aba6-476c-a924-503108815feb] Received unexpected event network-vif-plugged-fcf41550-37ef-4e93-9a0c-3d427418d01b for instance with vm_state building and task_state spawning.
Oct 26 00:59:10 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:59:10 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:59:10 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:59:12 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:59:12 user nova-compute[75165]: DEBUG nova.compute.manager [None req-2fdaa314-a681-49ce-b46c-a59d769926a1 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] [instance: 5dc4f5bd-aba6-476c-a924-503108815feb] Instance event wait completed in 0 seconds for  {{(pid=75165) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 00:59:12 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-2fdaa314-a681-49ce-b46c-a59d769926a1 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] [instance: 5dc4f5bd-aba6-476c-a924-503108815feb] Guest created on hypervisor {{(pid=75165) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 00:59:12 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: 5dc4f5bd-aba6-476c-a924-503108815feb] Instance spawned successfully.
Oct 26 00:59:12 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-2fdaa314-a681-49ce-b46c-a59d769926a1 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] [instance: 5dc4f5bd-aba6-476c-a924-503108815feb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 00:59:12 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-2fdaa314-a681-49ce-b46c-a59d769926a1 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] [instance: 5dc4f5bd-aba6-476c-a924-503108815feb] Found default for hw_cdrom_bus of ide {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:59:12 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-2fdaa314-a681-49ce-b46c-a59d769926a1 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] [instance: 5dc4f5bd-aba6-476c-a924-503108815feb] Found default for hw_disk_bus of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:59:12 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-2fdaa314-a681-49ce-b46c-a59d769926a1 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] [instance: 5dc4f5bd-aba6-476c-a924-503108815feb] Found default for hw_input_bus of None {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:59:12 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-2fdaa314-a681-49ce-b46c-a59d769926a1 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] [instance: 5dc4f5bd-aba6-476c-a924-503108815feb] Found default for hw_pointer_model of None {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:59:12 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-2fdaa314-a681-49ce-b46c-a59d769926a1 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] [instance: 5dc4f5bd-aba6-476c-a924-503108815feb] Found default for hw_video_model of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:59:12 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-2fdaa314-a681-49ce-b46c-a59d769926a1 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] [instance: 5dc4f5bd-aba6-476c-a924-503108815feb] Found default for hw_vif_model of virtio {{(pid=75165) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 00:59:12 user nova-compute[75165]: INFO nova.compute.manager [None req-2fdaa314-a681-49ce-b46c-a59d769926a1 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] [instance: 5dc4f5bd-aba6-476c-a924-503108815feb] Took 5.59 seconds to spawn the instance on the hypervisor.
Oct 26 00:59:12 user nova-compute[75165]: DEBUG nova.compute.manager [None req-2fdaa314-a681-49ce-b46c-a59d769926a1 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] [instance: 5dc4f5bd-aba6-476c-a924-503108815feb] Checking state {{(pid=75165) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 00:59:12 user nova-compute[75165]: DEBUG nova.compute.manager [req-110f4faa-6f5b-4946-bcf2-47e25614bd20 req-45a5445f-d257-4990-a7dc-0fa1ff281a65 service nova] [instance: 5dc4f5bd-aba6-476c-a924-503108815feb] Received event network-vif-plugged-fcf41550-37ef-4e93-9a0c-3d427418d01b {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 00:59:12 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-110f4faa-6f5b-4946-bcf2-47e25614bd20 req-45a5445f-d257-4990-a7dc-0fa1ff281a65 service nova] Acquiring lock "5dc4f5bd-aba6-476c-a924-503108815feb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:59:12 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-110f4faa-6f5b-4946-bcf2-47e25614bd20 req-45a5445f-d257-4990-a7dc-0fa1ff281a65 service nova] Lock "5dc4f5bd-aba6-476c-a924-503108815feb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:59:12 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-110f4faa-6f5b-4946-bcf2-47e25614bd20 req-45a5445f-d257-4990-a7dc-0fa1ff281a65 service nova] Lock "5dc4f5bd-aba6-476c-a924-503108815feb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:59:12 user nova-compute[75165]: DEBUG nova.compute.manager [req-110f4faa-6f5b-4946-bcf2-47e25614bd20 req-45a5445f-d257-4990-a7dc-0fa1ff281a65 service nova] [instance: 5dc4f5bd-aba6-476c-a924-503108815feb] No waiting events found dispatching network-vif-plugged-fcf41550-37ef-4e93-9a0c-3d427418d01b {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 00:59:12 user nova-compute[75165]: WARNING nova.compute.manager [req-110f4faa-6f5b-4946-bcf2-47e25614bd20 req-45a5445f-d257-4990-a7dc-0fa1ff281a65 service nova] [instance: 5dc4f5bd-aba6-476c-a924-503108815feb] Received unexpected event network-vif-plugged-fcf41550-37ef-4e93-9a0c-3d427418d01b for instance with vm_state building and task_state spawning.
Oct 26 00:59:12 user nova-compute[75165]: INFO nova.compute.manager [None req-2fdaa314-a681-49ce-b46c-a59d769926a1 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] [instance: 5dc4f5bd-aba6-476c-a924-503108815feb] Took 6.12 seconds to build instance.
Oct 26 00:59:12 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-2fdaa314-a681-49ce-b46c-a59d769926a1 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Lock "5dc4f5bd-aba6-476c-a924-503108815feb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.381s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:59:14 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:59:17 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:59:19 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:59:23 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:59:23 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Cleaning up deleted instances {{(pid=75165) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 26 00:59:23 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] There are 0 instances to clean {{(pid=75165) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 26 00:59:24 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:59:24 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:59:24 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75165) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 00:59:24 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75165) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 00:59:24 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75165) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 00:59:24 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:59:27 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:59:29 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:59:32 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:59:34 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:59:37 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:59:38 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:59:39 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:59:39 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:59:39 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75165) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 00:59:42 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:59:42 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:59:44 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:59:44 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:59:45 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:59:47 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:59:49 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:59:49 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:59:51 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:59:51 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Starting heal instance info cache {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 00:59:51 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Rebuilding the list of instances to heal {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 00:59:51 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "refresh_cache-5dc4f5bd-aba6-476c-a924-503108815feb" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 00:59:51 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquired lock "refresh_cache-5dc4f5bd-aba6-476c-a924-503108815feb" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 00:59:51 user nova-compute[75165]: DEBUG nova.network.neutron [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: 5dc4f5bd-aba6-476c-a924-503108815feb] Forcefully refreshing network info cache for instance {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 00:59:51 user nova-compute[75165]: DEBUG nova.objects.instance [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lazy-loading 'info_cache' on Instance uuid 5dc4f5bd-aba6-476c-a924-503108815feb {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 00:59:52 user nova-compute[75165]: DEBUG nova.network.neutron [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: 5dc4f5bd-aba6-476c-a924-503108815feb] Updating instance_info_cache with network_info: [{"id": "fcf41550-37ef-4e93-9a0c-3d427418d01b", "address": "fa:16:3e:fd:a5:fb", "network": {"id": "30343eb9-5e61-407a-8491-e58b28ff1645", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1025901471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f535693c3cbd4f4e969f279167ef7ba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcf41550-37", "ovs_interfaceid": "fcf41550-37ef-4e93-9a0c-3d427418d01b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 00:59:52 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Releasing lock "refresh_cache-5dc4f5bd-aba6-476c-a924-503108815feb" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 00:59:52 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: 5dc4f5bd-aba6-476c-a924-503108815feb] Updated the network info_cache for instance {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 00:59:52 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:59:52 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:59:52 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 00:59:52 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:59:52 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:59:52 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:59:52 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75165) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 00:59:52 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dc4f5bd-aba6-476c-a924-503108815feb/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:59:53 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dc4f5bd-aba6-476c-a924-503108815feb/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:59:53 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dc4f5bd-aba6-476c-a924-503108815feb/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 00:59:53 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dc4f5bd-aba6-476c-a924-503108815feb/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 00:59:53 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:59:53 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 00:59:53 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Hypervisor/Node resource view: name=user free_ram=9045MB free_disk=24.704689025878906GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75165) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 00:59:53 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 00:59:53 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 00:59:53 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 5dc4f5bd-aba6-476c-a924-503108815feb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 00:59:53 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75165) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 00:59:53 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75165) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 00:59:53 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 00:59:53 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 00:59:53 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Compute_service record updated for user:user {{(pid=75165) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 00:59:53 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.206s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 00:59:54 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:59:59 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 00:59:59 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 00:59:59 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75165) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 00:59:59 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75165) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 00:59:59 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75165) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 00:59:59 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 01:00:04 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 01:00:09 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 01:00:09 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 01:00:09 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75165) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 01:00:09 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75165) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 01:00:09 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75165) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 01:00:09 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 01:00:14 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 01:00:19 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 01:00:24 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 01:00:29 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 01:00:34 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 01:00:39 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 01:00:40 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 01:00:40 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75165) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 01:00:43 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 01:00:44 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 01:00:44 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 01:00:47 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 01:00:49 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 01:00:51 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 01:00:51 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 01:00:52 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 01:00:52 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Starting heal instance info cache {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 01:00:52 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Rebuilding the list of instances to heal {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 01:00:52 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "refresh_cache-5dc4f5bd-aba6-476c-a924-503108815feb" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 01:00:52 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquired lock "refresh_cache-5dc4f5bd-aba6-476c-a924-503108815feb" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 01:00:52 user nova-compute[75165]: DEBUG nova.network.neutron [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: 5dc4f5bd-aba6-476c-a924-503108815feb] Forcefully refreshing network info cache for instance {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 01:00:52 user nova-compute[75165]: DEBUG nova.objects.instance [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lazy-loading 'info_cache' on Instance uuid 5dc4f5bd-aba6-476c-a924-503108815feb {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 01:00:53 user nova-compute[75165]: DEBUG nova.network.neutron [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: 5dc4f5bd-aba6-476c-a924-503108815feb] Updating instance_info_cache with network_info: [{"id": "fcf41550-37ef-4e93-9a0c-3d427418d01b", "address": "fa:16:3e:fd:a5:fb", "network": {"id": "30343eb9-5e61-407a-8491-e58b28ff1645", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1025901471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f535693c3cbd4f4e969f279167ef7ba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcf41550-37", "ovs_interfaceid": "fcf41550-37ef-4e93-9a0c-3d427418d01b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 01:00:53 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Releasing lock "refresh_cache-5dc4f5bd-aba6-476c-a924-503108815feb" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 01:00:53 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: 5dc4f5bd-aba6-476c-a924-503108815feb] Updated the network info_cache for instance {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 01:00:53 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 01:00:53 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 01:00:53 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 01:00:53 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 01:00:53 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 01:00:53 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75165) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 01:00:53 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dc4f5bd-aba6-476c-a924-503108815feb/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 01:00:54 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dc4f5bd-aba6-476c-a924-503108815feb/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 01:00:54 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dc4f5bd-aba6-476c-a924-503108815feb/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 01:00:54 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 01:00:54 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dc4f5bd-aba6-476c-a924-503108815feb/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 01:00:54 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 01:00:54 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 01:00:54 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Hypervisor/Node resource view: name=user free_ram=9068MB free_disk=24.70407485961914GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75165) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 01:00:54 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 01:00:54 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 01:00:54 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 5dc4f5bd-aba6-476c-a924-503108815feb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 01:00:54 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75165) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 01:00:54 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75165) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 01:00:55 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 01:00:55 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 01:00:55 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Compute_service record updated for user:user {{(pid=75165) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 01:00:55 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.399s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 01:00:59 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 01:01:02 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-4c0eae3d-0ae9-423d-ab7b-514bc207481a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Acquiring lock "5dc4f5bd-aba6-476c-a924-503108815feb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 01:01:02 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-4c0eae3d-0ae9-423d-ab7b-514bc207481a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Lock "5dc4f5bd-aba6-476c-a924-503108815feb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 01:01:02 user nova-compute[75165]: DEBUG nova.objects.instance [None req-4c0eae3d-0ae9-423d-ab7b-514bc207481a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Lazy-loading 'flavor' on Instance uuid 5dc4f5bd-aba6-476c-a924-503108815feb {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 01:01:02 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-4c0eae3d-0ae9-423d-ab7b-514bc207481a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Lock "5dc4f5bd-aba6-476c-a924-503108815feb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 01:01:02 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-4c0eae3d-0ae9-423d-ab7b-514bc207481a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Acquiring lock "5dc4f5bd-aba6-476c-a924-503108815feb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 01:01:02 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-4c0eae3d-0ae9-423d-ab7b-514bc207481a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Lock "5dc4f5bd-aba6-476c-a924-503108815feb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 01:01:02 user nova-compute[75165]: INFO nova.compute.manager [None req-4c0eae3d-0ae9-423d-ab7b-514bc207481a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] [instance: 5dc4f5bd-aba6-476c-a924-503108815feb] Attaching volume 38b605b3-718c-4fa5-be8f-0422de9fdd92 to /dev/vdb
Oct 26 01:01:02 user nova-compute[75165]: DEBUG os_brick.utils [None req-4c0eae3d-0ae9-423d-ab7b-514bc207481a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 01:01:02 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 01:01:02 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 01:01:02 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[300e6a46-a512-4743-98ed-9942e808af88]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:aa94814ccb35\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 01:01:02 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 01:01:02 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 01:01:02 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[fae0dc44-a753-4847-8098-c3f1697da523]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 01:01:02 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 01:01:02 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 01:01:02 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[92cd14e8-ab22-4fde-a7fc-f12b3c1ea5b5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 01:01:02 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[d79499cd-7da8-4380-8ac3-89d700a4cbee]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 01:01:02 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-4c0eae3d-0ae9-423d-ab7b-514bc207481a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Running cmd (subprocess): nvme version {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 01:01:02 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-4c0eae3d-0ae9-423d-ab7b-514bc207481a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] 'nvme version' failed. Not Retrying. {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 01:01:02 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4c0eae3d-0ae9-423d-ab7b-514bc207481a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] nvme not present on system {{(pid=75165) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 01:01:02 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 01:01:02 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 01:01:02 user nova-compute[75165]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 01:01:02 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[11b7689a-1013-4da1-afa4-d1396290da35]: (4, '') {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 01:01:02 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-4c0eae3d-0ae9-423d-ab7b-514bc207481a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75165) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 01:01:02 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-4c0eae3d-0ae9-423d-ab7b-514bc207481a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75165) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 01:01:02 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.lightos [None req-4c0eae3d-0ae9-423d-ab7b-514bc207481a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] LIGHTOS: no hostnqn found. {{(pid=75165) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 01:01:02 user nova-compute[75165]: DEBUG os_brick.utils [None req-4c0eae3d-0ae9-423d-ab7b-514bc207481a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:aa94814ccb35', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 01:01:02 user nova-compute[75165]: DEBUG nova.virt.block_device [None req-4c0eae3d-0ae9-423d-ab7b-514bc207481a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] [instance: 5dc4f5bd-aba6-476c-a924-503108815feb] Updating existing volume attachment record: 0a96e67c-c34a-4bf5-864c-220946635049 {{(pid=75165) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 01:01:04 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 01:01:09 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 01:01:09 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 01:01:09 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75165) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 01:01:09 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75165) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 01:01:09 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75165) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 01:01:09 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 01:01:14 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 01:01:18 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c0eae3d-0ae9-423d-ab7b-514bc207481a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] [instance: 5dc4f5bd-aba6-476c-a924-503108815feb] Calling os-brick to attach iSCSI Volume {{(pid=75165) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 01:01:18 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c0eae3d-0ae9-423d-ab7b-514bc207481a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8bf8160e50>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:38b605b3-718c-4fa5-be8f-0422de9fdd92', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ogjpTEDF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 01:01:18 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-4c0eae3d-0ae9-423d-ab7b-514bc207481a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 01:01:18 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-4c0eae3d-0ae9-423d-ab7b-514bc207481a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 01:01:18 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-4c0eae3d-0ae9-423d-ab7b-514bc207481a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 01:01:18 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-4c0eae3d-0ae9-423d-ab7b-514bc207481a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 01:01:18 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-4c0eae3d-0ae9-423d-ab7b-514bc207481a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:38b605b3-718c-4fa5-be8f-0422de9fdd92" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 01:01:18 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-4c0eae3d-0ae9-423d-ab7b-514bc207481a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:38b605b3-718c-4fa5-be8f-0422de9fdd92" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 01:01:18 user nova-compute[75165]: INFO os_brick.initiator.connectors.iscsi [None req-4c0eae3d-0ae9-423d-ab7b-514bc207481a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 01:01:19 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38b605b3-718c-4fa5-be8f-0422de9fdd92 -p 172.16.0.220:3260 {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 01:01:19 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38b605b3-718c-4fa5-be8f-0422de9fdd92 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 01:01:19 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceb2a43f-5f82-4642-9386-582399dcd4e0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 01:01:19 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c0eae3d-0ae9-423d-ab7b-514bc207481a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 01:01:19 user nova-compute[75165]:  {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 01:01:19 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38b605b3-718c-4fa5-be8f-0422de9fdd92 -p 172.16.0.220:3260 --interface default --op new {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 01:01:19 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38b605b3-718c-4fa5-be8f-0422de9fdd92 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 01:01:19 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3721cbd-e7cf-4ed2-8688-1a4a32d7cff8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:38b605b3-718c-4fa5-be8f-0422de9fdd92] added\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 01:01:19 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c0eae3d-0ae9-423d-ab7b-514bc207481a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:38b605b3-718c-4fa5-be8f-0422de9fdd92] added
Oct 26 01:01:19 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 01:01:19 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38b605b3-718c-4fa5-be8f-0422de9fdd92 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 01:01:19 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38b605b3-718c-4fa5-be8f-0422de9fdd92 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 01:01:19 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[c02b92e4-3344-4923-8f16-325ef3884628]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 01:01:19 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c0eae3d-0ae9-423d-ab7b-514bc207481a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 01:01:19 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38b605b3-718c-4fa5-be8f-0422de9fdd92 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 01:01:19 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38b605b3-718c-4fa5-be8f-0422de9fdd92 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 01:01:19 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf7daddc-4bf4-473b-b02f-3f1ed84f8f6e]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 01:01:19 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c0eae3d-0ae9-423d-ab7b-514bc207481a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 01:01:19 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38b605b3-718c-4fa5-be8f-0422de9fdd92 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ogjpTEDF {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 01:01:19 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38b605b3-718c-4fa5-be8f-0422de9fdd92 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ogjpTEDF" returned: 0 in 0.017s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 01:01:19 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[5af70a7e-f4cf-4186-9ca0-2202d559e67c]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 01:01:19 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c0eae3d-0ae9-423d-ab7b-514bc207481a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ogjpTEDF'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 01:01:19 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38b605b3-718c-4fa5-be8f-0422de9fdd92 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 01:01:19 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38b605b3-718c-4fa5-be8f-0422de9fdd92 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 01:01:19 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[d336a32e-d7a3-4629-b77c-cbe6dddea675]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 01:01:19 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c0eae3d-0ae9-423d-ab7b-514bc207481a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 01:01:19 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 01:01:19 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 01:01:19 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7d1f2dd-848e-48b5-a35d-f80555c5dd47]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 01:01:19 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c0eae3d-0ae9-423d-ab7b-514bc207481a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 26 01:01:19 user nova-compute[75165]:  {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 01:01:19 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c0eae3d-0ae9-423d-ab7b-514bc207481a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 26 01:01:19 user nova-compute[75165]:  {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 01:01:19 user nova-compute[75165]: WARNING os_brick.initiator.connectors.iscsi [None req-4c0eae3d-0ae9-423d-ab7b-514bc207481a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 26 01:01:19 user nova-compute[75165]: 
Oct 26 01:01:19 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38b605b3-718c-4fa5-be8f-0422de9fdd92 -p 172.16.0.220:3260 --login {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 01:01:19 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 01:01:19 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38b605b3-718c-4fa5-be8f-0422de9fdd92 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 01:01:19 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2337c27-e5ef-425f-b3b3-e55e4f9cb49f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:38b605b3-718c-4fa5-be8f-0422de9fdd92, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:38b605b3-718c-4fa5-be8f-0422de9fdd92, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 01:01:19 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c0eae3d-0ae9-423d-ab7b-514bc207481a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:38b605b3-718c-4fa5-be8f-0422de9fdd92, portal: 172.16.0.220,3260]
Oct 26 01:01:19 user nova-compute[75165]: Login to [iface: default, target: iqn.2010-10.org.openstack:38b605b3-718c-4fa5-be8f-0422de9fdd92, portal: 172.16.0.220,3260] successful.
Oct 26 01:01:19 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 01:01:19 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38b605b3-718c-4fa5-be8f-0422de9fdd92 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 01:01:19 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38b605b3-718c-4fa5-be8f-0422de9fdd92 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 01:01:19 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[779f6608-196b-47e1-b964-53c53b5662d4]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 01:01:19 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c0eae3d-0ae9-423d-ab7b-514bc207481a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 01:01:19 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 01:01:19 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 01:01:19 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[02c13264-9dae-431d-888c-0b0fefdadc9b]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38b605b3-718c-4fa5-be8f-0422de9fdd92 (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 01:01:19 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c0eae3d-0ae9-423d-ab7b-514bc207481a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38b605b3-718c-4fa5-be8f-0422de9fdd92 (non-flash)
Oct 26 01:01:19 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 01:01:19 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c0eae3d-0ae9-423d-ab7b-514bc207481a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38b605b3-718c-4fa5-be8f-0422de9fdd92 (non-flash)
Oct 26 01:01:19 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 01:01:19 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-4c0eae3d-0ae9-423d-ab7b-514bc207481a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:38b605b3-718c-4fa5-be8f-0422de9fdd92" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.258s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 01:01:19 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c0eae3d-0ae9-423d-ab7b-514bc207481a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Connected to 172.16.0.220:3260 {{(pid=75165) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 01:01:19 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-4c0eae3d-0ae9-423d-ab7b-514bc207481a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] HCTL ('33', '-', '-', 0) found on session 59 with lun 0 {{(pid=75165) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 01:01:19 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-4c0eae3d-0ae9-423d-ab7b-514bc207481a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75165) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 01:01:19 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 01:01:19 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 01:01:19 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d28d355-93b8-4277-8c6e-3c828df93cea]: (4, ('- - 0', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 01:01:19 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-4c0eae3d-0ae9-423d-ab7b-514bc207481a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75165) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 01:01:19 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c0eae3d-0ae9-423d-ab7b-514bc207481a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:38b605b3-718c-4fa5-be8f-0422de9fdd92', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ogjpTEDF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75165) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 01:01:20 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-4c0eae3d-0ae9-423d-ab7b-514bc207481a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.293s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 01:01:20 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c0eae3d-0ae9-423d-ab7b-514bc207481a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] <== connect_volume: return (1295ms) {'type': 'block', 'scsi_wwn': '23366316139383831', 'path': '/dev/sdb'} {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 01:01:20 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c0eae3d-0ae9-423d-ab7b-514bc207481a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] [instance: 5dc4f5bd-aba6-476c-a924-503108815feb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23366316139383831', 'path': '/dev/sdb'} {{(pid=75165) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 01:01:20 user nova-compute[75165]: DEBUG nova.objects.instance [None req-4c0eae3d-0ae9-423d-ab7b-514bc207481a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Lazy-loading 'flavor' on Instance uuid 5dc4f5bd-aba6-476c-a924-503108815feb {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 01:01:20 user nova-compute[75165]: DEBUG nova.virt.libvirt.guest [None req-4c0eae3d-0ae9-423d-ab7b-514bc207481a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 01:01:20 user nova-compute[75165]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 01:01:20 user nova-compute[75165]:   <source dev="/dev/sdb"/>
Oct 26 01:01:20 user nova-compute[75165]:   <target dev="vdb" bus="virtio"/>
Oct 26 01:01:20 user nova-compute[75165]:   <serial>38b605b3-718c-4fa5-be8f-0422de9fdd92</serial>
Oct 26 01:01:20 user nova-compute[75165]: </disk>
Oct 26 01:01:20 user nova-compute[75165]:  {{(pid=75165) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 01:01:20 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-4c0eae3d-0ae9-423d-ab7b-514bc207481a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] No BDM found with device name vda, not building metadata. {{(pid=75165) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 01:01:20 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-4c0eae3d-0ae9-423d-ab7b-514bc207481a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75165) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 01:01:20 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-4c0eae3d-0ae9-423d-ab7b-514bc207481a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] No VIF found with MAC fa:16:3e:fd:a5:fb, not building metadata {{(pid=75165) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 01:01:20 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-4c0eae3d-0ae9-423d-ab7b-514bc207481a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Lock "5dc4f5bd-aba6-476c-a924-503108815feb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.564s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 01:01:22 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 01:01:23 user nova-compute[75165]: DEBUG nova.compute.manager [req-4cd4b0d6-e33e-4088-a00e-523fe9b6c370 req-2ffd848c-2911-4ad6-993f-fd8f1342374c service nova] [instance: 5dc4f5bd-aba6-476c-a924-503108815feb] Received event network-changed-fcf41550-37ef-4e93-9a0c-3d427418d01b {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 01:01:23 user nova-compute[75165]: DEBUG nova.compute.manager [req-4cd4b0d6-e33e-4088-a00e-523fe9b6c370 req-2ffd848c-2911-4ad6-993f-fd8f1342374c service nova] [instance: 5dc4f5bd-aba6-476c-a924-503108815feb] Refreshing instance network info cache due to event network-changed-fcf41550-37ef-4e93-9a0c-3d427418d01b. {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 01:01:23 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-4cd4b0d6-e33e-4088-a00e-523fe9b6c370 req-2ffd848c-2911-4ad6-993f-fd8f1342374c service nova] Acquiring lock "refresh_cache-5dc4f5bd-aba6-476c-a924-503108815feb" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 01:01:23 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-4cd4b0d6-e33e-4088-a00e-523fe9b6c370 req-2ffd848c-2911-4ad6-993f-fd8f1342374c service nova] Acquired lock "refresh_cache-5dc4f5bd-aba6-476c-a924-503108815feb" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 01:01:23 user nova-compute[75165]: DEBUG nova.network.neutron [req-4cd4b0d6-e33e-4088-a00e-523fe9b6c370 req-2ffd848c-2911-4ad6-993f-fd8f1342374c service nova] [instance: 5dc4f5bd-aba6-476c-a924-503108815feb] Refreshing network info cache for port fcf41550-37ef-4e93-9a0c-3d427418d01b {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 01:01:24 user nova-compute[75165]: DEBUG nova.network.neutron [req-4cd4b0d6-e33e-4088-a00e-523fe9b6c370 req-2ffd848c-2911-4ad6-993f-fd8f1342374c service nova] [instance: 5dc4f5bd-aba6-476c-a924-503108815feb] Updated VIF entry in instance network info cache for port fcf41550-37ef-4e93-9a0c-3d427418d01b. {{(pid=75165) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 01:01:24 user nova-compute[75165]: DEBUG nova.network.neutron [req-4cd4b0d6-e33e-4088-a00e-523fe9b6c370 req-2ffd848c-2911-4ad6-993f-fd8f1342374c service nova] [instance: 5dc4f5bd-aba6-476c-a924-503108815feb] Updating instance_info_cache with network_info: [{"id": "fcf41550-37ef-4e93-9a0c-3d427418d01b", "address": "fa:16:3e:fd:a5:fb", "network": {"id": "30343eb9-5e61-407a-8491-e58b28ff1645", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1025901471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f535693c3cbd4f4e969f279167ef7ba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcf41550-37", "ovs_interfaceid": "fcf41550-37ef-4e93-9a0c-3d427418d01b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 01:01:24 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-4cd4b0d6-e33e-4088-a00e-523fe9b6c370 req-2ffd848c-2911-4ad6-993f-fd8f1342374c service nova] Releasing lock "refresh_cache-5dc4f5bd-aba6-476c-a924-503108815feb" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 01:01:24 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 01:01:25 user nova-compute[75165]: DEBUG nova.compute.manager [req-fd2f810b-e012-4ad6-b810-3e2045a859c7 req-eacef8bf-97c1-40f1-9a75-ae22fd14c3d4 service nova] [instance: 5dc4f5bd-aba6-476c-a924-503108815feb] Received event network-changed-fcf41550-37ef-4e93-9a0c-3d427418d01b {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 01:01:25 user nova-compute[75165]: DEBUG nova.compute.manager [req-fd2f810b-e012-4ad6-b810-3e2045a859c7 req-eacef8bf-97c1-40f1-9a75-ae22fd14c3d4 service nova] [instance: 5dc4f5bd-aba6-476c-a924-503108815feb] Refreshing instance network info cache due to event network-changed-fcf41550-37ef-4e93-9a0c-3d427418d01b. {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 01:01:25 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-fd2f810b-e012-4ad6-b810-3e2045a859c7 req-eacef8bf-97c1-40f1-9a75-ae22fd14c3d4 service nova] Acquiring lock "refresh_cache-5dc4f5bd-aba6-476c-a924-503108815feb" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 01:01:25 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-fd2f810b-e012-4ad6-b810-3e2045a859c7 req-eacef8bf-97c1-40f1-9a75-ae22fd14c3d4 service nova] Acquired lock "refresh_cache-5dc4f5bd-aba6-476c-a924-503108815feb" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 01:01:25 user nova-compute[75165]: DEBUG nova.network.neutron [req-fd2f810b-e012-4ad6-b810-3e2045a859c7 req-eacef8bf-97c1-40f1-9a75-ae22fd14c3d4 service nova] [instance: 5dc4f5bd-aba6-476c-a924-503108815feb] Refreshing network info cache for port fcf41550-37ef-4e93-9a0c-3d427418d01b {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 01:01:25 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-1bbeb46e-1607-434c-8759-822ad9850f11 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Acquiring lock "5dc4f5bd-aba6-476c-a924-503108815feb" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 01:01:25 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-1bbeb46e-1607-434c-8759-822ad9850f11 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Lock "5dc4f5bd-aba6-476c-a924-503108815feb" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 01:01:25 user nova-compute[75165]: INFO nova.compute.manager [None req-1bbeb46e-1607-434c-8759-822ad9850f11 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] [instance: 5dc4f5bd-aba6-476c-a924-503108815feb] Rebooting instance
Oct 26 01:01:25 user nova-compute[75165]: DEBUG nova.network.neutron [req-fd2f810b-e012-4ad6-b810-3e2045a859c7 req-eacef8bf-97c1-40f1-9a75-ae22fd14c3d4 service nova] [instance: 5dc4f5bd-aba6-476c-a924-503108815feb] Updated VIF entry in instance network info cache for port fcf41550-37ef-4e93-9a0c-3d427418d01b. {{(pid=75165) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 01:01:25 user nova-compute[75165]: DEBUG nova.network.neutron [req-fd2f810b-e012-4ad6-b810-3e2045a859c7 req-eacef8bf-97c1-40f1-9a75-ae22fd14c3d4 service nova] [instance: 5dc4f5bd-aba6-476c-a924-503108815feb] Updating instance_info_cache with network_info: [{"id": "fcf41550-37ef-4e93-9a0c-3d427418d01b", "address": "fa:16:3e:fd:a5:fb", "network": {"id": "30343eb9-5e61-407a-8491-e58b28ff1645", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1025901471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f535693c3cbd4f4e969f279167ef7ba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcf41550-37", "ovs_interfaceid": "fcf41550-37ef-4e93-9a0c-3d427418d01b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 01:01:26 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-fd2f810b-e012-4ad6-b810-3e2045a859c7 req-eacef8bf-97c1-40f1-9a75-ae22fd14c3d4 service nova] Releasing lock "refresh_cache-5dc4f5bd-aba6-476c-a924-503108815feb" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 01:01:26 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-1bbeb46e-1607-434c-8759-822ad9850f11 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Acquiring lock "refresh_cache-5dc4f5bd-aba6-476c-a924-503108815feb" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 01:01:26 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-1bbeb46e-1607-434c-8759-822ad9850f11 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Acquired lock "refresh_cache-5dc4f5bd-aba6-476c-a924-503108815feb" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 01:01:26 user nova-compute[75165]: DEBUG nova.network.neutron [None req-1bbeb46e-1607-434c-8759-822ad9850f11 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] [instance: 5dc4f5bd-aba6-476c-a924-503108815feb] Building network info cache for instance {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 01:01:26 user nova-compute[75165]: DEBUG nova.network.neutron [None req-1bbeb46e-1607-434c-8759-822ad9850f11 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] [instance: 5dc4f5bd-aba6-476c-a924-503108815feb] Updating instance_info_cache with network_info: [{"id": "fcf41550-37ef-4e93-9a0c-3d427418d01b", "address": "fa:16:3e:fd:a5:fb", "network": {"id": "30343eb9-5e61-407a-8491-e58b28ff1645", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1025901471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f535693c3cbd4f4e969f279167ef7ba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcf41550-37", "ovs_interfaceid": "fcf41550-37ef-4e93-9a0c-3d427418d01b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 01:01:26 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-1bbeb46e-1607-434c-8759-822ad9850f11 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Releasing lock "refresh_cache-5dc4f5bd-aba6-476c-a924-503108815feb" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 01:01:26 user nova-compute[75165]: DEBUG nova.compute.manager [None req-1bbeb46e-1607-434c-8759-822ad9850f11 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] [instance: 5dc4f5bd-aba6-476c-a924-503108815feb] Checking state {{(pid=75165) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 01:01:27 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 01:01:28 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 01:01:28 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 01:01:28 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 01:01:28 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 01:01:28 user nova-compute[75165]: DEBUG nova.compute.manager [req-63758d37-e1be-49c3-9b25-0f4d30eeebad req-02040aec-eded-425e-9b92-70cf48fd331a service nova] [instance: 5dc4f5bd-aba6-476c-a924-503108815feb] Received event network-vif-unplugged-fcf41550-37ef-4e93-9a0c-3d427418d01b {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 01:01:28 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-63758d37-e1be-49c3-9b25-0f4d30eeebad req-02040aec-eded-425e-9b92-70cf48fd331a service nova] Acquiring lock "5dc4f5bd-aba6-476c-a924-503108815feb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 01:01:28 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-63758d37-e1be-49c3-9b25-0f4d30eeebad req-02040aec-eded-425e-9b92-70cf48fd331a service nova] Lock "5dc4f5bd-aba6-476c-a924-503108815feb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 01:01:28 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-63758d37-e1be-49c3-9b25-0f4d30eeebad req-02040aec-eded-425e-9b92-70cf48fd331a service nova] Lock "5dc4f5bd-aba6-476c-a924-503108815feb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 01:01:28 user nova-compute[75165]: DEBUG nova.compute.manager [req-63758d37-e1be-49c3-9b25-0f4d30eeebad req-02040aec-eded-425e-9b92-70cf48fd331a service nova] [instance: 5dc4f5bd-aba6-476c-a924-503108815feb] No waiting events found dispatching network-vif-unplugged-fcf41550-37ef-4e93-9a0c-3d427418d01b {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 01:01:28 user nova-compute[75165]: WARNING nova.compute.manager [req-63758d37-e1be-49c3-9b25-0f4d30eeebad req-02040aec-eded-425e-9b92-70cf48fd331a service nova] [instance: 5dc4f5bd-aba6-476c-a924-503108815feb] Received unexpected event network-vif-unplugged-fcf41550-37ef-4e93-9a0c-3d427418d01b for instance with vm_state active and task_state reboot_started.
Oct 26 01:01:29 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 01:01:29 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 01:01:29 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 01:01:29 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-1bbeb46e-1607-434c-8759-822ad9850f11 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] [instance: 5dc4f5bd-aba6-476c-a924-503108815feb] Instance shutdown successfully.
Oct 26 01:01:30 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 01:01:30 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 01:01:30 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 01:01:31 user nova-compute[75165]: DEBUG nova.compute.manager [req-4c289ab9-5a30-4f24-8c90-44ee6cde1f66 req-1e7ebea5-2b1d-4f3e-b720-11d894586e21 service nova] [instance: 5dc4f5bd-aba6-476c-a924-503108815feb] Received event network-vif-plugged-fcf41550-37ef-4e93-9a0c-3d427418d01b {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 01:01:31 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-4c289ab9-5a30-4f24-8c90-44ee6cde1f66 req-1e7ebea5-2b1d-4f3e-b720-11d894586e21 service nova] Acquiring lock "5dc4f5bd-aba6-476c-a924-503108815feb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 01:01:31 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-4c289ab9-5a30-4f24-8c90-44ee6cde1f66 req-1e7ebea5-2b1d-4f3e-b720-11d894586e21 service nova] Lock "5dc4f5bd-aba6-476c-a924-503108815feb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 01:01:31 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-4c289ab9-5a30-4f24-8c90-44ee6cde1f66 req-1e7ebea5-2b1d-4f3e-b720-11d894586e21 service nova] Lock "5dc4f5bd-aba6-476c-a924-503108815feb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 01:01:31 user nova-compute[75165]: DEBUG nova.compute.manager [req-4c289ab9-5a30-4f24-8c90-44ee6cde1f66 req-1e7ebea5-2b1d-4f3e-b720-11d894586e21 service nova] [instance: 5dc4f5bd-aba6-476c-a924-503108815feb] No waiting events found dispatching network-vif-plugged-fcf41550-37ef-4e93-9a0c-3d427418d01b {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 01:01:31 user nova-compute[75165]: WARNING nova.compute.manager [req-4c289ab9-5a30-4f24-8c90-44ee6cde1f66 req-1e7ebea5-2b1d-4f3e-b720-11d894586e21 service nova] [instance: 5dc4f5bd-aba6-476c-a924-503108815feb] Received unexpected event network-vif-plugged-fcf41550-37ef-4e93-9a0c-3d427418d01b for instance with vm_state active and task_state reboot_started.
Oct 26 01:01:31 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 01:01:31 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 01:01:31 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 01:01:31 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 01:01:32 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 01:01:33 user nova-compute[75165]: DEBUG nova.compute.manager [req-58545e79-e507-4090-86c0-58d64866bde9 req-84ad5211-51f8-4ce2-8a93-90238ea918db service nova] [instance: 5dc4f5bd-aba6-476c-a924-503108815feb] Received event network-vif-plugged-fcf41550-37ef-4e93-9a0c-3d427418d01b {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 01:01:33 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-58545e79-e507-4090-86c0-58d64866bde9 req-84ad5211-51f8-4ce2-8a93-90238ea918db service nova] Acquiring lock "5dc4f5bd-aba6-476c-a924-503108815feb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 01:01:33 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-58545e79-e507-4090-86c0-58d64866bde9 req-84ad5211-51f8-4ce2-8a93-90238ea918db service nova] Lock "5dc4f5bd-aba6-476c-a924-503108815feb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 01:01:33 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-58545e79-e507-4090-86c0-58d64866bde9 req-84ad5211-51f8-4ce2-8a93-90238ea918db service nova] Lock "5dc4f5bd-aba6-476c-a924-503108815feb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 01:01:33 user nova-compute[75165]: DEBUG nova.compute.manager [req-58545e79-e507-4090-86c0-58d64866bde9 req-84ad5211-51f8-4ce2-8a93-90238ea918db service nova] [instance: 5dc4f5bd-aba6-476c-a924-503108815feb] No waiting events found dispatching network-vif-plugged-fcf41550-37ef-4e93-9a0c-3d427418d01b {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 01:01:33 user nova-compute[75165]: WARNING nova.compute.manager [req-58545e79-e507-4090-86c0-58d64866bde9 req-84ad5211-51f8-4ce2-8a93-90238ea918db service nova] [instance: 5dc4f5bd-aba6-476c-a924-503108815feb] Received unexpected event network-vif-plugged-fcf41550-37ef-4e93-9a0c-3d427418d01b for instance with vm_state active and task_state reboot_started.
Oct 26 01:01:33 user nova-compute[75165]: DEBUG nova.compute.manager [req-58545e79-e507-4090-86c0-58d64866bde9 req-84ad5211-51f8-4ce2-8a93-90238ea918db service nova] [instance: 5dc4f5bd-aba6-476c-a924-503108815feb] Received event network-vif-plugged-fcf41550-37ef-4e93-9a0c-3d427418d01b {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 01:01:33 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-58545e79-e507-4090-86c0-58d64866bde9 req-84ad5211-51f8-4ce2-8a93-90238ea918db service nova] Acquiring lock "5dc4f5bd-aba6-476c-a924-503108815feb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 01:01:33 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-58545e79-e507-4090-86c0-58d64866bde9 req-84ad5211-51f8-4ce2-8a93-90238ea918db service nova] Lock "5dc4f5bd-aba6-476c-a924-503108815feb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 01:01:33 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-58545e79-e507-4090-86c0-58d64866bde9 req-84ad5211-51f8-4ce2-8a93-90238ea918db service nova] Lock "5dc4f5bd-aba6-476c-a924-503108815feb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 01:01:33 user nova-compute[75165]: DEBUG nova.compute.manager [req-58545e79-e507-4090-86c0-58d64866bde9 req-84ad5211-51f8-4ce2-8a93-90238ea918db service nova] [instance: 5dc4f5bd-aba6-476c-a924-503108815feb] No waiting events found dispatching network-vif-plugged-fcf41550-37ef-4e93-9a0c-3d427418d01b {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 01:01:33 user nova-compute[75165]: WARNING nova.compute.manager [req-58545e79-e507-4090-86c0-58d64866bde9 req-84ad5211-51f8-4ce2-8a93-90238ea918db service nova] [instance: 5dc4f5bd-aba6-476c-a924-503108815feb] Received unexpected event network-vif-plugged-fcf41550-37ef-4e93-9a0c-3d427418d01b for instance with vm_state active and task_state reboot_started.
Oct 26 01:01:33 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: 5dc4f5bd-aba6-476c-a924-503108815feb] Instance running successfully.
Oct 26 01:01:33 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-1bbeb46e-1607-434c-8759-822ad9850f11 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] [instance: 5dc4f5bd-aba6-476c-a924-503108815feb] Instance soft rebooted successfully.
Oct 26 01:01:33 user nova-compute[75165]: DEBUG nova.compute.manager [None req-1bbeb46e-1607-434c-8759-822ad9850f11 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] [instance: 5dc4f5bd-aba6-476c-a924-503108815feb] Checking state {{(pid=75165) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 01:01:33 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-1bbeb46e-1607-434c-8759-822ad9850f11 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Lock "5dc4f5bd-aba6-476c-a924-503108815feb" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.245s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 01:01:34 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 01:01:37 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 01:01:39 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 01:01:42 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 01:01:42 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75165) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 01:01:42 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 01:01:43 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 01:01:43 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 01:01:44 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 01:01:45 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 01:01:47 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 01:01:47 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 01:01:49 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 01:01:51 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 01:01:52 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 01:01:53 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 01:01:53 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 01:01:53 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 01:01:53 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 01:01:53 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 01:01:53 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 01:01:53 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75165) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 01:01:53 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dc4f5bd-aba6-476c-a924-503108815feb/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 01:01:54 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dc4f5bd-aba6-476c-a924-503108815feb/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 01:01:54 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dc4f5bd-aba6-476c-a924-503108815feb/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 01:01:54 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 01:01:54 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dc4f5bd-aba6-476c-a924-503108815feb/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 01:01:54 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75165) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 01:01:54 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 01:01:54 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 01:01:54 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Hypervisor/Node resource view: name=user free_ram=8997MB free_disk=24.69426727294922GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75165) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 01:01:54 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 01:01:54 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 01:01:54 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 5dc4f5bd-aba6-476c-a924-503108815feb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 01:01:54 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75165) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 01:01:54 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75165) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 01:01:54 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 01:01:54 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 01:01:54 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Compute_service record updated for user:user {{(pid=75165) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 01:01:54 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.183s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 01:01:55 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 01:01:55 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Starting heal instance info cache {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 01:01:55 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Rebuilding the list of instances to heal {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 01:01:55 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "refresh_cache-5dc4f5bd-aba6-476c-a924-503108815feb" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 01:01:55 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquired lock "refresh_cache-5dc4f5bd-aba6-476c-a924-503108815feb" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 01:01:55 user nova-compute[75165]: DEBUG nova.network.neutron [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: 5dc4f5bd-aba6-476c-a924-503108815feb] Forcefully refreshing network info cache for instance {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 01:01:55 user nova-compute[75165]: DEBUG nova.objects.instance [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lazy-loading 'info_cache' on Instance uuid 5dc4f5bd-aba6-476c-a924-503108815feb {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 01:01:56 user nova-compute[75165]: DEBUG nova.network.neutron [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: 5dc4f5bd-aba6-476c-a924-503108815feb] Updating instance_info_cache with network_info: [{"id": "fcf41550-37ef-4e93-9a0c-3d427418d01b", "address": "fa:16:3e:fd:a5:fb", "network": {"id": "30343eb9-5e61-407a-8491-e58b28ff1645", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1025901471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f535693c3cbd4f4e969f279167ef7ba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcf41550-37", "ovs_interfaceid": "fcf41550-37ef-4e93-9a0c-3d427418d01b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 01:01:56 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Releasing lock "refresh_cache-5dc4f5bd-aba6-476c-a924-503108815feb" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 01:01:56 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: 5dc4f5bd-aba6-476c-a924-503108815feb] Updated the network info_cache for instance {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 01:01:57 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 01:01:59 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 01:02:02 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 01:02:04 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 01:02:09 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 01:02:14 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 01:02:19 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 01:02:24 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 01:02:24 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 01:02:24 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75165) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 01:02:24 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75165) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 01:02:24 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75165) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 01:02:24 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 01:02:29 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 01:02:34 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 01:02:39 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 01:02:42 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 01:02:42 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75165) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 01:02:44 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 01:02:44 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 01:02:47 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 01:02:49 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 01:02:49 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 01:02:53 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 01:02:53 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 01:02:53 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 01:02:53 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 01:02:53 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 01:02:53 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75165) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 01:02:53 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dc4f5bd-aba6-476c-a924-503108815feb/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 01:02:54 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dc4f5bd-aba6-476c-a924-503108815feb/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 01:02:54 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dc4f5bd-aba6-476c-a924-503108815feb/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 01:02:54 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 01:02:54 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dc4f5bd-aba6-476c-a924-503108815feb/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 01:02:54 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75165) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 01:02:54 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 01:02:54 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 01:02:54 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Hypervisor/Node resource view: name=user free_ram=9059MB free_disk=24.693622589111328GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75165) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 01:02:54 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 01:02:54 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 01:02:54 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 5dc4f5bd-aba6-476c-a924-503108815feb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 01:02:54 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75165) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 01:02:54 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75165) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 01:02:54 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 01:02:54 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 01:02:54 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Compute_service record updated for user:user {{(pid=75165) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 01:02:54 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.187s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 01:02:55 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 01:02:55 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_shelved_instances {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 01:02:55 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 01:02:56 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 01:02:56 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Starting heal instance info cache {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 01:02:56 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Rebuilding the list of instances to heal {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 01:02:57 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "refresh_cache-5dc4f5bd-aba6-476c-a924-503108815feb" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 01:02:57 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquired lock "refresh_cache-5dc4f5bd-aba6-476c-a924-503108815feb" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 01:02:57 user nova-compute[75165]: DEBUG nova.network.neutron [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: 5dc4f5bd-aba6-476c-a924-503108815feb] Forcefully refreshing network info cache for instance {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 01:02:57 user nova-compute[75165]: DEBUG nova.objects.instance [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lazy-loading 'info_cache' on Instance uuid 5dc4f5bd-aba6-476c-a924-503108815feb {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 01:02:57 user nova-compute[75165]: DEBUG nova.network.neutron [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: 5dc4f5bd-aba6-476c-a924-503108815feb] Updating instance_info_cache with network_info: [{"id": "fcf41550-37ef-4e93-9a0c-3d427418d01b", "address": "fa:16:3e:fd:a5:fb", "network": {"id": "30343eb9-5e61-407a-8491-e58b28ff1645", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1025901471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f535693c3cbd4f4e969f279167ef7ba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcf41550-37", "ovs_interfaceid": "fcf41550-37ef-4e93-9a0c-3d427418d01b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 01:02:57 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Releasing lock "refresh_cache-5dc4f5bd-aba6-476c-a924-503108815feb" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 01:02:57 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: 5dc4f5bd-aba6-476c-a924-503108815feb] Updated the network info_cache for instance {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 01:02:59 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 01:03:04 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 01:03:09 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 01:03:14 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 01:03:14 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 01:03:14 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75165) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 01:03:14 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75165) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 01:03:14 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75165) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 01:03:14 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 01:03:17 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 01:03:17 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 01:03:17 user nova-compute[75165]: DEBUG nova.compute.manager [req-1047f7ff-aa77-490a-a6a7-e61cb3bf12cb req-dcf32d42-febe-4caf-b23b-77fb5ea2e800 service nova] [instance: 5dc4f5bd-aba6-476c-a924-503108815feb] Received event network-changed-fcf41550-37ef-4e93-9a0c-3d427418d01b {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 01:03:17 user nova-compute[75165]: DEBUG nova.compute.manager [req-1047f7ff-aa77-490a-a6a7-e61cb3bf12cb req-dcf32d42-febe-4caf-b23b-77fb5ea2e800 service nova] [instance: 5dc4f5bd-aba6-476c-a924-503108815feb] Refreshing instance network info cache due to event network-changed-fcf41550-37ef-4e93-9a0c-3d427418d01b. {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 01:03:17 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-1047f7ff-aa77-490a-a6a7-e61cb3bf12cb req-dcf32d42-febe-4caf-b23b-77fb5ea2e800 service nova] Acquiring lock "refresh_cache-5dc4f5bd-aba6-476c-a924-503108815feb" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 01:03:17 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-1047f7ff-aa77-490a-a6a7-e61cb3bf12cb req-dcf32d42-febe-4caf-b23b-77fb5ea2e800 service nova] Acquired lock "refresh_cache-5dc4f5bd-aba6-476c-a924-503108815feb" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 01:03:17 user nova-compute[75165]: DEBUG nova.network.neutron [req-1047f7ff-aa77-490a-a6a7-e61cb3bf12cb req-dcf32d42-febe-4caf-b23b-77fb5ea2e800 service nova] [instance: 5dc4f5bd-aba6-476c-a924-503108815feb] Refreshing network info cache for port fcf41550-37ef-4e93-9a0c-3d427418d01b {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 01:03:18 user nova-compute[75165]: DEBUG nova.network.neutron [req-1047f7ff-aa77-490a-a6a7-e61cb3bf12cb req-dcf32d42-febe-4caf-b23b-77fb5ea2e800 service nova] [instance: 5dc4f5bd-aba6-476c-a924-503108815feb] Updated VIF entry in instance network info cache for port fcf41550-37ef-4e93-9a0c-3d427418d01b. {{(pid=75165) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 01:03:18 user nova-compute[75165]: DEBUG nova.network.neutron [req-1047f7ff-aa77-490a-a6a7-e61cb3bf12cb req-dcf32d42-febe-4caf-b23b-77fb5ea2e800 service nova] [instance: 5dc4f5bd-aba6-476c-a924-503108815feb] Updating instance_info_cache with network_info: [{"id": "fcf41550-37ef-4e93-9a0c-3d427418d01b", "address": "fa:16:3e:fd:a5:fb", "network": {"id": "30343eb9-5e61-407a-8491-e58b28ff1645", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1025901471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f535693c3cbd4f4e969f279167ef7ba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcf41550-37", "ovs_interfaceid": "fcf41550-37ef-4e93-9a0c-3d427418d01b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 01:03:18 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-1047f7ff-aa77-490a-a6a7-e61cb3bf12cb req-dcf32d42-febe-4caf-b23b-77fb5ea2e800 service nova] Releasing lock "refresh_cache-5dc4f5bd-aba6-476c-a924-503108815feb" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 01:03:18 user nova-compute[75165]: DEBUG nova.compute.manager [req-fe71a50a-b78a-4bc1-8b4b-db00c145ace0 req-2f86c85e-3c5a-45f1-94cd-6dc04dec0496 service nova] [instance: 5dc4f5bd-aba6-476c-a924-503108815feb] Received event network-changed-fcf41550-37ef-4e93-9a0c-3d427418d01b {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 01:03:18 user nova-compute[75165]: DEBUG nova.compute.manager [req-fe71a50a-b78a-4bc1-8b4b-db00c145ace0 req-2f86c85e-3c5a-45f1-94cd-6dc04dec0496 service nova] [instance: 5dc4f5bd-aba6-476c-a924-503108815feb] Refreshing instance network info cache due to event network-changed-fcf41550-37ef-4e93-9a0c-3d427418d01b. {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 01:03:18 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-fe71a50a-b78a-4bc1-8b4b-db00c145ace0 req-2f86c85e-3c5a-45f1-94cd-6dc04dec0496 service nova] Acquiring lock "refresh_cache-5dc4f5bd-aba6-476c-a924-503108815feb" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 01:03:18 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-fe71a50a-b78a-4bc1-8b4b-db00c145ace0 req-2f86c85e-3c5a-45f1-94cd-6dc04dec0496 service nova] Acquired lock "refresh_cache-5dc4f5bd-aba6-476c-a924-503108815feb" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 01:03:18 user nova-compute[75165]: DEBUG nova.network.neutron [req-fe71a50a-b78a-4bc1-8b4b-db00c145ace0 req-2f86c85e-3c5a-45f1-94cd-6dc04dec0496 service nova] [instance: 5dc4f5bd-aba6-476c-a924-503108815feb] Refreshing network info cache for port fcf41550-37ef-4e93-9a0c-3d427418d01b {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 01:03:18 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-94abe4d5-701c-40a2-82e4-5eaa73549bc7 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Acquiring lock "5dc4f5bd-aba6-476c-a924-503108815feb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 01:03:18 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-94abe4d5-701c-40a2-82e4-5eaa73549bc7 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Lock "5dc4f5bd-aba6-476c-a924-503108815feb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 01:03:18 user nova-compute[75165]: INFO nova.compute.manager [None req-94abe4d5-701c-40a2-82e4-5eaa73549bc7 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] [instance: 5dc4f5bd-aba6-476c-a924-503108815feb] Detaching volume 38b605b3-718c-4fa5-be8f-0422de9fdd92
Oct 26 01:03:18 user nova-compute[75165]: INFO nova.virt.block_device [None req-94abe4d5-701c-40a2-82e4-5eaa73549bc7 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] [instance: 5dc4f5bd-aba6-476c-a924-503108815feb] Attempting to driver detach volume 38b605b3-718c-4fa5-be8f-0422de9fdd92 from mountpoint /dev/vdb
Oct 26 01:03:18 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-94abe4d5-701c-40a2-82e4-5eaa73549bc7 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Attempting to detach device vdb from instance 5dc4f5bd-aba6-476c-a924-503108815feb from the persistent domain config. {{(pid=75165) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 01:03:18 user nova-compute[75165]: DEBUG nova.virt.libvirt.guest [None req-94abe4d5-701c-40a2-82e4-5eaa73549bc7 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 01:03:18 user nova-compute[75165]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 01:03:18 user nova-compute[75165]:   <source dev="/dev/sdb"/>
Oct 26 01:03:18 user nova-compute[75165]:   <target dev="vdb" bus="virtio"/>
Oct 26 01:03:18 user nova-compute[75165]:   <serial>38b605b3-718c-4fa5-be8f-0422de9fdd92</serial>
Oct 26 01:03:18 user nova-compute[75165]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 01:03:18 user nova-compute[75165]: </disk>
Oct 26 01:03:18 user nova-compute[75165]:  {{(pid=75165) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 01:03:18 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-94abe4d5-701c-40a2-82e4-5eaa73549bc7 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Successfully detached device vdb from instance 5dc4f5bd-aba6-476c-a924-503108815feb from the persistent domain config.
Oct 26 01:03:18 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-94abe4d5-701c-40a2-82e4-5eaa73549bc7 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5dc4f5bd-aba6-476c-a924-503108815feb from the live domain config. {{(pid=75165) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 01:03:18 user nova-compute[75165]: DEBUG nova.virt.libvirt.guest [None req-94abe4d5-701c-40a2-82e4-5eaa73549bc7 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 01:03:18 user nova-compute[75165]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 01:03:18 user nova-compute[75165]:   <source dev="/dev/sdb"/>
Oct 26 01:03:18 user nova-compute[75165]:   <target dev="vdb" bus="virtio"/>
Oct 26 01:03:18 user nova-compute[75165]:   <serial>38b605b3-718c-4fa5-be8f-0422de9fdd92</serial>
Oct 26 01:03:18 user nova-compute[75165]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 01:03:18 user nova-compute[75165]: </disk>
Oct 26 01:03:18 user nova-compute[75165]:  {{(pid=75165) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 01:03:18 user nova-compute[75165]: DEBUG nova.network.neutron [req-fe71a50a-b78a-4bc1-8b4b-db00c145ace0 req-2f86c85e-3c5a-45f1-94cd-6dc04dec0496 service nova] [instance: 5dc4f5bd-aba6-476c-a924-503108815feb] Updated VIF entry in instance network info cache for port fcf41550-37ef-4e93-9a0c-3d427418d01b. {{(pid=75165) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 01:03:18 user nova-compute[75165]: DEBUG nova.network.neutron [req-fe71a50a-b78a-4bc1-8b4b-db00c145ace0 req-2f86c85e-3c5a-45f1-94cd-6dc04dec0496 service nova] [instance: 5dc4f5bd-aba6-476c-a924-503108815feb] Updating instance_info_cache with network_info: [{"id": "fcf41550-37ef-4e93-9a0c-3d427418d01b", "address": "fa:16:3e:fd:a5:fb", "network": {"id": "30343eb9-5e61-407a-8491-e58b28ff1645", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1025901471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f535693c3cbd4f4e969f279167ef7ba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcf41550-37", "ovs_interfaceid": "fcf41550-37ef-4e93-9a0c-3d427418d01b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 01:03:18 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-fe71a50a-b78a-4bc1-8b4b-db00c145ace0 req-2f86c85e-3c5a-45f1-94cd-6dc04dec0496 service nova] Releasing lock "refresh_cache-5dc4f5bd-aba6-476c-a924-503108815feb" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 01:03:19 user nova-compute[75165]: DEBUG nova.virt.libvirt.driver [None req-94abe4d5-701c-40a2-82e4-5eaa73549bc7 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5dc4f5bd-aba6-476c-a924-503108815feb {{(pid=75165) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 01:03:19 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 01:03:24 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 01:03:29 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 01:03:34 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 01:03:39 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-94abe4d5-701c-40a2-82e4-5eaa73549bc7 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 5dc4f5bd-aba6-476c-a924-503108815feb is timed out.
Oct 26 01:03:39 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-94abe4d5-701c-40a2-82e4-5eaa73549bc7 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Successfully detached device vdb from instance 5dc4f5bd-aba6-476c-a924-503108815feb from the live domain config.
Oct 26 01:03:39 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-94abe4d5-701c-40a2-82e4-5eaa73549bc7 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] [instance: 5dc4f5bd-aba6-476c-a924-503108815feb] calling os-brick to detach iSCSI Volume {{(pid=75165) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 01:03:39 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-94abe4d5-701c-40a2-82e4-5eaa73549bc7 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8bf8160e50>, {'target_iqn': 'iqn.2010-10.org.openstack:38b605b3-718c-4fa5-be8f-0422de9fdd92', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ogjpTEDF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 01:03:39 user nova-compute[75165]: WARNING os_brick.initiator.connectors.base [None req-94abe4d5-701c-40a2-82e4-5eaa73549bc7 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 01:03:39 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-94abe4d5-701c-40a2-82e4-5eaa73549bc7 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 01:03:39 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-94abe4d5-701c-40a2-82e4-5eaa73549bc7 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 01:03:39 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 01:03:39 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 01:03:39 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bf8fa4a-884b-42e9-b4df-7c970b38ad1d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:38b605b3-718c-4fa5-be8f-0422de9fdd92\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 01:03:39 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-94abe4d5-701c-40a2-82e4-5eaa73549bc7 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 01:03:39 user nova-compute[75165]: No targets found.
Oct 26 01:03:39 user nova-compute[75165]: iSNS:
Oct 26 01:03:39 user nova-compute[75165]: No targets found.
Oct 26 01:03:39 user nova-compute[75165]: STATIC:
Oct 26 01:03:39 user nova-compute[75165]: Target: iqn.2010-10.org.openstack:38b605b3-718c-4fa5-be8f-0422de9fdd92
Oct 26 01:03:39 user nova-compute[75165]:         Portal: 172.16.0.220:3260,-1
Oct 26 01:03:39 user nova-compute[75165]:                 Iface Name: default
Oct 26 01:03:39 user nova-compute[75165]: FIRMWARE:
Oct 26 01:03:39 user nova-compute[75165]: No targets found.
Oct 26 01:03:39 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 01:03:39 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-94abe4d5-701c-40a2-82e4-5eaa73549bc7 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 01:03:39 user nova-compute[75165]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 01:03:39 user nova-compute[75165]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75165) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 01:03:39 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-94abe4d5-701c-40a2-82e4-5eaa73549bc7 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:38b605b3-718c-4fa5-be8f-0422de9fdd92', 0)] {{(pid=75165) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 01:03:39 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 01:03:39 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 01:03:39 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bae0ee4-3825-4c8c-8a28-fbbe6ace6ac9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:38b605b3-718c-4fa5-be8f-0422de9fdd92\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 01:03:39 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 01:03:39 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 01:03:39 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[77b5aee5-7ff3-440f-8ddf-7a4e95160479]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38b605b3-718c-4fa5-be8f-0422de9fdd92 (non-flash)\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 01:03:39 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-94abe4d5-701c-40a2-82e4-5eaa73549bc7 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38b605b3-718c-4fa5-be8f-0422de9fdd92 (non-flash)
Oct 26 01:03:39 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 01:03:39 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-94abe4d5-701c-40a2-82e4-5eaa73549bc7 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38b605b3-718c-4fa5-be8f-0422de9fdd92 (non-flash)
Oct 26 01:03:39 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 01:03:39 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-94abe4d5-701c-40a2-82e4-5eaa73549bc7 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8be04e6560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:38b605b3-718c-4fa5-be8f-0422de9fdd92'): ({'sdb'}, set())}) {{(pid=75165) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 01:03:39 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-94abe4d5-701c-40a2-82e4-5eaa73549bc7 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Removing single pathed devices sdb {{(pid=75165) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 01:03:39 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 01:03:39 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 01:03:39 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[34ef3628-a9bb-4bee-9ba2-3efb6eebbc07]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 01:03:39 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 01:03:39 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 01:03:39 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[15c58049-ee14-466b-a8d4-58077a74966b]: (4, ('ok\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 01:03:39 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-94abe4d5-701c-40a2-82e4-5eaa73549bc7 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Flushing IO for device /dev/sdb {{(pid=75165) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 01:03:39 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 01:03:39 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.019s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 01:03:39 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b780dc7-7b98-4c02-944e-d3870e15e34c]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 01:03:39 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-94abe4d5-701c-40a2-82e4-5eaa73549bc7 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75165) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 01:03:39 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 01:03:39 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 01:03:39 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1e8ba93-9fb8-4eb8-8974-117830fe727c]: (4, ('1', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 01:03:39 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-94abe4d5-701c-40a2-82e4-5eaa73549bc7 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75165) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 01:03:39 user nova-compute[75165]: DEBUG os_brick.initiator.linuxscsi [None req-94abe4d5-701c-40a2-82e4-5eaa73549bc7 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] SCSI volumes sdb have been removed. {{(pid=75165) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 01:03:39 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-94abe4d5-701c-40a2-82e4-5eaa73549bc7 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:38b605b3-718c-4fa5-be8f-0422de9fdd92')] {{(pid=75165) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 01:03:39 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38b605b3-718c-4fa5-be8f-0422de9fdd92 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 01:03:39 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38b605b3-718c-4fa5-be8f-0422de9fdd92 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 01:03:39 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[07704aac-cc3b-463c-b80a-ee1602052588]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 01:03:39 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-94abe4d5-701c-40a2-82e4-5eaa73549bc7 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 01:03:39 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38b605b3-718c-4fa5-be8f-0422de9fdd92 -p 172.16.0.220:3260 --logout {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 01:03:39 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 01:03:39 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38b605b3-718c-4fa5-be8f-0422de9fdd92 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 01:03:39 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[1389e47d-793e-47b8-9c09-19df5fc434b1]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:38b605b3-718c-4fa5-be8f-0422de9fdd92, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:38b605b3-718c-4fa5-be8f-0422de9fdd92, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 01:03:39 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-94abe4d5-701c-40a2-82e4-5eaa73549bc7 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:38b605b3-718c-4fa5-be8f-0422de9fdd92, portal: 172.16.0.220,3260]
Oct 26 01:03:39 user nova-compute[75165]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:38b605b3-718c-4fa5-be8f-0422de9fdd92, portal: 172.16.0.220,3260] successful.
Oct 26 01:03:39 user nova-compute[75165]:  stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 01:03:39 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38b605b3-718c-4fa5-be8f-0422de9fdd92 -p 172.16.0.220:3260 --op delete {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 01:03:39 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38b605b3-718c-4fa5-be8f-0422de9fdd92 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86976) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 01:03:39 user nova-compute[75165]: DEBUG oslo.privsep.daemon [-] privsep: reply[438845f2-2e6f-4313-9557-184a7b337aea]: (4, ('', '')) {{(pid=86976) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 01:03:39 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-94abe4d5-701c-40a2-82e4-5eaa73549bc7 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75165) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 01:03:39 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.base [None req-94abe4d5-701c-40a2-82e4-5eaa73549bc7 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.303s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 01:03:39 user nova-compute[75165]: DEBUG os_brick.initiator.connectors.iscsi [None req-94abe4d5-701c-40a2-82e4-5eaa73549bc7 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] <== disconnect_volume: return (305ms) None {{(pid=75165) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 01:03:39 user nova-compute[75165]: DEBUG nova.virt.libvirt.volume.iscsi [None req-94abe4d5-701c-40a2-82e4-5eaa73549bc7 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] [instance: 5dc4f5bd-aba6-476c-a924-503108815feb] Disconnected iSCSI Volume {{(pid=75165) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 01:03:40 user nova-compute[75165]: DEBUG nova.objects.instance [None req-94abe4d5-701c-40a2-82e4-5eaa73549bc7 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Lazy-loading 'flavor' on Instance uuid 5dc4f5bd-aba6-476c-a924-503108815feb {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 01:03:40 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-94abe4d5-701c-40a2-82e4-5eaa73549bc7 tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Lock "5dc4f5bd-aba6-476c-a924-503108815feb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.702s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 01:03:43 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 01:03:43 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75165) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 01:03:44 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 01:03:44 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 01:03:44 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75165) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 01:03:44 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75165) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 01:03:44 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75165) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 01:03:44 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 01:03:45 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 01:03:45 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 01:03:49 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 01:03:49 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 01:03:50 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 01:03:51 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 01:03:51 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 01:03:53 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 01:03:53 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 01:03:53 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 01:03:53 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 01:03:53 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75165) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 01:03:53 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dc4f5bd-aba6-476c-a924-503108815feb/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 01:03:54 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dc4f5bd-aba6-476c-a924-503108815feb/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 01:03:54 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dc4f5bd-aba6-476c-a924-503108815feb/disk --force-share --output=json {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 01:03:54 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 01:03:54 user nova-compute[75165]: DEBUG oslo_concurrency.processutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dc4f5bd-aba6-476c-a924-503108815feb/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75165) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 01:03:54 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 01:03:54 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 01:03:54 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Hypervisor/Node resource view: name=user free_ram=9049MB free_disk=24.692848205566406GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75165) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 01:03:54 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 01:03:54 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 01:03:54 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Instance 5dc4f5bd-aba6-476c-a924-503108815feb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75165) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 01:03:54 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75165) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 01:03:54 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75165) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 01:03:54 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Refreshing inventories for resource provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 26 01:03:54 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Updating ProviderTree inventory for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 26 01:03:54 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Updating inventory in ProviderTree for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 26 01:03:54 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Refreshing aggregate associations for resource provider 03214fd5-21d1-46ec-b6b0-6449b77ba230, aggregates: None {{(pid=75165) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 26 01:03:54 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Refreshing trait associations for resource provider 03214fd5-21d1-46ec-b6b0-6449b77ba230, traits: COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NODE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_EXTEND,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_USB,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_TRUSTED_CERTS,COMPUTE_DEVICE_TAGGING,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO {{(pid=75165) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 26 01:03:54 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 01:03:54 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 01:03:55 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Compute_service record updated for user:user {{(pid=75165) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 01:03:55 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.283s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 01:03:55 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 01:03:56 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 01:03:56 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Starting heal instance info cache {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 01:03:56 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Rebuilding the list of instances to heal {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 01:03:56 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "refresh_cache-5dc4f5bd-aba6-476c-a924-503108815feb" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 01:03:56 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquired lock "refresh_cache-5dc4f5bd-aba6-476c-a924-503108815feb" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 01:03:56 user nova-compute[75165]: DEBUG nova.network.neutron [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: 5dc4f5bd-aba6-476c-a924-503108815feb] Forcefully refreshing network info cache for instance {{(pid=75165) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 01:03:56 user nova-compute[75165]: DEBUG nova.objects.instance [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lazy-loading 'info_cache' on Instance uuid 5dc4f5bd-aba6-476c-a924-503108815feb {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 01:03:57 user nova-compute[75165]: DEBUG nova.network.neutron [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: 5dc4f5bd-aba6-476c-a924-503108815feb] Updating instance_info_cache with network_info: [{"id": "fcf41550-37ef-4e93-9a0c-3d427418d01b", "address": "fa:16:3e:fd:a5:fb", "network": {"id": "30343eb9-5e61-407a-8491-e58b28ff1645", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1025901471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f535693c3cbd4f4e969f279167ef7ba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcf41550-37", "ovs_interfaceid": "fcf41550-37ef-4e93-9a0c-3d427418d01b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 01:03:57 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Releasing lock "refresh_cache-5dc4f5bd-aba6-476c-a924-503108815feb" {{(pid=75165) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 01:03:57 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] [instance: 5dc4f5bd-aba6-476c-a924-503108815feb] Updated the network info_cache for instance {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 01:03:57 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 01:03:57 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 01:03:59 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 01:04:03 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 01:04:03 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75165) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 26 01:04:04 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 01:04:04 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 01:04:04 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75165) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 01:04:04 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75165) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 01:04:04 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75165) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 01:04:04 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 01:04:09 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 01:04:14 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 01:04:19 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-9e937827-cfb9-431b-af30-84286205659a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Acquiring lock "5dc4f5bd-aba6-476c-a924-503108815feb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 01:04:19 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-9e937827-cfb9-431b-af30-84286205659a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Lock "5dc4f5bd-aba6-476c-a924-503108815feb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 01:04:19 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-9e937827-cfb9-431b-af30-84286205659a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Acquiring lock "5dc4f5bd-aba6-476c-a924-503108815feb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 01:04:19 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-9e937827-cfb9-431b-af30-84286205659a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Lock "5dc4f5bd-aba6-476c-a924-503108815feb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 01:04:19 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-9e937827-cfb9-431b-af30-84286205659a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Lock "5dc4f5bd-aba6-476c-a924-503108815feb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 01:04:19 user nova-compute[75165]: INFO nova.compute.manager [None req-9e937827-cfb9-431b-af30-84286205659a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] [instance: 5dc4f5bd-aba6-476c-a924-503108815feb] Terminating instance
Oct 26 01:04:19 user nova-compute[75165]: DEBUG nova.compute.manager [None req-9e937827-cfb9-431b-af30-84286205659a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] [instance: 5dc4f5bd-aba6-476c-a924-503108815feb] Start destroying the instance on the hypervisor. {{(pid=75165) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 01:04:19 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 01:04:19 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 01:04:19 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 01:04:19 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 01:04:19 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 01:04:19 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 01:04:19 user nova-compute[75165]: DEBUG nova.compute.manager [req-c5b4eb85-f5c3-4dba-9211-d3e4303995f7 req-a6fe27ce-f0f6-4429-8516-85ed8d3f89bd service nova] [instance: 5dc4f5bd-aba6-476c-a924-503108815feb] Received event network-vif-unplugged-fcf41550-37ef-4e93-9a0c-3d427418d01b {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 01:04:19 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-c5b4eb85-f5c3-4dba-9211-d3e4303995f7 req-a6fe27ce-f0f6-4429-8516-85ed8d3f89bd service nova] Acquiring lock "5dc4f5bd-aba6-476c-a924-503108815feb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 01:04:19 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-c5b4eb85-f5c3-4dba-9211-d3e4303995f7 req-a6fe27ce-f0f6-4429-8516-85ed8d3f89bd service nova] Lock "5dc4f5bd-aba6-476c-a924-503108815feb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 01:04:19 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-c5b4eb85-f5c3-4dba-9211-d3e4303995f7 req-a6fe27ce-f0f6-4429-8516-85ed8d3f89bd service nova] Lock "5dc4f5bd-aba6-476c-a924-503108815feb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 01:04:19 user nova-compute[75165]: DEBUG nova.compute.manager [req-c5b4eb85-f5c3-4dba-9211-d3e4303995f7 req-a6fe27ce-f0f6-4429-8516-85ed8d3f89bd service nova] [instance: 5dc4f5bd-aba6-476c-a924-503108815feb] No waiting events found dispatching network-vif-unplugged-fcf41550-37ef-4e93-9a0c-3d427418d01b {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 01:04:19 user nova-compute[75165]: DEBUG nova.compute.manager [req-c5b4eb85-f5c3-4dba-9211-d3e4303995f7 req-a6fe27ce-f0f6-4429-8516-85ed8d3f89bd service nova] [instance: 5dc4f5bd-aba6-476c-a924-503108815feb] Received event network-vif-unplugged-fcf41550-37ef-4e93-9a0c-3d427418d01b for instance with task_state deleting. {{(pid=75165) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 01:04:19 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 01:04:19 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 01:04:19 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 01:04:19 user nova-compute[75165]: INFO nova.virt.libvirt.driver [-] [instance: 5dc4f5bd-aba6-476c-a924-503108815feb] Instance destroyed successfully.
Oct 26 01:04:19 user nova-compute[75165]: DEBUG nova.objects.instance [None req-9e937827-cfb9-431b-af30-84286205659a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Lazy-loading 'resources' on Instance uuid 5dc4f5bd-aba6-476c-a924-503108815feb {{(pid=75165) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 01:04:19 user nova-compute[75165]: DEBUG nova.virt.libvirt.vif [None req-9e937827-cfb9-431b-af30-84286205659a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T00:59:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1105020865',display_name='tempest-TestMinimumBasicScenario-server-1105020865',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1105020865',id=52,image_ref='9623dafc-f204-4cde-96bd-232b02083d9d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBERtRZmi/S9frXiSJg9mjeHHOicf9GeslXqW2YXjh+MQyatcH700wJi2yiU3TwBlIlfRrbf+gdugkGZVF5eaQO8HSXJ4K8e5z9EKrXZ9faikpml2/7wDMg3L0PXxGgS0Bg==',key_name='tempest-TestMinimumBasicScenario-1702867609',keypairs=<?>,launch_index=0,launched_at=2023-10-26T00:59:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f535693c3cbd4f4e969f279167ef7ba8',ramdisk_id='',reservation_id='r-qf9yiq2b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='9623dafc-f204-4cde-96bd-232b02083d9d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-387809061',owner_user_name='tempest-TestMinimumBasicScenario-387809061-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T01:01:33Z,user_data=None,user_id='d7f8020ca2184967b2a810b0e6c8d4a0',uuid=5dc4f5bd-aba6-476c-a924-503108815feb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fcf41550-37ef-4e93-9a0c-3d427418d01b", "address": "fa:16:3e:fd:a5:fb", "network": {"id": "30343eb9-5e61-407a-8491-e58b28ff1645", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1025901471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f535693c3cbd4f4e969f279167ef7ba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcf41550-37", "ovs_interfaceid": "fcf41550-37ef-4e93-9a0c-3d427418d01b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 01:04:19 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-9e937827-cfb9-431b-af30-84286205659a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Converting VIF {"id": "fcf41550-37ef-4e93-9a0c-3d427418d01b", "address": "fa:16:3e:fd:a5:fb", "network": {"id": "30343eb9-5e61-407a-8491-e58b28ff1645", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1025901471-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f535693c3cbd4f4e969f279167ef7ba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcf41550-37", "ovs_interfaceid": "fcf41550-37ef-4e93-9a0c-3d427418d01b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 01:04:19 user nova-compute[75165]: DEBUG nova.network.os_vif_util [None req-9e937827-cfb9-431b-af30-84286205659a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fd:a5:fb,bridge_name='br-int',has_traffic_filtering=True,id=fcf41550-37ef-4e93-9a0c-3d427418d01b,network=Network(30343eb9-5e61-407a-8491-e58b28ff1645),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcf41550-37') {{(pid=75165) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 01:04:19 user nova-compute[75165]: DEBUG os_vif [None req-9e937827-cfb9-431b-af30-84286205659a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fd:a5:fb,bridge_name='br-int',has_traffic_filtering=True,id=fcf41550-37ef-4e93-9a0c-3d427418d01b,network=Network(30343eb9-5e61-407a-8491-e58b28ff1645),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcf41550-37') {{(pid=75165) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 01:04:19 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 01:04:19 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfcf41550-37, bridge=br-int, if_exists=True) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 01:04:19 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 01:04:19 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 01:04:19 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 01:04:19 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=11d67a1a-1ea8-42f3-b219-3c2f9fef5f74) {{(pid=75165) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 01:04:19 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 01:04:19 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 01:04:19 user nova-compute[75165]: INFO os_vif [None req-9e937827-cfb9-431b-af30-84286205659a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fd:a5:fb,bridge_name='br-int',has_traffic_filtering=True,id=fcf41550-37ef-4e93-9a0c-3d427418d01b,network=Network(30343eb9-5e61-407a-8491-e58b28ff1645),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcf41550-37')
Oct 26 01:04:19 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-9e937827-cfb9-431b-af30-84286205659a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] [instance: 5dc4f5bd-aba6-476c-a924-503108815feb] Deleting instance files /opt/stack/data/nova/instances/5dc4f5bd-aba6-476c-a924-503108815feb_del
Oct 26 01:04:19 user nova-compute[75165]: INFO nova.virt.libvirt.driver [None req-9e937827-cfb9-431b-af30-84286205659a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] [instance: 5dc4f5bd-aba6-476c-a924-503108815feb] Deletion of /opt/stack/data/nova/instances/5dc4f5bd-aba6-476c-a924-503108815feb_del complete
Oct 26 01:04:19 user nova-compute[75165]: INFO nova.compute.manager [None req-9e937827-cfb9-431b-af30-84286205659a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] [instance: 5dc4f5bd-aba6-476c-a924-503108815feb] Took 0.88 seconds to destroy the instance on the hypervisor.
Oct 26 01:04:19 user nova-compute[75165]: DEBUG oslo.service.loopingcall [None req-9e937827-cfb9-431b-af30-84286205659a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75165) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 01:04:19 user nova-compute[75165]: DEBUG nova.compute.manager [-] [instance: 5dc4f5bd-aba6-476c-a924-503108815feb] Deallocating network for instance {{(pid=75165) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 01:04:19 user nova-compute[75165]: DEBUG nova.network.neutron [-] [instance: 5dc4f5bd-aba6-476c-a924-503108815feb] deallocate_for_instance() {{(pid=75165) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 01:04:20 user nova-compute[75165]: DEBUG nova.network.neutron [-] [instance: 5dc4f5bd-aba6-476c-a924-503108815feb] Updating instance_info_cache with network_info: [] {{(pid=75165) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 01:04:20 user nova-compute[75165]: INFO nova.compute.manager [-] [instance: 5dc4f5bd-aba6-476c-a924-503108815feb] Took 0.51 seconds to deallocate network for instance.
Oct 26 01:04:20 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-9e937827-cfb9-431b-af30-84286205659a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 01:04:20 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-9e937827-cfb9-431b-af30-84286205659a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 01:04:20 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-9e937827-cfb9-431b-af30-84286205659a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 01:04:20 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-9e937827-cfb9-431b-af30-84286205659a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 01:04:20 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-9e937827-cfb9-431b-af30-84286205659a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.116s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 01:04:20 user nova-compute[75165]: INFO nova.scheduler.client.report [None req-9e937827-cfb9-431b-af30-84286205659a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Deleted allocations for instance 5dc4f5bd-aba6-476c-a924-503108815feb
Oct 26 01:04:20 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-9e937827-cfb9-431b-af30-84286205659a tempest-TestMinimumBasicScenario-387809061 tempest-TestMinimumBasicScenario-387809061-project-member] Lock "5dc4f5bd-aba6-476c-a924-503108815feb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.695s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 01:04:21 user nova-compute[75165]: DEBUG nova.compute.manager [req-ca87a5e5-1bfb-455d-99d8-190439b1c454 req-bdb8ba39-d109-47aa-8af2-2ff87c4fed0b service nova] [instance: 5dc4f5bd-aba6-476c-a924-503108815feb] Received event network-vif-plugged-fcf41550-37ef-4e93-9a0c-3d427418d01b {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 01:04:21 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-ca87a5e5-1bfb-455d-99d8-190439b1c454 req-bdb8ba39-d109-47aa-8af2-2ff87c4fed0b service nova] Acquiring lock "5dc4f5bd-aba6-476c-a924-503108815feb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 01:04:21 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-ca87a5e5-1bfb-455d-99d8-190439b1c454 req-bdb8ba39-d109-47aa-8af2-2ff87c4fed0b service nova] Lock "5dc4f5bd-aba6-476c-a924-503108815feb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 01:04:21 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [req-ca87a5e5-1bfb-455d-99d8-190439b1c454 req-bdb8ba39-d109-47aa-8af2-2ff87c4fed0b service nova] Lock "5dc4f5bd-aba6-476c-a924-503108815feb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 01:04:21 user nova-compute[75165]: DEBUG nova.compute.manager [req-ca87a5e5-1bfb-455d-99d8-190439b1c454 req-bdb8ba39-d109-47aa-8af2-2ff87c4fed0b service nova] [instance: 5dc4f5bd-aba6-476c-a924-503108815feb] No waiting events found dispatching network-vif-plugged-fcf41550-37ef-4e93-9a0c-3d427418d01b {{(pid=75165) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 01:04:21 user nova-compute[75165]: WARNING nova.compute.manager [req-ca87a5e5-1bfb-455d-99d8-190439b1c454 req-bdb8ba39-d109-47aa-8af2-2ff87c4fed0b service nova] [instance: 5dc4f5bd-aba6-476c-a924-503108815feb] Received unexpected event network-vif-plugged-fcf41550-37ef-4e93-9a0c-3d427418d01b for instance with vm_state deleted and task_state None.
Oct 26 01:04:21 user nova-compute[75165]: DEBUG nova.compute.manager [req-ca87a5e5-1bfb-455d-99d8-190439b1c454 req-bdb8ba39-d109-47aa-8af2-2ff87c4fed0b service nova] [instance: 5dc4f5bd-aba6-476c-a924-503108815feb] Received event network-vif-deleted-fcf41550-37ef-4e93-9a0c-3d427418d01b {{(pid=75165) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 01:04:24 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 01:04:27 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 01:04:27 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Cleaning up deleted instances {{(pid=75165) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 26 01:04:27 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] There are 0 instances to clean {{(pid=75165) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 26 01:04:29 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 01:04:34 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 01:04:34 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 01:04:34 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75165) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 01:04:34 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75165) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 01:04:34 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75165) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 01:04:34 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 01:04:35 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 01:04:39 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 01:04:43 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 01:04:43 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75165) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 01:04:44 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 01:04:46 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 01:04:49 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 01:04:49 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 01:04:51 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 01:04:53 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 01:04:53 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 01:04:53 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 01:04:53 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 01:04:53 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Auditing locally available compute resources for user (node: user) {{(pid=75165) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 01:04:54 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 01:04:54 user nova-compute[75165]: WARNING nova.virt.libvirt.driver [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 01:04:54 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Hypervisor/Node resource view: name=user free_ram=9194MB free_disk=24.720169067382812GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}] {{(pid=75165) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 01:04:54 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 01:04:54 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 01:04:54 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75165) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 01:04:54 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75165) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 01:04:54 user nova-compute[75165]: DEBUG nova.compute.provider_tree [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Inventory has not changed in ProviderTree for provider: 03214fd5-21d1-46ec-b6b0-6449b77ba230 {{(pid=75165) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 01:04:54 user nova-compute[75165]: DEBUG nova.scheduler.client.report [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Inventory has not changed for provider 03214fd5-21d1-46ec-b6b0-6449b77ba230 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75165) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 01:04:54 user nova-compute[75165]: DEBUG nova.compute.resource_tracker [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Compute_service record updated for user:user {{(pid=75165) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 01:04:54 user nova-compute[75165]: DEBUG oslo_concurrency.lockutils [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.151s {{(pid=75165) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 01:04:54 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 01:04:54 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 01:04:54 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75165) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 01:04:54 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75165) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 01:04:54 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75165) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 01:04:54 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 01:04:56 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 01:04:57 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 01:04:57 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 01:04:57 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Starting heal instance info cache {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 01:04:57 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Rebuilding the list of instances to heal {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 01:04:57 user nova-compute[75165]: DEBUG nova.compute.manager [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Didn't find any instances for network info cache update. {{(pid=75165) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 26 01:04:58 user nova-compute[75165]: DEBUG oslo_service.periodic_task [None req-29d0ed60-c7ca-4344-bb9d-387d7a0971c5 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75165) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 01:04:59 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 01:05:04 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 01:05:09 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 01:05:09 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 01:05:09 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75165) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 01:05:09 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75165) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 01:05:09 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75165) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 01:05:09 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 01:05:10 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 01:05:12 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 01:05:14 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 01:05:14 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 01:05:19 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 01:05:19 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 01:05:19 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75165) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 01:05:19 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75165) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 01:05:19 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75165) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 01:05:19 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 01:05:24 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 01:05:29 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 01:05:34 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 01:05:34 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 01:05:34 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75165) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 01:05:34 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75165) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 01:05:34 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75165) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 01:05:34 user nova-compute[75165]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75165) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}